You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 20:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sun Jan 11, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18704391260,0EcMasterDemoSyn0-21swapper/307:48:473
997839930,0EcMasterDemoSyn998829tAtEmLog_008:39:305
2341539920,0EcMasterDemoSyn2342529tAtEmLog_007:58:565
707239830,0EcMasterDemoSyn708229tAtEmLog_011:21:465
2105839830,0EcMasterDemoSyn2106829tAtEmLog_007:53:525
1552239830,0EcMasterDemoSyn1553229tAtEmLog_012:02:205
671539820,0EcMasterDemoSyn672529tAtEmLog_007:23:255
46839820,0EcMasterDemoSyn47829tAtEmLog_008:19:135
299239820,0EcMasterDemoSyn300229tAtEmLog_010:25:595
2180939820,0EcMasterDemoSyn2181929tAtEmLog_009:04:505
2009139820,0EcMasterDemoSyn2010129tAtEmLog_009:25:075
370339810,0EcMasterDemoSyn371329tAtEmLog_012:32:465
3105239810,0EcMasterDemoSyn3106229tAtEmLog_010:05:425
205139810,0EcMasterDemoSyn206129tAtEmLog_011:36:595
1236039810,0EcMasterDemoSyn1237029tAtEmLog_008:44:345
1206039690,0EcMasterDemoSyn1207029tAtEmLog_011:11:375
1257839450,0EcMasterDemoSyn12583-21runintdemo5min09:55:340
205102200,0sleep10-21swapper/109:42:321
115832200,0sleep50-21swapper/509:55:205
3032439190,0EcMasterDemoSyn30332-21runintdemo5min11:16:423
3194799180,10cyclictest28114-21ssh11:51:171
3194399185,9cyclictest31662-21sh10:41:450
264772180,0sleep00-21swapper/008:05:120
136099180,7tDemoTimingTask5493-21chrt12:15:095
31951991710,6cyclictest12955-21sed11:25:162
31951991710,2cyclictest171rcu_preempt09:40:192
3194799175,9cyclictest3281-21systemctl11:55:211
3194399176,6cyclictest4073-21ssh12:33:000
3194399174,6cyclictest327-21systemd-journal09:45:550
3194399170,9cyclictest816-21sh09:14:540
3194399170,9cyclictest4476-21proc_pri11:20:190
3194399170,9cyclictest14086-21sh11:44:060
3194399170,9cyclictest14014-21runrttasks07:38:460
3194399170,14cyclictest7047-21sh12:16:150
3194399170,13cyclictest27076-21runintdemo5min12:27:410
3194399170,13cyclictest10479-21sh12:36:110
136099170,7tDemoTimingTask3597-21chrt12:14:035
1085499170,10tDemoTimingTask19531-21taskset09:24:575
98099160,9tDemoTimingTask1011-21chrt09:15:005
3195999168,6cyclictest16099-21cut08:50:184
3195999168,6cyclictest16099-21cut08:50:174
3195999164,9cyclictest327-21systemd-journal07:35:004
31959991612,3cyclictest12378-21sendmail12:20:004
3195499160,9cyclictest32626-21ssh10:25:103
3195199164,6cyclictest6140-21idleruntime10:10:162
3195199160,9cyclictest25469-21sh12:26:332
3195199160,10cyclictest31906-21/usr/sbin/munin11:00:252
3194799164,8cyclictest12847-21aten2_r5power_v08:45:121
3194799160,9cyclictest9408-21sh09:36:091
3194799160,9cyclictest16-1pr/legacy07:23:251
3194399168,6cyclictest17760-21grep07:45:180
3194399160,9cyclictest831-21runrttasks11:35:000
3194399160,7cyclictest1261-21ssh10:07:320
3194399160,13cyclictest831-21runrttasks08:37:180
3194399160,13cyclictest19625-21aten2_r5power_v10:00:110
3194399160,12cyclictest6414-21vmstat10:45:270
3194399160,10cyclictest12109-21awk12:00:200
2707299164,5tDemoTimingTask27101-21taskset12:27:425
198499160,9tDemoTimingTask2135-21chrt07:14:565
1797429160,9tAtEmLog_018079-21taskset12:22:405
1397799160,6tDemoTimingTask16153-21chrt07:41:135
3195999154,8cyclictest807-21postgres11:39:504
3195999154,8cyclictest3294-21cat07:15:204
31959991511,3cyclictest5046-21cpuspeed_turbos07:20:124
3195999150,9cyclictest30727-21sh10:05:284
3195499158,6cyclictest19014-21tail10:35:153
3195499151,11cyclictest19989-21sh11:46:573
3195499151,10cyclictest6736-21cstates09:35:133
3195499151,10cyclictest20758-21runrttasks12:24:363
3195499151,10cyclictest1433-21ssh09:50:113
3195499150,9cyclictest30881-21/usr/sbin/munin12:30:173
3195499150,9cyclictest17239-21ssh11:27:323
3195499150,9cyclictest17070-21ssh10:34:283
3195499150,9cyclictest14803-21ssh09:21:393
3195499150,11cyclictest16-1pr/legacy08:49:373
3195199153,9cyclictest12161-21timerandwakeup09:55:262
3195199153,7cyclictest18633-21ssh12:04:312
3195199151,9cyclictest41-21ksoftirqd/211:45:012
3195199151,11cyclictest16-1pr/legacy12:12:272
3195199151,10cyclictest12846-21/usr/sbin/munin12:20:152
3195199150,9cyclictest6463-21sh11:57:172
3195199150,9cyclictest14177-21ssh10:15:002
3195199150,11cyclictest19809-21hddtemp_smartct07:50:152
3195199150,10cyclictest4589-21sh11:38:462
3194799152,9cyclictest21730-21sh12:25:041
31947991512,2cyclictest20252-21runintdemo5min11:47:071
3194799151,11cyclictest16-1pr/legacy10:36:071
3194799151,10cyclictest831-21runrttasks10:11:281
3194799151,10cyclictest1143-21runrttasks07:10:221
3194799151,10cyclictest10755-21cat09:20:011
3194799151,10cyclictest10013-21runrttasks12:18:201
3194799150,9cyclictest18487-21latency11:10:171
3194799150,10cyclictest831-21runrttasks07:35:171
3194799150,10cyclictest31017-21/usr/sbin/munin08:15:131
3194799150,10cyclictest11648-21ssh11:06:161
3194399156,7cyclictest27742-21sh12:09:340
3194399156,7cyclictest15186-21sh12:20:380
3194399154,6cyclictest6802-21sh09:52:510
31943991511,3cyclictest3004-21cron08:25:000
3194399150,9cyclictest7134-21sh11:57:450
3194399150,8cyclictest831-21runrttasks07:57:570
3194399150,7cyclictest1597-21sh12:12:380
3194399150,6cyclictest831-21runrttasks08:18:310
3194399150,13cyclictest611-21cut11:00:190
2025829150,8tAtEmLog_020787-21taskset11:47:285
1397629150,9tAtEmLog_011598-21sleep07:39:555
1217539150,3EcMasterDemoSyn651irq_work/510:31:045
3195999145,7cyclictest17669-21sed11:45:234
3195999145,7cyclictest1295-21cat10:25:194
3195999141,9cyclictest20777-21fschecks_time09:25:124
31959991411,2cyclictest0-21swapper/410:15:514
3195999141,10cyclictest16-1pr/legacy09:35:154
31959991410,3cyclictest28149-21grep10:40:134
3195999140,9cyclictest21716-21sh11:11:594
3195999140,5cyclictest10912-21cat07:30:234
3195999140,10cyclictest4914-21sh11:56:134
3195999140,10cyclictest3493-21ssh09:33:364
3195999140,10cyclictest3071-21sh12:13:404
3195999140,10cyclictest29004-21ssh09:47:054
3195999140,10cyclictest2527-21sh11:19:564
3195999140,10cyclictest24235-21ssh12:25:434
3195999140,10cyclictest24065-21sh10:38:024
3195999140,10cyclictest24013-21ssh12:06:584
3195999140,10cyclictest21423-21grep09:00:254
3195999140,10cyclictest20118-21taskset11:29:374
3195999140,10cyclictest15020-21ssh11:08:374
3195499143,8cyclictest760-21lldpd10:10:483
3195499143,8cyclictest744-21snmpd10:20:333
3195499141,9cyclictest4580-21runrttasks11:02:373
3195499141,9cyclictest20998-21sh11:30:013
3195499141,9cyclictest1618-21sh11:55:013
3195499141,9cyclictest14439-21runrttasks07:40:093
3195499141,10cyclictest20155-21runrttasks11:10:553
3195499141,10cyclictest11583-21runrttasks09:55:203
3195499140,9cyclictest30294-21sh10:59:303
3195499140,9cyclictest30294-21sh10:59:303
3195499140,12cyclictest24022-21sh10:02:113
3195499140,10cyclictest951-21/usr/sbin/munin08:20:153
3195499140,10cyclictest9378-21irqstats11:05:173
3195499140,10cyclictest8326-21irqstats12:35:173
3195499140,10cyclictest831-21runrttasks11:35:233
3195499140,10cyclictest831-21runrttasks08:44:233
3195499140,10cyclictest8127-21sh10:46:373
3195499140,10cyclictest5074-21sh11:20:243
3195499140,10cyclictest31324-21sh12:10:453
3195499140,10cyclictest30244-21unixbench_singl08:10:233
3195499140,10cyclictest28999-21ssh10:40:183
3195499140,10cyclictest28646-21/usr/sbin/munin10:05:193
3195499140,10cyclictest26440-21awk08:05:133
3195499140,10cyclictest24605-21/usr/sbin/munin09:45:213
3195499140,10cyclictest24599-21ssh09:10:033
3195499140,10cyclictest24238-21sh12:25:433
3195499140,10cyclictest23868-21/usr/sbin/munin08:00:223
3195499140,10cyclictest20217-21aten2_r5power_e09:25:103
3195499140,10cyclictest19665-21ssh12:05:033
3195499140,10cyclictest1782-21sh09:32:243
3195499140,10cyclictest16620-21ssh10:15:353
3195499140,10cyclictest15936-21ssh10:50:483
3195499140,10cyclictest15936-21ssh10:50:483
3195499140,10cyclictest15475-21/usr/sbin/munin09:40:193
3195499140,10cyclictest13551-21runrttasks07:35:323
3195499140,10cyclictest12693-21unixbench-2d12:00:253
3195499140,10cyclictest12643-21sh11:43:043
3195199147,2cyclictest171rcu_preempt10:31:402
3195199144,5cyclictest28066-21ssh09:11:172
3195199142,9cyclictest28305-21sh09:46:352
3195199141,9cyclictest9591-21runrttasks12:35:342
3195199141,9cyclictest4146-21runrttasks07:15:562
3195199141,9cyclictest41-21ksoftirqd/210:05:062
3195199141,8cyclictest41-21ksoftirqd/210:20:042
31951991411,2cyclictest24889-21/usr/sbin/munin11:50:192
3195199141,10cyclictest831-21runrttasks12:30:052
3195199141,10cyclictest6793-21sh11:40:072
3195199141,10cyclictest5372-21sh10:27:382
31951991410,3cyclictest717-21in:imuxsock08:59:592
3195199140,9cyclictest6310-21ssh09:35:092
3195199140,9cyclictest41-21ksoftirqd/212:17:592
3195199140,11cyclictest23911-21ssh11:13:332
3195199140,10cyclictest9566-21unixbench_multi08:35:252
3195199140,10cyclictest9534-21/usr/sbin/munin07:30:152
3195199140,10cyclictest9155-21chrt07:29:072
3195199140,10cyclictest831-21runrttasks11:16:352
3195199140,10cyclictest831-21runrttasks08:14:112
3195199140,10cyclictest831-21runrttasks07:23:192
3195199140,10cyclictest5665-21/usr/sbin/munin08:30:172
3195199140,10cyclictest5367-21ssh11:20:332
3195199140,10cyclictest4484-21aten2_r5power_c10:45:132
3195199140,10cyclictest397-21df07:10:172
3195199140,10cyclictest3816-21sh09:50:452
3195199140,10cyclictest31967-21sh09:30:512
3195199140,10cyclictest30979-21/usr/sbin/munin08:15:142
3195199140,10cyclictest27779-21/usr/sbin/munin10:40:142
3195199140,10cyclictest26295-21ssh09:28:162
3195199140,10cyclictest25698-21runrttasks08:02:042
3195199140,10cyclictest25637-21ssh10:56:132
3195199140,10cyclictest25637-21ssh10:56:132
3195199140,10cyclictest24507-21ssh11:31:212
3195199140,10cyclictest22564-21ssh12:05:572
3195199140,10cyclictest22170-21/usr/sbin/munin09:05:132
3195199140,10cyclictest1965-21wget09:15:132
3195199140,10cyclictest19274-21ssh10:00:012
3195199140,10cyclictest19106-21ssh10:35:152
3195199140,10cyclictest15751-21switchtime07:40:232
3195199140,10cyclictest13424-21sh10:50:102
3195199140,10cyclictest13424-21sh10:50:092
3195199140,10cyclictest11068-21/usr/sbin/munin09:20:262
3195199140,10cyclictest10779-21ssh11:05:392
3194799146,6cyclictest3925-21tail08:25:171
3194799145,7cyclictest29657-21tail10:40:231
3194799141,9cyclictest9820-21runrttasks08:37:301
3194799141,9cyclictest7887-21sh11:22:191
3194799141,9cyclictest30056-21sh10:05:201
3194799141,11cyclictest16-1pr/legacy08:09:021
3194799140,9cyclictest9651-21rm12:35:361
3194799140,9cyclictest19753-21gltestperf07:50:141
3194799140,7cyclictest3871-21ssh11:02:071
3194799140,10cyclictest831-21runrttasks08:56:421
3194799140,10cyclictest7275-21/usr/sbin/munin07:25:121
3194799140,10cyclictest6883-21/usr/sbin/munin11:40:171
3194799140,10cyclictest5828-21grep08:30:131
3194799140,10cyclictest4222-21ssh10:45:021
3194799140,10cyclictest32659-21/usr/sbin/munin10:25:181
3194799140,10cyclictest3223-21sh11:37:481
3194799140,10cyclictest31931-21ssh09:30:501
3194799140,10cyclictest30256-21ssh10:59:291
3194799140,10cyclictest30256-21ssh10:59:291
3194799140,10cyclictest28975-21chrt12:10:101
3194799140,10cyclictest28535-21latency_hist12:10:001
3194799140,10cyclictest28238-21ssh10:22:181
3194799140,10cyclictest27295-21sh09:10:461
3194799140,10cyclictest26794-21sh11:15:131
3194799140,10cyclictest2462-21atemtest07:15:151
3194799140,10cyclictest24615-21apt-get09:45:121
3194799140,10cyclictest23868-21/usr/sbin/munin08:00:221
3194799140,10cyclictest23517-21sh11:30:391
3194799140,10cyclictest22590-21ssh09:25:431
3194799140,10cyclictest21867-21forks07:55:151
3194799140,10cyclictest21483-21latency_hist12:25:001
3194799140,10cyclictest21015-21python310:00:211
3194799140,10cyclictest20694-21latency_hist11:30:011
3194799140,10cyclictest19821-21/usr/sbin/munin09:00:231
3194799140,10cyclictest18538-21taskset07:46:401
3194799140,10cyclictest17346-21ssh10:16:031
3194799140,10cyclictest16261-21taskset07:42:411
3194799140,10cyclictest15096-21/usr/sbin/munin08:50:251
3194799140,10cyclictest15096-21/usr/sbin/munin08:50:251
3194799140,10cyclictest14763-21ssh10:32:521
3194799140,10cyclictest1313-21ssh12:31:031
3194799140,10cyclictest11105-21ssh09:55:171
3194399147,5cyclictest16730-21ps10:51:210
3194399147,5cyclictest16730-21ps10:51:210
3194399146,6cyclictest31707-21plymouth11:35:200
3194399145,7cyclictest26312-21runintdemo5min10:20:570
3194399145,7cyclictest24230-21turbostat09:10:000
3194399145,7cyclictest15218-21ssh10:33:110
3194399144,8cyclictest17075-21/usr/sbin/munin11:45:170
3194399141,9cyclictest8456-21diskmemload10:11:120
3194399141,9cyclictest14412-21diskmemload10:15:110
3194399140,7cyclictest9581-21ls11:05:190
3194399140,7cyclictest28215-21ssh10:58:010
3194399140,7cyclictest28215-21ssh10:58:000
3194399140,7cyclictest28020-21ssh11:15:220
3194399140,7cyclictest18494-21aten2_r5power_v10:35:120
3194399140,11cyclictest6625-21sh09:17:210
3194399140,10cyclictest9704-21diskmemload09:36:220
3194399140,10cyclictest831-21runrttasks07:23:030
3194399140,10cyclictest802-21sh09:31:450
3194399140,10cyclictest30133-21sh11:52:410
3194399140,10cyclictest26224-21latency_hist08:05:000
3194399140,10cyclictest25480-21sh09:27:420
3194399140,10cyclictest20152-21sh11:10:550
3194399140,10cyclictest175-1kworker/0:1H+kblockd08:49:450
3194399140,10cyclictest17422-21sh11:27:420
3194399140,10cyclictest13189-21sh09:20:300
3194399140,10cyclictest10496-21aten2_r5power_v08:40:120
3194399140,10cyclictest10168-21tail07:30:160
2936399140,11tDemoTimingTask31514-21chrt07:05:425
527399130,11tDemoTimingTask7519-21chrt08:33:115
371329130,2tAtEmLog_0107982sleep512:36:275
3195999135,7cyclictest4184-21/usr/sbin/munin08:25:194
3195999132,8cyclictest2230-21switchtime08:20:264
3195999131,9cyclictest3880-21runrttasks11:20:144
3195999131,9cyclictest26383-21sh10:03:484
3195999131,9cyclictest12569-21ssh09:20:234
3195999130,9cyclictest831-21runrttasks08:36:524
3195999130,9cyclictest831-21runrttasks08:06:534
3195999130,9cyclictest744-21snmpd09:15:174
3195999130,9cyclictest7407-21sh12:35:104
3195999130,9cyclictest7182-21/usr/sbin/munin07:25:154
3195999130,9cyclictest6866-21ssh11:40:094
3195999130,9cyclictest4447-21/usr/sbin/munin10:45:164
3195999130,9cyclictest31880-21memory12:30:174
3195999130,9cyclictest27196-21ssh11:50:374
3195999130,9cyclictest25658-21rm10:20:314
3195999130,9cyclictest23529-21timerandwakeup09:05:244
3195999130,9cyclictest21495-21/usr/sbin/munin07:55:194
3195999130,9cyclictest19145-21/usr/sbin/munin07:50:124
3195999130,9cyclictest18580-21runrttasks07:47:134
3195999130,9cyclictest13775-21cpuspeed_turbos10:50:144
3195999130,9cyclictest13775-21cpuspeed_turbos10:50:144
3195999130,9cyclictest1326-21/usr/sbin/munin09:50:164
3195999130,9cyclictest12743-21/usr/sbin/munin08:45:234
3195999130,9cyclictest10410-21ssh09:55:114
3195999130,8cyclictest287-21jbd2/md0-809:40:144
3195999130,8cyclictest13126-21grep12:20:094
3195999130,10cyclictest5665-21/usr/sbin/munin08:30:134
3195999130,10cyclictest5523-21cpu10:10:124
3195999130,10cyclictest31802-21ssh11:00:064
3195999130,10cyclictest22683-21ssh11:30:204
3195999130,10cyclictest22354-21rm10:55:054
3195999130,10cyclictest22354-21rm10:55:054
3195999130,10cyclictest15020-21sh12:01:594
3195999130,10cyclictest14447-21taskset07:40:124
3195999130,10cyclictest12085-21ssh10:31:014
3195999130,10cyclictest1170-21grep07:10:244
3195999130,10cyclictest10390-21/usr/sbin/munin08:40:174
3195499138,3cyclictest7416-21tr07:25:143
3195499135,7cyclictest8019-21/usr/sbin/munin08:35:113
3195499133,7cyclictest744-21snmpd12:15:063
3195499131,7cyclictest32632-21/usr/sbin/munin07:10:173
3195499130,9cyclictest5835-21sort08:30:133
3195499130,9cyclictest4834-21apt-get07:20:113
3195499130,9cyclictest31041-21aten2_r5power_e08:15:133
3195499130,9cyclictest2713-21tr07:15:153
3195499130,9cyclictest22927-21/usr/sbin/munin09:05:173
3195499130,9cyclictest19821-21/usr/sbin/munin09:00:173
3195499130,9cyclictest19145-21/usr/sbin/munin07:50:203
3195499130,9cyclictest17485-21/usr/sbin/munin08:55:123
3195499130,9cyclictest1535-21ssh09:15:013
3195499130,9cyclictest15096-21/usr/sbin/munin08:50:113
3195499130,9cyclictest15096-21/usr/sbin/munin08:50:103
3195499130,9cyclictest10243-21if_enp5s007:30:163
3195499130,10cyclictest5175-21runrttasks08:28:193
3195499130,10cyclictest24889-21/usr/sbin/munin11:50:123
3195199136,3cyclictest13713-21grep08:45:182
3195199132,6cyclictest12015-21cpu07:35:182
3195199131,6cyclictest41-21ksoftirqd/208:50:152
3195199131,6cyclictest41-21ksoftirqd/208:50:152
3195199130,9cyclictest3480-21sort08:25:152
3195199130,9cyclictest23191-21runrttasks07:55:582
3195199130,9cyclictest1859-21missed_timers08:20:192
3195199130,9cyclictest10390-21/usr/sbin/munin08:40:142
3195199130,8cyclictest20494-21smartctl09:00:162
3195199130,10cyclictest26850-21chrt08:05:142
3194799135,6cyclictest11017-21sed08:40:151
3194799130,9cyclictest951-21/usr/sbin/munin08:20:211
3194799130,9cyclictest32254-21wc07:10:011
3194799130,9cyclictest29617-21tail08:10:181
3194799130,9cyclictest22170-21/usr/sbin/munin09:05:171
3194799130,9cyclictest15916-21ssh10:50:471
3194799130,9cyclictest15916-21ssh10:50:471
3194799130,9cyclictest1326-21/usr/sbin/munin09:50:121
3194799130,9cyclictest11544-21fschecks_time12:00:161
3194799130,9cyclictest10107-21fschecks_time07:30:151
3194799130,10cyclictest11986-21uname09:20:171
3194399135,6cyclictest7544-21diskstats07:25:140
3194399130,9cyclictest831-21runrttasks08:25:100
3194399130,9cyclictest831-21runrttasks07:12:470
3194399130,9cyclictest32402-21sh10:25:010
3194399130,9cyclictest29534-21missed_timers08:10:170
3194399130,9cyclictest20946-21processes09:00:200
3194399130,9cyclictest19346-21cpuspeed07:50:120
3194399130,7cyclictest831-21runrttasks07:42:550
3194399130,7cyclictest6027-21/usr/sbin/munin08:30:130
3194399130,7cyclictest175-1kworker/0:1H+kblockd07:15:070
3194399130,10cyclictest15411-21ssh09:40:080
3194399130,10cyclictest15218-21grep08:50:130
3194399130,10cyclictest15218-21grep08:50:130
1708499130,11tDemoTimingTask19204-21chrt08:56:515
1635729130,11tAtEmLog_018477-21chrt07:45:495
526239120,0EcMasterDemoSyn0-21swapper/508:29:205
3195999120,9cyclictest32110-21/usr/sbin/munin08:15:214
3195999120,9cyclictest28625-21/usr/sbin/munin08:10:114
3195999120,9cyclictest24659-21sh09:10:064
3195999120,9cyclictest17610-21cpu08:55:134
3195999120,8cyclictest24281-21fschecks_count08:00:154
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional