You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 12:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Tue Apr 07, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1102539950,0EcMasterDemoSyn1103229tAtEmLog_019:33:595
1637639930,0EcMasterDemoSyn1638629tAtEmLog_022:51:465
2587439860,0EcMasterDemoSyn2588029tAtEmLog_021:10:215
231539830,0EcMasterDemoSyn232529tAtEmLog_020:24:425
2992439820,0EcMasterDemoSyn2993429tAtEmLog_020:14:325
2618739820,0EcMasterDemoSyn2619729tAtEmLog_021:45:515
2618739820,0EcMasterDemoSyn2619729tAtEmLog_021:45:515
2388939820,0EcMasterDemoSyn2389929tAtEmLog_000:07:515
237539820,0EcMasterDemoSyn238529tAtEmLog_022:26:255
2047639820,0EcMasterDemoSyn2048629tAtEmLog_019:54:165
2046239820,0EcMasterDemoSyn2047229tAtEmLog_023:12:035
1338139820,0EcMasterDemoSyn1339129tAtEmLog_019:39:035
1177439820,0EcMasterDemoSyn1178429tAtEmLog_020:44:595
2853539810,0EcMasterDemoSyn2854529tAtEmLog_023:52:385
2853539810,0EcMasterDemoSyn2854529tAtEmLog_023:52:375
2455039810,0EcMasterDemoSyn2456029tAtEmLog_023:32:215
1228239810,0EcMasterDemoSyn1229229tAtEmLog_021:20:295
196922710,2sleep50-21swapper/521:00:145
305139660,0EcMasterDemoSyn0-21swapper/421:50:554
31799994643,2cyclictest23050irq/32-nvkm19:39:040
130239450,1EcMasterDemoSyn1311-21runintdemo5min23:37:243
293852370,0sleep00-21swapper/000:28:590
2541039270,0EcMasterDemoSyn0-21swapper/522:56:505
3179999200,9cyclictest2949-21sh00:14:340
3180899191,13cyclictest16-1pr/legacy21:00:102
3179999191,13cyclictest2879-21idleruntime-cro22:45:000
181012190,5sleep215760-21tail19:49:112
31813991815,2cyclictest21878-21turbostat00:29:553
31808991811,5cyclictest21768-21cron22:20:002
3179999180,14cyclictest11231-21sh23:06:540
3179999180,10cyclictest22855-21sh21:26:310
3181499179,6cyclictest10957-21tr21:20:174
3181499171,12cyclictest16-1pr/legacy23:22:104
3180499179,6cyclictest7846-21grep23:05:151
3180499176,6cyclictest21276-21latency_hist22:55:001
3179999174,11cyclictest18503-21grep22:35:190
3179999170,9cyclictest9309-21sh23:24:150
3179999170,9cyclictest4191-21taskset22:10:090
3179999170,9cyclictest2776-21ssh21:50:440
3179999170,9cyclictest22323-21sh23:30:450
3179999170,9cyclictest14418-21ssh21:21:590
1908229170,7tAtEmLog_020233-21chrt00:23:505
1443629170,10tAtEmLog_016462-21chrt20:54:545
1182329170,10tAtEmLog_011853-21chrt22:31:305
940699160,9tDemoTimingTask9438-21chrt20:39:585
3181499161,9cyclictest16-1pr/legacy23:37:234
3181499161,12cyclictest16-1pr/legacy19:18:464
3181499160,9cyclictest26750-21sh23:33:524
31813991612,3cyclictest32766-21aten2_r5power_c20:20:133
3180899161,9cyclictest24424-21runrttasks00:25:282
3180899160,9cyclictest286-21jbd2/md0-820:12:052
3180499169,5cyclictest25436-21grep21:10:171
3180499160,10cyclictest15649-21ssh00:20:361
3180499160,10cyclictest11115-21sh00:18:581
3179999160,8cyclictest5526-21sh22:28:370
3179999160,13cyclictest29567-21sh22:59:460
2522129160,7tAtEmLog_027310-21taskset20:06:105
1668629160,12tAtEmLog_0216842sleep521:44:175
3181499159,3cyclictest2560039EcMasterDemoSyn22:21:214
3181499153,8cyclictest755-21postgres19:44:154
3181499153,8cyclictest755-21postgres19:44:154
3181499151,10cyclictest14214-21sh21:40:124
3181499150,9cyclictest28826-21diskmemload23:16:364
3181499150,9cyclictest17868-21chrt19:45:594
3181399151,11cyclictest16-1pr/legacy22:06:073
3181399151,10cyclictest23357-21ssh21:45:023
3181399151,10cyclictest23357-21ssh21:45:013
3181399151,10cyclictest10765-21runrttasks19:30:343
3181399150,9cyclictest1920-21sh00:13:503
3181399150,10cyclictest28728-21ssh21:30:123
3180899151,10cyclictest29669-21runrttasks22:24:112
3180899150,11cyclictest4864-21ssh23:57:112
3180899150,11cyclictest18033-21unixbench_singl23:10:232
3180899150,11cyclictest12065-21runrttasks00:36:572
3180499159,5cyclictest18287-21wc22:35:171
3180499151,7cyclictest10882-21processes00:00:201
31804991511,3cyclictest31160-21gltestperf23:00:151
31804991511,3cyclictest2384-21cron20:25:001
3180499151,11cyclictest16-1pr/legacy22:41:361
3180499151,10cyclictest25011-21rm22:56:331
3180499150,9cyclictest20115-21cpu23:30:131
3180499150,11cyclictest1433-21ssh22:25:441
3179999157,6cyclictest4073-21turbostat.cron19:20:000
3179999156,7cyclictest22230-21ssh00:06:390
3179999154,8cyclictest9682-21cpuspeed_turbos21:55:130
3179999154,8cyclictest755-21postgres19:29:140
3179999154,8cyclictest26194-21timerwakeupswit21:10:230
3179999153,9cyclictest780-21runrttasks20:41:320
3179999150,8cyclictest780-21runrttasks19:42:470
3179999150,8cyclictest780-21runrttasks19:42:460
3179999150,7cyclictest23851-21cron21:10:000
3179999150,6cyclictest174-1kworker/0:1H+kblockd00:15:020
3179999150,11cyclictest13808-21ssh22:32:530
2993599151,11tDemoTimingTask32239-21chrt20:18:185
2813329150,6tAtEmLog_02093-21taskset00:31:175
2521139150,0EcMasterDemoSyn671rcuc/520:04:255
730539140,2EcMasterDemoSyn651irq_work/522:11:125
479799144,8tDemoTimingTask11681-21chrt00:36:415
3181499143,8cyclictest22663-21latency21:05:184
3181499141,9cyclictest326-21systemd-journal19:54:124
3181499141,9cyclictest30983-21diskmemload23:54:194
3181499141,9cyclictest30983-21diskmemload23:54:194
3181499141,9cyclictest29585-21sh22:41:044
3181499141,9cyclictest22273-21diskmemload00:25:064
3181499141,9cyclictest11533-21runrttasks20:41:514
3181499141,10cyclictest16-1pr/legacy23:12:024
3181499140,9cyclictest30303-21/usr/sbin/munin20:15:114
3181499140,10cyclictest9577-21chrt23:41:544
3181499140,10cyclictest8983-21grep22:30:154
3181499140,10cyclictest8912-21ssh21:19:314
3181499140,10cyclictest4280-21ssh23:03:204
3181499140,10cyclictest371-21ssh21:14:574
3181499140,10cyclictest31384-21sh21:49:254
3181499140,10cyclictest31384-21sh21:49:254
3181499140,10cyclictest30716-21sh00:11:184
3181499140,10cyclictest30024-21ssh22:05:484
3181499140,10cyclictest2614-21ssh00:31:384
3181499140,10cyclictest22071-21ssh22:37:194
3181499140,10cyclictest21939-21awk19:55:174
3181499140,10cyclictest20263-21sh22:54:294
3181499140,10cyclictest18952-21taskset00:22:574
3181499140,10cyclictest16383-21rm22:16:144
3181499140,10cyclictest13205-21ssh00:01:394
3181499140,10cyclictest12868-21sh23:08:034
3181499140,10cyclictest10183-21sh21:37:364
3181399143,8cyclictest1284-21if_err_enp6s023:55:163
3181399141,9cyclictest6314-21diskmemload22:46:043
3181399141,9cyclictest18539-21/usr/sbin/munin22:00:133
3181399141,9cyclictest16-1pr/legacy19:54:153
3181399141,10cyclictest7553-21latency_hist22:30:003
3181399141,10cyclictest29758-21runrttasks20:12:243
3181399141,10cyclictest21978-21fschecks_time22:55:153
3181399141,10cyclictest19761-21diskmemload22:35:443
3181399141,10cyclictest16478-21latency_hist20:55:003
3181399141,10cyclictest16-1pr/legacy20:09:273
3181399141,10cyclictest16-1pr/legacy20:04:243
3181399140,9cyclictest9105-21latency_hist21:55:003
3181399140,9cyclictest16784-21ssh22:34:583
3181399140,9cyclictest11448-21/usr/sbin/munin19:35:133
3181399140,10cyclictest9438-21/usr/sbin/munin21:55:173
3181399140,10cyclictest9432-21ssh22:12:403
3181399140,10cyclictest8663-21ssh23:05:213
3181399140,10cyclictest8249-21sh23:40:573
3181399140,10cyclictest823-21rm00:30:233
3181399140,10cyclictest780-21runrttasks21:16:193
3181399140,10cyclictest7696-21ssh00:35:033
3181399140,10cyclictest6864-21chrt20:32:373
3181399140,10cyclictest4929-21rm21:35:053
3181399140,10cyclictest3718-21ssh23:02:563
3181399140,10cyclictest31423-21ssh23:54:363
3181399140,10cyclictest31423-21ssh23:54:363
3181399140,10cyclictest22481-21rm23:30:523
3181399140,10cyclictest19189-21gltestperf00:05:153
3181399140,10cyclictest1872-21sh23:20:093
3181399140,10cyclictest17117-21/usr/sbin/munin20:55:233
3181399140,10cyclictest15932-21sh23:27:343
3181399140,10cyclictest15372-21sh21:40:183
3181399140,10cyclictest15294-21sh21:22:353
3181399140,10cyclictest14347-21rm23:45:043
3181399140,10cyclictest13812-21chrt20:45:513
3181399140,10cyclictest13809-21ssh00:02:063
3181399140,10cyclictest13426-21/usr/sbin/munin00:20:263
3181399140,10cyclictest12449-21sh22:50:093
3180899145,8cyclictest6178-21/usr/sbin/munin21:35:142
3180899141,9cyclictest8076-21idleruntime20:35:152
3180899141,9cyclictest780-21runrttasks23:37:092
3180899141,9cyclictest32063-21/usr/sbin/munin19:10:232
3180899141,9cyclictest2006-21/usr/sbin/munin19:15:222
3180899141,9cyclictest13165-21runrttasks19:36:152
3180899141,10cyclictest30995-21sh21:30:512
3180899140,9cyclictest9536-21aten2_r5power_p21:55:132
3180899140,9cyclictest10265-21sh22:13:162
3180899140,8cyclictest23867-21diskmemload22:30:552
3180899140,10cyclictest7947-21taskset23:05:162
3180899140,10cyclictest780-21runrttasks22:35:512
3180899140,10cyclictest780-21runrttasks21:49:532
3180899140,10cyclictest780-21runrttasks21:49:532
3180899140,10cyclictest780-21runrttasks20:06:432
3180899140,10cyclictest6757-21sh00:34:352
3180899140,10cyclictest4384-21/usr/sbin/munin19:20:182
3180899140,10cyclictest4337-21grep22:45:172
3180899140,10cyclictest4293-21ssh21:16:172
3180899140,10cyclictest3596-21/usr/sbin/munin20:25:172
3180899140,10cyclictest31418-21/usr/sbin/munin22:25:162
3180899140,10cyclictest30125-21ssh22:41:272
3180899140,10cyclictest29248-21taskset23:16:542
3180899140,10cyclictest28985-21python300:10:212
3180899140,10cyclictest28730-21ssh23:52:432
3180899140,10cyclictest28730-21ssh23:52:432
3180899140,10cyclictest26629-21sh23:33:472
3180899140,10cyclictest25529-21sh21:28:242
3180899140,10cyclictest24927-21chrt20:00:412
3180899140,10cyclictest23587-21ssh00:07:372
3180899140,10cyclictest20718-21ssh22:00:362
3180899140,10cyclictest19846-21sh22:54:122
3180899140,10cyclictest18064-21rm23:46:332
3180899140,10cyclictest17171-21sh00:21:422
3180899140,10cyclictest13806-21sh21:21:322
3180899140,10cyclictest12062-21sh00:00:512
3180899140,10cyclictest11760-21ssh23:43:252
3180899140,10cyclictest10706-21runrttasks23:25:022
3180899140,10cyclictest10436-21hddtemp_smartct20:40:142
3180499142,8cyclictest2170-21cat23:55:251
3180499141,9cyclictest5039-21/usr/sbin/munin20:30:181
3180499141,9cyclictest25638-21diskmemload22:21:211
3180499141,9cyclictest18885-21ssh23:29:401
3180499141,6cyclictest19838-21kworker/u24:4+xprtiod21:59:561
3180499141,11cyclictest16-1pr/legacy23:52:361
3180499141,11cyclictest16-1pr/legacy23:52:361
3180499141,11cyclictest16-1pr/legacy21:15:241
3180499141,10cyclictest16-1pr/legacy22:31:281
3180499140,9cyclictest2685-21/usr/sbin/munin20:25:151
3180499140,9cyclictest22262-21ssh23:49:321
3180499140,7cyclictest8557-21sh22:47:371
3180499140,7cyclictest19879-21grep22:00:201
3180499140,11cyclictest30929-21sh21:49:081
3180499140,11cyclictest30929-21sh21:49:081
3180499140,10cyclictest9770-21/usr/sbin/munin20:40:191
3180499140,10cyclictest8721-21ssh21:54:541
3180499140,10cyclictest8616-21ssh22:12:061
3180499140,10cyclictest6226-21grep21:35:151
3180499140,10cyclictest609-21grep19:10:161
3180499140,10cyclictest5421-21ssh23:40:061
3180499140,10cyclictest4906-21ssh23:21:111
3180499140,10cyclictest3777-21chrt19:16:571
3180499140,10cyclictest32701-21ssh23:36:421
3180499140,10cyclictest30216-21ssh00:10:561
3180499140,10cyclictest29923-21sh22:05:441
3180499140,10cyclictest24412-21ssh23:14:501
3180499140,10cyclictest22747-21ssh21:26:271
3180499140,10cyclictest22403-21/usr/sbin/munin00:25:131
3180499140,10cyclictest21200-21runrttasks21:00:581
3180499140,10cyclictest1851-21sh21:33:071
3180499140,10cyclictest17070-21sh21:23:501
3179999146,6cyclictest28682-21ssh23:35:030
3179999143,8cyclictest4461-21missed_timers22:45:170
3179999141,9cyclictest25023-21sh21:45:190
3179999141,9cyclictest25023-21sh21:45:190
3179999141,9cyclictest16992-21sh22:52:100
3179999141,9cyclictest16093-21runrttasks00:20:550
3179999141,11cyclictest28344-21ssh21:30:110
3179999141,10cyclictest3447-21kernelversion20:25:160
3179999140,9cyclictest18436-21sh21:41:590
3179999140,7cyclictest26102-21irqstats23:15:180
3179999140,7cyclictest19257-21sshd23:47:250
3179999140,12cyclictest17026-21/usr/sbin/munin23:10:150
3179999140,12cyclictest14347-21grep22:15:160
3179999140,12cyclictest10983-21/usr/sbin/munin00:00:200
3179999140,10cyclictest833-21ssh22:08:000
3179999140,10cyclictest7694-21sh00:35:030
3179999140,10cyclictest4629-21expr19:20:120
3179999140,10cyclictest326-21systemd-journal20:18:170
3179999140,10cyclictest3189-21sh21:15:300
3179999140,10cyclictest31383-21rm23:54:340
3179999140,10cyclictest31383-21rm23:54:340
3179999140,10cyclictest22345-21sh22:20:110
3179999140,10cyclictest21406-21/usr/sbin/munin19:55:130
3179999140,10cyclictest2131-21sh00:31:180
3179999140,10cyclictest20125-21gltestperf21:00:160
3179999140,10cyclictest19159-21grep22:00:150
3179999140,10cyclictest17066-21ssh23:28:220
3179999140,10cyclictest10296-21sh23:42:240
3179999140,10cyclictest10102-21ssh21:37:320
224599140,11tDemoTimingTask11117-21chrt23:06:495
468399131,10tDemoTimingTask6960-21chrt20:33:575
3181499131,9cyclictest7965-21/usr/sbin/munin00:35:114
3181499131,9cyclictest25596-21runrttasks20:05:074
3181499131,9cyclictest20661-21ssh00:05:334
3181499131,9cyclictest10927-21/usr/sbin/munin23:25:214
3181499130,9cyclictest9144-21aten2_r5power_e19:30:124
3181499130,9cyclictest7397-21/usr/sbin/munin20:35:184
3181499130,9cyclictest716-21snmpd19:25:034
3181499130,9cyclictest716-21snmpd19:14:294
3181499130,9cyclictest5039-21/usr/sbin/munin20:30:114
3181499130,9cyclictest4110-21sh22:10:064
3181499130,9cyclictest4107-21/usr/sbin/munin00:15:234
3181499130,9cyclictest32744-21/usr/sbin/munin20:20:254
3181499130,9cyclictest2994-21taskset23:55:514
3181499130,9cyclictest28327-21/usr/sbin/munin21:30:164
3181499130,9cyclictest27950-21/usr/sbin/munin20:10:184
3181499130,9cyclictest23566-21cut20:00:134
3181499130,9cyclictest22878-21ssh22:02:054
3181499130,9cyclictest21416-21runrttasks22:55:064
3181499130,9cyclictest20331-21/usr/sbin/munin21:00:184
3181499130,9cyclictest19918-21perl21:25:154
3181499130,9cyclictest17719-21sh23:46:184
3181499130,9cyclictest17117-21/usr/sbin/munin20:55:194
3181499130,9cyclictest14474-21/usr/sbin/munin20:50:234
3181499130,9cyclictest12252-21sed19:35:174
3181499130,9cyclictest12124-21/usr/sbin/munin20:45:174
3181499130,9cyclictest11436-21ssh21:55:274
3181499130,10cyclictest5567-21ssh22:45:334
3181499130,10cyclictest5344-21needreboot19:20:174
3181499130,10cyclictest31156-21sh22:25:034
3181499130,10cyclictest2927-21cut20:25:124
3181399135,6cyclictest8077-21basename20:35:153
3181399130,9cyclictest780-21runrttasks19:45:123
3181399130,9cyclictest7257-21cut19:25:143
3181399130,9cyclictest716-21snmpd19:42:253
3181399130,9cyclictest716-21snmpd19:42:253
3181399130,9cyclictest5009-21gltestperf19:20:153
3181399130,9cyclictest4107-21/usr/sbin/munin00:15:163
3181399130,9cyclictest3349-21hddtemp_smartct20:25:133
3181399130,9cyclictest30303-21/usr/sbin/munin20:15:123
3181399130,9cyclictest27998-21runrttasks23:16:003
3181399130,9cyclictest2677-21hddtemp_smartct19:15:143
3181399130,9cyclictest26389-21apt-config22:40:003
3181399130,9cyclictest24240-21ssh21:10:033
3181399130,9cyclictest23572-21runrttasks21:06:153
3181399130,9cyclictest22604-21sh21:26:213
3181399130,9cyclictest22365-21/usr/sbin/munin22:20:163
3181399130,9cyclictest21342-21grep19:55:133
3181399130,9cyclictest19480-21/usr/sbin/munin21:00:183
3181399130,9cyclictest14804-21/usr/sbin/munin22:15:223
3181399130,10cyclictest17406-21ssh23:10:183
3181399130,10cyclictest11615-21taskset20:42:573
3180899135,6cyclictest21834-21uname19:55:172
3180899134,7cyclictest7918-21find19:25:182
3180899131,9cyclictest4031-21diskmemload00:15:072
3180899131,9cyclictest16-1pr/legacy20:55:062
3180899131,8cyclictest6730-21seq20:30:522
3180899131,7cyclictest458-21aten2_r5power_v21:50:122
3180899130,9cyclictest9094-21/usr/sbin/munin19:30:172
3180899130,9cyclictest731-21sshd19:50:122
3180899130,9cyclictest30497-21/usr/sbin/munin23:00:192
3180899130,9cyclictest27464-21sh22:05:072
3180899130,9cyclictest24230-21sh21:10:032
3180899130,9cyclictest2284-21ssh23:20:122
3180899130,9cyclictest22668-21runintdemo5min21:05:182
3180899130,9cyclictest21576-21grep22:55:122
3180899130,9cyclictest17759-21ssh21:41:302
3180899130,9cyclictest14474-21/usr/sbin/munin20:50:182
3180899130,9cyclictest13819-21/usr/sbin/munin19:40:122
3180899130,9cyclictest13819-21/usr/sbin/munin19:40:112
3180899130,10cyclictest30418-21wget20:15:122
3180899130,10cyclictest12899-21tr20:45:172
3180499139,3cyclictest14456-21cpuspeed_turbos21:40:141
3180499131,9cyclictest9464-21entropy19:30:141
3180499130,9cyclictest780-21runrttasks19:40:341
3180499130,9cyclictest780-21runrttasks19:40:341
3180499130,9cyclictest780-21runrttasks19:35:541
3180499130,9cyclictest7397-21/usr/sbin/munin20:35:181
3180499130,9cyclictest731-21sshd20:52:031
3180499130,9cyclictest31072-21grep20:15:161
3180499130,9cyclictest28067-21wget20:10:121
3180499130,9cyclictest25831-21cpuspeed_turbos20:05:131
3180499130,9cyclictest25696-21fschecks_count23:15:151
3180499130,9cyclictest23250-21/usr/sbin/munin20:00:231
3180499130,9cyclictest21808-21/usr/sbin/munin21:05:251
3180499130,9cyclictest20874-21/usr/sbin/munin19:55:121
3180499130,9cyclictest19070-21fschecks_time19:50:141
3180499130,9cyclictest16170-21/usr/sbin/munin19:45:181
3180499130,9cyclictest10654-21diskmemload00:35:571
3180499130,7cyclictest7294-21perl19:25:131
3180499130,10cyclictest6438-21latency_hist19:25:001
3180499130,10cyclictest326-21systemd-journal20:55:171
3180499130,10cyclictest31848-21fschecks_count00:30:121
3180499130,10cyclictest18379-21ssh00:05:051
3180499130,10cyclictest16422-21ssh22:16:161
3179999135,6cyclictest31822-21cat19:10:000
3179999133,7cyclictest174-1kworker/0:1H+kblockd20:01:060
3179999131,9cyclictest780-21runrttasks20:21:170
3179999131,7cyclictest18346-21latency_hist19:50:010
3179999131,10cyclictest16478-21latency_hist20:55:000
3179999130,9cyclictest780-21runrttasks20:35:500
3179999130,9cyclictest780-21runrttasks20:32:490
3179999130,9cyclictest32733-21hddtemp_smartct19:10:140
3179999130,9cyclictest30476-21sh23:00:090
3179999130,9cyclictest28150-21cpuspeed20:10:120
3179999130,9cyclictest18438-21sed20:55:220
3179999130,9cyclictest10146-21/usr/sbin/munin19:30:180
3179999130,6cyclictest12479-21df_inode20:45:140
3179999130,11cyclictest444-21rm23:55:120
3179999130,10cyclictest26883-21grep20:05:230
2854699130,10tDemoTimingTask32683-21chrt23:55:045
2135939130,1EcMasterDemoSyn671rcuc/522:01:045
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional