You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 10:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon Jul 27, 2026 00:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2292521240,7sleep30-21swapper/300:06:113
31484212111,75sleep12374-21systemd-journal18:56:121
316429911548,50cyclictest6518-21diskmemload21:53:132
3141621126,16sleep00-21swapper/018:55:170
316309910360,36cyclictest277-21dbus-daemon19:21:121
31626999756,31cyclictest13139-21apt-get22:01:230
31630999655,35cyclictest2374-21systemd-journal23:16:051
31642999550,38cyclictest0-21swapper/221:56:512
31642999550,38cyclictest0-21swapper/221:56:512
31642999548,40cyclictest0-21swapper/222:41:492
31642999548,40cyclictest0-21swapper/222:41:492
31626999434,52cyclictest22547-21cat21:21:490
31626999434,52cyclictest22547-21cat21:21:490
3163099934,82cyclictest0-21swapper/121:26:281
31630999347,40cyclictest6518-21diskmemload22:31:301
31626999376,11cyclictest16417-21ssh21:11:450
31626999364,19cyclictest10756-21ssh22:51:240
3163099923,82cyclictest0-21swapper/122:51:241
31626999243,42cyclictest11860-21systemctl23:46:490
31626999243,42cyclictest11860-21systemctl23:46:490
31642999164,19cyclictest18187-21needreboot23:57:482
31642999164,19cyclictest18187-21needreboot23:57:482
31642999164,18cyclictest24527-21latency_hist21:26:142
31642999164,18cyclictest24527-21latency_hist21:26:142
31626999135,22cyclictest7360-21/usr/sbin/munin20:56:390
31642999066,15cyclictest31617-21cyclictest22:26:412
31642999066,15cyclictest31617-21cyclictest22:26:412
31642999048,36cyclictest31617-21cyclictest00:04:302
31626999049,29cyclictest3547-21apt-get20:46:210
31642998963,16cyclictest12871-21latency_hist19:36:152
31626998953,30cyclictest31644-21ssh23:26:280
31642998874,9cyclictest14401-21idleruntime23:51:362
31642998845,36cyclictest10053-21fschecks_count21:01:352
3163099884,74cyclictest21749-21ssh21:21:251
3163099884,74cyclictest21749-21ssh21:21:251
3163099884,72cyclictest0-21swapper/100:11:261
31626998872,11cyclictest300-21rs:main0
31642998770,11cyclictest20292-21ntp_kernel_pll_23:06:412
31642998763,17cyclictest22064-21sh22:16:142
31642998745,34cyclictest0-21swapper/221:36:442
3163099874,74cyclictest0-21swapper/119:11:231
3163099874,74cyclictest0-21swapper/119:11:231
3163099873,78cyclictest0-21swapper/123:36:251
31626998738,41cyclictest30668-21modprobe20:31:110
31630998661,14cyclictest0-21swapper/122:16:351
31630998661,14cyclictest0-21swapper/122:16:351
3163099864,76cyclictest0-21swapper/120:46:251
31626998658,22cyclictest25318-21ssh22:21:250
31626998653,22cyclictest19403-21apt-get19:56:240
31626998652,25cyclictest32143-21apt-get00:21:220
31626998652,21cyclictest6254-21apt-get19:16:270
31626998640,39cyclictest18280-21ntpq19:51:410
31626998639,39cyclictest6518-21diskmemload21:41:350
31626998639,39cyclictest6518-21diskmemload21:41:350
31642998563,12cyclictest0-21swapper/218:56:502
31642998561,17cyclictest1237-21kworker/u17:2-xprtiod00:26:142
31642998531,47cyclictest16870-21sh23:01:302
3163099855,73cyclictest0-21swapper/121:46:231
3163099855,73cyclictest0-21swapper/121:46:231
3163099855,70cyclictest0-21swapper/120:51:281
31630998544,34cyclictest19676-21snmpd21:36:581
3163099853,72cyclictest0-21swapper/121:41:221
3163099853,72cyclictest0-21swapper/121:41:221
31626998553,25cyclictest0-21swapper/021:06:140
31642998443,34cyclictest13683-21/usr/sbin/munin22:56:372
31642998442,34cyclictest0-21swapper/220:51:112
31642998435,38cyclictest0-21swapper/219:11:152
3163099845,68cyclictest0-21swapper/100:01:231
3163099843,72cyclictest0-21swapper/123:46:251
3163099843,72cyclictest0-21swapper/123:46:251
31630998435,43cyclictest13322-21latency21:06:401
31630998435,43cyclictest13322-21latency21:06:401
31626998455,20cyclictest277-21dbus-daemon20:21:120
31626998450,21cyclictest22672-21apt-get23:11:280
31626998445,30cyclictest22358-21basename23:11:110
31642998350,21cyclictest27198-21sh20:21:112
31642998334,41cyclictest0-21swapper/223:31:452
3163099835,69cyclictest0-21swapper/120:01:271
3163099835,69cyclictest0-21swapper/120:01:271
3163099834,74cyclictest0-21swapper/123:51:281
31630998341,34cyclictest0-21swapper/121:31:511
31630998341,34cyclictest0-21swapper/121:31:511
31626998366,12cyclictest31617-21cyclictest19:01:310
31626998356,21cyclictest2544-21awk22:36:440
31626998356,21cyclictest2544-21awk22:36:440
31626998351,23cyclictest2123-21apt-get23:31:220
31626998348,23cyclictest7594-21apt-get19:21:250
31626998347,25cyclictest31176-21apt-get20:32:090
31626998343,31cyclictest4452-21/usr/sbin/munin21:46:340
31626998343,31cyclictest4452-21/usr/sbin/munin21:46:340
31626998338,36cyclictest23313-21timerwakeupswit22:16:500
31626998338,36cyclictest23313-21timerwakeupswit22:16:500
31626998336,37cyclictest11262-21users21:56:500
31626998336,37cyclictest11262-21users21:56:500
31642998266,8cyclictest0-21swapper/221:16:442
31642998266,8cyclictest0-21swapper/221:16:442
31642998265,12cyclictest5948-21threads23:36:462
31642998260,12cyclictest31062-21latency_hist20:31:152
31642998246,30cyclictest297-21systemd-logind20:16:132
31642998242,34cyclictest6518-21diskmemload22:23:532
31642998239,36cyclictest277-21dbus-daemon21:11:132
31642998239,36cyclictest277-21dbus-daemon21:11:132
3164299823,41cyclictest25189-21latency_hist22:21:152
3164299823,41cyclictest25189-21latency_hist22:21:152
31630998265,8cyclictest0-21swapper/121:01:461
31630998262,14cyclictest9842-21idleruntime-cro21:56:111
3163099824,72cyclictest0-21swapper/120:32:111
31626998266,9cyclictest18750-21ssh21:16:220
31626998266,9cyclictest18750-21ssh21:16:220
31626998245,27cyclictest31124-21sed22:31:140
31626998245,27cyclictest31124-21sed22:31:140
31626998241,27cyclictest16793-21open_inodes22:06:440
31626998239,37cyclictest418-21rm21:39:550
31626998238,37cyclictest28994-21ssh21:32:200
31626998238,37cyclictest28994-21ssh21:32:200
31642998165,8cyclictest0-21swapper/222:51:292
31642998143,33cyclictest0-21swapper/219:36:282
31642998143,33cyclictest0-21swapper/219:36:282
3163099813,70cyclictest0-21swapper/121:16:221
3163099813,70cyclictest0-21swapper/121:16:221
31626998146,25cyclictest19349-21acpi22:11:230
31626998141,33cyclictest28374-21latency_hist23:21:130
31626998140,33cyclictest9064-21ssh22:47:210
31626998139,15cyclictest6941-21ssh22:44:510
31626998139,15cyclictest6941-21ssh22:44:510
31642998042,32cyclictest6518-21diskmemload22:33:352
31642998039,34cyclictest2374-21systemd-journal19:53:082
31642998032,40cyclictest5081-21timerandwakeup21:46:482
31642998032,40cyclictest5081-21timerandwakeup21:46:482
3164299802,67cyclictest24759-21ssh21:26:282
3164299802,67cyclictest0-21swapper/219:46:252
3163099806,69cyclictest0-21swapper/119:46:251
3163099804,66cyclictest0-21swapper/120:26:271
3163099804,66cyclictest0-21swapper/119:56:291
31626998061,12cyclictest16689-21ssh23:01:220
31626998045,30cyclictest0-21swapper/022:56:210
31626998045,27cyclictest14540-21apt-get19:41:270
31626998044,25cyclictest17262-21apt-get23:57:020
31626998044,25cyclictest17262-21apt-get23:57:020
31626998042,31cyclictest31395-21sed23:26:130
31626998042,31cyclictest14396-21ssh23:51:360
31626998040,30cyclictest25248-21ssh21:26:390
3104828027,32sleep20-21swapper/218:52:012
3164299793,69cyclictest0-21swapper/223:11:252
31642997930,42cyclictest0-21swapper/220:32:432
3163099794,70cyclictest0-21swapper/123:31:271
3163099794,64cyclictest0-21swapper/120:11:241
31630997939,33cyclictest0-21swapper/100:20:161
31630997939,33cyclictest0-21swapper/100:20:161
3163099793,71cyclictest0-21swapper/123:21:261
31630997932,40cyclictest0-21swapper/120:21:131
31626997951,20cyclictest7706-21sh21:51:380
31626997946,22cyclictest9724-21apt-get19:26:230
31626997945,27cyclictest87-21kswapd018:56:230
31626997945,22cyclictest2018-21/usr/sbin/munin20:41:450
31626997940,24cyclictest3975-21unixbench_singl19:06:470
3164299782,63cyclictest31616-21apt-get23:26:282
3163099784,65cyclictest0-21swapper/100:21:251
31642997758,9cyclictest0-21swapper/220:53:542
31642997752,19cyclictest18945-21apt-key22:11:152
31642997738,32cyclictest0-21swapper/200:16:372
31642997738,32cyclictest0-21swapper/200:16:372
31642997737,34cyclictest352-21runrttasks23:49:532
31642997737,34cyclictest352-21runrttasks23:49:532
3164299773,65cyclictest26803-21ssh00:11:432
3164299773,59cyclictest10784-40mandb23:46:152
3164299773,59cyclictest10784-40mandb23:46:152
31642997734,36cyclictest0-21swapper/223:16:492
31642997734,35cyclictest0-21swapper/222:49:452
3163099774,68cyclictest0-21swapper/123:41:241
3163099774,68cyclictest0-21swapper/123:41:241
3163099774,67cyclictest0-21swapper/119:31:231
3163099774,66cyclictest0-21swapper/100:06:261
3163099774,66cyclictest0-21swapper/100:06:261
3163099774,64cyclictest0-21swapper/122:56:241
3163099773,69cyclictest0-21swapper/123:01:221
31630997732,40cyclictest2317-21grep19:01:501
3163099772,59cyclictest6836-21apt-get20:56:241
31626997748,20cyclictest12665-21modprobe19:36:120
31626997743,24cyclictest31702-21grep22:31:370
31626997742,27cyclictest13885-21grep19:36:490
31626997742,27cyclictest13885-21grep19:36:490
31626997739,31cyclictest21372-21ssh00:01:560
31626997738,21cyclictest24789-21/usr/sbin/munin20:11:410
31642997654,12cyclictest0-21swapper/219:22:462
31642997653,15cyclictest28303-21ntp_kernel_pll_20:23:022
31642997653,15cyclictest28303-21ntp_kernel_pll_20:23:022
3164299763,66cyclictest0-21swapper/219:11:232
3164299763,66cyclictest0-21swapper/219:11:232
3164299763,62cyclictest0-21swapper/223:21:292
31630997660,9cyclictest0-21swapper/122:41:341
31630997660,9cyclictest0-21swapper/122:41:341
3163099765,64cyclictest13154-21ssh22:01:251
3163099763,62cyclictest0-21swapper/119:36:261
3163099763,62cyclictest0-21swapper/119:36:261
3163099763,60cyclictest25640-21apt-get23:16:231
31630997634,37cyclictest0-21swapper/122:21:271
31630997632,37cyclictest0-21swapper/122:06:371
31630997629,40cyclictest0-21swapper/122:12:351
31626997643,23cyclictest27200-21apt-get20:21:250
31626997643,23cyclictest27200-21apt-get20:21:250
31626997642,26cyclictest5355-21fschecks_count23:36:320
31626997641,25cyclictest8734-21/usr/sbin/munin23:41:440
31626997641,25cyclictest8734-21/usr/sbin/munin23:41:440
31626997640,25cyclictest24876-21ssh00:08:220
31626997640,25cyclictest24876-21ssh00:08:220
31626997638,32cyclictest30681-21ssh00:17:570
31626997638,32cyclictest30681-21ssh00:17:570
3164299754,63cyclictest0-21swapper/219:56:262
31642997539,27cyclictest0-21swapper/221:46:152
31642997539,27cyclictest0-21swapper/221:46:152
3164299753,64cyclictest0-21swapper/219:16:262
3164299753,56cyclictest21828-21/usr/sbin/munin20:01:482
3164299753,56cyclictest21828-21/usr/sbin/munin20:01:482
31642997535,32cyclictest0-21swapper/219:01:382
3163099755,60cyclictest0-21swapper/119:06:251
31630997536,32cyclictest0-21swapper/121:11:391
3163099752,60cyclictest19694-21apt-get23:06:221
31626997554,11cyclictest0-21swapper/000:11:490
31626997544,21cyclictest24221-21latency_hist20:11:150
31626997541,27cyclictest14987-21ssh21:09:530
31626997541,27cyclictest14987-21ssh21:09:530
31626997540,26cyclictest5414-21fschecks_time20:51:340
31626997540,24cyclictest20989-21/usr/sbin/munin20:01:220
31626997540,24cyclictest20989-21/usr/sbin/munin20:01:220
31642997460,7cyclictest0-21swapper/221:31:292
31642997460,7cyclictest0-21swapper/221:31:292
31642997452,10cyclictest0-21swapper/220:06:342
31642997446,22cyclictest3065-21kworker/u17:0-xprtiod20:59:572
3163099746,63cyclictest0-21swapper/120:06:271
31630997457,11cyclictest12826-21grep22:01:111
31630997457,11cyclictest12826-21grep22:01:111
3163099743,66cyclictest0-21swapper/120:36:251
31630997436,32cyclictest0-21swapper/123:56:311
31630997436,32cyclictest0-21swapper/123:56:311
3164299733,64cyclictest0-21swapper/220:36:252
31642997334,32cyclictest0-21swapper/220:41:492
31642997333,32cyclictest0-21swapper/221:14:142
3164299732,61cyclictest1786-21apt-get22:36:212
3164299732,61cyclictest1786-21apt-get22:36:212
3163099737,61cyclictest0-21swapper/123:26:251
31630997337,32cyclictest11021-21kworker/u17:0-rpciod22:26:401
31630997337,32cyclictest11021-21kworker/u17:0-rpciod22:26:401
31630997332,9cyclictest181rcu_preempt22:41:141
31630997332,9cyclictest181rcu_preempt22:41:141
3163099732,61cyclictest9885-21taskset19:26:331
31626997342,21cyclictest2412-21runrttasks20:41:530
31626997338,25cyclictest4647-21apt-get19:11:230
31626997338,25cyclictest4647-21apt-get19:11:230
31642997250,14cyclictest9705-21/usr/sbin/munin19:26:402
3164299723,59cyclictest23386-21ssh00:06:292
3164299723,59cyclictest23386-21ssh00:06:292
31642997155,7cyclictest0-21swapper/222:01:472
3164299713,58cyclictest15530-21/usr/sbin/munin19:41:492
3163099713,63cyclictest0-21swapper/118:56:241
3163099713,58cyclictest3304-21modprobe20:46:111
3163099713,54cyclictest14603-21sort19:41:271
3163099713,52cyclictest7942-21ssh22:46:291
3163099712,64cyclictest0-21swapper/119:51:281
3164799703,54cyclictest18808-21chrt22:11:113
3164799693,52cyclictest26877-21chrt00:11:473
3163099694,57cyclictest27702-21apt-get20:21:251
3163099694,57cyclictest27702-21apt-get20:21:251
3164799683,51cyclictest815-21taskset21:41:023
3164799683,51cyclictest7447-21chrt22:46:113
3164799683,51cyclictest7447-21chrt22:46:113
3164799682,53cyclictest11118-21chrt23:46:293
3164799682,53cyclictest11118-21chrt23:46:293
3163099685,55cyclictest952-21munin-node19:21:241
3164799673,51cyclictest31847-21chrt00:21:113
3164799673,51cyclictest31847-21chrt00:21:113
3164799673,50cyclictest32352-21chrt00:21:313
3164799672,52cyclictest763-21taskset22:34:113
3164799663,50cyclictest15478-21chrt23:52:453
3164799663,49cyclictest1984-21chrt22:36:303
3164799663,49cyclictest1984-21chrt22:36:303
3164799663,49cyclictest0-21swapper/321:26:283
3164799663,48cyclictest5609-21chrt19:11:483
3164799663,48cyclictest5609-21chrt19:11:483
3164799663,48cyclictest3489-21chrt23:32:343
3164799662,51cyclictest12272-21taskset21:59:403
3164799662,51cyclictest12272-21taskset21:59:403
3164799662,50cyclictest21235-21taskset21:20:433
3164799662,50cyclictest21235-21taskset21:20:433
3164799656,46cyclictest2655-21chrt21:42:493
3164799656,46cyclictest2655-21chrt21:42:493
3164799653,49cyclictest837-21taskset23:28:283
3164799653,49cyclictest7213-21taskset21:51:243
3164799653,49cyclictest15125-21taskset21:10:173
3164799653,49cyclictest15125-21taskset21:10:173
3164799653,48cyclictest7388-21taskset19:18:413
3164799653,48cyclictest28791-21chrt21:31:503
3164799653,48cyclictest28791-21chrt21:31:503
3164799653,48cyclictest14223-21chrt22:56:373
3164799653,47cyclictest22926-21taskset21:22:053
3164799653,47cyclictest22926-21taskset21:22:053
3164799652,50cyclictest27586-21taskset23:19:123
3164799652,50cyclictest24596-21chrt20:11:353
3164799652,50cyclictest21290-21taskset23:08:133
3164799652,50cyclictest14311-21chrt19:41:133
3164799652,50cyclictest14311-21chrt19:41:133
3164799652,50cyclictest11951-21taskset21:04:453
3164799643,48cyclictest944-21chrt20:36:453
3164799643,48cyclictest8691-21chrt23:41:423
3164799643,48cyclictest8691-21chrt23:41:423
3164799643,48cyclictest27717-21taskset20:21:323
3164799643,48cyclictest27717-21taskset20:21:323
3164799643,48cyclictest21397-21taskset22:14:283
3164799642,50cyclictest17834-21taskset23:01:563
3164799642,49cyclictest14418-21chrt22:02:193
3164799642,48cyclictest19380-21taskset19:56:203
3164799642,45cyclictest29216-21chrt23:21:433
3164799636,46cyclictest25880-21chrt22:21:423
3164799633,47cyclictest7369-21chrt23:40:083
3164799633,47cyclictest32239-21chrt20:33:013
3164799632,49cyclictest30124-21chrt22:28:513
3164799632,49cyclictest30124-21chrt22:28:513
3164799632,49cyclictest17215-21taskset19:47:213
3164799632,48cyclictest18209-21chrt21:15:363
3164799632,48cyclictest10119-21chrt22:50:203
3164799632,46cyclictest6856-21chrt20:56:263
3164799623,47cyclictest4303-21chrt19:10:223
3164799623,47cyclictest22359-21chrt22:16:273
3164799623,47cyclictest22359-21chrt22:16:273
3164799623,45cyclictest0-21swapper/323:11:253
3164799623,45cyclictest0-21swapper/321:46:233
3164799623,45cyclictest0-21swapper/321:46:233
3164799622,47cyclictest19094-21taskset23:58:543
3164799622,47cyclictest19094-21taskset23:58:543
3164799622,47cyclictest10863-21chrt19:28:453
3164799622,46cyclictest25868-21chrt20:16:253
3164799613,45cyclictest6445-21chrt20:55:373
3164799613,45cyclictest15080-21chrt19:41:423
3164799613,42cyclictest0-21swapper/322:51:243
3164799612,47cyclictest22096-21chrt20:03:093
3164799612,47cyclictest22096-21chrt20:03:093
3164799612,46cyclictest4727-21taskset20:49:093
3164799612,46cyclictest2930-21chrt20:42:083
3164799612,46cyclictest2407-21chrt19:02:043
3164799612,46cyclictest22996-21chrt20:06:373
3164799612,46cyclictest19086-21chrt19:55:433
3164799603,44cyclictest32260-21taskset18:56:373
3164799603,44cyclictest29558-21chrt20:26:343
3164799602,46cyclictest8175-21chrt19:22:253
3164799602,46cyclictest11305-21chrt19:31:173
3164799573,43cyclictest24561-21chrt00:07:293
3164799573,43cyclictest24561-21chrt00:07:293
3164799522,40cyclictest317672sleep318:56:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional