You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 14:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Apr 29, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27536216613,106sleep027569-21proc_pri06:57:540
28371215112,105sleep128375-21latency_hist07:02:151
28454991273,78cyclictest0-21swapper/009:32:270
28454991272,78cyclictest27734-21apt-get08:37:220
28454991253,83cyclictest1319-21rm09:52:290
28454991253,83cyclictest1319-21rm09:52:290
284549911625,52cyclictest0-21swapper/011:07:140
284549911534,60cyclictest0-21swapper/011:12:440
284549911534,60cyclictest0-21swapper/011:12:440
28454991143,68cyclictest0-21swapper/008:37:130
28454991143,68cyclictest0-21swapper/008:37:130
28454991142,71cyclictest2952-1kworker/0:0H+mmc_complete09:32:150
284549911417,76cyclictest0-21swapper/012:07:450
28454991133,77cyclictest7148-21modprobe11:52:110
2824721136,16sleep20-21swapper/207:01:312
28454991118,62cyclictest0-21swapper/008:02:130
28454991118,62cyclictest0-21swapper/008:02:130
28454991113,62cyclictest0-21swapper/007:52:220
284549911132,64cyclictest0-21swapper/007:32:140
284549911116,71cyclictest25224-21switchtime08:27:450
284549911116,71cyclictest25224-21switchtime08:27:450
28454991086,93cyclictest29586-21apt-get08:43:100
28454991084,74cyclictest4204-21munin-run11:47:100
28454991083,98cyclictest13297-21apt-get11:07:230
28454991083,98cyclictest13297-21apt-get11:07:230
28454991076,85cyclictest21664-21grep10:27:140
28454991076,85cyclictest21664-21grep10:27:140
28454991073,66cyclictest32530-21idleruntime-cro08:52:120
28454991073,66cyclictest32530-21idleruntime-cro08:52:120
28454991073,64cyclictest0-21swapper/008:17:130
28454991072,70cyclictest4990-21ntp_kernel_err10:52:380
284549910720,49cyclictest0-21swapper/012:27:380
284549910720,49cyclictest0-21swapper/012:27:380
284709910672,10cyclictest181rcu_preempt11:42:062
28454991063,80cyclictest6785-21apt-get07:32:300
28454991063,66cyclictest6909-21apt-get09:07:290
284549910636,63cyclictest0-21swapper/012:07:110
284549910636,63cyclictest0-21swapper/012:07:110
28454991062,64cyclictest17755-21modprobe08:07:110
28454991062,64cyclictest17755-21modprobe08:07:110
28454991053,58cyclictest0-21swapper/009:05:230
284549910531,47cyclictest0-21swapper/010:02:490
284549910531,47cyclictest0-21swapper/010:02:490
28454991033,93cyclictest0-21swapper/012:22:230
28454991033,64cyclictest16851-21ssh10:17:470
28454991033,64cyclictest0-21swapper/011:37:160
28454991033,58cyclictest27510-21latency_hist09:42:140
284549910249,47cyclictest3312-21diskmemload10:47:450
284549910249,47cyclictest3312-21diskmemload10:47:450
28454991024,61cyclictest0-21swapper/007:17:120
28454991023,60cyclictest18401-21ssh09:27:090
28454991022,63cyclictest21485-21chrt11:21:070
284549910210,59cyclictest7817-21grep11:52:330
284549910136,57cyclictest0-21swapper/011:27:470
284549910136,57cyclictest0-21swapper/011:27:470
28454991013,60cyclictest0-21swapper/007:17:460
28454991013,60cyclictest0-21swapper/007:17:460
28454991012,62cyclictest30741-21latency_hist11:37:130
28454991003,66cyclictest25331-21/usr/sbin/munin10:32:380
28454991003,66cyclictest25331-21/usr/sbin/munin10:32:380
2845499994,61cyclictest30239-21forks07:07:170
2845499993,79cyclictest0-21swapper/009:47:280
2845499993,59cyclictest10018-21cron11:02:110
2845499993,59cyclictest10018-21cron11:02:110
28454999933,60cyclictest0-21swapper/007:22:350
2845499992,68cyclictest22159-21/usr/sbin/munin11:22:370
2845499992,59cyclictest10997-21ntpq11:57:390
28454999843,49cyclictest277-21dbus-daemon08:12:120
2845499983,61cyclictest0-21swapper/009:12:360
2845499982,58cyclictest13690-21grep09:17:490
2845499982,58cyclictest13690-21grep09:17:490
28470999774,16cyclictest28441-21cyclictest11:22:272
28454999735,56cyclictest0-21swapper/009:57:480
2845499972,65cyclictest28321-21uname09:42:420
2845499972,63cyclictest15814-21ls10:17:150
2845499963,56cyclictest0-21swapper/010:42:250
151362950,8sleep20-21swapper/212:04:412
151362950,8sleep20-21swapper/212:04:412
2845499949,52cyclictest0-21swapper/012:17:130
2845499944,56cyclictest0-21swapper/010:10:370
2845499943,84cyclictest22074-21fschecks_count10:27:320
2845499942,64cyclictest22038-21xargs08:17:460
2845499942,60cyclictest10657-21runrttasks07:42:440
28463999368,17cyclictest277-21dbus-daemon09:17:131
2845499933,54cyclictest0-21swapper/010:37:270
28470999269,9cyclictest181rcu_preempt12:25:222
2845499923,81cyclictest1965-21apt-get08:57:240
28470999159,11cyclictest181rcu_preempt10:05:232
28470999159,11cyclictest181rcu_preempt10:05:232
2845499913,58cyclictest24230-21sh08:27:110
28470999056,9cyclictest181rcu_preempt10:27:292
28470998956,14cyclictest181rcu_preempt09:56:002
28470998956,14cyclictest181rcu_preempt09:56:002
28470998941,11cyclictest181rcu_preempt09:50:002
2845499892,54cyclictest22289-21ssh12:17:280
28454998910,57cyclictest0-21swapper/008:56:450
28454998826,53cyclictest0-21swapper/007:39:260
2845499872,69cyclictest29885-21kworker/u17:1+ext4-rsv-conversion07:52:150
28463998644,29cyclictest31487-21diskstats10:43:301
28470998562,11cyclictest0-21swapper/209:17:482
28470998562,11cyclictest0-21swapper/209:17:482
28463998548,12cyclictest181rcu_preempt07:52:451
28470998461,13cyclictest0-21swapper/207:37:332
28470998438,9cyclictest181rcu_preempt10:12:302
28463998463,15cyclictest25860-21sendmail08:32:121
28463998463,15cyclictest25860-21sendmail08:32:121
2845499848,46cyclictest0-21swapper/007:07:140
28470998363,12cyclictest0-21swapper/211:32:452
28470998363,12cyclictest0-21swapper/208:42:142
28470998265,10cyclictest0-21swapper/210:07:442
28470998225,13cyclictest181rcu_preempt10:47:112
28463998265,12cyclictest28441-21cyclictest09:02:401
28463998125,9cyclictest181rcu_preempt08:47:351
28463998125,9cyclictest181rcu_preempt08:47:351
28470998064,12cyclictest28441-21cyclictest09:57:292
28470998064,11cyclictest28441-21cyclictest10:32:482
28470998064,11cyclictest28441-21cyclictest10:32:482
28470998058,16cyclictest28441-21cyclictest07:55:082
28470998058,15cyclictest3312-21diskmemload09:38:532
28470998055,8cyclictest181rcu_preempt10:47:352
28470998055,8cyclictest181rcu_preempt10:47:352
28470998051,13cyclictest181rcu_preempt07:07:242
28463998030,8cyclictest181rcu_preempt07:02:461
28470997957,15cyclictest277-21dbus-daemon11:22:122
28470997956,15cyclictest3400-21latency_hist09:02:142
28470997952,10cyclictest181rcu_preempt09:17:142
28470997927,13cyclictest181rcu_preempt08:57:112
2847099792,43cyclictest18916-21modprobe11:17:122
2847099792,43cyclictest18916-21modprobe11:17:122
28463997957,12cyclictest0-21swapper/109:42:341
28463997932,13cyclictest181rcu_preempt08:37:331
2699427914,36sleep30-21swapper/306:57:323
2847099784,65cyclictest4580-21timerwakeupswit09:02:482
28470997839,11cyclictest181rcu_preempt10:27:142
28470997839,11cyclictest181rcu_preempt10:27:142
28463997860,12cyclictest9451-21systemd-run09:12:141
28463997852,18cyclictest12952-21fschecks_time09:17:341
28463997852,18cyclictest12952-21fschecks_time09:17:341
28463997840,11cyclictest10203-21ssh11:02:141
28463997840,11cyclictest10203-21ssh11:02:141
28470997760,9cyclictest0-21swapper/211:12:122
28470997760,9cyclictest0-21swapper/211:12:122
28470997760,10cyclictest297-21systemd-logind12:17:122
28470997758,12cyclictest297-21systemd-logind08:37:122
28470997758,12cyclictest297-21systemd-logind08:37:122
28470997756,14cyclictest29007-21xargs12:27:462
28470997756,14cyclictest29007-21xargs12:27:462
28470997752,19cyclictest24684-21apt-key09:37:152
28470997751,20cyclictest297-21systemd-logind11:07:122
28463997738,9cyclictest0-21swapper/107:17:481
28463997738,9cyclictest0-21swapper/107:17:481
2847099767,59cyclictest6866-21apt-get09:07:312
28470997653,13cyclictest0-21swapper/207:57:342
28470997653,13cyclictest0-21swapper/207:57:342
28470997641,11cyclictest181rcu_preempt12:10:382
28470997637,17cyclictest0-21swapper/209:44:252
28463997659,10cyclictest0-21swapper/110:17:281
28463997648,18cyclictest31129-21apt-key12:32:161
28463997648,18cyclictest31129-21apt-key12:32:161
28470997556,11cyclictest0-21swapper/208:07:342
28470997555,13cyclictest21453-21munin-run09:32:132
28470997544,7cyclictest181rcu_preempt10:40:352
28470997531,11cyclictest7865-21if_eth011:52:342
28463997559,9cyclictest0-21swapper/112:12:481
28463997535,12cyclictest13062-21ssh11:07:131
28463997458,12cyclictest28441-21cyclictest11:27:341
28463997458,12cyclictest28441-21cyclictest11:27:341
28463997426,8cyclictest0-21swapper/108:57:261
2846399742,43cyclictest1705-21munin-run08:57:111
28470997357,9cyclictest0-21swapper/207:47:382
28470997352,15cyclictest5158-21fschecks_count07:28:272
28470997329,10cyclictest28441-21cyclictest10:52:462
28470997326,10cyclictest181rcu_preempt08:52:142
28470997326,10cyclictest181rcu_preempt08:52:142
28470997316,40cyclictest11513-21cat07:47:152
28463997359,10cyclictest28441-21cyclictest10:07:411
28463997358,8cyclictest0-21swapper/107:12:331
28463997358,7cyclictest0-21swapper/107:42:401
28463997357,10cyclictest3128-21cpuspeed07:22:261
28463997353,14cyclictest18972-21latency_hist12:12:131
28463997346,7cyclictest181rcu_preempt11:57:471
28463997338,8cyclictest181rcu_preempt11:47:491
28463997332,20cyclictest21686-21kworker/u17:1-ext4-rsv-conversion12:22:141
28470997250,9cyclictest181rcu_preempt12:18:302
28470997247,8cyclictest181rcu_preempt08:26:502
28470997242,9cyclictest181rcu_preempt07:22:462
28470997242,22cyclictest607-21threads07:12:452
28470997230,16cyclictest0-21swapper/207:34:102
28463997255,8cyclictest0-21swapper/108:12:451
28463997252,7cyclictest181rcu_preempt10:00:301
28463997249,8cyclictest181rcu_preempt11:52:311
28463997248,16cyclictest28441-21cyclictest09:25:481
28463997247,8cyclictest181rcu_preempt08:47:121
28463997245,18cyclictest0-21swapper/110:37:141
28463997245,18cyclictest0-21swapper/110:37:141
2846399723,37cyclictest352-21runrttasks09:27:191
165402720,7sleep30-21swapper/308:02:293
165402720,7sleep30-21swapper/308:02:293
28470997153,11cyclictest24861-21kernelversion08:27:352
28470997153,11cyclictest24861-21kernelversion08:27:352
28470997148,16cyclictest4206-21idleruntime-cro11:47:102
28470997135,17cyclictest181rcu_preempt08:17:352
28470997118,10cyclictest181rcu_preempt11:47:332
28463997150,12cyclictest0-21swapper/110:37:331
28463997135,9cyclictest181rcu_preempt08:02:371
28463997135,9cyclictest181rcu_preempt08:02:371
268732710,7sleep10-21swapper/109:40:451
2847699704,38cyclictest15450-21taskset12:05:353
2847699704,38cyclictest15450-21taskset12:05:353
28470997033,7cyclictest181rcu_preempt09:23:592
28463997045,15cyclictest0-21swapper/108:02:141
28463997045,15cyclictest0-21swapper/108:02:141
28463997043,8cyclictest181rcu_preempt11:10:141
28463997043,8cyclictest181rcu_preempt11:10:141
28463997028,7cyclictest181rcu_preempt11:42:471
28470996940,7cyclictest181rcu_preempt12:02:132
2847699689,48cyclictest0-21swapper/310:02:273
2847699689,48cyclictest0-21swapper/310:02:273
2847699682,29cyclictest24513-21taskset10:32:113
2847699682,26cyclictest2161-21chrt07:17:483
2847699682,26cyclictest2161-21chrt07:17:483
28470996855,8cyclictest39-21ksoftirqd/211:00:552
28470996855,8cyclictest39-21ksoftirqd/211:00:552
28470996848,8cyclictest0-21swapper/208:43:212
28470996838,8cyclictest181rcu_preempt11:27:452
28470996838,8cyclictest181rcu_preempt11:27:452
28463996844,16cyclictest0-21swapper/109:52:141
28463996834,8cyclictest31836-21ssh11:37:451
2846399683,42cyclictest5203-21fschecks_count07:28:271
28463996830,10cyclictest181rcu_preempt07:47:321
2847699673,23cyclictest7231-21chrt09:08:263
2847099673,48cyclictest16182-21fschecks_count10:17:332
28463996750,11cyclictest22298-21ntp_kernel_pll_09:32:401
2846399673,34cyclictest1501-21cut09:52:341
2846399673,34cyclictest1501-21cut09:52:341
28463996730,14cyclictest29662-21kworker/u17:2-xprtiod11:24:081
28463996729,8cyclictest0-21swapper/112:27:081
28463996728,10cyclictest181rcu_preempt10:57:111
2847699664,30cyclictest15497-21chrt10:16:513
28470996646,10cyclictest0-21swapper/208:02:342
28470996646,10cyclictest0-21swapper/208:02:342
28463996651,9cyclictest7687-21ntp_offset10:02:411
28463996651,9cyclictest7687-21ntp_offset10:02:411
28463996649,12cyclictest0-21swapper/112:07:121
28463996649,12cyclictest0-21swapper/112:07:121
28463996641,17cyclictest0-21swapper/110:12:351
28463996639,8cyclictest181rcu_preempt11:17:381
28463996639,18cyclictest9695-21modprobe07:42:111
2847699654,29cyclictest2760-21chrt10:48:243
2847699654,29cyclictest2760-21chrt10:48:243
2847699654,27cyclictest12423-21chrt09:17:143
2847699653,27cyclictest18712-21chrt10:22:143
2847699653,24cyclictest1970-21chrt08:57:243
2847699653,23cyclictest17542-21chrt09:24:403
2847699652,25cyclictest18604-21taskset08:07:433
28470996515,21cyclictest29433-21timerandwakeup07:02:462
2846399655,23cyclictest0-21swapper/110:47:331
2846399655,23cyclictest0-21swapper/110:47:331
2846399654,45cyclictest26139-21cpu08:32:271
2846399654,45cyclictest26139-21cpu08:32:271
28463996526,9cyclictest181rcu_preempt07:32:421
2846399652,44cyclictest30635-21netstat07:07:241
2846399652,41cyclictest22120-21ssh10:27:331
2847699644,45cyclictest28559-21taskset12:27:363
2847699644,45cyclictest28559-21taskset12:27:363
2847699643,27cyclictest22282-21chrt12:17:273
2847699643,26cyclictest3837-21chrt11:46:103
2847699643,26cyclictest20643-21chrt10:24:413
2847699643,26cyclictest20643-21chrt10:24:413
2847699643,24cyclictest6764-21chrt07:32:223
2847699642,29cyclictest21908-21chrt09:32:303
2847699642,26cyclictest6418-21taskset07:32:133
2847699642,26cyclictest4927-21chrt11:47:363
2847699642,26cyclictest27260-21chrt11:30:473
2847699642,26cyclictest27260-21chrt11:30:473
2847699642,24cyclictest22199-21chrt11:22:243
28470996445,8cyclictest0-21swapper/207:17:462
28470996445,8cyclictest0-21swapper/207:17:462
28463996445,14cyclictest24164-21kworker/u17:3+events_unbound08:27:121
2847699633,28cyclictest5728-21taskset09:05:343
2847699633,24cyclictest30081-21chrt10:41:193
2847699633,24cyclictest26344-21chrt09:39:133
2847699633,24cyclictest18754-21chrt09:27:243
2847699633,22cyclictest25182-21chrt12:22:213
2847699632,26cyclictest372-21chrt10:45:043
2847699632,26cyclictest11903-21chrt11:58:513
2846399634,23cyclictest28343-21ssh11:32:321
2846399632,27cyclictest27171-21kworker/1:2-mm_percpu_wq10:24:211
2846399632,27cyclictest27171-21kworker/1:2-mm_percpu_wq10:24:211
2847699624,20cyclictest11916-21chrt11:04:083
2847699623,26cyclictest16017-21chrt08:00:303
2847699623,26cyclictest16017-21chrt08:00:303
2847699623,24cyclictest19328-21chrt12:12:243
2847699623,22cyclictest28121-21chrt11:32:253
2847699622,28cyclictest31644-21taskset11:37:403
2847699622,25cyclictest15059-21chrt09:21:283
2847699622,25cyclictest15059-21chrt09:21:283
2847699622,25cyclictest14465-21chrt07:56:133
2847699622,24cyclictest27673-21chrt09:42:213
2847699622,24cyclictest21287-21taskset11:20:343
2847699622,24cyclictest17898-21chrt11:14:173
2847699622,24cyclictest17898-21chrt11:14:173
2847699622,23cyclictest28638-21chrt07:02:243
2847699622,22cyclictest31653-21chrt07:07:513
2847099624,21cyclictest0-21swapper/208:17:142
2846399624,33cyclictest17022-21mailstats11:12:441
2846399624,33cyclictest17022-21mailstats11:12:441
28463996229,9cyclictest19449-21latency_hist08:12:131
2847699618,43cyclictest0-21swapper/312:07:273
2847699614,46cyclictest0-21swapper/307:22:253
2847699613,45cyclictest0-21swapper/307:52:113
2847699613,27cyclictest31815-21chrt09:48:003
2847699613,25cyclictest8364-21taskset07:37:223
2847699613,24cyclictest1497-21chrt09:52:343
2847699613,24cyclictest1497-21chrt09:52:343
2847699613,23cyclictest22393-21chrt08:19:253
2847699613,22cyclictest8656-21chrt10:58:173
2847699613,22cyclictest8656-21chrt10:58:173
2847699613,22cyclictest1640-21chrt08:56:393
2847699613,22cyclictest15113-21chrt11:09:523
2847699613,22cyclictest15113-21chrt11:09:523
2847699613,21cyclictest25571-21chrt08:28:573
2847699613,21cyclictest25571-21chrt08:28:573
2847699613,21cyclictest11943-21chrt10:10:103
2847699612,24cyclictest31180-21chrt08:47:283
2847699612,24cyclictest31180-21chrt08:47:283
2847699612,24cyclictest23979-21chrt08:24:073
2847699612,23cyclictest1064-21chrt07:15:413
2847699612,22cyclictest9275-21taskset11:54:463
2847699612,22cyclictest29600-21chrt08:42:303
2847699612,22cyclictest28767-21chrt08:38:173
2847699612,21cyclictest4625-21chrt10:52:293
2847699612,20cyclictest27038-21chrt10:36:043
2847699612,20cyclictest27038-21chrt10:36:043
28476996110,41cyclictest0-21swapper/307:42:333
28463996125,8cyclictest181rcu_preempt08:22:151
2847699602,23cyclictest27281-21chrt08:34:573
2847699602,23cyclictest27281-21chrt08:34:573
2847699602,22cyclictest20720-21chrt08:13:303
2847699602,20cyclictest5269-21chrt09:57:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional