You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 22:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue May 12, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31789212400,13sleep0211rcuc/006:57:020
31429222015,49sleep20-21swapper/206:56:492
3183621898,64sleep131883-21sed06:57:041
32627991054,74cyclictest12586-21apt-get07:36:351
326319910483,11cyclictest0-21swapper/210:26:372
3263699993,74cyclictest2982-21chrt08:46:433
3262799972,53cyclictest17189-21taskset09:16:501
3262799962,77cyclictest30571-21kworker/u19:1+flush-179:007:21:431
32623999674,10cyclictest0-21swapper/008:26:350
32623999673,12cyclictest0-21swapper/007:51:570
32627999429,21cyclictest0-21swapper/110:48:441
32623999458,9cyclictest181rcu_preempt08:01:520
32627999312,45cyclictest31-21ksoftirqd/111:45:271
32623999352,32cyclictest30650-21latency11:26:460
32623999352,32cyclictest30650-21latency11:26:460
32623999272,11cyclictest0-21swapper/009:06:220
32623999221,24cyclictest0-21swapper/011:01:110
32623999171,12cyclictest0-21swapper/008:11:230
32627998817,35cyclictest31-21ksoftirqd/108:10:441
32623998870,10cyclictest5971-21ssh10:46:220
32623998870,10cyclictest5971-21ssh10:46:220
32631998768,10cyclictest0-21swapper/207:11:212
32631998768,10cyclictest0-21swapper/207:11:212
3262799873,50cyclictest21252-21apt-get11:12:081
3262799873,50cyclictest21252-21apt-get11:12:081
32627998641,14cyclictest181rcu_preempt08:21:531
32627998612,47cyclictest31-21ksoftirqd/108:12:141
32627998610,50cyclictest31-21ksoftirqd/110:54:051
3262799853,64cyclictest19676-21snmpd09:22:011
32627998517,36cyclictest31-21ksoftirqd/108:30:241
32623998571,7cyclictest0-21swapper/011:12:160
32623998571,7cyclictest0-21swapper/011:12:160
32623998523,40cyclictest26397-21kworker/u17:0+xprtiod11:37:200
32623998523,40cyclictest26397-21kworker/u17:0+xprtiod11:37:200
32636998417,48cyclictest0-21swapper/309:16:503
32627998415,47cyclictest31-21ksoftirqd/109:04:191
32623998463,15cyclictest12738-21sh10:01:570
32631998363,14cyclictest27749-21fschecks_count12:16:392
32627998348,9cyclictest181rcu_preempt07:26:231
32627998316,34cyclictest31-21ksoftirqd/107:43:181
3262399838,27cyclictest20280-21apt-get09:21:340
32623998355,21cyclictest25356-21latency_hist08:16:220
32627998259,16cyclictest32614-21cyclictest12:21:431
32627998259,16cyclictest32614-21cyclictest12:21:431
32623998268,7cyclictest0-21swapper/011:01:550
32623998259,13cyclictest0-21swapper/007:26:560
32623998215,26cyclictest4390-21rm09:48:340
32631998154,18cyclictest20688-21cut11:11:212
32627998160,8cyclictest181rcu_preempt11:16:411
32627998119,33cyclictest31-21ksoftirqd/108:39:231
32627998119,33cyclictest31-21ksoftirqd/108:39:231
32623998111,29cyclictest2137-21rm11:32:490
32627998057,17cyclictest20691-21idleruntime-cro11:11:191
32623998012,26cyclictest26003-21seq11:18:530
32623998010,28cyclictest25697-21ssh09:30:440
32631997961,10cyclictest0-21swapper/208:21:362
32627997960,13cyclictest297-21systemd-logind07:51:191
32627997960,13cyclictest297-21systemd-logind07:51:191
32627997944,8cyclictest181rcu_preempt08:31:471
32627997944,10cyclictest19827-21sed07:56:541
32627997916,32cyclictest31-21ksoftirqd/110:07:161
32623997964,10cyclictest32614-21cyclictest10:36:430
32623997959,10cyclictest0-21swapper/008:36:210
32623997945,29cyclictest32614-21cyclictest11:51:540
32623997912,27cyclictest16140-21rm10:08:030
32623997911,27cyclictest25871-21ssh10:25:080
32623997910,27cyclictest28561-21seq11:22:420
32631997847,22cyclictest12846-21grep07:37:462
32627997858,14cyclictest12295-21sendmail11:51:181
32627997850,9cyclictest181rcu_preempt12:17:161
32627997849,8cyclictest181rcu_preempt11:53:571
32627997826,9cyclictest0-21swapper/110:33:131
32623997857,15cyclictest544-21cron09:41:180
32623997813,23cyclictest20057-21ssh11:09:340
32623997811,26cyclictest31385-21rm10:33:490
32631997762,10cyclictest32614-21cyclictest09:51:492
32631997758,14cyclictest6963-21threads08:56:542
32631997758,11cyclictest14411-21runrttasks11:00:242
32631997721,22cyclictest24267-21uname10:21:492
3262799778,29cyclictest31-21ksoftirqd/112:12:591
32627997754,9cyclictest181rcu_preempt11:30:441
32627997754,9cyclictest181rcu_preempt11:30:441
32627997738,21cyclictest24370-21latency_hist12:11:221
32627997716,33cyclictest31-21ksoftirqd/107:13:251
32623997714,25cyclictest30047-21ssh12:21:040
32623997714,22cyclictest7545-21diskmemload09:51:470
32623997711,28cyclictest26191-21ssh12:13:290
32631997658,11cyclictest16524-21latency_hist09:16:242
32631997658,11cyclictest16524-21latency_hist09:16:242
32631997655,15cyclictest6181-21ntp_offset07:16:502
3262799769,37cyclictest31-21ksoftirqd/110:17:451
32627997661,10cyclictest32614-21cyclictest11:31:561
32627997646,7cyclictest181rcu_preempt10:02:351
32627997638,8cyclictest181rcu_preempt07:51:561
32627997636,12cyclictest3131-21apt-get10:41:301
32627997636,12cyclictest3131-21apt-get10:41:301
32623997616,26cyclictest0-21swapper/009:09:160
32623997614,28cyclictest6728-21ntp_states10:46:500
32623997613,24cyclictest14178-21/usr/sbin/munin07:41:520
32623997613,23cyclictest24043-21ssh12:10:540
32631997559,10cyclictest4824-21fschecks_time08:51:432
32631997559,10cyclictest4824-21fschecks_time08:51:432
32631997556,13cyclictest30438-21/usr/sbin/munin12:21:502
32631997556,13cyclictest30438-21/usr/sbin/munin12:21:502
32627997547,8cyclictest181rcu_preempt09:11:161
32627997531,14cyclictest0-21swapper/109:13:141
32627997531,14cyclictest0-21swapper/109:13:141
32627997513,33cyclictest31-21ksoftirqd/109:00:291
32623997556,13cyclictest18702-21sh10:11:560
32623997556,13cyclictest18702-21sh10:11:560
32623997515,21cyclictest28060-21ssh09:33:560
32623997515,21cyclictest28060-21ssh09:33:560
32623997514,22cyclictest19975-21sh12:02:450
32623997513,33cyclictest2244-21sh12:27:220
32623997512,22cyclictest10864-21ssh09:59:560
32631997457,10cyclictest12066-21rm10:01:442
32631997457,10cyclictest10483-21switchtime11:46:562
32627997451,9cyclictest181rcu_preempt09:39:291
32627997451,8cyclictest181rcu_preempt11:21:231
32627997449,8cyclictest181rcu_preempt09:46:231
32627997448,12cyclictest181rcu_preempt10:29:181
32627997445,8cyclictest181rcu_preempt11:57:431
32627997445,8cyclictest181rcu_preempt09:53:401
3262799744,51cyclictest2951-21apt-get08:46:421
32627997420,18cyclictest0-21swapper/108:53:491
32627997420,18cyclictest0-21swapper/108:53:491
32627997415,27cyclictest31-21ksoftirqd/107:32:571
32627997412,35cyclictest31-21ksoftirqd/109:31:411
32627997412,35cyclictest31-21ksoftirqd/109:31:411
3262399749,26cyclictest19478-21ssh09:20:390
32623997443,21cyclictest26296-21cat08:16:540
32623997418,18cyclictest12591-21runrttasks07:36:340
32623997413,31cyclictest0-21swapper/012:23:360
32623997413,31cyclictest0-21swapper/012:23:360
32623997412,21cyclictest17313-21ssh11:58:380
32623997411,23cyclictest941-21ssh09:42:130
32623997410,21cyclictest15436-21ssh09:13:140
32623997410,21cyclictest15436-21ssh09:13:140
32631997355,14cyclictest32614-21cyclictest10:31:572
32631997355,12cyclictest298-21in:imuxsock09:11:202
32631997318,19cyclictest1934-21taskset11:32:162
3262799736,37cyclictest31-21ksoftirqd/111:06:041
32627997358,10cyclictest3679-21modprobe12:31:181
32627997352,8cyclictest181rcu_preempt08:06:171
32627997326,13cyclictest0-21swapper/109:26:581
32627997324,30cyclictest0-21swapper/111:38:231
32627997324,30cyclictest0-21swapper/111:38:231
32627997320,24cyclictest0-21swapper/110:11:571
32627997320,24cyclictest0-21swapper/110:11:571
32627997319,32cyclictest31-21ksoftirqd/110:01:041
3262399738,26cyclictest23125-21ssh10:20:450
32623997351,11cyclictest0-21swapper/007:56:410
32623997344,16cyclictest181rcu_preempt11:45:360
32636997210,39cyclictest0-21swapper/311:11:453
32636997210,39cyclictest0-21swapper/311:11:453
32631997255,9cyclictest0-21swapper/210:46:482
32631997250,16cyclictest544-21cron08:31:202
32627997253,12cyclictest20977-21sh12:05:361
32627997248,8cyclictest181rcu_preempt09:41:581
32627997237,11cyclictest24274-21ntp_states10:21:491
32627997228,21cyclictest0-21swapper/108:41:551
3262399729,20cyclictest5700-21seq08:53:210
3262399729,20cyclictest5700-21seq08:53:210
32623997220,43cyclictest26935-21fschecks_time10:26:430
32623997212,23cyclictest10979-21ssh10:54:060
32623997212,22cyclictest9665-21sh11:46:340
32627997135,20cyclictest25662-21diskstats08:16:391
32627997131,10cyclictest0-21swapper/110:37:311
32627997112,31cyclictest31-21ksoftirqd/111:00:371
32623997151,10cyclictest0-21swapper/008:21:390
32623997113,20cyclictest6948-21seq07:20:590
3262399711,26cyclictest16888-21runrttasks07:48:160
3262399711,26cyclictest16888-21runrttasks07:48:160
32631997056,8cyclictest0-21swapper/209:31:562
32631997056,8cyclictest0-21swapper/209:31:562
32631997047,17cyclictest7545-21diskmemload11:22:432
32627997011,20cyclictest301ktimers/107:01:431
3262399703,35cyclictest2951-21apt-get08:46:430
3263199697,24cyclictest0-21swapper/209:41:432
32631996955,10cyclictest32614-21cyclictest08:07:482
32631996951,11cyclictest298-21in:imuxsock10:38:072
32631996914,24cyclictest17024-21seq07:50:022
32631996914,24cyclictest17024-21seq07:50:022
32631996911,25cyclictest2187-21seq08:43:042
32627996945,8cyclictest181rcu_preempt07:16:551
32627996914,20cyclictest31-21ksoftirqd/107:11:191
32627996914,20cyclictest31-21ksoftirqd/107:11:191
32623996953,11cyclictest32614-21cyclictest07:01:440
32631996830,8cyclictest181rcu_preempt12:14:302
32631996827,8cyclictest181rcu_preempt11:59:002
32631996825,34cyclictest2746-21ssh09:46:352
32631996823,40cyclictest0-21swapper/210:06:342
32623996839,19cyclictest7703-21latency_hist09:01:220
3263199678,30cyclictest11127-21taskset10:54:312
3263199677,28cyclictest352-21runrttasks07:52:052
32631996752,8cyclictest0-21swapper/209:26:422
32631996748,11cyclictest2374-21systemd-journal08:00:342
32631996713,23cyclictest5137-21seq07:13:172
32631996651,8cyclictest0-21swapper/209:26:202
32631996650,9cyclictest0-21swapper/210:16:552
32631996647,13cyclictest29199-21/usr/sbin/munin09:36:392
32631996614,25cyclictest8763-21seq07:25:322
32631996611,25cyclictest700-21seq08:39:402
32631996611,25cyclictest700-21seq08:39:402
32631996610,23cyclictest4081-21seq08:48:392
32623996644,15cyclictest4598-21open_inodes07:11:520
32623996634,7cyclictest0-21swapper/008:46:210
32631996549,10cyclictest8365-21latency09:01:472
32631996548,11cyclictest21603-21unixbench_singl08:01:552
32631996545,14cyclictest15302-21cut11:56:202
32631996535,20cyclictest10434-21modprobe07:31:192
32623996519,8cyclictest0-21swapper/007:11:110
32623996519,8cyclictest0-21swapper/007:11:110
3263699648,37cyclictest0-21swapper/307:21:423
3263699642,44cyclictest0-21swapper/309:21:373
32631996448,10cyclictest20016-21gpgv09:21:232
32631996447,11cyclictest23937-21systemd-run11:16:202
32631996447,11cyclictest23937-21systemd-run11:16:202
32631996445,11cyclictest0-21swapper/209:56:422
32631996410,24cyclictest1637-21seq07:05:402
32631996410,19cyclictest15032-21chrt11:01:282
32623996413,20cyclictest11974-21seq07:35:080
32631996348,8cyclictest0-21swapper/212:26:552
32631996312,18cyclictest25162-21seq08:15:342
3263699623,35cyclictest0-21swapper/307:36:343
3263199628,22cyclictest7545-21diskmemload12:01:502
3263199626,23cyclictest0-21swapper/207:41:492
32631996249,9cyclictest32614-21cyclictest11:43:192
32623996212,19cyclictest32100-21taskset08:36:370
32623996212,19cyclictest32100-21taskset08:36:370
32631996121,9cyclictest0-21swapper/208:31:482
32631996112,19cyclictest5208-21seq11:38:052
32631996112,19cyclictest5208-21seq11:38:052
3262399619,21cyclictest7554-21runrttasks07:22:080
32631996044,9cyclictest0-21swapper/210:41:572
32631996044,9cyclictest0-21swapper/210:41:572
32631996042,12cyclictest1-21systemd08:21:072
32631996042,12cyclictest0-21swapper/211:26:462
32631996042,12cyclictest0-21swapper/211:26:462
32631995944,9cyclictest24241-21sendmail12:11:192
32631995925,26cyclictest12428-21date07:36:232
32631995919,9cyclictest0-21swapper/211:16:502
32631995836,12cyclictest0-21swapper/210:11:412
32631995836,12cyclictest0-21swapper/210:11:412
3263699563,41cyclictest7688-21taskset09:01:223
3263699563,41cyclictest31969-21chrt08:36:353
3263699563,41cyclictest31969-21chrt08:36:353
3263699554,41cyclictest14841-21chrt11:01:213
3263699553,39cyclictest18692-21chrt11:06:523
32636995513,33cyclictest503-21chrt12:25:543
32636995513,33cyclictest503-21chrt12:25:543
3263699544,36cyclictest26746-21taskset12:15:043
3263699542,39cyclictest28865-21taskset12:17:403
317412549,27sleep30-21swapper/306:57:023
3263699534,35cyclictest806-21chrt11:31:363
3263699533,41cyclictest9932-21chrt10:51:573
3263699533,40cyclictest29806-21chrt10:31:393
3263699533,39cyclictest29979-21chrt11:26:213
3263699533,37cyclictest2922-21chrt09:46:413
3263699532,35cyclictest17628-21chrt10:11:293
3263699532,35cyclictest17628-21chrt10:11:293
3263699524,34cyclictest2146-21chrt09:45:393
3263699523,37cyclictest28606-21taskset08:26:223
3263699514,35cyclictest1308-21chrt08:41:413
3263699513,38cyclictest7669-21chrt09:54:183
3263699513,34cyclictest23876-21taskset08:11:283
3263699513,33cyclictest1016-21taskset12:26:353
3263699512,37cyclictest6061-21chrt10:46:263
3263699503,39cyclictest30238-21taskset09:36:563
3263699503,39cyclictest11140-21taskset10:00:433
3263699503,37cyclictest10473-21taskset11:46:563
3263699503,35cyclictest5702-21chrt11:39:303
3263699503,35cyclictest5702-21chrt11:39:303
3263699503,34cyclictest9288-21chrt11:46:153
3263699503,33cyclictest12972-21chrt10:02:293
3263699503,31cyclictest19024-21chrt07:56:293
3263699502,34cyclictest30787-21chrt11:26:503
3263699502,34cyclictest30787-21chrt11:26:503
3263699502,34cyclictest18866-21chrt07:56:213
3263699493,36cyclictest15932-21chrt10:07:283
3263699493,35cyclictest5028-21chrt10:44:113
3263699493,35cyclictest5028-21chrt10:44:113
3263699493,34cyclictest30565-21chrt08:31:413
3263699493,34cyclictest1636-21chrt10:38:033
3263699493,33cyclictest10576-21chrt09:06:203
3263699492,38cyclictest22993-21chrt12:07:553
3263699492,33cyclictest29257-21chrt10:31:183
3263699492,31cyclictest7304-21chrt07:21:223
3263699483,33cyclictest17649-21chrt11:06:113
3263699482,38cyclictest25572-21taskset09:30:233
3263699482,32cyclictest806-21taskset07:01:463
3263699473,36cyclictest5417-21chrt07:16:203
3263699472,32cyclictest14794-21chrt11:54:543
3263699463,35cyclictest19148-21taskset12:01:473
3263699463,33cyclictest27702-21chrt09:32:553
3263699463,33cyclictest27702-21chrt09:32:553
3263699463,33cyclictest10731-21chrt07:31:313
3263699463,31cyclictest15087-21chrt09:12:163
3263699463,31cyclictest15087-21chrt09:12:163
3263699463,29cyclictest17609-21chrt11:59:283
3263699453,34cyclictest16577-21taskset07:46:543
3263699453,34cyclictest16577-21taskset07:46:543
3263699453,30cyclictest25648-21chrt10:24:303
3263699453,30cyclictest22180-21chrt10:18:133
3263699452,34cyclictest24827-21chrt11:16:493
3263699452,33cyclictest13521-21taskset09:11:183
32636994510,19cyclictest0-21swapper/307:11:223
32636994510,19cyclictest0-21swapper/307:11:223
3263699442,28cyclictest5720-21chrt08:53:363
3263699442,28cyclictest5720-21chrt08:53:363
3263699433,31cyclictest20741-21taskset08:01:363
3263699403,22cyclictest25955-21chrt08:16:463
3263699402,28cyclictest30110-21chrt08:31:203
3263699393,24cyclictest10354-21chrt07:30:213
3263699392,27cyclictest23360-21taskset08:08:203
3263699382,26cyclictest15229-21taskset07:42:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional