You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 17:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Jun 25, 2026 12:44:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6505991494,72cyclictest8504-21ssh09:43:370
65139910980,19cyclictest2374-21systemd-journal12:09:321
65199910545,11cyclictest0-21swapper/210:53:212
65199910336,12cyclictest0-21swapper/211:48:562
65199910239,13cyclictest0-21swapper/208:13:232
65199910239,13cyclictest0-21swapper/208:13:232
65199910154,40cyclictest0-21swapper/208:18:452
65199910137,12cyclictest0-21swapper/209:18:482
65139910048,45cyclictest352-21runrttasks11:23:361
1223621000,7sleep20-21swapper/207:13:372
6513999939,13cyclictest10074-21latency_hist07:08:251
61222987,71sleep00-21swapper/006:55:190
6513999756,33cyclictest378-21ssh09:28:571
6519999646,15cyclictest352-21runrttasks09:07:212
6519999646,15cyclictest352-21runrttasks09:07:212
6513999637,7cyclictest0-21swapper/107:48:241
6513999625,17cyclictest0-21swapper/112:23:471
6513999625,17cyclictest0-21swapper/112:23:471
60262959,60sleep16029-21vmstat06:54:101
6513999436,13cyclictest1032-21idleruntime08:18:431
6513999429,8cyclictest0-21swapper/110:38:201
6519999338,10cyclictest0-21swapper/207:48:212
6519999323,25cyclictest18836-21seq09:59:432
6513999366,20cyclictest544-21cron09:28:211
6513999366,20cyclictest544-21cron09:28:211
6513999336,7cyclictest0-21swapper/107:48:381
6513999336,49cyclictest0-21swapper/108:28:431
6519999232,11cyclictest0-21swapper/212:03:242
6513999242,43cyclictest0-21swapper/111:38:441
651399923,33cyclictest18034-21sed09:58:481
651399923,30cyclictest8456-21/usr/sbin/munin09:43:311
6513999226,11cyclictest0-21swapper/111:13:241
651399922,35cyclictest1359-21rm12:13:411
6519999135,10cyclictest0-21swapper/211:53:392
6513999139,7cyclictest0-21swapper/112:18:521
6513999134,50cyclictest0-21swapper/107:38:561
651399913,31cyclictest6045-21ntpq09:38:481
6513999127,9cyclictest0-21swapper/109:08:511
6513999032,8cyclictest0-21swapper/112:03:591
651399902,31cyclictest12499-21latency_hist11:38:231
6513998946,36cyclictest7703-21ntp_kernel_pll_08:38:491
651399893,33cyclictest3416-21cat09:33:561
651399893,23cyclictest15182-21idleruntime-cro07:23:211
651399893,23cyclictest15182-21idleruntime-cro07:23:211
6513998930,9cyclictest0-21swapper/107:23:471
6513998929,12cyclictest0-21swapper/111:13:541
651399892,34cyclictest5811-21ssh10:33:241
6513998833,7cyclictest0-21swapper/108:33:561
651399883,36cyclictest25743-21ssh11:58:571
651399883,34cyclictest9164-21ssh10:38:401
651399882,32cyclictest31487-21latency_hist08:13:241
651399882,32cyclictest31487-21latency_hist08:13:241
651399882,32cyclictest15618-21/usr/sbin/munin11:43:301
651399882,31cyclictest21059-21ntp_offset10:03:491
651399882,31cyclictest21059-21ntp_offset10:03:491
651399873,36cyclictest19564-21latency_hist09:08:231
651399873,36cyclictest19564-21latency_hist09:08:231
651399873,35cyclictest27085-21grep09:19:151
651399873,32cyclictest23775-21taskset09:14:211
6513998726,11cyclictest0-21swapper/108:01:351
6513998713,28cyclictest12006-21latency_hist07:13:221
651399863,32cyclictest15301-21switchtime09:53:541
651399863,30cyclictest14934-21/usr/sbin/munin10:48:541
651399863,30cyclictest12509-21cat08:53:471
6513998626,12cyclictest0-21swapper/110:53:511
651399862,34cyclictest31696-21cstates08:13:381
651399862,34cyclictest31696-21cstates08:13:381
651399862,30cyclictest22406-21awk11:53:531
6513998562,14cyclictest2374-21systemd-journal11:19:321
6513998562,14cyclictest2374-21systemd-journal11:19:321
6513998527,12cyclictest0-21swapper/107:03:251
6513998527,12cyclictest0-21swapper/107:03:251
6519998424,23cyclictest0-21swapper/212:09:102
651399847,30cyclictest1-21systemd09:53:211
651399843,31cyclictest445-21cat10:23:451
651399842,29cyclictest352-21runrttasks09:00:511
651399842,22cyclictest29686-21fschecks_count10:18:421
651399842,22cyclictest29686-21fschecks_count10:18:421
651399833,32cyclictest23904-21kernelversion10:08:461
651999823,46cyclictest814-21cpu11:18:502
651999823,46cyclictest814-21cpu11:18:502
6513998237,7cyclictest0-21swapper/108:03:551
6513998132,12cyclictest0-21swapper/111:52:181
29692810,6sleep2381ktimers/210:28:302
6519998064,11cyclictest8195-21systemd-run09:43:222
6519998055,14cyclictest0-21swapper/207:03:452
651399802,31cyclictest26806-21latency_hist11:08:231
6513998020,21cyclictest25704-21proc_pri07:53:531
6505998060,14cyclictest10418-21latency_hist07:08:240
651399793,30cyclictest21482-21/usr/sbin/munin10:58:471
6505997961,11cyclictest277-21dbus-daemon10:08:220
6505997961,11cyclictest277-21dbus-daemon10:08:220
6519997857,11cyclictest0-21swapper/208:38:242
651399783,30cyclictest27102-21ssh10:13:521
6519997761,9cyclictest0-21swapper/208:23:522
6519997759,8cyclictest0-21swapper/208:28:542
6519997755,13cyclictest0-21swapper/207:23:242
6519997755,13cyclictest0-21swapper/207:23:242
6519997750,19cyclictest13397-21cron08:58:202
6505997755,10cyclictest0-21swapper/009:19:130
565727725,26sleep30-21swapper/306:54:033
6519997657,11cyclictest0-21swapper/209:58:242
6519997654,14cyclictest12718-21kworker/u17:0-xprtiod08:58:262
651999763,44cyclictest10601-21apt-get07:08:362
651399762,28cyclictest6878-21df_inode11:28:391
651399762,28cyclictest6878-21df_inode11:28:391
85762750,7sleep20-21swapper/212:25:022
85762750,7sleep20-21swapper/212:25:022
6519997555,11cyclictest0-21swapper/207:38:232
6519997553,16cyclictest32726-21apt-key11:18:232
6513997556,13cyclictest9177-21kernelversion08:43:451
6513997556,13cyclictest9177-21kernelversion08:43:451
6505997560,8cyclictest13003-21diskmemload11:38:440
6523997421,38cyclictest0-21swapper/309:13:413
6519997457,8cyclictest0-21swapper/207:43:232
6505997454,14cyclictest17639-21sh10:53:200
6519997357,8cyclictest0-21swapper/212:18:372
6519997357,8cyclictest0-21swapper/208:03:532
6505997358,9cyclictest6914-21diskmemload10:33:580
6505997357,10cyclictest27539-21kworker/u19:0-rpciod11:17:180
6519997257,10cyclictest9829-21kworker/u18:0-rpciod10:05:422
6519997257,10cyclictest9829-21kworker/u18:0-rpciod10:05:422
6519997255,7cyclictest0-21swapper/211:03:522
6519997255,11cyclictest12188-21processes09:48:532
6513997248,18cyclictest352-21runrttasks07:33:561
6505997255,11cyclictest1-21systemd12:08:190
6505997254,12cyclictest352-21runrttasks10:53:570
6505997158,9cyclictest6492-21cyclictest06:58:460
6505997158,9cyclictest6492-21cyclictest06:58:460
6505997157,9cyclictest3116-21ssh10:28:370
6519997051,13cyclictest13418-21diskmemload09:43:492
6519997033,9cyclictest181rcu_preempt10:20:452
6519997033,9cyclictest181rcu_preempt10:20:452
6519997022,33cyclictest19733-21sort09:08:312
6505997054,10cyclictest24079-21ntp_offset10:08:500
6505997053,10cyclictest20268-21ssh09:08:480
6505997052,12cyclictest29829-21timerandwakeup09:23:560
6505997052,12cyclictest29829-21timerandwakeup09:23:560
103532700,7sleep30-21swapper/308:48:243
103532700,7sleep30-21swapper/308:48:243
652399693,51cyclictest20014-21taskset07:38:213
6505996954,9cyclictest2836-21ssh12:15:360
6505996942,20cyclictest20046-21kworker/u17:0+nfsiod11:55:140
6519996851,11cyclictest6780-21sort11:28:362
6519996851,11cyclictest6780-21sort11:28:362
6519996843,16cyclictest7440-21fschecks_time08:38:422
6505996853,9cyclictest2385-21cpu08:23:360
6505996853,9cyclictest13418-21diskmemload10:13:370
6505996843,19cyclictest20046-21kworker/u17:0+nfsiod12:00:380
6505996842,18cyclictest2073-21modprobe08:23:200
6505996840,21cyclictest32639-21kworker/u17:0+nfsiod11:26:110
6505996832,30cyclictest837-21sh12:13:200
6519996745,17cyclictest26056-21kworker/u19:3+nfsiod09:21:112
6519996739,7cyclictest181rcu_preempt11:43:552
6505996741,20cyclictest21318-21kworker/u17:1+nfsiod10:19:090
6505996741,20cyclictest21318-21kworker/u17:1+nfsiod10:19:090
650599673,34cyclictest7881-21sensors_temp12:23:540
650599673,34cyclictest7881-21sensors_temp12:23:540
6519996649,11cyclictest352-21runrttasks11:25:592
6519996649,11cyclictest11891-21latency_hist08:53:232
6519996647,13cyclictest17514-21needreboot07:28:492
6519996638,9cyclictest181rcu_preempt09:27:252
6519996638,9cyclictest181rcu_preempt09:27:252
6505996652,8cyclictest13412-21ssh10:45:000
6505996652,10cyclictest6492-21cyclictest07:28:440
6505996646,14cyclictest15625-21ssh09:01:100
6505996646,13cyclictest0-21swapper/009:28:580
650599664,49cyclictest27961-21unixbench_multi11:08:580
6505996644,14cyclictest16917-21sh09:03:400
6505996644,14cyclictest16917-21sh09:03:400
6505996640,20cyclictest25727-21kworker/u17:3+nfsiod09:35:080
58212669,33sleep20-21swapper/206:54:062
6519996549,9cyclictest0-21swapper/210:23:552
651999652,24cyclictest1898-21grep12:13:532
6505996553,8cyclictest7161-21kworker/u19:1+rpciod09:43:130
6505996548,11cyclictest1-21systemd09:53:210
650599654,33cyclictest22973-21apt-get09:13:330
6505996543,14cyclictest352-21runrttasks07:38:540
6505996539,18cyclictest5535-21kworker/u17:2+nfsiod11:29:230
6505996539,18cyclictest5535-21kworker/u17:2+nfsiod11:29:230
6505996535,24cyclictest5183-21kworker/u17:0+nfsiod10:41:520
6505996532,24cyclictest4721-21ntpq12:18:480
652399647,32cyclictest0-21swapper/311:18:363
652399647,32cyclictest0-21swapper/311:18:363
6519996449,7cyclictest0-21swapper/210:48:232
6519996444,12cyclictest1-21systemd09:28:552
651999643,29cyclictest16908-21latency_hist07:28:232
6513996443,10cyclictest0-21swapper/110:48:221
6505996439,19cyclictest22025-21kworker/u17:3+nfsiod11:00:360
6505996436,21cyclictest12718-21kworker/u17:0+nfsiod10:23:280
6519996346,11cyclictest352-21runrttasks11:13:202
6519996346,10cyclictest0-21swapper/211:38:582
6519996344,9cyclictest0-21swapper/206:58:392
6519996344,9cyclictest0-21swapper/206:58:392
6519996339,16cyclictest0-21swapper/210:33:422
6505996344,13cyclictest17167-21idleruntime-cro09:58:200
650599633,32cyclictest692-21apt-get11:18:320
650599633,32cyclictest692-21apt-get11:18:320
652399623,45cyclictest8246-21taskset07:03:253
652399623,45cyclictest8246-21taskset07:03:253
6519996246,10cyclictest23854-21sh10:08:452
6519996245,12cyclictest23871-21kernelversion07:48:462
6519996244,13cyclictest21552-21sh10:58:502
651999623,40cyclictest10900-21ssh10:41:202
6519996233,21cyclictest10216-21nfs4_client11:33:472
6513996241,10cyclictest0-21swapper/107:28:571
6505996247,9cyclictest10078-21ssh11:33:450
6505996241,12cyclictest31607-21cpu08:13:370
6505996241,12cyclictest31607-21cpu08:13:370
6505996234,21cyclictest5640-21kworker/u17:2+nfsiod10:02:160
6505996234,20cyclictest11941-21modprobe07:13:200
6505996233,23cyclictest181rcu_preempt07:48:490
6505996232,22cyclictest13547-21modprobe07:18:200
6519996114,8cyclictest181rcu_preempt07:58:432
6513996145,9cyclictest0-21swapper/108:48:571
6505996146,9cyclictest24584-21ssh11:03:520
6505996135,20cyclictest16435-21kworker/u17:1+nfsiod11:44:080
650599613,34cyclictest19676-21snmpd11:48:350
652399608,43cyclictest0-21swapper/307:08:373
6519996047,9cyclictest6492-21cyclictest09:34:502
6519996029,22cyclictest277-21dbus-daemon10:18:222
650599603,40cyclictest8554-21latency_hist08:43:230
650599603,32cyclictest5947-21uname08:33:450
650599603,29cyclictest10441-21acpi08:48:300
6505996032,19cyclictest10149-21modprobe08:48:210
6505996032,19cyclictest10149-21modprobe08:48:210
652399593,39cyclictest20928-21chrt10:58:303
6519995946,9cyclictest6492-21cyclictest10:57:082
6519995919,19cyclictest32202-21uname08:13:542
6519995919,19cyclictest32202-21uname08:13:542
6513995944,9cyclictest0-21swapper/108:23:421
6513995937,12cyclictest0-21swapper/107:13:421
6505995945,7cyclictest0-21swapper/008:28:430
650599594,40cyclictest12172-21cstates08:53:380
650599593,47cyclictest26719-21/usr/sbin/munin07:58:480
652399583,40cyclictest5797-21chrt08:33:423
6519995842,10cyclictest277-21dbus-daemon07:58:212
6519995836,12cyclictest0-21swapper/212:07:442
650599584,40cyclictest15215-21latency_hist07:23:230
650599584,40cyclictest15215-21latency_hist07:23:230
650599584,39cyclictest16786-21idleruntime-cro07:28:200
650599584,30cyclictest352-21runrttasks07:33:440
650599582,43cyclictest26633-21grep07:58:230
650599582,41cyclictest28326-21/usr/sbin/munin08:03:590
652399574,37cyclictest25134-21chrt07:53:323
652399572,38cyclictest26887-21chrt09:19:133
6519995742,10cyclictest8991-21fschecks_count08:43:422
6519995742,10cyclictest8991-21fschecks_count08:43:422
6505995738,13cyclictest23334-21latency_hist07:48:230
650599573,27cyclictest30090-21ls08:08:370
650599573,27cyclictest30090-21ls08:08:370
652399564,37cyclictest8850-21chrt09:43:453
652399553,39cyclictest25017-21taskset10:10:113
652399553,37cyclictest32085-21chrt08:13:493
652399553,37cyclictest32085-21chrt08:13:493
652399544,39cyclictest6970-21chrt11:28:423
652399544,39cyclictest6970-21chrt11:28:423
652399543,40cyclictest27371-21taskset07:58:543
652399543,39cyclictest15067-21chrt10:48:373
652399543,38cyclictest3837-21chrt08:28:233
652399543,38cyclictest14135-21chrt09:53:173
652399543,38cyclictest12883-21chrt11:38:433
652399543,36cyclictest12442-21chrt11:38:223
652399543,35cyclictest11685-21chrt10:43:223
652399543,28cyclictest518-21chrt11:18:243
652399542,39cyclictest29254-21taskset09:23:433
652399542,39cyclictest29254-21taskset09:23:433
652399542,39cyclictest18409-21chrt09:05:343
652399542,39cyclictest18409-21chrt09:05:343
652399542,35cyclictest19603-21taskset11:48:563
652399534,33cyclictest2333-21chrt09:33:233
652399534,33cyclictest22878-21chrt09:13:253
652399533,38cyclictest9926-21taskset12:28:233
652399533,38cyclictest9926-21taskset12:28:233
652399533,38cyclictest18437-21chrt11:48:233
652399533,37cyclictest15992-21taskset07:23:513
652399533,37cyclictest14439-21chrt08:58:533
652399533,36cyclictest1565-21taskset08:18:553
652399532,39cyclictest17855-21chrt07:28:573
652399523,37cyclictest10971-21taskset08:48:493
652399523,36cyclictest32219-21taskset12:10:203
652399523,35cyclictest20795-21chrt07:38:493
652399523,33cyclictest18099-21chrt10:53:363
652399522,39cyclictest19313-21taskset10:01:033
652399522,38cyclictest22785-21taskset11:53:583
652399522,37cyclictest31328-21chrt10:21:103
652399522,37cyclictest31328-21chrt10:21:103
652399522,36cyclictest468-21taskset10:23:453
652399515,26cyclictest0-21swapper/307:08:213
652399514,34cyclictest1722-21chrt12:13:483
652399513,35cyclictest7102-21chrt09:40:253
652399513,34cyclictest30362-21chrt12:08:213
652399513,33cyclictest12272-21chrt08:53:433
6523995127,12cyclictest276022chrt11:08:523
652399512,37cyclictest4038-21chrt11:23:433
6523995038,8cyclictest451rcuc/308:30:433
652399503,34cyclictest24815-21chrt11:58:363
652399503,34cyclictest13517-21chrt10:45:173
652399503,33cyclictest5196-21chrt09:38:223
652399502,38cyclictest7529-21chrt08:38:443
652399502,35cyclictest28893-21chrt08:03:533
652399502,35cyclictest28206-21chrt10:15:473
652399493,33cyclictest4519-21chrt10:30:093
652399493,32cyclictest6564-21taskset10:33:503
652399492,36cyclictest12327-21taskset07:13:383
652399484,31cyclictest15190-21chrt07:23:223
652399484,31cyclictest15190-21chrt07:23:223
652399484,30cyclictest24125-21chrt11:03:413
652399484,27cyclictest23182-21taskset10:08:213
652399484,27cyclictest23182-21taskset10:08:213
652399483,32cyclictest6817-21chrt12:23:213
652399482,33cyclictest24447-21chrt07:48:583
6523994815,14cyclictest0-21swapper/307:48:213
652399454,25cyclictest17362-21chrt09:58:243
6523994330,9cyclictest451rcuc/308:11:563
6523994330,9cyclictest451rcuc/308:11:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional