You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 21:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Sun Apr 26, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
737299974,26cyclictest31096-21rm11:17:381
70982979,60sleep17099-21sshd07:01:061
737299964,41cyclictest21831-21grep07:43:011
736399963,41cyclictest1641-21ssh11:22:370
7380999512,71cyclictest32411-21apt-get12:12:382
7372999440,44cyclictest0-21swapper/111:52:501
738099933,71cyclictest417-21apt-get09:32:482
737299915,30cyclictest30048-21/usr/sbin/munin09:27:501
7372999067,15cyclictest277-21dbus-daemon08:22:241
7372999047,36cyclictest31154-21processes10:22:561
737299904,41cyclictest7868-21apt-get11:32:351
737299903,40cyclictest352-21runrttasks10:50:381
737299892,42cyclictest12564-21idleruntime-cro07:17:231
737299892,42cyclictest12564-21idleruntime-cro07:17:231
7363998971,14cyclictest17190-21kworker/u18:3+events_unbound11:52:230
7363998971,14cyclictest17190-21kworker/u18:3+events_unbound11:52:230
736399893,75cyclictest500-21rm09:32:480
7380998864,14cyclictest27845-21kworker/u17:3-rpciod10:02:582
7380998864,14cyclictest27845-21kworker/u17:3-rpciod10:02:582
7372998871,11cyclictest352-21runrttasks12:23:001
737299885,40cyclictest15180-21sshd11:49:051
737299885,40cyclictest15180-21sshd11:49:051
7372998841,39cyclictest0-21swapper/109:42:561
7372998841,39cyclictest0-21swapper/109:42:561
7372998838,43cyclictest0-21swapper/111:23:011
737299883,35cyclictest28691-21latency_hist08:07:261
737299883,31cyclictest22524-21latency11:02:491
737299882,28cyclictest13117-21sh09:52:551
7363998868,14cyclictest352-21runrttasks07:07:260
7380998766,15cyclictest7303-21latency_hist11:32:262
7372998741,39cyclictest17911-21sh09:07:481
7372998738,42cyclictest0-21swapper/110:32:541
737299873,34cyclictest7019-21/usr/sbin/munin10:37:471
737299873,32cyclictest352-21runrttasks12:17:411
737299873,32cyclictest23394-21grep07:48:001
737299873,28cyclictest26590-21/usr/sbin/munin09:22:531
7363998759,20cyclictest23826-21processes11:57:560
7372998646,17cyclictest181rcu_preempt12:07:361
7372998646,17cyclictest181rcu_preempt12:07:361
737299863,37cyclictest352-21runrttasks10:46:041
737299863,31cyclictest16565-21latency_hist11:47:271
737299863,30cyclictest25032-21/usr/sbin/munin11:07:411
737299863,27cyclictest26353-21latency_hist09:22:261
737299863,27cyclictest26353-21latency_hist09:22:261
7372998627,51cyclictest0-21swapper/108:47:461
7363998643,11cyclictest181rcu_preempt12:27:250
7380998569,10cyclictest277-21dbus-daemon11:42:242
7380998569,10cyclictest277-21dbus-daemon11:42:242
7380998517,57cyclictest8050-21taskset11:33:022
737299854,39cyclictest18741-21latency_hist10:57:261
737299854,29cyclictest7791-21modprobe08:42:231
737299854,29cyclictest7791-21modprobe08:42:231
7372998535,43cyclictest0-21swapper/111:42:491
737299853,37cyclictest9297-21runrttasks08:46:071
737299853,32cyclictest352-21runrttasks09:03:061
737299853,31cyclictest5424-21ps08:32:561
737299853,31cyclictest5424-21ps08:32:561
737299853,30cyclictest11268-21fschecks_time11:37:591
737299853,30cyclictest11268-21fschecks_time11:37:591
737299853,28cyclictest25812-21ssh12:02:221
7372998531,44cyclictest24623-21ntp_kernel_pll_07:52:521
7372998531,44cyclictest24623-21ntp_kernel_pll_07:52:521
737299852,30cyclictest21733-21modprobe11:02:221
7363998566,10cyclictest16612-21/usr/sbin/munin11:47:230
7363998566,10cyclictest16612-21/usr/sbin/munin11:47:230
7363998564,15cyclictest32743-21ssh12:13:300
7363998553,13cyclictest181rcu_preempt09:41:250
7372998438,38cyclictest0-21swapper/110:17:531
737299843,33cyclictest31362-21timerandwakeup08:12:591
737299843,33cyclictest31362-21timerandwakeup08:12:591
737299843,33cyclictest15910-21latency09:57:501
737299843,33cyclictest1215-21kernelversion09:33:501
737299843,29cyclictest12073-21timerandwakeup08:52:561
7372998429,41cyclictest0-21swapper/110:12:541
7372998429,41cyclictest0-21swapper/110:12:541
737299842,34cyclictest352-21runrttasks08:09:191
737299842,34cyclictest352-21runrttasks08:09:191
737299842,32cyclictest10390-21sed07:08:021
737299842,30cyclictest12352-21latency_hist09:52:271
7363998453,10cyclictest181rcu_preempt09:43:160
7363998453,10cyclictest181rcu_preempt09:43:160
7363998444,11cyclictest0-21swapper/008:23:390
7380998359,18cyclictest1093-21latency_hist08:22:252
737299834,39cyclictest27226-21latency_hist08:02:261
737299833,34cyclictest19184-21latency_hist07:37:271
737299833,33cyclictest13031-21fschecks_count07:17:471
737299833,33cyclictest13031-21fschecks_count07:17:471
737299833,29cyclictest20876-21fschecks_count09:12:461
737299833,28cyclictest27199-21grep12:03:011
737299832,29cyclictest4683-21latency_hist08:32:271
738099822,62cyclictest17201-21ssh11:47:472
738099822,62cyclictest17201-21ssh11:47:472
737299825,29cyclictest352-21runrttasks08:57:511
737299825,29cyclictest352-21runrttasks08:57:511
737299824,32cyclictest28403-21fschecks_time11:12:471
737299823,32cyclictest32388-21ssh12:12:341
737299823,31cyclictest7519-21/usr/sbin/munin07:02:481
737299823,31cyclictest3966-21latency_hist10:32:271
737299823,31cyclictest1893-21fschecks_time08:23:301
737299823,30cyclictest19471-21ssh10:03:001
737299823,30cyclictest19471-21ssh10:03:001
737299823,30cyclictest15369-21grep07:22:591
737299823,30cyclictest15369-21grep07:22:591
737299823,29cyclictest4596-21/usr/sbin/munin11:27:571
737299823,29cyclictest19542-21cut07:37:461
737299823,28cyclictest16866-21grep07:27:581
737299823,26cyclictest9439-21sed12:27:491
737299823,26cyclictest3632-21sh09:37:451
7363998255,21cyclictest15869-21latency_hist10:52:260
7372998156,18cyclictest21501-21ssh10:07:401
736399816,68cyclictest27735-21kworker/u17:0+ext4-rsv-conversion11:32:500
7363998150,12cyclictest181rcu_preempt07:47:580
7363998141,17cyclictest181rcu_preempt11:02:440
7380998050,22cyclictest27158-21idleruntime-cro10:17:232
7380998050,22cyclictest27158-21idleruntime-cro10:17:232
7363998056,18cyclictest20706-21latency_hist07:42:260
7363998041,12cyclictest181rcu_preempt12:30:380
7363998040,9cyclictest181rcu_preempt08:43:020
7363997962,11cyclictest17102-21ssh09:06:580
7363997960,15cyclictest7350-21cyclictest11:07:300
7363997949,11cyclictest181rcu_preempt12:07:260
7363997949,11cyclictest181rcu_preempt12:07:260
7363997859,13cyclictest17856-21fschecks_count07:32:470
7363997858,7cyclictest181rcu_preempt07:12:270
7363997857,15cyclictest21286-21rm11:53:060
7363997852,17cyclictest17574-21/usr/sbin/munin09:08:010
7363997828,12cyclictest181rcu_preempt10:04:330
7363997828,12cyclictest181rcu_preempt10:04:330
738799776,47cyclictest0-21swapper/309:32:483
7387997743,28cyclictest0-21swapper/311:33:023
7380997758,13cyclictest18464-21timerandwakeup07:33:002
7380997736,20cyclictest39-21ksoftirqd/207:52:342
7380997736,20cyclictest39-21ksoftirqd/207:52:342
7363997757,15cyclictest7350-21cyclictest12:02:450
7363997743,18cyclictest181rcu_preempt08:37:410
7363997743,18cyclictest181rcu_preempt08:37:410
7363997740,13cyclictest181rcu_preempt07:22:550
7363997740,13cyclictest181rcu_preempt07:22:550
7380997661,11cyclictest7350-21cyclictest12:02:582
7380997660,11cyclictest7350-21cyclictest09:38:062
7380997653,17cyclictest6261-21latency_hist08:37:262
7380997653,17cyclictest6261-21latency_hist08:37:262
7380997649,19cyclictest14277-21diskmemload09:11:342
7363997655,15cyclictest25840-21ssh10:13:440
7363997655,15cyclictest25840-21ssh10:13:440
7363997653,17cyclictest4875-21fschecks_count11:27:460
7363997640,7cyclictest181rcu_preempt10:47:240
7363997636,13cyclictest181rcu_preempt11:17:450
7363997635,34cyclictest0-21swapper/010:27:500
736399763,32cyclictest26477-21latency_hist09:22:270
736399763,32cyclictest26477-21latency_hist09:22:270
7363997633,12cyclictest181rcu_preempt10:40:440
7363997626,14cyclictest0-21swapper/008:02:490
7380997558,11cyclictest297-21systemd-logind09:07:242
7363997555,7cyclictest181rcu_preempt09:26:420
7363997554,13cyclictest11329-21ssh11:38:000
7363997554,13cyclictest11329-21ssh11:38:000
7363997543,11cyclictest181rcu_preempt09:58:260
7363997537,9cyclictest0-21swapper/008:52:390
736399752,32cyclictest15-21ksoftirqd/010:36:460
7380997444,21cyclictest30589-21rm10:22:412
736399747,30cyclictest161ktimers/010:11:320
7363997452,8cyclictest181rcu_preempt09:29:360
7363997443,13cyclictest181rcu_preempt07:52:410
7363997443,13cyclictest181rcu_preempt07:52:410
7363997437,22cyclictest181rcu_preempt08:02:240
736399742,37cyclictest16347-21ssh10:52:460
7363997418,47cyclictest161ktimers/010:22:350
7380997356,12cyclictest2374-21systemd-journal07:12:252
7380997354,14cyclictest7350-21cyclictest08:23:452
7380997354,13cyclictest14787-21ssh11:42:592
7380997354,13cyclictest14787-21ssh11:42:592
7363997348,9cyclictest181rcu_preempt07:42:560
7363997341,23cyclictest9898-21latency09:47:490
7380997251,8cyclictest181rcu_preempt09:51:262
7363997249,9cyclictest181rcu_preempt09:16:410
7363997249,14cyclictest20500-21ssh10:58:570
7363997240,11cyclictest181rcu_preempt08:07:420
7363997240,11cyclictest181rcu_preempt08:07:420
63352729,43sleep05862-21/usr/sbin/munin06:57:590
7380997155,12cyclictest10129-21kworker/u18:1-ext4-rsv-conversion08:12:272
7380997155,12cyclictest10129-21kworker/u18:1-ext4-rsv-conversion08:12:272
738099714,28cyclictest39-21ksoftirqd/210:07:592
7363997132,12cyclictest181rcu_preempt11:16:430
7363997126,13cyclictest181rcu_preempt07:12:390
7363997126,13cyclictest181rcu_preempt07:12:390
736399712,41cyclictest15-21ksoftirqd/008:33:510
736399712,41cyclictest15-21ksoftirqd/008:33:510
7363997114,12cyclictest0-21swapper/009:52:390
7380997046,7cyclictest181rcu_preempt11:05:572
7380997043,7cyclictest181rcu_preempt10:28:262
7380997022,10cyclictest371rcuc/208:27:582
736399709,32cyclictest15-21ksoftirqd/008:57:400
736399709,32cyclictest15-21ksoftirqd/008:57:400
7363997047,8cyclictest181rcu_preempt07:27:460
7363997028,17cyclictest181rcu_preempt10:18:450
7363997025,13cyclictest181rcu_preempt08:20:140
7380996953,10cyclictest27807-21systemd-run11:12:252
7380996949,7cyclictest181rcu_preempt11:59:472
7380996949,13cyclictest7350-21cyclictest10:48:102
7380996947,16cyclictest21771-21systemd-run11:02:232
7380996932,19cyclictest39-21ksoftirqd/207:47:552
7363996949,12cyclictest5624-21cron12:22:220
7380996854,8cyclictest9530-21ssh12:27:522
7380996853,8cyclictest0-21swapper/209:22:442
7380996852,10cyclictest29213-21runrttasks11:13:052
7380996851,11cyclictest7746-21kworker/u17:2-ext4-rsv-conversion09:17:262
7380996848,14cyclictest298-21in:imuxsock08:42:242
7380996848,14cyclictest298-21in:imuxsock08:42:242
7380996848,10cyclictest0-21swapper/211:53:022
738099684,29cyclictest39-21ksoftirqd/212:20:312
738099683,26cyclictest39-21ksoftirqd/208:12:502
738099683,26cyclictest39-21ksoftirqd/208:12:502
738099682,49cyclictest4745-21wc10:32:552
738099682,40cyclictest27088-21basename08:02:232
7380996815,33cyclictest22192-21sshd07:47:062
7363996832,18cyclictest181rcu_preempt07:18:010
7363996832,18cyclictest181rcu_preempt07:18:010
642826813,32sleep20-21swapper/206:58:052
738099675,40cyclictest11439-21fschecks_time07:12:452
738099675,40cyclictest11439-21fschecks_time07:12:452
7380996749,12cyclictest13765-21unixbench_singl07:18:022
7380996749,12cyclictest13765-21unixbench_singl07:18:022
7380996746,15cyclictest27413-21cpuspeed08:02:402
738099674,28cyclictest39-21ksoftirqd/209:29:582
738099673,26cyclictest39-21ksoftirqd/209:46:112
738099673,26cyclictest39-21ksoftirqd/209:46:112
736399674,31cyclictest15-21ksoftirqd/008:27:340
7363996738,7cyclictest181rcu_preempt08:12:370
7363996738,7cyclictest181rcu_preempt08:12:370
738099668,26cyclictest39-21ksoftirqd/212:12:012
738099668,26cyclictest39-21ksoftirqd/212:12:012
7380996640,18cyclictest13158-21find09:52:562
738099663,46cyclictest16934-21unixbench_multi07:27:592
738099663,37cyclictest26306-21latency_hist09:22:272
738099663,37cyclictest26306-21latency_hist09:22:272
738099662,42cyclictest39-21ksoftirqd/212:24:462
738099661,39cyclictest39-21ksoftirqd/209:57:542
7363996636,12cyclictest181rcu_preempt08:47:410
738099658,26cyclictest39-21ksoftirqd/211:23:282
738099653,42cyclictest352-21runrttasks08:50:492
738099653,41cyclictest31819-21mailstats11:17:572
7380996511,32cyclictest39-21ksoftirqd/207:05:202
7380996446,10cyclictest30197-21ssh10:22:252
7380996442,13cyclictest13679-21threads08:57:582
7380996442,13cyclictest13679-21threads08:57:582
7380996426,27cyclictest14875-21load07:22:492
7380996426,27cyclictest14875-21load07:22:492
7380996346,11cyclictest2374-21systemd-journal08:43:062
738099634,28cyclictest39-21ksoftirqd/210:54:312
7380996340,7cyclictest181rcu_preempt08:52:532
738099632,40cyclictest10156-21runrttasks10:42:412
7380996321,32cyclictest7717-21grep10:37:572
738099631,26cyclictest39-21ksoftirqd/207:37:412
7387996113,29cyclictest0-21swapper/311:47:523
7387996113,29cyclictest0-21swapper/311:47:523
7387996010,28cyclictest0-21swapper/312:12:383
738799573,41cyclictest3087-21taskset08:27:273
738799563,39cyclictest510-21chrt08:17:593
738799544,41cyclictest30611-21chrt11:17:003
738799544,39cyclictest27937-21taskset11:12:273
738799544,36cyclictest30356-21chrt10:22:263
738799543,40cyclictest5199-21taskset08:32:493
738799543,40cyclictest5199-21taskset08:32:493
738799535,36cyclictest15354-21chrt07:22:593
738799535,36cyclictest15354-21chrt07:22:593
738799535,36cyclictest1231-21chrt10:27:453
738799534,37cyclictest27221-21taskset12:03:013
738799533,39cyclictest14337-21chrt09:02:263
738799533,39cyclictest14337-21chrt09:02:263
738799533,36cyclictest4190-21chrt10:32:393
738799523,37cyclictest31345-21chrt10:22:593
738799523,37cyclictest19201-21chrt10:02:573
738799523,37cyclictest19201-21chrt10:02:573
738799523,35cyclictest3631-21chrt09:37:453
738799523,35cyclictest12853-21chrt10:47:263
738799522,41cyclictest21990-21chrt10:07:523
738799522,40cyclictest16557-21chrt09:58:033
738799522,36cyclictest8419-21chrt09:45:313
738799522,36cyclictest8419-21chrt09:45:313
738799514,37cyclictest28002-21taskset08:02:563
738799513,38cyclictest31872-21taskset11:17:583
738799513,35cyclictest16535-21chrt10:52:493
738799513,34cyclictest23111-21chrt09:16:533
738799513,34cyclictest20157-21chrt11:52:353
738799512,39cyclictest25030-21taskset09:18:523
738799512,39cyclictest25030-21taskset09:18:523
738799512,34cyclictest4180-21chrt08:27:593
155232510,7sleep30-21swapper/311:44:293
155232510,7sleep30-21swapper/311:44:293
738799504,31cyclictest9255-21chrt07:07:323
738799503,35cyclictest32106-21taskset08:17:263
738799503,35cyclictest32106-21taskset08:17:263
738799503,35cyclictest24077-21taskset07:52:273
738799503,32cyclictest16271-21chrt07:27:453
738799503,31cyclictest8752-21chrt12:27:253
738799502,38cyclictest7257-21chrt10:37:463
738799502,35cyclictest4725-21chrt12:19:513
738799493,37cyclictest11498-21chrt12:31:593
738799493,36cyclictest29164-21chrt08:07:463
738799493,36cyclictest29164-21chrt08:07:463
738799493,36cyclictest27398-21taskset09:22:573
738799493,36cyclictest24157-21chrt07:52:403
738799493,36cyclictest24157-21chrt07:52:403
738799493,36cyclictest20075-21chrt10:58:003
738799493,36cyclictest18541-21taskset09:08:013
738799493,36cyclictest13966-21chrt07:19:593
738799493,36cyclictest13966-21chrt07:19:593
738799493,36cyclictest11467-21chrt08:52:423
738799493,35cyclictest6747-21taskset08:37:473
738799493,35cyclictest6747-21taskset08:37:473
738799492,38cyclictest30889-21chrt09:28:283
738799492,35cyclictest11672-21taskset07:12:513
738799492,35cyclictest11672-21taskset07:12:513
738799482,35cyclictest7804-21taskset07:02:463
738799482,35cyclictest14732-21chrt10:49:413
738799482,33cyclictest3164-21chrt11:24:143
738799482,32cyclictest29175-21taskset12:07:393
738799482,32cyclictest29175-21taskset12:07:393
738799481,37cyclictest11338-21taskset11:38:003
738799481,37cyclictest11338-21taskset11:38:003
738799473,35cyclictest8685-21taskset08:42:583
738799473,35cyclictest23589-21chrt11:04:123
738799473,35cyclictest12587-21chrt09:52:403
738799473,29cyclictest10177-21chrt08:47:523
738799472,34cyclictest21437-21taskset07:42:563
738799472,34cyclictest17899-21chrt07:32:473
738799472,33cyclictest10532-21chrt09:48:023
738799463,33cyclictest26398-21chrt07:57:583
738799463,32cyclictest25145-21chrt10:12:543
738799463,32cyclictest25145-21chrt10:12:543
738799463,29cyclictest25335-21taskset12:01:023
738799453,29cyclictest15111-21taskset09:02:503
738799452,28cyclictest20835-21chrt07:42:273
738799423,29cyclictest5811-21taskset11:28:153
597324210,18sleep30-21swapper/306:57:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional