You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 19:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Sep 24, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25862212311,83sleep125943-21grep07:04:201
25862212311,83sleep125943-21grep07:04:201
264499911848,35cyclictest3340-21latency07:33:591
26444991133,28cyclictest343-21runrttasks12:17:590
26444991093,20cyclictest12620-21apt-get08:03:470
264449910746,54cyclictest0-21swapper/009:14:100
26444991063,29cyclictest6530-21/usr/sbin/munin11:59:030
264449910545,55cyclictest0-21swapper/008:24:080
26444991044,52cyclictest7769-21apt-get07:48:450
264449910418,32cyclictest3977-21latency11:53:580
264549910255,40cyclictest31458-21sh11:45:122
264449910221,73cyclictest26447-21latency_hist07:08:370
264449910221,73cyclictest26447-21latency_hist07:08:370
26444991013,25cyclictest27545-21runrttasks12:33:440
26444991012,25cyclictest27344-21fschecks_count08:48:540
26444991012,25cyclictest27344-21fschecks_count08:48:540
264499910024,36cyclictest0-21swapper/111:22:401
26444991003,28cyclictest19205-21/usr/sbin/munin09:38:340
26444991003,28cyclictest19205-21/usr/sbin/munin09:38:340
26444991002,34cyclictest31990-21latency09:58:590
264449910014,27cyclictest26402-21sort09:49:080
26444999936,58cyclictest0-21swapper/011:09:010
26444999936,58cyclictest0-21swapper/011:09:010
2644499993,32cyclictest18223-21latency11:23:580
2644499993,30cyclictest1195-21/usr/sbin/munin09:08:480
2644499993,30cyclictest1195-21/usr/sbin/munin09:08:480
2644499993,29cyclictest5470-21idleruntime10:09:010
2644499992,26cyclictest29181-21ssh10:48:540
2644499983,23cyclictest24863-21cut12:28:580
26449999771,18cyclictest26442-21cyclictest11:29:061
26449999771,18cyclictest26442-21cyclictest11:29:061
26449999751,37cyclictest0-21swapper/109:33:351
26449999751,37cyclictest0-21swapper/109:33:351
2644499975,29cyclictest25840-21munin-run10:43:340
2644499974,28cyclictest11677-21/usr/sbin/munin11:13:570
2644499973,32cyclictest200-21systemd-journal12:08:340
2644499973,27cyclictest18849-21taskset08:23:340
2644499973,24cyclictest10229-21/usr/sbin/munin09:24:060
2644499972,28cyclictest343-21runrttasks08:56:510
2644499972,25cyclictest26425-21apt-get11:38:480
2644499972,25cyclictest26425-21apt-get11:38:480
2644499964,32cyclictest1524-21cut07:29:140
26444999636,53cyclictest0-21swapper/008:43:360
2644499963,28cyclictest14223-21awk10:23:490
2644499963,23cyclictest15924-21latency_hist09:33:380
2644499963,23cyclictest15924-21latency_hist09:33:380
2644499962,27cyclictest24796-21head11:34:100
2644499956,11cyclictest0-21swapper/010:48:360
2644499956,11cyclictest0-21swapper/010:48:360
2644499954,29cyclictest715-21unixbench_multi10:54:110
26444999537,51cyclictest0-21swapper/010:18:500
2644499953,32cyclictest6510-21cut11:04:080
2644499953,31cyclictest1093-21latency_hist09:08:370
2644499953,29cyclictest2405-21ssh11:51:180
2644499953,29cyclictest2405-21ssh11:51:180
2644499953,24cyclictest14721-21/usr/sbin/munin11:18:420
26444999531,56cyclictest0-21swapper/011:43:530
26444999528,61cyclictest10929-21latency_hist07:58:370
26444999528,61cyclictest10929-21latency_hist07:58:370
2644499952,40cyclictest24298-21latency_hist12:28:350
2644499952,40cyclictest24298-21latency_hist12:28:350
255302959,58sleep225533-21ntpq07:04:122
255302959,58sleep225533-21ntpq07:04:122
2644499943,31cyclictest15593-21runrttasks08:13:340
2644499943,28cyclictest17913-21/usr/sbin/munin10:29:110
2644499942,27cyclictest17332-21latency_hist08:18:360
2644499942,25cyclictest834-21gpgv07:28:340
26444999412,25cyclictest22966-21sh09:43:590
26444999412,25cyclictest22966-21sh09:43:590
26454999346,41cyclictest12173-21latency11:13:562
2644499933,31cyclictest20295-21grep09:39:080
2644499933,30cyclictest20790-21taskset11:28:510
2644499933,30cyclictest20790-21taskset11:28:510
2644499932,27cyclictest22497-21cut08:33:550
26454999269,15cyclictest28763-21fschecks_count09:53:552
26454999269,15cyclictest28763-21fschecks_count09:53:552
26449999242,43cyclictest27235-21latency_hist12:33:361
2644499924,27cyclictest27085-21latency_hist08:48:360
2644499924,27cyclictest27085-21latency_hist08:48:360
2644499923,32cyclictest26813-21fschecks_count07:08:560
2644499923,28cyclictest10993-21/usr/sbin/munin07:59:090
2644499922,31cyclictest31667-21idleruntime-cro07:23:340
2644499913,33cyclictest10780-21taskset10:18:330
2644499913,32cyclictest4823-21grep07:38:560
2644499913,31cyclictest29471-21/usr/sbin/munin09:54:100
2644499913,31cyclictest29471-21/usr/sbin/munin09:54:100
2644499913,28cyclictest4918-21latency_hist10:08:360
2644499913,26cyclictest3835-21/usr/sbin/munin10:59:140
2644499913,24cyclictest28898-21fschecks_time07:13:580
2644499912,28cyclictest12781-21ssh12:08:590
26444999110,12cyclictest0-21swapper/009:19:000
26454999060,19cyclictest10074-21sh09:23:372
26449999040,39cyclictest0-21swapper/112:03:361
2644499904,29cyclictest18528-21/usr/sbin/munin12:18:410
2644499903,33cyclictest20201-21/usr/sbin/munin10:33:490
2644499903,30cyclictest30583-21fschecks_count08:58:570
2644499903,28cyclictest4451-21latency_hist07:38:360
2644499902,28cyclictest20890-21sort08:28:560
26449998950,34cyclictest26442-21cyclictest07:54:011
26449998950,34cyclictest26442-21cyclictest07:54:011
2644499892,20cyclictest6164-21apt-get07:43:490
26454998844,37cyclictest2757-21cpu10:58:522
26449998850,32cyclictest911-21diskmemload10:56:451
188762880,6sleep20-21swapper/210:31:032
26449998738,42cyclictest22178-21sh09:43:331
26449998727,33cyclictest0-21swapper/109:44:291
26449998727,33cyclictest0-21swapper/109:44:291
26449998721,37cyclictest0-21swapper/110:14:241
26454998645,33cyclictest31971-21latency_hist10:53:362
2645499863,48cyclictest28729-21ssh11:40:552
2645499863,48cyclictest28729-21ssh11:40:552
26449998646,33cyclictest5741-21sh10:09:081
26454998558,16cyclictest13354-21sh09:28:512
26454998558,16cyclictest13354-21sh09:28:512
26454998541,37cyclictest911-21diskmemload09:14:582
2644999853,52cyclictest10818-21seq11:11:581
2644999853,52cyclictest10818-21seq11:11:581
2644999852,54cyclictest493-21seq11:48:411
2644999852,54cyclictest493-21seq11:48:411
26454998468,10cyclictest22771-21ssh10:38:332
26454998441,36cyclictest0-21swapper/212:03:542
26454998438,41cyclictest0-21swapper/210:04:092
26449998468,11cyclictest1-21systemd08:23:341
26449998467,11cyclictest9860-21kworker/u17:2-events_unbound10:39:031
26449998443,34cyclictest0-21swapper/110:28:591
2644999843,43cyclictest0-21swapper/110:03:491
26449998349,28cyclictest5924-21sh11:03:551
26449998341,36cyclictest911-21diskmemload09:24:221
26454998254,20cyclictest26291-21threads08:44:082
26454998254,20cyclictest26291-21threads08:44:082
26454998242,33cyclictest0-21swapper/209:34:302
26454998242,33cyclictest0-21swapper/209:34:302
26454998237,36cyclictest0-21swapper/209:43:442
26454998237,36cyclictest0-21swapper/209:43:442
2645499822,54cyclictest26937-21seq09:50:052
26449998261,16cyclictest26442-21cyclictest07:48:541
26449998245,29cyclictest0-21swapper/110:49:151
26449998237,34cyclictest0-21swapper/112:38:361
2644999823,68cyclictest0-21swapper/111:33:491
2644999823,49cyclictest2977-21fschecks_count10:58:581
26454998159,14cyclictest200-21systemd-journal11:26:452
26454998143,33cyclictest1449-21fschecks_count09:08:542
26454998143,33cyclictest1449-21fschecks_count09:08:542
26449998145,30cyclictest26636-21diskmemload10:43:591
26449998145,30cyclictest26636-21diskmemload10:43:591
26449998142,33cyclictest12460-21latency_hist08:03:361
26449998136,39cyclictest0-21swapper/112:28:341
26449998136,39cyclictest0-21swapper/112:28:341
2644999813,46cyclictest31659-21seq09:02:421
2644999812,67cyclictest0-21swapper/108:33:481
26454998062,11cyclictest317-21dbus-daemon12:23:342
26454998058,15cyclictest200-21systemd-journal11:06:462
26454998054,14cyclictest0-21swapper/212:14:062
26454998042,31cyclictest0-21swapper/210:38:462
26454998039,34cyclictest11212-21timerwakeupswit09:24:102
26454998039,34cyclictest0-21swapper/207:38:552
2645499803,66cyclictest0-21swapper/208:08:452
26454998033,39cyclictest0-21swapper/211:38:342
2645499802,48cyclictest343-21runrttasks12:11:472
2645499802,45cyclictest23148-21seq12:25:332
2645499802,45cyclictest23148-21seq12:25:332
26449998060,14cyclictest7057-21latency_hist09:18:361
26449998041,31cyclictest0-21swapper/107:18:331
26454997953,20cyclictest8525-21threads07:49:072
26449997939,32cyclictest0-21swapper/108:53:361
2644999793,62cyclictest32007-21apt-get09:03:461
26449997933,37cyclictest32165-21cut07:23:561
2646299783,37cyclictest12980-21taskset09:28:353
26454997837,36cyclictest0-21swapper/211:59:102
26449997858,10cyclictest0-21swapper/112:19:011
2644999783,70cyclictest0-21swapper/110:33:451
26449997835,35cyclictest0-21swapper/109:35:221
26449997835,35cyclictest0-21swapper/109:35:221
2644999782,67cyclictest0-21swapper/107:18:501
2644999782,42cyclictest911-21diskmemload09:22:081
2645499774,68cyclictest0-21swapper/208:03:472
26449997740,30cyclictest0-21swapper/111:18:351
2644999773,65cyclictest0-21swapper/108:23:491
26449997736,34cyclictest301ktimers/112:13:431
2646299763,32cyclictest22884-21chrt08:34:063
26454997649,18cyclictest0-21swapper/210:23:552
2645499764,62cyclictest29440-21wc07:14:112
26454997637,32cyclictest0-21swapper/211:28:532
26454997637,32cyclictest0-21swapper/211:28:532
2645499763,68cyclictest0-21swapper/211:53:472
26454997635,33cyclictest0-21swapper/208:38:582
2644999763,64cyclictest0-21swapper/108:48:481
26449997635,33cyclictest0-21swapper/109:53:361
2644999762,65cyclictest0-21swapper/107:29:081
2644999762,63cyclictest0-21swapper/107:43:441
2644999762,43cyclictest343-21runrttasks08:08:191
2646299754,31cyclictest8953-21chrt11:08:573
2646299754,31cyclictest8953-21chrt11:08:573
26454997557,13cyclictest1731-21sh10:56:492
2645499753,64cyclictest0-21swapper/212:28:472
26449997556,10cyclictest0-21swapper/110:19:101
2644999753,67cyclictest0-21swapper/109:58:451
2644999752,64cyclictest0-21swapper/107:08:501
26449997516,20cyclictest28227-21sendmail_mailqu11:40:331
26449997516,20cyclictest28227-21sendmail_mailqu11:40:331
26454997459,8cyclictest0-21swapper/207:08:532
26454997458,9cyclictest0-21swapper/208:23:592
26454997443,25cyclictest15206-21kworker/u17:0-nfsiod10:10:472
2645499743,61cyclictest11126-21apt-get10:18:442
26454997431,38cyclictest0-21swapper/211:18:522
26454997420,45cyclictest2928-21sshd11:52:462
26454997420,45cyclictest2928-21sshd11:52:462
26449997456,10cyclictest0-21swapper/108:13:331
2644999743,66cyclictest0-21swapper/109:53:491
2644999743,66cyclictest0-21swapper/109:53:491
2644999743,61cyclictest0-21swapper/108:53:491
26449997432,37cyclictest0-21swapper/110:23:491
2644999742,67cyclictest0-21swapper/108:43:481
2644999742,67cyclictest0-21swapper/108:43:481
26454997339,28cyclictest9714-21timerwakeupswit11:09:122
26454997339,28cyclictest9714-21timerwakeupswit11:09:122
26454997333,33cyclictest0-21swapper/208:19:052
26449997353,10cyclictest0-21swapper/111:43:521
26449997352,10cyclictest0-21swapper/108:18:371
26449997337,31cyclictest0-21swapper/111:53:541
2646299724,29cyclictest20046-21chrt09:39:013
2646299724,26cyclictest1145-21chrt07:28:373
2646299723,30cyclictest5982-21taskset07:43:363
2646299723,30cyclictest22525-21chrt10:37:533
2646299723,27cyclictest21557-21taskset11:29:113
2646299723,27cyclictest21557-21taskset11:29:113
26454997249,13cyclictest0-21swapper/208:33:562
2645499723,63cyclictest0-21swapper/209:03:462
26449997222,42cyclictest15396-21wc12:13:371
2646299714,31cyclictest13304-21chrt08:04:053
2646299714,27cyclictest25230-21chrt12:29:093
2646299713,26cyclictest16805-21chrt08:14:093
2646299712,28cyclictest31290-21chrt11:44:433
26454997153,11cyclictest0-21swapper/212:34:092
26454997132,32cyclictest0-21swapper/210:44:092
26454997132,32cyclictest0-21swapper/210:44:092
26449997153,12cyclictest26442-21cyclictest09:11:341
26449997153,12cyclictest26442-21cyclictest09:11:341
26449997153,11cyclictest0-21swapper/108:38:471
2646299704,26cyclictest27017-21chrt11:38:473
2646299704,26cyclictest27017-21chrt11:38:473
2646299702,32cyclictest25641-21taskset08:43:503
2646299702,32cyclictest25641-21taskset08:43:503
26454997053,12cyclictest31678-21systemd-run07:23:342
26454997052,13cyclictest31743-21munin-plugin-st09:03:352
26454997047,14cyclictest0-21swapper/207:43:592
2645499703,60cyclictest0-21swapper/207:23:452
2645499703,56cyclictest0-21swapper/207:58:472
26454997032,32cyclictest0-21swapper/208:28:562
26454997029,34cyclictest0-21swapper/209:39:012
26449997050,13cyclictest0-21swapper/112:03:491
2644999703,57cyclictest17744-21apt-get11:23:481
2646299697,13cyclictest0-21swapper/312:03:453
2646299693,27cyclictest30874-21chrt07:19:063
2645499693,61cyclictest0-21swapper/207:29:082
26454996927,37cyclictest0-21swapper/210:14:082
2646299683,30cyclictest27086-21taskset07:09:013
2646299683,27cyclictest18809-21chrt08:23:333
2646299683,23cyclictest17148-21chrt11:22:473
2646299682,28cyclictest30279-21chrt08:58:363
26454996847,14cyclictest26442-21cyclictest09:58:442
26454996847,10cyclictest0-21swapper/207:54:072
26454996847,10cyclictest0-21swapper/207:54:072
26454996845,11cyclictest0-21swapper/208:54:082
26454996835,26cyclictest0-21swapper/208:53:352
26454996835,26cyclictest0-21swapper/208:53:352
26454996824,39cyclictest0-21swapper/207:33:502
2644999684,59cyclictest0-21swapper/108:28:461
26449996844,7cyclictest181rcu_preempt07:38:491
2597426826,27sleep30-21swapper/307:04:223
2597426826,27sleep30-21swapper/307:04:223
2646299673,28cyclictest5680-21chrt09:15:093
2646299673,27cyclictest27905-21chrt09:52:473
2646299673,25cyclictest13621-21taskset10:23:063
2646299673,24cyclictest879-21taskset11:48:573
2646299673,24cyclictest879-21taskset11:48:573
2646299673,22cyclictest31749-21chrt09:58:553
2646299673,22cyclictest19566-21chrt10:32:593
2646299672,22cyclictest19111-21chrt12:19:003
26454996728,32cyclictest0-21swapper/208:18:352
2646299663,25cyclictest19601-21chrt08:24:023
2646299663,24cyclictest23743-21chrt11:33:453
2646299663,23cyclictest28343-21chrt12:34:073
2646299662,26cyclictest1233-21taskset09:08:453
2646299662,26cyclictest1233-21taskset09:08:453
2646299662,25cyclictest32756-21chrt10:54:063
2646299662,24cyclictest18689-21chrt09:37:193
2646299662,24cyclictest18689-21chrt09:37:193
2646299653,26cyclictest24274-21chrt10:39:193
2646299653,26cyclictest22925-21taskset12:24:553
2646299653,26cyclictest22925-21taskset12:24:553
2646299652,27cyclictest28458-21taskset10:47:383
2646299652,27cyclictest28458-21taskset10:47:383
2646299652,26cyclictest4317-21taskset07:38:343
2646299652,25cyclictest1560-21chrt07:29:143
2646299652,24cyclictest9891-21chrt10:16:053
2646299652,23cyclictest24542-21chrt09:46:473
2646299652,23cyclictest24542-21chrt09:46:473
2646299643,25cyclictest7328-21taskset10:12:203
2646299643,25cyclictest31201-21taskset10:51:553
2646299643,23cyclictest28679-21chrt07:13:473
2646299643,22cyclictest22042-21chrt08:33:333
2646299643,21cyclictest14350-21taskset08:08:513
2646299643,20cyclictest11093-21chrt07:58:513
2646299642,24cyclictest15585-21chrt10:25:133
2646299633,24cyclictest28474-21chrt08:53:303
2646299633,24cyclictest28474-21chrt08:53:303
2646299633,23cyclictest9037-21taskset09:21:053
2646299633,22cyclictest7978-21chrt12:00:033
2646299633,22cyclictest13198-21chrt09:28:393
2646299633,22cyclictest13198-21chrt09:28:393
2646299633,21cyclictest13629-21chrt12:09:153
2646299632,25cyclictest30334-21chrt09:56:113
2646299632,25cyclictest30334-21chrt09:56:113
2646299632,25cyclictest2112-21taskset10:03:453
2646299632,23cyclictest6167-21chrt07:43:443
2646299632,22cyclictest3869-21chrt11:53:553
2646299623,22cyclictest15817-21chrt12:13:533
2646299622,22cyclictest31535-21chrt09:01:033
2646299622,22cyclictest24274-21chrt08:38:563
2646299622,21cyclictest8268-21chrt11:08:123
2646299622,20cyclictest10219-21chrt07:54:093
2646299622,20cyclictest10219-21chrt07:54:093
2646299622,19cyclictest13645-21chrt11:16:273
2646299613,20cyclictest7911-21chrt07:48:503
2646299613,20cyclictest32017-21chrt09:03:513
2646299612,22cyclictest4764-21taskset11:01:483
2646299608,14cyclictest0-21swapper/311:23:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional