You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 16:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Mar 10, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18460211210,18sleep015-21ksoftirqd/007:05:340
18525991144,52cyclictest352-21runrttasks12:03:340
185329911365,40cyclictest277-21dbus-daemon11:45:321
185259911349,56cyclictest200-21systemd-journal09:30:330
185259911136,10cyclictest0-21swapper/010:36:050
185259911136,10cyclictest0-21swapper/010:36:050
185329910950,51cyclictest0-21swapper/108:20:491
18525991083,31cyclictest4754-21fschecks_count12:05:520
18525991083,31cyclictest4754-21fschecks_count12:05:520
18525991063,47cyclictest12456-21fschecks_count09:35:540
185259910628,13cyclictest0-21swapper/012:26:080
185259910622,28cyclictest25924-21diskmemload11:56:030
185259910444,54cyclictest12114-21unixbench_singl08:21:090
185259910442,54cyclictest0-21swapper/009:20:310
18525991033,40cyclictest15735-21ssh11:30:470
18525991033,40cyclictest15735-21ssh11:30:470
18525991033,36cyclictest7339-21/usr/sbin/munin11:15:590
18525991033,28cyclictest23053-21ssh11:41:350
18525991023,38cyclictest352-21runrttasks12:30:590
18525991023,37cyclictest12929-21ssh11:25:490
18525991023,36cyclictest32088-21latency_hist09:15:340
18525991023,32cyclictest21080-21/usr/sbin/munin09:51:010
185259910221,22cyclictest6688-21sort11:15:340
185259910221,22cyclictest6688-21sort11:15:340
2610021010,7sleep20-21swapper/209:58:402
18525991014,37cyclictest10011-21ssh09:31:210
185259910135,11cyclictest0-21swapper/008:00:310
18525991013,45cyclictest352-21runrttasks08:57:110
18525991013,33cyclictest3527-21/usr/sbin/munin10:15:530
18525991012,29cyclictest30904-21cat11:55:340
18525991005,19cyclictest18802-21proc_pri09:46:030
18525991004,35cyclictest30909-21ntpq11:00:590
185259910038,55cyclictest200-21systemd-journal08:10:310
18525991003,39cyclictest21141-21wc10:45:330
18525991003,36cyclictest10697-21/usr/sbin/munin12:16:300
18525991003,29cyclictest23948-21cat07:20:350
18525991003,29cyclictest23948-21cat07:20:350
1852599995,37cyclictest27500-21fschecks_time07:30:560
1852599995,37cyclictest27500-21fschecks_time07:30:560
1852599994,35cyclictest515-21/usr/sbin/munin10:10:500
1852599993,39cyclictest30190-21latency_hist11:00:340
1852599993,36cyclictest31079-21find07:41:040
1852599993,35cyclictest32212-21df07:45:490
1852599993,35cyclictest25604-21/usr/sbin/munin07:26:000
1852599993,35cyclictest10372-21apt-config12:15:340
1852599993,35cyclictest10372-21apt-config12:15:340
1852599993,34cyclictest15840-21latency_hist08:35:340
18525999930,8cyclictest0-21swapper/008:10:490
18525999930,11cyclictest0-21swapper/010:30:470
18525999923,20cyclictest25919-21sort11:46:060
18525999923,20cyclictest25919-21sort11:46:060
182542997,71sleep10-21swapper/107:03:401
1853299983,69cyclictest24064-21apt-get09:00:491
1852599985,27cyclictest18919-21/usr/sbin/munin11:35:410
1852599984,35cyclictest3626-21latency_hist11:10:340
18525999838,52cyclictest0-21swapper/007:36:060
18525999838,52cyclictest0-21swapper/007:36:060
1852599983,34cyclictest13683-21unixbench_multi08:26:060
1852599983,34cyclictest13683-21unixbench_multi08:26:060
18525999825,12cyclictest0-21swapper/011:20:480
18525999825,12cyclictest0-21swapper/011:20:480
18525999825,12cyclictest0-21swapper/010:05:480
1852599982,38cyclictest24646-21grep10:50:540
274852970,6sleep30-21swapper/307:30:563
274852970,6sleep30-21swapper/307:30:563
1852599974,36cyclictest26020-21latency_hist09:05:340
1852599974,34cyclictest19020-21/usr/sbin/munin08:45:320
1852599974,31cyclictest4911-21cut08:00:540
1852599974,31cyclictest15474-21fschecks_time09:40:520
18525999739,51cyclictest26650-21kernelversion09:05:560
1852599973,34cyclictest352-21runrttasks10:02:170
1852599973,33cyclictest6797-21taskset10:20:530
1852599973,30cyclictest23996-21/usr/sbin/munin07:20:500
1852599973,29cyclictest16960-21grep08:36:070
1852599972,40cyclictest9549-21/usr/sbin/munin08:16:030
1852599972,33cyclictest21839-21latency10:45:560
1852599972,33cyclictest21839-21latency10:45:560
1852599972,33cyclictest21068-21/usr/sbin/munin08:51:040
1852599972,33cyclictest13657-21/usr/sbin/munin12:20:560
18536999616,56cyclictest10718-21apt-get12:15:472
1852599963,37cyclictest18712-21/usr/sbin/munin07:06:000
1852599963,33cyclictest352-21runrttasks09:22:060
18525999612,27cyclictest0-21swapper/010:30:040
1852599954,29cyclictest19457-21/usr/sbin/munin08:46:160
1852599953,34cyclictest24083-21/usr/sbin/munin09:56:030
1852599953,28cyclictest1578-21kernelversion07:50:570
18536999375,12cyclictest18116-21idleruntime-cro10:40:312
18536999375,12cyclictest18116-21idleruntime-cro10:40:312
1852599923,33cyclictest20752-21/usr/sbin/munin07:11:000
1852599923,33cyclictest20752-21/usr/sbin/munin07:11:000
18536998973,9cyclictest0-21swapper/209:30:462
18536998962,19cyclictest22120-21latency_hist07:15:352
18536998962,19cyclictest22120-21latency_hist07:15:352
18532998952,31cyclictest25276-21timerandwakeup10:51:081
18532998952,30cyclictest300-21rs:main1
1853299893,76cyclictest32484-21apt-get09:15:471
1853299893,30cyclictest12186-21/usr/sbin/munin09:35:501
18536998766,15cyclictest30811-21latency_hist11:55:332
18532998769,12cyclictest7170-21kworker/u17:3-rpciod12:21:081
18536998663,16cyclictest18516-21cyclictest08:01:092
1853299863,34cyclictest4530-21/usr/sbin/munin11:11:041
1853299863,34cyclictest4530-21/usr/sbin/munin11:11:041
1853299862,34cyclictest15161-21ssh11:29:551
18532998547,33cyclictest0-21swapper/111:56:031
18532998543,35cyclictest0-21swapper/112:11:041
18532998543,35cyclictest0-21swapper/112:11:041
18532998541,36cyclictest0-21swapper/110:34:291
1853299853,37cyclictest9767-21sort10:25:531
1853299853,36cyclictest19126-21/usr/sbin/munin10:41:061
1853299852,39cyclictest9312-21ssh09:30:591
18532998466,12cyclictest19676-21snmpd08:50:491
1853299844,8cyclictest0-21swapper/112:05:421
1853299844,8cyclictest0-21swapper/112:05:421
1853299843,40cyclictest19475-21apt-get08:45:461
1853299843,38cyclictest27745-21latency_hist11:50:341
1853299843,38cyclictest27745-21latency_hist11:50:341
1853299843,36cyclictest3562-21sh10:15:421
1853299843,33cyclictest16688-21cut08:36:041
1853299843,27cyclictest2636-21grep12:01:091
1853299842,39cyclictest22161-21modprobe07:15:321
1853299842,39cyclictest22161-21modprobe07:15:321
1853299842,37cyclictest3977-21/usr/sbin/munin07:56:481
1853299842,37cyclictest12000-21sendmail_mailst12:17:401
1853299842,31cyclictest12218-21seq11:24:561
1853299842,31cyclictest12218-21seq11:24:561
18536998365,12cyclictest9150-21latency_hist09:30:362
18532998365,13cyclictest18516-21cyclictest08:10:321
18532998362,15cyclictest803-21sendmail-mta10:02:181
1853299834,7cyclictest0-21swapper/109:40:441
1853299833,69cyclictest27393-21ssh10:55:461
1853299833,36cyclictest14830-21/usr/sbin/munin08:30:581
1853299833,23cyclictest2002-21seq10:12:081
1853299832,36cyclictest20810-21ssh11:38:201
18536998261,15cyclictest21376-21/usr/sbin/munin10:46:052
18536998261,15cyclictest21376-21/usr/sbin/munin10:46:052
18532998239,36cyclictest25924-21diskmemload12:30:541
1853299823,35cyclictest24066-21/usr/sbin/munin07:20:481
1853299823,32cyclictest7490-21/usr/sbin/munin11:16:051
1853299814,8cyclictest0-21swapper/107:40:431
1853299814,33cyclictest16238-21netstat11:31:001
1853299814,33cyclictest16238-21netstat11:31:001
1853299813,7cyclictest0-21swapper/110:20:431
1853299813,36cyclictest1040-21/usr/sbin/munin11:05:521
1853299813,33cyclictest28023-21/usr/sbin/munin11:50:461
1853299813,33cyclictest26469-21fschecks_count09:05:521
18532998132,39cyclictest0-21swapper/110:40:351
18532998132,39cyclictest0-21swapper/110:40:351
1853299812,33cyclictest19295-21ssh09:46:181
18536998063,11cyclictest297-21systemd-logind07:35:332
18536998063,11cyclictest297-21systemd-logind07:35:332
1853699803,52cyclictest24567-21apt-get09:00:572
1853299807,30cyclictest16843-21sh12:25:511
18532998062,13cyclictest31272-21sh09:13:451
1853299804,7cyclictest0-21swapper/108:40:461
1853299803,45cyclictest25924-21diskmemload10:45:421
1853299803,45cyclictest25924-21diskmemload10:45:421
1853299803,41cyclictest31043-21grep10:06:081
1853299803,36cyclictest8687-21munin-run09:30:311
1853299803,36cyclictest20062-21modprobe07:10:311
1853299802,37cyclictest30358-21ssh11:00:461
1853299802,35cyclictest4883-21/usr/sbin/munin08:00:541
1853299802,34cyclictest27455-21fschecks_time07:30:561
1853299802,34cyclictest27455-21fschecks_time07:30:561
1853299802,30cyclictest21272-21expr09:50:481
18536997952,19cyclictest31910-21modprobe09:15:312
18536997927,39cyclictest25397-21cat07:25:332
1853299793,31cyclictest22735-21if_eth007:15:541
1853299793,31cyclictest22735-21if_eth007:15:541
1853299792,40cyclictest24135-21ssh09:55:481
1853299792,33cyclictest10996-21latency_hist08:20:341
1853299792,26cyclictest2897-21latency_hist07:55:351
1853299784,32cyclictest25631-21/usr/sbin/munin07:25:491
1853299783,32cyclictest30304-21latency_hist07:40:341
1853299783,32cyclictest30304-21latency_hist07:40:341
18532997821,48cyclictest14339-21latency_hist08:30:351
18532997821,48cyclictest14339-21latency_hist08:30:351
18536997758,13cyclictest1-21systemd07:55:312
1853299772,34cyclictest23037-21/usr/sbin/munin08:55:541
1853299772,32cyclictest2923-21/usr/sbin/munin09:21:081
18536997648,19cyclictest10580-21sh11:21:062
18536997648,19cyclictest10580-21sh11:21:062
18536997646,21cyclictest26374-21threads07:26:072
18536997621,41cyclictest1017-21latency10:10:552
1853299763,22cyclictest8144-21fschecks_time08:10:531
1825027524,18sleep2181rcu_preempt07:03:372
18536997452,16cyclictest18516-21cyclictest09:36:072
1854399732,47cyclictest0-21swapper/311:35:393
18536997356,12cyclictest8729-21sh10:24:162
18536997352,13cyclictest23752-21idleruntime-cro07:20:312
18536997352,13cyclictest23752-21idleruntime-cro07:20:312
18536997251,15cyclictest3911-21threads07:56:472
18536997242,22cyclictest15175-21timerandwakeup08:31:072
18536997240,22cyclictest10491-21apt-key12:15:362
18536997240,22cyclictest10491-21apt-key12:15:362
18536997239,24cyclictest11365-21cut08:20:542
1853699718,47cyclictest32574-21ssh09:15:562
18536997153,8cyclictest0-21swapper/209:54:312
1853699714,51cyclictest32070-21apt-get07:45:432
18536997144,16cyclictest25924-21diskmemload10:40:572
1853699706,45cyclictest22180-21sh11:40:522
18536997052,12cyclictest200-21systemd-journal10:35:112
18536997051,13cyclictest17813-21latency_hist09:45:342
18536997049,13cyclictest25924-21diskmemload10:27:342
18536997045,19cyclictest18138-21sh12:27:172
18536997044,20cyclictest12788-21cpu08:25:472
18536997044,20cyclictest12788-21cpu08:25:472
1853699704,35cyclictest9549-21/usr/sbin/munin08:16:062
18536997043,19cyclictest1929-21sh11:06:092
18536997032,9cyclictest0-21swapper/211:36:322
1854399693,51cyclictest6602-21chrt09:26:003
1853699698,51cyclictest27740-21apt11:50:312
1853699698,51cyclictest27740-21apt11:50:312
1853699693,42cyclictest18739-21wc11:35:352
1853699693,42cyclictest18739-21wc11:35:352
1854399682,53cyclictest22151-21taskset11:40:453
1854399682,52cyclictest8638-21taskset11:18:103
1854399674,48cyclictest18069-21chrt08:40:593
1854399673,51cyclictest18448-21chrt10:40:453
18536996744,16cyclictest0-21swapper/208:45:332
18536996741,18cyclictest0-21swapper/208:55:342
1853699673,41cyclictest26614-21/usr/sbin/munin09:05:552
1853699672,43cyclictest4397-21switchtime10:16:042
18536996724,32cyclictest19521-21cpu08:46:062
18536996722,9cyclictest381ktimers/208:11:052
1854399662,50cyclictest8953-21taskset08:11:383
1854399662,49cyclictest5838-21taskset12:06:453
1854399662,49cyclictest5838-21taskset12:06:453
18536996648,12cyclictest352-21runrttasks12:04:542
1853699664,42cyclictest19938-21fschecks_time12:30:542
18536996644,12cyclictest0-21swapper/208:10:342
18536996644,11cyclictest0-21swapper/210:56:052
18536996643,15cyclictest13657-21/usr/sbin/munin12:20:542
18536996638,19cyclictest0-21swapper/212:10:342
18536996638,19cyclictest0-21swapper/212:10:342
1853699663,46cyclictest742-21latency_hist11:05:352
1854399653,49cyclictest2174-21chrt12:01:013
1854399653,48cyclictest25630-21chrt10:51:353
1854399653,48cyclictest16624-21taskset09:42:113
1854399652,50cyclictest14737-21chrt12:21:093
1854399652,49cyclictest5156-21taskset11:11:503
1854399652,49cyclictest5156-21taskset11:11:503
1854399652,49cyclictest12751-21chrt08:25:363
1854399652,49cyclictest12751-21chrt08:25:363
18536996542,14cyclictest11540-21kworker/u18:0-nfsiod11:15:432
1853699653,43cyclictest31850-21latency_hist07:45:332
1736226512,32sleep30-21swapper/307:01:013
1854399644,48cyclictest32513-21chrt09:15:463
1854399643,48cyclictest4718-21chrt08:00:453
1854399643,48cyclictest30876-21chrt09:12:383
1854399643,48cyclictest25360-21chrt09:56:343
1854399643,47cyclictest10674-21chrt12:15:373
1854399642,49cyclictest21596-21chrt12:33:373
1854399642,49cyclictest16842-21chrt12:25:513
1854399642,48cyclictest2530-21chrt10:13:373
1853699644,50cyclictest3785-21/usr/sbin/munin11:10:542
1853699644,50cyclictest3785-21/usr/sbin/munin11:10:542
1853699643,40cyclictest32696-21idleruntime-cro10:10:312
1854399633,48cyclictest28844-21taskset10:03:033
1854399633,47cyclictest32259-21chrt10:09:193
1854399633,47cyclictest28130-21taskset09:08:203
1854399632,49cyclictest5097-21chrt09:23:533
1854399632,49cyclictest14106-21taskset11:26:543
1854399632,48cyclictest30810-21chrt07:40:563
1854399632,48cyclictest25388-21chrt11:45:533
1854399632,48cyclictest25388-21chrt11:45:533
1854399632,48cyclictest24090-21chrt09:00:323
1854399632,46cyclictest32051-21taskset11:02:543
1853699635,38cyclictest24069-21ls09:00:322
18536996347,10cyclictest13045-21perl11:25:532
18536996344,9cyclictest0-21swapper/209:45:542
18536996344,14cyclictest0-21swapper/209:21:172
18536996343,13cyclictest0-21swapper/212:00:332
1854399623,47cyclictest28102-21chrt10:56:053
1854399623,46cyclictest10678-21chrt10:26:223
1854399622,48cyclictest18008-21chrt10:40:163
1854399622,48cyclictest18008-21chrt10:40:163
1854399622,47cyclictest30470-21taskset11:54:533
1854399622,47cyclictest24022-21taskset07:20:473
1854399622,47cyclictest19863-21taskset09:47:543
1854399622,47cyclictest17356-21taskset11:32:413
1854399622,47cyclictest17356-21taskset11:32:413
1854399622,47cyclictest14482-21chrt09:39:313
1854399622,46cyclictest29192-21chrt07:35:543
1854399622,46cyclictest29192-21chrt07:35:543
1854399613,46cyclictest25739-21chrt07:25:503
1854399613,45cyclictest9861-21chrt09:31:163
1854399613,44cyclictest19480-21taskset08:45:443
1854399612,47cyclictest4061-21chrt10:15:563
1854399612,47cyclictest12282-21taskset08:22:403
1854399612,46cyclictest24983-21chrt09:01:523
1854399612,46cyclictest22646-21taskset10:46:323
1854399612,46cyclictest22646-21taskset10:46:323
1854399612,45cyclictest0-21swapper/307:45:463
18536996138,14cyclictest0-21swapper/207:36:042
18536996138,14cyclictest0-21swapper/207:36:042
1853699613,34cyclictest19005-21fschecks_time07:05:542
1853699612,23cyclictest25960-21ssh10:52:302
1854399603,45cyclictest19966-21chrt07:09:213
1854399603,44cyclictest8436-21chrt10:23:263
1854399603,44cyclictest31233-21chrt11:55:503
1854399603,44cyclictest21799-21chrt07:11:403
1854399603,44cyclictest21799-21chrt07:11:403
1854399603,44cyclictest15694-21taskset08:35:203
1854399602,46cyclictest8011-21chrt12:10:593
1854399602,46cyclictest8011-21chrt12:10:593
1854399602,46cyclictest12866-21chrt10:30:563
1854399602,45cyclictest2507-21chrt07:54:583
1854399602,45cyclictest22436-21chrt09:51:483
1854399602,44cyclictest4354-21taskset07:59:313
1854399602,43cyclictest6321-21taskset08:05:433
1853699603,42cyclictest16910-21unixbench_multi08:36:062
1854399592,46cyclictest9749-21chrt11:20:373
1854399592,46cyclictest9749-21chrt11:20:373
1854399592,45cyclictest22242-21taskset08:53:193
1853699594,40cyclictest27382-21tune2fs10:00:542
1854399583,44cyclictest0-21swapper/311:05:423
1854399583,44cyclictest0-21swapper/308:35:433
1854399582,44cyclictest23514-21chrt07:17:403
1854399582,44cyclictest23514-21chrt07:17:403
1854399582,43cyclictest10585-21chrt08:16:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional