You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 18:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Apr 07, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1938213911,31sleep21981-21df06:59:362
1800212612,80sleep01284-21apt-get06:59:010
32719911563,45cyclictest0-21swapper/010:53:560
1839221150,7sleep22898-21kworker/u19:2+rpciod11:03:422
3271991134,37cyclictest32186-21switchtime12:19:150
3271991132,31cyclictest30905-21/usr/sbin/munin11:24:030
3271991132,31cyclictest30905-21/usr/sbin/munin11:24:030
3271991103,34cyclictest23743-21cpuspeed10:18:540
3271991103,34cyclictest23743-21cpuspeed10:18:540
3271991093,29cyclictest16197-21/usr/sbin/munin10:59:110
32719910932,8cyclictest0-21swapper/009:08:430
32719910932,8cyclictest0-21swapper/009:08:430
32719910914,34cyclictest916-21latency_hist08:33:440
32719910836,7cyclictest0-21swapper/009:59:150
32719910835,64cyclictest0-21swapper/011:18:430
32719910734,12cyclictest0-21swapper/012:24:020
32719910639,60cyclictest0-21swapper/011:09:180
32719910639,60cyclictest0-21swapper/011:09:180
32719910635,9cyclictest0-21swapper/011:30:350
32719910632,9cyclictest0-21swapper/009:34:070
32719910632,9cyclictest0-21swapper/009:34:070
3271991054,42cyclictest20597-21ntp_offset09:19:090
3271991053,36cyclictest15191-21cpu07:38:570
3271991053,32cyclictest9993-21/usr/sbin/munin10:49:150
3271991053,32cyclictest9993-21/usr/sbin/munin10:49:150
3271991053,32cyclictest8774-21cpu07:18:560
3271991052,34cyclictest19559-21fschecks_count11:59:000
3271991052,30cyclictest6040-21ls09:49:050
32719910450,47cyclictest26519-21ssh12:09:310
3271991043,32cyclictest5116-21fschecks_count12:29:000
32719910430,18cyclictest20284-21fschecks_time07:54:030
3271991042,23cyclictest23143-21switchtime12:04:130
32719910346,50cyclictest27511-21ssh10:24:140
32719910337,8cyclictest0-21swapper/008:14:020
3271991033,39cyclictest2952-21systemd-journal08:23:430
3271991032,34cyclictest30779-21chrt10:29:200
3271991024,36cyclictest6476-21fschecks_count10:44:010
3271991024,22cyclictest10643-21fschecks_time11:44:020
3271991024,22cyclictest10643-21fschecks_time11:44:020
3271991023,37cyclictest14245-21sort09:09:020
3271991023,37cyclictest14245-21sort09:09:020
32719910231,14cyclictest0-21swapper/007:59:150
3271991022,30cyclictest16615-21/usr/sbin/munin11:54:010
3271991022,30cyclictest16615-21/usr/sbin/munin11:54:010
3271991013,36cyclictest23414-21grep08:04:010
3271991013,36cyclictest18470-21/usr/sbin/munin11:03:580
3271991013,34cyclictest17037-21fschecks_time07:44:010
32719910127,66cyclictest0-21swapper/011:53:420
3271991012,37cyclictest19964-21latency_hist07:53:440
3271991012,35cyclictest4400-21grep07:04:160
3271991012,33cyclictest10075-21latency_hist11:43:410
299421015,15sleep10-21swapper/107:02:081
3271991003,42cyclictest5530-21modprobe08:48:390
3271991003,38cyclictest489-21fschecks_time10:34:010
3271991003,38cyclictest489-21fschecks_time10:34:010
3271991003,35cyclictest2801-21grep09:44:010
3271991003,32cyclictest18621-21grep10:09:170
3271991002,36cyclictest31137-21latency_hist12:18:420
3271991002,31cyclictest5911-21latency_hist10:43:430
327199993,35cyclictest5738-21fschecks_time07:09:040
327199993,35cyclictest24832-21/usr/sbin/munin08:09:070
327199993,34cyclictest9175-21sed09:54:080
327199993,32cyclictest9672-21latency08:59:030
327199993,31cyclictest12194-21fschecks_time07:29:010
3271999933,10cyclictest0-21swapper/011:19:390
3271999933,10cyclictest0-21swapper/011:19:390
327199993,29cyclictest8090-21kernelversion08:54:410
327199993,29cyclictest8090-21kernelversion08:54:410
327199992,32cyclictest3211-21cat08:39:140
327199992,32cyclictest13557-21/usr/sbin/munin07:34:170
327199992,24cyclictest32001-21/usr/sbin/munin09:39:200
327199983,36cyclictest17540-21latency_hist10:08:430
327199983,35cyclictest7387-21fschecks_time07:14:010
327199983,35cyclictest22974-21/usr/sbin/munin09:24:020
327199983,35cyclictest22974-21/usr/sbin/munin09:24:020
327199983,33cyclictest6750-21grep08:49:150
327199983,31cyclictest21322-21proc_pri10:14:120
3271999824,13cyclictest0-21swapper/008:35:040
3271999814,25cyclictest28871-21cut09:33:430
3280999726,33cyclictest0-21swapper/110:49:141
3280999726,33cyclictest0-21swapper/110:49:141
327199973,33cyclictest4596-21fschecks_count11:34:030
327199973,32cyclictest16983-21/usr/sbin/munin09:14:070
3271999725,16cyclictest0-21swapper/007:24:060
328999963,67cyclictest985-21modprobe08:34:002
327199962,72cyclictest29196-21timerandwakeup08:20:110
3289999367,19cyclictest544-21cron11:43:392
3280999345,22cyclictest365-21ntpd10:44:071
3280999068,14cyclictest31297-21idleruntime-cro08:28:401
329699894,38cyclictest26350-21taskset10:23:403
329699894,38cyclictest26350-21taskset10:23:403
328999896,65cyclictest12497-21apt-get10:53:582
3289998927,35cyclictest39-21ksoftirqd/207:34:272
328999885,29cyclictest39-21ksoftirqd/212:14:152
328999878,67cyclictest1297-21apt-get11:28:532
328999872,56cyclictest39-21ksoftirqd/210:05:532
3289998718,29cyclictest39-21ksoftirqd/210:09:432
3289998658,12cyclictest181rcu_preempt12:24:102
3289998640,16cyclictest181rcu_preempt12:10:352
329699853,37cyclictest6454-21taskset07:09:193
329699852,34cyclictest17429-21chrt09:14:063
3289998446,15cyclictest181rcu_preempt08:12:212
3280998435,35cyclictest462-21wc09:39:161
329699833,32cyclictest22674-21chrt12:04:023
3289998316,46cyclictest39-21ksoftirqd/208:57:132
3289998316,46cyclictest39-21ksoftirqd/208:57:132
3289998315,39cyclictest39-21ksoftirqd/209:09:022
3289998315,39cyclictest39-21ksoftirqd/209:09:022
328099833,60cyclictest755-21apt-get11:28:531
3289998256,19cyclictest22489-21timerwakeupswit07:59:172
3280998266,10cyclictest20573-21ssh10:13:441
3280998261,15cyclictest21227-21sh09:19:381
329699813,33cyclictest9060-21chrt08:58:423
329699813,33cyclictest9060-21chrt08:58:423
3289998155,20cyclictest2758-21fschecks_count08:39:022
328999812,46cyclictest39-21ksoftirqd/209:46:042
329699802,33cyclictest22112-21chrt07:59:083
3289998051,20cyclictest5684-21fschecks_count07:09:042
3289998028,19cyclictest0-21swapper/212:01:152
328999796,28cyclictest381ktimers/210:23:332
328999796,28cyclictest381ktimers/210:23:332
3289997939,13cyclictest181rcu_preempt09:35:102
3289997939,13cyclictest181rcu_preempt09:35:102
3289997917,35cyclictest39-21ksoftirqd/209:43:002
3289997915,29cyclictest39-21ksoftirqd/208:45:472
329699784,33cyclictest13341-21chrt11:48:543
329699783,32cyclictest3304-21chrt07:03:443
329699783,31cyclictest26733-21taskset08:14:023
3289997852,17cyclictest352-21runrttasks10:14:032
328999782,53cyclictest15157-21kworker/u17:2+ext4-rsv-conversion08:19:032
3280997858,13cyclictest10642-21diskmemload12:13:401
3280997854,17cyclictest277-21dbus-daemon09:08:421
3280997854,17cyclictest277-21dbus-daemon09:08:421
329699773,33cyclictest2650-21chrt10:37:583
329699773,33cyclictest2650-21chrt10:37:583
329699773,31cyclictest7106-21taskset10:44:143
328999772,29cyclictest39-21ksoftirqd/211:08:302
3289997722,33cyclictest0-21swapper/212:08:372
3280997761,10cyclictest10642-21diskmemload11:18:581
3280997761,10cyclictest10642-21diskmemload11:18:581
3280997754,15cyclictest1-21systemd11:27:211
3280997754,15cyclictest1-21systemd11:27:211
3289997655,8cyclictest181rcu_preempt11:08:492
3289997655,8cyclictest181rcu_preempt11:08:492
3289997647,8cyclictest181rcu_preempt09:29:532
3289997637,13cyclictest181rcu_preempt12:31:542
3289997617,35cyclictest39-21ksoftirqd/211:37:362
3289997610,41cyclictest39-21ksoftirqd/209:27:002
3289997610,41cyclictest39-21ksoftirqd/209:27:002
3289997548,8cyclictest181rcu_preempt12:23:102
328999754,52cyclictest8503-21latency_hist07:18:422
3280997557,13cyclictest32334-21idleruntime-cro10:33:391
3280997554,15cyclictest13445-21latency_hist07:33:431
329699749,41cyclictest0-21swapper/311:29:123
3289997449,9cyclictest181rcu_preempt11:49:112
3289997435,16cyclictest181rcu_preempt07:52:232
3289997432,12cyclictest181rcu_preempt09:50:102
3289997410,41cyclictest19680-21apt09:18:392
3280997448,17cyclictest7856-21needreboot11:39:081
3280997448,16cyclictest0-21swapper/109:48:421
3280997424,21cyclictest0-21swapper/109:54:091
3280997421,19cyclictest10642-21diskmemload11:06:121
3280997414,44cyclictest28335-21apt-get08:19:031
329699733,34cyclictest5533-21chrt12:29:103
3289997340,12cyclictest181rcu_preempt07:30:102
3289997335,11cyclictest181rcu_preempt07:58:252
3289997328,9cyclictest181rcu_preempt09:21:012
3280997350,15cyclictest2952-21systemd-journal11:58:211
3280997350,15cyclictest2952-21systemd-journal11:58:211
3280997347,17cyclictest2655-21mailstats12:24:131
3280997311,47cyclictest437-21apt-get08:33:541
3289997250,7cyclictest181rcu_preempt10:52:412
3289997250,7cyclictest181rcu_preempt10:52:412
3289997239,14cyclictest181rcu_preempt08:25:092
328999723,43cyclictest39-21ksoftirqd/210:39:252
3289997219,30cyclictest39-21ksoftirqd/207:26:252
3280997252,14cyclictest22028-21idleruntime-cro12:03:391
3280997252,11cyclictest17281-21fschecks_time09:14:021
3280997219,41cyclictest11089-21systemctl11:44:131
3280997219,41cyclictest11089-21systemctl11:44:131
3289997135,13cyclictest181rcu_preempt10:28:382
328999712,47cyclictest39-21ksoftirqd/210:28:582
328999712,44cyclictest39-21ksoftirqd/209:58:062
3289997115,35cyclictest39-21ksoftirqd/207:19:162
3280997153,12cyclictest10642-21diskmemload12:14:021
328999708,39cyclictest39-21ksoftirqd/209:00:002
328999705,42cyclictest352-21runrttasks08:51:342
3289997049,14cyclictest2952-21systemd-journal10:44:202
3289997037,15cyclictest181rcu_preempt10:35:432
3289997037,15cyclictest181rcu_preempt10:35:432
3289997019,24cyclictest0-21swapper/211:56:102
3289997019,24cyclictest0-21swapper/211:56:102
3289997015,32cyclictest39-21ksoftirqd/208:14:282
3280997050,14cyclictest27428-21sh10:24:141
3280997044,18cyclictest0-21swapper/110:19:141
3280997044,18cyclictest0-21swapper/110:19:141
3289996950,13cyclictest1061-21apt-key11:28:432
3289996950,13cyclictest1061-21apt-key11:28:432
3289996945,12cyclictest181rcu_preempt09:05:252
3289996945,12cyclictest181rcu_preempt09:05:252
3289996941,8cyclictest181rcu_preempt11:20:152
3289996941,8cyclictest181rcu_preempt11:20:152
328999693,29cyclictest18117-21modprobe07:48:402
3289996913,29cyclictest39-21ksoftirqd/208:07:232
3280996954,8cyclictest0-21swapper/110:14:161
3280996952,11cyclictest5913-21sh12:29:151
3280996951,12cyclictest14327-21unin-run10:03:411
3280996920,21cyclictest0-21swapper/112:08:021
328099691,36cyclictest884-21cat08:33:441
3289996840,10cyclictest181rcu_preempt07:39:592
328999683,43cyclictest10604-21fschecks_time11:44:012
328999683,43cyclictest10604-21fschecks_time11:44:012
3289996821,16cyclictest0-21swapper/207:06:012
3280996854,10cyclictest3259-21cyclictest11:37:041
3280996851,11cyclictest297-21systemd-logind07:58:401
3280996832,9cyclictest181rcu_preempt07:39:171
328099683,26cyclictest5380-21cut07:08:511
328999674,35cyclictest12469-21timerandwakeup09:59:142
3289996734,9cyclictest181rcu_preempt11:17:042
3280996751,9cyclictest0-21swapper/111:53:391
3280996750,10cyclictest0-21swapper/109:24:011
3280996750,10cyclictest0-21swapper/109:24:011
3280996744,15cyclictest352-21runrttasks11:17:591
3280996740,18cyclictest0-21swapper/107:04:041
3280996734,14cyclictest23256-21cpu08:03:561
328099672,27cyclictest10642-21diskmemload10:39:111
3280996714,21cyclictest0-21swapper/109:52:091
328999662,46cyclictest31957-21latency08:29:052
3280996647,13cyclictest10642-21diskmemload11:09:551
3280996647,13cyclictest10642-21diskmemload11:09:551
3280996646,14cyclictest7460-21apt-key08:53:441
328099664,45cyclictest5114-21sed08:44:161
3280996644,16cyclictest10642-21diskmemload10:58:421
3280996636,20cyclictest0-21swapper/108:18:431
328099663,41cyclictest10228-21latency_hist07:23:431
329699657,25cyclictest0-21swapper/310:53:563
328099653,43cyclictest23170-21latency_hist08:03:431
3296996411,41cyclictest0-21swapper/308:18:543
328099644,41cyclictest9267-21/usr/sbin/munin08:59:101
3280996441,13cyclictest0-21swapper/109:09:171
3280996441,13cyclictest0-21swapper/109:09:171
328099643,41cyclictest17536-21find07:44:141
3280996352,7cyclictest0-21swapper/108:53:561
3280996352,7cyclictest0-21swapper/108:53:561
328099633,34cyclictest11833-21latency_hist07:28:431
328099632,46cyclictest18902-21ntp_kernel_pll_07:49:061
328099632,24cyclictest10642-21diskmemload10:34:071
328099632,24cyclictest10642-21diskmemload10:34:071
3280996246,10cyclictest277-21dbus-daemon09:33:401
328099623,40cyclictest3292-21ls08:39:151
328099623,39cyclictest30066-21unixbench_singl09:34:161
328099623,39cyclictest30066-21unixbench_singl09:34:161
328099622,50cyclictest13576-21apt-get07:33:531
3280996219,21cyclictest0-21swapper/110:04:371
3280996218,22cyclictest7911-21timerandwakeup07:14:141
3280996040,11cyclictest352-21runrttasks10:58:581
3280996037,15cyclictest21909-21kworker/u19:0-rpciod12:18:581
328099603,38cyclictest26390-21latency_hist08:13:431
329699584,39cyclictest14848-21taskset09:09:153
329699584,39cyclictest14848-21taskset09:09:153
329699582,41cyclictest20196-21chrt07:54:023
329699574,39cyclictest23026-21chrt09:23:553
329699574,39cyclictest23026-21chrt09:23:553
329699563,41cyclictest20661-21chrt11:59:523
329699553,38cyclictest31334-21chrt09:37:403
329699553,38cyclictest31334-21chrt09:37:403
329699553,36cyclictest10430-21taskset11:43:563
329699553,36cyclictest10430-21taskset11:43:563
329699553,35cyclictest17774-21taskset07:44:183
329699553,35cyclictest15829-21chrt10:59:013
329699544,35cyclictest23379-21chrt10:18:413
329699543,39cyclictest19116-21chrt07:49:123
329699543,37cyclictest4069-21taskset10:39:163
329699543,37cyclictest10750-21chrt10:50:263
329699543,37cyclictest10750-21chrt10:50:263
329699543,36cyclictest727-21taskset08:33:433
329699543,34cyclictest32422-21taskset12:19:173
329699534,33cyclictest5842-21taskset11:35:253
329699533,37cyclictest26864-21chrt10:24:003
329699533,37cyclictest20399-21chrt09:19:043
329699533,36cyclictest5110-21chrt08:44:163
329699533,36cyclictest26314-21taskset12:09:163
329699533,35cyclictest19106-21chrt11:04:083
329699533,34cyclictest8104-21chrt07:14:173
329699532,36cyclictest9934-21chrt08:59:103
329699532,34cyclictest13735-21taskset07:34:013
329699524,35cyclictest3612-21chrt07:04:003
329699523,37cyclictest26989-21taskset11:18:063
329699523,35cyclictest23252-21chrt11:11:053
329699523,35cyclictest23252-21chrt11:11:053
329699523,34cyclictest17708-21chrt10:08:573
329699523,33cyclictest28941-21taskset09:33:433
329699523,31cyclictest30831-21chrt11:24:013
329699523,31cyclictest30831-21chrt11:24:013
329699522,34cyclictest10144-21taskset09:55:313
329699522,33cyclictest5799-21chrt08:48:493
329699515,34cyclictest8404-21chrt11:39:183
329699513,36cyclictest28793-21chrt11:19:443
329699513,36cyclictest28793-21chrt11:19:443
329699513,36cyclictest18912-21chrt11:58:223
329699513,36cyclictest18912-21chrt11:58:223
329699513,35cyclictest4657-21chrt12:28:413
329699513,35cyclictest30882-21chrt08:24:153
329699513,34cyclictest30260-21chrt12:16:303
329699504,30cyclictest25355-21chrt08:09:083
329699503,34cyclictest2679-21chrt09:43:573
329699503,30cyclictest4146-21chrt08:43:433
329699493,34cyclictest17180-21taskset10:08:243
329699493,31cyclictest13559-21chrt09:08:263
329699493,31cyclictest13559-21chrt09:08:263
329699492,33cyclictest1509-21chrt08:34:523
329699484,32cyclictest5568-21chrt09:48:513
329699483,33cyclictest16553-21taskset07:43:413
329699482,34cyclictest9495-21taskset07:19:153
329699482,33cyclictest986-21chrt09:40:123
329699482,31cyclictest12314-21chrt09:59:123
329699473,31cyclictest11812-21chrt07:28:433
329699454,32cyclictest29612-21chrt10:28:463
329699443,29cyclictest24234-21taskset08:04:193
329699443,28cyclictest12098-21taskset07:28:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional