You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-14 - 16:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Tue Oct 14, 2025 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29136689910873,24cyclictest2982393-21apt-get10:40:160
29136689910597,6cyclictest2952699-21http09:10:010
29136689910397,4cyclictest2956078-21kworker/u8:0+flush-179:009:35:170
29136699910187,11cyclictest2988769-21apt-get11:00:131
29136699910187,11cyclictest2988769-21apt-get11:00:121
2913668999784,9cyclictest2935952-21latency_hist08:20:000
2913668999784,11cyclictest2978932-21apt-get10:30:130
2913669999181,7cyclictest2948665-21kworker/u8:0+events_unbound09:00:031
2913669999181,7cyclictest2948665-21kworker/u8:0+events_unbound09:00:021
2913669999180,8cyclictest601706-21systemd-journal09:35:001
2913668999176,12cyclictest601706-21systemd-journal10:15:120
2913669998777,7cyclictest601706-21systemd-journal09:45:001
2913669998677,7cyclictest2996996-21apt-get11:25:121
2913669998677,7cyclictest2996996-21apt-get11:25:121
2913669998576,7cyclictest2947619-21latency_hist08:55:011
2913668998578,4cyclictest2951114-21kworker/u8:3+events_unbound09:10:020
2913668998576,6cyclictest2976167-21kworker/u8:2+flush-179:011:05:010
2913668998576,6cyclictest2976167-21kworker/u8:2+flush-179:011:05:000
2913669998478,4cyclictest2926383-21kworker/u8:1+flush-179:007:50:241
2913669998373,7cyclictest601706-21systemd-journal08:24:431
2913668998374,7cyclictest601706-21systemd-journal07:55:010
2913668997969,7cyclictest2993299-21apt-get11:15:000
2913669997866,9cyclictest601706-21systemd-journal10:15:011
2913669997862,14cyclictest2923118-21cp07:37:241
2913668997870,6cyclictest3019565-21apt-get12:35:130
2913671997743,31cyclictest0-21swapper/207:27:592
2913669997768,6cyclictest2999906-21kworker/u8:2+flush-179:011:40:211
2913668997767,7cyclictest2910581-21kworker/u8:3+events_unbound07:45:170
2913668997766,8cyclictest502-21rs:main0
2913668997665,9cyclictest2985570-21apt-get10:50:120
2913668997336,34cyclictest722-21Xorg07:27:590
2913669997261,9cyclictest601706-21systemd-journal07:30:011
2913668997263,6cyclictest3011330-21kworker/u8:2+flush-179:012:15:200
2913668997166,4cyclictest191rcuc/012:25:000
2913669997059,9cyclictest2941245-21apt-get08:35:131
2913668997063,5cyclictest2944163-21kworker/u8:1+events_unbound09:00:220
2913668997063,5cyclictest2944163-21kworker/u8:1+events_unbound09:00:220
2913669996957,9cyclictest601706-21systemd-journal11:20:301
2913669996957,8cyclictest601706-21systemd-journal09:55:061
2913669996956,10cyclictest2993776-21kworker/u8:0+flush-179:011:15:161
2913668996962,5cyclictest2976167-21kworker/u8:2+flush-179:010:25:140
2913668996957,10cyclictest2944443-21apt-get08:45:140
2913668996859,7cyclictest3003446-21kworker/u8:1+flush-179:012:00:010
2913669996761,4cyclictest2985551-21kworker/u8:0+flush-179:010:50:241
2913668996757,8cyclictest601706-21systemd-journal09:30:000
2913671996662,2cyclictest0-21swapper/209:57:592
2913669996658,6cyclictest601706-21systemd-journal09:13:421
2913669996658,5cyclictest2993776-21kworker/u8:0+flush-179:011:45:151
2913669996658,5cyclictest2929572-21latency_hist08:00:011
2913669996654,9cyclictest2933024-21apt-get08:10:131
2913669996654,10cyclictest2952683-21apt-get09:10:001
2913668996660,4cyclictest2956078-21kworker/u8:0+flush-179:009:55:150
2913669996554,8cyclictest2988517-21latency_hist11:00:011
2913668996555,7cyclictest2976167-21kworker/u8:2+flush-179:010:55:230
2913668996458,4cyclictest2993776-21kworker/u8:0+events_unbound11:30:260
2913668996458,4cyclictest2983715-21kworker/u8:1+events_unbound10:50:010
2913669996354,6cyclictest2913575-21kworker/u8:2+flush-179:007:15:151
2913668996355,6cyclictest3016320-21kworker/u8:3+events_unbound12:30:260
2913669996253,5cyclictest3003446-21kworker/u8:1+events_unbound11:50:241
2913669996253,5cyclictest3003446-21kworker/u8:1+events_unbound11:50:241
2913669996252,8cyclictest3007885-21apt-get12:00:001
2913668996255,5cyclictest2972024-21kworker/u8:3+events_unbound10:20:140
2913669996156,4cyclictest3012918-21kworker/u8:1+events_unbound12:25:001
2913669996154,5cyclictest2926383-21kworker/u8:1+flush-179:008:05:171
2913668996153,7cyclictest2976167-21kworker/u8:2+events_unbound11:05:240
2913668996152,7cyclictest601706-21systemd-journal08:55:010
2913669996052,5cyclictest2967254-21latency_hist09:55:011
2913668996052,7cyclictest2988549-21kworker/u8:3+flush-179:011:20:250
2913669995952,5cyclictest2918383-21kworker/u8:2+flush-179:007:35:001
2913669995946,9cyclictest2956667-21diskstats09:20:181
2913668995948,9cyclictest2962755-21apt-get09:40:160
2913668995849,7cyclictest2910581-21kworker/u8:3+flush-179:007:55:200
2913669995749,6cyclictest3011330-21kworker/u8:2+flush-179:012:25:191
2913669995749,6cyclictest2951066-21kworker/u8:2+flush-179:009:30:001
2913668995750,5cyclictest601706-21systemd-journal07:13:250
2913669995650,5cyclictest2956078-21kworker/u8:0+flush-179:010:00:161
2913669995637,3cyclictest2945780-21apt08:50:001
2913668995650,5cyclictest2944163-21kworker/u8:1+flush-179:008:55:160
2913668995647,7cyclictest2981886-21latency_hist10:40:010
2913668995644,10cyclictest3011883-21diskstats12:10:170
2913668995548,4cyclictest2926383-21kworker/u8:1+flush-179:008:10:140
2913668995546,7cyclictest3006294-21latency_hist11:55:010
2913668995546,7cyclictest3006294-21latency_hist11:55:010
4505291540,9ptp4l441ktimers/307:05:343
2913669995448,5cyclictest2910581-21kworker/u8:3+events_unbound08:40:261
2913669995448,4cyclictest2956078-21kworker/u8:0+events_unbound10:05:251
2913668995449,3cyclictest2913575-21kworker/u8:2+flush-179:007:15:280
2913669995346,5cyclictest2956116-21latency_hist09:20:021
2913669995344,7cyclictest2910581-21kworker/u8:3+events_unbound08:00:261
2913669995344,6cyclictest2918383-21kworker/u8:2+flush-179:007:40:221
2913669995343,8cyclictest3003446-21kworker/u8:1+flush-179:012:00:231
2913669995343,8cyclictest2934610-21apt-get08:15:141
2913668995347,4cyclictest2937532-21kworker/u8:0+events_unbound08:35:000
2913671995249,2cyclictest0-21swapper/208:57:592
2913669995246,5cyclictest2910581-21kworker/u8:3+events_unbound07:10:241
2913669995244,5cyclictest2965670-21latency_hist09:50:011
2913669995242,7cyclictest2976167-21kworker/u8:2+flush-179:010:25:231
2913668995241,9cyclictest2937563-21apt-get08:25:000
2913669995146,4cyclictest2980251-21kworker/u8:3+flush-179:010:35:231
2913669995145,5cyclictest2937532-21kworker/u8:0+flush-179:008:30:271
2913669995140,9cyclictest2999906-21kworker/u8:2+events_unbound11:40:011
2913668995145,5cyclictest2951066-21kworker/u8:2+flush-179:009:15:220
2913668995145,4cyclictest2999906-21kworker/u8:2+flush-179:011:35:180
2913668995144,5cyclictest2959557-21apt-get09:30:140
2913669995043,5cyclictest2947857-21/usr/sbin/munin08:55:171
2913668995045,4cyclictest2951066-21kworker/u8:2+events_unbound09:20:160
2913668994940,7cyclictest601706-21systemd-journal09:52:430
2913674994842,4cyclictest3003128-21turbostat11:45:003
2913668994842,5cyclictest2910581-21kworker/u8:3+events_unbound08:00:140
2913669994742,4cyclictest3016320-21kworker/u8:3+events_unbound12:35:251
2913668994742,3cyclictest2923255-21systemd-run07:40:000
201699470,4rtkit-daemon2015-21rtkit-daemon10:12:131
2913668994641,4cyclictest2937532-21kworker/u8:0+flush-179:008:35:250
2913668994639,5cyclictest3003446-21kworker/u8:1+events_unbound12:05:010
2913668994638,6cyclictest2926383-21kworker/u8:1+flush-179:008:05:280
2913669994536,7cyclictest3012928-21latency_hist12:15:011
291366999450,43cyclictest3012941-21turbostat12:19:551
2913668994537,6cyclictest2962460-21kworker/u8:1+flush-179:009:45:190
2913668994434,8cyclictest2973628-21latency_hist10:15:010
2913668994338,3cyclictest2956078-21kworker/u8:0+flush-179:010:05:150
2913668994337,4cyclictest2956078-21kworker/u8:0+flush-179:010:00:200
2913674994232,7cyclictest0-21swapper/308:06:593
291367199420,40cyclictest0-21swapper/211:56:592
291367499410,39cyclictest2977099-21turbostat10:25:003
2913669994133,6cyclictest3009990-21/usr/sbin/munin12:05:181
2913668994131,8cyclictest601706-21systemd-journal07:32:250
291367499400,4cyclictest2998343-21turbostat11:30:013
291367499400,4cyclictest2998343-21turbostat11:30:013
291367499400,39cyclictest0-21swapper/308:03:593
291367499400,38cyclictest2972050-21turbostat10:10:003
2913669994036,3cyclictest2976167-21kworker/u8:2+flush-179:010:40:291
2913669994031,7cyclictest3019310-21latency_hist12:35:011
291366899401,2cyclictest722-21Xorg07:40:580
2913674993921,5cyclictest2957725-21turbostat09:25:003
291367499390,3cyclictest2921538-21turbostat07:35:003
2913671993935,2cyclictest0-21swapper/209:34:592
291366999390,37cyclictest722-21Xorg11:32:591
291366999390,37cyclictest722-21Xorg10:23:591
2913668993934,3cyclictest2918347-21cron07:25:000
2913668993932,5cyclictest3003446-21kworker/u8:1+flush-179:012:05:150
2913668993931,6cyclictest601706-21systemd-journal08:26:430
2913671993835,2cyclictest0-21swapper/207:53:592
2913671993834,2cyclictest0-21swapper/208:50:582
291367199380,35cyclictest0-21swapper/212:30:592
2913669993831,5cyclictest2984268-21diskstats10:45:161
2913669993829,7cyclictest2916999-21/usr/sbin/munin07:20:231
2913668993831,5cyclictest2996721-21kworker/u8:1+flush-179:011:25:170
2913668993831,5cyclictest2996721-21kworker/u8:1+flush-179:011:25:170
201699380,4rtkit-daemon2979555-21load10:30:191
4505291370,6ptp4l431rcuc/308:40:003
2913674993720,5cyclictest2945785-21turbostat08:49:593
291367499370,36cyclictest0-21swapper/311:24:593
291367499370,2cyclictest0-21swapper/310:18:003
291367499370,2cyclictest0-21swapper/310:04:003
291367499370,1cyclictest0-21swapper/311:04:003
291367499370,1cyclictest0-21swapper/311:03:593
2913671993734,2cyclictest0-21swapper/210:54:592
2913671993734,2cyclictest0-21swapper/209:54:592
2913671993733,2cyclictest0-21swapper/211:07:002
2913669993734,2cyclictest0-21swapper/109:36:001
2913669993734,2cyclictest0-21swapper/107:49:591
2913669993733,3cyclictest2988549-21kworker/u8:3+flush-179:011:10:401
2913668993733,3cyclictest2999906-21kworker/u8:2+flush-179:011:45:260
2913674993634,1cyclictest0-21swapper/310:12:593
2913674993634,1cyclictest0-21swapper/307:35:593
2913674993633,2cyclictest0-21swapper/309:19:583
2913674993631,4cyclictest2959307-21turbostat09:30:003
2913671993633,1cyclictest0-21swapper/207:34:582
2913671993632,2cyclictest0-21swapper/211:04:592
2913671993632,2cyclictest0-21swapper/211:04:592
2913669993630,4cyclictest2937532-21kworker/u8:0+events_unbound08:25:031
2913668993631,3cyclictest495-21systemd-logind12:30:000
2913674993532,2cyclictest0-21swapper/312:38:593
2913674993532,2cyclictest0-21swapper/309:13:003
2913674993531,3cyclictest2945785-21turbostat08:54:543
2913674993530,4cyclictest2952673-21turbostat09:10:003
291367499350,34cyclictest0-21swapper/307:49:553
2913674993429,4cyclictest2983733-21turbostat10:45:003
2913671993430,2cyclictest0-21swapper/209:17:592
2913668993427,6cyclictest3001787-21http11:40:130
2913674993331,1cyclictest0-21swapper/309:42:003
291367499330,27cyclictest0-21swapper/312:00:153
2913671993330,2cyclictest0-21swapper/210:39:002
2913668993328,3cyclictest0-21swapper/008:45:000
2913674993230,1cyclictest0-21swapper/311:16:593
2913674993229,2cyclictest0-21swapper/308:57:003
2913671993229,2cyclictest0-21swapper/209:02:592
2913671993229,2cyclictest0-21swapper/209:02:592
2913674993129,1cyclictest0-21swapper/312:29:553
2913674993129,1cyclictest0-21swapper/307:18:003
2913674993126,4cyclictest3011355-21turbostat12:10:003
2913674993125,5cyclictest2927996-21turbostat07:55:013
291367499310,24cyclictest0-21swapper/311:30:593
2913671993129,1cyclictest0-21swapper/207:24:592
2913671993128,2cyclictest0-21swapper/212:15:132
2913671993127,2cyclictest0-21swapper/208:13:002
201699310,2rtkit-daemon0-21swapper/111:05:561
2913674993028,1cyclictest0-21swapper/312:34:593
2913674993028,1cyclictest0-21swapper/312:19:543
2913674993028,1cyclictest0-21swapper/311:59:593
2913674993028,1cyclictest0-21swapper/309:58:003
2913674993025,4cyclictest3001521-21turbostat11:40:003
2913671993027,2cyclictest0-21swapper/211:40:132
2913671993027,2cyclictest0-21swapper/210:40:182
2913671993027,2cyclictest0-21swapper/210:30:582
2913671993027,2cyclictest0-21swapper/207:35:162
291367199300,2cyclictest0-21swapper/208:40:172
291367199300,27cyclictest0-21swapper/210:59:002
2913674992927,1cyclictest0-21swapper/308:22:593
2913674992927,1cyclictest0-21swapper/307:10:133
291367499290,28cyclictest0-21swapper/310:25:133
2913671992926,2cyclictest0-21swapper/211:30:142
2913671992926,2cyclictest0-21swapper/211:25:132
2913671992926,2cyclictest0-21swapper/211:25:132
2913671992926,2cyclictest0-21swapper/210:05:152
2913671992926,2cyclictest0-21swapper/208:35:132
291367199290,28cyclictest0-21swapper/211:22:592
291367199290,27cyclictest0-21swapper/212:00:152
291367199290,27cyclictest0-21swapper/211:10:172
291367199290,27cyclictest0-21swapper/210:45:142
291367199290,27cyclictest0-21swapper/209:25:112
291367199290,27cyclictest0-21swapper/209:20:152
291367199290,27cyclictest0-21swapper/209:05:142
291367199290,27cyclictest0-21swapper/208:25:142
291367199290,1cyclictest0-21swapper/211:15:132
291367199290,1cyclictest0-21swapper/208:20:132
4505291280,6ptp4l61790irq/134-eno1-TxRx-007:30:003
2913674992826,1cyclictest0-21swapper/309:00:023
2913674992826,1cyclictest0-21swapper/309:00:023
2913674992825,2cyclictest0-21swapper/308:25:063
291367499280,21cyclictest0-21swapper/311:09:593
2913671992825,2cyclictest0-21swapper/210:15:022
2913671992825,2cyclictest0-21swapper/209:40:592
2913671992825,2cyclictest0-21swapper/208:00:132
291367199280,26cyclictest0-21swapper/211:37:592
291367199280,26cyclictest0-21swapper/208:47:592
2913674992725,1cyclictest0-21swapper/309:50:143
2913674992725,1cyclictest0-21swapper/309:49:593
2913674992725,1cyclictest0-21swapper/309:37:593
2913674992725,1cyclictest0-21swapper/308:34:583
291367499270,1cyclictest0-21swapper/311:12:593
291367499270,1cyclictest0-21swapper/308:40:173
2913671992724,2cyclictest0-21swapper/212:25:592
2913671992724,2cyclictest0-21swapper/211:49:592
291367199270,25cyclictest0-21swapper/210:00:582
291367199270,1cyclictest0-21swapper/210:25:132
4505291260,6ptp4l61790irq/134-eno1-TxRx-011:55:013
4505291260,6ptp4l61790irq/134-eno1-TxRx-011:55:013
4505291260,6ptp4l61790irq/134-eno1-TxRx-008:19:593
4505291260,6ptp4l441ktimers/310:49:553
4505291260,5ptp4l61790irq/134-eno1-TxRx-010:35:023
4505291260,5ptp4l61790irq/134-eno1-TxRx-008:15:023
4505291260,5ptp4l441ktimers/311:00:013
4505291260,5ptp4l441ktimers/308:00:003
2913671992622,2cyclictest0-21swapper/207:10:242
291367199260,2cyclictest0-21swapper/208:00:002
291367199260,24cyclictest0-21swapper/212:10:592
291367199260,24cyclictest0-21swapper/207:15:322
4505291250,5ptp4l61790irq/134-eno1-TxRx-012:15:003
4505291250,5ptp4l61790irq/134-eno1-TxRx-010:54:563
4505291250,5ptp4l61790irq/134-eno1-TxRx-010:40:003
4505291250,5ptp4l61790irq/134-eno1-TxRx-007:44:543
4505291250,5ptp4l441ktimers/312:25:003
4505291250,5ptp4l441ktimers/307:24:563
2913671992522,2cyclictest0-21swapper/210:22:002
291367199250,2cyclictest0-21swapper/212:09:002
4505291240,4ptp4l61790irq/134-eno1-TxRx-011:49:563
4505291230,4ptp4l441ktimers/309:34:543
2913671992218,2cyclictest0-21swapper/212:37:002
2913669992118,2cyclictest0-21swapper/107:10:021
201699210,12rtkit-daemon486-21gpm07:08:220
2913671991815,2cyclictest0-21swapper/207:41:592
2913671991714,2cyclictest0-21swapper/209:35:142
2913671991714,2cyclictest0-21swapper/207:46:592
2913671991411,2cyclictest0-21swapper/212:22:592
291367199139,2cyclictest2965686-21turbostat09:50:012
2913671991310,2cyclictest0-21swapper/208:08:592
291367199118,2cyclictest0-21swapper/210:13:582
291367199118,2cyclictest0-21swapper/208:31:002
291367199110,8cyclictest0-21swapper/208:19:232
291367199107,2cyclictest0-21swapper/209:10:272
291367199100,7cyclictest0-21swapper/211:50:392
291367199100,7cyclictest0-21swapper/211:50:392
29136719930,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional