You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 06:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Tue Mar 10, 2026 00:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22026939910491,10cyclictest3708207-21cups-browsed00:00:001
2202693999283,7cyclictest2285538-21latency_hist23:25:001
2202689999284,6cyclictest2287123-21latency_hist23:30:000
2202689998479,3cyclictest2217382-21kworker/u8:0+flush-179:020:20:010
2202693998174,5cyclictest2272787-21kworker/u8:2+flush-179:022:45:261
2202693998074,4cyclictest2241525-21kworker/u8:1+flush-179:021:20:191
2202689998073,5cyclictest2279149-21kworker/u8:3+flush-179:023:05:000
2202689998069,9cyclictest2290571-21apt-get23:40:110
2202693997770,5cyclictest2287128-21kworker/u8:3+flush-179:023:40:261
2202693997770,5cyclictest2189380-21kworker/u8:0+flush-179:019:40:011
2202693997768,7cyclictest2269355-21latency_hist22:35:001
2202693997671,4cyclictest2225389-21kworker/u8:2+flush-179:020:35:171
2202689997670,4cyclictest2296723-21kworker/u8:2+flush-179:000:00:010
2202693997570,4cyclictest2266173-21kworker/u8:0+flush-179:022:25:241
2202693997465,6cyclictest2238361-21latency_hist21:00:011
2202693997262,8cyclictest2303576-21cp00:20:021
2202693997165,5cyclictest2269390-21kworker/u8:1+flush-179:022:35:221
2202689997065,4cyclictest2274374-21kworker/u8:0+flush-179:022:55:010
2202689997063,5cyclictest2283988-21kworker/u8:0+events_unbound00:05:000
2202689997063,5cyclictest2283988-21kworker/u8:0+events_unbound00:04:590
2202689997061,6cyclictest2267768-21latency_hist22:30:010
2202693996961,6cyclictest2259561-21latency_hist22:05:011
2202693996959,8cyclictest266-21systemd-journal22:20:001
2202693996759,6cyclictest2264544-21kworker/u8:2+flush-179:022:20:251
2202693996660,4cyclictest2238330-21kworker/u8:0+flush-179:021:05:011
2202689996657,7cyclictest2249746-21latency_hist21:35:010
2202689996560,4cyclictest2236737-21kworker/u8:1+events_unbound20:55:010
2202693996456,6cyclictest2241525-21kworker/u8:1+flush-179:021:10:211
2202693996354,7cyclictest266-21systemd-journal20:10:001
2202689996353,7cyclictest2296723-21kworker/u8:2+flush-179:000:35:210
220268999630,1cyclictest0-21swapper/020:04:000
220268999630,1cyclictest0-21swapper/020:03:590
2202693996254,6cyclictest2243369-21kworker/u8:0+flush-179:021:30:221
2202689996052,6cyclictest2264581-21latency_hist22:20:010
2202693995953,4cyclictest2278621-21kworker/u8:1+flush-179:023:30:211
2202689995953,4cyclictest2202807-21kworker/u8:2+events_unbound19:15:130
2202689995952,5cyclictest2296723-21kworker/u8:2+events_unbound00:15:010
2202689995950,7cyclictest2222184-21latency_hist20:10:000
2202693995850,5cyclictest2280759-21latency_hist23:10:011
2202689995853,4cyclictest2205205-21kworker/u8:1+events_unbound20:00:010
2202689995752,4cyclictest2266173-21kworker/u8:0+flush-179:022:40:220
2202689995751,4cyclictest2241525-21kworker/u8:1+flush-179:021:25:220
2202689995750,5cyclictest2243369-21kworker/u8:0+flush-179:021:15:180
2202689995749,6cyclictest266-21systemd-journal21:58:170
2202693995650,4cyclictest2205205-21kworker/u8:1+flush-179:019:40:191
2202693995646,8cyclictest2262729-21latency_hist22:15:011
2202689995649,5cyclictest2283988-21kworker/u8:0+events_unbound00:20:000
2202689995649,5cyclictest2225389-21kworker/u8:2+flush-179:021:00:190
2202693995538,14cyclictest2222218-21kworker/u8:3+flush-179:020:20:251
2202689995549,4cyclictest2225389-21kworker/u8:2+flush-179:020:45:000
2202689995546,4cyclictest2243369-21kworker/u8:0+events_unbound21:35:140
2202689995543,10cyclictest2216885-21latency_hist19:55:000
2202693995448,4cyclictest2222218-21kworker/u8:3+flush-179:020:25:221
2202693995446,6cyclictest2215302-21latency_hist19:50:001
2202689995445,7cyclictest510-21rs:main0
2202689995343,8cyclictest266-21systemd-journal21:10:010
2202699995250,1cyclictest0-21swapper/323:42:003
2202693995247,4cyclictest2293520-21kworker/u8:1+flush-179:000:00:111
2202693995247,4cyclictest2293520-21kworker/u8:1+flush-179:000:00:111
2202693995243,7cyclictest2305203-21apt-get00:25:111
2202693995243,7cyclictest2305203-21apt-get00:25:101
2202689995245,5cyclictest2283988-21kworker/u8:0+flush-179:023:50:210
2202689995244,6cyclictest2204157-21latency_hist19:15:010
2202693995146,3cyclictest2283988-21kworker/u8:0+events_unbound00:05:181
2202689995146,4cyclictest2303255-21kworker/u8:1+events_unbound00:20:230
2202689995146,4cyclictest2272787-21kworker/u8:2+flush-179:023:20:010
2202689995145,4cyclictest2189380-21kworker/u8:0+flush-179:019:38:130
4577091500,14ptp4l441ktimers/319:10:003
2202693995047,2cyclictest2283988-21kworker/u8:0+events_unbound00:10:171
2202693995045,4cyclictest2222218-21kworker/u8:3+flush-179:020:15:011
2202693994944,4cyclictest2205205-21kworker/u8:1+events_unbound19:25:011
2202693994943,4cyclictest2251340-21latency_hist21:40:021
2202689994944,4cyclictest2205205-21kworker/u8:1+flush-179:019:24:560
2202689994944,3cyclictest2296723-21kworker/u8:2+flush-179:000:34:540
2202689994942,5cyclictest510-21rs:main0
2202689994942,5cyclictest2283988-21kworker/u8:0+flush-179:023:49:590
2202689994942,5cyclictest2241525-21kworker/u8:1+flush-179:021:20:200
2202699994846,1cyclictest0-21swapper/320:02:003
2202699994846,1cyclictest0-21swapper/320:02:003
2202693994843,4cyclictest2243369-21kworker/u8:0+flush-179:021:15:241
2202693994841,5cyclictest2274374-21kworker/u8:0+events_unbound23:00:211
2202693994839,7cyclictest2220342-21latency_hist20:05:011
2202693994839,7cyclictest2220342-21latency_hist20:05:011
2202693994838,9cyclictest2287128-21kworker/u8:3+flush-179:023:35:231
2202689994841,5cyclictest266-21systemd-journal21:45:010
2202689994741,5cyclictest2296723-21kworker/u8:2+flush-179:000:05:240
2202689994741,4cyclictest2228549-21latency_hist20:30:010
2202693994641,4cyclictest2296723-21kworker/u8:2+flush-179:000:15:171
2202693994641,4cyclictest2205205-21kworker/u8:1+flush-179:019:50:231
2202693994640,5cyclictest2205205-21kworker/u8:1+events_unbound20:40:191
2202693994640,4cyclictest2225389-21kworker/u8:2+flush-179:020:45:221
2202689994643,2cyclictest2205205-21kworker/u8:1+events_unbound19:40:240
2202693994541,3cyclictest2202807-21kworker/u8:2+flush-179:019:10:191
2202693994537,6cyclictest2274631-21/usr/sbin/munin22:50:241
2202693994529,14cyclictest2243369-21kworker/u8:0+flush-179:021:50:251
2202689994537,6cyclictest2252955-21apt-get21:45:010
2202689994536,7cyclictest266-21systemd-journal22:32:170
220268999450,4cyclictest2234918-21idleruntime-cro20:50:010
2202693994439,4cyclictest2243369-21kworker/u8:0+flush-179:022:09:561
2202693994439,4cyclictest2243369-21kworker/u8:0+flush-179:022:09:561
2202693994438,5cyclictest2272787-21kworker/u8:2+flush-179:023:25:241
2202693994425,17cyclictest2270983-21perf22:44:551
2202689994439,4cyclictest2279149-21kworker/u8:3+flush-179:023:05:170
2202689994437,4cyclictest0-21swapper/019:25:590
2202693994340,2cyclictest2241525-21kworker/u8:1+events_unbound21:25:171
2202693994338,4cyclictest2296723-21kworker/u8:2+flush-179:000:35:241
2202693994338,4cyclictest2283988-21kworker/u8:0+flush-179:000:30:201
2202693994338,4cyclictest2217382-21kworker/u8:0+flush-179:020:15:191
2202689994340,2cyclictest2212170-21kworker/u8:2+events_unbound19:50:010
2202689994337,4cyclictest2303255-21kworker/u8:1+events_unbound00:25:140
2202689994337,4cyclictest2303255-21kworker/u8:1+events_unbound00:25:140
2202689994337,4cyclictest2236737-21kworker/u8:1+events_unbound20:55:230
2202689994336,5cyclictest2287128-21kworker/u8:3+events_unbound23:35:200
2202693994237,4cyclictest2283988-21kworker/u8:0+events_unbound23:50:231
2202693994231,4cyclictest2228539-21kworker/u8:0+flush-179:020:30:151
2202693994231,4cyclictest2228539-21kworker/u8:0+flush-179:020:30:141
2202689994237,4cyclictest2225389-21kworker/u8:2+flush-179:020:20:130
2202689994233,7cyclictest2209193-21apt-get19:30:100
220269999410,5cyclictest2241543-21turbostat21:10:013
2202695994138,2cyclictest0-21swapper/220:22:592
2202693994134,5cyclictest2278621-21kworker/u8:1+events_unbound23:15:141
220269399411,3cyclictest2277575-21munin-run23:00:001
220269399411,38cyclictest714-21Xorg23:48:591
2202689994135,4cyclictest2205205-21kworker/u8:1+flush-179:020:10:150
2202699994034,5cyclictest2259572-21turbostat22:05:013
2202693994035,3cyclictest2236758-21munin-run20:55:001
2202689994036,3cyclictest2258009-21kworker/u8:3+flush-179:022:10:210
2202689994035,4cyclictest2258009-21kworker/u8:3+flush-179:022:00:230
2202689994033,5cyclictest2269390-21kworker/u8:1+events_unbound22:35:210
2202689994031,7cyclictest2266184-21latency_hist22:25:010
220269999390,38cyclictest2288718-21turbostat23:35:003
2202693993935,3cyclictest1-21systemd19:20:011
2202693993933,4cyclictest2252916-21kworker/u8:2+flush-179:021:55:161
220269399390,38cyclictest0-21swapper/121:47:581
2202699993833,4cyclictest2272817-21turbostat22:45:003
2202699993833,4cyclictest2222196-21turbostat20:09:593
220269999380,31cyclictest0-21swapper/319:51:583
2202695993834,2cyclictest0-21swapper/219:24:552
220269599380,36cyclictest0-21swapper/222:05:592
220269599380,36cyclictest0-21swapper/222:05:592
2202693993832,5cyclictest2205205-21kworker/u8:1+flush-179:019:25:201
2202689993833,4cyclictest2278621-21kworker/u8:1+flush-179:023:20:260
2202699993731,5cyclictest2299919-21turbostat00:10:003
220269599370,35cyclictest0-21swapper/223:04:592
220269599370,35cyclictest0-21swapper/222:17:592
2202693993729,6cyclictest2205205-21kworker/u8:1+events_unbound19:55:031
2202693993727,8cyclictest2251608-21apt-get21:40:111
2202689993733,3cyclictest2276639-21fschecks_time22:55:160
2202689993733,3cyclictest1-21systemd22:50:010
2202699993634,1cyclictest0-21swapper/323:04:553
2202699993634,1cyclictest0-21swapper/320:48:593
2202699993629,6cyclictest2246593-21turbostat21:25:003
220269999360,35cyclictest0-21swapper/321:31:593
220269999360,35cyclictest0-21swapper/319:37:583
2202695993633,2cyclictest0-21swapper/219:47:002
2202695993633,2cyclictest0-21swapper/200:30:002
2202695993633,2cyclictest0-21swapper/200:29:592
2202695993633,2cyclictest0-21swapper/200:05:002
2202695993633,2cyclictest0-21swapper/200:05:002
2202695993632,2cyclictest0-21swapper/222:02:582
220269599360,34cyclictest0-21swapper/221:42:592
220269599360,1cyclictest0-21swapper/223:32:592
220269599360,1cyclictest0-21swapper/220:04:002
220269599360,1cyclictest0-21swapper/220:03:592
2202693993633,2cyclictest2241790-21latency_hist21:10:011
2202689993633,2cyclictest2278621-21kworker/u8:1+events_unbound23:10:220
220268999361,31cyclictest0-21swapper/020:30:130
220268999361,31cyclictest0-21swapper/020:30:130
2202699993533,1cyclictest0-21swapper/319:59:593
220269999350,1cyclictest0-21swapper/300:24:003
220269599350,1cyclictest0-21swapper/222:11:592
220269599350,1cyclictest0-21swapper/221:56:592
220269599350,1cyclictest0-21swapper/219:50:592
2202699993432,1cyclictest0-21swapper/321:40:593
2202699993432,1cyclictest0-21swapper/320:43:593
2202699993432,1cyclictest0-21swapper/320:11:593
2202695993432,1cyclictest0-21swapper/220:19:582
2202699993331,1cyclictest0-21swapper/320:51:593
2202699993331,1cyclictest0-21swapper/320:32:003
2202699993331,1cyclictest0-21swapper/320:32:003
2202699993331,1cyclictest0-21swapper/320:27:593
2202699993327,4cyclictest2308134-21turbostat00:34:593
2202695993331,1cyclictest0-21swapper/222:59:592
2202695993330,2cyclictest0-21swapper/200:16:592
2202689993331,1cyclictest0-21swapper/021:54:550
2202699993230,1cyclictest0-21swapper/323:39:593
2202699993230,1cyclictest0-21swapper/319:32:003
2202695993229,2cyclictest0-21swapper/222:34:552
2202695993229,2cyclictest0-21swapper/221:45:592
2202695993229,2cyclictest0-21swapper/200:32:592
2202695993228,2cyclictest0-21swapper/200:22:592
220269599320,29cyclictest0-21swapper/221:00:002
220268999321,29cyclictest714-21Xorg22:05:590
220268999321,29cyclictest714-21Xorg22:05:590
4577091310,5ptp4l61490irq/134-eno1-TxRx-020:59:563
2202699993125,5cyclictest2277583-21turbostat23:00:003
2202695993129,1cyclictest0-21swapper/220:14:592
4577091300,7ptp4l441ktimers/323:10:013
4577091300,7ptp4l441ktimers/300:05:003
4577091300,7ptp4l441ktimers/300:04:593
2202699993028,1cyclictest0-21swapper/300:29:593
2202699993028,1cyclictest0-21swapper/300:29:593
220269999300,28cyclictest0-21swapper/322:45:593
220269999300,28cyclictest0-21swapper/321:10:023
2202695993027,2cyclictest0-21swapper/221:28:592
2202695993027,2cyclictest0-21swapper/219:20:012
220269599300,2cyclictest0-21swapper/221:10:042
2202693993025,4cyclictest2272787-21kworker/u8:2+flush-179:023:10:151
2202689993028,1cyclictest211irq_work/020:36:580
4577091290,7ptp4l61490irq/134-eno1-TxRx-023:20:013
4577091290,7ptp4l441ktimers/319:20:003
4577091290,6ptp4l441ktimers/323:25:003
4577091290,6ptp4l441ktimers/300:15:003
2202699992927,1cyclictest0-21swapper/322:39:553
2202699992927,1cyclictest0-21swapper/322:20:133
2202699992927,1cyclictest0-21swapper/321:29:003
2202699992926,2cyclictest0-21swapper/322:50:133
2202699992926,2cyclictest0-21swapper/300:15:133
220269999290,2cyclictest0-21swapper/321:45:143
220269999290,28cyclictest0-21swapper/323:45:123
220269999290,27cyclictest0-21swapper/323:50:123
220269999290,27cyclictest0-21swapper/321:50:133
220269999290,27cyclictest0-21swapper/321:35:133
2202695992926,2cyclictest0-21swapper/223:20:132
2202695992926,2cyclictest0-21swapper/221:54:002
2202695992926,2cyclictest0-21swapper/221:37:592
2202695992926,2cyclictest0-21swapper/220:50:032
220269599290,2cyclictest0-21swapper/219:35:122
220269599290,27cyclictest0-21swapper/223:50:122
220269599290,27cyclictest0-21swapper/222:25:132
220269599290,27cyclictest0-21swapper/200:05:122
220269599290,26cyclictest0-21swapper/222:38:592
4577091280,6ptp4l61490irq/134-eno1-TxRx-022:00:003
4577091280,6ptp4l61490irq/134-eno1-TxRx-019:15:013
4577091280,6ptp4l61490irq/134-eno1-TxRx-000:39:553
4577091280,6ptp4l441ktimers/323:30:013
4577091280,6ptp4l441ktimers/322:35:003
4577091280,6ptp4l441ktimers/320:20:013
4577091280,6ptp4l441ktimers/319:50:013
4577091280,5ptp4l441ktimers/319:30:003
2202699992826,1cyclictest0-21swapper/322:15:033
2202699992826,1cyclictest0-21swapper/300:00:023
220269999280,27cyclictest0-21swapper/322:05:133
220269999280,27cyclictest0-21swapper/322:05:133
220269999280,26cyclictest0-21swapper/319:20:123
2202695992825,2cyclictest0-21swapper/223:43:592
2202695992825,2cyclictest0-21swapper/222:45:152
2202695992825,2cyclictest0-21swapper/222:40:012
2202695992825,2cyclictest0-21swapper/221:30:132
2202695992825,2cyclictest0-21swapper/221:15:142
2202695992825,2cyclictest0-21swapper/220:45:592
2202695992825,2cyclictest0-21swapper/200:35:122
220269599280,2cyclictest0-21swapper/219:55:022
220269599280,27cyclictest0-21swapper/220:05:022
220269599280,26cyclictest0-21swapper/223:25:122
220269599280,26cyclictest0-21swapper/223:10:592
220269599280,26cyclictest0-21swapper/223:05:132
220269599280,26cyclictest0-21swapper/222:50:132
220269599280,26cyclictest0-21swapper/220:30:122
220269599280,26cyclictest0-21swapper/220:30:122
2202693992824,3cyclictest714-21Xorg19:33:591
4577091270,6ptp4l441ktimers/320:25:003
4577091270,5ptp4l441ktimers/322:30:013
220269999270,26cyclictest0-21swapper/321:17:583
2202695992724,2cyclictest0-21swapper/220:25:142
4577091260,6ptp4l61490irq/134-eno1-TxRx-023:15:003
2202699992624,1cyclictest0-21swapper/322:12:593
2202699992623,2cyclictest2213724-21turbostat19:45:003
220269999260,24cyclictest2239961-21turbostat21:05:003
2202695992624,1cyclictest0-21swapper/223:19:582
2202695992623,2cyclictest0-21swapper/222:24:002
2202695992623,2cyclictest0-21swapper/221:07:592
2202695992623,2cyclictest0-21swapper/219:10:162
2202695992623,2cyclictest0-21swapper/200:13:592
4577091250,4ptp4l441ktimers/320:39:553
2202695992522,2cyclictest0-21swapper/219:40:582
2202695992522,2cyclictest0-21swapper/219:27:592
2202695992421,2cyclictest0-21swapper/223:56:002
2202695992219,2cyclictest0-21swapper/220:42:592
2202695992119,1cyclictest0-21swapper/221:24:592
2202693992116,4cyclictest0-21swapper/119:10:021
231999190,10rtkit-daemon3203871-21ntpd19:06:490
2202695991916,2cyclictest0-21swapper/223:46:592
2202695991916,2cyclictest0-21swapper/221:00:592
2202695991714,2cyclictest0-21swapper/220:40:002
22026959974,2cyclictest0-21swapper/223:39:072
22026959963,2cyclictest0-21swapper/219:30:192
22026959930,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional