You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-05 - 17:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Fri Dec 05, 2025 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
453876999685,8cyclictest538482-21latency_hist12:40:000
453878999488,5cyclictest509314-21kworker/u8:2+events_unbound11:20:011
453878999388,4cyclictest468731-21kworker/u8:2+events_unbound09:05:001
453878999387,4cyclictest515938-21kworker/u8:2+flush-179:012:00:011
453878999287,2cyclictest458145-21kworker/u8:1+events_unbound07:40:221
453876998776,8cyclictest455378-21latency_hist07:15:010
453876998775,9cyclictest515961-21latency_hist11:30:020
453878998577,6cyclictest501421-21kworker/u8:2+events_unbound10:50:241
453878998277,4cyclictest500337-21kworker/u8:1+events_unbound10:40:221
453878998277,4cyclictest500337-21kworker/u8:1+events_unbound10:40:221
453878998277,4cyclictest495056-21kworker/u8:3+flush-179:010:35:241
453878998276,5cyclictest535346-21kworker/u8:2+events_unbound12:35:201
453876998275,5cyclictest469982-21kworker/u8:0+flush-179:009:00:010
453878997771,4cyclictest480741-21kworker/u8:0+flush-179:010:10:011
453878997767,8cyclictest462125-21latency_hist08:05:011
4670791760,37ptp4l441ktimers/307:09:253
453878997670,4cyclictest528983-21kworker/u8:1+flush-179:012:15:201
453878997663,12cyclictest466350-21kworker/u8:0+flush-179:008:45:001
453878997570,4cyclictest468731-21kworker/u8:2+flush-179:008:55:211
453878997469,4cyclictest453337-21kworker/u8:2+events_unbound07:10:011
453878997469,3cyclictest470661-21kworker/u8:3+events_unbound09:10:001
453878997468,5cyclictest470661-21kworker/u8:3+flush-179:009:35:001
453878997464,8cyclictest472768-21kworker/u8:1+flush-179:009:20:191
453878997368,4cyclictest480741-21kworker/u8:0+events_unbound10:19:591
453878997368,4cyclictest468731-21kworker/u8:2+events_unbound09:40:221
453878997366,5cyclictest504792-21/usr/sbin/munin10:55:331
453878997266,5cyclictest480741-21kworker/u8:0+events_unbound10:25:251
453878997264,6cyclictest464521-21kworker/u8:3+flush-179:008:35:011
453876997262,7cyclictest474323-21latency_hist09:20:010
453878997163,5cyclictest480741-21kworker/u8:0+events_unbound10:05:001
453878997064,4cyclictest480741-21kworker/u8:0+events_unbound10:20:221
453878996965,3cyclictest528983-21kworker/u8:1+events_unbound12:25:251
453878996955,7cyclictest3970180-21kworker/u8:0+events_unbound07:10:171
453878996756,8cyclictest536898-21latency_hist12:35:021
453878996756,8cyclictest536898-21latency_hist12:35:011
453878996661,3cyclictest506126-21kworker/u8:0+flush-179:011:00:251
453876996660,4cyclictest528983-21kworker/u8:1+flush-179:012:30:260
453876996660,4cyclictest528983-21kworker/u8:1+flush-179:012:30:250
453878996559,4cyclictest521480-21kworker/u8:0+flush-179:011:50:241
453878996462,1cyclictest0-21swapper/108:23:591
453878996455,6cyclictest521480-21kworker/u8:0+events_unbound12:20:151
453878996359,3cyclictest488692-21kworker/u8:2+flush-179:010:15:011
453878996356,5cyclictest515938-21kworker/u8:2+flush-179:011:45:251
453878996356,5cyclictest468731-21kworker/u8:2+flush-179:009:10:211
453878996350,4cyclictest500337-21kworker/u8:1+flush-179:011:20:241
453876996353,7cyclictest506126-21kworker/u8:0+flush-179:011:05:230
453878996256,4cyclictest470661-21kworker/u8:3+events_unbound09:25:261
453876996251,8cyclictest499794-21latency_hist10:40:020
453878996149,9cyclictest479354-21apt-get09:35:101
453878996054,4cyclictest515938-21kworker/u8:2+flush-179:011:45:001
453878995950,5cyclictest521480-21kworker/u8:0+flush-179:012:10:231
453876995950,6cyclictest515938-21kworker/u8:2+flush-179:011:55:230
453876995949,8cyclictest517803-21apt-get11:35:090
453878995854,3cyclictest517526-21kworker/u8:3+flush-179:011:35:221
453878995751,4cyclictest480741-21kworker/u8:0+events_unbound10:30:151
453878995650,4cyclictest506126-21kworker/u8:0+events_unbound11:05:191
453876995646,8cyclictest488912-21apt-get10:05:120
453878995549,4cyclictest515938-21kworker/u8:2+flush-179:012:05:151
453878995440,5cyclictest472768-21kworker/u8:1+events_unbound09:15:231
453876995441,10cyclictest271-21systemd-journal11:55:000
453878995348,4cyclictest483910-21kworker/u8:3+events_unbound09:50:241
453878995248,3cyclictest466350-21kworker/u8:0+flush-179:008:39:561
453878995246,4cyclictest457556-21kworker/u8:2+events_unbound07:55:131
453876995248,3cyclictest455614-21kworker/u8:1+flush-179:007:25:260
453876995244,5cyclictest517526-21kworker/u8:3+flush-179:011:40:160
453876995242,8cyclictest271-21systemd-journal09:10:000
453878995144,5cyclictest486002-21diskstats09:55:171
453878995041,6cyclictest457556-21kworker/u8:2+flush-179:007:35:011
453878994942,5cyclictest468731-21kworker/u8:2+events_unbound09:45:201
453876994941,6cyclictest493416-21latency_hist10:20:010
453881994845,2cyclictest0-21swapper/210:42:002
453881994845,2cyclictest0-21swapper/210:41:592
453876994843,4cyclictest468731-21kworker/u8:2+events_unbound09:35:230
453876994840,6cyclictest464005-21kworker/u8:2+flush-179:008:20:000
453876994840,6cyclictest271-21systemd-journal07:38:300
453878994738,7cyclictest462384-21latency_hist08:10:011
453876994739,6cyclictest471383-21/usr/sbin/munin09:10:120
453876994640,4cyclictest501421-21kworker/u8:2+flush-179:010:50:200
453876994637,7cyclictest530533-21latency_hist12:15:000
453876994637,7cyclictest509574-21/usr/sbin/munin11:10:210
453881994543,1cyclictest0-21swapper/208:34:592
453878994541,3cyclictest500337-21kworker/u8:1+events_unbound11:10:211
453876994540,4cyclictest488692-21kworker/u8:2+events_unbound10:25:000
453876994536,7cyclictest521480-21kworker/u8:0+flush-179:012:20:210
453876994440,3cyclictest475-21dbus-daemon10:05:010
453876994437,5cyclictest464005-21kworker/u8:2+flush-179:008:25:210
453876994437,5cyclictest271-21systemd-journal07:34:290
453876994436,6cyclictest455698-21kworker/u8:3+events_unbound07:55:200
45387899431,3cyclictest527368-21munin-run12:05:001
453876994337,4cyclictest470661-21kworker/u8:3+flush-179:009:30:260
453876994336,5cyclictest460290-21kworker/u8:1+events_unbound08:15:000
453876994334,7cyclictest271-21systemd-journal10:46:290
453882994240,1cyclictest0-21swapper/309:31:593
453881994237,2cyclictest0-21swapper/207:36:592
453878994237,4cyclictest464005-21kworker/u8:2+events_unbound08:25:231
453878994235,4cyclictest455698-21kworker/u8:3+events_unbound07:50:001
453878994232,4cyclictest455614-21kworker/u8:1+events_unbound07:25:251
453876994233,7cyclictest507751-21latency_hist11:05:020
453876994231,9cyclictest498193-21latency_hist10:35:010
45387699420,40cyclictest723-21Xorg10:12:000
45387899410,39cyclictest723-21Xorg08:13:591
453876994136,4cyclictest528983-21kworker/u8:1+flush-179:012:15:230
453876994135,5cyclictest472768-21kworker/u8:1+events_unbound09:20:220
453876994132,7cyclictest464755-21kworker/u8:4+flush-179:008:40:200
453876994131,7cyclictest517526-21kworker/u8:3+events_unbound11:45:020
45388299400,39cyclictest0-21swapper/307:30:593
45388299400,1cyclictest0-21swapper/308:45:593
453878994035,3cyclictest460293-21systemd-run07:55:011
453876994034,5cyclictest466350-21kworker/u8:0+flush-179:008:50:000
45387699400,2cyclictest723-21Xorg09:28:000
45388299390,4cyclictest512805-21turbostat11:20:003
453878993935,2cyclictest723-21Xorg10:49:581
453876993933,5cyclictest480741-21kworker/u8:0+flush-179:009:44:300
453876993932,5cyclictest528964-21grep12:09:590
45387699391,2cyclictest191rcuc/007:54:590
453882993832,4cyclictest477528-21turbostat09:30:003
45388299380,35cyclictest0-21swapper/307:50:593
45388199380,36cyclictest0-21swapper/208:53:592
45388199380,36cyclictest0-21swapper/208:26:592
453876993833,4cyclictest500337-21kworker/u8:1+flush-179:011:20:170
45387699380,37cyclictest0-21swapper/008:21:590
453882993735,1cyclictest0-21swapper/308:38:593
45388299370,2cyclictest0-21swapper/310:19:593
45388299370,1cyclictest0-21swapper/312:13:583
453881993733,2cyclictest0-21swapper/210:12:592
45388199370,35cyclictest0-21swapper/212:03:592
45388199370,35cyclictest0-21swapper/211:09:592
453878993732,4cyclictest3970180-21kworker/u8:0+events_unbound07:35:291
453876993733,3cyclictest528983-21kworker/u8:1+flush-179:012:25:260
453882993634,1cyclictest0-21swapper/312:17:593
453882993634,1cyclictest0-21swapper/308:09:593
453882993634,1cyclictest0-21swapper/307:45:593
453882993632,2cyclictest0-21swapper/312:08:593
45388299360,35cyclictest0-21swapper/312:27:583
45388299360,35cyclictest0-21swapper/310:14:003
45388299360,35cyclictest0-21swapper/309:20:593
453881993633,2cyclictest0-21swapper/212:38:592
453881993633,2cyclictest0-21swapper/207:49:562
45388199360,1cyclictest0-21swapper/211:00:012
453878993633,2cyclictest0-21swapper/108:16:591
453878993632,3cyclictest3970180-21kworker/u8:0+events_unbound07:18:291
453878993631,4cyclictest500337-21kworker/u8:1+events_unbound11:25:231
453876993630,4cyclictest468755-21latency_hist08:55:010
453876993629,5cyclictest723-21Xorg08:32:590
453876993626,8cyclictest483910-21kworker/u8:3+flush-179:009:55:210
45387699360,1cyclictest0-21swapper/007:24:000
453882993533,1cyclictest0-21swapper/310:09:543
453881993533,1cyclictest0-21swapper/208:49:592
453876993530,4cyclictest468731-21kworker/u8:2+flush-179:009:01:290
453876993529,4cyclictest515938-21kworker/u8:2+flush-179:012:00:210
453882993432,1cyclictest0-21swapper/310:00:593
453882993432,1cyclictest0-21swapper/307:35:593
453876993429,4cyclictest468731-21kworker/u8:2+flush-179:009:49:290
453876993428,4cyclictest500337-21kworker/u8:1+flush-179:010:40:170
453876993428,4cyclictest500337-21kworker/u8:1+flush-179:010:40:170
453876993427,5cyclictest483910-21kworker/u8:3+flush-179:009:50:230
453876993426,7cyclictest510941-21apt-get11:15:030
453882993331,1cyclictest0-21swapper/312:01:003
453882993331,1cyclictest0-21swapper/309:08:593
453882993330,2cyclictest0-21swapper/309:14:593
453878993329,3cyclictest466350-21kworker/u8:0+events_unbound08:49:261
453876993329,3cyclictest501421-21kworker/u8:2+flush-179:010:55:140
453876993329,2cyclictest723-21Xorg07:17:580
453876993328,4cyclictest480741-21kworker/u8:0+flush-179:010:25:210
453876993328,4cyclictest457556-21kworker/u8:2+flush-179:007:50:000
453876993328,3cyclictest457556-21kworker/u8:2+flush-179:008:01:010
453882993230,1cyclictest0-21swapper/308:12:593
453882993230,1cyclictest0-21swapper/308:01:583
453881993229,2cyclictest0-21swapper/207:30:002
453876993229,2cyclictest723-21Xorg07:41:590
453876993225,5cyclictest511417-21kworker/u8:0+flush-179:011:30:200
453882993129,1cyclictest0-21swapper/311:14:553
453882993129,1cyclictest0-21swapper/307:25:003
453882993128,2cyclictest0-21swapper/308:24:553
453882993125,4cyclictest515980-21turbostat11:30:013
45388199310,29cyclictest0-21swapper/211:45:152
453876993128,2cyclictest0-21swapper/008:05:590
453881993027,2cyclictest0-21swapper/208:59:002
45388199300,2cyclictest0-21swapper/210:25:142
45388199300,28cyclictest0-21swapper/211:40:122
45388199300,28cyclictest0-21swapper/207:55:112
45387899300,29cyclictest0-21swapper/107:20:591
45387699300,4cyclictest723-21Xorg08:36:590
453882992927,1cyclictest0-21swapper/312:31:003
453882992927,1cyclictest0-21swapper/312:30:593
453882992927,1cyclictest0-21swapper/308:20:003
45388299290,28cyclictest0-21swapper/311:35:103
45388299290,1cyclictest0-21swapper/311:00:133
453881992926,2cyclictest0-21swapper/209:45:132
453881992926,2cyclictest0-21swapper/209:16:582
453881992925,2cyclictest0-21swapper/212:30:142
453881992925,2cyclictest0-21swapper/212:30:142
453881992925,2cyclictest0-21swapper/211:25:122
45388199290,27cyclictest0-21swapper/210:50:142
45388199290,27cyclictest0-21swapper/210:45:142
45388199290,27cyclictest0-21swapper/209:55:142
45388199290,27cyclictest0-21swapper/209:35:102
45388199290,27cyclictest0-21swapper/209:10:032
453882992826,1cyclictest0-21swapper/309:40:133
453882992825,2cyclictest0-21swapper/310:40:003
453882992822,4cyclictest522595-21turbostat11:50:013
453882992822,4cyclictest470630-21turbostat09:05:003
45388299280,27cyclictest0-21swapper/308:40:133
45388299280,26cyclictest0-21swapper/311:50:143
45388299280,26cyclictest0-21swapper/310:30:143
453881992825,2cyclictest0-21swapper/211:52:002
453881992825,2cyclictest0-21swapper/211:30:592
453881992825,2cyclictest0-21swapper/210:35:592
453881992825,2cyclictest0-21swapper/209:30:592
453881992825,2cyclictest0-21swapper/207:44:552
45388199280,26cyclictest0-21swapper/212:05:162
45388199280,26cyclictest0-21swapper/209:44:002
45388199280,26cyclictest0-21swapper/207:11:592
4670791270,6ptp4l441ktimers/309:50:003
453882992725,1cyclictest0-21swapper/307:40:123
453882992724,2cyclictest0-21swapper/311:32:593
453882992724,1cyclictest0-21swapper/307:55:593
453882992723,2cyclictest0-21swapper/307:18:193
45388299270,26cyclictest0-21swapper/308:28:593
453881992725,1cyclictest0-21swapper/208:40:002
453881992724,2cyclictest0-21swapper/212:16:592
453881992724,2cyclictest0-21swapper/212:10:142
453881992724,2cyclictest0-21swapper/209:04:562
45388199270,1cyclictest0-21swapper/207:31:592
453878992722,3cyclictest468767-21awk08:55:001
4670791260,6ptp4l61690irq/136-eno1-TxRx-008:35:013
4670791260,5ptp4l441ktimers/310:25:003
4670791260,5ptp4l441ktimers/309:55:013
45388299260,1cyclictest0-21swapper/308:51:593
453881992623,2cyclictest0-21swapper/209:22:592
453881992623,2cyclictest0-21swapper/208:02:592
45388199260,25cyclictest0-21swapper/212:24:592
45388199260,24cyclictest0-21swapper/212:28:592
45388199260,24cyclictest0-21swapper/210:20:132
45388199260,24cyclictest0-21swapper/208:20:592
45388199260,24cyclictest0-21swapper/208:09:552
45388199260,24cyclictest0-21swapper/207:16:022
4670791250,6ptp4l441ktimers/310:49:553
4670791250,5ptp4l441ktimers/311:45:013
4670791250,5ptp4l441ktimers/310:44:593
4670791250,5ptp4l441ktimers/310:44:593
4670791250,4ptp4l441ktimers/311:55:013
453882992523,1cyclictest0-21swapper/309:17:593
453882992523,1cyclictest0-21swapper/307:10:163
45388299250,24cyclictest0-21swapper/309:35:593
45388299250,1cyclictest0-21swapper/312:22:003
453881992523,1cyclictest0-21swapper/209:25:142
45388199250,2cyclictest0-21swapper/208:17:592
453878992520,4cyclictest511417-21kworker/u8:0+events_unbound11:30:171
4670791240,5ptp4l61690irq/136-eno1-TxRx-011:00:003
4670791240,5ptp4l441ktimers/310:24:543
4670791240,4ptp4l61690irq/136-eno1-TxRx-010:55:013
453881992422,1cyclictest0-21swapper/209:55:002
453881992421,2cyclictest0-21swapper/211:37:592
453881992421,2cyclictest0-21swapper/211:13:592
453881992421,2cyclictest0-21swapper/210:16:592
453881992421,2cyclictest0-21swapper/207:20:322
453876992420,2cyclictest0-21swapper/007:10:010
4670791230,5ptp4l441ktimers/311:24:563
4670791230,5ptp4l441ktimers/311:09:563
4670791230,5ptp4l441ktimers/309:59:563
4670791230,5ptp4l441ktimers/307:29:553
4670791230,4ptp4l441ktimers/312:40:003
453881992320,2cyclictest0-21swapper/207:10:012
453881992219,2cyclictest0-21swapper/211:02:582
4670791210,4ptp4l441ktimers/308:59:563
453881992016,2cyclictest0-21swapper/207:51:592
453881991916,2cyclictest0-21swapper/210:00:172
453881991715,1cyclictest0-21swapper/210:09:002
453881991412,1cyclictest0-21swapper/211:55:132
45388199130,12cyclictest0-21swapper/211:19:562
4538819996,2cyclictest0-21swapper/210:30:042
4538819996,2cyclictest0-21swapper/208:41:332
4538819985,2cyclictest0-21swapper/211:23:162
4538819980,7cyclictest0-21swapper/209:09:042
4538819974,2cyclictest0-21swapper/208:10:292
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional