You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 15:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Wed Dec 10, 2025 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3415599910891,15cyclictest432063-21kworker/u8:0+flush-179:000:20:001
3415599910093,6cyclictest380550-21kworker/u8:0+flush-179:021:20:001
341559999281,8cyclictest401441-21/usr/sbin/munin22:15:231
341559998983,4cyclictest417632-21kworker/u8:0+flush-179:023:05:251
341559998781,4cyclictest406278-21kworker/u8:1+flush-179:023:30:001
341558998679,4cyclictest427188-21kworker/u8:2+flush-179:023:55:000
341559998580,3cyclictest351573-21kworker/u8:1+events_unbound20:20:241
341559998277,4cyclictest406278-21kworker/u8:1+events_unbound22:40:231
341558998274,6cyclictest432063-21kworker/u8:0+events_unbound00:30:240
341559998175,4cyclictest393791-21kworker/u8:2+flush-179:022:25:011
341559998175,4cyclictest367806-21kworker/u8:3+events_unbound20:39:591
341559998073,5cyclictest385328-21kworker/u8:3+events_unbound21:25:281
341559998072,6cyclictest401248-21kworker/u8:3+events_unbound22:30:221
341559998072,6cyclictest401248-21kworker/u8:3+events_unbound22:30:221
341559998072,6cyclictest348397-21kworker/u8:0+events_unbound19:55:011
341558998070,6cyclictest380550-21kworker/u8:0+events_unbound21:15:250
341558997973,4cyclictest427188-21kworker/u8:2+flush-179:023:35:000
341559997870,6cyclictest379161-21/usr/sbin/munin21:05:241
341559997865,11cyclictest341529-21kworker/u8:2+flush-179:019:20:161
341559997771,5cyclictest432063-21kworker/u8:0+flush-179:000:04:001
341559997771,5cyclictest406278-21kworker/u8:1+events_unbound22:45:241
341558997768,7cyclictest415789-21latency_hist23:00:010
341559997671,4cyclictest351573-21kworker/u8:1+flush-179:020:10:281
341559997668,6cyclictest371003-21kworker/u8:0+flush-179:020:50:011
341558997564,9cyclictest430405-21apt-get23:44:400
341559997467,5cyclictest414233-21kworker/u8:3+events_unbound23:00:031
341559997369,3cyclictest371003-21kworker/u8:0+events_unbound20:40:241
341559997368,4cyclictest390042-21kworker/u8:1+events_unbound21:40:231
341559997366,6cyclictest374378-21kworker/u8:2+flush-179:021:00:001
341559997266,5cyclictest359595-21kworker/u8:2+flush-179:020:10:001
341559997266,4cyclictest406278-21kworker/u8:1+events_unbound22:50:241
341559997264,5cyclictest438637-21cat00:10:001
341558997263,6cyclictest443239-21latency_hist00:25:010
341559997165,5cyclictest414233-21kworker/u8:3+flush-179:023:25:001
341559997165,4cyclictest414233-21kworker/u8:3+flush-179:023:45:221
341559997164,5cyclictest396772-21kworker/u8:1+flush-179:022:05:011
341559997065,4cyclictest406278-21kworker/u8:1+events_unbound23:00:011
341559997064,4cyclictest436828-21kworker/u8:1+events_unbound00:25:171
341559997063,5cyclictest406278-21kworker/u8:1+flush-179:023:15:011
341558997063,5cyclictest374378-21kworker/u8:2+flush-179:020:55:190
341559996964,4cyclictest436828-21kworker/u8:1+flush-179:000:10:161
341558996962,5cyclictest374378-21kworker/u8:2+events_unbound21:10:000
341558996962,5cyclictest348397-21kworker/u8:0+events_unbound19:35:000
341558996958,9cyclictest271-21systemd-journal00:04:110
341558996859,7cyclictest351573-21kworker/u8:1+events_unbound19:50:010
341558996763,3cyclictest341529-21kworker/u8:2+events_unbound19:15:260
341558996761,5cyclictest348397-21kworker/u8:0+flush-179:019:40:010
341559996661,3cyclictest345012-21kworker/u8:3+flush-179:019:35:241
341559996660,5cyclictest375762-21kworker/u8:3+flush-179:021:00:241
341559996660,4cyclictest436828-21kworker/u8:1+flush-179:000:30:211
341559996656,8cyclictest271-21systemd-journal19:29:591
341558996660,4cyclictest432063-21kworker/u8:0+events_unbound23:55:170
341558996659,5cyclictest380550-21kworker/u8:0+flush-179:021:45:000
341558996659,4cyclictest444869-21kworker/u8:3+flush-179:000:35:160
341559996557,6cyclictest336955-21kworker/u8:1+events_unbound19:10:151
341558996556,7cyclictest382096-21latency_hist21:15:020
341563996461,2cyclictest0-21swapper/220:26:592
341558996355,6cyclictest385325-21kworker/u8:2+events_unbound21:40:000
341559996256,4cyclictest396772-21kworker/u8:1+events_unbound22:05:141
341559996256,4cyclictest380550-21kworker/u8:0+flush-179:021:20:221
341559996256,4cyclictest359595-21kworker/u8:2+flush-179:020:30:211
341559996251,9cyclictest351862-21apt-get19:40:101
341558996154,5cyclictest391699-21kworker/u8:3+flush-179:021:45:200
341559996054,4cyclictest427188-21kworker/u8:2+events_unbound23:35:221
341559996054,4cyclictest380550-21kworker/u8:0+events_unbound21:30:141
341558996050,8cyclictest271-21systemd-journal23:30:000
202199600,20rtkit-daemon2005-21lightdm-gtk-gre22:40:260
341559995953,3cyclictest414233-21kworker/u8:3+events_unbound23:15:201
341559995951,5cyclictest351573-21kworker/u8:1+flush-179:020:00:181
341559995851,5cyclictest393791-21kworker/u8:2+flush-179:021:55:191
341559995849,5cyclictest414233-21kworker/u8:3+flush-179:023:40:151
341558995855,2cyclictest0-21swapper/022:00:590
341558995854,3cyclictest406278-21kworker/u8:1+flush-179:022:30:010
341559995751,4cyclictest380550-21kworker/u8:0+flush-179:021:50:211
341558995749,6cyclictest417632-21kworker/u8:0+flush-179:023:05:150
341559995650,5cyclictest348397-21kworker/u8:0+flush-179:019:45:201
341559995650,4cyclictest432063-21kworker/u8:0+events_unbound23:55:231
341558995647,6cyclictest399616-21latency_hist22:10:020
341559995550,4cyclictest380550-21kworker/u8:0+flush-179:021:35:251
341559995548,6cyclictest393791-21kworker/u8:2+flush-179:022:25:151
341558995540,4cyclictest401248-21kworker/u8:3+events_unbound22:35:190
341559995448,5cyclictest374378-21kworker/u8:2+events_unbound21:10:211
341558995448,4cyclictest374378-21kworker/u8:2+flush-179:020:50:190
341558995447,6cyclictest427188-21kworker/u8:2+events_unbound23:50:010
341559995348,4cyclictest432063-21kworker/u8:0+flush-179:000:35:261
341558995347,5cyclictest380550-21kworker/u8:0+events_unbound21:20:250
341558995347,4cyclictest359595-21kworker/u8:2+flush-179:020:25:150
341559995244,6cyclictest393246-21latency_hist21:50:011
341558995247,4cyclictest436828-21kworker/u8:1+flush-179:000:25:190
341559995134,4cyclictest414233-21kworker/u8:3+events_unbound23:30:231
341558995145,4cyclictest406278-21kworker/u8:1+flush-179:023:00:220
341558995045,4cyclictest351573-21kworker/u8:1+flush-179:019:45:010
341558995045,3cyclictest427188-21kworker/u8:2+flush-179:023:35:160
341563994946,2cyclictest0-21swapper/221:25:592
341559994939,8cyclictest364331-21apt-get20:20:011
341558994944,4cyclictest351573-21kworker/u8:1+flush-179:020:15:000
341558994943,4cyclictest375762-21kworker/u8:3+flush-179:021:00:230
4670791480,13ptp4l61690irq/136-eno1-TxRx-019:10:013
341568994846,1cyclictest0-21swapper/300:02:593
341558994843,3cyclictest341529-21kworker/u8:2+flush-179:019:20:210
341559994742,4cyclictest393791-21kworker/u8:2+flush-179:022:10:161
341559994741,5cyclictest348397-21kworker/u8:0+flush-179:019:30:161
341558994740,6cyclictest393791-21kworker/u8:2+flush-179:021:55:010
341559994642,3cyclictest359595-21kworker/u8:2+flush-179:020:29:561
341558994642,3cyclictest356403-21munin-run19:55:000
341558994635,9cyclictest395376-21diskstats21:55:160
341558994538,6cyclictest371003-21kworker/u8:0+flush-179:020:40:160
341558994534,7cyclictest351573-21kworker/u8:1+events_unbound20:15:250
341558994438,5cyclictest400152-21kworker/u8:0+flush-179:022:20:000
341559994337,4cyclictest432063-21kworker/u8:0+flush-179:000:20:151
341558994338,4cyclictest393791-21kworker/u8:2+flush-179:022:10:220
341558994335,6cyclictest351573-21kworker/u8:1+flush-179:020:05:160
34155899432,39cyclictest438464-21turbostat00:14:550
34156399420,40cyclictest0-21swapper/222:01:592
341558994238,3cyclictest380550-21kworker/u8:0+flush-179:021:30:170
341558994237,4cyclictest432063-21kworker/u8:0+events_unbound00:15:190
341558994237,4cyclictest414233-21kworker/u8:3+flush-179:023:15:250
341558994236,5cyclictest351573-21kworker/u8:1+flush-179:019:55:210
34156399410,39cyclictest0-21swapper/219:22:582
341558994137,3cyclictest401248-21kworker/u8:3+events_unbound22:20:240
341558994136,4cyclictest351573-21kworker/u8:1+flush-179:020:00:190
341558994133,6cyclictest502-21rs:main0
341568994033,5cyclictest0-21swapper/300:16:593
34156899400,38cyclictest364339-21turbostat20:20:013
341558994036,3cyclictest436828-21kworker/u8:1+flush-179:000:05:250
34156399390,36cyclictest0-21swapper/220:54:552
341559993934,4cyclictest432063-21kworker/u8:0+flush-179:023:50:241
34155999390,37cyclictest723-21Xorg19:16:591
341568993836,1cyclictest0-21swapper/320:44:003
341568993835,2cyclictest0-21swapper/320:05:003
34156399380,36cyclictest0-21swapper/223:30:592
34156399380,36cyclictest0-21swapper/221:31:592
341558993835,2cyclictest386883-21munin-run21:30:000
341558993826,10cyclictest723-21Xorg20:34:000
34155899380,2cyclictest0-21swapper/022:54:590
34156899370,36cyclictest0-21swapper/322:30:593
34156899370,36cyclictest0-21swapper/322:30:593
341563993735,1cyclictest0-21swapper/222:19:592
341563993734,2cyclictest0-21swapper/221:17:002
341563993734,2cyclictest0-21swapper/220:20:592
341563993734,2cyclictest0-21swapper/219:34:002
341563993734,2cyclictest0-21swapper/219:26:592
34156399370,35cyclictest0-21swapper/221:46:592
34156399370,35cyclictest0-21swapper/200:14:592
341558993733,3cyclictest414233-21kworker/u8:3+flush-179:023:20:160
341568993633,2cyclictest0-21swapper/323:32:593
34156899360,1cyclictest0-21swapper/323:41:593
341563993633,2cyclictest0-21swapper/200:30:592
34156399360,1cyclictest0-21swapper/223:40:592
341559993633,2cyclictest0-21swapper/122:36:001
341558993630,5cyclictest351573-21kworker/u8:1+events_unbound20:35:200
341558993625,9cyclictest343116-21apt-get19:15:010
341568993533,1cyclictest0-21swapper/319:23:593
34156899350,34cyclictest0-21swapper/323:04:553
341563993532,2cyclictest0-21swapper/222:53:592
341563993532,2cyclictest0-21swapper/220:14:552
34156399350,1cyclictest0-21swapper/221:45:002
341558993532,2cyclictest0-21swapper/023:11:590
341558993532,2cyclictest0-21swapper/022:34:580
341558993532,2cyclictest0-21swapper/022:34:580
341558993532,2cyclictest0-21swapper/020:24:590
341558993531,3cyclictest351573-21kworker/u8:1+events_unbound20:45:200
341568993432,2cyclictest0-21swapper/321:14:563
341568993432,1cyclictest0-21swapper/321:57:593
341568993431,2cyclictest0-21swapper/320:52:593
34156899340,27cyclictest0-21swapper/320:45:143
34156899340,27cyclictest0-21swapper/319:55:133
341563993431,2cyclictest0-21swapper/222:33:592
341563993431,2cyclictest0-21swapper/222:33:582
341563993431,2cyclictest0-21swapper/221:53:592
341563993431,2cyclictest0-21swapper/221:23:592
341559993429,4cyclictest374378-21kworker/u8:2+events_unbound20:52:411
341559993429,4cyclictest351573-21kworker/u8:1+events_unbound19:55:251
341568993332,1cyclictest0-21swapper/322:24:553
341568993331,1cyclictest0-21swapper/323:19:553
341568993331,1cyclictest0-21swapper/321:54:563
341568993331,1cyclictest0-21swapper/300:37:593
341568993331,1cyclictest0-21swapper/300:33:583
341568993325,7cyclictest0-21swapper/300:09:593
34156899330,27cyclictest0-21swapper/320:10:163
34156899330,27cyclictest0-21swapper/319:35:143
341563993330,2cyclictest0-21swapper/219:58:582
341563993330,2cyclictest0-21swapper/219:51:592
341568993230,1cyclictest0-21swapper/322:50:593
34156899320,26cyclictest0-21swapper/322:10:143
341563993229,2cyclictest0-21swapper/223:02:582
341563993229,2cyclictest0-21swapper/220:56:592
341563993229,2cyclictest0-21swapper/219:44:592
34156399320,30cyclictest0-21swapper/219:47:002
341568993125,5cyclictest0-21swapper/322:46:583
341563993129,1cyclictest0-21swapper/222:09:592
341563993128,2cyclictest0-21swapper/223:39:552
341563993128,2cyclictest0-21swapper/219:13:592
341558993126,4cyclictest406278-21kworker/u8:1+flush-179:022:45:160
4670791300,7ptp4l441ktimers/322:10:003
4670791300,7ptp4l441ktimers/300:25:003
341568993028,1cyclictest0-21swapper/322:39:543
341568993026,2cyclictest0-21swapper/323:05:133
341568993023,6cyclictest0-21swapper/322:29:003
34156899300,26cyclictest0-21swapper/323:35:153
34156899290,28cyclictest0-21swapper/300:25:153
34156899290,27cyclictest0-21swapper/323:25:143
34156899290,27cyclictest0-21swapper/319:10:143
34156899290,21cyclictest0-21swapper/320:35:133
341563992927,1cyclictest0-21swapper/221:55:152
341563992926,2cyclictest0-21swapper/222:55:162
341563992926,2cyclictest0-21swapper/222:36:592
341563992926,2cyclictest0-21swapper/222:10:122
341563992926,2cyclictest0-21swapper/221:01:002
341563992926,2cyclictest0-21swapper/220:45:152
341563992926,2cyclictest0-21swapper/200:00:122
34156399290,2cyclictest0-21swapper/200:20:152
34156399290,28cyclictest0-21swapper/223:25:142
34156399290,28cyclictest0-21swapper/222:25:022
34156399290,27cyclictest0-21swapper/222:20:132
34156399290,27cyclictest0-21swapper/220:00:162
341558992926,2cyclictest341563-21cyclictest19:10:020
4670791280,6ptp4l441ktimers/322:19:543
341568992826,1cyclictest0-21swapper/323:00:013
341568992826,1cyclictest0-21swapper/321:34:593
341568992826,1cyclictest0-21swapper/320:20:033
341568992825,2cyclictest0-21swapper/323:20:143
341568992825,2cyclictest0-21swapper/321:20:133
34156899280,27cyclictest0-21swapper/320:30:593
34156899280,27cyclictest0-21swapper/319:34:593
34156899280,27cyclictest0-21swapper/319:25:013
34156899280,27cyclictest0-21swapper/300:14:003
34156899280,26cyclictest0-21swapper/319:15:033
341563992826,1cyclictest0-21swapper/223:15:002
341563992826,1cyclictest0-21swapper/222:45:002
341563992826,1cyclictest0-21swapper/219:15:022
341563992825,2cyclictest0-21swapper/223:55:592
341563992825,2cyclictest0-21swapper/223:15:132
341563992825,2cyclictest0-21swapper/221:05:592
34156399280,27cyclictest0-21swapper/200:35:132
34156399280,26cyclictest0-21swapper/220:08:592
4670791270,6ptp4l61690irq/136-eno1-TxRx-021:45:003
4670791270,6ptp4l441ktimers/323:15:003
4670791270,6ptp4l441ktimers/321:09:553
4670791270,6ptp4l441ktimers/320:30:003
4670791270,5ptp4l61690irq/136-eno1-TxRx-021:20:013
4670791270,5ptp4l441ktimers/323:50:013
4670791270,4ptp4l441ktimers/322:05:003
341568992725,1cyclictest0-21swapper/321:00:143
341568992724,2cyclictest435221-21turbostat00:00:003
34156899270,26cyclictest0-21swapper/321:39:593
341563992724,2cyclictest0-21swapper/223:51:592
34156399270,25cyclictest0-21swapper/223:47:592
4670791260,4ptp4l441ktimers/321:50:003
341563992624,1cyclictest0-21swapper/219:37:592
34156399260,24cyclictest0-21swapper/221:35:152
202199260,14rtkit-daemon340907-21ntp_192.168.11419:05:281
4670791250,5ptp4l61690irq/136-eno1-TxRx-023:55:003
4670791250,5ptp4l61690irq/136-eno1-TxRx-020:59:553
4670791250,4ptp4l61690irq/136-eno1-TxRx-020:10:003
4670791250,4ptp4l61690irq/136-eno1-TxRx-019:44:553
341568992523,1cyclictest0-21swapper/319:49:003
34156899250,24cyclictest0-21swapper/319:51:583
4670791240,4ptp4l61690irq/136-eno1-TxRx-021:29:553
34156899240,1cyclictest0-21swapper/322:45:003
341563992421,2cyclictest351rcuc/221:14:552
341563992219,2cyclictest0-21swapper/200:08:592
341563992118,2cyclictest0-21swapper/220:33:592
341563992017,2cyclictest0-21swapper/223:07:002
341563992017,2cyclictest0-21swapper/200:25:152
341563991916,2cyclictest0-21swapper/220:43:002
341563991815,2cyclictest0-21swapper/223:22:592
341563991815,2cyclictest0-21swapper/220:15:592
341563991715,1cyclictest0-21swapper/200:17:592
341563991613,2cyclictest0-21swapper/220:38:582
341563991410,3cyclictest351rcuc/222:49:562
3415639931,1cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional