You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 04:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Sun Apr 26, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22810109910493,8cyclictest2313322-21latency_hist20:50:001
22810069910089,9cyclictest2318406-21kworker/u8:2+flush-179:022:20:010
22810069910089,9cyclictest2318406-21kworker/u8:2+flush-179:022:20:000
2281010999772,22cyclictest1213033-21systemd-journal00:00:001
2281006999679,14cyclictest2366617-21kworker/u8:1+events_unbound00:40:000
2281006999587,5cyclictest2306953-21latency_hist20:30:010
2281010999484,7cyclictest2284142-21latency_hist19:20:011
2281010999372,18cyclictest2290788-21latency_hist19:40:011
2281006999179,9cyclictest2328156-21kworker/u8:3+flush-179:021:45:010
2281010998981,6cyclictest2344394-21kworker/u8:0+events_unbound22:30:011
2281010998965,22cyclictest2321772-21/usr/sbin/munin21:15:241
2281006998778,6cyclictest2321569-21kworker/u8:1+events_unbound21:20:240
2281006998679,4cyclictest2280960-21kworker/u8:2+flush-179:019:30:140
2281006998678,5cyclictest2326815-21kworker/u8:0+events_unbound21:35:210
2281006998676,7cyclictest2292406-21kworker/u8:3+flush-179:020:00:230
2281006998579,4cyclictest2292406-21kworker/u8:3+events_unbound20:20:240
2281006998579,4cyclictest2284118-21kworker/u8:0+flush-179:019:25:270
2281006998476,5cyclictest2341196-21kworker/u8:1+events_unbound22:25:000
2281006998374,5cyclictest2366617-21kworker/u8:1+events_unbound23:55:010
2281006998274,4cyclictest2318406-21kworker/u8:2+events_unbound22:00:010
2281006998172,6cyclictest2311737-21latency_hist20:45:010
2281006998172,6cyclictest2311737-21latency_hist20:45:000
2281010998071,6cyclictest2280895-21kworker/u8:1+flush-179:019:10:251
2281010997971,6cyclictest1213033-21systemd-journal23:00:011
2281006997971,5cyclictest2357129-21kworker/u8:1+flush-179:023:10:210
2281006997971,5cyclictest2357129-21kworker/u8:1+flush-179:023:10:210
2281006997971,5cyclictest2292406-21kworker/u8:3+events_unbound20:35:240
2281010997768,7cyclictest1213033-21systemd-journal00:23:321
2281010997763,11cyclictest2293959-21latency_hist19:50:011
2281006997772,3cyclictest2366617-21kworker/u8:1+flush-179:023:35:190
2281006997770,4cyclictest2379993-21kworker/u8:2+flush-179:000:20:210
2281006997766,8cyclictest2313860-21kworker/u8:0+flush-179:021:00:000
2281010997670,4cyclictest2280960-21kworker/u8:2+flush-179:019:30:261
2281010997667,6cyclictest2280960-21kworker/u8:2+flush-179:019:50:221
228101099760,1cyclictest0-21swapper/121:53:591
2281006997667,6cyclictest2365029-21kworker/u8:2+events_unbound23:40:240
2281010997566,6cyclictest2366640-21latency_hist23:35:021
2281006997566,6cyclictest2292356-21kworker/u8:0+flush-179:019:55:200
2281006997565,7cyclictest2318362-21latency_hist21:05:020
2281010997464,7cyclictest2292356-21kworker/u8:0+flush-179:020:05:001
2281006997466,5cyclictest2320203-21apt-get21:10:110
2281006997366,5cyclictest2280960-21kworker/u8:2+flush-179:019:40:160
2281006997365,5cyclictest2366617-21kworker/u8:1+flush-179:000:15:200
2281006997266,4cyclictest2329824-21kworker/u8:1+flush-179:021:45:160
2281006997265,5cyclictest2344394-21kworker/u8:0+flush-179:022:45:000
2281006997164,5cyclictest2321569-21kworker/u8:1+flush-179:021:25:170
2281006997159,4cyclictest2365029-21kworker/u8:2+events_unbound00:00:170
2281006997064,5cyclictest2365029-21kworker/u8:2+flush-179:000:05:140
2281006997060,7cyclictest2344394-21kworker/u8:0+flush-179:022:55:250
2281010996962,5cyclictest2302172-21latency_hist20:15:011
2281006996965,3cyclictest2318406-21kworker/u8:2+events_unbound21:10:010
2281006996964,4cyclictest2366617-21kworker/u8:1+flush-179:023:55:220
2281006996962,5cyclictest2292356-21kworker/u8:0+flush-179:020:10:000
2281006996962,4cyclictest2280960-21kworker/u8:2+events_unbound19:50:140
2281010996859,6cyclictest2332947-21latency_hist21:50:021
2281010996856,11cyclictest2337766-21kworker/u8:3+flush-179:023:05:011
2281006996863,4cyclictest2308529-21kworker/u8:2+flush-179:020:34:560
2281006996862,4cyclictest2360311-21kworker/u8:0+flush-179:023:30:230
2281006996761,4cyclictest2352567-21apt-get22:50:120
2281006996751,6cyclictest2329824-21kworker/u8:1+events_unbound21:50:260
2281010996655,9cyclictest2380214-21apt-get00:15:111
2281006996660,4cyclictest2318406-21kworker/u8:2+events_unbound22:05:010
2281006996657,6cyclictest2337766-21kworker/u8:3+flush-179:022:30:210
2281006996656,8cyclictest2280960-21kworker/u8:2+flush-179:019:40:000
2281006996655,8cyclictest2355761-21apt-get23:00:130
2281006996557,6cyclictest2326815-21kworker/u8:0+flush-179:021:30:220
2281010996455,7cyclictest2307210-21apt-get20:30:121
2281006996459,4cyclictest2318406-21kworker/u8:2+flush-179:022:15:010
2281006996457,5cyclictest2349174-21kworker/u8:1+events_unbound22:50:010
2281006996456,6cyclictest2353932-21kworker/u8:2+flush-179:023:15:150
2281010996255,5cyclictest2378373-21latency_hist00:10:021
2281006996257,4cyclictest2310195-21kworker/u8:1+flush-179:020:45:160
2281010996153,6cyclictest1213033-21systemd-journal00:14:321
2281010996050,8cyclictest2285773-21http19:25:011
2281006996055,4cyclictest2292406-21kworker/u8:3+flush-179:020:10:220
2281006996053,5cyclictest2280960-21kworker/u8:2+events_unbound19:45:240
2281006996051,7cyclictest2284118-21kworker/u8:0+flush-179:019:20:200
2281013995953,4cyclictest2357110-21turbostat23:05:003
2281006995954,4cyclictest2366617-21kworker/u8:1+flush-179:000:30:220
2281010995835,21cyclictest2318599-21/usr/sbin/munin21:05:231
2281006995852,4cyclictest2366617-21kworker/u8:1+events_unbound00:25:190
2281006995851,4cyclictest2378341-21kworker/u8:0+flush-179:000:10:190
2281010995749,5cyclictest2321569-21kworker/u8:1+flush-179:021:20:171
2281010995746,9cyclictest2296058-21apt-get19:55:111
2281006995752,4cyclictest2280895-21kworker/u8:1+events_unbound19:15:180
2281006995747,8cyclictest2281216-21apt-get19:10:120
2281006995746,9cyclictest2370376-21diskstats23:45:160
2281010995648,6cyclictest2343009-21/usr/sbin/munin22:20:181
2281006995648,6cyclictest2337766-21kworker/u8:3+flush-179:022:35:200
2281010995543,9cyclictest1213033-21systemd-journal00:04:001
2281010995515,30cyclictest0-21swapper/119:40:211
2281006995449,3cyclictest2337766-21kworker/u8:3+flush-179:022:10:000
2281010995346,5cyclictest2366617-21kworker/u8:1+flush-179:023:35:211
2281010995343,8cyclictest2317031-21apt-get21:00:131
2281006995347,4cyclictest2313860-21kworker/u8:0+flush-179:020:50:150
2281010995242,8cyclictest2341416-21apt-get22:15:101
2281010995242,8cyclictest2341416-21apt-get22:15:101
2281010995239,10cyclictest2326319-21latency_hist21:30:001
4577091510,24ptp4l61490irq/134-eno1-TxRx-019:05:023
2281010995144,5cyclictest2292356-21kworker/u8:0+events_unbound20:25:231
2281010995041,6cyclictest2366617-21kworker/u8:1+events_unbound00:30:201
2281006995044,5cyclictest2318406-21kworker/u8:2+events_unbound21:15:170
228101099490,1cyclictest0-21swapper/120:44:561
228101099490,1cyclictest0-21swapper/120:44:561
228101099481,43cyclictest2313577-21apt-get20:50:131
228101099481,2cyclictest0-21swapper/122:10:041
2281006994843,4cyclictest2341196-21kworker/u8:1+flush-179:022:30:010
2281010994738,7cyclictest1213033-21systemd-journal22:10:011
2281010994736,9cyclictest2362132-21apt-get23:20:111
2281010994731,14cyclictest0-21swapper/100:35:591
2281010994638,6cyclictest2328156-21kworker/u8:3+events_unbound21:35:011
2281010994626,17cyclictest0-21swapper/123:40:131
2281010994537,6cyclictest2350728-21latency_hist22:45:021
228101099450,1cyclictest0-21swapper/122:30:131
2281006994540,4cyclictest2360311-21kworker/u8:0+events_unbound23:27:340
2281006994539,4cyclictest2353932-21kworker/u8:2+flush-179:023:05:220
2281013994433,10cyclictest2381561-21turbostat00:20:003
2281010994439,4cyclictest2292406-21kworker/u8:3+flush-179:020:20:161
2281010994436,6cyclictest2286257-21apt-get19:25:121
2281010994433,9cyclictest2347787-21apt-get22:35:111
2281010994337,4cyclictest1-21systemd22:05:001
2281010994336,5cyclictest2365029-21kworker/u8:2+flush-179:023:45:221
2281010994326,15cyclictest2328422-21apt-get21:35:131
2281006994338,4cyclictest2362923-21kworker/u8:1+flush-179:023:20:250
228101399420,40cyclictest2284163-21turbostat19:24:553
2281011994238,2cyclictest0-21swapper/221:34:552
2281010994234,6cyclictest2308529-21kworker/u8:2+flush-179:020:40:011
228101099420,2cyclictest714-21Xorg23:07:591
228101099420,28cyclictest2363700-21/usr/sbin/munin23:25:221
2281006994233,7cyclictest2303765-21latency_hist20:20:010
2281013994139,1cyclictest0-21swapper/321:34:543
2281010994126,14cyclictest0-21swapper/121:10:591
228101099410,27cyclictest2335000-21cat21:55:141
4577091400,5ptp4l431rcuc/322:45:003
228101399400,39cyclictest0-21swapper/322:10:593
2281013993930,1cyclictest0-21swapper/321:54:583
228101399390,38cyclictest2345960-21turbostat22:30:003
2281011993935,2cyclictest0-21swapper/219:58:592
2281011993932,6cyclictest0-21swapper/222:12:592
228101199390,36cyclictest0-21swapper/220:42:592
228101199390,36cyclictest0-21swapper/220:42:582
2281010993936,2cyclictest714-21Xorg20:15:581
2281010993920,17cyclictest2331025-21switchtime21:40:231
2281013993833,4cyclictest2373278-21turbostat23:55:003
2281011993834,2cyclictest0-21swapper/219:45:592
228101199380,36cyclictest0-21swapper/222:52:592
2281010993831,5cyclictest2337766-21kworker/u8:3+events_unbound23:15:001
2281010993831,5cyclictest2337766-21kworker/u8:3+events_unbound23:14:591
2281013993734,2cyclictest0-21swapper/319:45:593
2281013993732,4cyclictest2295812-21turbostat19:55:003
228101399370,30cyclictest0-21swapper/320:42:593
228101399370,30cyclictest0-21swapper/320:42:583
2281011993734,2cyclictest0-21swapper/223:55:002
2281011993734,2cyclictest0-21swapper/223:24:592
2281011993733,3cyclictest0-21swapper/200:18:592
2281011993733,2cyclictest0-21swapper/223:04:552
2281011993733,2cyclictest0-21swapper/200:34:552
2281011993730,1cyclictest0-21swapper/221:54:582
2281010993730,5cyclictest2344394-21kworker/u8:0+flush-179:022:45:171
2281013993634,1cyclictest0-21swapper/323:25:003
2281013993634,1cyclictest0-21swapper/319:58:593
228101399360,35cyclictest0-21swapper/322:52:593
228101399360,35cyclictest0-21swapper/320:16:593
2281011993633,2cyclictest0-21swapper/222:59:002
2281010993632,2cyclictest2360261-21cron23:15:011
4577091350,3ptp4l441ktimers/320:05:143
2281013993533,1cyclictest0-21swapper/300:34:553
2281013993532,2cyclictest0-21swapper/322:58:593
2281013993532,2cyclictest0-21swapper/320:23:593
2281011993532,2cyclictest0-21swapper/220:23:592
2281010993517,16cyclictest0-21swapper/120:05:171
2281011993432,1cyclictest0-21swapper/219:55:002
2281011993430,3cyclictest0-21swapper/222:03:002
4577091330,2ptp4l441ktimers/323:40:133
2281011993330,2cyclictest0-21swapper/220:38:592
2281011993329,2cyclictest0-21swapper/220:34:552
228101199320,30cyclictest0-21swapper/200:25:032
2281010993215,15cyclictest0-21swapper/122:50:231
228101099321,30cyclictest0-21swapper/120:55:131
228101099321,29cyclictest0-21swapper/123:50:031
228101099320,29cyclictest2383475-21apt-key00:25:031
2281013993129,1cyclictest0-21swapper/322:03:003
2281013993129,1cyclictest0-21swapper/320:38:593
2281013993129,1cyclictest0-21swapper/320:34:553
228101399310,23cyclictest0-21swapper/300:25:033
228101199310,29cyclictest0-21swapper/223:10:132
228101199310,29cyclictest0-21swapper/223:10:132
228101199310,28cyclictest0-21swapper/219:19:552
2281013993026,3cyclictest2313340-21turbostat20:50:003
2281013993026,2cyclictest0-21swapper/322:20:133
228101399300,2cyclictest0-21swapper/323:10:123
228101399300,2cyclictest0-21swapper/323:10:123
228101399300,28cyclictest0-21swapper/321:35:133
228101399300,28cyclictest0-21swapper/321:30:013
228101199300,28cyclictest0-21swapper/222:20:142
228101199300,28cyclictest0-21swapper/221:55:122
228101199300,28cyclictest0-21swapper/221:05:132
228101199300,27cyclictest0-21swapper/223:31:582
228101199300,27cyclictest0-21swapper/222:25:132
2281013992926,2cyclictest0-21swapper/319:44:593
2281013992925,2cyclictest4577091ptp4l22:45:173
228101399290,2cyclictest0-21swapper/323:25:133
228101399290,27cyclictest0-21swapper/321:55:133
228101399290,27cyclictest0-21swapper/321:05:133
228101399290,27cyclictest0-21swapper/300:10:143
2281011992925,2cyclictest0-21swapper/220:55:592
228101199290,2cyclictest0-21swapper/223:40:142
228101199290,2cyclictest0-21swapper/223:25:142
228101199290,27cyclictest0-21swapper/223:19:582
228101199290,27cyclictest0-21swapper/221:30:012
228101199290,27cyclictest0-21swapper/220:45:142
4577091280,7ptp4l61490irq/134-eno1-TxRx-022:35:013
4577091280,7ptp4l61490irq/134-eno1-TxRx-000:04:563
4577091280,7ptp4l441ktimers/300:10:003
4577091280,6ptp4l61490irq/134-eno1-TxRx-023:10:023
4577091280,6ptp4l61490irq/134-eno1-TxRx-000:00:023
4577091280,6ptp4l441ktimers/323:20:003
2281013992825,2cyclictest0-21swapper/320:55:593
2281013992825,2cyclictest0-21swapper/320:03:593
228101399280,26cyclictest0-21swapper/319:25:033
228101399280,1cyclictest0-21swapper/319:19:553
2281011992826,1cyclictest0-21swapper/219:44:592
2281011992825,2cyclictest0-21swapper/200:10:142
2281011992824,2cyclictest0-21swapper/220:13:592
2281011992824,2cyclictest0-21swapper/220:01:592
228101199280,2cyclictest0-21swapper/222:15:132
228101199280,2cyclictest0-21swapper/222:15:132
228101199280,2cyclictest0-21swapper/219:25:022
228101199280,2cyclictest0-21swapper/200:39:592
228101199280,27cyclictest0-21swapper/219:35:142
228101199280,26cyclictest0-21swapper/221:35:122
228101199280,25cyclictest0-21swapper/222:05:592
4577091270,6ptp4l61490irq/134-eno1-TxRx-000:25:013
4577091270,6ptp4l441ktimers/321:20:013
4577091270,6ptp4l441ktimers/321:04:563
4577091270,6ptp4l441ktimers/300:40:003
4577091270,5ptp4l441ktimers/319:15:003
228101399270,26cyclictest0-21swapper/319:35:143
228101399270,1cyclictest0-21swapper/323:31:583
228101399270,1cyclictest0-21swapper/322:15:133
228101399270,1cyclictest0-21swapper/322:15:123
2281011992724,2cyclictest0-21swapper/220:53:592
2281011992724,2cyclictest0-21swapper/220:06:002
2281011992723,2cyclictest0-21swapper/219:21:592
4577091260,6ptp4l61490irq/134-eno1-TxRx-023:50:003
4577091260,6ptp4l441ktimers/322:10:003
4577091260,6ptp4l441ktimers/319:34:563
4577091260,5ptp4l441ktimers/323:39:573
4577091260,5ptp4l441ktimers/321:44:563
2281013992624,1cyclictest0-21swapper/320:53:593
2281013992624,1cyclictest0-21swapper/320:13:593
2281011992623,2cyclictest0-21swapper/222:35:142
2281011992623,2cyclictest0-21swapper/221:44:002
2281011992622,3cyclictest0-21swapper/222:32:592
228101199260,24cyclictest0-21swapper/200:04:562
228101099261,22cyclictest2281007-21latency_hist19:10:011
4577091250,5ptp4l441ktimers/321:50:003
4577091250,5ptp4l441ktimers/321:14:553
2281013992523,1cyclictest0-21swapper/322:35:133
2281013992523,1cyclictest0-21swapper/320:25:593
2281011992523,1cyclictest0-21swapper/222:45:132
2281011992522,2cyclictest0-21swapper/220:25:592
4577091240,5ptp4l441ktimers/321:24:563
2281011992320,2cyclictest0-21swapper/219:34:592
2281011992219,2cyclictest0-21swapper/223:36:592
2281011992219,2cyclictest0-21swapper/200:21:002
2281011992118,2cyclictest0-21swapper/223:05:132
2281011992118,2cyclictest0-21swapper/220:17:592
2281011992018,1cyclictest0-21swapper/221:50:012
2281011992018,1cyclictest0-21swapper/221:15:002
2281011992017,2cyclictest0-21swapper/221:18:002
2281006992016,3cyclictest2281016-21latency_hist19:10:010
2281011991814,2cyclictest0-21swapper/223:58:592
2281011991714,2cyclictest0-21swapper/219:14:552
2281011991714,2cyclictest0-21swapper/200:05:022
2281011991412,1cyclictest0-21swapper/221:24:592
2281011991411,2cyclictest0-21swapper/221:00:132
228101199107,2cyclictest0-21swapper/223:45:582
22810119996,2cyclictest0-21swapper/222:43:592
22810119940,2cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional