You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 05:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Thu Dec 04, 2025 00:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44225499147131,12cyclictest536622-40mandb00:00:011
4422509910396,5cyclictest519079-21kworker/u8:0+events_unbound23:20:000
4422509910190,9cyclictest511185-21gpgv22:40:010
442250999785,9cyclictest484664-21latency_hist21:20:010
442250999487,5cyclictest455278-21kworker/u8:1+events_unbound19:55:000
442256999359,32cyclictest0-21swapper/219:25:592
442250999385,6cyclictest446988-21kworker/u8:3+flush-179:019:30:320
442261999056,33cyclictest0-21swapper/319:25:593
442254998984,4cyclictest505839-21kworker/u8:3+events_unbound22:30:241
442254998982,5cyclictest515937-21kworker/u8:2+flush-179:023:00:011
442254998980,7cyclictest440809-21kworker/u8:0+flush-179:020:10:011
442254998881,5cyclictest446988-21kworker/u8:3+events_unbound19:25:401
442254998476,6cyclictest515937-21kworker/u8:2+flush-179:023:05:011
442250998472,9cyclictest271-21systemd-journal19:19:330
442250998472,9cyclictest271-21systemd-journal19:19:330
442254998377,4cyclictest515937-21kworker/u8:2+flush-179:000:40:001
442254998376,5cyclictest496069-21kworker/u8:2+events_unbound22:05:011
442254998376,5cyclictest496069-21kworker/u8:2+events_unbound22:05:001
442250998376,6cyclictest446988-21kworker/u8:3+flush-179:019:40:000
442254998276,4cyclictest460307-21kworker/u8:3+flush-179:020:35:241
442254998276,4cyclictest460307-21kworker/u8:3+flush-179:020:35:011
442254998275,5cyclictest505839-21kworker/u8:3+events_unbound22:30:011
442254998275,5cyclictest505839-21kworker/u8:3+events_unbound22:30:001
442254997974,4cyclictest525719-21kworker/u8:0+events_unbound23:55:011
442254997967,5cyclictest426872-21kworker/u8:2+events_unbound19:15:251
442254997967,5cyclictest426872-21kworker/u8:2+events_unbound19:15:251
442254997870,6cyclictest455278-21kworker/u8:1+flush-179:020:25:001
442254997771,4cyclictest505839-21kworker/u8:3+events_unbound22:35:241
442250997772,4cyclictest460307-21kworker/u8:3+events_unbound21:40:000
442254997671,4cyclictest488322-21kworker/u8:1+events_unbound21:35:241
442254997667,7cyclictest271-21systemd-journal21:00:001
442250997669,5cyclictest525719-21kworker/u8:0+events_unbound23:45:240
442250997668,6cyclictest460307-21kworker/u8:3+events_unbound21:10:210
442250997666,8cyclictest503999-21latency_hist22:20:020
442250997666,7cyclictest505852-21latency_hist22:25:020
442254997569,4cyclictest460307-21kworker/u8:3+events_unbound20:20:001
442250997569,4cyclictest515937-21kworker/u8:2+events_unbound00:10:180
442250997470,3cyclictest479653-21kworker/u8:2+events_unbound21:05:260
442250997468,4cyclictest515937-21kworker/u8:2+events_unbound23:00:000
442250997365,5cyclictest525719-21kworker/u8:0+flush-179:023:40:230
442250997365,5cyclictest525719-21kworker/u8:0+flush-179:023:40:220
44225099731,68cyclictest478067-21unin-run21:00:010
442254997266,4cyclictest486227-21kworker/u8:0+flush-179:021:25:211
442254997165,4cyclictest519079-21kworker/u8:0+flush-179:023:15:221
442254997164,4cyclictest496012-21kworker/u8:1+events_unbound21:55:141
442250997161,8cyclictest486477-21/usr/sbin/munin21:25:260
442254997064,4cyclictest520716-21kworker/u8:3+events_unbound23:20:261
442254997061,6cyclictest426872-21kworker/u8:2+flush-179:019:20:211
442250997062,6cyclictest510952-21kworker/u8:0+flush-179:022:50:000
442250997062,5cyclictest515937-21kworker/u8:2+events_unbound23:35:170
442250997060,7cyclictest460263-21latency_hist20:05:010
442254996963,4cyclictest534481-21kworker/u8:1+events_unbound00:00:251
442254996962,5cyclictest460307-21kworker/u8:3+flush-179:021:25:011
442254996960,6cyclictest440809-21kworker/u8:0+flush-179:019:40:151
442254996956,4cyclictest460307-21kworker/u8:3+flush-179:021:50:271
442250996965,3cyclictest525719-21kworker/u8:0+events_unbound23:55:260
442254996862,4cyclictest440809-21kworker/u8:0+events_unbound20:00:011
442254996861,6cyclictest460307-21kworker/u8:3+flush-179:021:05:011
442254996859,5cyclictest440809-21kworker/u8:0+flush-179:020:00:201
442250996862,5cyclictest520716-21kworker/u8:3+flush-179:023:20:180
442250996862,4cyclictest515937-21kworker/u8:2+events_unbound23:05:200
442250996862,4cyclictest440809-21kworker/u8:0+events_unbound20:05:220
442250996861,5cyclictest460307-21kworker/u8:3+flush-179:021:40:160
442254996761,4cyclictest515937-21kworker/u8:2+events_unbound00:15:261
442254996761,4cyclictest460307-21kworker/u8:3+events_unbound21:45:171
442250996762,4cyclictest486227-21kworker/u8:0+flush-179:021:45:250
442250996662,3cyclictest546183-21kworker/u8:3+flush-179:000:30:250
442250996658,6cyclictest515937-21kworker/u8:2+flush-179:023:25:200
442254996559,4cyclictest505839-21kworker/u8:3+flush-179:022:45:181
442254996457,5cyclictest505839-21kworker/u8:3+events_unbound22:40:191
442254996455,6cyclictest525719-21kworker/u8:0+flush-179:023:45:201
442250996456,5cyclictest496069-21kworker/u8:2+events_unbound22:10:220
442250996452,9cyclictest512735-21latency_hist22:45:010
442254996358,4cyclictest460307-21kworker/u8:3+flush-179:020:30:001
442254996353,3cyclictest525719-21kworker/u8:0+flush-179:023:40:211
442254996353,3cyclictest525719-21kworker/u8:0+flush-179:023:40:211
442250996358,4cyclictest534481-21kworker/u8:1+flush-179:023:50:240
442250996358,4cyclictest515937-21kworker/u8:2+flush-179:023:14:550
442250996358,3cyclictest539849-21kworker/u8:1+events_unbound00:20:170
442254996254,6cyclictest486227-21kworker/u8:0+flush-179:021:30:201
442254996254,6cyclictest460307-21kworker/u8:3+flush-179:020:40:211
442254996253,7cyclictest442107-21latency_hist19:10:021
442250996254,5cyclictest496012-21kworker/u8:1+flush-179:022:50:210
442250996254,5cyclictest496012-21kworker/u8:1+flush-179:022:50:200
442254996153,6cyclictest496012-21kworker/u8:1+flush-179:022:50:151
442254996153,6cyclictest496012-21kworker/u8:1+flush-179:022:50:151
442250996155,4cyclictest455278-21kworker/u8:1+flush-179:020:10:210
442250996154,5cyclictest478907-21kworker/u8:1+flush-179:021:00:200
442250996152,6cyclictest515937-21kworker/u8:2+flush-179:023:00:200
442250996151,7cyclictest497633-21latency_hist22:00:010
442254995954,4cyclictest496069-21kworker/u8:2+flush-179:022:10:241
442250995955,3cyclictest446988-21kworker/u8:3+events_unbound19:45:140
442250995954,4cyclictest446988-21kworker/u8:3+events_unbound19:25:180
442250995953,4cyclictest525719-21kworker/u8:0+events_unbound23:30:150
442250995950,7cyclictest460307-21kworker/u8:3+events_unbound20:30:150
442250995853,4cyclictest473230-21kworker/u8:0+flush-179:020:45:210
442250995852,4cyclictest515937-21kworker/u8:2+events_unbound00:05:170
442250995849,3cyclictest515937-21kworker/u8:2+events_unbound00:00:170
442254995751,4cyclictest519079-21kworker/u8:0+flush-179:023:10:201
442254995748,6cyclictest539849-21kworker/u8:1+events_unbound00:20:191
442250995754,1cyclictest1-21systemd00:20:000
442250995753,3cyclictest496012-21kworker/u8:1+events_unbound22:25:240
442250995753,3cyclictest496012-21kworker/u8:1+events_unbound22:25:240
442250995752,3cyclictest515937-21kworker/u8:2+flush-179:000:25:220
442250995746,9cyclictest497878-21/usr/sbin/munin22:00:230
442250995746,9cyclictest497878-21/usr/sbin/munin22:00:220
442254995651,4cyclictest441785-21kworker/u8:3+flush-179:019:10:221
442254995646,4cyclictest460307-21kworker/u8:3+events_unbound20:55:011
442254995645,4cyclictest473230-21kworker/u8:0+flush-179:020:45:161
442254995551,3cyclictest460307-21kworker/u8:3+events_unbound21:10:251
442254995550,4cyclictest544846-21kworker/u8:0+events_unbound00:25:161
442254995548,5cyclictest460307-21kworker/u8:3+flush-179:021:15:211
442254995546,6cyclictest547786-21latency_hist00:35:011
442254995542,5cyclictest525719-21kworker/u8:0+events_unbound23:30:191
442250995550,4cyclictest460307-21kworker/u8:3+events_unbound20:20:190
442254995449,4cyclictest515937-21kworker/u8:2+flush-179:023:40:011
442254995448,4cyclictest479653-21kworker/u8:2+flush-179:021:05:161
442254995448,4cyclictest440809-21kworker/u8:0+flush-179:019:30:271
442254995348,4cyclictest515937-21kworker/u8:2+events_unbound00:10:161
442254995348,4cyclictest440809-21kworker/u8:0+events_unbound19:50:241
442250995344,7cyclictest509035-21apt-get22:35:000
442250995248,3cyclictest441785-21kworker/u8:3+flush-179:019:10:150
442254995141,4cyclictest455278-21kworker/u8:1+events_unbound20:10:241
442250995147,3cyclictest455278-21kworker/u8:1+flush-179:020:25:200
442250995046,3cyclictest471442-21kworker/u8:1+flush-179:020:50:220
442250994944,4cyclictest455278-21kworker/u8:1+events_unbound20:15:140
4670791480,13ptp4l441ktimers/319:10:003
442254994841,6cyclictest496069-21kworker/u8:2+flush-179:022:05:261
442250994842,5cyclictest460307-21kworker/u8:3+events_unbound21:20:260
442254994742,4cyclictest496012-21kworker/u8:1+flush-179:022:25:001
442254994741,5cyclictest446988-21kworker/u8:3+flush-179:019:45:211
442254994734,10cyclictest271-21systemd-journal23:30:001
442256994642,2cyclictest0-21swapper/220:03:592
44225699450,42cyclictest0-21swapper/223:16:592
442250994540,4cyclictest440809-21kworker/u8:0+events_unbound19:20:240
442256994440,2cyclictest0-21swapper/222:49:552
442250994440,3cyclictest549432-21systemd-run00:40:000
442261994340,2cyclictest0-21swapper/320:03:593
44225699430,41cyclictest0-21swapper/222:43:002
442254994337,5cyclictest486227-21kworker/u8:0+flush-179:021:40:221
442250994339,3cyclictest440809-21kworker/u8:0+flush-179:019:40:210
442250994338,4cyclictest486227-21kworker/u8:0+flush-179:021:31:390
442261994239,2cyclictest0-21swapper/319:59:553
44226199420,41cyclictest0-21swapper/323:04:593
442254994239,2cyclictest723-21Xorg22:17:001
44226199410,39cyclictest473007-21turbostat20:45:013
44225499410,38cyclictest452054-21munin-run19:40:001
442250994137,3cyclictest460307-21kworker/u8:3+flush-179:020:35:150
442250994137,2cyclictest458687-21munin-plugin-st20:00:000
44226199400,5cyclictest544621-21turbostat00:25:003
44226199400,5cyclictest487837-21turbostat21:30:013
44226199400,39cyclictest481210-21turbostat21:10:003
44226199400,39cyclictest450459-21turbostat19:35:003
44226199400,39cyclictest446967-21turbostat19:25:003
442256994037,2cyclictest0-21swapper/220:26:592
442261993937,1cyclictest0-21swapper/322:49:553
44226199390,4cyclictest494453-21turbostat21:50:013
44226199390,38cyclictest531836-21turbostat23:45:003
44226199390,38cyclictest531836-21turbostat23:44:593
44226199390,38cyclictest522278-21turbostat23:15:003
44226199390,38cyclictest509034-21turbostat22:35:003
44226199390,38cyclictest469811-21turbostat20:35:003
44225699390,2cyclictest0-21swapper/221:14:552
44225099390,2cyclictest723-21Xorg21:51:000
44226199380,37cyclictest0-21swapper/323:19:553
442256993834,2cyclictest0-21swapper/219:24:562
442256993834,2cyclictest0-21swapper/200:11:592
44225699380,35cyclictest0-21swapper/200:29:552
44225699380,35cyclictest0-21swapper/200:09:552
442250993833,4cyclictest496069-21kworker/u8:2+flush-179:022:05:320
442261993735,1cyclictest0-21swapper/322:10:583
44226199370,36cyclictest0-21swapper/322:29:553
44226199370,36cyclictest0-21swapper/322:29:553
44226199370,35cyclictest0-21swapper/319:36:593
442256993734,2cyclictest0-21swapper/222:31:592
442256993734,2cyclictest0-21swapper/220:41:592
442256993733,3cyclictest0-21swapper/223:45:592
44225699370,2cyclictest0-21swapper/222:29:562
44225699370,2cyclictest0-21swapper/222:29:552
44225699370,2cyclictest0-21swapper/219:36:592
44225699370,2cyclictest0-21swapper/200:24:592
442254993732,4cyclictest515937-21kworker/u8:2+events_unbound23:05:171
442261993634,1cyclictest0-21swapper/323:49:543
442261993634,1cyclictest0-21swapper/323:24:553
442261993634,1cyclictest0-21swapper/321:44:543
442261993634,1cyclictest0-21swapper/321:35:593
442261993634,1cyclictest0-21swapper/321:12:593
442261993634,1cyclictest0-21swapper/320:26:583
44226199360,1cyclictest0-21swapper/322:55:583
442256993633,2cyclictest0-21swapper/222:12:592
442256993633,2cyclictest0-21swapper/222:02:592
442256993633,2cyclictest0-21swapper/222:02:592
442256993632,2cyclictest0-21swapper/221:59:562
442256993632,2cyclictest0-21swapper/220:38:002
442261993533,1cyclictest0-21swapper/321:00:583
442261993533,1cyclictest0-21swapper/320:24:553
442256993532,2cyclictest0-21swapper/223:37:582
442256993531,2cyclictest0-21swapper/223:57:592
442261993432,1cyclictest0-21swapper/322:03:003
442261993432,1cyclictest0-21swapper/322:02:593
442261993431,2cyclictest0-21swapper/300:11:593
442256993431,2cyclictest0-21swapper/219:55:002
442256993430,3cyclictest0-21swapper/200:01:002
442250993426,6cyclictest460307-21kworker/u8:3+flush-179:020:40:140
442261993330,2cyclictest0-21swapper/321:59:553
442261993330,2cyclictest0-21swapper/320:38:003
442261993328,4cyclictest549380-21turbostat00:40:003
442256993330,2cyclictest0-21swapper/222:08:002
442256993330,2cyclictest0-21swapper/200:40:002
44225699330,25cyclictest0-21swapper/223:15:002
442261993229,2cyclictest0-21swapper/323:58:003
442256993229,2cyclictest0-21swapper/220:59:552
442256993229,2cyclictest0-21swapper/219:56:592
442254993223,7cyclictest539827-21latency_hist00:10:001
442261993129,1cyclictest0-21swapper/323:37:583
442261993128,1cyclictest0-21swapper/300:00:593
442256993129,1cyclictest0-21swapper/219:44:592
442256993127,2cyclictest0-21swapper/219:16:592
442256993127,2cyclictest0-21swapper/219:16:592
442261993028,1cyclictest0-21swapper/319:55:003
442261993027,2cyclictest0-21swapper/319:44:593
442256993027,2cyclictest0-21swapper/220:11:002
44225699300,28cyclictest0-21swapper/200:15:162
442261992927,1cyclictest0-21swapper/322:08:003
44226199290,28cyclictest0-21swapper/321:50:153
44226199290,27cyclictest0-21swapper/320:55:023
442256992926,2cyclictest0-21swapper/223:33:002
442256992926,2cyclictest0-21swapper/222:50:142
442256992926,2cyclictest0-21swapper/222:50:132
442256992926,2cyclictest0-21swapper/221:15:152
442256992925,2cyclictest0-21swapper/223:20:592
44225699290,27cyclictest0-21swapper/221:30:032
44225699290,27cyclictest0-21swapper/200:30:132
44225699290,21cyclictest0-21swapper/222:35:032
44225699290,21cyclictest0-21swapper/221:50:152
4670791280,7ptp4l441ktimers/323:35:003
442261992826,1cyclictest0-21swapper/300:30:133
442261992826,1cyclictest0-21swapper/300:15:163
442261992825,2cyclictest0-21swapper/323:54:593
442261992825,2cyclictest0-21swapper/322:50:143
442261992825,2cyclictest0-21swapper/322:50:133
442261992825,2cyclictest0-21swapper/319:16:593
442261992825,2cyclictest0-21swapper/319:16:593
44226199280,27cyclictest0-21swapper/322:35:033
44226199280,26cyclictest0-21swapper/321:30:033
442256992825,2cyclictest0-21swapper/221:35:142
442256992824,2cyclictest0-21swapper/221:46:592
44225699280,2cyclictest0-21swapper/222:55:142
44225699280,26cyclictest0-21swapper/220:50:132
4670791270,6ptp4l441ktimers/319:50:013
442261992725,1cyclictest0-21swapper/322:40:023
442261992725,1cyclictest0-21swapper/320:50:143
442261992725,1cyclictest0-21swapper/320:11:003
442256992723,2cyclictest0-21swapper/223:40:592
442256992723,2cyclictest0-21swapper/223:40:592
442256992723,2cyclictest0-21swapper/223:27:592
442256992723,2cyclictest0-21swapper/223:06:592
4670791260,6ptp4l441ktimers/320:10:003
44226199260,24cyclictest0-21swapper/320:48:583
442256992623,2cyclictest0-21swapper/220:17:592
442256992622,2cyclictest0-21swapper/223:54:592
442256992622,2cyclictest0-21swapper/219:45:132
44225699260,2cyclictest0-21swapper/220:48:592
44225699260,24cyclictest0-21swapper/219:10:222
4670791250,6ptp4l61690irq/136-eno1-TxRx-021:24:543
4670791250,6ptp4l441ktimers/323:29:553
4670791250,6ptp4l441ktimers/320:19:563
4670791250,6ptp4l441ktimers/300:10:003
4670791250,5ptp4l441ktimers/300:29:563
442261992523,1cyclictest0-21swapper/322:18:003
442261992523,1cyclictest0-21swapper/321:15:153
442261992523,1cyclictest0-21swapper/319:11:083
442256992520,2cyclictest0-21swapper/220:33:582
4670791240,5ptp4l441ktimers/323:09:563
4670791240,5ptp4l441ktimers/322:25:023
442250992419,4cyclictest442338-21latency_hist19:10:020
442256992320,2cyclictest0-21swapper/222:15:592
442256992319,2cyclictest0-21swapper/221:00:142
442256992118,2cyclictest0-21swapper/220:10:002
442256991412,1cyclictest0-21swapper/220:25:002
44225699129,2cyclictest0-21swapper/219:30:032
44225699118,2cyclictest0-21swapper/221:25:582
44225699107,2cyclictest0-21swapper/223:02:592
44225699107,2cyclictest0-21swapper/221:23:292
4422569975,2cyclictest0-21swapper/222:24:552
4422569970,2cyclictest0-21swapper/221:05:152
4422569963,2cyclictest0-21swapper/221:43:112
4422569940,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional