You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 03:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Fri Apr 24, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
89401599120111,6cyclictest1213033-21systemd-journal00:04:011
8940159911898,17cyclictest918379-21kworker/u8:3+flush-179:021:20:011
89401599118107,8cyclictest970073-21latency_hist23:05:011
8940159910796,8cyclictest1213033-21systemd-journal20:10:001
8940149910499,4cyclictest976587-21kworker/u8:0+flush-179:000:04:010
894014999986,11cyclictest987833-40logrotate00:00:010
894015999789,5cyclictest963685-21/usr/sbin/munin22:45:241
894014999686,8cyclictest901917-21kworker/u8:2+events_unbound19:40:000
894015999078,9cyclictest960254-21latency_hist22:35:011
894014998980,6cyclictest918379-21kworker/u8:3+events_unbound20:45:000
894014998879,5cyclictest992639-21kworker/u8:2+flush-179:000:20:000
894015998672,10cyclictest911498-21apt-get20:05:001
894014998679,5cyclictest987894-21kworker/u8:3+flush-179:000:05:270
894014998174,5cyclictest918379-21kworker/u8:3+events_unbound21:15:250
894014998173,6cyclictest928427-21latency_hist20:55:010
894015998072,5cyclictest916515-21apt-get20:20:031
894014998073,5cyclictest963492-21kworker/u8:2+flush-179:022:50:150
894014998073,5cyclictest963492-21kworker/u8:2+flush-179:022:50:140
894014998070,7cyclictest953922-21kworker/u8:1+flush-179:022:35:250
894014997973,4cyclictest874495-21kworker/u8:0+flush-179:019:20:000
894014997971,5cyclictest953922-21kworker/u8:1+events_unbound22:25:240
89401499790,77cyclictest937996-21dump-pmu-power21:24:590
894014997873,4cyclictest918379-21kworker/u8:3+events_unbound20:55:240
894014997870,6cyclictest963448-21latency_hist22:45:010
894014997870,6cyclictest919960-21latency_hist20:30:010
894014997668,5cyclictest952539-21/usr/sbin/munin22:10:240
894015997366,4cyclictest994238-21kworker/u8:0+flush-179:000:30:191
894015997363,7cyclictest992656-21latency_hist00:15:001
894014997165,5cyclictest933443-21kworker/u8:1+flush-179:021:30:180
894014997165,4cyclictest903777-21kworker/u8:0+events_unbound21:05:250
894014997162,7cyclictest903777-21kworker/u8:0+events_unbound19:45:000
894015997061,7cyclictest968467-21latency_hist23:00:001
894014997065,3cyclictest934825-21kworker/u8:2+flush-179:021:35:250
894014997062,6cyclictest903777-21kworker/u8:0+flush-179:020:40:010
894014997059,8cyclictest970117-21kworker/u8:0+events_unbound23:05:230
894015996961,6cyclictest936637-21/usr/sbin/munin21:20:231
894015996961,6cyclictest900345-21latency_hist19:30:011
894015996945,21cyclictest1213033-21systemd-journal20:20:011
894014996964,3cyclictest934825-21kworker/u8:2+flush-179:021:55:240
894014996963,4cyclictest949092-21kworker/u8:0+flush-179:022:15:240
894014996962,5cyclictest918379-21kworker/u8:3+flush-179:021:00:210
894014996860,6cyclictest1000683-21latency_hist00:40:000
894014996858,8cyclictest893986-21kworker/u8:2+events_unbound19:15:000
894015996758,7cyclictest987874-40mandb00:00:011
894014996761,4cyclictest934825-21kworker/u8:2+events_unbound22:05:020
894014996758,7cyclictest991308-21/usr/sbin/munin00:10:230
894014996661,4cyclictest963492-21kworker/u8:2+events_unbound22:50:000
894014996658,6cyclictest979869-21latency_hist23:35:010
89401699650,1cyclictest0-21swapper/222:36:592
894014996557,6cyclictest903777-21kworker/u8:0+flush-179:019:45:140
894014996556,7cyclictest912005-21apt-get20:05:100
894014996555,8cyclictest1213033-21systemd-journal20:32:240
894015996453,9cyclictest995861-21apt-get00:23:561
894014996458,4cyclictest983842-21kworker/u8:1+flush-179:023:50:250
894014996358,4cyclictest893986-21kworker/u8:2+events_unbound19:10:020
894014996256,4cyclictest923408-21kworker/u8:1+flush-179:020:45:170
894019996058,1cyclictest0-21swapper/322:37:003
894016996048,2cyclictest0-21swapper/200:06:582
894014996055,4cyclictest983842-21kworker/u8:1+flush-179:000:29:550
894014996053,5cyclictest909883-21latency_hist20:00:010
894014996053,5cyclictest874495-21kworker/u8:0+flush-179:019:20:140
894015995947,10cyclictest926583-21latency_hist20:50:021
894014995954,4cyclictest934825-21kworker/u8:2+events_unbound21:50:260
894014995953,4cyclictest949092-21kworker/u8:0+flush-179:022:24:560
894016995854,2cyclictest0-21swapper/221:37:002
894015995850,7cyclictest933444-21/usr/sbin/munin21:10:231
894015995847,9cyclictest999339-21apt-get00:35:141
894019995654,1cyclictest0-21swapper/323:03:593
894014995645,9cyclictest913315-21kworker/u8:1+flush-179:020:20:010
89401499561,53cyclictest976657-21apt-key23:25:000
894015995547,6cyclictest974839-21latency_hist23:20:011
894015995448,4cyclictest918379-21kworker/u8:3+events_unbound20:35:001
894015995448,4cyclictest903777-21kworker/u8:0+flush-179:019:50:161
89401599540,51cyclictest714-21Xorg21:47:581
894014995448,4cyclictest958649-21kworker/u8:2+events_unbound22:30:230
894014995447,6cyclictest934825-21kworker/u8:2+flush-179:021:45:220
894015995318,18cyclictest0-21swapper/123:05:251
89401599523,37cyclictest933206-21latency_hist21:10:011
894015995216,23cyclictest714-21Xorg21:56:591
894014995245,6cyclictest963492-21kworker/u8:2+events_unbound23:00:230
894014995242,7cyclictest1213033-21systemd-journal23:25:020
894015995145,5cyclictest953922-21kworker/u8:1+flush-179:022:25:251
894014995146,4cyclictest874495-21kworker/u8:0+flush-179:019:30:010
894014995145,4cyclictest910503-21fschecks_time20:00:150
894015995039,9cyclictest1213033-21systemd-journal19:14:561
894015995013,23cyclictest994207-21awk00:15:241
894015994940,7cyclictest996158-21apt-get00:25:121
894015994940,7cyclictest976587-21kworker/u8:0+flush-179:023:50:211
894014994943,4cyclictest933443-21kworker/u8:1+events_unbound21:15:020
4577091490,13ptp4l441ktimers/319:10:013
894014994844,3cyclictest901917-21kworker/u8:2+flush-179:020:10:260
894014994843,4cyclictest983842-21kworker/u8:1+flush-179:023:45:250
894015994735,9cyclictest921801-21apt-get20:35:101
89401599471,44cyclictest0-21swapper/123:25:131
89401599470,43cyclictest0-21swapper/120:50:121
894014994740,5cyclictest966664-21kworker/u8:3+flush-179:022:55:210
894015994638,7cyclictest975089-21/usr/sbin/munin23:20:231
894015994627,18cyclictest966664-21kworker/u8:3+events_unbound23:15:001
89401599461,41cyclictest962117-21apt-get22:40:121
894015994614,16cyclictest0-21swapper/122:15:251
894014994637,7cyclictest934825-21kworker/u8:2+events_unbound22:05:200
894015994540,4cyclictest933443-21kworker/u8:1+flush-179:021:25:261
89401599451,42cyclictest714-21Xorg21:04:591
894014994539,4cyclictest963492-21kworker/u8:2+events_unbound23:40:140
894019994442,1cyclictest0-21swapper/321:36:593
894019994438,5cyclictest934792-21turbostat21:15:013
894015994425,17cyclictest954012-21latency_hist22:15:011
894015994412,16cyclictest0-21swapper/122:20:011
89401599440,29cyclictest0-21swapper/123:40:261
894014994437,6cyclictest994238-21kworker/u8:0+flush-179:000:30:210
894014994434,4cyclictest963492-21kworker/u8:2+events_unbound23:10:250
894015994326,16cyclictest901970-21systemd-run19:35:011
89401599431,27cyclictest714-21Xorg19:18:591
894014994336,5cyclictest934825-21kworker/u8:2+flush-179:021:25:160
894016994240,1cyclictest0-21swapper/221:25:002
894015994231,9cyclictest903777-21kworker/u8:0+flush-179:019:50:001
89401599421,25cyclictest1-21systemd19:10:021
89401599420,29cyclictest0-21swapper/120:10:221
894019994139,1cyclictest0-21swapper/322:52:003
894019994139,1cyclictest0-21swapper/322:51:593
894015994132,7cyclictest953922-21kworker/u8:1+flush-179:022:35:181
894015994130,8cyclictest1213033-21systemd-journal22:53:251
894015994130,8cyclictest1213033-21systemd-journal22:53:241
89401599410,40cyclictest908307-21turbostat19:59:551
894014994136,4cyclictest976587-21kworker/u8:0+flush-179:023:35:190
894014994136,3cyclictest992639-21kworker/u8:2+flush-179:000:20:210
894019994038,1cyclictest0-21swapper/320:39:553
894015994010,17cyclictest941159-21latency_hist21:35:001
894014994036,3cyclictest903777-21kworker/u8:0+flush-179:019:50:210
894014994034,5cyclictest934825-21kworker/u8:2+events_unbound21:40:200
894014994033,5cyclictest874495-21kworker/u8:0+events_unbound19:30:130
894016993936,2cyclictest0-21swapper/220:33:582
894015993936,2cyclictest0-21swapper/119:24:591
894015993935,3cyclictest0-21swapper/122:05:591
89401599390,37cyclictest714-21Xorg22:00:591
894019993835,2cyclictest0-21swapper/322:40:593
894019993833,4cyclictest955491-21turbostat22:20:003
89401699380,35cyclictest0-21swapper/220:44:552
894015993834,3cyclictest714-21Xorg20:41:001
894015993834,3cyclictest714-21Xorg19:36:591
89401599381,23cyclictest980936-21awk23:35:221
89401599380,2cyclictest714-21Xorg20:57:581
89401599380,24cyclictest0-21swapper/121:43:241
894019993735,1cyclictest0-21swapper/300:06:593
89401699370,35cyclictest0-21swapper/223:54:592
89401599370,35cyclictest991088-21idleruntime-cro00:10:001
894019993634,1cyclictest0-21swapper/323:32:003
894019993634,1cyclictest0-21swapper/323:18:593
894019993634,1cyclictest0-21swapper/320:24:553
894019993634,1cyclictest0-21swapper/320:04:563
894019993631,4cyclictest999093-21turbostat00:35:003
89401999360,35cyclictest0-21swapper/322:34:593
89401999360,35cyclictest0-21swapper/322:27:583
89401999360,34cyclictest0-21swapper/323:05:593
894016993633,2cyclictest0-21swapper/222:00:582
89401699360,1cyclictest0-21swapper/221:49:552
894015993618,17cyclictest0-21swapper/121:50:271
894015993617,18cyclictest942408-21switchtime21:35:261
89401599360,22cyclictest904709-21mailstats19:40:231
894014993632,3cyclictest913315-21kworker/u8:1+flush-179:020:20:040
894019993533,1cyclictest0-21swapper/321:30:593
894016993533,1cyclictest0-21swapper/219:44:592
894016993532,1cyclictest0-21swapper/220:25:012
894014993526,7cyclictest973496-21apt-get23:15:100
894019993432,1cyclictest0-21swapper/323:38:583
894019993432,1cyclictest0-21swapper/320:31:593
894019993432,1cyclictest0-21swapper/319:33:593
894019993428,5cyclictest984654-21turbostat23:50:003
894016993431,2cyclictest0-21swapper/219:48:592
894016993430,2cyclictest0-21swapper/223:07:592
894015993431,2cyclictest714-21Xorg20:26:001
894015993429,4cyclictest983842-21kworker/u8:1+events_unbound23:45:231
894019993331,1cyclictest0-21swapper/323:44:553
894019993331,1cyclictest0-21swapper/321:26:003
894016993330,2cyclictest0-21swapper/222:15:002
894016993329,2cyclictest0-21swapper/222:31:592
894019993231,1cyclictest0-21swapper/320:41:003
894019993230,1cyclictest0-21swapper/323:51:593
894019993230,1cyclictest0-21swapper/321:55:583
894019993129,1cyclictest0-21swapper/321:49:553
894019993126,4cyclictest937994-21turbostat21:24:593
89401999310,30cyclictest0-21swapper/320:18:593
894016993128,2cyclictest0-21swapper/223:28:592
894016993128,2cyclictest0-21swapper/220:47:592
894016993128,2cyclictest0-21swapper/219:56:592
89401599312,25cyclictest714-21Xorg23:31:591
894019993028,1cyclictest0-21swapper/319:19:593
89401999300,28cyclictest0-21swapper/323:25:023
894016993027,2cyclictest0-21swapper/220:57:592
894016993026,2cyclictest0-21swapper/221:54:002
894016993026,2cyclictest0-21swapper/219:31:592
89401699300,28cyclictest0-21swapper/221:10:132
89401699300,28cyclictest0-21swapper/221:01:592
4577091300,7ptp4l61490irq/134-eno1-TxRx-020:10:003
4577091300,7ptp4l441ktimers/319:55:013
894019992926,2cyclictest0-21swapper/320:45:023
89401999290,28cyclictest0-21swapper/322:55:033
89401999290,27cyclictest0-21swapper/300:25:133
894016992927,1cyclictest0-21swapper/200:39:592
894016992926,2cyclictest0-21swapper/221:05:122
894016992926,2cyclictest0-21swapper/220:12:002
894016992926,2cyclictest0-21swapper/219:54:552
89401699290,2cyclictest0-21swapper/219:11:592
89401699290,27cyclictest0-21swapper/223:15:132
89401699290,27cyclictest0-21swapper/222:55:042
89401699290,27cyclictest0-21swapper/222:45:142
89401699290,27cyclictest0-21swapper/221:55:162
89401699290,27cyclictest0-21swapper/220:50:012
89401699290,27cyclictest0-21swapper/220:05:012
89401699290,27cyclictest0-21swapper/219:15:132
89401699290,27cyclictest0-21swapper/200:25:132
89401699290,27cyclictest0-21swapper/200:00:132
4577091290,7ptp4l61490irq/134-eno1-TxRx-022:50:003
4577091290,6ptp4l441ktimers/321:05:003
894019992823,4cyclictest976445-21turbostat23:24:593
89401999280,2cyclictest0-21swapper/321:50:163
89401999280,27cyclictest0-21swapper/319:55:133
89401999280,27cyclictest0-21swapper/300:00:133
89401999280,27cyclictest0-21swapper/300:00:013
894016992825,2cyclictest0-21swapper/223:35:142
894016992825,2cyclictest0-21swapper/223:30:132
894016992825,2cyclictest0-21swapper/222:15:142
894016992825,2cyclictest0-21swapper/222:07:002
894016992825,2cyclictest0-21swapper/220:25:142
89401699280,21cyclictest0-21swapper/220:05:012
4577091280,7ptp4l441ktimers/322:04:563
4577091280,7ptp4l441ktimers/320:29:593
4577091280,6ptp4l61490irq/134-eno1-TxRx-020:15:013
4577091280,6ptp4l61490irq/134-eno1-TxRx-019:45:013
4577091280,6ptp4l61490irq/134-eno1-TxRx-019:25:013
4577091280,6ptp4l441ktimers/321:45:003
4577091280,6ptp4l441ktimers/321:20:003
4577091280,6ptp4l441ktimers/319:30:013
4577091280,6ptp4l441ktimers/300:25:003
894019992725,1cyclictest0-21swapper/321:05:133
894019992725,1cyclictest0-21swapper/320:50:023
894019992725,1cyclictest0-21swapper/319:48:593
894016992724,2cyclictest0-21swapper/219:24:552
894016992724,2cyclictest0-21swapper/200:23:592
89401699270,25cyclictest0-21swapper/222:50:592
89401699270,25cyclictest0-21swapper/222:50:592
4577091270,6ptp4l61490irq/134-eno1-TxRx-023:15:013
4577091270,6ptp4l441ktimers/319:40:003
4577091270,5ptp4l61490irq/134-eno1-TxRx-021:00:013
4577091270,5ptp4l441ktimers/322:14:593
4577091270,5ptp4l441ktimers/300:20:003
894019992623,2cyclictest0-21swapper/300:38:593
894016992624,1cyclictest0-21swapper/223:05:002
894016992623,2cyclictest0-21swapper/223:40:592
894016992623,2cyclictest0-21swapper/222:20:592
894016992623,2cyclictest0-21swapper/221:26:582
894016992623,2cyclictest0-21swapper/220:18:592
89401699260,2cyclictest0-21swapper/221:42:582
89401699260,24cyclictest0-21swapper/223:47:592
4577091260,5ptp4l61490irq/134-eno1-TxRx-022:24:563
4577091260,5ptp4l61490irq/134-eno1-TxRx-019:14:563
89401999250,1cyclictest0-21swapper/300:11:593
894016992522,2cyclictest0-21swapper/222:42:592
894016992521,2cyclictest0-21swapper/219:25:592
4577091250,5ptp4l441ktimers/322:09:563
894016992320,2cyclictest0-21swapper/223:20:112
894016992220,1cyclictest0-21swapper/200:15:002
894016992219,2cyclictest0-21swapper/223:11:582
894016992118,2cyclictest0-21swapper/222:25:592
894016992118,2cyclictest0-21swapper/200:16:592
894016992017,2cyclictest0-21swapper/219:38:592
894016991816,2cyclictest0-21swapper/223:57:592
894016991513,1cyclictest0-21swapper/221:19:592
894016991411,2cyclictest0-21swapper/200:31:592
894016991311,1cyclictest0-21swapper/221:34:592
894016991210,1cyclictest0-21swapper/220:40:002
8940169930,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional