You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 12:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Tue Dec 23, 2025 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
312079998781,4cyclictest382621-21latency_hist22:50:010
312080998475,7cyclictest357147-21/usr/sbin/munin21:30:231
312079998373,7cyclictest311975-21kworker/u8:1+flush-179:019:25:210
312080998069,9cyclictest266-21systemd-journal00:00:001
312080997666,7cyclictest406557-21latency_hist00:05:011
312079997670,5cyclictest392197-21kworker/u8:0+flush-179:000:04:000
312079997366,5cyclictest352161-21kworker/u8:2+flush-179:021:45:220
312079997161,7cyclictest414770-21latency_hist00:30:010
312079996956,10cyclictest372837-21latency_hist22:20:010
312080996860,6cyclictest392162-21latency_hist23:20:001
312079996658,4cyclictest3319112-21kworker/u8:5+events_unbound19:15:140
312079996657,7cyclictest316820-21latency_hist19:25:010
312079996451,10cyclictest266-21systemd-journal23:45:000
312079996355,5cyclictest3319112-21kworker/u8:5+events_unbound19:35:010
312080996254,5cyclictest369634-21latency_hist22:10:001
312080996254,5cyclictest369634-21latency_hist22:10:001
4577091610,9ptp4l441ktimers/319:07:103
312079996155,4cyclictest360111-21kworker/u8:0+flush-179:021:50:190
312079996155,3cyclictest336208-21kworker/u8:2+flush-179:020:35:250
312079996152,6cyclictest366458-21latency_hist22:00:010
312079996145,11cyclictest1780925-21cups-browsed23:59:590
312080995950,7cyclictest344362-21/usr/sbin/munin20:50:251
312079995953,4cyclictest326401-21kworker/u8:3+flush-179:020:20:210
312079995949,5cyclictest369614-21kworker/u8:1+flush-179:022:50:160
312079995948,9cyclictest331390-21apt-get20:10:140
312080995750,5cyclictest3319112-21kworker/u8:5+flush-179:019:15:011
312079995751,4cyclictest336412-21/usr/sbin/munin20:25:220
312079995649,5cyclictest349193-21kworker/u8:1+events_unbound21:10:000
312079995649,5cyclictest326401-21kworker/u8:3+flush-179:020:00:230
312079995648,6cyclictest381036-21latency_hist22:45:010
312079995648,6cyclictest361686-21latency_hist21:45:000
312079995550,4cyclictest360111-21kworker/u8:0+flush-179:022:00:180
312079995549,4cyclictest3319112-21kworker/u8:5+flush-179:019:40:140
312079995548,5cyclictest392197-21kworker/u8:0+flush-179:000:05:170
312079995548,5cyclictest388384-21kworker/u8:2+flush-179:023:15:240
312079995548,4cyclictest401753-21kworker/u8:3+flush-179:023:55:010
312079995544,8cyclictest345763-21latency_hist20:55:010
312080995446,5cyclictest350518-21kworker/u8:3+flush-179:021:15:251
312080995445,7cyclictest392197-21kworker/u8:0+flush-179:023:40:001
312079995446,6cyclictest266-21systemd-journal00:31:090
312080995348,3cyclictest336208-21kworker/u8:2+flush-179:020:35:211
312080995344,7cyclictest411834-21/usr/sbin/munin00:20:251
312079995349,2cyclictest0-21swapper/000:15:000
312079995346,3cyclictest3319112-21kworker/u8:5+flush-179:019:35:240
312079995345,6cyclictest392197-21kworker/u8:0+flush-179:023:35:210
312079995344,7cyclictest326401-21kworker/u8:3+flush-179:020:00:010
312080995238,13cyclictest340924-21kworker/u8:0+flush-179:021:10:261
312079995244,5cyclictest369614-21kworker/u8:1+flush-179:023:05:150
312081995047,2cyclictest0-21swapper/223:19:002
312080995042,5cyclictest266-21systemd-journal21:50:001
312079995045,4cyclictest360111-21kworker/u8:0+flush-179:022:20:190
312079995044,5cyclictest392197-21kworker/u8:0+flush-179:023:30:230
312079995044,5cyclictest392197-21kworker/u8:0+flush-179:023:30:230
312080994936,12cyclictest0-21swapper/120:01:591
312079994943,4cyclictest484-21dbus-daemon20:50:010
312079994942,5cyclictest1-21systemd22:35:010
312079994937,8cyclictest369614-21kworker/u8:1+events_unbound22:35:190
312085994846,1cyclictest0-21swapper/300:15:003
312080994840,5cyclictest311975-21kworker/u8:1+events_unbound19:30:251
312080994831,15cyclictest385790-21sendmail23:00:011
312080994829,18cyclictest348331-21needreboot21:00:191
31208099480,2cyclictest0-21swapper/120:10:151
312079994843,4cyclictest360111-21kworker/u8:0+events_unbound22:05:250
312079994843,4cyclictest360111-21kworker/u8:0+events_unbound22:05:250
312079994843,4cyclictest326401-21kworker/u8:3+flush-179:020:55:230
312079994837,8cyclictest331133-21latency_hist20:10:000
312080994728,17cyclictest373276-21apt-key22:20:011
312080994639,5cyclictest365112-21apt-get21:55:121
312080994631,14cyclictest0-21swapper/120:59:591
31208099460,2cyclictest0-21swapper/119:45:121
312079994643,2cyclictest352161-21kworker/u8:2+events_unbound21:35:200
312079994643,2cyclictest352161-21kworker/u8:2+events_unbound21:35:200
312080994538,5cyclictest408400-21latency_hist00:10:001
312080994538,5cyclictest349193-21kworker/u8:1+flush-179:021:05:211
312080994535,8cyclictest325026-21apt-get19:50:131
312079994538,5cyclictest381013-21kworker/u8:2+flush-179:022:55:260
312079994538,5cyclictest326401-21kworker/u8:3+events_unbound20:40:240
312080994434,8cyclictest266-21systemd-journal22:05:011
312079994439,4cyclictest369614-21kworker/u8:1+flush-179:022:10:220
312085994340,2cyclictest0-21swapper/320:04:593
31208199430,41cyclictest0-21swapper/223:28:592
312080994324,18cyclictest363943-21gltestperf21:50:191
31208099430,28cyclictest378102-21apt-get22:35:121
31208099430,1cyclictest0-21swapper/123:10:151
312079994338,4cyclictest312049-21kworker/u8:2+flush-179:019:10:200
312079994335,6cyclictest371264-21kworker/u8:3+flush-179:022:25:260
312079994334,7cyclictest347625-21apt-get21:00:120
312080994233,8cyclictest360355-21apt-get21:40:101
31208099421,39cyclictest321603-21turbostat19:44:551
31208099420,2cyclictest714-21Xorg19:18:001
312079994234,6cyclictest401753-21kworker/u8:3+events_unbound00:20:000
312079994232,8cyclictest386070-21apt-get23:00:130
312079994232,8cyclictest386070-21apt-get23:00:130
31208599410,39cyclictest340963-21turbostat20:40:003
31208099411,2cyclictest714-21Xorg19:24:581
312079994136,4cyclictest416395-21kworker/u8:1+events_unbound00:35:280
312079994136,4cyclictest331117-21kworker/u8:1+flush-179:020:15:170
312079994133,6cyclictest389224-21/usr/sbin/munin23:10:190
312079994133,6cyclictest350518-21kworker/u8:3+events_unbound21:15:230
312085994038,1cyclictest0-21swapper/322:03:593
31208099400,38cyclictest714-21Xorg20:17:591
31207999400,37cyclictest714-21Xorg20:35:000
312085993937,1cyclictest0-21swapper/319:55:593
312085993934,4cyclictest334309-21turbostat20:20:013
312085993930,6cyclictest414781-21turbostat00:30:003
31208599390,36cyclictest0-21swapper/323:37:583
312080993935,3cyclictest369614-21kworker/u8:1+flush-179:022:13:101
312080993927,9cyclictest398807-21apt-get23:40:151
312085993836,1cyclictest0-21swapper/321:35:593
312085993836,1cyclictest0-21swapper/321:35:593
31208599380,35cyclictest0-21swapper/322:46:593
31208599380,35cyclictest0-21swapper/321:43:593
31208199380,36cyclictest0-21swapper/200:33:002
312080993835,2cyclictest0-21swapper/122:44:591
312080993830,6cyclictest344123-21latency_hist20:50:021
312080993819,17cyclictest0-21swapper/120:45:011
312080993819,17cyclictest0-21swapper/119:25:211
31208099380,37cyclictest714-21Xorg23:49:591
312079993833,4cyclictest408399-21kworker/u8:1+flush-179:000:20:230
312079993830,6cyclictest321644-21kworker/u8:2+events_unbound19:50:150
312081993734,2cyclictest0-21swapper/220:01:002
312081993734,2cyclictest0-21swapper/200:38:592
31208199370,35cyclictest0-21swapper/223:05:002
31208199370,35cyclictest0-21swapper/223:05:002
31208199370,35cyclictest0-21swapper/219:40:592
312080993734,2cyclictest714-21Xorg23:20:591
312080993730,6cyclictest369614-21kworker/u8:1+events_unbound22:26:591
312080993725,11cyclictest417971-21cut00:40:011
31208099371,32cyclictest0-21swapper/122:30:141
312079993730,5cyclictest266-21systemd-journal21:26:100
312085993634,1cyclictest0-21swapper/321:19:593
312085993634,1cyclictest0-21swapper/319:43:593
312085993634,1cyclictest0-21swapper/300:05:593
312085993634,1cyclictest0-21swapper/300:04:003
312085993633,2cyclictest0-21swapper/300:37:583
31208599360,1cyclictest0-21swapper/322:14:593
312081993634,1cyclictest0-21swapper/221:29:592
31208199360,34cyclictest0-21swapper/200:23:582
31208199360,2cyclictest0-21swapper/222:02:592
31208199360,1cyclictest0-21swapper/223:45:592
312080993631,4cyclictest324749-21kworker/u8:0+events_unbound20:05:261
312080993628,5cyclictest356906-21latency_hist21:30:011
31208099362,32cyclictest416360-21latency_hist00:35:001
312080993623,11cyclictest0-21swapper/123:25:231
312080993619,15cyclictest0-21swapper/121:35:241
312080993619,15cyclictest0-21swapper/121:35:231
312080993615,3cyclictest0-21swapper/121:20:131
312080993614,5cyclictest337741-21sshd20:27:101
312079993630,5cyclictest340924-21kworker/u8:0+flush-179:021:15:010
312085993533,1cyclictest0-21swapper/320:22:593
312085993533,1cyclictest0-21swapper/300:33:593
31208599350,34cyclictest0-21swapper/320:35:003
31208199350,1cyclictest0-21swapper/221:02:592
312080993532,2cyclictest714-21Xorg23:54:581
312080993531,3cyclictest369614-21kworker/u8:1+flush-179:023:00:261
312080993531,3cyclictest369614-21kworker/u8:1+flush-179:023:00:261
31208099352,17cyclictest2304-21lightdm-gtk-gre22:18:591
312080993512,4cyclictest0-21swapper/100:29:591
312080993511,5cyclictest383965-21grep22:50:251
312085993432,1cyclictest0-21swapper/323:09:583
312085993432,1cyclictest0-21swapper/322:24:553
31208099341,30cyclictest0-21swapper/100:10:131
312079993430,3cyclictest714-21Xorg21:22:580
312085993331,1cyclictest0-21swapper/323:01:593
312085993331,1cyclictest0-21swapper/323:01:593
312081993330,2cyclictest0-21swapper/221:57:592
31208199330,31cyclictest0-21swapper/219:47:002
31208199330,30cyclictest0-21swapper/222:50:002
312080993326,4cyclictest0-21swapper/100:16:001
312080993313,3cyclictest0-21swapper/123:30:251
312080993313,3cyclictest0-21swapper/123:30:241
312079993329,2cyclictest714-21Xorg19:45:590
312079993328,4cyclictest388384-21kworker/u8:2+flush-179:023:20:260
312079993327,5cyclictest356942-21kworker/u8:1+flush-179:021:30:160
31207999331,2cyclictest0-21swapper/023:25:130
312085993226,5cyclictest376274-21turbostat22:30:003
312081993229,2cyclictest0-21swapper/223:38:592
312080993229,2cyclictest0-21swapper/119:36:591
31208099321,29cyclictest334315-21apt-get20:20:031
312085993129,1cyclictest0-21swapper/322:52:593
312085993127,2cyclictest0-21swapper/300:20:153
312085993124,5cyclictest396956-21turbostat23:35:003
312085993124,5cyclictest396956-21turbostat23:35:003
31208599310,28cyclictest0-21swapper/320:25:123
312081993128,2cyclictest0-21swapper/219:30:582
31207999310,1cyclictest0-21swapper/023:49:590
31208599300,27cyclictest0-21swapper/323:25:123
312081993027,2cyclictest0-21swapper/222:30:142
312081993027,2cyclictest0-21swapper/221:30:592
312081993027,2cyclictest0-21swapper/221:11:592
312081993027,2cyclictest0-21swapper/220:56:592
31208199300,2cyclictest0-21swapper/222:25:152
31208199300,2cyclictest0-21swapper/219:38:592
312080993023,5cyclictest387657-21apt-get23:05:141
4577091290,7ptp4l441ktimers/300:00:003
312085992927,1cyclictest0-21swapper/323:54:593
312085992927,1cyclictest0-21swapper/323:40:583
312085992927,1cyclictest0-21swapper/323:13:593
312085992927,1cyclictest0-21swapper/321:22:583
312085992927,1cyclictest0-21swapper/321:15:003
31208599290,27cyclictest347358-21turbostat21:00:003
312081992926,2cyclictest0-21swapper/223:50:152
312081992926,2cyclictest0-21swapper/223:06:592
31208199290,2cyclictest0-21swapper/220:54:552
31208199290,27cyclictest0-21swapper/222:20:162
31208199290,27cyclictest0-21swapper/220:35:132
4577091280,6ptp4l61490irq/134-eno1-TxRx-020:15:003
4577091280,6ptp4l441ktimers/322:45:003
312085992826,1cyclictest0-21swapper/322:38:593
312085992826,1cyclictest0-21swapper/321:00:593
312085992826,1cyclictest0-21swapper/319:45:593
31208599280,2cyclictest0-21swapper/319:50:133
31208599280,26cyclictest0-21swapper/323:20:153
31208599280,26cyclictest0-21swapper/320:50:163
31208599280,24cyclictest0-21swapper/319:10:123
312081992825,2cyclictest0-21swapper/220:10:152
312081992825,2cyclictest0-21swapper/219:50:132
312081992825,2cyclictest0-21swapper/200:25:142
31208199280,2cyclictest0-21swapper/221:45:142
31208199280,26cyclictest0-21swapper/223:10:142
31208199280,26cyclictest0-21swapper/219:21:002
31208099280,27cyclictest0-21swapper/122:45:581
4577091270,6ptp4l441ktimers/322:20:003
4577091270,6ptp4l441ktimers/321:50:003
4577091270,6ptp4l441ktimers/320:09:593
4577091270,5ptp4l61490irq/134-eno1-TxRx-021:10:013
4577091270,5ptp4l441ktimers/322:10:003
4577091270,5ptp4l441ktimers/322:10:003
312085992725,1cyclictest0-21swapper/322:55:153
31208599270,24cyclictest0-21swapper/319:15:113
312081992725,1cyclictest0-21swapper/222:59:592
312081992725,1cyclictest0-21swapper/221:15:142
312081992724,2cyclictest0-21swapper/220:25:582
312081992724,2cyclictest0-21swapper/200:03:592
31208199270,1cyclictest0-21swapper/200:13:002
312080992723,3cyclictest338966-21mailstats20:30:231
4577091260,6ptp4l441ktimers/323:50:013
4577091260,5ptp4l61490irq/134-eno1-TxRx-021:35:003
4577091260,4ptp4l441ktimers/300:20:013
312085992620,4cyclictest342544-21turbostat20:45:003
31208599260,25cyclictest0-21swapper/319:23:183
31208599260,1cyclictest0-21swapper/321:27:593
31208599260,1cyclictest0-21swapper/319:31:593
312081992624,1cyclictest0-21swapper/200:19:592
312081992623,2cyclictest0-21swapper/222:10:132
312081992623,2cyclictest0-21swapper/220:18:592
312081992623,2cyclictest0-21swapper/219:56:582
312081992623,2cyclictest0-21swapper/219:25:492
31208199260,24cyclictest0-21swapper/221:24:552
31208199260,24cyclictest0-21swapper/219:19:292
4577091250,5ptp4l441ktimers/321:55:003
4577091250,4ptp4l61490irq/134-eno1-TxRx-022:00:013
312085992523,1cyclictest0-21swapper/323:18:003
312085992523,1cyclictest0-21swapper/319:36:003
312085992523,1cyclictest0-21swapper/319:25:543
312081992522,2cyclictest0-21swapper/223:42:592
312081992522,2cyclictest0-21swapper/221:39:552
312081992522,2cyclictest0-21swapper/221:39:552
31208199250,2cyclictest0-21swapper/222:18:592
31208199250,2cyclictest0-21swapper/219:10:222
4577091240,4ptp4l441ktimers/320:50:013
312085992422,1cyclictest0-21swapper/322:31:593
312081992422,1cyclictest0-21swapper/222:09:592
312081992422,1cyclictest0-21swapper/222:09:592
312081992422,1cyclictest0-21swapper/200:09:582
312081992421,2cyclictest0-21swapper/222:37:592
312081992421,2cyclictest0-21swapper/221:54:592
312081992420,2cyclictest0-21swapper/223:56:592
312080992419,3cyclictest0-21swapper/119:55:251
312081992321,1cyclictest0-21swapper/220:50:002
312081992320,2cyclictest0-21swapper/222:53:592
31208099224,16cyclictest312105-21cat19:10:011
312079992217,3cyclictest0-21swapper/019:10:010
312081992119,1cyclictest0-21swapper/223:23:592
312081992118,2cyclictest0-21swapper/222:43:582
312081992017,2cyclictest0-21swapper/221:05:592
312081991715,1cyclictest0-21swapper/220:25:012
312081991715,1cyclictest0-21swapper/220:09:592
312081991612,2cyclictest0-21swapper/220:44:562
312081991512,2cyclictest0-21swapper/223:35:002
312081991512,2cyclictest0-21swapper/223:34:592
31208199107,2cyclictest0-21swapper/220:30:132
3120819996,2cyclictest0-21swapper/221:44:042
3120819930,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional