You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-13 - 06:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Sat Dec 13, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1322599998981,5cyclictest1408676-21latency_hist23:40:000
1322601998471,10cyclictest266-21systemd-journal00:04:011
1322599997771,4cyclictest1324114-21kworker/u8:3+events_unbound19:35:240
1322603997648,27cyclictest0-21swapper/219:45:582
1322599997671,4cyclictest1415074-21kworker/u8:1+events_unbound00:00:120
1322599997565,8cyclictest1344876-21/usr/sbin/munin20:20:220
1322601997260,9cyclictest266-21systemd-journal23:40:001
1322599997266,4cyclictest1318965-21kworker/u8:1+flush-179:019:10:210
1322599997162,6cyclictest1382876-21latency_hist22:20:010
4577091690,30ptp4l441ktimers/319:08:293
1322599996658,5cyclictest1373568-21kworker/u8:1+flush-179:022:00:130
1322599996356,5cyclictest1398926-21latency_hist23:10:010
132260199610,2cyclictest714-21Xorg19:45:581
1322606996058,1cyclictest0-21swapper/321:40:003
1322599996054,5cyclictest1352581-21kworker/u8:3+events_unbound21:10:240
1322599996053,5cyclictest1381209-21kworker/u8:2+flush-179:022:20:240
1322599995854,3cyclictest1352581-21kworker/u8:3+flush-179:021:15:210
1322599995844,10cyclictest1415018-40mandb00:00:010
1322606995627,1cyclictest0-21swapper/319:45:583
1322599995651,4cyclictest1386285-21apt-get22:30:140
1322601995550,3cyclictest1352581-21kworker/u8:3+events_unbound20:55:011
1322601995548,5cyclictest1357799-21apt-get21:00:131
1322599995547,6cyclictest266-21systemd-journal20:40:000
1322599995547,6cyclictest266-21systemd-journal20:40:000
1322606995452,1cyclictest0-21swapper/321:17:593
1322599995449,3cyclictest1400484-21kworker/u8:1+flush-179:023:30:140
1322601995342,9cyclictest1341721-21apt-get20:10:121
1322601995342,9cyclictest1341721-21apt-get20:10:121
1322601995334,17cyclictest1352581-21kworker/u8:3+flush-179:021:00:001
1322599995347,5cyclictest1400484-21kworker/u8:1+flush-179:023:40:150
1322599995247,4cyclictest1373568-21kworker/u8:1+flush-179:022:05:180
1322599995246,5cyclictest1381209-21kworker/u8:2+flush-179:022:25:190
1322599995245,5cyclictest1324114-21kworker/u8:3+flush-179:019:30:230
1322599995242,8cyclictest266-21systemd-journal21:50:000
1322601995147,3cyclictest714-21Xorg21:54:001
1322599995145,5cyclictest1362246-21kworker/u8:2+flush-179:021:20:180
1322599995145,4cyclictest1400484-21kworker/u8:1+flush-179:023:20:220
1322599995143,6cyclictest1392347-21latency_hist22:50:010
1322599995044,4cyclictest1346247-21kworker/u8:2+flush-179:020:40:170
1322601994940,7cyclictest1359356-21/usr/sbin/munin21:05:231
1322599994945,3cyclictest1411882-21kworker/u8:3+flush-179:000:05:230
1322599994943,4cyclictest1415056-21kworker/u8:0+flush-179:000:25:200
1322599994845,2cyclictest1324114-21kworker/u8:3+events_unbound19:20:230
1322599994842,4cyclictest1341512-21kworker/u8:1+flush-179:020:20:000
1322601994732,14cyclictest0-21swapper/121:26:591
1322601994725,20cyclictest0-21swapper/122:05:121
1322599994743,3cyclictest1375917-21kworker/u8:2+flush-179:021:55:190
1322599994740,5cyclictest1381271-21kworker/u8:3+flush-179:022:15:000
1322601994635,9cyclictest1388149-21diskstats22:35:161
1322601994633,10cyclictest1354105-21latency_hist20:50:011
1322601994625,17cyclictest1399181-21apt-get23:10:101
1322601994624,20cyclictest1370444-21http21:40:141
1322601994611,32cyclictest0-21swapper/121:35:161
1322599994641,4cyclictest1395735-21kworker/u8:2+flush-179:023:10:180
1322599994640,5cyclictest1346247-21kworker/u8:2+flush-179:020:25:220
1322599994639,5cyclictest1324114-21kworker/u8:3+flush-179:019:50:220
1322599994639,4cyclictest1362246-21kworker/u8:2+flush-179:021:40:160
1322599994638,6cyclictest1352581-21kworker/u8:3+flush-179:021:00:000
1322599994637,7cyclictest1362246-21kworker/u8:2+events_unbound21:40:000
1322601994539,4cyclictest1346247-21kworker/u8:2+flush-179:020:35:221
1322601994539,4cyclictest1346247-21kworker/u8:2+flush-179:020:35:221
1322599994538,4cyclictest1411882-21kworker/u8:3+flush-179:000:15:100
1322599994537,6cyclictest1418545-21kworker/u8:1+events_unbound00:20:140
132260699440,43cyclictest1350976-21turbostat20:40:013
132260699440,43cyclictest1350976-21turbostat20:40:013
1322601994424,19cyclictest1336733-21perf19:55:001
1322601994421,19cyclictest0-21swapper/120:30:011
1322599994439,4cyclictest1338572-21apt-get20:00:120
1322599994438,4cyclictest714-21Xorg21:33:590
1322599994437,5cyclictest1386016-21kworker/u8:1+flush-179:022:35:290
1322601994338,3cyclictest1394136-21ls22:55:011
1322601994337,4cyclictest1381536-21apt-get22:15:081
1322601994335,6cyclictest1328825-21latency_hist19:30:001
1322601994326,14cyclictest0-21swapper/123:25:151
1322601994326,14cyclictest0-21swapper/122:40:101
1322601994324,16cyclictest714-21Xorg22:03:591
1322601994323,19cyclictest1417597-21gltestperf00:05:141
1322599994337,4cyclictest1408917-21kworker/u8:2+flush-179:023:50:210
1322599994337,4cyclictest1408917-21kworker/u8:2+flush-179:023:50:200
1322599994333,8cyclictest266-21systemd-journal20:50:130
132260199420,3cyclictest714-21Xorg19:44:581
1322599994236,4cyclictest1400484-21kworker/u8:1+flush-179:023:25:180
1322599994231,7cyclictest0-21swapper/022:42:580
1322606994134,6cyclictest1371766-21turbostat21:44:593
1322603994134,6cyclictest0-21swapper/220:59:592
1322603994132,7cyclictest0-21swapper/220:30:592
132260399410,1cyclictest0-21swapper/222:13:592
1322601994134,5cyclictest266-21systemd-journal21:16:131
1322601994133,6cyclictest1403933-21latency_hist23:25:021
1322601994122,17cyclictest1415396-21apt-config00:00:011
1322601994122,17cyclictest0-21swapper/120:20:001
1322599994136,4cyclictest1386016-21kworker/u8:1+flush-179:022:50:180
1322599994136,4cyclictest1352581-21kworker/u8:3+events_unbound20:45:220
1322599994136,4cyclictest1332020-21kworker/u8:0+flush-179:019:45:220
1322599994135,4cyclictest1336955-21kworker/u8:1+events_unbound20:00:000
1322599994131,6cyclictest0-21swapper/019:15:580
132259999410,39cyclictest1327268-21turbostat19:29:540
132260699400,38cyclictest1420084-21turbostat00:15:013
1322601994035,4cyclictest1381271-21kworker/u8:3+flush-179:022:15:001
1322601994032,6cyclictest1405490-21kworker/u8:0+flush-179:023:34:591
1322601994020,18cyclictest0-21swapper/100:10:171
132260199401,3cyclictest714-21Xorg23:08:001
1322599994036,3cyclictest714-21Xorg21:00:590
1322599994033,5cyclictest1390756-21kworker/u8:0+flush-179:023:15:170
1322606993937,1cyclictest0-21swapper/322:09:003
132260699390,38cyclictest1408694-21turbostat23:40:013
132260699390,38cyclictest1330412-21turbostat19:35:003
132260399390,36cyclictest0-21swapper/222:54:542
1322601993935,2cyclictest714-21Xorg21:46:591
1322601993933,4cyclictest0-21swapper/122:35:011
1322601993931,6cyclictest266-21systemd-journal21:57:131
132260199390,38cyclictest271rcuc/122:24:001
132260199390,37cyclictest714-21Xorg19:14:581
1322599993935,3cyclictest1390756-21kworker/u8:0+flush-179:023:00:580
1322599993935,3cyclictest1390756-21kworker/u8:0+flush-179:023:00:580
1322606993833,4cyclictest1402101-21turbostat23:20:003
1322606993832,5cyclictest1413422-21turbostat23:55:003
1322606993832,5cyclictest1413422-21turbostat23:55:003
132260699381,2cyclictest431rcuc/319:30:003
132260699380,37cyclictest1343050-21turbostat20:14:593
132260699380,37cyclictest1343050-21turbostat20:14:593
132260699380,37cyclictest0-21swapper/322:42:583
1322603993830,6cyclictest0-21swapper/220:45:592
1322601993835,2cyclictest0-21swapper/123:48:001
132260199383,33cyclictest0-21swapper/120:34:471
1322601993820,16cyclictest0-21swapper/120:25:001
1322599993833,3cyclictest1341688-21latency_hist20:10:010
1322606993734,2cyclictest0-21swapper/322:19:593
1322603993734,2cyclictest0-21swapper/223:54:002
1322603993734,2cyclictest0-21swapper/223:53:592
1322603993734,2cyclictest0-21swapper/222:33:582
1322603993734,2cyclictest0-21swapper/221:11:592
132260399370,35cyclictest0-21swapper/220:28:582
132260199374,31cyclictest1329463-21tune2fs19:30:171
1322601993732,3cyclictest714-21Xorg00:24:001
1322601993715,20cyclictest0-21swapper/119:40:011
1322601993714,2cyclictest0-21swapper/121:30:141
1322601993711,7cyclictest1413377-21users23:50:211
1322601993711,7cyclictest1413377-21users23:50:211
1322599993730,6cyclictest1324114-21kworker/u8:3+flush-179:019:40:110
1322599993728,7cyclictest1341512-21kworker/u8:1+flush-179:020:10:210
1322599993728,7cyclictest1341512-21kworker/u8:1+flush-179:020:10:210
132259999370,36cyclictest0-21swapper/022:59:560
132259999370,36cyclictest0-21swapper/000:34:560
1322606993634,1cyclictest0-21swapper/322:47:583
1322606993634,1cyclictest0-21swapper/319:59:553
1322606993631,4cyclictest1418504-21turbostat00:10:013
1322606993631,4cyclictest1376492-21turbostat22:00:003
1322603993633,2cyclictest0-21swapper/223:23:002
1322603993633,2cyclictest0-21swapper/222:25:582
1322603993633,2cyclictest0-21swapper/221:08:592
132260399360,2cyclictest0-21swapper/219:30:142
132260399360,1cyclictest0-21swapper/223:42:592
1322601993632,2cyclictest714-21Xorg22:45:591
1322601993616,18cyclictest0-21swapper/119:55:131
1322601993615,3cyclictest0-21swapper/123:00:261
1322601993615,3cyclictest0-21swapper/123:00:261
1322601993610,6cyclictest1326201-21expr19:20:141
1322606993532,2cyclictest0-21swapper/323:55:583
1322606993530,4cyclictest1421669-21turbostat00:20:003
1322606993530,4cyclictest1410260-21turbostat23:45:003
1322606993530,4cyclictest1365446-21turbostat21:25:003
1322606993530,4cyclictest1349370-21turbostat20:35:003
1322606993530,4cyclictest1332003-21turbostat19:40:003
1322606993529,5cyclictest1346218-21turbostat20:25:003
132260699350,1cyclictest0-21swapper/322:12:593
132260399350,1cyclictest0-21swapper/200:15:102
1322601993528,4cyclictest0-21swapper/120:41:591
1322601993525,9cyclictest0-21swapper/122:29:551
1322601993515,3cyclictest1401531-21ntp_kernel_pll_23:15:161
132260199351,16cyclictest1410359-21cat23:45:011
132259999352,5cyclictest1410511-21apt-get23:45:100
1322606993432,1cyclictest0-21swapper/322:58:593
1322606993432,1cyclictest0-21swapper/322:51:003
1322603993431,2cyclictest0-21swapper/222:49:552
1322603993431,2cyclictest0-21swapper/219:40:592
132260399340,2cyclictest0-21swapper/221:32:592
1322601993428,4cyclictest1415056-21kworker/u8:0+events_unbound00:25:111
1322601993415,3cyclictest0-21swapper/121:10:201
132260199340,32cyclictest1340151-21apt-get20:05:121
1322599993429,4cyclictest1411882-21kworker/u8:3+flush-179:000:10:230
1322599993429,4cyclictest1346247-21kworker/u8:2+events_unbound20:30:150
1322606993330,2cyclictest0-21swapper/322:22:593
1322603993330,2cyclictest0-21swapper/221:54:002
1322603993330,2cyclictest0-21swapper/220:04:592
1322603993325,7cyclictest0-21swapper/223:10:112
1322601993324,7cyclictest1425632-21diskstats00:30:121
1322599993328,4cyclictest1362246-21kworker/u8:2+flush-179:021:25:190
1322606993230,1cyclictest0-21swapper/300:01:593
1322603993229,2cyclictest0-21swapper/221:17:592
132260199320,25cyclictest0-21swapper/119:16:331
1322599993226,5cyclictest484-21dbus-daemon21:55:000
1322599993226,4cyclictest1352581-21kworker/u8:3+events_unbound21:10:000
4577091310,3ptp4l441ktimers/320:50:003
1322606993129,1cyclictest0-21swapper/323:34:003
1322606993129,1cyclictest0-21swapper/320:40:593
1322606993129,1cyclictest0-21swapper/319:50:593
1322606993126,4cyclictest1397365-21turbostat23:04:593
1322606993126,4cyclictest1397365-21turbostat23:04:593
1322606993126,4cyclictest1347798-21turbostat20:30:003
1322603993128,2cyclictest0-21swapper/222:44:552
1322603993128,2cyclictest0-21swapper/220:40:142
1322603993126,4cyclictest0-21swapper/221:40:132
1322603993125,5cyclictest0-21swapper/222:05:112
132260399310,29cyclictest0-21swapper/219:24:592
132260199312,8cyclictest2304-21lightdm-gtk-gre22:59:581
1322606993028,1cyclictest0-21swapper/321:03:593
1322606993025,4cyclictest1400519-21turbostat23:15:003
1322603993027,2cyclictest0-21swapper/223:19:002
132260399300,2cyclictest0-21swapper/221:35:132
132260399300,28cyclictest0-21swapper/200:20:022
4577091290,3ptp4l441ktimers/321:14:553
1322606992927,1cyclictest0-21swapper/320:05:123
1322606992924,4cyclictest1367025-21turbostat21:30:003
1322606992923,5cyclictest1389194-21turbostat22:40:003
132260699290,28cyclictest0-21swapper/321:30:143
132260699290,27cyclictest0-21swapper/322:25:103
1322603992926,2cyclictest0-21swapper/223:46:592
1322603992926,2cyclictest0-21swapper/223:05:112
1322603992926,2cyclictest0-21swapper/200:05:112
132260399290,27cyclictest0-21swapper/220:05:122
132260399290,27cyclictest0-21swapper/219:50:132
132260399290,27cyclictest0-21swapper/219:10:122
132260399290,27cyclictest0-21swapper/200:10:112
1322601992922,5cyclictest714-21Xorg00:16:591
1322601992922,5cyclictest1322478-21latency_hist19:10:011
1322599992925,3cyclictest266-21systemd-journal00:40:000
1322606992823,4cyclictest1405524-21turbostat23:30:003
132260699280,26cyclictest0-21swapper/319:10:123
1322603992825,2cyclictest0-21swapper/200:00:032
1322603992824,2cyclictest0-21swapper/221:46:582
132260399280,26cyclictest0-21swapper/200:27:582
4577091270,3ptp4l441ktimers/320:55:013
1322606992726,1cyclictest0-21swapper/319:21:593
1322606992725,1cyclictest0-21swapper/323:20:013
1322606992725,1cyclictest0-21swapper/300:28:583
1322606992722,4cyclictest1426946-21turbostat00:40:003
1322606992722,4cyclictest1325665-21turbostat19:19:593
132260699270,26cyclictest0-21swapper/300:20:013
1322603992724,2cyclictest0-21swapper/223:04:562
1322603992724,2cyclictest0-21swapper/223:04:562
1322603992723,2cyclictest0-21swapper/221:26:592
1322603992721,5cyclictest0-21swapper/220:51:592
132260399270,24cyclictest0-21swapper/220:15:592
132260399270,24cyclictest0-21swapper/200:00:002
132260399270,1cyclictest0-21swapper/222:24:002
1322601992722,4cyclictest1364661-21kernelversion21:20:171
1322601992721,4cyclictest1339284-21needreboot20:00:201
132260199270,2cyclictest714-21Xorg00:38:581
4577091260,3ptp4l441ktimers/321:10:003
4577091260,3ptp4l441ktimers/320:20:003
1322606992624,1cyclictest0-21swapper/323:49:593
1322606992624,1cyclictest0-21swapper/322:33:593
1322603992623,2cyclictest0-21swapper/219:15:032
132260399260,2cyclictest0-21swapper/223:36:002
132260399260,2cyclictest0-21swapper/221:23:592
132260399260,24cyclictest0-21swapper/222:16:592
132260399260,24cyclictest0-21swapper/200:33:592
4577091250,3ptp4l441ktimers/322:04:543
4577091250,3ptp4l441ktimers/321:54:553
1322606992523,1cyclictest0-21swapper/321:48:593
1322606992523,1cyclictest0-21swapper/319:44:553
1322606992523,1cyclictest0-21swapper/300:31:003
132260699250,23cyclictest0-21swapper/323:06:003
1322603992522,2cyclictest0-21swapper/219:58:582
1322603992522,2cyclictest0-21swapper/200:37:002
1322606992422,1cyclictest0-21swapper/320:03:593
1322603992422,1cyclictest0-21swapper/220:24:592
1322603992421,2cyclictest0-21swapper/223:34:542
1322603992421,2cyclictest0-21swapper/219:38:592
4577091230,3ptp4l441ktimers/320:54:553
1322603992320,2cyclictest0-21swapper/223:27:582
1322603992320,2cyclictest0-21swapper/221:56:002
1322603992219,2cyclictest0-21swapper/222:01:592
1322603992017,2cyclictest0-21swapper/220:36:592
1322603992017,2cyclictest0-21swapper/220:36:592
1322603991613,2cyclictest0-21swapper/221:02:592
1322603991512,2cyclictest0-21swapper/222:37:002
1322599991410,2cyclictest0-21swapper/019:10:010
132260399131,9cyclictest1393936-21turbostat22:59:562
132260399129,2cyclictest0-21swapper/220:11:592
132260399129,2cyclictest0-21swapper/220:11:592
132260399129,2cyclictest0-21swapper/219:25:592
132260399100,2cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional