You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 12:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Sun May 31, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
244125699135120,11cyclictest1213033-21systemd-journal23:55:010
244125699112101,8cyclictest2503196-21latency_hist22:20:020
24412569910799,5cyclictest2541967-21latency_hist00:20:000
24412589910568,26cyclictest2442994-21apt-get19:15:091
24412569910592,9cyclictest2467394-21latency_hist20:30:000
24412569910393,7cyclictest2460769-21latency_hist20:10:010
24412589910293,7cyclictest2469240-21latency_hist20:35:011
24412569910290,9cyclictest2444335-21latency_hist19:20:010
24412569910088,9cyclictest2499741-21latency_hist22:10:010
2441256999788,6cyclictest2519355-21latency_hist23:10:010
2441258999486,5cyclictest2540116-21apt-get00:15:021
2441258998879,6cyclictest2471144-21apt-key20:40:011
2441258998879,6cyclictest2471144-21apt-key20:40:011
2441258998679,5cyclictest2488578-21kworker/u8:3+flush-179:021:40:001
2441256998676,7cyclictest2535304-40mandb00:00:010
2441256998575,7cyclictest2450970-21latency_hist19:40:000
2441256998477,5cyclictest2542636-21kworker/u8:2+flush-179:000:40:010
2441258998374,6cyclictest1213033-21systemd-journal20:55:241
2441258998372,9cyclictest1213033-21systemd-journal00:00:011
2441258998272,7cyclictest2484833-21kworker/u8:2+flush-179:021:30:011
2441258998173,6cyclictest2508186-21kworker/u8:0+flush-179:022:45:001
2441258998168,11cyclictest1213033-21systemd-journal23:30:011
2441256998071,6cyclictest2516436-21apt-get23:00:120
2441258997969,8cyclictest2496823-21apt-get22:00:121
2441262997641,30cyclictest0-21swapper/221:19:592
2441258997669,5cyclictest2528901-21latency_hist23:40:001
2441258997664,9cyclictest1213033-21systemd-journal21:45:001
2441256997666,8cyclictest2537187-21apt-get00:05:120
2441258997565,8cyclictest2483834-21latency_hist21:20:011
2441256997566,6cyclictest2470848-21apt-get20:40:000
2441258997366,6cyclictest2459158-21kworker/u8:3+flush-179:020:50:011
2441256997364,7cyclictest2540116-21apt-get00:15:000
2441256997361,9cyclictest2457337-21latency_hist20:00:000
2441263997141,1cyclictest0-21swapper/321:19:593
2441258997063,5cyclictest2521576-21kworker/u8:1+flush-179:023:40:161
2441258997062,6cyclictest1-21systemd23:55:001
2441258997061,6cyclictest2447780-21latency_hist19:30:021
2441258997061,6cyclictest1213033-21systemd-journal00:04:001
2441258997060,7cyclictest1213033-21systemd-journal21:50:001
2441258996961,5cyclictest2512992-21latency_hist22:50:001
2441256996966,2cyclictest2480677-21kworker/u8:0+events_unbound21:40:010
2441258996860,6cyclictest2452561-21latency_hist19:45:021
2441258996859,7cyclictest2517804-21kworker/u8:0+flush-179:023:05:001
2441256996762,3cyclictest2508186-21kworker/u8:0+flush-179:022:50:090
2441256996758,7cyclictest2545149-21latency_hist00:30:010
2441256996757,8cyclictest2487265-21apt-get21:30:100
2441256996757,7cyclictest2465559-21apt-get20:25:000
2441258996656,7cyclictest2454146-21latency_hist19:50:011
2441256996652,11cyclictest1213033-21systemd-journal00:05:010
2441258996556,7cyclictest2462609-21apt-get20:15:121
2441256996559,4cyclictest2525979-21apt-get23:30:110
2441256996559,4cyclictest2525979-21apt-get23:30:110
2441258996456,6cyclictest2539094-21kworker/u8:1+flush-179:000:25:001
2441256996457,5cyclictest2485678-21apt-get21:25:130
2441258996359,3cyclictest2521576-21kworker/u8:1+events_unbound23:15:241
2441258996351,9cyclictest1213033-21systemd-journal20:05:001
244125899630,4cyclictest714-21Xorg20:29:581
2441258996255,5cyclictest2455730-21latency_hist19:55:011
2441256996247,5cyclictest2467908-21apt-get20:30:090
2441258996051,6cyclictest2459158-21kworker/u8:3+flush-179:020:50:201
2441258996049,8cyclictest510-21rs:main1
2441258995952,5cyclictest2508186-21kworker/u8:0+events_unbound22:55:001
2441256995952,5cyclictest2508186-21kworker/u8:0+flush-179:022:45:230
2441258995851,5cyclictest2477504-21kworker/u8:3+flush-179:021:05:241
2441258995851,5cyclictest2477504-21kworker/u8:3+flush-179:021:05:241
2441258995850,6cyclictest2548588-21latency_hist00:40:021
244125699581,56cyclictest1-21systemd22:02:320
2441258995752,4cyclictest2460804-21kworker/u8:0+flush-179:020:10:151
2441258995750,5cyclictest2543593-21kworker/u8:3+events_unbound00:30:021
2441258995651,4cyclictest2464011-21kworker/u8:2+flush-179:020:20:151
2441258995646,7cyclictest2508186-21kworker/u8:0+flush-179:022:35:161
2441258995549,5cyclictest2480677-21kworker/u8:0+flush-179:021:20:211
244125899541,2cyclictest2494963-21munin-run21:55:011
2441256995443,9cyclictest1213033-21systemd-journal19:25:000
2441258995346,5cyclictest2442787-21kworker/u8:0+flush-179:019:30:141
2441258995328,21cyclictest0-21swapper/120:37:591
2441256995344,7cyclictest2459184-21latency_hist20:05:010
2441256995342,8cyclictest1213033-21systemd-journal21:10:010
2441256995342,8cyclictest1213033-21systemd-journal21:10:000
2441256995245,4cyclictest2522529-21latency_hist23:20:010
2441256995143,4cyclictest2480677-21kworker/u8:0+flush-179:021:40:240
2441256995140,8cyclictest2520940-21latency_hist23:15:010
2441256995042,7cyclictest2482260-21kworker/u8:1+flush-179:021:15:240
4577091490,13ptp4l61490irq/134-eno1-TxRx-019:09:593
2441258994945,2cyclictest2439667-21kworker/u8:1+events_unbound19:10:021
2441258994934,12cyclictest1213033-21systemd-journal00:15:001
2441258994926,20cyclictest0-21swapper/122:15:161
2441256994939,8cyclictest1213033-21systemd-journal21:25:000
2441256994939,7cyclictest2439667-21kworker/u8:1+flush-179:019:30:220
2441256994927,14cyclictest2471359-21apt-get20:40:120
2441256994927,14cyclictest2471359-21apt-get20:40:110
2441258994842,5cyclictest2503248-21kworker/u8:0+flush-179:022:20:241
2441258994840,7cyclictest2426880-21kworker/u8:3+flush-179:019:10:191
244125899474,12cyclictest714-21Xorg00:25:581
2441258994739,6cyclictest2505701-21kworker/u8:1+flush-179:022:25:261
244125899470,30cyclictest0-21swapper/121:56:591
2441258994639,5cyclictest2511451-21kworker/u8:3+events_unbound23:15:001
2441258994639,5cyclictest2454181-21kworker/u8:2+flush-179:019:59:571
2441258994536,6cyclictest321-21hwrng19:39:591
2441258994533,7cyclictest2511451-21kworker/u8:3+flush-179:022:55:201
2441258994522,4cyclictest2487374-21cpuspeed_turbos21:30:131
244125899450,43cyclictest714-21Xorg20:08:591
2441258994420,4cyclictest2506880-21apt-get22:30:131
2441256994436,6cyclictest2511451-21kworker/u8:3+flush-179:023:00:010
244125699440,42cyclictest714-21Xorg21:13:580
2441258994338,4cyclictest2480677-21kworker/u8:0+flush-179:022:05:161
2441258994333,8cyclictest2439667-21kworker/u8:1+flush-179:019:20:141
2441258994237,3cyclictest2524173-21systemd-run23:25:001
2441258994235,5cyclictest2472726-21kworker/u8:2+flush-179:021:10:161
244125899411,28cyclictest2530757-21apt-get23:45:141
2441256994035,3cyclictest2462392-21systemd-run20:15:000
2441256994033,5cyclictest2524136-21latency_hist23:25:010
244125699401,38cyclictest211irq_work/000:24:590
4577091390,7ptp4l431rcuc/321:25:003
244126399390,38cyclictest0-21swapper/323:08:593
244126299390,36cyclictest0-21swapper/223:08:592
244126299390,36cyclictest0-21swapper/220:19:552
244126299390,2cyclictest0-21swapper/200:06:592
2441256993936,2cyclictest2454151-21sh19:50:010
2441256993935,3cyclictest2528953-21systemd-run23:40:000
2441256993934,4cyclictest0-21swapper/021:47:590
2441256993929,8cyclictest1213033-21systemd-journal20:20:000
244126299380,1cyclictest0-21swapper/220:24:592
2441256993835,2cyclictest714-21Xorg19:53:590
2441263993734,2cyclictest0-21swapper/300:09:553
244126399370,35cyclictest0-21swapper/322:01:593
2441262993733,2cyclictest0-21swapper/220:39:552
244126299370,2cyclictest0-21swapper/222:47:592
2441258993732,3cyclictest2527309-21munin-run23:35:011
2441258993732,3cyclictest2527309-21munin-run23:35:001
2441256993732,3cyclictest2511413-21awk22:45:000
2441256993730,5cyclictest2501585-21latency_hist22:15:010
2441256993712,9cyclictest2503710-21apt-get22:20:130
2441263993634,1cyclictest0-21swapper/320:24:563
2441263993634,1cyclictest0-21swapper/300:11:583
244126399360,35cyclictest0-21swapper/320:19:553
2441262993633,2cyclictest0-21swapper/223:32:002
2441262993633,2cyclictest0-21swapper/223:31:592
244126299360,2cyclictest0-21swapper/220:28:592
244126299360,1cyclictest0-21swapper/222:01:592
2441258993626,6cyclictest0-21swapper/121:01:591
244125699361,34cyclictest714-21Xorg23:49:000
2441263993533,1cyclictest0-21swapper/320:39:553
2441262993531,2cyclictest0-21swapper/223:12:592
2441262993531,2cyclictest0-21swapper/222:55:582
2441258993531,2cyclictest714-21Xorg00:09:581
244125699354,30cyclictest0-21swapper/019:12:590
2441256993532,2cyclictest714-21Xorg21:53:590
2441256993531,3cyclictest2530506-21munin-plugin-st23:44:590
2441256993530,3cyclictest1-21systemd23:30:000
2441263993432,1cyclictest0-21swapper/323:32:003
2441263993432,1cyclictest0-21swapper/323:32:003
2441263993431,2cyclictest0-21swapper/323:12:593
2441263993430,2cyclictest0-21swapper/300:29:553
2441263993427,5cyclictest2457325-21turbostat19:59:593
2441262993431,2cyclictest0-21swapper/221:42:592
2441262993431,2cyclictest0-21swapper/221:12:002
2441262993431,2cyclictest0-21swapper/219:24:582
2441262993430,2cyclictest0-21swapper/221:36:592
2441262993430,2cyclictest0-21swapper/219:29:552
2441258993429,3cyclictest2519358-21munin-run23:10:001
2441256993426,6cyclictest510-21rs:main0
244125699341,29cyclictest0-21swapper/020:50:130
2441263993331,1cyclictest0-21swapper/322:55:593
2441263993331,1cyclictest0-21swapper/321:11:593
2441263993329,3cyclictest0-21swapper/321:36:593
2441262993330,2cyclictest0-21swapper/200:32:002
2441262993330,2cyclictest0-21swapper/200:29:552
244125699330,31cyclictest2545465-21apt-key00:30:010
2441263993230,1cyclictest0-21swapper/321:43:003
2441263993230,1cyclictest0-21swapper/319:24:583
2441263993229,2cyclictest0-21swapper/300:31:593
2441262993229,2cyclictest0-21swapper/219:10:582
244125699324,25cyclictest2508468-21apt-get22:35:130
2441256993219,11cyclictest0-21swapper/022:00:000
4577091310,7ptp4l441ktimers/323:05:013
2441263993129,1cyclictest0-21swapper/322:34:593
2441263993129,1cyclictest0-21swapper/320:27:583
2441263993129,1cyclictest0-21swapper/319:29:563
2441263993128,2cyclictest0-21swapper/319:10:593
2441262993129,1cyclictest0-21swapper/222:34:592
2441262993127,3cyclictest0-21swapper/220:30:592
2441262993127,2cyclictest0-21swapper/219:37:002
2441262993127,2cyclictest0-21swapper/200:38:582
2441262993126,2cyclictest0-21swapper/219:59:552
244125699310,28cyclictest0-21swapper/021:00:130
2441263993027,2cyclictest0-21swapper/323:35:143
2441263993027,2cyclictest0-21swapper/319:36:593
2441263993027,1cyclictest0-21swapper/320:30:593
244126399300,28cyclictest0-21swapper/320:45:143
2441262993027,2cyclictest0-21swapper/223:35:142
2441262993027,2cyclictest0-21swapper/200:20:002
244126299300,2cyclictest0-21swapper/219:50:142
244126299300,28cyclictest0-21swapper/223:40:122
244126299300,28cyclictest0-21swapper/223:25:142
244126299300,28cyclictest0-21swapper/200:00:112
244126299300,27cyclictest0-21swapper/221:50:122
244126299300,21cyclictest0-21swapper/223:45:132
2441256993025,4cyclictest714-21Xorg20:49:590
4577091290,7ptp4l61490irq/134-eno1-TxRx-022:40:013
4577091290,7ptp4l61490irq/134-eno1-TxRx-021:49:553
4577091290,7ptp4l61490irq/134-eno1-TxRx-020:45:013
4577091290,7ptp4l61490irq/134-eno1-TxRx-020:45:003
4577091290,7ptp4l441ktimers/322:25:003
2441263992926,2cyclictest0-21swapper/300:38:593
2441263992925,2cyclictest0-21swapper/323:25:133
244126399290,28cyclictest0-21swapper/322:10:033
244126399290,28cyclictest0-21swapper/321:55:103
244126399290,28cyclictest0-21swapper/321:50:123
244126399290,21cyclictest0-21swapper/320:00:023
244126399290,1cyclictest0-21swapper/300:15:013
244126299290,2cyclictest0-21swapper/222:10:032
244126299290,2cyclictest0-21swapper/220:45:142
244126299290,2cyclictest0-21swapper/220:10:132
244126299290,27cyclictest0-21swapper/223:20:592
244126299290,27cyclictest0-21swapper/221:55:102
244126299290,27cyclictest0-21swapper/200:20:582
244126299290,27cyclictest0-21swapper/200:15:022
244126299290,21cyclictest0-21swapper/220:40:042
244126299290,21cyclictest0-21swapper/220:40:032
2441256992918,8cyclictest714-21Xorg20:57:580
4577091280,6ptp4l61490irq/134-eno1-TxRx-021:35:003
4577091280,6ptp4l61490irq/134-eno1-TxRx-020:10:013
4577091280,6ptp4l441ktimers/322:45:003
4577091280,6ptp4l441ktimers/321:10:013
4577091280,6ptp4l441ktimers/321:10:003
4577091280,6ptp4l441ktimers/319:50:023
4577091280,5ptp4l61490irq/134-eno1-TxRx-023:55:023
4577091280,3ptp4l431rcuc/320:14:553
2441263992825,2cyclictest0-21swapper/323:45:143
2441263992825,2cyclictest0-21swapper/323:19:593
244126399280,27cyclictest0-21swapper/319:50:133
244126399280,26cyclictest0-21swapper/300:00:123
244126399280,1cyclictest0-21swapper/323:40:113
2441262992825,2cyclictest0-21swapper/223:55:152
2441262992825,1cyclictest0-21swapper/223:19:582
2441262992824,2cyclictest0-21swapper/220:53:592
244126299280,2cyclictest0-21swapper/220:07:592
244126299280,2cyclictest0-21swapper/220:00:012
2441256992823,4cyclictest2442787-21kworker/u8:0+flush-179:019:26:510
4577091270,6ptp4l61490irq/134-eno1-TxRx-020:55:013
4577091270,6ptp4l441ktimers/323:25:013
4577091270,6ptp4l441ktimers/322:50:003
4577091270,6ptp4l441ktimers/322:30:003
4577091270,5ptp4l61490irq/134-eno1-TxRx-022:19:563
4577091270,5ptp4l441ktimers/322:54:543
2441263992725,1cyclictest0-21swapper/323:55:143
244126399270,26cyclictest0-21swapper/300:20:593
2441262992724,2cyclictest0-21swapper/220:59:592
2441262992723,2cyclictest0-21swapper/222:16:592
244126299270,25cyclictest0-21swapper/222:36:592
2441256992717,7cyclictest714-21Xorg22:32:590
4577091260,5ptp4l61490irq/134-eno1-TxRx-020:59:553
4577091260,5ptp4l61490irq/134-eno1-TxRx-019:20:003
4577091260,4ptp4l441ktimers/319:44:553
4577091260,4ptp4l441ktimers/319:34:563
2441262992623,2cyclictest0-21swapper/219:34:562
2441262992621,3cyclictest0-21swapper/219:40:122
4577091250,4ptp4l441ktimers/322:09:553
4577091250,4ptp4l441ktimers/321:04:553
4577091250,3ptp4l441ktimers/321:30:013
2441262992523,1cyclictest0-21swapper/222:20:122
2441262992520,2cyclictest0-21swapper/223:02:002
2441256992421,2cyclictest0-21swapper/022:27:590
231999240,13rtkit-daemon2439847-21apt-get19:05:150
2441262992320,2cyclictest0-21swapper/222:05:112
2441262992319,3cyclictest0-21swapper/221:28:582
2441262992319,2cyclictest0-21swapper/222:43:592
2441262992319,2cyclictest0-21swapper/221:05:592
2441262992319,2cyclictest0-21swapper/221:05:592
2441262992218,2cyclictest0-21swapper/223:51:592
2441262992117,2cyclictest0-21swapper/222:27:592
2441262992117,2cyclictest0-21swapper/219:19:552
2441262992017,2cyclictest0-21swapper/221:46:002
2441262991813,3cyclictest2488616-21turbostat21:35:002
2441262991714,2cyclictest0-21swapper/222:51:592
2441262991713,2cyclictest0-21swapper/219:45:132
2441262991512,2cyclictest0-21swapper/221:20:142
244126299107,2cyclictest0-21swapper/221:01:592
24412629930,2cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional