You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 23:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Thu Jul 02, 2026 12:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
262557199132122,8cyclictest2635497-21kworker/u8:0+flush-179:008:55:011
262557199127115,9cyclictest2723126-21kworker/u8:0+flush-179:012:20:001
262556699124117,5cyclictest2710614-21kworker/u8:3+flush-179:011:40:020
262557199119110,6cyclictest2635497-21kworker/u8:0+events_unbound08:20:211
262557199118102,7cyclictest2608238-21kworker/u8:3+flush-179:007:20:011
262557199117100,7cyclictest2650122-21kworker/u8:1+events_unbound08:50:001
262557199116109,4cyclictest2705310-21latency_hist11:15:011
26255719911499,5cyclictest2628686-21kworker/u8:0+events_unbound07:20:241
262556699114103,8cyclictest2663141-21latency_hist09:05:020
262557199112101,8cyclictest2645103-21latency_hist08:10:001
26255669911099,8cyclictest1213033-21systemd-journal08:20:010
26255669911099,8cyclictest1213033-21systemd-journal08:20:010
262557199109100,6cyclictest2682299-21kworker/u8:3+events_unbound10:10:001
26255719910693,9cyclictest2715800-21kworker/u8:2+flush-179:011:50:211
26255669910698,6cyclictest2630238-21latency_hist07:25:010
26255719910599,3cyclictest2723126-21kworker/u8:0+flush-179:012:25:251
26255719910592,5cyclictest2677444-21kworker/u8:1+events_unbound09:50:021
26255719910497,5cyclictest2658395-21kworker/u8:3+events_unbound09:20:011
26255719910492,8cyclictest2667895-21kworker/u8:1+flush-179:009:30:131
26255719910390,10cyclictest2656516-21latency_hist08:45:021
26255719910383,17cyclictest2706922-21apt-get11:20:011
26255719910194,5cyclictest2674331-21kworker/u8:2+flush-179:010:10:191
26255719910093,5cyclictest2658395-21kworker/u8:3+events_unbound09:15:011
26255719910091,6cyclictest2701914-21kworker/u8:0+events_unbound11:30:141
26255719910083,5cyclictest2650122-21kworker/u8:1+events_unbound08:25:211
2625571999989,8cyclictest2728121-21kworker/u8:2+events_unbound12:40:001
2625566999994,4cyclictest2635497-21kworker/u8:0+flush-179:008:40:260
2625566999889,6cyclictest2728138-21latency_hist12:25:010
2625571999791,4cyclictest2635497-21kworker/u8:0+flush-179:009:00:161
2625571999787,8cyclictest2674331-21kworker/u8:2+flush-179:009:45:011
2625571999688,6cyclictest2719881-21kworker/u8:2+flush-179:012:10:001
2625571999588,5cyclictest2635497-21kworker/u8:0+flush-179:008:30:211
2625571999585,6cyclictest2689129-21kworker/u8:1+events_unbound11:00:001
2625571999582,9cyclictest2698662-21kworker/u8:2+flush-179:011:05:201
2625571999576,7cyclictest2715800-21kworker/u8:2+flush-179:011:45:241
2625571999485,7cyclictest2658395-21kworker/u8:3+events_unbound09:40:001
2625571999284,5cyclictest2633651-21kworker/u8:3+flush-179:007:40:211
2625571999283,6cyclictest2641897-21kworker/u8:3+flush-179:008:00:221
2625571999182,6cyclictest2641897-21kworker/u8:3+flush-179:008:15:211
2625571999182,6cyclictest2641897-21kworker/u8:3+flush-179:008:15:211
2625571999083,4cyclictest2633651-21kworker/u8:3+events_unbound07:35:231
2625571999076,10cyclictest2646689-21latency_hist08:15:011
2625571999076,10cyclictest2646689-21latency_hist08:15:011
2625566999081,6cyclictest2723126-21kworker/u8:0+flush-179:012:30:150
2625566999081,6cyclictest2723126-21kworker/u8:0+flush-179:012:30:150
2625571998982,4cyclictest2728121-21kworker/u8:2+events_unbound12:35:001
2625571998982,4cyclictest2728121-21kworker/u8:2+events_unbound12:35:001
2625571998979,8cyclictest2667895-21kworker/u8:1+flush-179:009:30:011
2625571998974,5cyclictest2679032-21kworker/u8:0+flush-179:010:15:201
2625571998884,3cyclictest2718287-21kworker/u8:1+flush-179:012:00:001
2625571998776,5cyclictest2658395-21kworker/u8:3+events_unbound09:20:121
2625571998677,7cyclictest2637141-21kworker/u8:1+flush-179:007:50:011
2625571998677,6cyclictest2679032-21kworker/u8:0+events_unbound09:55:161
2625566998676,8cyclictest2703465-21latency_hist11:10:010
2625571998579,4cyclictest2650122-21kworker/u8:1+flush-179:008:35:251
2625571998578,4cyclictest2689129-21kworker/u8:1+flush-179:011:00:201
2625571998576,7cyclictest2635497-21kworker/u8:0+flush-179:007:50:261
2625571998575,7cyclictest2723126-21kworker/u8:0+flush-179:012:20:141
2625571998574,8cyclictest2689129-21kworker/u8:1+flush-179:010:45:211
2625571998478,4cyclictest2625468-21kworker/u8:1+events_unbound07:30:021
2625566998478,4cyclictest2689129-21kworker/u8:1+flush-179:010:45:150
2625571998376,5cyclictest2690964-21kworker/u8:3+events_unbound10:30:231
2625571998277,3cyclictest2719881-21kworker/u8:2+events_unbound12:10:181
2625571998067,9cyclictest1213033-21systemd-journal10:45:011
2625566998075,4cyclictest2674331-21kworker/u8:2+events_unbound09:47:440
2625566997968,8cyclictest2635497-21kworker/u8:0+flush-179:008:20:220
2625571997872,3cyclictest2682299-21kworker/u8:3+events_unbound10:20:231
2625571997871,4cyclictest2658395-21kworker/u8:3+flush-179:009:05:191
2625571997772,4cyclictest2650122-21kworker/u8:1+events_unbound08:55:251
2625571997771,4cyclictest2689129-21kworker/u8:1+events_unbound10:25:231
2625566997672,3cyclictest2689129-21kworker/u8:1+events_unbound11:14:450
2625566997666,7cyclictest2635497-21kworker/u8:0+flush-179:007:55:210
2625571997569,5cyclictest2674331-21kworker/u8:2+flush-179:010:39:551
2625571997569,5cyclictest2674331-21kworker/u8:2+flush-179:010:39:551
2625571997568,4cyclictest2719881-21kworker/u8:2+flush-179:012:00:251
2625566997564,6cyclictest2631825-21latency_hist07:30:010
2625566997561,11cyclictest2685690-21apt-get10:15:000
2625571997465,7cyclictest2630494-21apt-get07:25:121
2625566997470,3cyclictest2723126-21kworker/u8:0+events_unbound12:25:450
2625566997466,5cyclictest2680673-21latency_hist10:00:000
2625571997362,7cyclictest2674331-21kworker/u8:2+flush-179:009:50:171
2625566997367,4cyclictest2674331-21kworker/u8:2+flush-179:010:35:170
2625566997367,4cyclictest2674331-21kworker/u8:2+flush-179:010:35:170
2625566997265,4cyclictest2650122-21kworker/u8:1+flush-179:008:45:110
2625566997163,6cyclictest2658395-21kworker/u8:3+flush-179:009:05:150
2625566997161,8cyclictest2634185-21apt-get07:35:100
2625571997064,4cyclictest2689129-21kworker/u8:1+events_unbound11:20:141
2625571997064,4cyclictest2689129-21kworker/u8:1+events_unbound11:20:141
2625571997055,5cyclictest2608238-21kworker/u8:3+events_unbound07:10:191
2625571996962,4cyclictest2689129-21kworker/u8:1+flush-179:011:25:121
2625566996965,3cyclictest2679032-21kworker/u8:0+events_unbound10:15:450
2625566996959,7cyclictest2689129-21kworker/u8:1+flush-179:010:25:220
2625572996734,31cyclictest0-21swapper/210:14:002
2625566996764,2cyclictest0-21swapper/010:24:590
2625566996751,12cyclictest1213033-21systemd-journal12:15:000
2625566996658,6cyclictest2653321-21latency_hist08:35:010
2625572996460,2cyclictest0-21swapper/207:38:592
2625566996457,5cyclictest2718287-21kworker/u8:1+flush-179:012:00:250
2625571996358,3cyclictest2679032-21kworker/u8:0+flush-179:010:04:551
2625566996356,4cyclictest2700285-21latency_hist11:00:010
2625566996350,9cyclictest1213033-21systemd-journal08:40:000
2625566996157,3cyclictest2689129-21kworker/u8:1+events_unbound10:51:450
2625566996053,5cyclictest2674331-21kworker/u8:2+events_unbound09:45:000
2625571995941,7cyclictest2689129-21kworker/u8:1+events_unbound11:35:191
2625566995949,7cyclictest2701914-21kworker/u8:0+flush-179:011:55:140
2625566995949,7cyclictest2689129-21kworker/u8:1+events_unbound10:35:000
2625566995948,9cyclictest2709022-21apt-get11:25:100
2625566995848,7cyclictest2715137-21latency_hist11:45:010
2625566995844,11cyclictest1213033-21systemd-journal08:10:000
2625566995753,3cyclictest2674331-21kworker/u8:2+events_unbound10:05:090
2625566995751,4cyclictest2668181-21apt-get09:20:100
2625566995745,8cyclictest1213033-21systemd-journal08:15:010
2625566995745,8cyclictest1213033-21systemd-journal08:15:000
2625571995651,4cyclictest2635497-21kworker/u8:0+flush-179:007:55:251
2625566995649,5cyclictest2670053-21diskstats09:25:150
2625571995549,4cyclictest2689129-21kworker/u8:1+flush-179:010:50:201
2625574995351,1cyclictest0-21swapper/307:38:593
2625566995346,5cyclictest2674331-21kworker/u8:2+flush-179:009:50:230
2625566995341,9cyclictest2701914-21kworker/u8:0+flush-179:011:30:140
2625566995243,7cyclictest2731300-21kworker/u8:3+flush-179:012:35:230
2625571995139,10cyclictest2689129-21kworker/u8:1+events_unbound11:40:211
2625566995142,6cyclictest2715800-21kworker/u8:2+events_unbound11:50:000
2625574995043,5cyclictest2726296-21turbostat12:20:003
2625566994843,3cyclictest2627080-21systemd-run07:15:000
4577091470,13ptp4l441ktimers/307:10:013
2625566994642,3cyclictest2679032-21kworker/u8:0+flush-179:010:00:460
2625566994640,4cyclictest2650122-21kworker/u8:1+flush-179:009:10:170
2625566994637,6cyclictest2643517-21latency_hist08:05:010
2625566994541,2cyclictest2701914-21kworker/u8:0+flush-179:011:20:260
2625566994541,2cyclictest2701914-21kworker/u8:0+flush-179:011:20:250
2625566994538,5cyclictest2665709-21kworker/u8:0+flush-179:009:17:010
2625566994535,7cyclictest1213033-21systemd-journal07:45:440
2625566994534,9cyclictest2705852-21diskstats11:15:130
262557299440,42cyclictest0-21swapper/211:50:582
262557499430,42cyclictest0-21swapper/307:26:593
2625566994334,7cyclictest2674331-21kworker/u8:2+flush-179:010:40:240
2625566994333,7cyclictest321-21hwrng08:25:590
2625574994239,2cyclictest0-21swapper/310:23:593
262557499420,1cyclictest0-21swapper/307:21:593
2625566994238,3cyclictest2661549-21munin-plugin-st09:00:010
2625566994238,3cyclictest2658395-21kworker/u8:3+events_unbound09:39:240
262557299410,39cyclictest0-21swapper/209:46:592
2625566994138,3cyclictest2650122-21kworker/u8:1+events_unbound08:50:480
2625566994137,3cyclictest2698662-21kworker/u8:2+events_unbound11:01:370
2625566994135,5cyclictest2633651-21kworker/u8:3+flush-179:007:31:350
2625566994036,3cyclictest2723124-21systemd-run12:10:010
2625566994036,3cyclictest2635497-21kworker/u8:0+events_unbound07:50:480
2625566994036,3cyclictest2633651-21kworker/u8:3+flush-179:007:40:130
2625574993937,1cyclictest0-21swapper/311:55:003
2625572993935,2cyclictest0-21swapper/212:20:592
262557299390,36cyclictest0-21swapper/210:17:592
262556699390,3cyclictest2671116-21turbostat09:34:560
2625572993835,2cyclictest0-21swapper/212:38:592
2625572993835,2cyclictest0-21swapper/209:52:592
262557299380,36cyclictest0-21swapper/211:07:582
262557299380,35cyclictest0-21swapper/211:22:592
262557299380,35cyclictest0-21swapper/211:22:582
2625566993829,7cyclictest510-21rs:main0
2625574993735,1cyclictest0-21swapper/311:17:593
2625574993734,2cyclictest0-21swapper/309:08:593
262557499370,36cyclictest0-21swapper/312:39:563
262557499370,30cyclictest0-21swapper/307:13:593
2625572993734,2cyclictest0-21swapper/211:43:002
262557299370,35cyclictest0-21swapper/212:19:592
262557299370,35cyclictest0-21swapper/207:59:002
262557299370,2cyclictest0-21swapper/212:25:592
2625566993733,3cyclictest2608238-21kworker/u8:3+events_unbound07:15:170
2625574993634,2cyclictest0-21swapper/312:03:593
2625574993634,1cyclictest0-21swapper/312:29:553
2625574993634,1cyclictest0-21swapper/310:14:553
2625574993634,1cyclictest0-21swapper/308:31:593
2625574993633,2cyclictest2638757-21sleep07:50:013
262557499360,35cyclictest0-21swapper/311:58:593
2625572993632,2cyclictest0-21swapper/208:35:592
262557299360,1cyclictest0-21swapper/211:59:002
262557299360,1cyclictest0-21swapper/209:35:592
262557299360,1cyclictest0-21swapper/208:33:592
2625574993533,1cyclictest0-21swapper/309:47:003
2625574993533,1cyclictest0-21swapper/309:03:593
262557499350,34cyclictest0-21swapper/312:24:593
262557499350,1cyclictest0-21swapper/309:11:003
262557499350,1cyclictest0-21swapper/308:47:593
2625572993533,1cyclictest0-21swapper/208:50:002
2625572993532,2cyclictest0-21swapper/211:26:592
2625572993532,2cyclictest0-21swapper/207:28:002
2625566993532,3cyclictest2718287-21kworker/u8:1+events_unbound11:52:100
2625574993429,4cyclictest2641942-21turbostat07:59:593
2625572993431,2cyclictest0-21swapper/208:05:592
4577091330,3ptp4l61490irq/134-eno1-TxRx-012:33:593
4577091330,3ptp4l61490irq/134-eno1-TxRx-012:33:593
2625574993331,1cyclictest0-21swapper/311:40:003
2625574993331,1cyclictest0-21swapper/310:26:593
2625572993330,2cyclictest0-21swapper/211:35:582
2625574993230,1cyclictest0-21swapper/309:35:593
2625574993230,1cyclictest0-21swapper/308:53:583
2625574993228,2cyclictest0-21swapper/310:35:593
2625574993228,2cyclictest0-21swapper/310:35:593
2625572993229,2cyclictest0-21swapper/209:58:002
2625572993229,2cyclictest0-21swapper/208:17:592
2625572993229,2cyclictest0-21swapper/208:17:592
2625572993229,2cyclictest0-21swapper/207:19:592
2625574993129,1cyclictest0-21swapper/311:22:593
2625574993129,1cyclictest0-21swapper/311:22:583
2625574993129,1cyclictest0-21swapper/311:07:593
2625574993129,1cyclictest0-21swapper/308:40:593
2625572993128,2cyclictest0-21swapper/212:14:552
2625572993128,2cyclictest0-21swapper/210:04:542
2625572993127,2cyclictest0-21swapper/211:12:002
262557299310,29cyclictest0-21swapper/207:30:022
4577091300,10ptp4l61490irq/134-eno1-TxRx-011:29:553
2625574993028,1cyclictest0-21swapper/310:17:593
2625574993027,2cyclictest0-21swapper/310:50:153
2625574993027,2cyclictest0-21swapper/310:05:033
262557499300,29cyclictest0-21swapper/310:41:593
2625572993027,2cyclictest0-21swapper/210:50:142
2625572993027,2cyclictest0-21swapper/207:14:562
2625572993026,2cyclictest0-21swapper/207:45:592
2625574992926,2cyclictest0-21swapper/310:45:143
2625574992926,2cyclictest0-21swapper/307:35:013
262557499290,28cyclictest0-21swapper/308:15:133
262557499290,28cyclictest0-21swapper/308:15:133
2625572992925,2cyclictest0-21swapper/212:05:132
262557299290,27cyclictest0-21swapper/210:35:142
262557299290,27cyclictest0-21swapper/210:35:132
262557299290,27cyclictest0-21swapper/210:05:022
262557299290,27cyclictest0-21swapper/209:30:122
262557299290,27cyclictest0-21swapper/208:40:122
262557299290,27cyclictest0-21swapper/208:15:022
4578291280,26phc2sys0-21swapper/308:20:133
4577091280,7ptp4l441ktimers/310:35:003
2625574992827,1cyclictest0-21swapper/310:03:593
2625574992827,1cyclictest0-21swapper/309:15:133
2625574992826,1cyclictest0-21swapper/311:42:593
2625574992826,1cyclictest0-21swapper/309:52:593
2625574992826,1cyclictest0-21swapper/309:30:133
2625574992826,1cyclictest0-21swapper/308:05:123
2625574992825,2cyclictest0-21swapper/312:10:123
262557499280,26cyclictest0-21swapper/312:05:123
262557499280,26cyclictest0-21swapper/309:40:133
2625572992825,2cyclictest0-21swapper/208:29:592
2625572992824,2cyclictest0-21swapper/211:45:122
262557299280,2cyclictest0-21swapper/209:40:142
262557299280,2cyclictest0-21swapper/208:50:142
262557299280,26cyclictest0-21swapper/210:45:132
262557299280,26cyclictest0-21swapper/209:15:132
4577091270,6ptp4l61490irq/134-eno1-TxRx-011:05:003
4577091270,6ptp4l61490irq/134-eno1-TxRx-009:25:013
4577091270,6ptp4l61490irq/134-eno1-TxRx-007:45:003
4577091270,4ptp4l441ktimers/307:20:013
262557499270,26cyclictest0-21swapper/309:55:143
262557499270,26cyclictest0-21swapper/308:35:583
2625572992725,1cyclictest0-21swapper/210:57:002
262557299270,24cyclictest0-21swapper/208:00:592
262557299270,19cyclictest0-21swapper/209:09:562
2625571992723,3cyclictest2625583-21latency_hist07:10:021
231999270,10rtkit-daemon1469876-21munin-node07:05:340
4577091260,5ptp4l61490irq/134-eno1-TxRx-008:05:003
4577091260,5ptp4l441ktimers/309:30:013
4577091260,5ptp4l441ktimers/308:15:013
4577091260,5ptp4l441ktimers/308:15:013
2625574992623,2cyclictest0-21swapper/310:56:593
262557499260,24cyclictest0-21swapper/311:30:593
2625572992624,1cyclictest0-21swapper/208:23:592
2625572992623,2cyclictest0-21swapper/209:23:592
262557299260,2cyclictest0-21swapper/208:11:592
262557299260,24cyclictest0-21swapper/211:15:592
262557299260,24cyclictest0-21swapper/207:25:002
4577091250,5ptp4l61490irq/134-eno1-TxRx-008:30:013
4577091250,5ptp4l61490irq/134-eno1-TxRx-007:54:563
4577091250,5ptp4l441ktimers/311:49:553
2625574992523,1cyclictest0-21swapper/311:11:593
2625572992522,2cyclictest0-21swapper/211:00:112
4577091240,4ptp4l61490irq/134-eno1-TxRx-009:00:013
2625572992219,2cyclictest0-21swapper/212:30:592
2625572992219,2cyclictest0-21swapper/212:30:592
2625572992219,2cyclictest0-21swapper/210:32:592
2625572992118,2cyclictest0-21swapper/211:34:552
2625572992017,2cyclictest0-21swapper/210:24:542
2625572992017,2cyclictest0-21swapper/207:51:592
2625572991916,2cyclictest0-21swapper/209:25:142
2625572991816,1cyclictest0-21swapper/209:04:592
2625572991512,2cyclictest0-21swapper/209:12:002
2625572991311,2cyclictest0-21swapper/207:41:592
2625572991311,1cyclictest0-21swapper/208:59:592
262557299118,2cyclictest0-21swapper/212:04:552
262557299107,2cyclictest0-21swapper/210:41:002
26255729985,2cyclictest0-21swapper/210:30:002
26255729930,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional