You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 20:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Wed Jan 07, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2104262999589,4cyclictest2171615-21latency_hist10:40:010
2104264999487,6cyclictest2155672-21kworker/u8:0+events_unbound09:55:241
2104262999279,9cyclictest2161380-21kworker/u8:3+flush-179:010:25:220
2104264999080,7cyclictest2187792-21latency_hist11:30:011
2104264998984,4cyclictest2155672-21kworker/u8:0+events_unbound09:50:251
2104262998983,4cyclictest2168464-21kworker/u8:2+events_unbound10:50:010
2104264998676,8cyclictest2173211-21latency_hist10:45:011
2104264998479,4cyclictest2121457-21kworker/u8:1+flush-179:008:10:231
2104264998275,5cyclictest2112387-21kworker/u8:3+flush-179:007:35:251
2104264998075,4cyclictest2137635-21kworker/u8:1+events_unbound08:50:231
2104264997964,13cyclictest2161380-21kworker/u8:3+flush-179:010:10:151
2104264997873,3cyclictest2163637-21kworker/u8:0+events_unbound10:15:201
2104264997873,3cyclictest2163637-21kworker/u8:0+events_unbound10:15:201
2104264997871,5cyclictest2135587-21kworker/u8:0+events_unbound08:55:271
2104264997771,4cyclictest2189416-21kworker/u8:3+events_unbound11:45:251
2104264997765,9cyclictest266-21systemd-journal09:20:001
2104262997770,4cyclictest2135587-21kworker/u8:0+flush-179:008:45:160
2104264997668,6cyclictest2125217-21kworker/u8:2+events_unbound08:40:201
2104264997668,6cyclictest2107445-21kworker/u8:2+events_unbound07:20:031
2104264997667,7cyclictest2160710-21/usr/sbin/munin10:05:261
2104264997661,5cyclictest2178293-21kworker/u8:3+events_unbound11:15:191
2104264997570,4cyclictest2178293-21kworker/u8:3+events_unbound11:20:241
2104264997570,4cyclictest2121457-21kworker/u8:1+events_unbound08:00:241
2104264997566,7cyclictest2201603-21kworker/u8:3+flush-179:012:40:001
2104264997465,7cyclictest2149559-21/usr/sbin/munin09:30:221
2104264997366,5cyclictest2154082-21kworker/u8:1+events_unbound10:20:201
2104264997264,5cyclictest2187770-21kworker/u8:2+events_unbound11:30:141
2104264997166,4cyclictest2122034-21kworker/u8:3+flush-179:008:05:191
2104264997164,4cyclictest2125217-21kworker/u8:2+events_unbound08:35:211
2104264997163,6cyclictest2136579-21latency_hist08:50:001
2104264997162,6cyclictest2168416-21kworker/u8:0+events_unbound10:50:151
2104264997065,4cyclictest2195155-21kworker/u8:0+flush-179:012:00:211
2104264996964,4cyclictest2144571-21kworker/u8:3+flush-179:009:20:221
2104262996963,4cyclictest2147715-21kworker/u8:0+flush-179:009:35:250
2104262996859,7cyclictest2162058-21latency_hist10:10:010
2104264996762,4cyclictest2197312-21kworker/u8:1+flush-179:012:10:011
2104262996759,6cyclictest266-21systemd-journal08:20:000
2104264996558,5cyclictest2176618-21kworker/u8:1+events_unbound11:05:141
2104262996559,4cyclictest2198991-21kworker/u8:2+events_unbound12:10:130
2104262996555,7cyclictest2122000-21latency_hist08:05:010
2104264996458,4cyclictest2106354-21kworker/u8:0+flush-179:008:20:181
2104262996455,6cyclictest2198991-21kworker/u8:2+events_unbound12:35:240
210426299640,62cyclictest2191029-21munin-run11:40:010
2104262996357,4cyclictest2187770-21kworker/u8:2+flush-179:011:30:220
2104264996257,4cyclictest2127445-21kworker/u8:1+events_unbound08:25:191
2104264996256,4cyclictest2106354-21kworker/u8:0+flush-179:007:55:211
2104264996255,6cyclictest2168464-21kworker/u8:2+events_unbound10:55:171
2104262996255,5cyclictest2178287-21kworker/u8:0+flush-179:011:25:210
2104264996156,4cyclictest2195155-21kworker/u8:0+events_unbound12:15:161
2104264996153,6cyclictest2206936-21kworker/u8:1+events_unbound12:30:241
2104262996154,5cyclictest2195155-21kworker/u8:0+flush-179:011:55:230
2104262996154,5cyclictest2163637-21kworker/u8:0+flush-179:010:20:010
2104262996154,5cyclictest2163637-21kworker/u8:0+flush-179:010:20:000
2104262996153,6cyclictest2106354-21kworker/u8:0+events_unbound07:55:250
2104264996055,4cyclictest2147715-21kworker/u8:0+events_unbound09:25:241
2104262996052,6cyclictest2178287-21kworker/u8:0+flush-179:011:40:200
2104264995954,4cyclictest2112387-21kworker/u8:3+events_unbound07:45:131
2104264995953,4cyclictest2189358-21kworker/u8:1+events_unbound11:35:181
2104267995855,2cyclictest0-21swapper/211:10:592
2104264995852,5cyclictest2201603-21kworker/u8:3+events_unbound12:20:201
2104262995850,6cyclictest2106354-21kworker/u8:0+flush-179:007:40:000
2104262995850,5cyclictest2139730-21kworker/u8:2+flush-179:009:00:140
2104264995752,4cyclictest2161380-21kworker/u8:3+events_unbound10:35:241
2104264995751,5cyclictest2106354-21kworker/u8:0+flush-179:008:15:231
2104264995748,7cyclictest2112383-21kworker/u8:2+flush-179:007:50:211
2104262995751,4cyclictest2125217-21kworker/u8:2+events_unbound08:35:240
2104262995751,4cyclictest2106354-21kworker/u8:0+flush-179:008:10:160
2104264995652,3cyclictest2155672-21kworker/u8:0+events_unbound10:00:251
2104264995648,6cyclictest2189358-21kworker/u8:1+events_unbound11:50:201
2104264995545,4cyclictest2168416-21kworker/u8:0+events_unbound10:45:201
2104262995549,4cyclictest2201603-21kworker/u8:3+events_unbound12:25:220
2104262995549,4cyclictest2176618-21kworker/u8:1+events_unbound11:15:010
2104262995549,4cyclictest2125217-21kworker/u8:2+flush-179:008:50:160
2104264995450,3cyclictest2112383-21kworker/u8:2+events_unbound07:40:211
2104264995449,4cyclictest2137635-21kworker/u8:1+flush-179:009:10:221
2104264995448,5cyclictest2141341-21kworker/u8:0+events_unbound09:05:201
2104264995441,11cyclictest2201603-21kworker/u8:3+flush-179:012:15:011
2104262995449,3cyclictest2155672-21kworker/u8:0+events_unbound09:50:200
2104264995349,3cyclictest2178287-21kworker/u8:0+flush-179:011:40:231
2104264995349,3cyclictest2147715-21kworker/u8:0+flush-179:009:35:221
2104264995348,4cyclictest2102884-21kworker/u8:1+events_unbound07:10:241
2104264995342,8cyclictest2154106-21latency_hist09:45:011
2104262995348,4cyclictest2155672-21kworker/u8:0+flush-179:010:00:160
2104262995348,4cyclictest2107445-21kworker/u8:2+flush-179:007:20:200
2104262995345,6cyclictest714-21Xorg09:29:590
2104262995345,6cyclictest2146146-21latency_hist09:20:010
2104262995344,7cyclictest2178293-21kworker/u8:3+flush-179:011:20:210
2104262995341,10cyclictest2122256-21apt-get08:05:110
2104262995247,4cyclictest2197312-21kworker/u8:1+flush-179:012:05:210
2104262995243,7cyclictest2189358-21kworker/u8:1+events_unbound11:50:130
2104262995243,7cyclictest2170016-21latency_hist10:35:010
2104262995145,5cyclictest2206936-21kworker/u8:1+flush-179:012:30:210
4577091500,14ptp4l61490irq/134-eno1-TxRx-007:09:593
2104262995041,7cyclictest2144536-21latency_hist09:15:000
2104264994945,3cyclictest2161380-21kworker/u8:3+events_unbound10:25:191
2104262994942,6cyclictest2112383-21kworker/u8:2+flush-179:007:40:200
2104262994842,4cyclictest2102884-21kworker/u8:1+flush-179:007:10:180
2104262994841,6cyclictest2161380-21kworker/u8:3+events_unbound10:10:140
2104262994838,7cyclictest2112407-21latency_hist07:35:010
2104264994744,2cyclictest714-21Xorg11:55:581
2104264994742,4cyclictest2130616-21kworker/u8:0+events_unbound08:30:201
2104262994742,4cyclictest2106354-21kworker/u8:0+flush-179:007:50:290
2104262994642,3cyclictest2176618-21kworker/u8:1+flush-179:011:05:250
2104262994642,3cyclictest2135587-21kworker/u8:0+events_unbound08:55:240
2104262994641,3cyclictest2091304-21kworker/u8:3+flush-179:007:25:210
2104262994640,5cyclictest2144571-21kworker/u8:3+flush-179:009:20:220
2104264994541,3cyclictest2178293-21kworker/u8:3+flush-179:011:10:221
2104262994543,2cyclictest2147726-21kworker/u8:2+events_unbound09:45:220
2104262994540,3cyclictest2205352-21systemd-run12:24:590
2104262994539,5cyclictest2176618-21kworker/u8:1+flush-179:011:00:220
2104264994439,4cyclictest2161380-21kworker/u8:3+flush-179:010:30:271
2104264994439,4cyclictest2110796-21kworker/u8:1+flush-179:007:30:271
2104264994433,4cyclictest2102884-21kworker/u8:1+events_unbound07:15:121
2104264994339,3cyclictest2201603-21kworker/u8:3+flush-179:012:25:421
2104262994340,2cyclictest2168464-21kworker/u8:2+events_unbound10:55:250
2104262994338,4cyclictest2147715-21kworker/u8:0+flush-179:009:40:200
2104262994338,4cyclictest2131578-21kworker/u8:3+flush-179:008:40:230
2104262994337,5cyclictest2155672-21kworker/u8:0+flush-179:009:55:220
2104262994337,4cyclictest2116947-21expr07:45:220
4577091420,6ptp4l431rcuc/312:35:013
210426899420,40cyclictest2107383-21turbostat07:20:013
2104262994236,5cyclictest2195155-21kworker/u8:0+flush-179:012:15:220
2104262994236,5cyclictest2195155-21kworker/u8:0+flush-179:012:00:210
2104262994236,4cyclictest2171861-21/usr/sbin/munin10:40:160
2104268994134,5cyclictest2141374-21turbostat09:05:013
2104267994138,2cyclictest0-21swapper/212:11:582
2104267994138,2cyclictest0-21swapper/210:43:592
2104264994136,4cyclictest2147726-21kworker/u8:2+events_unbound09:45:201
2104264994132,7cyclictest2104162-21latency_hist07:10:021
210426899400,38cyclictest2117220-21turbostat07:50:013
210426899400,38cyclictest2115640-21turbostat07:45:003
2104268993932,6cyclictest2138180-21turbostat08:55:003
210426899390,38cyclictest2184632-21turbostat11:20:003
210426899390,37cyclictest2158868-21turbostat10:00:003
2104262993936,2cyclictest0-21swapper/010:51:000
210426799380,36cyclictest0-21swapper/210:28:592
210426799380,35cyclictest0-21swapper/209:29:562
2104262993832,4cyclictest2127445-21kworker/u8:1+flush-179:008:30:400
210426299380,37cyclictest0-21swapper/011:48:590
2104268993735,1cyclictest0-21swapper/309:30:593
2104268993734,2cyclictest0-21swapper/307:34:003
210426899370,35cyclictest0-21swapper/310:05:593
2104267993734,2cyclictest0-21swapper/212:25:002
2104267993734,2cyclictest0-21swapper/209:10:582
2104267993734,2cyclictest0-21swapper/207:29:592
210426799370,35cyclictest0-21swapper/210:19:592
210426799370,35cyclictest0-21swapper/210:19:592
210426799370,35cyclictest0-21swapper/207:32:582
2104262993732,4cyclictest2127445-21kworker/u8:1+flush-179:008:25:170
2104262993729,6cyclictest2141906-21diskstats09:05:150
4577091360,3ptp4l441ktimers/312:05:123
2104268993634,1cyclictest0-21swapper/311:54:593
2104268993634,1cyclictest0-21swapper/308:35:593
2104268993631,4cyclictest2157294-21turbostat09:55:003
2104268993631,4cyclictest2146154-21turbostat09:20:003
2104268993630,4cyclictest2210088-21turbostat12:40:013
210426899360,35cyclictest0-21swapper/310:49:563
210426899360,35cyclictest0-21swapper/308:49:003
210426899360,35cyclictest0-21swapper/308:13:583
210426899360,1cyclictest0-21swapper/311:12:593
210426899360,1cyclictest0-21swapper/309:35:593
210426899360,1cyclictest0-21swapper/309:23:003
2104267993633,2cyclictest0-21swapper/209:18:592
210426799360,1cyclictest0-21swapper/211:18:592
2104268993533,1cyclictest0-21swapper/312:16:003
2104268993533,1cyclictest0-21swapper/311:43:593
2104268993533,1cyclictest0-21swapper/310:04:593
2104268993533,1cyclictest0-21swapper/307:28:583
210426899350,34cyclictest0-21swapper/308:42:583
210426899350,1cyclictest0-21swapper/311:49:593
2104267993532,2cyclictest0-21swapper/211:51:582
2104267993532,2cyclictest0-21swapper/211:39:592
2104267993532,2cyclictest0-21swapper/210:05:592
210426799350,1cyclictest0-21swapper/208:50:002
2104264993531,2cyclictest2141395-21systemd-run09:05:001
2104268993432,1cyclictest0-21swapper/308:01:593
2104268993431,2cyclictest0-21swapper/310:14:593
2104268993431,2cyclictest0-21swapper/309:11:593
2104268993429,4cyclictest2181432-21turbostat11:10:013
2104267993431,2cyclictest0-21swapper/209:04:552
2104262993430,3cyclictest2102884-21kworker/u8:1+flush-179:007:15:230
2104268993331,1cyclictest0-21swapper/309:25:593
2104268993331,1cyclictest0-21swapper/308:59:593
2104267993331,1cyclictest0-21swapper/212:10:002
2104262993329,3cyclictest2165943-21hwlatdetect10:20:170
2104262993328,4cyclictest2106354-21kworker/u8:0+flush-179:008:20:150
2104268993230,1cyclictest0-21swapper/308:34:593
210426799320,30cyclictest0-21swapper/208:36:592
210426499321,29cyclictest0-21swapper/111:00:121
2104268993129,1cyclictest0-21swapper/310:15:593
2104268993129,1cyclictest0-21swapper/310:15:593
2104268993128,2cyclictest0-21swapper/310:41:593
2104267993129,1cyclictest0-21swapper/212:05:002
2104267993129,1cyclictest0-21swapper/211:45:002
2104267993129,1cyclictest0-21swapper/211:25:002
2104267993129,1cyclictest0-21swapper/210:55:002
2104267993128,2cyclictest0-21swapper/207:46:582
2104264993120,8cyclictest266-21systemd-journal07:30:001
2104262993125,5cyclictest2147726-21kworker/u8:2+flush-179:009:30:110
2104268993028,1cyclictest0-21swapper/309:40:593
2104268993027,2cyclictest0-21swapper/308:20:593
210426799300,2cyclictest0-21swapper/209:45:112
2104268992926,2cyclictest0-21swapper/311:20:143
210426899290,28cyclictest0-21swapper/308:25:143
210426899290,27cyclictest0-21swapper/311:55:143
210426899290,22cyclictest0-21swapper/307:10:153
210426899290,1cyclictest0-21swapper/309:05:133
2104267992926,2cyclictest0-21swapper/210:35:132
2104267992926,2cyclictest0-21swapper/208:05:112
2104267992925,2cyclictest0-21swapper/211:29:592
210426799290,28cyclictest0-21swapper/208:15:162
210426799290,28cyclictest0-21swapper/207:40:152
210426799290,27cyclictest0-21swapper/210:45:022
210426799290,27cyclictest0-21swapper/208:31:002
4577091280,7ptp4l61490irq/134-eno1-TxRx-012:15:013
2104268992826,1cyclictest0-21swapper/308:19:593
2104268992826,1cyclictest0-21swapper/307:20:123
2104268992825,2cyclictest0-21swapper/310:30:133
2104268992825,2cyclictest0-21swapper/307:55:133
210426899280,26cyclictest0-21swapper/311:25:143
210426899280,26cyclictest0-21swapper/310:20:143
210426899280,26cyclictest0-21swapper/307:35:143
2104267992826,1cyclictest0-21swapper/212:35:132
2104267992826,1cyclictest0-21swapper/212:00:002
2104267992825,2cyclictest0-21swapper/207:20:032
2104267992825,2cyclictest0-21swapper/207:17:592
210426799280,2cyclictest0-21swapper/208:45:002
4577091270,7ptp4l441ktimers/312:04:593
4577091270,6ptp4l441ktimers/312:30:003
4577091270,5ptp4l441ktimers/312:24:593
2104268992725,1cyclictest0-21swapper/310:58:593
210426899270,26cyclictest0-21swapper/311:01:593
210426899270,26cyclictest0-21swapper/310:25:143
210426899270,1cyclictest0-21swapper/310:51:593
2104267992724,2cyclictest0-21swapper/209:42:592
210426799270,25cyclictest0-21swapper/209:08:592
210426799270,1cyclictest0-21swapper/208:21:592
210426799270,1cyclictest0-21swapper/207:10:162
4577091260,6ptp4l61490irq/134-eno1-TxRx-007:54:573
4577091260,6ptp4l441ktimers/311:40:003
4577091260,4ptp4l441ktimers/311:35:013
2104267992623,2cyclictest0-21swapper/212:32:592
2104267992623,2cyclictest0-21swapper/212:25:582
210426799260,2cyclictest0-21swapper/211:00:592
210426799260,2cyclictest0-21swapper/210:56:582
210426799260,2cyclictest0-21swapper/209:24:552
210426799260,2cyclictest0-21swapper/208:26:582
210426799260,24cyclictest0-21swapper/211:06:592
210426799260,24cyclictest0-21swapper/210:24:562
210426799260,24cyclictest0-21swapper/208:00:452
210426799260,24cyclictest0-21swapper/207:56:562
210426799260,24cyclictest0-21swapper/207:35:442
2104262992622,2cyclictest2184630-21latency_hist11:20:010
4577091250,5ptp4l61490irq/134-eno1-TxRx-009:49:553
231999250,12rtkit-daemon685-21snmpd07:05:300
210426899250,24cyclictest0-21swapper/308:07:303
2104267992522,2cyclictest0-21swapper/211:47:002
2104267992521,2cyclictest0-21swapper/208:54:562
210426799250,23cyclictest0-21swapper/210:04:592
2104267992421,2cyclictest0-21swapper/208:58:592
2104267992420,2cyclictest0-21swapper/209:52:592
210426799240,1cyclictest0-21swapper/209:34:592
210426799240,1cyclictest0-21swapper/207:51:142
2104267992320,2cyclictest0-21swapper/209:55:592
2104267992319,2cyclictest0-21swapper/208:11:592
2104267992219,2cyclictest0-21swapper/212:15:132
2104267992117,2cyclictest0-21swapper/210:34:552
2104267991614,1cyclictest0-21swapper/209:39:592
4577091140,3ptp4l61490irq/134-eno1-TxRx-010:35:193
210426799119,1cyclictest0-21swapper/211:32:002
21042679980,7cyclictest0-21swapper/210:10:342
21042679930,2cyclictest0-21swapper/207:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional