You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 20:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackbslot1.osadl.org (updated Sun Nov 23, 2025 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20700212221165,14sleep10-21swapper/107:08:151
20699862220192,18sleep30-21swapper/307:07:483
20700892188165,13sleep00-21swapper/007:09:050
20699332186156,20sleep20-21swapper/207:07:112
209713921340,1sleep1271rcuc/107:35:051
2070355991011,98cyclictest2231737-21chrome09:45:012
2070353997061,6cyclictest2200040-31munin-html09:10:341
2070353996860,6cyclictest2293369-21/usr/share/muni10:45:211
2070355996663,2cyclictest2344444-21kworker/u8:0+flush-179:012:00:152
2070355996258,3cyclictest2138447-21kworker/u8:3+flush-179:009:05:112
2070352996157,3cyclictest2252188-21cat10:05:010
2070355995956,2cyclictest2344444-21kworker/u8:0+flush-179:011:40:352
2070355995955,3cyclictest2179523-21kworker/u8:0+flush-179:009:10:312
2070352995752,3cyclictest2279241-21ntpq10:30:140
2070352995749,6cyclictest2267728-21/usr/share/muni10:20:200
2070355995651,4cyclictest2205440-21kworker/u8:5+flush-179:009:45:012
207035299565,51cyclictest2028984-21kworker/u8:1+efi_rts_wq08:08:170
2070355995551,3cyclictest2169438-21kworker/u8:4+flush-179:009:30:092
2070352995552,2cyclictest2276690-21kworker/u8:1+flush-179:010:30:000
2070355995451,2cyclictest2344444-21kworker/u8:0+flush-179:012:20:202
2070355995450,3cyclictest2231099-21kworker/u8:0+flush-179:010:10:382
2070355995450,3cyclictest2231099-21kworker/u8:0+events_unbound10:55:012
2070352995448,5cyclictest2112631-21/usr/share/muni07:50:090
2070358995343,8cyclictest2408253-21/usr/share/muni12:35:113
2070355995349,3cyclictest2231099-21kworker/u8:0+flush-179:009:50:322
2070358995246,4cyclictest2086843-21/usr/share/muni07:25:143
2070355995250,2cyclictest2028984-21kworker/u8:1+flush-179:007:55:292
2070355995249,2cyclictest2344444-21kworker/u8:0+flush-179:012:15:282
2070355995249,2cyclictest2231099-21kworker/u8:0+flush-179:010:15:422
2070355995248,3cyclictest2085671-21kworker/u8:3+flush-179:007:40:202
2070355995247,3cyclictest2145451-21apt-get08:20:142
2070355995247,3cyclictest2145451-21apt-get08:20:142
2070353995248,3cyclictest2303260-21kworker/u8:1+flush-179:011:00:151
2070358995148,2cyclictest2169438-21kworker/u8:4+flush-179:008:55:333
2070358995147,3cyclictest2074624-31munin-html07:10:353
2070358995147,2cyclictest2231771-21/usr/share/muni09:45:013
2070355995148,2cyclictest2179523-21kworker/u8:0+flush-179:009:25:372
2070355995147,3cyclictest2344444-21kworker/u8:0+flush-179:012:10:222
2070355995147,3cyclictest2080419-21kworker/u8:0+events_unbound08:25:072
2070353995147,3cyclictest2360774-21kworker/u8:4+events_unbound11:55:181
2070353995146,3cyclictest2231099-21kworker/u8:0+events_unbound10:30:101
2070352995148,2cyclictest2329808-21kworker/u8:3+flush-179:011:20:350
207035899503,46cyclictest2028984-21kworker/u8:1+efi_rts_wq08:08:153
2070355995048,2cyclictest2256838-21kworker/u8:3+flush-179:010:47:582
2070355995047,2cyclictest2096412-21kworker/u8:4+flush-179:007:47:562
2070355995047,2cyclictest2080419-21kworker/u8:0+flush-179:008:30:322
207035599503,47cyclictest2028984-21kworker/u8:1+efi_rts_wq08:08:172
2070352995045,4cyclictest2323571-31munin-html11:10:350
2070358994944,4cyclictest2216358-21/usr/share/muni09:30:133
2070355994946,2cyclictest2072053-21kworker/u8:2+events_unbound07:10:212
2070355994945,3cyclictest2246631-21kworker/u8:2+flush-179:010:05:262
2070355994923,25cyclictest2179523-21kworker/u8:0+flush-179:009:20:092
2070353994944,4cyclictest2153531-31munin-html08:25:351
2070355994846,2cyclictest2048797-21kworker/u8:4+flush-179:007:20:162
2070355994845,2cyclictest2169438-21kworker/u8:4+events_unbound08:53:542
2070355994844,3cyclictest2303260-21kworker/u8:1+flush-179:011:30:212
2070355994844,3cyclictest2138447-21kworker/u8:3+flush-179:009:00:292
2070353994842,5cyclictest247560-21ThreadPoolForeg11:50:141
2070358994743,3cyclictest2075601-21/usr/share/muni07:15:043
2070358994742,4cyclictest2326227-21apt-get11:15:133
2070355994744,2cyclictest2344444-21kworker/u8:0+events_unbound11:45:052
2070355994743,3cyclictest2397159-21kworker/u8:4+flush-179:012:30:102
2070353994743,3cyclictest2303260-21kworker/u8:1+flush-179:011:35:311
2070353994743,3cyclictest2138447-21kworker/u8:3+flush-179:008:20:101
2070353994743,3cyclictest2138447-21kworker/u8:3+flush-179:008:20:101
2070358994643,2cyclictest2220933-21kworker/u8:1+flush-179:009:55:293
2070358994629,15cyclictest2271839-21munin-limits10:20:353
2070355994643,2cyclictest2231099-21kworker/u8:0+events_unbound10:00:192
2070355994643,2cyclictest2179523-21kworker/u8:0+events_unbound08:55:022
2070353994642,3cyclictest2233110-21ThreadPoolForeg09:45:161
2070353994641,3cyclictest2344476-21munin-limits11:30:371
2070353994641,3cyclictest2179523-21kworker/u8:0+events_unbound09:19:471
2070352994640,5cyclictest2140343-21ntpq08:15:160
2070358994542,2cyclictest2282032-31munin-html10:30:353
2070358994541,3cyclictest2231099-21kworker/u8:0+flush-179:010:05:163
2070358994541,3cyclictest2085671-21kworker/u8:3+events_unbound07:40:143
2070355994543,2cyclictest2303260-21kworker/u8:1+flush-179:011:35:192
2070355994543,2cyclictest2096412-21kworker/u8:4+flush-179:007:50:202
2070355994542,2cyclictest2344444-21kworker/u8:0+flush-179:012:25:162
2070355994542,2cyclictest2344444-21kworker/u8:0+events_unbound12:35:192
2070355994542,2cyclictest2282389-21kworker/u8:2+flush-179:010:40:172
2070355994542,2cyclictest2170353-21kworker/2:1+pm09:36:172
2070355994540,4cyclictest2138447-21kworker/u8:3+events_unbound08:13:342
2070353994540,4cyclictest2114128-21ntpq07:50:161
2070353994529,14cyclictest2185681-21/usr/share/muni09:00:041
2070352994542,2cyclictest2122622-21kworker/u8:2+flush-179:008:00:280
2070352994542,2cyclictest2122622-21kworker/u8:2+flush-179:008:00:280
2070352994541,3cyclictest2366267-21apt-get11:55:000
2070358994441,2cyclictest2205440-21kworker/u8:5+flush-179:009:35:153
2070358994440,2cyclictest2355981-21snmp_wanpowerct11:45:013
2070355994441,2cyclictest2256844-21kworker/u8:4+events_unbound10:20:252
2070355994441,2cyclictest2080419-21kworker/u8:0+flush-179:007:15:372
2070353994441,2cyclictest2138447-21kworker/u8:3+flush-179:008:35:271
2070353994440,3cyclictest2179523-21kworker/u8:0+flush-179:009:24:231
2070353994438,4cyclictest2256805-31munin-graph10:06:131
2070353994436,7cyclictest2303260-21kworker/u8:1+flush-179:011:10:231
207035299449,34cyclictest99883-21in:imklog12:25:220
2070352994433,7cyclictest2179166-31munin-html08:50:350
2070358994340,2cyclictest2028984-21kworker/u8:1+flush-179:008:00:193
2070358994340,2cyclictest2028984-21kworker/u8:1+flush-179:008:00:183
2070358994339,3cyclictest2329808-21kworker/u8:3+flush-179:011:40:173
2070358994339,3cyclictest2202195-21apt-get09:15:133
2070358994339,3cyclictest2144407-21kworker/u8:2+events_unbound08:30:353
2070355994341,2cyclictest2080419-21kworker/u8:0+flush-179:007:30:202
2070355994340,2cyclictest2303260-21kworker/u8:1+events_unbound11:15:042
2070355994339,3cyclictest2231099-21kworker/u8:0+flush-179:009:59:002
2070355994339,3cyclictest2138447-21kworker/u8:3+flush-179:008:45:152
2070355994336,2cyclictest2360771-21kworker/u8:2+flush-179:011:53:352
2070353994340,2cyclictest2080419-21kworker/u8:0+flush-179:007:30:191
2070353994327,15cyclictest76405-21systemd-journal12:30:001
2070358994239,2cyclictest2282389-21kworker/u8:2+flush-179:011:20:363
2070358994239,2cyclictest2028984-21kworker/u8:1+flush-179:007:50:373
2070358994237,4cyclictest2179904-21latency_hist08:55:013
207035899420,2cyclictest1254-21openvpn11:35:143
2070353994235,5cyclictest1634485-21apache212:00:181
2070352994240,2cyclictest2303260-21kworker/u8:1+events_unbound11:09:000
2070352994240,2cyclictest2231099-21kworker/u8:0+events_unbound10:08:540
2070352994239,3cyclictest2282389-21kworker/u8:2+events_unbound11:17:300
2070355994139,2cyclictest2276690-21kworker/u8:1+events_unbound10:39:502
2070355994138,2cyclictest2256844-21kworker/u8:4+flush-179:010:25:102
2070355994137,3cyclictest3125688-21Chrome_ChildIOT11:25:112
2070355994128,13cyclictest2278254-21kworker/2:2+pm11:07:482
2070353994137,3cyclictest2256838-21kworker/u8:3+flush-179:010:20:061
2070352994139,2cyclictest2256838-21kworker/u8:3+events_unbound11:04:240
2070352994137,3cyclictest2256838-21kworker/u8:3+flush-179:010:40:120
2070355994039,1cyclictest971910-1kworker/2:1H+kblockd08:44:542
2070355994037,2cyclictest2278254-21kworker/2:2+pm10:56:032
2070355994037,2cyclictest2028984-21kworker/u8:1+events_unbound07:39:262
2070355994036,3cyclictest2122622-21kworker/u8:2+events_unbound08:00:372
2070355994036,3cyclictest2122622-21kworker/u8:2+events_unbound08:00:362
2070353994036,3cyclictest2138447-21kworker/u8:3+events_unbound08:30:101
2070353994032,7cyclictest2179523-21kworker/u8:0+flush-179:009:25:321
2070352994038,2cyclictest2080419-21kworker/u8:0+events_unbound07:44:150
2070352994037,2cyclictest2360774-21kworker/u8:4+events_unbound11:49:100
2070352994035,4cyclictest247560-21ThreadPoolForeg09:00:540
2070352994035,4cyclictest2256838-21kworker/u8:3+flush-179:010:11:380
2070352994035,4cyclictest2226580-21/usr/share/muni09:40:160
2070352994035,4cyclictest2192018-21apt-get09:05:130
2070352994022,17cyclictest3125725-21ThreadPoolForeg07:49:490
2070358993936,2cyclictest2344444-21kworker/u8:0+flush-179:012:00:113
2070358993936,2cyclictest2303260-21kworker/u8:1+events_unbound11:29:523
2070358993936,2cyclictest2282389-21kworker/u8:2+flush-179:010:55:073
2070358993933,4cyclictest2398056-21/usr/share/muni12:25:183
2070355993936,2cyclictest2360774-21kworker/u8:4+events_unbound12:05:342
2070355993936,2cyclictest2278254-21kworker/2:2+pm11:10:122
2070355993936,2cyclictest2278254-21kworker/2:2+pm11:03:502
2070355993936,2cyclictest2138447-21kworker/u8:3+flush-179:009:15:362
2070355993936,2cyclictest2138447-21kworker/u8:3+flush-179:008:35:122
2070355993936,2cyclictest2056686-21kworker/2:2+pm07:28:252
2070353993934,4cyclictest2107347-21ThreadPoolForeg07:45:031
2070352993937,2cyclictest2231099-21kworker/u8:0+events_unbound10:18:570
2070352993937,1cyclictest1680882-1kworker/0:0H+kblockd10:35:170
2070352993935,3cyclictest2080419-21kworker/u8:0+flush-179:008:11:030
2070352993934,4cyclictest2299850-21ntpq10:50:160
2070352993934,3cyclictest1680882-1kworker/0:0H+kblockd07:10:040
2070352993933,4cyclictest2211249-21/usr/share/muni09:25:040
2070358993836,1cyclictest2308753-21kworker/3:1+pm11:54:453
2070358993835,2cyclictest247563-13Compositor10:02:333
2070358993834,3cyclictest247560-21ThreadPoolForeg11:04:183
2070358993832,4cyclictest2241499-31munin-graph09:51:113
2070358993832,2cyclictest2096412-21kworker/u8:4+flush-179:008:25:173
2070358993824,13cyclictest247468-13Chrome_IOThread10:53:023
2070358993823,13cyclictest247515-21ThreadPoolForeg08:35:343
2070355993836,2cyclictest2282389-21kworker/u8:2+events_unbound11:20:112
2070355993835,2cyclictest2170353-21kworker/2:1+pm10:30:052
2070355993833,4cyclictest2142987-21munin-limits08:15:332
2070353993834,3cyclictest2246631-21kworker/u8:2+flush-179:009:57:281
2070353993834,3cyclictest2205440-21kworker/u8:5+flush-179:009:35:321
2070353993834,3cyclictest2179523-21kworker/u8:0+flush-179:009:05:171
2070353993834,3cyclictest2169438-21kworker/u8:4+flush-179:009:33:151
2070353993834,3cyclictest2080419-21kworker/u8:0+flush-179:008:04:021
2070353993834,3cyclictest2080419-21kworker/u8:0+flush-179:008:04:011
2070353993834,3cyclictest2028984-21kworker/u8:1+flush-179:007:10:311
2070353993832,4cyclictest2324828-21/usr/share/muni11:15:021
2070352993836,2cyclictest2220933-21kworker/u8:1+events_unbound09:38:190
2070352993836,2cyclictest2096412-21kworker/u8:4+events_unbound08:25:300
2070352993836,1cyclictest2303054-21kworker/0:0+pm11:36:550
2070352993835,2cyclictest2303054-21kworker/0:0+pm12:13:200
2070352993834,2cyclictest1680882-1kworker/0:0H+kblockd09:31:390
2070352993833,4cyclictest247560-21ThreadPoolForeg11:33:490
2070352993831,5cyclictest2403151-21/usr/share/muni12:30:030
207035299381,34cyclictest3125709-13VizCompositorTh10:45:250
2070358993735,1cyclictest1930199-1kworker/3:2H+kblockd09:08:013
2070358993734,2cyclictest3125727-21ThreadPoolForeg10:10:283
2070358993734,2cyclictest2122622-21kworker/u8:2+flush-179:008:10:193
2070358993734,2cyclictest1930199-1kworker/3:2H+kblockd12:20:363
2070358993733,3cyclictest2256838-21kworker/u8:3+events_unbound10:47:473
2070353993734,2cyclictest2276690-21kworker/u8:1+flush-179:010:42:241
2070353993734,2cyclictest1815724-1kworker/1:2H+kblockd10:25:031
2070353993734,2cyclictest1815724-1kworker/1:2H+kblockd10:15:341
2070353993734,2cyclictest1815724-1kworker/1:2H+kblockd07:28:511
2070353993734,2cyclictest1815724-1kworker/1:2H+kblockd07:17:071
2070353993733,3cyclictest2231099-21kworker/u8:0+flush-179:010:55:331
2070353993733,3cyclictest2028984-21kworker/u8:1+flush-179:007:20:211
2070353993731,5cyclictest3125725-21ThreadPoolForeg08:10:311
2070352993735,2cyclictest2329808-21kworker/u8:3+events_unbound11:42:050
2070352993735,1cyclictest1680882-1kworker/0:0H+kblockd12:38:380
2070352993734,2cyclictest2360774-21kworker/u8:4+events_unbound12:02:380
2070352993734,2cyclictest1680882-1kworker/0:0H+kblockd10:56:040
2070352993734,2cyclictest1680882-1kworker/0:0H+kblockd08:33:310
2070352993734,2cyclictest1680882-1kworker/0:0H+kblockd07:26:040
2070352993734,2cyclictest1680882-1kworker/0:0H+kblockd07:15:170
2070352993734,1cyclictest1680882-1kworker/0:0H+kblockd09:55:010
2070352993733,2cyclictest1680882-1kworker/0:0H+kblockd07:37:060
2070352993732,4cyclictest2210343-21munin-limits09:20:320
2070352993731,5cyclictest247560-21ThreadPoolForeg09:45:230
2070358993634,1cyclictest1930199-1kworker/3:2H+kblockd12:15:043
2070358993634,1cyclictest1930199-1kworker/3:2H+kblockd09:12:443
2070358993634,1cyclictest1930199-1kworker/3:2H+kblockd08:41:353
2070358993633,2cyclictest1930199-1kworker/3:2H+kblockd12:05:573
2070358993633,2cyclictest1930199-1kworker/3:2H+kblockd11:11:293
2070358993633,2cyclictest1930199-1kworker/3:2H+kblockd10:41:313
2070358993632,3cyclictest2360774-21kworker/u8:4+flush-179:011:55:023
2070358993632,3cyclictest2282389-21kworker/u8:2+events_unbound10:35:013
2070358993632,2cyclictest1930199-1kworker/3:2H+kblockd09:00:163
2070355993634,1cyclictest2278254-21kworker/2:2+pm11:55:322
2070353993634,1cyclictest2355979-21snmp_wanswitch.11:45:021
2070353993634,1cyclictest2091743-21kworker/1:0+pm07:44:311
2070353993634,1cyclictest1815724-1kworker/1:2H+kblockd12:15:161
2070353993634,1cyclictest1815724-1kworker/1:2H+kblockd11:20:301
2070353993634,1cyclictest1815724-1kworker/1:2H+kblockd10:11:121
2070353993634,1cyclictest1815724-1kworker/1:2H+kblockd08:45:111
2070353993633,2cyclictest2344444-21kworker/u8:0+events_unbound12:20:191
2070353993633,2cyclictest1815724-1kworker/1:2H+kblockd08:08:361
2070353993632,3cyclictest2138447-21kworker/u8:3+flush-179:008:55:111
2070353993631,4cyclictest2378353-21apt-get12:05:131
2070352993634,1cyclictest1680882-1kworker/0:0H+kblockd08:40:300
2070352993634,1cyclictest1680882-1kworker/0:0H+kblockd08:20:060
2070352993634,1cyclictest1680882-1kworker/0:0H+kblockd08:20:050
2070352993633,2cyclictest2205440-21kworker/u8:5+events_unbound09:59:190
2070352993632,2cyclictest1680882-1kworker/0:0H+kblockd12:21:100
2070352993630,5cyclictest2081751-21/usr/share/muni07:20:020
2070358993533,1cyclictest1930199-1kworker/3:2H+kblockd07:21:093
2070358993532,2cyclictest2096412-21kworker/u8:4+flush-179:007:47:113
2070358993532,2cyclictest1930199-1kworker/3:2H+kblockd07:36:283
2070358993532,2cyclictest1930199-1kworker/3:2H+kblockd07:30:573
2070358993531,3cyclictest2344444-21kworker/u8:0+flush-179:012:10:313
2070358993530,4cyclictest247560-21ThreadPoolForeg08:22:443
2070358993530,4cyclictest247560-21ThreadPoolForeg08:22:433
2070353993533,1cyclictest1815724-1kworker/1:2H+kblockd09:50:161
2070353993532,2cyclictest2313727-21kworker/u8:4+flush-179:011:05:071
2070353993530,4cyclictest2407635-31munin-graph12:30:531
2070353993530,3cyclictest2246968-21munin-update10:00:341
2070353993529,5cyclictest3125724-21ThreadPoolForeg07:55:201
2070353993520,13cyclictest1260-21snmpd08:44:231
2070352993532,2cyclictest3125624-21chromedriver08:55:320
2070352993532,2cyclictest1680882-1kworker/0:0H+kblockd09:16:010
2070352993531,3cyclictest2360774-21kworker/u8:4+flush-179:011:57:020
2070352993531,3cyclictest2144407-21kworker/u8:2+flush-179:008:45:310
2070352993531,2cyclictest1680882-1kworker/0:0H+kblockd07:55:590
2070352993530,4cyclictest2335305-21sshd11:25:030
2070352993529,5cyclictest2391447-31munin-html12:15:370
2070358993432,2cyclictest2344444-21kworker/u8:0+flush-179:012:30:333
2070358993432,1cyclictest1930199-1kworker/3:2H+kblockd10:15:063
2070358993432,1cyclictest1930199-1kworker/3:2H+kblockd08:17:443
2070358993431,2cyclictest3125721-21chrome11:33:303
2070358993430,3cyclictest2226576-21/usr/share/muni09:40:123
2070358993430,3cyclictest2169438-21kworker/u8:4+flush-179:008:49:293
2070353993431,2cyclictest1815724-1kworker/1:2H+kblockd10:51:371
2070353993430,3cyclictest2256838-21kworker/u8:3+flush-179:010:38:491
207035399341,32cyclictest3125721-21chrome12:10:161
2070352993432,1cyclictest1680882-1kworker/0:0H+kblockd07:31:150
2070352993431,2cyclictest1260-21snmpd09:10:450
2070352993430,3cyclictest2080419-21kworker/u8:0+events_unbound08:37:410
2070358993332,1cyclictest1930199-1kworker/3:2H+kblockd11:07:563
2070358993330,2cyclictest1260-21snmpd09:25:153
2070358993330,2cyclictest1260-21snmpd07:55:193
207035399338,24cyclictest3125728-13Compositor11:40:411
2070353993330,2cyclictest2397159-21kworker/u8:4+events_unbound12:35:141
2070353993321,2cyclictest247545-13VizCompositorTh11:25:191
2070353993230,1cyclictest2169438-21kworker/u8:4+events_unbound08:50:091
2070353993229,2cyclictest1815724-1kworker/1:2H+kblockd08:15:361
2070352993229,2cyclictest1680882-1kworker/0:0H+kblockd12:06:220
2070358993129,1cyclictest1930199-1kworker/3:2H+kblockd09:20:143
2070358993129,1cyclictest1260-21snmpd10:25:363
2070353992825,2cyclictest247562-13Chrome_ChildIOT09:41:411
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional