You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 06:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot0.osadl.org (updated Thu Nov 20, 2025 00:45:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
211899245,11cyclictest0-21swapper/119:45:191
212599220,18cyclictest0-21swapper/222:43:582
211899221,18cyclictest0-21swapper/122:20:011
211899214,16cyclictest0-21swapper/119:33:351
211899212,3cyclictest0-21swapper/123:48:141
211899212,16cyclictest4581-21H212:26:331
2113992113,1cyclictest0-21swapper/000:15:160
2125992011,8cyclictest0-21swapper/200:15:162
211899204,15cyclictest21-21ksoftirqd/121:21:241
211899204,15cyclictest0-21swapper/119:35:121
211899201,18cyclictest16260-21smartctl23:50:221
211899200,5cyclictest0-21swapper/121:39:421
211899200,2cyclictest30149-21latency_hist20:30:011
212599192,16cyclictest31611-21cut22:25:142
2125991916,2cyclictest29536-21sh23:17:002
212599190,16cyclictest4534-21H212:26:332
212599190,16cyclictest4534-21H212:26:332
211899193,15cyclictest0-21swapper/120:45:001
211899192,16cyclictest0-21swapper/121:34:051
211899192,15cyclictest0-21swapper/123:05:041
211899190,5cyclictest0-21swapper/122:40:161
211899190,2cyclictest4593-21H212:26:331
211399193,15cyclictest0-21swapper/021:20:130
2113991914,1cyclictest0-21swapper/022:25:120
2113991913,3cyclictest15714-21tr21:00:140
211399190,18cyclictest0-21swapper/019:27:590
2125991817,1cyclictest28-21ksoftirqd/222:20:202
2125991816,1cyclictest0-21swapper/219:55:102
2125991816,1cyclictest0-21swapper/200:10:002
2125991815,2cyclictest921-21in:imklog21:02:182
2125991814,3cyclictest4593-21H212:26:332
2125991814,3cyclictest4593-21H212:26:332
2125991814,3cyclictest4534-21H212:26:332
2125991814,3cyclictest4532-21H212:26:332
212599181,2cyclictest13442-21timerandwakeup21:50:222
2125991810,4cyclictest0-21swapper/220:07:252
212599180,3cyclictest0-21swapper/221:05:162
212599180,2cyclictest5776-21irqstats22:35:162
212599180,2cyclictest4532-21H212:26:332
212599180,2cyclictest4526-21H212:26:332
212599180,16cyclictest4593-21H212:26:332
212599180,16cyclictest4532-21H212:26:332
212599180,16cyclictest4530-21H212:26:332
212599180,15cyclictest4581-21H212:26:332
211899183,1cyclictest0-21swapper/120:59:131
211899182,15cyclictest10770-21/usr/sbin/munin23:40:151
211899182,15cyclictest0-21swapper/122:26:351
2118991816,1cyclictest21-21ksoftirqd/100:06:181
2118991815,2cyclictest995-21irqbalance22:45:421
2118991814,3cyclictest4532-21H212:26:331
211899180,17cyclictest4526-21H212:26:331
2113991814,3cyclictest4536-21H212:26:330
2113991814,3cyclictest4536-21H212:26:330
2113991814,3cyclictest4534-21H212:26:330
2113991814,2cyclictest4532-21H212:26:330
2113991814,2cyclictest15400-21munin-plugin-st21:00:010
211399181,2cyclictest4530-21H212:26:330
211399181,1cyclictest4534-21H212:26:330
211399180,3cyclictest4530-21H212:26:330
211399180,16cyclictest1845-21systemd-journal20:35:020
211399180,15cyclictest4534-21H212:26:330
212599172,1cyclictest0-21swapper/221:45:122
2125991715,1cyclictest64412sleep220:43:482
2125991715,1cyclictest28-21ksoftirqd/222:30:052
2125991715,1cyclictest0-21swapper/220:20:222
2125991714,2cyclictest7698-21nfsd423:35:172
2125991714,2cyclictest4593-21H212:26:332
2125991714,2cyclictest4536-21H212:26:332
2125991714,2cyclictest4536-21H212:26:332
2125991714,2cyclictest4536-21H212:26:332
2125991714,2cyclictest32374-21expr21:30:122
2125991714,2cyclictest11555-21ps20:50:222
2125991713,3cyclictest4593-21H212:26:332
2125991713,3cyclictest4532-21H212:26:332
212599170,2cyclictest5400-21cron19:30:012
212599170,2cyclictest4536-21H212:26:332
212599170,2cyclictest4523-21H212:26:332
212599170,2cyclictest23721-21ntp_kernel_pll_20:15:202
212599170,2cyclictest17331-21grep22:00:152
212599170,2cyclictest17331-21grep22:00:152
212599170,1cyclictest4526-21H212:26:332
212599170,16cyclictest6295-21grep00:30:222
212599170,16cyclictest4528-21H212:26:332
212599170,16cyclictest4528-21H212:26:332
212599170,16cyclictest4523-21H212:26:332
212599170,16cyclictest4095-21timerwakeupswit00:25:212
212599170,16cyclictest25375-21ps21:15:192
212599170,16cyclictest1845-21systemd-journal23:09:002
211899172,1cyclictest0-21swapper/120:02:191
2118991715,1cyclictest3830-21cpuspeed_turbos23:30:141
2118991714,2cyclictest9287-21apt-get20:50:011
2118991714,2cyclictest7670-21chrt19:42:131
2118991714,2cyclictest4025-21latency_hist19:20:011
2118991714,2cyclictest30001-21snapd21:02:201
2118991714,2cyclictest29682-21expr21:25:171
2118991714,2cyclictest25823-21which20:20:181
2118991714,2cyclictest21913-21cron20:15:011
2118991714,2cyclictest18659-21cron23:00:011
2118991714,2cyclictest16318-21uptime21:55:221
211899171,15cyclictest0-21swapper/122:35:151
211899170,3cyclictest893-21systemd-logind19:11:071
211899170,3cyclictest0-21swapper/120:50:231
211899170,2cyclictest9707-21cat21:45:141
211899170,2cyclictest7527-21awk21:40:161
211899170,2cyclictest6456-21cat00:30:221
211899170,2cyclictest4599-21chrt19:24:351
211899170,2cyclictest4581-21H212:26:331
211899170,2cyclictest3687-21taskset22:31:291
211899170,2cyclictest2863-21awk00:25:161
211899170,2cyclictest20381-21cat22:05:131
211899170,2cyclictest13078-21/usr/sbin/munin21:50:201
211899170,2cyclictest10586-21expr19:53:111
211899170,2cyclictest10586-21expr19:53:111
211899170,16cyclictest5113-21chrt19:26:021
211899170,16cyclictest4593-21H212:26:331
211899170,16cyclictest4593-21H212:26:331
211899170,16cyclictest4534-21H212:26:331
211899170,16cyclictest4532-21H212:26:331
211899170,16cyclictest32110-21pzem_power20:30:241
211899170,16cyclictest27482-21nvmesmart_nvme000:10:181
211899170,16cyclictest23446-21fw_packets22:10:121
211899170,16cyclictest22551-21grep20:15:151
211899170,16cyclictest21912-21sed21:10:181
211899170,16cyclictest21059-21cut21:10:011
211899170,16cyclictest20856-21expr00:00:131
211899170,16cyclictest19192-21cron20:10:001
2113991715,1cyclictest0-21swapper/019:48:570
2113991714,2cyclictest5822-21/usr/sbin/munin20:40:220
2113991714,2cyclictest4536-21H212:26:330
2113991714,2cyclictest31913-21grep20:30:210
2113991714,2cyclictest11540-21grep22:45:140
2113991714,2cyclictest10399-21cat23:40:130
2113991714,2cyclictest0-21swapper/023:32:530
2113991714,1cyclictest4536-21H212:26:330
211399171,15cyclictest19093-21cat21:05:160
211399171,15cyclictest0-21swapper/020:10:170
211399170,2cyclictest7493-21grep21:40:160
211399170,2cyclictest6919-21sort19:39:010
211399170,2cyclictest6408-21nfsd400:30:230
211399170,2cyclictest4593-21H212:26:330
211399170,2cyclictest4534-21H212:26:330
211399170,1cyclictest4581-21H212:26:330
211399170,1cyclictest0-21swapper/020:05:130
211399170,16cyclictest8835-21sort23:39:000
211399170,16cyclictest881-21avahi-daemon23:05:210
211399170,16cyclictest7685-21munin-run22:40:010
211399170,16cyclictest4593-21H212:26:330
211399170,16cyclictest4534-21H212:26:330
211399170,16cyclictest4528-21H212:26:330
211399170,16cyclictest4523-21H212:26:330
211399170,16cyclictest28980-21needreboot20:25:180
211399170,16cyclictest27980-21sed00:10:220
211399170,16cyclictest2167-21proc_pri23:25:220
211399170,16cyclictest21253-21ntp_states22:05:180
211399170,16cyclictest14689-21munin-run23:50:000
211399170,16cyclictest1086-21snmpd23:02:040
2125991614,1cyclictest0-21swapper/223:55:142
2125991614,1cyclictest0-21swapper/223:45:182
2125991614,1cyclictest0-21swapper/221:20:112
2125991614,1cyclictest0-21swapper/219:42:182
2125991614,1cyclictest0-21swapper/219:35:012
2125991614,1cyclictest0-21swapper/219:13:192
2125991613,2cyclictest1703-21http_loadtime20:35:162
212599160,2cyclictest20848-21latency22:05:162
212599160,1cyclictest4581-21H212:26:332
212599160,1cyclictest20251-21fschecks_count20:10:172
212599160,1cyclictest0-21swapper/221:40:212
212599160,15cyclictest14653-21cstates21:55:152
212599160,15cyclictest0-21swapper/219:39:022
212599160,14cyclictest0-21swapper/219:18:182
211899160,2cyclictest4534-21H212:26:331
211899160,1cyclictest0-21swapper/123:15:141
211899160,15cyclictest17238-21tr22:00:161
211899160,15cyclictest17238-21tr22:00:151
211899160,15cyclictest11203-21/usr/sbin/munin19:55:081
211899160,15cyclictest0-21swapper/123:25:041
211899160,15cyclictest0-21swapper/123:20:121
211899160,15cyclictest0-21swapper/122:20:191
2113991614,1cyclictest4526-21H212:26:330
2113991614,1cyclictest0-21swapper/023:55:170
2113991614,1cyclictest0-21swapper/022:15:170
2113991614,1cyclictest0-21swapper/022:00:160
2113991614,1cyclictest0-21swapper/022:00:150
2113991614,1cyclictest0-21swapper/021:45:090
2113991614,1cyclictest0-21swapper/019:25:000
2113991614,1cyclictest0-21swapper/019:15:010
2113991614,1cyclictest0-21swapper/000:20:190
2113991613,2cyclictest11789-21cpuspeed_turbos21:50:150
211399161,15cyclictest9-21ksoftirqd/022:50:100
211399160,2cyclictest27026-21cron23:15:010
211399160,15cyclictest4581-21H212:26:330
211399160,15cyclictest4534-21H212:26:330
211399160,15cyclictest4534-21H212:26:330
211399160,15cyclictest4534-21H212:26:330
211399160,15cyclictest23953-21awk22:10:150
211399160,15cyclictest14407-21cpu21:55:130
211399160,15cyclictest0-21swapper/020:50:160
211399160,15cyclictest0-21swapper/020:20:170
211399160,15cyclictest0-21swapper/019:35:010
211399160,14cyclictest0-21swapper/019:44:540
2125991514,1cyclictest0-21swapper/220:25:152
212599150,0cyclictest0-21swapper/219:21:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional