You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-04 - 08:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot0.osadl.org (updated Tue Nov 04, 2025 00:45:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16487992411,0cyclictest0-21swapper/222:12:412
16486992422,1cyclictest32509-21mii-tool20:35:171
1648799230,5cyclictest0-21swapper/221:16:202
1648799210,20cyclictest823-21systemd-network23:19:592
1648699210,3cyclictest0-21swapper/122:25:211
16487992017,2cyclictest31516-21munin-plugin-st20:35:012
1648799200,1cyclictest0-21swapper/222:43:572
1648599200,2cyclictest32001-21nvmesmart_nvme021:30:240
16487991917,1cyclictest0-21swapper/222:56:202
16487991917,1cyclictest0-21swapper/222:16:502
1648699193,1cyclictest0-21swapper/119:26:131
1648599190,18cyclictest0-21swapper/023:15:000
1648799182,2cyclictest20058-21chrt20:11:522
1648799182,15cyclictest32695-21latency20:35:172
1648799182,15cyclictest0-21swapper/220:06:282
16487991816,1cyclictest0-21swapper/219:10:192
16487991816,1cyclictest0-21swapper/200:29:272
16487991814,3cyclictest0-21swapper/220:40:232
1648799181,2cyclictest8908-21chrt19:51:182
1648799181,2cyclictest1603-21lxd22:26:572
1648799180,3cyclictest3355-21qmgr20:27:272
1648799180,1cyclictest0-21swapper/222:07:132
1648799180,17cyclictest0-21swapper/219:25:182
16486991816,1cyclictest0-21swapper/100:05:011
16486991814,3cyclictest0-21swapper/100:00:251
16485991816,1cyclictest0-21swapper/020:25:070
16485991815,2cyclictest5962-21cpuspeed_turbos20:45:150
16485991814,3cyclictest3707-21lxd23:16:560
16485991813,3cyclictest12527-21grep20:00:160
1648599180,3cyclictest823-21systemd-network19:20:070
1648599180,3cyclictest10359-21cpuspeed_turbos23:45:160
16487991715,1cyclictest0-21swapper/223:45:192
16487991715,1cyclictest0-21swapper/223:35:142
16487991715,1cyclictest0-21swapper/221:45:172
16487991714,2cyclictest5390-21cron00:35:012
16487991714,2cyclictest3695-21tune2fs00:30:152
16487991714,2cyclictest27151-21expr22:20:152
16487991714,2cyclictest25113-21munin-run23:15:012
16487991714,2cyclictest15398-21ntp_offset21:00:192
16487991714,2cyclictest15398-21ntp_offset21:00:192
16487991714,1cyclictest0-21swapper/221:30:172
1648799171,15cyclictest1175-21ntp_kernel_pll_22:30:222
1648799171,15cyclictest0-21swapper/220:25:012
1648799170,2cyclictest31731-21nfsd419:35:192
1648799170,2cyclictest30025-21snapd22:51:492
1648799170,2cyclictest29013-21idleruntime23:20:162
1648799170,2cyclictest24633-21expr00:10:172
1648799170,2cyclictest22073-21ls00:05:172
1648799170,2cyclictest21002-21ntp_kernel_pll_21:10:202
1648799170,2cyclictest20480-21df23:05:162
1648799170,2cyclictest16896-21expr21:05:142
1648799170,2cyclictest16374-21sed23:55:182
1648799170,16cyclictest6479-21fschecks_time20:45:172
1648799170,16cyclictest22571-21expr19:20:142
1648799170,16cyclictest18684-21pzem_energy23:00:242
1648799170,16cyclictest18400-21apache_processe00:00:152
1648799170,16cyclictest15383-21grep22:00:132
1648799170,16cyclictest14007-21sed23:50:182
1648799170,16cyclictest13992-21plymouth21:55:222
1648799170,16cyclictest10967-21latency_hist20:55:012
1648799170,16cyclictest0-21swapper/223:32:102
1648799170,16cyclictest0-21swapper/220:05:002
16486991714,2cyclictest25514-21apache_volume23:15:141
16486991714,2cyclictest17221-21cat19:10:171
16486991714,2cyclictest14764-21systemctl22:00:011
16486991713,3cyclictest2707-21lxd23:40:571
16486991713,3cyclictest2707-21lxd23:40:571
16486991713,1cyclictest0-21swapper/123:13:411
1648699170,2cyclictest30025-21snapd19:41:491
1648699170,2cyclictest29481-21expr20:30:151
1648699170,2cyclictest28040-21cat19:30:151
1648699170,2cyclictest1304-21lxd20:50:571
1648699170,2cyclictest11768-21expr22:50:141
1648699170,1cyclictest0-21swapper/120:20:221
1648699170,16cyclictest9613-21/usr/sbin/munin19:55:191
1648699170,16cyclictest8709-21cpuspeed_turbos22:45:141
1648699170,16cyclictest7193-21ntpq22:40:191
1648699170,16cyclictest454-21plymouthd21:20:191
1648699170,16cyclictest4536-21H212:26:331
1648699170,16cyclictest3726-21latency_hist21:40:001
1648699170,16cyclictest32313-21nfsd423:25:181
1648699170,16cyclictest30536-21sshd23:24:281
1648699170,16cyclictest25406-21processes22:15:231
1648699170,16cyclictest23819-21sendmail_mailqu19:20:221
1648699170,16cyclictest18528-21ls21:05:231
1648699170,16cyclictest11242-21/usr/sbin/munin20:55:231
1648699170,15cyclictest18100-21cpuspeed_turbos20:10:151
16485991714,2cyclictest995-21irqbalance21:45:430
16485991714,2cyclictest9535-21latency22:45:170
16485991714,2cyclictest7410-21sendmail_mailtr00:35:200
16485991714,2cyclictest3908-21cat22:35:190
16485991714,2cyclictest30083-21snapd23:02:040
16485991714,2cyclictest26700-21sed00:15:010
16485991714,2cyclictest16718-21pzem_voltage22:00:210
16485991714,2cyclictest0-21swapper/020:55:200
1648599171,16cyclictest4536-21H212:26:330
1648599171,15cyclictest23065-21/usr/sbin/munin00:05:230
1648599170,2cyclictest5723-21grep23:35:180
1648599170,2cyclictest29124-21expr20:30:140
1648599170,2cyclictest20436-21cut19:15:180
1648599170,2cyclictest11293-21cpu22:50:130
1648599170,1cyclictest0-21swapper/022:22:420
1648599170,16cyclictest3692-21master21:59:190
1648599170,16cyclictest16322-21nfsd420:05:170
1648599170,16cyclictest10059-21sed20:50:230
1648599170,15cyclictest4536-21H212:26:330
16487991614,1cyclictest1649-21tune2fs21:35:172
16487991614,1cyclictest0-21swapper/222:45:132
16487991614,1cyclictest0-21swapper/222:35:182
16487991614,1cyclictest0-21swapper/221:50:122
16487991614,1cyclictest0-21swapper/220:55:222
16487991614,1cyclictest0-21swapper/220:15:152
16487991614,1cyclictest0-21swapper/219:55:132
16487991614,1cyclictest0-21swapper/219:15:162
16487991614,1cyclictest0-21swapper/200:20:132
16487991613,2cyclictest27758-21chrt19:30:112
1648799160,15cyclictest32533-21pzem_energy23:25:192
1648799160,15cyclictest27770-21cut00:15:182
1648799160,15cyclictest0-21swapper/223:40:142
1648799160,15cyclictest0-21swapper/223:40:132
1648799160,15cyclictest0-21swapper/221:25:192
1648799160,15cyclictest0-21swapper/221:20:172
1648799160,15cyclictest0-21swapper/219:45:182
1648799160,15cyclictest0-21swapper/219:40:202
16486991614,1cyclictest29578-21grep21:25:241
16486991614,1cyclictest0-21swapper/123:48:311
16486991614,1cyclictest0-21swapper/122:30:181
16486991614,1cyclictest0-21swapper/122:07:271
16486991614,1cyclictest0-21swapper/121:40:191
16486991614,1cyclictest0-21swapper/121:30:221
16486991614,1cyclictest0-21swapper/121:15:171
16486991614,1cyclictest0-21swapper/121:00:141
16486991614,1cyclictest0-21swapper/121:00:131
16486991614,1cyclictest0-21swapper/120:48:051
16486991614,1cyclictest0-21swapper/120:00:131
16486991614,1cyclictest0-21swapper/100:35:211
16486991613,2cyclictest7957-21latency21:45:191
16486991613,2cyclictest11808-21sshd21:52:361
1648699160,2cyclictest4189-21grep19:45:151
1648699160,2cyclictest26974-21expr22:20:161
1648699160,1cyclictest25517-21ntpq00:10:201
1648699160,1cyclictest20169-21expr23:05:141
1648699160,1cyclictest0-21swapper/123:30:221
1648699160,1cyclictest0-21swapper/122:55:021
1648699160,1cyclictest0-21swapper/121:10:141
1648699160,1cyclictest0-21swapper/119:15:171
1648699160,15cyclictest4581-21H212:26:331
1648699160,15cyclictest4526-21H212:26:331
1648699160,15cyclictest30820-21cat19:35:161
1648699160,15cyclictest20915-21dpkg22:10:011
1648699160,15cyclictest16886-21switchtime22:00:221
1648699160,15cyclictest15108-21acpi20:05:111
1648699160,15cyclictest0-21swapper/123:55:151
1648699160,15cyclictest0-21swapper/123:50:141
1648699160,15cyclictest0-21swapper/120:15:161
1648699160,15cyclictest0-21swapper/119:55:021
1648699160,15cyclictest0-21swapper/100:30:171
1648699160,15cyclictest0-21swapper/100:25:151
1648699160,15cyclictest0-21swapper/100:20:151
1648699160,15cyclictest0-21swapper/100:15:161
16485991615,1cyclictest16484-21cyclictest22:27:190
16485991614,1cyclictest0-21swapper/023:55:150
16485991614,1cyclictest0-21swapper/023:55:010
16485991614,1cyclictest0-21swapper/023:40:190
16485991614,1cyclictest0-21swapper/023:40:190
16485991614,1cyclictest0-21swapper/023:30:120
16485991614,1cyclictest0-21swapper/023:20:170
16485991614,1cyclictest0-21swapper/023:05:140
16485991614,1cyclictest0-21swapper/022:55:170
16485991614,1cyclictest0-21swapper/021:44:490
16485991614,1cyclictest0-21swapper/021:15:190
16485991614,1cyclictest0-21swapper/020:40:180
16485991614,1cyclictest0-21swapper/020:35:200
16485991614,1cyclictest0-21swapper/019:55:160
16485991614,1cyclictest0-21swapper/019:40:200
16485991614,1cyclictest0-21swapper/019:35:150
16485991614,1cyclictest0-21swapper/000:32:550
16485991614,1cyclictest0-21swapper/000:20:160
16485991613,2cyclictest22140-21nvmesmart_nvme020:15:220
16485991613,2cyclictest19303-21grep22:05:210
1648599160,2cyclictest32627-21expr22:30:170
1648599160,2cyclictest20027-21expr21:10:160
1648599160,1cyclictest21865-21fschecks_time22:10:160
1648599160,1cyclictest15790-21timerandwakeup21:00:220
1648599160,1cyclictest15790-21timerandwakeup21:00:210
1648599160,1cyclictest0-21swapper/023:25:170
1648599160,1cyclictest0-21swapper/000:25:250
1648599160,15cyclictest32712chrt21:38:070
1648599160,15cyclictest27638-21if_eno100:15:160
1648599160,15cyclictest25082-21needreboot22:15:200
1648599160,15cyclictest23956-21expr20:20:170
1648599160,15cyclictest20198-21sshd20:13:410
1648599160,15cyclictest0-21swapper/021:50:180
1648599160,15cyclictest0-21swapper/021:25:190
1648599160,15cyclictest0-21swapper/021:20:220
1648599160,15cyclictest0-21swapper/021:05:130
1648599160,15cyclictest0-21swapper/019:50:170
1648599160,15cyclictest0-21swapper/019:45:160
1648599160,15cyclictest0-21swapper/019:30:150
1648599160,15cyclictest0-21swapper/019:25:120
1648599160,15cyclictest0-21swapper/000:00:150
16486991512,2cyclictest27384-21needreboot20:25:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional