You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 19:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot0.osadl.org (updated Thu Nov 20, 2025 12:45:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
679992214,7cyclictest9660-21package-data-do07:25:011
679992213,6cyclictest0-21swapper/111:55:201
67499226,12cyclictest9-21ksoftirqd/007:16:320
67499226,12cyclictest9-21ksoftirqd/007:16:320
68399212,16cyclictest4530-21H212:26:332
674992119,1cyclictest9-21ksoftirqd/009:55:370
68399200,19cyclictest823-21systemd-network08:47:182
679992014,3cyclictest0-21swapper/108:25:311
674992018,1cyclictest19465-21date10:35:000
674992015,4cyclictest0-21swapper/010:55:410
67499200,17cyclictest0-21swapper/010:15:190
683991916,2cyclictest4526-21H212:26:332
683991915,3cyclictest0-21swapper/212:32:512
68399190,18cyclictest0-21swapper/211:57:422
68399190,16cyclictest4593-21H212:26:332
68399190,16cyclictest4538-21H212:26:332
68399190,16cyclictest4526-21H212:26:332
679991917,1cyclictest0-21swapper/110:55:221
679991917,1cyclictest0-21swapper/108:00:151
679991917,1cyclictest0-21swapper/107:52:011
679991916,2cyclictest8338-21sed08:20:011
679991914,4cyclictest823-21systemd-network10:50:011
67999191,1cyclictest0-21swapper/108:32:451
67999191,17cyclictest25393-21ps09:45:231
67999190,5cyclictest0-21swapper/112:33:051
67999190,3cyclictest0-21swapper/109:15:131
67999190,16cyclictest4593-21H212:26:331
67499193,15cyclictest0-21swapper/012:33:280
67499192,16cyclictest29944-21timerandwakeup10:50:220
674991917,1cyclictest9-21ksoftirqd/010:43:210
674991914,3cyclictest4530-21H212:26:330
68399182,15cyclictest28-21ksoftirqd/210:47:382
683991816,1cyclictest28-21ksoftirqd/212:35:172
683991816,1cyclictest0-21swapper/210:37:112
683991815,2cyclictest4528-21H212:26:332
683991815,2cyclictest4526-21H212:26:332
683991814,3cyclictest4593-21H212:26:332
68399180,2cyclictest4536-21H212:26:332
68399180,17cyclictest7325-21cron11:10:002
68399180,16cyclictest0-21swapper/209:10:142
67999183,1cyclictest4593-21H212:26:331
67999182,1cyclictest0-21swapper/107:14:411
67999182,15cyclictest62092sleep107:16:571
67999182,15cyclictest62092sleep107:16:571
67999182,15cyclictest27851-21nfsd409:50:191
67999182,15cyclictest21-21ksoftirqd/111:15:521
67999182,15cyclictest20323-21switchtime11:30:241
67999182,15cyclictest0-21swapper/111:42:191
679991816,1cyclictest21550-21expr11:35:131
679991816,1cyclictest0-21swapper/112:10:181
679991815,2cyclictest7402-21latency_hist11:10:001
679991815,2cyclictest4578-21accounts12:26:331
679991814,3cyclictest941-21find09:05:011
679991814,3cyclictest1079-21gdbus09:40:231
679991814,3cyclictest0-21swapper/108:56:081
679991812,5cyclictest414-20systemd-journal07:49:561
67999181,16cyclictest454-21plymouthd12:00:141
67999180,17cyclictest4581-21H212:26:331
67999180,17cyclictest0-21swapper/107:44:161
67999180,17cyclictest0-21swapper/107:44:161
67999180,16cyclictest4593-21H212:26:331
67999180,16cyclictest4532-21H212:26:331
67999180,15cyclictest4581-21H212:26:331
67499183,1cyclictest0-21swapper/008:08:180
674991816,1cyclictest0-21swapper/012:04:130
674991816,1cyclictest0-21swapper/010:36:510
674991815,2cyclictest0-21swapper/011:01:320
67499180,3cyclictest28386-21cut11:45:210
67499180,2cyclictest4593-21H212:26:330
67499180,2cyclictest4536-21H212:26:330
67499180,2cyclictest4532-21H212:26:330
67499180,17cyclictest4536-21H212:26:330
67499180,16cyclictest4593-21H212:26:330
67499180,16cyclictest4534-21H212:26:330
67499180,15cyclictest4581-21H212:26:330
683991715,1cyclictest28-21ksoftirqd/209:08:512
683991715,1cyclictest193252chrt12:28:462
683991714,2cyclictest6843-21needreboot08:15:202
683991714,2cyclictest4538-21H212:26:332
683991714,2cyclictest4536-21H212:26:332
683991714,2cyclictest4534-21H212:26:332
683991714,2cyclictest29621-21cat09:55:142
683991714,2cyclictest27126-21cpuspeed_turbos11:45:172
683991714,2cyclictest26473-21processes08:50:212
683991714,2cyclictest19748-21pzem_voltage09:35:182
683991714,2cyclictest14667-21cat12:20:122
683991714,2cyclictest12344-21sed07:30:012
683991713,3cyclictest4523-21H212:26:332
68399171,1cyclictest5781-21switchtime07:15:232
68399171,1cyclictest5781-21switchtime07:15:232
68399171,15cyclictest0-21swapper/209:50:132
68399170,2cyclictest4918-21taskset08:10:242
68399170,2cyclictest4538-21H212:26:332
68399170,2cyclictest4538-21H212:26:332
68399170,2cyclictest4534-21H212:26:332
68399170,2cyclictest4526-21H212:26:332
68399170,2cyclictest4523-21H212:26:332
68399170,2cyclictest30053-21snapd07:43:572
68399170,2cyclictest30053-21snapd07:43:572
68399170,2cyclictest21204-21grep07:45:152
68399170,2cyclictest21104-21plymouth08:40:182
68399170,2cyclictest1700-21smtpd08:05:232
68399170,2cyclictest10330-21nvmesmart_nvme010:15:192
68399170,16cyclictest9325-21latency_hist07:25:012
68399170,16cyclictest8653-21expr08:20:152
68399170,16cyclictest659-21gpg-connect-age09:05:012
68399170,16cyclictest4528-21H212:26:332
68399170,16cyclictest29997-21snapd09:31:372
68399170,16cyclictest27716-21/usr/sbin/munin08:55:132
68399170,16cyclictest25342-21sed11:40:162
68399170,16cyclictest22669-21sendmail_mailqu09:40:222
68399170,16cyclictest17877-21cron07:40:012
68399170,16cyclictest17356-21http_loadtime08:35:182
68399170,16cyclictest1581-21expr07:10:152
68399170,16cyclictest15182-21cat09:30:012
68399170,16cyclictest1059-21cups-browsed09:21:222
679991715,1cyclictest0-21swapper/111:00:031
679991714,2cyclictest9773-21awk08:20:201
679991714,2cyclictest4534-21H212:26:331
679991714,2cyclictest3929-21expr09:09:011
679991714,2cyclictest30702-21grep09:55:181
679991714,2cyclictest28476-21cstates10:50:141
679991714,2cyclictest27070-21apache_volume11:45:151
679991714,2cyclictest24339-21mailstats10:40:221
679991714,2cyclictest19891-21cstates08:40:121
679991714,2cyclictest17840-21which12:25:131
679991714,2cyclictest17623-21latency08:35:201
679991714,2cyclictest14786-21expr10:25:141
679991714,2cyclictest14496-21awk11:20:191
679991714,2cyclictest12302-21fschecks_time12:15:151
679991714,2cyclictest10040-21apache_volume09:20:111
679991713,3cyclictest4578-21accounts12:26:331
67999171,15cyclictest3380-21fschecks_count08:10:151
67999171,15cyclictest0-21swapper/108:50:191
67999171,15cyclictest0-21swapper/107:30:171
67999170,2cyclictest15676-21nfsd412:20:171
67999170,1cyclictest4523-21H212:26:331
67999170,16cyclictest7028-21munin-plugin-st09:15:011
67999170,16cyclictest369-21cut10:00:151
67999170,16cyclictest29997-21snapd12:07:171
67999170,16cyclictest26988-21cstates07:55:121
67999170,16cyclictest23491-21grep08:45:171
67999170,16cyclictest23368-21if_eno112:35:161
67999170,16cyclictest17177-21sed07:35:231
67499172,15cyclictest9-21ksoftirqd/007:22:190
674991715,1cyclictest12611-21cut10:20:170
674991714,2cyclictest6683-21fschecks_time12:05:140
674991714,2cyclictest4536-21H212:26:330
674991714,2cyclictest4534-21H212:26:330
674991714,2cyclictest4528-21H212:26:330
674991714,2cyclictest4526-21H212:26:330
674991714,2cyclictest4523-21H212:26:330
674991714,2cyclictest29113-21ntp_kernel_pll_08:55:190
674991714,2cyclictest22064-21fschecks_time11:35:140
674991713,3cyclictest4581-21H212:26:330
67499171,2cyclictest6744-21timerwakeupswit11:05:200
67499171,15cyclictest0-21swapper/009:40:150
67499170,2cyclictest4534-21H212:26:330
67499170,2cyclictest19922-21expr08:40:120
67499170,2cyclictest11886-21cpuspeed_turbos12:15:140
67499170,1cyclictest4530-21H212:26:330
67499170,16cyclictest4581-21H212:26:330
67499170,16cyclictest4532-21H212:26:330
67499170,16cyclictest4530-21H212:26:330
67499170,16cyclictest23855-21systemctl08:45:200
67499170,16cyclictest2385-21cut07:10:190
67499170,16cyclictest16621-21/usr/sbin/munin08:35:150
67499170,16cyclictest1472-21lxd08:23:040
67499170,16cyclictest13130-21expr07:30:140
67499170,16cyclictest0-21swapper/009:33:560
683991614,1cyclictest0-21swapper/211:25:172
683991614,1cyclictest0-21swapper/208:30:162
683991614,1cyclictest0-21swapper/208:00:202
683991613,2cyclictest14180-21sed12:20:002
68399160,1cyclictest271rcuc/210:25:132
68399160,15cyclictest8685-21smartctl09:15:212
68399160,15cyclictest25175-21ntp_states07:50:192
68399160,15cyclictest10449-21pzem_energy12:10:202
679991614,1cyclictest0-21swapper/110:30:141
679991614,1cyclictest0-21swapper/109:30:141
67999160,15cyclictest9321-21cstates10:15:141
674991614,1cyclictest21518-21cstates07:45:160
674991614,1cyclictest14127-21awk09:25:170
674991614,1cyclictest14065-21expr08:30:120
674991614,1cyclictest0-21swapper/012:20:160
674991614,1cyclictest0-21swapper/012:10:170
674991614,1cyclictest0-21swapper/008:50:090
674991614,1cyclictest0-21swapper/008:15:170
674991613,2cyclictest1555-21lxd09:15:050
67499160,1cyclictest23758-21find07:50:110
67499160,1cyclictest0-21swapper/008:10:340
67499160,15cyclictest4593-21H212:26:330
67499160,15cyclictest4538-21H212:26:330
67499160,15cyclictest30479-21/usr/sbin/munin09:00:120
67499160,15cyclictest29493-21cut08:00:130
67499160,15cyclictest19421-21missed_timers07:40:180
67499160,15cyclictest19421-21missed_timers07:40:180
67499160,15cyclictest11415-21cpuspeed_turbos08:25:110
67499160,15cyclictest0-21swapper/011:40:130
67499160,15cyclictest0-21swapper/007:55:150
68399150,14cyclictest0-21swapper/207:30:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional