You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 13:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot0.osadl.org (updated Fri Dec 05, 2025 00:45:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1330899263,19cyclictest0-21swapper/221:05:102
1330899263,19cyclictest0-21swapper/221:05:102
1330899260,8cyclictest0-21swapper/219:18:092
1330899253,21cyclictest0-21swapper/220:45:482
1330699251,19cyclictest7686-21latency_hist20:55:000
13308992417,6cyclictest0-21swapper/219:34:512
1330899241,22cyclictest0-21swapper/223:17:492
1330899240,23cyclictest17817-21cat22:10:012
1330899232,20cyclictest970-21dbus-daemon19:10:222
1330899231,21cyclictest2907-21cat00:35:012
1330899231,21cyclictest14207-21ntpq23:55:222
1330899230,7cyclictest5672-21mailstats19:50:212
1330899230,22cyclictest2575-21awk23:35:192
1330899223,4cyclictest0-21swapper/223:40:402
1330899223,4cyclictest0-21swapper/223:40:402
1330899222,5cyclictest23204-21chrt21:20:202
1330899222,19cyclictest25652-21cpuspeed_turbos23:20:142
1330899220,21cyclictest9560-21missed_timers22:50:192
1330899220,21cyclictest6146-21cut21:50:002
1330899220,21cyclictest52242chrt20:50:082
1330899220,21cyclictest4752sleep221:40:062
1330899220,21cyclictest32503-21apt21:40:012
1330899220,21cyclictest324072sleep219:43:522
1330899220,21cyclictest32098-21wc22:35:152
1330899220,21cyclictest293082chrt22:30:032
1330899220,21cyclictest29152-21cat00:25:002
1330899220,21cyclictest28513-21grep21:30:242
1330899220,21cyclictest2396-21cat00:35:002
1330899220,21cyclictest23632-21sed19:25:212
1330899220,21cyclictest22966-21cat22:15:202
1330899220,21cyclictest18543-21uniq20:15:162
1330899220,21cyclictest15783-21timerwakeupswit23:00:262
1330899220,21cyclictest15467-21expr20:10:162
1330899220,21cyclictest13293-21munin-run21:05:002
1330899220,21cyclictest12168-21sed20:05:012
1330899220,20cyclictest0-21swapper/220:30:252
1330899220,20cyclictest0-21swapper/200:05:182
1330899220,1cyclictest0-21swapper/220:40:012
1330699220,18cyclictest0-21swapper/022:10:180
13308992114,6cyclictest3623-21latency_hist19:50:002
13308992114,6cyclictest15945-21expr00:00:162
1330899210,6cyclictest0-21swapper/221:18:592
1330899210,20cyclictest7149-21ls19:55:162
1330899210,20cyclictest29232-21latency_hist22:30:012
1330899210,20cyclictest28597-21awk19:35:192
1330899210,20cyclictest25608-21sed22:20:222
1330899210,20cyclictest23461-21wc20:25:152
1330899210,20cyclictest19189-21cpuspeed_turbos19:20:132
1330899210,20cyclictest12352-21grep22:55:192
1330899210,20cyclictest0-21swapper/223:25:142
1330899210,20cyclictest0-21swapper/222:44:412
1330899210,20cyclictest0-21swapper/200:28:202
1330899210,1cyclictest3441-21gsd-color23:46:582
1330899210,1cyclictest0-21swapper/223:10:012
1330899210,1cyclictest0-21swapper/222:45:182
1330899210,1cyclictest0-21swapper/222:10:172
1330899210,1cyclictest0-21swapper/221:50:212
1330899210,1cyclictest0-21swapper/220:40:242
1330899210,0cyclictest0-21swapper/220:20:172
1330799216,14cyclictest0-21swapper/122:12:311
13307992116,2cyclictest767-21nvmesmart_nvme020:40:221
1330899201,18cyclictest4538-21H212:26:332
1330899200,5cyclictest12346-21/usr/sbin/munin22:00:172
1330899200,19cyclictest17924-21mailstats21:10:212
1330899200,19cyclictest0-21swapper/223:30:192
1330899200,19cyclictest0-21swapper/220:05:182
1330899200,19cyclictest0-21swapper/200:20:012
1330699204,15cyclictest0-21swapper/021:39:360
13308991914,4cyclictest0-21swapper/220:55:162
1330899190,18cyclictest0-21swapper/223:07:362
1330899190,18cyclictest0-21swapper/221:55:152
13307991916,2cyclictest31676-21grep22:35:011
13307991916,2cyclictest26865-21grep19:35:001
13307991915,3cyclictest4581-21H212:26:331
1330699193,15cyclictest9-21ksoftirqd/000:06:230
1330699192,15cyclictest0-21swapper/020:05:160
13306991914,4cyclictest13500-21cron23:00:010
1330799182,1cyclictest0-21swapper/121:46:021
1330799182,15cyclictest4534-21H212:26:331
1330799182,15cyclictest0-21swapper/121:05:331
1330799182,15cyclictest0-21swapper/121:05:321
13307991816,1cyclictest0-21swapper/123:55:201
13307991816,1cyclictest0-21swapper/120:17:031
13307991811,6cyclictest17330-21fschecks_time23:05:171
1330799180,2cyclictest4526-21H212:26:331
1330799180,17cyclictest14705-21perf22:05:011
1330799180,17cyclictest12085-21cat20:05:011
1330699182,15cyclictest4526-21H212:26:330
1330699182,15cyclictest23034-21nfsd419:25:180
13306991816,1cyclictest5459-21ntp_kernel_pll_19:50:190
13306991816,1cyclictest0-21swapper/020:30:000
13306991814,3cyclictest4528-21H212:26:330
1330699180,3cyclictest32078-21sort19:40:220
1330699180,3cyclictest1411-21lxd23:51:140
1330699180,17cyclictest21410-21idleruntime-cro21:20:010
13307991715,1cyclictest3441-21gsd-color19:39:351
13307991715,1cyclictest0-21swapper/123:10:261
13307991715,1cyclictest0-21swapper/123:00:171
13307991714,2cyclictest4593-21H212:26:331
13307991714,2cyclictest4538-21H212:26:331
13307991714,2cyclictest4538-21H212:26:331
13307991714,2cyclictest4526-21H212:26:331
13307991714,2cyclictest25025-21missed_timers22:20:181
13307991714,2cyclictest23377-21/usr/sbin/munin20:25:131
13307991714,2cyclictest2011-21taskset00:32:081
13307991714,2cyclictest20085-21sed21:15:191
13307991714,2cyclictest18139-21timerandwakeup19:15:221
13307991714,2cyclictest16403-21cut20:10:201
13307991714,2cyclictest11851-21sed21:00:241
13307991714,2cyclictest11373-21cpuspeed_turbos22:55:161
1330799171,1cyclictest0-21swapper/123:46:191
1330799170,2cyclictest4593-21H212:26:331
1330799170,2cyclictest4137-21cpuspeed_turbos19:50:131
1330799170,16cyclictest9619-21needreboot22:50:191
1330799170,16cyclictest3692-21master23:33:011
1330799170,16cyclictest30598-21expr19:40:141
1330799170,16cyclictest29987-21/usr/sbin/munin21:35:131
1330799170,16cyclictest29106-21perf00:25:001
1330799170,16cyclictest28702-21smartctl21:30:251
1330799170,16cyclictest27973-21ntp_kernel_err22:25:201
1330799170,16cyclictest26084-21fschecks_count23:20:151
1330799170,16cyclictest24386-21munin-run19:30:021
1330799170,16cyclictest16494-21ntp_offset22:05:201
1330799170,16cyclictest1355-21lxd20:57:131
1330799170,16cyclictest11005-21kernelversion23:50:161
13306991715,1cyclictest293542chrt19:37:090
13306991715,1cyclictest24531-21/usr/sbin/munin19:30:190
13306991715,1cyclictest0-21swapper/022:15:120
13306991715,1cyclictest0-21swapper/021:45:270
13306991715,1cyclictest0-21swapper/021:00:200
13306991714,2cyclictest881-21avahi-daemon21:10:210
13306991714,2cyclictest4526-21H212:26:330
13306991714,2cyclictest27584-21expr21:30:200
13306991714,2cyclictest2727-21ntp_kernel_pll_23:35:190
13306991714,2cyclictest19678-21sh19:20:140
13306991714,2cyclictest17886-21grep23:05:200
13306991714,2cyclictest15899-21smartctl20:10:160
13306991714,2cyclictest15128-21cpu22:05:140
1330699170,2cyclictest4593-21H212:26:330
1330699170,2cyclictest4538-21H212:26:330
1330699170,2cyclictest4538-21H212:26:330
1330699170,2cyclictest4536-21H212:26:330
1330699170,2cyclictest4523-21H212:26:330
1330699170,2cyclictest21831-21apache_accesses21:20:130
1330699170,1cyclictest0-21swapper/021:28:500
1330699170,16cyclictest8021-21awk19:55:190
1330699170,16cyclictest677-21https19:45:010
1330699170,16cyclictest6542-21store21:50:010
1330699170,16cyclictest4373-21/usr/sbin/munin20:45:240
1330699170,16cyclictest30008-21snapd19:11:490
1330699170,16cyclictest29517-21tune2fs20:35:160
1330699170,16cyclictest28571-21date20:35:000
1330699170,16cyclictest28073-21cut23:25:010
1330699170,16cyclictest27169-21expr00:20:150
1330699170,16cyclictest259392chrt22:21:530
1330699170,16cyclictest13296-21sed22:00:170
1330699170,16cyclictest10288-21turbostat21:00:000
13307991614,1cyclictest0-21swapper/122:40:201
13307991614,1cyclictest0-21swapper/121:55:071
13307991614,1cyclictest0-21swapper/121:50:021
13307991614,1cyclictest0-21swapper/121:40:181
13307991614,1cyclictest0-21swapper/121:25:221
13307991614,1cyclictest0-21swapper/120:50:171
1330799160,1cyclictest0-21swapper/123:40:151
1330799160,1cyclictest0-21swapper/123:40:151
1330799160,1cyclictest0-21swapper/120:20:231
1330799160,15cyclictest6791-21/usr/sbin/munin19:55:141
1330799160,15cyclictest4538-21H212:26:331
1330799160,15cyclictest4536-21H212:26:331
1330799160,15cyclictest32058-21/usr/sbin/munin22:35:191
1330799160,15cyclictest29636-21if_eno120:35:171
1330799160,15cyclictest28159-21/usr/sbin/munin23:25:121
1330799160,15cyclictest26546-21expr20:30:201
1330799160,15cyclictest21812-21/usr/sbin/munin21:20:111
1330799160,15cyclictest21705-21df22:15:121
1330799160,15cyclictest190672chrt19:20:051
1330799160,15cyclictest0-21swapper/123:35:171
1330799160,15cyclictest0-21swapper/122:45:211
1330799160,15cyclictest0-21swapper/120:50:011
1330799160,15cyclictest0-21swapper/119:45:191
13306991614,1cyclictest8397-21sed23:45:190
13306991614,1cyclictest0-21swapper/023:30:080
13306991614,1cyclictest0-21swapper/022:41:270
13306991614,1cyclictest0-21swapper/020:20:130
13306991614,1cyclictest0-21swapper/019:15:110
13306991614,1cyclictest0-21swapper/000:35:010
13306991613,2cyclictest823-21systemd-network21:43:210
1330699160,2cyclictest4610-21cat23:40:120
1330699160,2cyclictest4610-21cat23:40:120
1330699160,2cyclictest28503-21expr23:25:140
1330699160,2cyclictest14295-21expr23:00:140
1330699160,1cyclictest9634-21/usr/sbin/munin21:55:170
1330699160,1cyclictest0-21swapper/022:25:200
1330699160,15cyclictest9783-21expr20:00:160
1330699160,15cyclictest6686-21cat22:45:180
1330699160,15cyclictest4593-21H212:26:330
1330699160,15cyclictest19310-21ntp_states20:15:200
1330699160,15cyclictest0-21swapper/022:50:140
1330699160,15cyclictest0-21swapper/021:05:200
1330699160,15cyclictest0-21swapper/021:05:190
1330699160,15cyclictest0-21swapper/020:40:200
1330699150,14cyclictest0-21swapper/022:35:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional