You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-10 - 12:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot0.osadl.org (updated Sat May 10, 2025 00:45:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1452799252,19cyclictest0-21swapper/221:37:242
14527992313,5cyclictest0-21swapper/200:00:182
1452799230,8cyclictest32243-21wc23:30:002
1452799230,22cyclictest21289-21ls19:20:172
1452799230,22cyclictest10257-21idleruntime-cro20:00:002
1452799222,19cyclictest8775-21chrt20:52:272
1452799221,20cyclictest20779-21tail22:10:222
1452799221,20cyclictest13637-21sendmail-msp22:00:002
1452799221,19cyclictest31767-21fschecks_count00:25:152
1452799220,21cyclictest9802-21expr20:55:162
1452799220,21cyclictest6972-21sed00:39:012
1452799220,21cyclictest5933-21smtp20:45:422
1452799220,21cyclictest414-20systemd-journal22:29:562
1452799220,21cyclictest26733-21cat21:25:172
1452799220,21cyclictest26284-21awk20:25:182
1452799220,21cyclictest26284-21awk20:25:172
1452799220,21cyclictest25507-21latency_hist19:30:012
1452799220,21cyclictest16472-21sed23:00:182
1452799220,21cyclictest0-21swapper/222:20:222
1452799220,20cyclictest2049-21systemd-journal23:55:422
1452799220,20cyclictest2049-21systemd-journal23:55:412
1452799211,6cyclictest17739-21awk21:10:122
14527992114,6cyclictest5851-21apt-config23:40:012
14527992114,6cyclictest18073-21awk20:10:202
14527992114,6cyclictest16184-21awk21:05:202
14527992114,6cyclictest0-21swapper/200:30:232
14527992113,7cyclictest31927-21grep20:35:222
1452799210,6cyclictest31114-21sed00:25:012
1452799210,20cyclictest6117-21fschecks_time21:45:182
1452799210,20cyclictest5882-21fschecks_time19:50:162
1452799210,20cyclictest3390-21sessionclean22:39:002
1452799210,20cyclictest26746-21grep19:30:162
1452799210,20cyclictest25547-21sed00:15:002
1452799210,20cyclictest24567-21if_enp1s023:15:192
1452799210,20cyclictest2398-21ps20:40:212
1452799210,20cyclictest22251-21timerandwakeup21:15:222
1452799210,20cyclictest21712chrt19:45:152
1452799210,20cyclictest20259-21awk20:15:172
1452799210,20cyclictest157872chrt20:09:342
1452799210,20cyclictest12746-21kernelversion23:50:172
1452799210,20cyclictest0-21swapper/223:40:142
1452799210,20cyclictest0-21swapper/222:55:152
1452799210,20cyclictest0-21swapper/222:30:152
1452799210,20cyclictest0-21swapper/221:20:132
1452799210,20cyclictest0-21swapper/220:32:052
1452799210,20cyclictest0-21swapper/220:20:202
14527992014,5cyclictest8837-21fschecks_time21:50:202
14527992014,5cyclictest26362-21fschecks_time00:15:152
14527992013,6cyclictest9415-21expr23:45:162
14527992013,6cyclictest2814-21rs:main2
1452799200,19cyclictest6868-21perf22:45:012
1452799200,19cyclictest31405-21sed19:40:002
1452799200,19cyclictest18612-21sed19:15:182
1452799200,19cyclictest16381-21find19:10:192
1452799200,19cyclictest0-21swapper/223:30:192
1452799200,19cyclictest0-21swapper/223:20:022
1452799200,19cyclictest0-21swapper/223:10:182
1452799200,19cyclictest0-21swapper/223:05:142
1452799200,19cyclictest0-21swapper/222:50:182
1452799200,19cyclictest0-21swapper/222:49:392
1452799200,19cyclictest0-21swapper/222:15:212
1452799200,19cyclictest0-21swapper/219:43:402
1452799190,5cyclictest0-21swapper/221:03:002
1452799190,4cyclictest0-21swapper/222:05:172
1452799190,4cyclictest0-21swapper/200:05:172
1452799190,19cyclictest0-21swapper/222:00:172
1452799190,18cyclictest0-21swapper/221:40:202
1452799190,18cyclictest0-21swapper/220:01:132
14526991916,2cyclictest1104-21lldpd00:22:591
1452699190,3cyclictest0-21swapper/123:40:021
1452599192,16cyclictest3921-21grep21:40:200
1452599192,16cyclictest31455-21apt-key21:35:010
1452599190,18cyclictest0-21swapper/000:01:460
1452699183,9cyclictest30946-21perf21:35:011
1452699182,15cyclictest10927-21munin-plugin-st21:55:021
14526991816,1cyclictest0-21swapper/122:21:181
14526991816,1cyclictest0-21swapper/100:35:021
14526991814,3cyclictest2343-21grep23:35:001
1452699181,2cyclictest575-21needreboot21:35:201
14526991812,1cyclictest0-21swapper/119:59:361
1452699180,16cyclictest414-20systemd-journal23:38:591
1452599182,10cyclictest25318-21perf19:30:000
14525991814,2cyclictest22447-21nvmesmart_nvme023:10:200
1452599180,2cyclictest4523-21H212:26:330
14526991715,1cyclictest0-21swapper/121:28:161
14526991714,2cyclictest5024-21grep21:45:011
14526991714,2cyclictest4526-21H212:26:331
14526991714,2cyclictest26595-21kernelversion00:15:181
14526991714,2cyclictest24472-21cron20:25:011
14526991714,2cyclictest24472-21cron20:25:011
14526991714,2cyclictest23024-21fschecks_time22:15:191
14526991714,2cyclictest21812-21ntp_kernel_err21:15:191
14526991714,2cyclictest18631-21ntp_kernel_err00:00:181
14526991714,2cyclictest1404-21lxd22:34:571
14526991714,2cyclictest13533-21ntp_offset21:00:201
14526991714,2cyclictest11181-21postgres23:47:171
14526991714,2cyclictest0-21swapper/119:20:171
14526991714,1cyclictest4593-21H212:26:331
14526991713,3cyclictest4523-21H212:26:331
1452699170,2cyclictest6075-21/usr/sbin/munin22:40:211
1452699170,2cyclictest23443-21cat00:10:161
1452699170,2cyclictest16714-21cron22:05:001
1452699170,1cyclictest4532-21H212:26:331
1452699170,16cyclictest967-21thermald23:05:221
1452699170,16cyclictest9275-21seq22:46:141
1452699170,16cyclictest4473-21df20:45:121
1452699170,16cyclictest26884-21/usr/sbin/munin23:20:251
1452699170,16cyclictest24675-21cat19:25:231
1452699170,16cyclictest20649-21netstat20:15:191
1452699170,16cyclictest19553-21postgres19:16:111
1452699170,16cyclictest19355-21sensors21:10:211
1452699170,16cyclictest15994-21ps23:55:191
1452699170,16cyclictest15994-21ps23:55:191
1452699170,16cyclictest0-21swapper/121:55:021
1452599172,1cyclictest44382sleep019:46:320
14525991715,1cyclictest0-21swapper/020:45:010
14525991714,2cyclictest5759-21/usr/sbin/munin22:40:200
14525991714,2cyclictest27645-21latency_hist22:25:010
14525991714,2cyclictest15901-21missed_timers19:10:160
14525991714,1cyclictest0-21swapper/021:55:200
1452599171,1cyclictest0-21swapper/000:27:310
1452599170,2cyclictest32300-21timerandwakeup22:30:230
1452599170,2cyclictest24048-21timerwakeupswit20:20:210
1452599170,2cyclictest23970-21cut23:15:150
1452599170,1cyclictest0-21swapper/000:05:350
1452599170,16cyclictest967-21thermald22:10:250
1452599170,16cyclictest8250-21grep21:50:180
1452599170,16cyclictest6956-21sed00:39:010
1452599170,16cyclictest5362-21sed23:39:000
1452599170,16cyclictest4593-21H212:26:330
1452599170,16cyclictest4536-21H212:26:330
1452599170,16cyclictest4530-21H212:26:330
1452599170,16cyclictest4523-21H212:26:330
1452599170,16cyclictest4523-21H212:26:330
1452599170,16cyclictest31548-21apt-key21:35:020
1452599170,16cyclictest29972-21cat19:35:180
1452599170,16cyclictest21991-21pzem21:15:210
1452599170,16cyclictest1545-21tune2fs22:35:180
1452599170,16cyclictest1404-21lxd23:44:570
1452599170,16cyclictest11227-21df20:00:140
1452599170,16cyclictest0-21swapper/023:53:170
1452599170,16cyclictest0-21swapper/023:45:220
1452599170,15cyclictest4526-21H212:26:330
14526991614,1cyclictest0-21swapper/123:00:141
14526991614,1cyclictest0-21swapper/122:35:191
14526991614,1cyclictest0-21swapper/121:23:191
14526991614,1cyclictest0-21swapper/120:55:161
14526991614,1cyclictest0-21swapper/120:50:231
14526991614,1cyclictest0-21swapper/120:35:181
14526991614,1cyclictest0-21swapper/119:10:171
14526991614,1cyclictest0-21swapper/100:30:201
14526991614,1cyclictest0-21swapper/100:05:131
14526991613,2cyclictest14704-21nfsd420:05:191
1452699160,2cyclictest4280-21timerwakeupswit19:45:241
1452699160,2cyclictest2060-21sed20:40:201
1452699160,1cyclictest11047-21missed_timers22:50:221
1452699160,15cyclictest5508-21cpuspeed_turbos21:45:151
1452699160,15cyclictest4530-21H212:26:331
1452699160,15cyclictest3692-21master20:34:571
1452699160,15cyclictest32214-21expr19:40:141
1452699160,15cyclictest22246-21cpuspeed_turbos20:20:141
1452699160,15cyclictest15596-21http_loadtime21:05:161
1452699160,15cyclictest0-21swapper/123:25:171
1452699160,15cyclictest0-21swapper/122:00:191
1452699160,15cyclictest0-21swapper/120:10:021
1452699160,15cyclictest0-21swapper/120:00:151
1452699160,15cyclictest0-21swapper/119:35:151
1452699160,15cyclictest0-21swapper/100:25:181
1452599164,6cyclictest0-21swapper/020:10:050
14525991614,1cyclictest9-21ksoftirqd/022:51:240
14525991614,1cyclictest29619-21apt-get23:25:130
14525991614,1cyclictest254352sleep021:24:290
14525991614,1cyclictest0-21swapper/023:05:190
14525991614,1cyclictest0-21swapper/022:25:150
14525991614,1cyclictest0-21swapper/022:15:220
14525991614,1cyclictest0-21swapper/021:10:140
14525991614,1cyclictest0-21swapper/021:10:000
14525991614,1cyclictest0-21swapper/020:35:170
14525991614,1cyclictest0-21swapper/020:30:140
14525991614,1cyclictest0-21swapper/020:15:190
14525991614,1cyclictest0-21swapper/019:55:190
14525991614,1cyclictest0-21swapper/019:50:190
14525991614,1cyclictest0-21swapper/019:15:150
14525991614,1cyclictest0-21swapper/000:15:160
14525991613,2cyclictest26829-21hddtemp_smartct19:30:170
14525991613,2cyclictest25844-21latency20:25:170
14525991613,2cyclictest25844-21latency20:25:170
1452599160,1cyclictest0-21swapper/020:50:230
1452599160,1cyclictest0-21swapper/020:45:140
1452599160,15cyclictest9001-21timerandwakeup22:45:220
1452599160,15cyclictest15155-21timerandwakeup20:05:220
1452599160,15cyclictest12960-21cat21:00:170
1452599160,15cyclictest12852-21cpuspeed_turbos22:55:150
1452599160,15cyclictest0-21swapper/023:30:180
1452599160,15cyclictest0-21swapper/021:45:160
1452599160,15cyclictest0-21swapper/019:20:160
1452599160,15cyclictest0-21swapper/000:30:160
1452599160,15cyclictest0-21swapper/000:10:220
14526991513,1cyclictest27590-21ps19:30:211
14525991514,1cyclictest0-21swapper/021:25:150
14525991513,1cyclictest0-21swapper/020:55:140
1452599150,14cyclictest0-21swapper/019:40:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional