You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-07 - 10:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot0.osadl.org (updated Mon Oct 07, 2024 00:45:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1209499309,2cyclictest17662-21gpgv21:15:010
12097992414,0cyclictest0-21swapper/221:45:212
12097992412,12cyclictest28431-21kworker/u16:119:41:342
1209499241,5cyclictest0-21swapper/021:05:000
12094992314,8cyclictest8072-21python321:55:000
1209499231,20cyclictest0-21swapper/022:52:290
1209499231,16cyclictest8691-21cstates20:00:120
12095992222,0cyclictest0-21swapper/100:10:141
12095992222,0cyclictest0-21swapper/100:10:131
12094992214,7cyclictest28681-21entropy22:30:130
1209499220,2cyclictest2932-21ls21:45:130
1209499220,21cyclictest6670-21missed_timers19:55:200
1209499220,1cyclictest0-21swapper/019:35:110
12094992114,6cyclictest29734-21python323:30:010
12094992114,6cyclictest19375-21taskset23:10:110
12094992114,6cyclictest10443-21ls21:55:230
12094992114,6cyclictest0-21swapper/022:35:180
12094992114,6cyclictest0-21swapper/022:25:000
12094992114,6cyclictest0-21swapper/020:55:110
12094992113,7cyclictest11386-21expr20:05:140
12094992113,7cyclictest0-21swapper/022:43:480
1209499211,1cyclictest0-21swapper/000:35:140
1209499210,2cyclictest29010-21grep20:35:200
1209499210,2cyclictest16101-21df19:15:140
1209499210,2cyclictest14400-21grep23:00:160
1209499210,2cyclictest13853-21ls19:10:180
1209499210,20cyclictest30838-21timerwakeupswit00:25:220
1209499210,20cyclictest19506-21grep21:15:180
1209499210,1cyclictest32655-21df19:45:130
1209499210,1cyclictest21519-21smartctl00:10:130
1209499210,1cyclictest21519-21smartctl00:10:120
1209499210,1cyclictest0-21swapper/023:30:010
1209499210,1cyclictest0-21swapper/000:20:200
1209499210,19cyclictest0-21swapper/021:30:200
1209499210,16cyclictest26272-21munin-plugin-st19:35:000
1209499210,15cyclictest17954-21awk20:15:190
1209499210,15cyclictest0-21swapper/023:10:000
12094992015,4cyclictest0-21swapper/021:44:140
12094992014,5cyclictest31373-21cat20:40:160
12094992014,5cyclictest2885-21expr19:50:130
12094992014,5cyclictest274382chrt22:27:030
12094992014,5cyclictest274382chrt22:27:020
12094992014,5cyclictest0-21swapper/023:40:130
12094992014,5cyclictest0-21swapper/023:22:070
12094992014,5cyclictest0-21swapper/021:20:140
12094992014,5cyclictest0-21swapper/020:30:000
12094992014,5cyclictest0-21swapper/019:25:140
12094992013,6cyclictest4615-21tr22:45:130
12094992013,6cyclictest18795-21/usr/sbin/munin22:10:210
12094992013,6cyclictest0-21swapper/000:15:220
12094992012,7cyclictest15266-21grep20:10:180
12094992012,7cyclictest15266-21grep20:10:170
1209499200,2cyclictest29222-21apache_volume21:35:110
1209499200,1cyclictest0-21swapper/022:09:000
1209499200,1cyclictest0-21swapper/020:35:010
1209499200,1cyclictest0-21swapper/019:40:130
1209499200,19cyclictest4532-21H212:26:330
1209499200,19cyclictest0-21swapper/021:05:210
1209499200,19cyclictest0-21swapper/020:45:130
1209499200,19cyclictest0-21swapper/020:20:130
1209499200,19cyclictest0-21swapper/000:00:450
1209499200,18cyclictest0-21swapper/023:55:140
1209499200,16cyclictest0-21swapper/023:15:180
1209499200,14cyclictest0-21swapper/019:20:110
1209499200,0cyclictest0-21swapper/023:35:100
1209799192,16cyclictest11810-21smtpd21:04:472
1209799190,2cyclictest29826-21fschecks_count21:35:132
1209599193,2cyclictest4534-21H212:26:331
1209599190,1cyclictest0-21swapper/122:48:461
1209599190,17cyclictest29827-21fschecks_count21:35:141
12094991914,4cyclictest0-21swapper/023:50:160
1209499190,18cyclictest0-21swapper/023:46:090
1209499190,18cyclictest0-21swapper/020:50:220
1209499190,18cyclictest0-21swapper/000:31:450
1209499190,18cyclictest0-21swapper/000:05:130
1209799182,15cyclictest13230-21expr19:10:152
12097991815,2cyclictest4093-21latency_hist22:45:012
12097991814,3cyclictest0-21swapper/222:53:592
12097991814,3cyclictest0-21swapper/222:11:222
1209799180,3cyclictest2049-21systemd-journal20:29:402
1209799180,17cyclictest823-21systemd-network22:06:582
1209799180,17cyclictest1059-21cups-browsed20:20:022
1209599182,2cyclictest19501-21nfsd421:15:191
12095991814,3cyclictest17010-21apache220:55:091
1209599181,2cyclictest20521-21ntpq23:10:161
1209599181,2cyclictest0-21swapper/122:05:131
1209599181,16cyclictest12460-21nfsd420:05:191
1209599180,2cyclictest4526-21H212:26:331
12094991814,3cyclictest0-21swapper/022:55:150
12094991811,2cyclictest12763-21netstat22:00:180
1209499180,17cyclictest0-21swapper/022:15:130
12097991715,1cyclictest325502sleep220:40:522
12097991715,1cyclictest0-21swapper/222:04:462
12097991714,2cyclictest8458-21systemctl23:45:212
12097991714,2cyclictest6924-21nfsd419:55:202
12097991714,2cyclictest4532-21H212:26:332
12097991714,2cyclictest4530-21H212:26:332
12097991714,2cyclictest4530-21H212:26:332
12097991714,2cyclictest32279-21tr21:40:122
12097991714,2cyclictest26670-21cat00:20:142
12097991714,2cyclictest22027-21cut23:15:112
12097991714,2cyclictest19757-21fschecks_count23:10:132
12097991714,2cyclictest18732-21munin-plugin-st23:10:012
12097991714,2cyclictest16290-21nfsd400:00:162
1209799171,15cyclictest3908-21date20:50:012
1209799170,2cyclictest5656-21needreboot22:45:172
1209799170,2cyclictest4593-21H212:26:332
1209799170,2cyclictest4523-21H212:26:332
1209799170,2cyclictest28538-21nfsd423:25:162
1209799170,2cyclictest23060-21sshd00:14:272
1209799170,2cyclictest23060-21sshd00:14:272
1209799170,2cyclictest22815-21cut22:20:132
1209799170,2cyclictest16539-21ntp_offset21:10:172
1209799170,2cyclictest13010-21fschecks_time23:55:142
1209799170,16cyclictest4532-21H212:26:332
1209799170,16cyclictest32439-21expr19:45:142
1209799170,16cyclictest29330-21nfsd422:30:172
1209799170,16cyclictest26854-21expr19:35:132
1209799170,16cyclictest24750-21cut23:20:122
1209799170,16cyclictest24655-21sed00:15:172
1209799170,16cyclictest20059-21taskset00:07:492
1209799170,16cyclictest19981-21expr20:20:132
1209799170,16cyclictest19554-21grep21:15:182
1209799170,16cyclictest12274-21munin-run23:00:012
1209799170,16cyclictest11822-21which20:05:162
1209799170,16cyclictest1134-21snapd19:51:112
1209799170,16cyclictest1131-21snapd22:28:422
1209799170,16cyclictest1131-21snapd22:28:422
1209799170,15cyclictest0-21swapper/200:30:112
12095991715,1cyclictest4593-21H212:26:331
12095991715,1cyclictest170442sleep100:00:411
12095991715,1cyclictest0-21swapper/123:30:001
12095991714,2cyclictest8777-21fgrep22:50:221
12095991714,2cyclictest25163-21expr20:30:111
12095991714,2cyclictest2103-21nfsd423:35:181
12095991714,2cyclictest19185-21cut20:20:011
12095991714,2cyclictest1677-21sshd00:34:071
12095991714,2cyclictest15492-21python323:05:001
12095991714,2cyclictest1404-21lxd20:44:531
1209599171,15cyclictest0-21swapper/121:42:301
1209599170,2cyclictest4776-21lxd21:20:521
1209599170,2cyclictest29626-21cut00:25:151
1209599170,2cyclictest26836-21processes22:25:201
1209599170,2cyclictest26836-21processes22:25:191
1209599170,2cyclictest17659-21nvmesmart_nvme023:05:191
1209599170,2cyclictest16517-21grep21:10:161
1209599170,1cyclictest4538-21H212:26:331
1209599170,16cyclictest8517-21apt-key21:55:011
1209599170,16cyclictest4469-21expr20:50:141
1209599170,16cyclictest30559-21nfsd419:40:181
1209599170,16cyclictest2798-21expr21:45:131
1209599170,16cyclictest27028-21df19:35:131
1209599170,16cyclictest27003-21http_loadtime00:20:151
1209599170,16cyclictest24453-21fschecks_time21:25:151
1209599170,16cyclictest23295-21cron19:30:011
1209599170,16cyclictest22812-21grep22:20:121
1209599170,16cyclictest18253-21/usr/sbin/munin19:20:151
1209599170,16cyclictest1444-21apt-get22:40:101
1209599170,16cyclictest14047-21munin-run22:05:001
1209599170,16cyclictest1104-21lldpd21:55:591
1209599170,16cyclictest10681-21cron20:05:001
1209599170,16cyclictest0-21swapper/123:49:081
12097991614,1cyclictest0-21swapper/223:50:192
12097991614,1cyclictest0-21swapper/223:00:132
12097991614,1cyclictest0-21swapper/221:30:212
12097991614,1cyclictest0-21swapper/220:50:142
12097991614,1cyclictest0-21swapper/220:35:192
12097991614,1cyclictest0-21swapper/220:00:132
12097991614,1cyclictest0-21swapper/219:30:192
12097991614,1cyclictest0-21swapper/219:20:112
12097991613,2cyclictest4532-21H212:26:332
12097991613,2cyclictest31263-21cat22:35:132
12097991613,2cyclictest21051-21apache_volume21:20:112
1209799160,1cyclictest29531-21expr00:25:132
1209799160,1cyclictest1941-21missed_timers23:35:172
1209799160,1cyclictest0-21swapper/221:25:142
1209799160,1cyclictest0-21swapper/221:05:132
1209799160,1cyclictest0-21swapper/219:25:132
1209799160,15cyclictest7931-21missed_timers20:55:152
1209799160,15cyclictest20475-21df22:15:132
1209799160,15cyclictest0-21swapper/223:30:122
1209799160,15cyclictest0-21swapper/220:30:202
12095991615,1cyclictest0-21swapper/121:05:131
12095991614,1cyclictest27553-21cat21:30:161
12095991614,1cyclictest23926-21expr00:15:131
12095991614,1cyclictest0-21swapper/123:40:121
12095991614,1cyclictest0-21swapper/120:10:141
12095991614,1cyclictest0-21swapper/120:10:131
1209599161,14cyclictest0-21swapper/119:33:111
1209599160,1cyclictest0-21swapper/122:55:131
1209599160,1cyclictest0-21swapper/122:10:151
1209599160,15cyclictest32755-21fschecks_time19:45:141
1209599160,15cyclictest32182-21timerandwakeup23:30:211
1209599160,15cyclictest30815-21apache_accesses22:35:101
1209599160,15cyclictest2997-21expr19:50:141
1209599160,15cyclictest19878-21/usr/sbin/munin22:15:101
1209599160,15cyclictest12752-21expr23:55:141
1209599160,15cyclictest0-21swapper/123:20:161
1209599160,15cyclictest0-21swapper/122:30:161
1209599160,15cyclictest0-21swapper/121:00:131
1209599160,15cyclictest0-21swapper/120:49:401
1209599160,15cyclictest0-21swapper/120:20:161
1209599160,15cyclictest0-21swapper/119:55:191
1209599160,15cyclictest0-21swapper/100:05:211
12095991513,1cyclictest0-21swapper/123:50:391
12095991513,1cyclictest0-21swapper/120:25:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional