You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-13 - 12:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot0.osadl.org (updated Sun Jul 13, 2025 00:45:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17359993230,0cyclictest0-21swapper/220:25:172
17357992322,1cyclictest0-21swapper/020:05:230
1735799230,5cyclictest0-21swapper/022:31:130
1735799230,5cyclictest0-21swapper/020:15:000
1735799221,3cyclictest9-21ksoftirqd/000:05:330
17359992114,3cyclictest0-21swapper/223:51:572
1735899212,15cyclictest19981-21perf19:15:001
17358992111,0cyclictest0-21swapper/122:05:191
17357992121,0cyclictest17000-21kworker/0:222:24:090
1735799210,4cyclictest0-21swapper/023:15:270
1735799210,3cyclictest0-21swapper/023:44:340
1735799210,17cyclictest0-21swapper/021:12:090
17359992014,3cyclictest0-21swapper/219:26:542
1735899203,16cyclictest19448-21apt-get22:05:011
1735799202,16cyclictest21138-21latency_hist23:05:010
1735799200,9cyclictest0-21swapper/019:30:160
17359991917,1cyclictest0-21swapper/221:06:262
17359991916,2cyclictest28330-21munin-run22:20:012
17359991915,2cyclictest4795-21grep20:40:162
17359991915,2cyclictest4795-21grep20:40:162
17359991915,2cyclictest17985-21python321:05:012
1735999190,1cyclictest0-21swapper/223:45:242
1735999190,18cyclictest0-21swapper/221:50:162
1735899193,15cyclictest8012-21cstates22:40:141
1735899192,2cyclictest5782-21ls21:40:001
17358991919,0cyclictest0-21swapper/122:15:191
17358991917,1cyclictest0-21swapper/121:15:181
17358991916,2cyclictest27256-21mii-tool00:10:171
17358991915,1cyclictest0-21swapper/100:20:261
17358991914,4cyclictest0-21swapper/122:55:011
17358991914,3cyclictest0-21swapper/100:00:151
17358991914,2cyclictest1239-21fschecks_count23:25:181
1735899191,16cyclictest9543-21nvmesmart_nvme000:35:201
1735899190,18cyclictest0-21swapper/123:15:431
1735799193,15cyclictest0-21swapper/000:39:450
17357991917,1cyclictest0-21swapper/023:07:350
1735999184,11cyclictest4529-21H212:26:332
17359991815,2cyclictest4532-21H212:26:332
17359991814,3cyclictest0-21swapper/223:32:182
1735999181,16cyclictest19365-21smartctl23:55:212
1735999181,16cyclictest1086-21snmpd20:56:042
1735899182,15cyclictest199712sleep123:56:241
1735899182,15cyclictest14055-21nfsd420:55:201
1735899182,15cyclictest0-21swapper/120:35:151
17358991816,1cyclictest0-21swapper/123:00:211
17358991816,1cyclictest0-21swapper/121:28:521
17358991816,1cyclictest0-21swapper/121:10:251
17358991815,2cyclictest15878-21fschecks_time23:50:161
17358991815,2cyclictest0-21swapper/123:30:241
17358991815,1cyclictest0-21swapper/123:20:171
17358991815,1cyclictest0-21swapper/100:34:001
17358991814,3cyclictest19958-21grep21:05:211
17358991814,1cyclictest0-21swapper/122:35:181
17358991813,3cyclictest0-21swapper/121:31:481
1735899181,16cyclictest0-21swapper/120:10:001
1735899180,3cyclictest29501-21latency_hist21:25:011
1735899180,3cyclictest13565-21munin-run20:00:011
1735899180,17cyclictest1324-21cron22:30:001
1735899180,17cyclictest1324-21cron22:30:001
1735899180,17cyclictest0-21swapper/122:20:251
1735899180,16cyclictest0-21swapper/119:15:001
1735899180,15cyclictest0-21swapper/123:40:231
17357991816,1cyclictest0-21swapper/019:36:130
1735799180,3cyclictest6583-21cut00:30:200
1735799180,3cyclictest1304-21lxd23:12:560
17359991715,1cyclictest261032sleep219:23:072
17359991715,1cyclictest12670-21open_files19:55:232
17359991715,1cyclictest11421-21latency22:45:172
17359991715,1cyclictest0-21swapper/223:20:102
17359991714,2cyclictest9608-21fschecks_time21:45:152
17359991714,2cyclictest4528-21H212:26:332
17359991714,2cyclictest3350-21master19:45:442
17359991714,2cyclictest28869-21tr22:20:162
17359991714,2cyclictest1959-21expr22:30:172
17359991714,2cyclictest1219-21sed00:20:252
17359991713,3cyclictest454-21plymouthd20:10:252
17359991713,2cyclictest311232chrt00:15:402
1735999171,2cyclictest967-21thermald22:10:222
17359991712,3cyclictest0-21swapper/200:35:152
1735999171,15cyclictest0-21swapper/222:40:142
1735999171,15cyclictest0-21swapper/219:41:202
1735999170,2cyclictest7313-21/usr/sbin/munin20:45:132
1735999170,2cyclictest4669-21chrt00:25:562
1735999170,2cyclictest454-21plymouthd19:50:242
1735999170,2cyclictest28721-21grep23:15:192
1735999170,2cyclictest22761-21needreboot21:10:182
1735999170,2cyclictest18763-21proxymap20:06:352
1735999170,2cyclictest17710-21df22:00:162
1735999170,16cyclictest6621-21cpuspeed_turbos23:35:172
1735999170,16cyclictest4435-21snapd19:19:112
1735999170,16cyclictest32243-21nfsd420:30:202
1735999170,16cyclictest32176-21if_enp1s022:25:212
1735999170,16cyclictest32176-21if_enp1s022:25:202
1735999170,16cyclictest31729-21munin-run19:35:022
1735999170,16cyclictest30421-21fschecks_count21:25:152
1735999170,16cyclictest24751-21/usr/sbin/munin23:10:182
1735999170,16cyclictest22323-21/usr/sbin/munin20:15:192
1735999170,16cyclictest22252-21sendmail_mailqu00:00:222
1735999170,16cyclictest19538-21http22:05:012
1735999170,16cyclictest10758-21hddtemp_smartct20:50:162
1735899175,11cyclictest0-21swapper/119:45:151
17358991715,1cyclictest23868-21which22:10:151
17358991715,1cyclictest0-21swapper/120:30:171
17358991714,2cyclictest414-20systemd-journal19:39:001
17358991714,2cyclictest29829-21expr19:30:151
17358991714,2cyclictest27446-21basename19:25:171
17358991714,2cyclictest25550-21cat23:10:161
17358991714,2cyclictest25265-21date20:20:011
17358991714,2cyclictest2263-21expr22:30:181
17358991714,2cyclictest20794-21cut20:10:211
17358991714,2cyclictest18058-21cat21:05:011
17358991714,2cyclictest13981-21/usr/sbin/munin20:00:211
17358991714,2cyclictest13058-21sed23:45:211
17358991714,2cyclictest11870-21tr21:50:171
17358991714,2cyclictest10960-21latency_hist19:55:001
17358991714,2cyclictest10069-21egrep20:50:141
17358991713,3cyclictest0-21swapper/120:46:071
1735899170,2cyclictest4943-21cstates20:40:171
1735899170,2cyclictest4943-21cstates20:40:161
1735899170,2cyclictest31597-21munin-plugin-st00:20:001
1735899170,2cyclictest2337-21apache_accesses00:25:121
1735899170,2cyclictest21761-21dpkg23:05:031
1735899170,2cyclictest10616-21cat21:45:221
1735899170,16cyclictest881-21avahi-daemon00:05:261
1735899170,16cyclictest7438-21sed23:35:191
1735899170,16cyclictest4193-21nfsd419:40:231
1735899170,16cyclictest28206-21chrt20:25:121
1735899170,16cyclictest24746-21latency_hist20:20:011
1735899170,16cyclictest23715-21dpkg19:20:021
1735899170,16cyclictest14687-21ls21:55:151
1735899170,16cyclictest11690-21nfsd422:45:171
1735799172,1cyclictest140682chrt23:45:430
17357991717,0cyclictest0-21swapper/023:32:480
17357991715,1cyclictest0-21swapper/022:35:180
17357991715,1cyclictest0-21swapper/021:20:410
17357991715,1cyclictest0-21swapper/020:51:480
17357991714,2cyclictest4525-21H212:26:330
17357991714,2cyclictest24319-21find21:15:120
17357991714,2cyclictest20086-21chrt23:57:520
17357991714,2cyclictest16357-21expr22:55:170
17357991714,2cyclictest15688-21munin-plugin-st22:55:000
17357991714,2cyclictest0-21swapper/020:45:160
17357991714,1cyclictest0-21swapper/019:58:480
17357991713,3cyclictest0-21swapper/023:21:510
1735799171,15cyclictest29040-21iwlist20:25:170
1735799171,15cyclictest0-21swapper/023:53:080
1735799170,2cyclictest29237-21munin-run19:30:020
1735799170,2cyclictest19708-21grep22:05:010
1735799170,2cyclictest13019-21expr20:55:150
1735799170,16cyclictest9148-21grep19:50:170
1735799170,16cyclictest6735-21expr21:40:170
1735799170,16cyclictest4536-21H212:26:330
1735799170,16cyclictest26714-21grep20:20:200
1735799170,16cyclictest24303-21needreboot22:10:180
1735799170,16cyclictest21356-21expr19:15:170
1735799170,16cyclictest2049-21systemd-journal19:45:180
1735799170,16cyclictest0-21swapper/000:15:190
17359991614,1cyclictest21900-21apt-get23:05:142
17359991614,1cyclictest0-21swapper/223:27:062
17359991614,1cyclictest0-21swapper/222:55:172
17359991614,1cyclictest0-21swapper/222:50:172
17359991614,1cyclictest0-21swapper/221:55:162
17359991614,1cyclictest0-21swapper/221:40:012
17359991614,1cyclictest0-21swapper/221:40:012
17359991614,1cyclictest0-21swapper/221:30:132
17359991614,1cyclictest0-21swapper/220:00:222
17359991614,1cyclictest0-21swapper/219:35:172
17359991614,1cyclictest0-21swapper/200:10:212
1735999160,1cyclictest6921-21/usr/sbin/munin00:30:222
1735999160,15cyclictest9372-21apt-get23:40:142
1735999160,15cyclictest27344-21cstates21:20:162
1735999160,15cyclictest26792-21awk20:20:192
1735999160,15cyclictest25252-21cat00:05:272
1735999160,15cyclictest0-21swapper/222:35:182
1735999160,15cyclictest0-21swapper/221:15:142
1735899160,15cyclictest15931-21apache_processe22:55:151
17357991614,1cyclictest3145-21grep21:35:160
17357991614,1cyclictest26506-21grep00:10:150
17357991614,1cyclictest16300-21smartctl21:00:180
17357991614,1cyclictest14372-21expr20:00:170
17357991614,1cyclictest0-21swapper/022:40:160
17357991614,1cyclictest0-21swapper/022:25:270
17357991614,1cyclictest0-21swapper/022:25:270
17357991614,1cyclictest0-21swapper/021:30:180
17357991614,1cyclictest0-21swapper/021:25:230
17357991614,1cyclictest0-21swapper/020:35:150
17357991614,1cyclictest0-21swapper/020:30:180
17357991614,1cyclictest0-21swapper/020:15:250
17357991614,1cyclictest0-21swapper/019:20:010
17357991614,1cyclictest0-21swapper/000:00:130
17357991613,2cyclictest11719-21grep21:50:180
1735799161,1cyclictest557-21missed_timers00:20:200
1735799160,1cyclictest926-21expr23:25:160
1735799160,1cyclictest0-21swapper/022:05:200
1735799160,15cyclictest4434-21snapd20:44:110
1735799160,15cyclictest4434-21snapd20:44:100
1735799160,15cyclictest27099-21nfsd422:15:200
1735799160,15cyclictest18877-21nfsd419:10:220
1735799160,15cyclictest0-21swapper/022:45:140
1735799160,15cyclictest0-21swapper/021:55:120
1735799160,15cyclictest0-21swapper/021:45:190
1735799160,15cyclictest0-21swapper/021:05:020
1735799160,15cyclictest0-21swapper/000:25:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional