You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 04:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot0.osadl.org (updated Sat Aug 30, 2025 00:46:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
375599240,19cyclictest22514-21nfsd400:25:192
374699220,4cyclictest0-21swapper/021:19:100
375599210,3cyclictest0-21swapper/219:20:032
375599210,1cyclictest0-21swapper/220:15:372
375599210,1cyclictest0-21swapper/220:15:372
375599203,16cyclictest18497-21nfsd423:20:212
3755992017,2cyclictest1754-21missed_timers21:55:182
375599200,19cyclictest823-21systemd-network23:43:052
375599193,15cyclictest0-21swapper/220:26:072
3755991914,4cyclictest0-21swapper/219:53:042
375599190,5cyclictest0-21swapper/219:14:262
375599190,18cyclictest0-21swapper/220:57:592
375099199,0cyclictest0-21swapper/121:45:191
374699193,15cyclictest0-21swapper/020:26:480
375599183,1cyclictest0-21swapper/222:01:332
375599182,15cyclictest0-21swapper/222:58:122
3755991818,0cyclictest0-21swapper/220:47:362
3755991816,1cyclictest0-21swapper/220:33:152
3755991816,1cyclictest0-21swapper/220:21:152
3755991815,2cyclictest21395-21memory22:30:192
3755991814,3cyclictest0-21swapper/222:45:162
375599181,2cyclictest14188-21chrt22:16:352
375599180,1cyclictest0-21swapper/222:40:132
375099182,15cyclictest5004-21nfsd422:00:181
3750991816,1cyclictest4536-21H212:26:331
3750991816,1cyclictest0-21swapper/120:26:421
3750991815,2cyclictest11807-21latency_hist22:15:011
3750991814,2cyclictest4523-21H212:26:331
375099181,16cyclictest21490-21cpuspeed_turbos00:25:151
375099180,3cyclictest12213-21awk23:10:181
375099180,2cyclictest4528-21H212:26:331
374699182,15cyclictest16632-21timerandwakeup22:20:200
3746991816,1cyclictest0-21swapper/020:30:260
374699180,2cyclictest4530-21H212:26:330
374699180,1cyclictest0-21swapper/023:40:120
374699180,17cyclictest4581-21H212:26:330
374699180,17cyclictest3707-21lxd19:16:550
374699180,17cyclictest0-21swapper/022:41:290
3755991716,1cyclictest28-21ksoftirqd/200:20:112
3755991715,1cyclictest4530-21H212:26:332
3755991715,1cyclictest24022-21latency22:35:182
3755991715,1cyclictest0-21swapper/223:05:162
3755991715,1cyclictest0-21swapper/222:25:522
3755991715,1cyclictest0-21swapper/219:40:052
3755991714,2cyclictest28777-21cpuspeed_turbos20:50:112
3755991714,2cyclictest20323-21expr23:25:132
3755991714,2cyclictest0-21swapper/200:05:182
375599171,15cyclictest0-21swapper/223:50:132
375599171,15cyclictest0-21swapper/219:59:512
375599170,2cyclictest8851-21sed22:09:012
375599170,2cyclictest823-21systemd-network23:58:032
375599170,2cyclictest8128-21tar21:10:022
375599170,2cyclictest6315-21awk21:05:202
375599170,2cyclictest6315-21awk21:05:202
375599170,2cyclictest24796-21/usr/sbin/munin21:40:172
375599170,2cyclictest23741-21latency23:30:172
375599170,2cyclictest1798-21systemd20:08:072
375599170,2cyclictest16768-21cat21:25:142
375599170,2cyclictest11745-21idleruntime21:15:182
375599170,1cyclictest0-21swapper/221:04:152
375599170,16cyclictest967-21thermald23:35:212
375599170,16cyclictest3441-21gsd-color21:35:222
375599170,16cyclictest30845-21expr21:50:172
375599170,16cyclictest30008-21snapd19:29:232
375599170,16cyclictest27530-21find21:45:142
375599170,16cyclictest18693-21expr19:35:172
375599170,16cyclictest14985-21nfsd421:20:192
375599170,16cyclictest1405-21lxd22:24:552
375599170,16cyclictest11924-21cut23:10:172
375599170,16cyclictest11362-21vmstat22:10:252
375599170,16cyclictest0-21swapper/220:35:192
3750991716,1cyclictest21-21ksoftirqd/122:42:461
3750991715,1cyclictest67272sleep123:57:581
3750991715,1cyclictest0-21swapper/122:50:231
3750991715,1cyclictest0-21swapper/119:41:001
3750991715,1cyclictest0-21swapper/119:14:571
3750991714,2cyclictest9407-21nfsd423:05:181
3750991714,2cyclictest7728-21expr00:00:151
3750991714,2cyclictest4536-21H212:26:331
3750991714,2cyclictest2908-21nfsd423:50:171
3750991714,2cyclictest27140-21cut20:45:201
3750991714,2cyclictest26440-21latency23:35:161
3750991714,2cyclictest23141-21apache_accesses20:40:121
3750991714,2cyclictest23141-21apache_accesses20:40:111
3750991714,2cyclictest20822-21/usr/sbin/munin20:35:151
3750991714,2cyclictest18506-21ntp_states20:30:191
3750991714,2cyclictest18045-21apt.systemd.dai00:19:071
3750991714,2cyclictest13423-21nfsd422:15:161
3750991714,1cyclictest0-21swapper/123:32:391
3750991712,3cyclictest0-21swapper/122:35:161
375099171,1cyclictest201rcuc/122:30:191
375099171,15cyclictest30775-21chrt22:46:381
375099171,15cyclictest0-21swapper/120:10:101
375099170,2cyclictest306242chrt20:50:321
375099170,2cyclictest27683-21tr00:35:181
375099170,2cyclictest27683-21tr00:35:171
375099170,2cyclictest1586-21cat20:00:231
375099170,16cyclictest7582-21apt-config21:10:011
375099170,16cyclictest7582-21apt-config21:10:001
375099170,16cyclictest7237-21/usr/sbin/munin19:15:191
375099170,16cyclictest4526-21H212:26:331
375099170,16cyclictest26163-21grep21:40:171
375099170,16cyclictest23800-21/usr/sbin/munin19:45:151
375099170,16cyclictest21890-21/usr/sbin/munin21:35:231
375099170,16cyclictest18758-21cron21:30:001
375099170,16cyclictest0-21swapper/121:10:181
3746991715,1cyclictest0-21swapper/023:16:040
3746991715,1cyclictest0-21swapper/023:16:040
3746991714,2cyclictest8823-21sessionclean22:09:000
3746991714,2cyclictest881-21avahi-daemon20:50:190
3746991714,2cyclictest6209-21cat20:10:140
3746991714,2cyclictest414-20systemd-journal23:09:000
3746991714,2cyclictest24450-21expr00:30:130
3746991714,2cyclictest23191-21nfsd421:35:190
3746991714,2cyclictest22892-21sed19:40:250
3746991714,2cyclictest19718-21cat21:30:150
3746991714,2cyclictest1840-21dpkg21:00:130
3746991714,2cyclictest17198-21ntp_states00:15:190
3746991714,2cyclictest14368-21awk00:10:210
3746991714,2cyclictest13611-21ps22:15:170
3746991713,3cyclictest32625-21processes23:45:210
374699171,15cyclictest8269-21uname00:00:170
374699171,15cyclictest26660-21cpuspeed_turbos19:50:140
374699170,3cyclictest0-21swapper/022:45:130
374699170,2cyclictest4776-21lxd19:10:550
374699170,2cyclictest4530-21H212:26:330
374699170,2cyclictest30007-21snapd23:01:440
374699170,2cyclictest29997-21snapd20:24:190
374699170,2cyclictest15242-21latency_hist19:30:020
374699170,2cyclictest1405-21lxd21:28:550
374699170,1cyclictest0-21swapper/021:59:370
374699170,1cyclictest0-21swapper/021:45:200
374699170,16cyclictest998-21gmain00:06:050
374699170,16cyclictest9658-21ntpq21:10:190
374699170,16cyclictest5289-21expr21:05:150
374699170,16cyclictest5289-21expr21:05:150
374699170,16cyclictest4536-21H212:26:330
374699170,16cyclictest4530-21H212:26:330
374699170,16cyclictest25759-21cut20:45:010
374699170,16cyclictest25759-21cut20:45:010
374699170,16cyclictest2134-21expr22:55:170
374699170,16cyclictest21198-21cut00:25:010
374699170,16cyclictest20951-21which20:35:160
374699170,16cyclictest2078-21perf20:05:020
374699170,16cyclictest20355-21/usr/sbin/munin22:30:130
374699170,16cyclictest0-21swapper/019:30:210
3755991614,1cyclictest0-21swapper/222:50:132
3755991614,1cyclictest0-21swapper/220:43:092
3755991614,1cyclictest0-21swapper/220:43:082
3755991614,1cyclictest0-21swapper/200:30:132
3755991613,2cyclictest7161-21gpg-connect-age19:15:022
375599160,2cyclictest0-21swapper/219:35:012
375599160,1cyclictest26831-21grep00:35:132
375599160,1cyclictest26831-21grep00:35:132
375599160,1cyclictest0-21swapper/221:30:162
375599160,1cyclictest0-21swapper/200:15:122
375599160,15cyclictest32030-21taskset20:00:092
375599160,15cyclictest25182-21ntpq19:45:162
375599160,15cyclictest14159-21sed00:10:212
375599160,15cyclictest1385-21latency_hist23:50:002
375599160,15cyclictest13742-21apt-config23:15:012
375599160,15cyclictest13742-21apt-config23:15:012
375599160,15cyclictest0-21swapper/223:00:152
3750991614,1cyclictest2367-21expr21:00:151
3750991614,1cyclictest0-21swapper/123:40:071
3750991614,1cyclictest0-21swapper/121:20:181
3750991614,1cyclictest0-21swapper/120:20:171
3750991614,1cyclictest0-21swapper/119:55:221
3750991614,1cyclictest0-21swapper/100:10:201
3750991613,2cyclictest782-21cpuspeed_turbos21:55:151
3750991613,2cyclictest6533-21dpkg22:05:121
3750991613,2cyclictest18699-21expr19:35:161
3750991613,2cyclictest16902-21master22:21:051
375099160,2cyclictest28011-21proc_pri19:50:201
375099160,1cyclictest0-21swapper/123:25:131
375099160,1cyclictest0-21swapper/122:55:211
375099160,1cyclictest0-21swapper/120:55:161
375099160,15cyclictest8390-21master20:15:021
375099160,15cyclictest8390-21master20:15:021
375099160,15cyclictest24939-21kernelversion00:30:161
375099160,15cyclictest2454-21/usr/sbin/munin20:05:151
375099160,15cyclictest17609-21/usr/sbin/munin22:25:121
375099160,15cyclictest13216-21expr19:25:131
375099160,15cyclictest0-21swapper/123:15:011
375099160,15cyclictest0-21swapper/123:15:011
375099160,15cyclictest0-21swapper/121:50:191
375099160,15cyclictest0-21swapper/121:25:221
375099160,15cyclictest0-21swapper/121:15:221
375099160,15cyclictest0-21swapper/119:30:141
375099160,15cyclictest0-21swapper/119:20:131
3746991614,1cyclictest0-21swapper/023:35:190
3746991614,1cyclictest0-21swapper/022:50:060
3746991614,1cyclictest0-21swapper/022:10:150
3746991614,1cyclictest0-21swapper/022:00:180
3746991614,1cyclictest0-21swapper/021:55:000
3746991614,1cyclictest0-21swapper/021:20:170
3746991614,1cyclictest0-21swapper/000:35:190
3746991614,1cyclictest0-21swapper/000:35:180
3746991614,1cyclictest0-21swapper/000:25:230
3746991613,2cyclictest29476-21cpuspeed_turbos19:55:140
374699160,1cyclictest0-21swapper/023:25:160
374699160,1cyclictest0-21swapper/022:25:200
374699160,1cyclictest0-21swapper/019:35:230
374699160,15cyclictest4593-21H212:26:330
374699160,15cyclictest0-21swapper/023:50:140
374699160,15cyclictest0-21swapper/023:20:240
374699160,15cyclictest0-21swapper/020:45:170
374699160,15cyclictest0-21swapper/020:15:230
374699160,15cyclictest0-21swapper/020:15:220
374699160,15cyclictest0-21swapper/020:05:190
3755991513,1cyclictest6424-21http_loadtime20:10:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional