You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 22:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot0.osadl.org (updated Wed Dec 03, 2025 12:46:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3073199230,19cyclictest0-21swapper/211:17:212
3072499230,18cyclictest0-21swapper/111:40:011
3073199222,17cyclictest0-21swapper/210:30:002
30731992112,6cyclictest0-21swapper/212:11:192
3072299210,19cyclictest414-20systemd-journal07:59:560
3072299210,18cyclictest0-21swapper/007:25:150
3073199202,17cyclictest16600-21cpuspeed_turbos12:25:152
30731992017,2cyclictest12169-21cut12:15:182
3073199200,17cyclictest24270-21cpuspeed_turbos07:55:142
30724992017,2cyclictest4532-21H212:26:331
3072299206,12cyclictest0-21swapper/009:13:500
30731991917,1cyclictest0-21swapper/211:14:242
30731991916,2cyclictest2071-21sed12:00:012
30731991913,3cyclictest0-21swapper/212:35:012
3072499194,1cyclictest0-21swapper/107:39:581
3072499193,15cyclictest0-21swapper/110:59:331
3072499193,15cyclictest0-21swapper/107:51:521
30724991917,1cyclictest0-21swapper/107:59:451
30724991916,2cyclictest4538-21H212:26:331
30724991914,4cyclictest12044-21cat10:25:011
30722991917,1cyclictest0-21swapper/012:24:060
30722991917,1cyclictest0-21swapper/011:12:290
30722991917,1cyclictest0-21swapper/010:35:160
30722991917,1cyclictest0-21swapper/007:16:270
3072299191,2cyclictest4532-21H212:26:330
3072299190,16cyclictest4581-21H212:26:330
3072299190,16cyclictest4530-21H212:26:330
3073199182,15cyclictest28-21ksoftirqd/210:43:002
3073199182,15cyclictest0-21swapper/210:45:182
30731991817,1cyclictest28-21ksoftirqd/208:54:212
30731991816,1cyclictest0-21swapper/211:53:432
30731991816,1cyclictest0-21swapper/208:30:172
30731991815,2cyclictest6584-21expr08:20:162
30731991815,2cyclictest15873-21taskset12:24:112
30731991815,2cyclictest15064-21pzem_power09:30:202
3073199181,16cyclictest18966-21/usr/sbin/munin11:35:122
3073199180,2cyclictest4530-21H212:26:332
3073199180,17cyclictest1304-21lxd11:05:052
3073199180,17cyclictest1304-21lxd11:05:052
3072499183,1cyclictest21-21ksoftirqd/110:25:391
3072499182,15cyclictest0-21swapper/112:33:461
30724991816,1cyclictest0-21swapper/111:20:161
30724991816,1cyclictest0-21swapper/109:05:211
30724991814,3cyclictest454-21plymouthd08:50:161
3072499180,17cyclictest4528-21H212:26:331
30722991816,1cyclictest9-21ksoftirqd/010:40:310
30722991816,1cyclictest9-21ksoftirqd/007:21:340
30722991815,2cyclictest4581-21H212:26:330
30722991815,2cyclictest31256-21dump-pmu-power11:00:000
30722991814,3cyclictest20738-21cupsd08:30:120
3072299181,2cyclictest19880-21nfsd407:45:180
3072299180,4cyclictest0-21swapper/011:02:440
3072299180,15cyclictest4532-21H212:26:330
30731991714,2cyclictest4534-21H212:26:332
30731991714,2cyclictest4534-21H212:26:332
30731991714,2cyclictest4528-21H212:26:332
30731991714,2cyclictest4526-21H212:26:332
30731991714,2cyclictest4526-21H212:26:332
30731991714,2cyclictest4526-21H212:26:332
30731991714,2cyclictest3728-21mailstats09:10:222
30731991714,2cyclictest32563-21cut07:10:222
30731991714,2cyclictest29878-21cstates08:05:142
30731991714,2cyclictest26277-21grep10:50:132
30731991714,2cyclictest25581-21cpuspeed_turbos11:45:132
30731991714,2cyclictest25327-21expr09:50:132
30731991714,2cyclictest23682-21tr11:40:182
30731991714,2cyclictest21404-21apache_processe07:50:122
30731991714,2cyclictest16519-21awk10:30:192
30731991714,2cyclictest10375-21taskset09:25:032
30731991714,2cyclictest1012-21cpuspeed_turbos10:05:142
3073199171,15cyclictest0-21swapper/207:27:102
3073199170,2cyclictest9989-21munin-run09:25:012
3073199170,2cyclictest9989-21munin-run09:25:012
3073199170,2cyclictest4534-21H212:26:332
3073199170,2cyclictest21542-21nfsd408:45:192
3073199170,2cyclictest12139-21awk11:20:192
3073199170,1cyclictest4526-21H212:26:332
3073199170,16cyclictest5858-21cat08:20:002
3073199170,16cyclictest4581-21H212:26:332
3073199170,16cyclictest4532-21H212:26:332
3073199170,16cyclictest4530-21H212:26:332
3073199170,16cyclictest28984-21grep09:55:212
3073199170,16cyclictest2765-21expr07:15:202
3073199170,16cyclictest26857-21/usr/sbin/munin08:00:182
3073199170,16cyclictest24009-21cat09:45:222
3073199170,16cyclictest2079-21systemd-udevd11:27:062
3073199170,16cyclictest19954-21nfsd407:45:192
3073199170,16cyclictest19161-21munin-run09:40:012
3073199170,16cyclictest17941-21grep10:35:152
3073199170,16cyclictest17454-21runrttasks07:40:222
3073199170,16cyclictest14434-21dpkg08:35:012
3073199170,16cyclictest11980-21perf10:25:012
3073199170,16cyclictest0-21swapper/211:00:192
3073199170,16cyclictest0-21swapper/210:01:532
3073199170,16cyclictest0-21swapper/207:20:142
30724991715,1cyclictest26121-21missed_timers09:50:171
30724991715,1cyclictest0-21swapper/109:10:241
30724991714,2cyclictest4581-21H212:26:331
30724991714,2cyclictest4538-21H212:26:331
30724991714,2cyclictest4538-21H212:26:331
30724991714,2cyclictest4538-21H212:26:331
30724991714,2cyclictest4534-21H212:26:331
30724991714,2cyclictest4528-21H212:26:331
30724991714,2cyclictest4260-21cat07:20:021
30724991714,2cyclictest32687-21ntp_kernel_err11:55:191
30724991714,2cyclictest32687-21ntp_kernel_err11:55:191
30724991714,2cyclictest2611-21cat08:15:021
30724991714,2cyclictest24677-21python311:45:011
30724991714,2cyclictest16521-21grep12:25:141
30724991714,2cyclictest1628-21fschecks_time10:05:161
30724991714,2cyclictest15668-21expr10:30:141
30724991713,3cyclictest454-21plymouthd11:50:021
3072499170,2cyclictest9848-21cat11:15:241
3072499170,2cyclictest4581-21H212:26:331
3072499170,2cyclictest4530-21H212:26:331
3072499170,2cyclictest4526-21H212:26:331
3072499170,2cyclictest18041-21expr10:35:141
3072499170,1cyclictest4528-21H212:26:331
3072499170,16cyclictest881-21avahi-daemon12:05:241
3072499170,16cyclictest5576-21smartctl10:10:201
3072499170,16cyclictest4534-21H212:26:331
3072499170,16cyclictest4534-21H212:26:331
3072499170,16cyclictest4532-21H212:26:331
3072499170,16cyclictest4532-21H212:26:331
3072499170,16cyclictest4526-21H212:26:331
3072499170,16cyclictest4526-21H212:26:331
3072499170,16cyclictest30145-21systemctl09:00:211
3072499170,16cyclictest30018-21snapd07:30:501
3072499170,16cyclictest25916-21cut10:50:011
30722991715,1cyclictest0-21swapper/011:28:510
30722991715,1cyclictest0-21swapper/011:15:150
30722991715,1cyclictest0-21swapper/009:01:590
30722991714,2cyclictest8468-21if_eno109:20:160
30722991714,2cyclictest8468-21if_eno109:20:150
30722991714,2cyclictest4530-21H212:26:330
30722991714,2cyclictest4528-21H212:26:330
30722991714,2cyclictest4526-21H212:26:330
30722991714,2cyclictest4526-21H212:26:330
30722991714,2cyclictest2049-21systemd-journal12:14:140
30722991714,2cyclictest18906-21cut08:40:180
30722991714,2cyclictest16673-21apache_volume09:35:150
30722991714,2cyclictest14288-21grep07:35:220
30722991714,2cyclictest11364-21expr11:20:160
30722991713,3cyclictest0-21swapper/011:45:210
3072299171,15cyclictest4581-21H212:26:330
3072299171,15cyclictest11142sleep011:58:070
3072299171,15cyclictest11142sleep011:58:060
3072299171,15cyclictest0-21swapper/008:53:120
3072299170,2cyclictest6123-21nfsd409:15:190
3072299170,2cyclictest4581-21H212:26:330
3072299170,2cyclictest29498-21kernelversion11:50:150
3072299170,2cyclictest26252-21cat08:55:150
3072299170,2cyclictest26252-21cat08:55:140
3072299170,2cyclictest21697-21expr07:50:130
3072299170,2cyclictest20738-21cupsd09:27:530
3072299170,2cyclictest1332-21latency_hist07:15:010
3072299170,1cyclictest4581-21H212:26:330
3072299170,16cyclictest9923-21ls10:20:120
3072299170,16cyclictest6010-21/usr/sbin/munin08:20:200
3072299170,16cyclictest4530-21H212:26:330
3072299170,16cyclictest30007-21snapd08:28:360
3072299170,16cyclictest25095-21readlink11:45:010
3072299170,16cyclictest23037-21cron10:49:550
3072299170,16cyclictest19556-21/usr/sbin/munin09:40:210
3072299170,16cyclictest18877-21munin-plugin-st12:30:000
3072299170,16cyclictest16039-21ls07:40:140
3072299170,16cyclictest1355-21lxd12:38:510
3072299170,16cyclictest11491-21grep07:30:180
30731991614,1cyclictest0-21swapper/211:55:152
30731991614,1cyclictest0-21swapper/211:55:142
30731991614,1cyclictest0-21swapper/210:55:122
30731991614,1cyclictest0-21swapper/209:15:142
30731991614,1cyclictest0-21swapper/208:25:142
30731991613,2cyclictest683-21df08:10:152
3073199160,15cyclictest0-21swapper/212:35:142
30724991614,1cyclictest27825-21switchtime10:50:211
30724991614,1cyclictest26954-21grep08:00:161
30724991614,1cyclictest19657-21latency07:45:171
30724991614,1cyclictest0-21swapper/112:35:151
30724991614,1cyclictest0-21swapper/112:10:141
30724991614,1cyclictest0-21swapper/111:05:201
30724991614,1cyclictest0-21swapper/111:05:191
30724991614,1cyclictest0-21swapper/111:00:221
30724991614,1cyclictest0-21swapper/109:35:021
30724991614,1cyclictest0-21swapper/109:25:141
30724991614,1cyclictest0-21swapper/108:40:141
30724991614,1cyclictest0-21swapper/108:20:221
3072499160,15cyclictest20305-21/usr/sbin/munin08:45:141
3072499160,15cyclictest13872-21expr09:30:141
3072499160,15cyclictest0-21swapper/112:00:011
3072499160,15cyclictest0-21swapper/111:45:011
3072499160,15cyclictest0-21swapper/111:30:131
3072499160,15cyclictest0-21swapper/108:25:141
3072499160,15cyclictest0-21swapper/108:05:301
3072499160,15cyclictest0-21swapper/107:40:171
30722991614,1cyclictest0-21swapper/010:25:140
30722991613,2cyclictest1500-21grep08:10:180
3072299160,1cyclictest4094-21apache_volume10:10:130
3072299160,15cyclictest30001-21snapd10:51:370
3072299160,15cyclictest2999-21apache_processe08:15:120
3072299160,15cyclictest2203-21cpuspeed_turbos11:05:130
3072299160,15cyclictest2203-21cpuspeed_turbos11:05:130
3072299160,15cyclictest15493-21smtpd09:30:280
3072299160,15cyclictest1472-21lxd08:05:040
3072299160,15cyclictest0-21swapper/010:15:160
3072299160,15cyclictest0-21swapper/009:45:140
3072299160,15cyclictest0-21swapper/009:05:020
3072299150,1cyclictest0-21swapper/012:05:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional