You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-18 - 15:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot0.osadl.org (updated Fri Apr 18, 2025 12:46:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
77499230,22cyclictest823-21systemd-network12:19:242
77499220,1cyclictest0-21swapper/212:07:122
76999223,18cyclictest21-21ksoftirqd/112:25:011
76499220,4cyclictest0-21swapper/011:00:010
774992117,3cyclictest0-21swapper/212:21:292
77499210,20cyclictest823-21systemd-network07:30:512
76499210,4cyclictest4887-21python311:30:010
774991917,1cyclictest0-21swapper/209:27:582
76499190,3cyclictest28995-21needreboot11:10:130
76499190,17cyclictest5523-21systemctl12:35:210
76499190,17cyclictest5523-21systemctl12:35:210
774991814,3cyclictest1356-21lxd11:57:032
774991814,3cyclictest0-21swapper/208:58:112
77499180,16cyclictest20657-21ntp_kernel_pll_09:40:192
76999182,15cyclictest31872sleep112:33:421
769991816,1cyclictest15614-21cpuspeed_turbos07:35:171
769991815,2cyclictest28826-21wc12:15:221
769991815,2cyclictest25439-21switchtime11:00:241
769991814,3cyclictest28268-21apt-key10:00:011
769991814,3cyclictest28268-21apt-key10:00:011
76499182,15cyclictest9-21ksoftirqd/009:10:260
764991816,1cyclictest9-21ksoftirqd/011:35:000
764991816,1cyclictest0-21swapper/011:02:390
764991815,2cyclictest4534-21H212:26:330
76499180,2cyclictest0-21swapper/008:40:020
77499177,8cyclictest111rcu_preempt10:29:252
774991716,1cyclictest28-21ksoftirqd/207:41:572
774991715,1cyclictest0-21swapper/212:35:142
774991715,1cyclictest0-21swapper/212:35:142
774991715,1cyclictest0-21swapper/211:30:172
774991715,1cyclictest0-21swapper/208:45:012
774991715,1cyclictest0-21swapper/208:25:212
774991715,1cyclictest0-21swapper/208:15:172
774991715,1cyclictest0-21swapper/207:15:012
774991714,2cyclictest5030-21apt-config11:30:012
774991714,2cyclictest3692-21master08:45:062
774991714,2cyclictest3441-21gsd-color12:25:542
774991714,2cyclictest30090-21cat08:00:162
774991714,2cyclictest27974-21ls08:55:002
774991714,2cyclictest17236-21switchtime07:35:242
774991714,2cyclictest10127-21grep08:20:212
774991714,2cyclictest10002-21sh07:25:012
77499171,1cyclictest0-21swapper/209:00:212
77499170,2cyclictest28407-21cat10:00:012
77499170,2cyclictest27756-21cron10:00:002
77499170,2cyclictest27756-21cron09:59:592
77499170,2cyclictest26481-21apt-config11:05:032
77499170,2cyclictest24691-21uname11:00:192
77499170,2cyclictest1879-21grep08:05:232
77499170,2cyclictest16008-21nfsd411:50:142
77499170,2cyclictest15830-21nfsd408:30:222
77499170,2cyclictest10613-21ntp_states10:30:292
77499170,1cyclictest4593-21H212:26:332
77499170,1cyclictest0-21swapper/210:15:012
77499170,16cyclictest5206-21smtp10:18:442
77499170,16cyclictest4748-21nfsd408:10:222
77499170,16cyclictest4748-21nfsd408:10:222
77499170,16cyclictest4348-21munin-plugin-st09:10:012
77499170,16cyclictest30198-21python311:14:592
77499170,16cyclictest23924-21grep07:50:182
77499170,16cyclictest10580-21expr09:20:162
77499170,16cyclictest0-21swapper/211:40:202
77499170,16cyclictest0-21swapper/207:55:022
769991716,0cyclictest0-21swapper/110:35:161
769991715,1cyclictest640-21cat10:10:121
769991715,1cyclictest1117-21latency08:05:181
769991715,1cyclictest0-21swapper/109:02:511
769991715,1cyclictest0-21swapper/108:20:211
769991714,2cyclictest27536-21lxd08:35:031
769991714,2cyclictest24343-21ls07:50:181
769991714,2cyclictest15434-21fschecks_time11:50:111
769991714,2cyclictest1155-21snapd11:41:431
769991714,1cyclictest0-21swapper/110:00:171
76999171,2cyclictest22751-21acpi09:50:081
76999171,1cyclictest5690-21grep07:15:221
76999171,15cyclictest1359-21grep07:10:141
76999171,15cyclictest0-21swapper/110:50:141
76999170,2cyclictest15088-21cron07:35:001
76999170,1cyclictest4593-21H212:26:331
76999170,16cyclictest5425-21fschecks_time09:10:181
76999170,16cyclictest4532-21H212:26:331
76999170,16cyclictest4532-21H212:26:331
76999170,16cyclictest30617-21kernelversion08:00:191
76999170,16cyclictest26692-21apt-config11:05:031
76999170,16cyclictest25041-21nfsd412:10:131
76999170,16cyclictest23743-21munin-plugin-st12:10:001
76999170,16cyclictest20984-21sed07:45:011
76999170,16cyclictest1007-21cron09:05:011
76999170,15cyclictest0-21swapper/110:55:171
76999170,14cyclictest0-21swapper/111:25:231
764991715,1cyclictest9-21ksoftirqd/010:50:290
764991715,1cyclictest9-21ksoftirqd/008:45:200
764991715,1cyclictest9-21ksoftirqd/007:20:220
764991714,2cyclictest4593-21H212:26:330
764991714,2cyclictest3360-21chrt07:11:450
764991714,2cyclictest27536-21lxd10:03:030
764991714,2cyclictest13509-21sendmail_mailst10:35:190
764991714,2cyclictest12374-21cron07:30:010
764991714,1cyclictest26318-21kworker/0:212:26:570
764991713,2cyclictest28305-21nfsd407:55:190
76499171,15cyclictest9-21ksoftirqd/011:55:150
76499171,15cyclictest0-21swapper/009:07:380
76499170,2cyclictest640-21fschecks_count08:05:160
76499170,2cyclictest31918-21sed11:15:170
76499170,2cyclictest23003-21chrt12:06:420
76499170,2cyclictest1007-21cron09:05:010
76499170,1cyclictest4593-21H212:26:330
76499170,1cyclictest0-21swapper/008:00:170
76499170,16cyclictest8208-21cut10:25:010
76499170,16cyclictest4534-21H212:26:330
76499170,16cyclictest29649-21latency_hist12:20:010
76499170,16cyclictest22734-21/usr/sbin/munin09:50:130
76499170,16cyclictest17603-21awk09:35:200
76499170,16cyclictest1132-21snapd08:13:430
76499170,16cyclictest1132-21snapd08:13:430
76499170,16cyclictest10828-21fschecks_count09:20:170
76499170,16cyclictest0-21swapper/008:50:210
76499170,15cyclictest0-21swapper/009:40:180
76499170,15cyclictest0-21swapper/007:50:220
774991614,1cyclictest17126-21chrt10:44:592
774991614,1cyclictest0-21swapper/211:20:172
774991614,1cyclictest0-21swapper/210:35:182
774991614,1cyclictest0-21swapper/209:35:032
774991614,1cyclictest0-21swapper/209:30:102
774991614,1cyclictest0-21swapper/209:30:092
774991614,1cyclictest0-21swapper/209:20:012
774991614,1cyclictest0-21swapper/209:14:302
774991614,1cyclictest0-21swapper/207:20:132
77499160,2cyclictest21476-21expr07:45:142
77499160,1cyclictest4532-21H212:26:332
77499160,1cyclictest0-21swapper/212:12:472
77499160,1cyclictest0-21swapper/212:00:142
77499160,1cyclictest0-21swapper/211:15:142
77499160,15cyclictest6343-21df10:20:162
77499160,15cyclictest4582-21H212:26:332
77499160,15cyclictest23603-21if_err_enp1s009:50:132
77499160,15cyclictest1880-21ls12:30:132
77499160,15cyclictest0-21swapper/211:35:182
77499160,15cyclictest0-21swapper/210:55:152
77499160,15cyclictest0-21swapper/210:50:132
77499160,15cyclictest0-21swapper/207:15:082
769991615,1cyclictest4534-21H212:26:331
769991615,1cyclictest21-21ksoftirqd/112:26:361
769991614,1cyclictest8776-21expr11:35:131
769991614,1cyclictest28159-21nfsd407:55:191
769991614,1cyclictest22914-21/usr/sbin/munin08:45:181
769991614,1cyclictest0-21swapper/111:46:471
769991614,1cyclictest0-21swapper/110:30:101
769991614,1cyclictest0-21swapper/110:20:191
769991614,1cyclictest0-21swapper/109:48:541
769991614,1cyclictest0-21swapper/108:25:161
769991613,2cyclictest3839-21/usr/sbin/munin12:35:121
769991613,2cyclictest3839-21/usr/sbin/munin12:35:121
769991613,2cyclictest19291-21apache_processe09:40:131
76999160,2cyclictest6554-21expr08:15:151
76999160,2cyclictest17021-21tune2fs09:35:171
76999160,1cyclictest0-21swapper/111:10:101
76999160,1cyclictest0-21swapper/109:20:151
76999160,1cyclictest0-21swapper/107:45:111
76999160,1cyclictest0-21swapper/107:20:131
76999160,15cyclictest8151-21fschecks_time09:15:151
76999160,15cyclictest4525-21H212:26:331
76999160,15cyclictest29446-21missed_timers08:55:181
76999160,15cyclictest16018-21ntp_states08:30:231
76999160,15cyclictest15140-21cat10:40:151
76999160,15cyclictest13318-21sed09:30:001
76999160,15cyclictest0-21swapper/112:00:151
76999160,15cyclictest0-21swapper/111:32:091
76999160,15cyclictest0-21swapper/111:25:001
76999160,15cyclictest0-21swapper/111:15:131
76999160,15cyclictest0-21swapper/108:40:181
76999160,15cyclictest0-21swapper/107:25:241
764991614,1cyclictest9-21ksoftirqd/010:40:160
764991614,1cyclictest4039-21cat10:15:190
764991614,1cyclictest193012chrt08:35:460
764991614,1cyclictest1816-21expr11:20:140
764991614,1cyclictest0-21swapper/012:35:000
764991614,1cyclictest0-21swapper/012:00:320
764991614,1cyclictest0-21swapper/011:46:360
764991614,1cyclictest0-21swapper/010:30:130
764991614,1cyclictest0-21swapper/008:55:170
764991613,2cyclictest1845-21systemd-journal09:28:480
764991611,3cyclictest4528-21H212:26:330
76499160,1cyclictest4532-21H212:26:330
76499160,1cyclictest220572chrt09:46:180
76499160,1cyclictest0-21swapper/010:29:250
76499160,1cyclictest0-21swapper/010:05:400
76499160,1cyclictest0-21swapper/008:25:140
76499160,15cyclictest9-21ksoftirqd/007:45:140
76499160,15cyclictest8653-21cat11:35:130
76499160,15cyclictest4596-21expr07:15:160
76499160,15cyclictest24265-21cat12:10:100
76499160,15cyclictest156692chrt09:30:570
76499160,15cyclictest156692chrt09:30:570
76499160,15cyclictest0-21swapper/012:20:140
76499160,15cyclictest0-21swapper/011:50:100
76499160,15cyclictest0-21swapper/011:40:210
76499160,15cyclictest0-21swapper/009:55:170
76499160,15cyclictest0-21swapper/009:55:170
76499160,15cyclictest0-21swapper/008:33:260
76499160,15cyclictest0-21swapper/008:15:150
76499160,15cyclictest0-21swapper/007:30:190
774991514,1cyclictest0-21swapper/210:05:142
774991513,1cyclictest0-21swapper/210:48:322
769991513,1cyclictest0-21swapper/110:50:001
769991513,1cyclictest0-21swapper/108:10:251
769991513,1cyclictest0-21swapper/108:10:251
76499150,14cyclictest0-21swapper/011:05:030
76999140,14cyclictest0-21swapper/110:25:461
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional