You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 00:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot0.osadl.org (updated Mon Jun 30, 2025 12:46:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1257799230,22cyclictest0-21swapper/010:45:150
1258299220,5cyclictest0-21swapper/107:20:011
1258699210,17cyclictest0-21swapper/208:54:472
12582992117,3cyclictest2079-21systemd-udevd11:57:071
12582992117,3cyclictest2079-21systemd-udevd11:57:061
12577992121,0cyclictest0-21swapper/011:15:140
1258699200,17cyclictest0-21swapper/210:15:192
1258299201,18cyclictest0-21swapper/110:15:231
1257799200,19cyclictest0-21swapper/011:20:210
1258699193,1cyclictest0-21swapper/212:07:262
12586991916,2cyclictest28-21ksoftirqd/212:29:112
12586991916,2cyclictest13164-21wc10:00:222
12586991914,1cyclictest0-21swapper/210:40:432
1258699190,16cyclictest4530-21H212:26:332
1258699190,16cyclictest4523-21H212:26:332
1258699190,16cyclictest29262-21fschecks_time10:30:202
1258299192,11cyclictest26603-21perf09:30:001
12582991917,1cyclictest0-21swapper/109:45:201
12582991916,2cyclictest3066-21systemd-logind11:53:061
12582991914,2cyclictest22200-21cut09:20:221
1258299191,15cyclictest0-21swapper/110:50:001
1258299190,2cyclictest4581-21H212:26:331
1258299190,2cyclictest4581-21H212:26:331
1258299190,16cyclictest4536-21H212:26:331
12577991917,1cyclictest19282-21cut10:10:250
12577991917,1cyclictest0-21swapper/008:48:540
12577991917,1cyclictest0-21swapper/007:30:450
12577991916,2cyclictest4536-21H212:26:330
12577991916,2cyclictest15973-21wc09:10:020
12577991916,2cyclictest0-21swapper/012:28:120
1257799190,2cyclictest4523-21H212:26:330
1257799190,2cyclictest4523-21H212:26:330
1257799190,16cyclictest4528-21H212:26:330
1257799190,16cyclictest25618-21cat08:30:000
1258699182,2cyclictest0-21swapper/208:30:182
1258699182,15cyclictest0-21swapper/211:40:132
12586991816,1cyclictest0-21swapper/210:36:042
12586991815,2cyclictest27714-21expr11:25:182
12586991814,3cyclictest19644-21grep08:20:012
12586991814,3cyclictest0-21swapper/207:25:142
12586991813,4cyclictest0-21swapper/212:30:242
1258699181,16cyclictest4593-21H212:26:332
1258699181,16cyclictest0-21swapper/209:30:222
1258699180,3cyclictest823-21systemd-network11:53:012
1258699180,2cyclictest4593-21H212:26:332
1258699180,17cyclictest4593-21H212:26:332
1258699180,16cyclictest14916-21cpuspeed_turbos10:05:132
1258299182,15cyclictest17867-21cut11:05:231
1258299182,15cyclictest17867-21cut11:05:221
12582991816,1cyclictest29030-21mailstats09:30:281
12582991815,2cyclictest24001-21cat10:20:201
12582991815,2cyclictest13910-21cut09:05:191
12582991814,3cyclictest4530-21H212:26:331
12582991814,3cyclictest3354-21grep08:45:211
12582991814,3cyclictest0-21swapper/110:36:431
12582991814,3cyclictest0-21swapper/107:50:251
1258299181,2cyclictest4530-21H212:26:331
1258299181,2cyclictest19142-21expr09:15:181
1258299181,16cyclictest32520-21grep12:30:161
1258299181,16cyclictest0-21swapper/112:10:201
1258299180,9cyclictest0-21swapper/112:39:411
1258299180,3cyclictest4538-21H212:26:331
1258299180,2cyclictest4530-21H212:26:331
1258299180,1cyclictest0-21swapper/111:37:521
1258299180,17cyclictest4530-21H212:26:331
1258299180,17cyclictest4530-21H212:26:331
1258299180,17cyclictest19972-21ls12:05:271
1258299180,15cyclictest4528-21H212:26:331
1257799182,15cyclictest0-21swapper/007:55:010
12577991816,1cyclictest9-21ksoftirqd/012:11:320
12577991816,1cyclictest0-21swapper/009:35:240
12577991814,3cyclictest4523-21H212:26:330
12577991814,2cyclictest8998-21grep08:55:240
1257799180,2cyclictest4530-21H212:26:330
1257799180,17cyclictest4536-21H212:26:330
1257799180,17cyclictest4536-21H212:26:330
1257799180,17cyclictest4536-21H212:26:330
1257799180,17cyclictest4536-21H212:26:330
1257799180,17cyclictest11738-21nfsd409:00:230
1257799180,17cyclictest11738-21nfsd409:00:220
1257799180,15cyclictest4528-21H212:26:330
12586991715,1cyclictest0-21swapper/208:01:292
12586991714,2cyclictest7343-21netstat07:55:222
12586991714,2cyclictest6567-21/usr/sbin/munin09:50:172
12586991714,2cyclictest5772-21basename10:45:192
12586991714,2cyclictest4581-21H212:26:332
12586991714,2cyclictest4581-21H212:26:332
12586991714,2cyclictest4015-21ls09:45:182
12586991714,2cyclictest31801-21python307:45:012
12586991714,2cyclictest31779-21chrt09:35:292
12586991714,2cyclictest30833-21sessionclean08:39:012
12586991714,2cyclictest17675-21apache_accesses10:10:162
12586991714,2cyclictest14735-21pzem_power11:00:222
12586991714,2cyclictest0-21swapper/208:45:202
12586991712,3cyclictest30322-21https11:30:022
12586991712,3cyclictest30322-21https11:30:022
1258699171,1cyclictest26624-21cpuspeed_turbos07:35:142
1258699171,15cyclictest4532-21H212:26:332
1258699170,2cyclictest877-21apache_processe11:35:152
1258699170,2cyclictest8240-21if_lxdbr011:45:202
1258699170,2cyclictest4530-21H212:26:332
1258699170,2cyclictest4530-21H212:26:332
1258699170,2cyclictest4430-21missed_timers07:50:232
1258699170,2cyclictest28064-21latency12:20:232
1258699170,2cyclictest28064-21latency12:20:222
1258699170,2cyclictest17006-21fschecks_time11:05:172
1258699170,2cyclictest17006-21fschecks_time11:05:172
1258699170,2cyclictest13357-21cat08:05:252
1258699170,2cyclictest13156-21apt-get09:05:082
1258699170,2cyclictest10491-21netstat09:55:202
1258699170,16cyclictest2973-21apache_accesses12:35:122
1258699170,16cyclictest24302-21apache_accesses12:15:122
1258699170,16cyclictest21941-21apache_processe11:15:122
1258699170,16cyclictest20741-21pzem_energy11:10:232
1258699170,16cyclictest20204-21smartctl09:15:242
1258699170,16cyclictest1510-21uname07:45:212
1258699170,16cyclictest14183-21awk07:10:192
1258699170,16cyclictest12810-21apache_accesses11:55:142
1258699170,16cyclictest12810-21apache_accesses11:55:142
12582991714,2cyclictest8465-21sed10:50:181
12582991714,2cyclictest31598-21cpuspeed_turbos08:40:191
12582991714,2cyclictest30844-21ntp_states07:40:221
12582991714,2cyclictest27391-21/usr/sbin/munin10:25:251
12582991714,2cyclictest25007-21expr11:20:161
12582991714,2cyclictest22964-21sed11:15:171
12582991714,2cyclictest21370-21cat07:25:141
12582991714,2cyclictest17905-21tune2fs08:15:171
12582991714,2cyclictest12057-21apache_volume10:00:181
1258299171,1cyclictest12073-21cat08:05:161
1258299170,2cyclictest4944-21apache_processe08:50:151
1258299170,2cyclictest28949-21expr10:30:171
1258299170,2cyclictest28553-21apache_processe08:35:141
1258299170,16cyclictest9365-21cpuspeed_turbos09:55:151
1258299170,16cyclictest9138-21cat08:00:161
1258299170,16cyclictest7828-21grep08:55:191
1258299170,16cyclictest6852-21cstates09:50:191
1258299170,16cyclictest6676-21cat07:55:191
1258299170,16cyclictest4603-21cstates11:40:151
1258299170,16cyclictest434-21systemd-udevd08:23:081
1258299170,16cyclictest27998-21cat11:25:181
1258299170,16cyclictest26411-21df_inode08:30:151
1258299170,16cyclictest24303-21apache_processe12:15:131
1258299170,16cyclictest24289-21cstates07:30:181
1258299170,16cyclictest21804-21latency_hist11:15:011
1258299170,16cyclictest18837-21cstates07:20:151
1258299170,16cyclictest17678-21apache_processe10:10:151
1258299170,16cyclictest17582-21pzem_current09:10:231
1258299170,16cyclictest15466-21fschecks_time10:05:141
1258299170,16cyclictest1400-21sendmail-mta11:32:301
1258299170,16cyclictest1400-21sendmail-mta11:32:291
1258299170,16cyclictest10414-21apache_accesses09:00:161
1258299170,16cyclictest10414-21apache_accesses09:00:161
12577991715,1cyclictest22281-21nfsd407:25:190
12577991714,2cyclictest4536-21H212:26:330
12577991714,2cyclictest32643-21nfsd410:35:210
12577991714,2cyclictest20002-21nfsd409:15:220
12577991714,2cyclictest19228-21apt-get11:10:170
12577991714,2cyclictest16486-21expr09:10:170
12577991714,2cyclictest12905-21cpuspeed_turbos11:55:150
12577991714,2cyclictest12905-21cpuspeed_turbos11:55:150
1257799170,2cyclictest4593-21H212:26:330
1257799170,2cyclictest4536-21H212:26:330
1257799170,2cyclictest4532-21H212:26:330
1257799170,2cyclictest4532-21H212:26:330
1257799170,2cyclictest4528-21H212:26:330
1257799170,2cyclictest4523-21H212:26:330
1257799170,2cyclictest27805-21cat09:30:210
1257799170,2cyclictest27108-21grep08:30:200
1257799170,2cyclictest10943-21switchtime09:55:230
1257799170,1cyclictest5130-21grep08:50:180
1257799170,1cyclictest0-21swapper/010:07:200
1257799170,16cyclictest8849-21sed10:50:210
1257799170,16cyclictest4532-21H212:26:330
1257799170,16cyclictest4528-21H212:26:330
1257799170,16cyclictest4528-21H212:26:330
1257799170,16cyclictest4432-21snapd07:41:570
1257799170,16cyclictest4412-21fschecks_count09:45:200
1257799170,16cyclictest30010-21proc_pri08:35:220
1257799170,16cyclictest16988-21fschecks_time11:05:180
1257799170,16cyclictest16988-21fschecks_time11:05:180
1257799170,16cyclictest14398-21latency_hist08:10:000
1257799170,16cyclictest10619-21grep10:55:150
1257799170,15cyclictest4528-21H212:26:330
12586991614,1cyclictest6412chrt09:40:092
12586991614,1cyclictest15606-21apt-get07:15:152
12586991614,1cyclictest0-21swapper/210:20:172
12586991613,3cyclictest0-21swapper/207:32:492
1258699160,1cyclictest27012-21cat10:25:222
1258699160,1cyclictest0-21swapper/209:00:262
1258699160,1cyclictest0-21swapper/209:00:252
1258699160,1cyclictest0-21swapper/207:20:142
1258699160,15cyclictest76462chrt08:55:082
1258699160,15cyclictest24048-21latency08:25:202
1258699160,15cyclictest0-21swapper/212:10:242
1258699160,15cyclictest0-21swapper/209:25:202
12582991614,1cyclictest23110-21apache_processe08:25:161
12582991614,1cyclictest0-21swapper/108:10:141
12582991614,1cyclictest0-21swapper/108:10:141
12582991614,1cyclictest0-21swapper/107:45:011
12582991614,1cyclictest0-21swapper/107:10:151
12582991613,2cyclictest26824-21expr07:35:151
12577991614,1cyclictest32463-21tar07:45:010
12577991614,1cyclictest0-21swapper/012:30:160
12577991614,1cyclictest0-21swapper/011:50:020
12577991614,1cyclictest0-21swapper/011:00:150
12577991614,1cyclictest0-21swapper/009:50:280
12577991614,1cyclictest0-21swapper/007:35:350
12577991614,1cyclictest0-21swapper/007:20:170
1257799160,2cyclictest2026-21memory11:35:200
1257799160,15cyclictest9767-21awk08:00:200
1257799160,15cyclictest23198-21cpu10:20:180
1257799160,15cyclictest20400-21apache_accesses10:15:160
1257799160,15cyclictest0-21swapper/010:30:180
1257799160,15cyclictest0-21swapper/010:25:130
1257799160,15cyclictest0-21swapper/009:40:180
1257799160,15cyclictest0-21swapper/007:15:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional