You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 00:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackcslot4.osadl.org (updated Fri Jul 11, 2025 12:45:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6654902301188,97sleep00-21swapper/007:09:080
6654902301188,97sleep00-21swapper/007:09:080
6655232298255,26sleep10-21swapper/107:09:301
6655232298255,26sleep10-21swapper/107:09:301
665694991392,130cyclictest723166-21sh09:20:170
6656949912667,50cyclictest668112-21irqstats07:15:030
665699991230,116cyclictest757575-21sh10:05:001
665699991210,115cyclictest701572-21pmu-power08:35:251
665694991210,115cyclictest857277-21cpuspeed_turbos12:15:170
665694991210,115cyclictest715363-21fschecks_count09:10:200
665694991202,112cyclictest706427-21latency_hist08:50:010
6656999911919,94cyclictest772951-21apt-get10:25:101
665699991191,112cyclictest875252-21sh12:39:411
6656949911865,43cyclictest806764-21rm11:09:270
665699991170,111cyclictest850110-21sh12:05:201
665694991150,109cyclictest735331-21ntp_offset09:35:210
665694991140,108cyclictest749602-21latency_hist09:55:020
665699991131,106cyclictest761723-21sh10:10:131
66569999113107,4cyclictest713927-21kworker/u8:109:24:201
665699991130,107cyclictest782727-21sh10:36:401
6656949911154,43cyclictest849772-21ssh12:05:160
665699991100,104cyclictest834384-21sh11:45:191
665699991080,102cyclictest813218-21sh11:17:171
665699991080,102cyclictest686898-21idleruntime-cro08:00:001
665694991080,102cyclictest792147-21/usr/sbin/munin10:50:190
665699991060,100cyclictest825079-21sh11:33:031
665699991060,100cyclictest749275-21sh09:54:221
665694991060,100cyclictest696665-21latency_hist08:25:010
665694991050,99cyclictest811983-21processes11:15:250
665694991040,98cyclictest714348-21apt-config09:09:570
665699991030,97cyclictest670677-21gltestperf07:20:181
665694991030,97cyclictest700565-21munin-plugin-st08:35:000
665694991020,98cyclictest749960-21apt-config09:55:040
665694991020,87cyclictest677334-21needreboot07:35:230
665699991010,95cyclictest666587-21ntp_offset07:10:231
665694991010,95cyclictest803162-21latency_hist11:05:010
665699991000,94cyclictest857150-21acpi12:15:141
665699991000,94cyclictest841953-21sh11:55:201
665694991000,94cyclictest768913-21turbostat.cron10:20:000
665694991000,87cyclictest730186-21sh09:29:410
66569999990,93cyclictest826860-21missed_timers11:35:201
66569999970,91cyclictest778571-21sh10:31:061
66569999970,91cyclictest707549-21rt-features08:50:241
66569499970,91cyclictest856606-21apt-key12:15:010
66569999960,91cyclictest803162-21latency_hist11:05:011
66569999960,91cyclictest704781-21cpuspeed_turbos08:45:151
66569999960,90cyclictest734224-21latency_hist09:35:001
66569499960,90cyclictest762824-21switchtime10:10:270
66569499950,89cyclictest826962-21needreboot11:35:200
66569499950,89cyclictest823715-21switchtime11:30:270
66569999940,89cyclictest696876-21cpu08:25:141
66569999940,89cyclictest690817-21sh08:10:011
66569999940,88cyclictest864301-21sh12:24:101
665694999428,55cyclictest835008-21processes11:45:240
66569499932,80cyclictest757271-21sh10:04:270
66569499920,86cyclictest723004-21latency_hist09:20:010
66569499900,83cyclictest741891-21sh09:45:010
66569999890,84cyclictest736345-21sh09:36:191
66569499890,75cyclictest843159-21sh11:56:150
665694998849,34cyclictest724827-1kworker/u9:009:30:140
66569999870,81cyclictest796186-21fschecks_count10:55:201
66569499872,75cyclictest828-21runrttasks07:27:290
66569499872,70cyclictest691308-21fschecks_time08:10:180
66569499862,72cyclictest848157-21sh12:02:350
66569499860,71cyclictest787363-21sh10:43:310
66569999856,73cyclictest727278-21gltestperf09:25:211
66569999850,79cyclictest815510-21sh11:20:211
66569999833,66cyclictest805920-21sh11:07:491
66569999830,76cyclictest678267-21update-cracklib07:38:211
665694998236,36cyclictest874676-21seq12:38:230
66569499821,70cyclictest780592-21latency_hist10:35:010
66569499820,76cyclictest684941-21perf07:55:000
66569499820,67cyclictest862475-21timerandwakeup12:20:260
66569999800,73cyclictest744143-21sh09:46:351
665694998037,34cyclictest670398-21sort07:20:150
66569499800,74cyclictest797258-21unixbench_singl10:55:280
66569499792,67cyclictest828-21runrttasks07:31:270
665699997831,38cyclictest738848-21cut09:40:161
665694997857,16cyclictest790390-21ssh10:46:520
665694997723,40cyclictest686983-21latency_hist08:00:010
66569499771,70cyclictest701836-21xargs08:35:260
66569499770,71cyclictest709223-21needreboot08:55:210
66569499770,42cyclictest782275-21seq10:35:370
665699997628,38cyclictest792724-21/usr/sbin/munin10:50:191
665699997621,45cyclictest699741-21grep08:30:251
66569999760,70cyclictest696666-21turbostat08:25:001
66569999756,63cyclictest687852-21ntp_kernel_pll_08:00:241
66569999748,60cyclictest869658-21unixbench_multi12:30:261
665694997428,41cyclictest759152-21unixbench_multi10:05:280
66569499740,68cyclictest815771-21pmu-power11:20:240
665699997338,25cyclictest718834-21cron09:14:591
665699997321,47cyclictest668472-21cpuspeed_turbos07:15:151
66569999730,68cyclictest673379-21latency07:25:311
66569499732,62cyclictest711611-21xargs09:00:250
66569499732,62cyclictest711611-21xargs09:00:250
665694997318,38cyclictest742404-21seq09:45:170
66569499731,51cyclictest772951-21apt-get10:25:120
66569499720,66cyclictest702994-21fschecks_count08:40:200
66569499720,55cyclictest698633-21sh08:30:000
66569499720,52cyclictest833788-21cut11:45:000
665699997117,49cyclictest848636-21sh12:03:371
66569999710,65cyclictest818720-21acpi11:25:121
66569499710,65cyclictest690892-21latency_hist08:10:010
66569499710,54cyclictest708121-21taskset08:52:300
66569499710,53cyclictest667386-21seq07:13:100
66569499710,52cyclictest687082-21munin-node08:00:130
665699997020,47cyclictest712284-21idleruntime-cro09:05:001
665699997020,47cyclictest712284-21idleruntime-cro09:04:591
66569999700,64cyclictest714692-21tar09:09:591
66569999700,64cyclictest693400-21idleruntime08:15:201
66569499700,64cyclictest807455-21cpuspeed_turbos11:10:150
665699996917,47cyclictest856618-21apt-config12:15:011
66569999680,61cyclictest750017-21apt-key09:55:041
66569499681,47cyclictest868185-21sed12:30:010
66569499680,62cyclictest694184-21unixbench_singl08:15:270
66569499680,48cyclictest839859-21sh11:52:080
66569999670,61cyclictest708578-21cpu08:55:141
66569999670,61cyclictest691600-21missed_timers08:10:221
66569999670,61cyclictest679733-21mailstats07:40:261
66569999661,59cyclictest833792-21latency_hist11:45:011
66569499660,60cyclictest869398-21mailstats12:30:240
66569999652,61cyclictest768996-21latency_hist10:20:001
66569999650,59cyclictest681181-21idleruntime07:45:191
66569499650,44cyclictest818851-21ls11:25:160
66569999630,57cyclictest785496-21sendmail_mailqu10:40:281
66569999630,57cyclictest674876-21cstates07:30:151
66569999622,58cyclictest955-21cron10:25:001
66569999620,59cyclictest759200-21unixbench_singl10:05:291
66569499620,56cyclictest772696-21cron10:25:000
66569999612,57cyclictest789115-21needreboot10:45:201
66569999602,56cyclictest810863-21latency_hist11:15:001
66569999600,57cyclictest684944-21idleruntime-cro07:55:001
66569999600,56cyclictest703259-21kernelversion08:40:211
66569999600,55cyclictest720931-21sh09:16:181
66569499600,38cyclictest680517-21cron07:49:550
66569499600,38cyclictest680053-21grep07:40:270
665699995915,39cyclictest838284-21kernelversion11:50:191
66569999540,50cyclictest868237-21latency_hist12:30:001
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional