You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-08 - 03:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot5.osadl.org (updated Thu Dec 07, 2023 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282142630,0sleep00-21swapper/011:51:500
1924699510,49cyclictest27220-21meminfo08:55:261
1924699490,47cyclictest11544-21meminfo09:40:241
1924699480,46cyclictest29077-21meminfo09:00:231
1924699480,46cyclictest15245-21meminfo09:50:241
1924699450,43cyclictest8017-21meminfo12:25:251
1924699440,43cyclictest1192-21meminfo07:45:271
1924699440,42cyclictest28248-21meminfo10:25:261
1924599440,43cyclictest11542-21meminfo09:40:240
1924599440,42cyclictest12369-21meminfo08:15:240
1924699430,41cyclictest25995-21meminfo07:25:261
1924599430,41cyclictest516-21meminfo12:05:250
1924599430,41cyclictest25554-21meminfo11:45:240
1924699420,40cyclictest10705-21meminfo11:05:251
1924599420,40cyclictest5134-21meminfo10:50:260
1924599410,39cyclictest7825-21meminfo09:30:270
1924699400,38cyclictest30939-21meminfo09:05:281
1924599400,39cyclictest20827-21meminfo10:05:260
1924699390,37cyclictest8854-21meminfo11:00:261
1924699390,37cyclictest17104-21meminfo09:55:291
1924699390,37cyclictest11718-21meminfo12:35:271
1924599390,37cyclictest3285-21meminfo10:45:260
1924599390,37cyclictest23523-21meminfo08:45:290
1924699380,37cyclictest29258-21meminfo11:55:281
1924699380,36cyclictest31942-21meminfo10:35:261
1924599380,37cyclictest4294-21meminfo12:15:250
1924599380,37cyclictest25372-21meminfo08:50:280
1924599380,36cyclictest22674-21meminfo10:10:250
1924699370,35cyclictest24527-21meminfo10:15:251
1924599370,36cyclictest24144-21meminfo07:20:230
1924599360,34cyclictest17945-21meminfo08:30:270
1924699350,34cyclictest4951-21meminfo07:55:251
1924699350,33cyclictest4123-21meminfo09:20:231
1924599350,34cyclictest19804-21meminfo08:35:280
1924599350,33cyclictest6820-21meminfo08:00:260
1924699340,33cyclictest19847-21meminfo07:10:251
1924599340,32cyclictest4125-21meminfo09:20:240
1924599340,32cyclictest14407-21meminfo11:15:270
1924599340,32cyclictest14241-21meminfo08:20:260
1924699330,32cyclictest1395-21meminfo10:40:221
1924599330,32cyclictest2255-21meminfo09:15:250
1924599330,31cyclictest29737-21meminfo07:35:240
1924599330,31cyclictest2447-21meminfo12:10:270
1924699320,31cyclictest30092-21meminfo10:30:261
1924699310,30cyclictest9865-21meminfo12:30:241
1924599300,28cyclictest23706-21meminfo11:40:250
1924699290,28cyclictest27848-21meminfo07:30:241
1924699290,27cyclictest27402-21meminfo11:50:251
1924599280,27cyclictest6164-21meminfo12:20:250
1924599280,27cyclictest3102-21meminfo07:50:260
1924599280,27cyclictest18966-21meminfo10:00:240
1924599270,26cyclictest21670-21meminfo08:40:250
1924699250,24cyclictest16096-21meminfo08:25:271
1924699240,23cyclictest31756-21meminfo07:40:251
1924699240,23cyclictest22278-21meminfo07:15:271
1924599240,23cyclictest18131-21meminfo11:25:250
1924599220,21cyclictest9862-21meminfo12:30:240
1924599220,21cyclictest318-21meminfo09:10:240
1924599220,20cyclictest13393-21meminfo09:45:240
127402220,1sleep00-21swapper/011:10:300
1924599210,20cyclictest6992-21meminfo10:55:300
129612210,1sleep032043-21diskmemload12:40:000
1924699200,18cyclictest18130-21meminfo11:25:261
1924599190,18cyclictest19987-21meminfo11:30:250
1924699183,9cyclictest4568-21apt-get10:50:191
1924699180,17cyclictest31122-21meminfo12:00:261
1924599184,4cyclictest19863-21kworker/u4:4-xprtiod10:23:040
1924599180,17cyclictest5982-21meminfo09:25:290
1924699170,16cyclictest8668-21meminfo08:05:251
1924599172,11cyclictest29461-21/usr/sbin/munin09:00:280
1924599170,16cyclictest10517-21meminfo08:10:240
19246991612,3cyclictest12828-21apt-get09:45:181
1924699160,15cyclictest9676-21meminfo09:35:251
1924599164,7cyclictest0-21swapper/012:28:390
1924599154,6cyclictest23956-21/usr/sbin/munin10:15:220
1924699147,5cyclictest20089-21latency_hist10:05:001
1924699145,7cyclictest17379-21apt-get08:30:221
1924699142,5cyclictest24798-21apt-get08:50:191
1924699141,9cyclictest5578-21/usr/sbin/munin09:25:231
19246991412,1cyclictest32043-21diskmemload12:20:251
1924699141,10cyclictest7821-21kworker/u4:3+xprtiod11:35:561
1924599148,4cyclictest0-21swapper/010:25:270
19245991412,1cyclictest28208-21lxcfs07:40:370
19245991411,2cyclictest9170-21timerwakeupswit08:05:310
1924699139,3cyclictest0-21swapper/111:33:051
19246991311,1cyclictest26472-21needreboot10:20:271
19246991311,1cyclictest10592-21needreboot08:10:241
1924599137,5cyclictest4385-21apt-get07:55:190
1924599132,10cyclictest18219-21/usr/sbin/munin10:00:010
1924599131,7cyclictest10139-21apt-get11:05:210
19245991310,2cyclictest1736-21lxcfs07:45:240
179902131,9sleep118089-21ntp_kernel_pll_07:05:281
1924699129,2cyclictest32623-21cat09:10:241
1924699129,2cyclictest25117-21cat11:45:181
1924699129,2cyclictest2048-21sh12:10:231
1924699129,2cyclictest15899-21cut11:20:191
1924699129,2cyclictest1286-21seq12:06:021
1924699125,2cyclictest12112-21idleruntime08:15:221
1924699124,7cyclictest21234-21cstates08:40:211
1924699123,5cyclictest32190-21kworker/u4:3+rpciod09:33:491
19246991210,1cyclictest4236-21latency_hist07:55:001
19246991210,1cyclictest19863-21kworker/u4:4-xprtiod10:55:101
19246991210,1cyclictest13887-21fschecks_count08:20:221
1924699120,8cyclictest11960-21kworker/u4:2+rpciod12:15:181
1924699120,11cyclictest20826-21meminfo10:05:261
1924599129,2cyclictest31179-21uname12:00:270
1924599129,2cyclictest29740-21sort10:30:210
1924599129,2cyclictest28627-21chrt07:31:320
1924599129,2cyclictest22170-21cat07:15:260
1924599129,2cyclictest16827-21taskset08:26:040
1924599128,2cyclictest2027-21runrttasks11:20:040
1924599124,5cyclictest0-21swapper/011:59:060
1924699119,1cyclictest139002sleep111:15:231
1924699118,2cyclictest6461-21cut08:00:231
1924699118,2cyclictest29708-21latency07:35:251
1924699118,2cyclictest24648-21seq11:43:191
1924699118,2cyclictest23677-21cut07:20:191
1924699118,2cyclictest23311-21iwlist08:45:271
1924699118,2cyclictest22098-21chrt10:10:131
1924699118,2cyclictest19546-21idleruntime08:35:251
1924699118,2cyclictest12762-21cut11:10:311
1924699115,5cyclictest1671-21apt-get09:15:201
1924699110,1cyclictest0-21swapper/110:45:291
1924599119,1cyclictest9863-21grep09:35:280
1924599119,1cyclictest9195-21grep11:00:310
1924599119,1cyclictest27848-21awk08:55:320
1924599119,1cyclictest25547-21tr07:25:200
1924599119,1cyclictest20403-21grep07:10:300
1924599118,2cyclictest21601-21if_ecat011:35:200
1924599118,2cyclictest15217-21wc09:50:230
1924599111,4cyclictest0-21swapper/009:05:190
1924599110,10cyclictest1344-21cat10:40:220
1924599107,2cyclictest32381-21cat10:35:320
17387292,4sleep00-21swapper/007:05:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional