You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-12 - 22:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Fri Jul 12, 2024 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
227782239162,25sleep00-21swapper/007:07:310
227612237163,24sleep30-21swapper/307:07:173
228712228155,59sleep10-21swapper/107:08:411
210142203163,26sleep20-21swapper/207:05:102
3196621780,5sleep12306599cyclictest11:07:331
3074221650,4sleep22307099cyclictest11:05:172
313232580,2sleep20-21swapper/208:40:132
157272500,4sleep12306599cyclictest09:15:361
56452490,2sleep30-21swapper/312:35:173
113182430,3sleep311322-21latency_hist07:55:033
250472370,5sleep12306599cyclictest09:40:021
2306099318,11cyclictest28137-21awk07:20:000
2306099292,12cyclictest4219-21basename11:20:000
2306099291,4cyclictest15254-21/usr/sbin/munin09:15:270
212512290,15sleep10-21swapper/111:55:341
2306599271,19cyclictest0-21swapper/111:00:391
8322260,2sleep30-21swapper/312:25:143
2306599269,3cyclictest12285-21memory07:55:211
2306599252,10cyclictest836-21runrttasks08:21:431
2306599251,12cyclictest0-21swapper/111:48:281
2306599250,15cyclictest32743-21kworker/u8:208:16:451
2306599250,15cyclictest32743-21kworker/u8:208:16:451
2306099257,9cyclictest8999-1kworker/u9:108:52:390
2306099257,5cyclictest0-21swapper/009:45:320
211602250,4sleep081ktimersoftd/011:55:320
23070992411,4cyclictest0-21swapper/209:25:282
2306599241,17cyclictest0-21swapper/109:58:311
2306599241,14cyclictest7094-21ntp_states10:10:311
23060992419,3cyclictest27114-21sh12:10:160
2306099241,12cyclictest10812-21perf11:35:000
2306099241,12cyclictest10812-21perf11:35:000
2306099240,12cyclictest1372-21awk10:00:010
2307599236,7cyclictest0-21swapper/309:38:073
2307599231,6cyclictest0-21swapper/310:36:513
2307599231,19cyclictest11772-21diskmemload10:08:003
2307599230,11cyclictest0-21swapper/311:24:453
2307099236,4cyclictest0-21swapper/209:55:022
2306599236,16cyclictest0-21swapper/110:50:591
2306599232,3cyclictest0-21swapper/108:52:421
2306599232,15cyclictest0-21swapper/108:47:041
23065992315,3cyclictest0-21swapper/110:09:591
23065992315,2cyclictest0-21swapper/109:30:121
2306599231,16cyclictest0-21swapper/111:21:321
2306099238,9cyclictest0-21swapper/008:08:370
2306099232,7cyclictest6630-21/usr/sbin/munin11:25:270
141772230,4sleep339-21rcuc/308:00:163
2307599221,10cyclictest0-21swapper/310:31:403
2307099229,2cyclictest6752-21awk07:45:012
2307099225,5cyclictest24962-21grep09:40:022
2307099224,15cyclictest29636-21netstat12:15:252
2307099222,5cyclictest25746-21perl09:40:182
2307099221,8cyclictest20516-21grep10:40:322
2307099221,8cyclictest15150-21cat09:15:262
2306599227,3cyclictest0-21swapper/109:47:481
2306599222,16cyclictest0-21swapper/112:19:241
2306599222,15cyclictest0-21swapper/109:12:171
2306599221,7cyclictest0-21swapper/109:20:301
23065992214,3cyclictest0-21swapper/112:13:421
23065992214,3cyclictest0-21swapper/111:30:121
23065992214,3cyclictest0-21swapper/111:30:121
23065992214,3cyclictest0-21swapper/110:04:171
2306599221,3cyclictest3427-21latency07:35:181
23065992213,3cyclictest0-21swapper/110:35:251
2306599221,19cyclictest0-21swapper/109:40:051
2306599221,16cyclictest0-21swapper/109:07:571
2306599221,15cyclictest0-21swapper/112:33:291
2306599221,15cyclictest0-21swapper/112:02:061
2306599221,15cyclictest0-21swapper/111:11:011
2306599221,15cyclictest0-21swapper/110:55:171
2306599221,15cyclictest0-21swapper/110:45:551
2306599221,15cyclictest0-21swapper/110:30:191
23065992211,3cyclictest26211-21/usr/sbin/munin12:10:021
2306599221,11cyclictest9478-21/usr/sbin/munin10:15:321
2306599220,16cyclictest0-21swapper/110:20:161
2306099224,15cyclictest13980-21perf09:15:000
23060992215,4cyclictest28636-21grep11:00:170
2306099221,18cyclictest23371-21ls10:50:010
2306099220,15cyclictest0-21swapper/008:35:140
2307599211,11cyclictest31621-21ntp_states07:25:303
2307599210,10cyclictest0-21swapper/309:45:573
2307599210,10cyclictest0-21swapper/309:24:303
2307099216,8cyclictest86850irq/129-enp1s0-11:15:222
2307099215,5cyclictest792-21avahi-daemon09:22:182
2307099211,7cyclictest0-21swapper/210:22:582
2306599219,4cyclictest32572-21cat07:30:011
2306599216,8cyclictest0-21swapper/112:39:401
2306599212,17cyclictest0-21swapper/107:30:581
23065992113,3cyclictest0-21swapper/109:53:081
2306599211,18cyclictest19864-21swap09:25:281
2306599211,15cyclictest0-21swapper/111:40:121
2306599211,15cyclictest0-21swapper/109:03:011
2306599211,15cyclictest0-21swapper/108:42:501
2306599211,12cyclictest0-21swapper/110:25:151
2306099216,8cyclictest86750irq/128-enp1s0-07:10:340
2306099215,8cyclictest86750irq/128-enp1s0-08:10:280
2306099212,11cyclictest5388-21/usr/sbin/munin08:55:150
2306099211,8cyclictest11772-21diskmemload09:30:300
2306099211,7cyclictest0-21swapper/011:21:160
23060992114,4cyclictest4434-21head12:30:330
2306099211,11cyclictest9170-21/usr/sbin/munin07:50:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional