You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-25 - 11:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot4s.osadl.org (updated Mon Sep 25, 2023 00:45:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2839799724,7cyclictest131rcu_preempt21:05:210
2839799713,7cyclictest131rcu_preempt00:05:200
2839799704,34cyclictest3420-21ssh22:25:170
2839799694,41cyclictest9523-21ssh00:10:230
2840699581,36cyclictest7201-21ssh00:30:200
2841199573,46cyclictest27604-21ssh22:00:200
2839799571,31cyclictest27542-21ssh23:20:200
28397995421,7cyclictest12-21ksoftirqd/019:10:170
2841199531,18cyclictest664-21ntpd21:10:210
2839799532,35cyclictest19260-21ssh22:55:180
28397995222,5cyclictest0-21swapper/021:30:210
2839799511,32cyclictest4388-21ssh21:25:200
2839799501,25cyclictest600-21rngd23:05:200
2840699497,13cyclictest12-21ksoftirqd/019:15:190
2840699472,27cyclictest11367-21ssh21:50:220
2839799445,22cyclictest3120-21ssh23:45:200
2839799413,23cyclictest19827-21ssh21:35:200
28397993926,5cyclictest3018-21latency_hist22:45:020
28406993526,3cyclictest19151-21latency_hist23:15:010
2839799333,19cyclictest600-21rngd00:15:200
2839799312,23cyclictest12555-21diskmemload23:55:200
2839799296,11cyclictest600-21rngd00:25:210
2839799284,12cyclictest0-21swapper/023:50:180
2839799272,20cyclictest3306-21ssh23:25:200
28397992720,3cyclictest12-21ksoftirqd/000:00:210
2840699261,22cyclictest7925-21vmstat21:45:550
2839799263,15cyclictest27547-21ssh21:40:200
2839799262,19cyclictest19814-21sh22:35:210
2839799262,18cyclictest24638-21ssh00:20:200
28397992517,5cyclictest20055-21irqcore23:35:280
2841199249,8cyclictest12-21ksoftirqd/022:10:010
28397992418,4cyclictest17419-21kthreadcore20:40:340
2841199232,16cyclictest600-21rngd22:50:230
28411992314,6cyclictest26356-21fschecks_count20:50:280
28406992318,3cyclictest15530-21sed23:30:410
2839799232,16cyclictest16046-21apt-get20:05:200
28397992318,3cyclictest27261-21/usr/sbin/munin23:00:450
28411992211,9cyclictest23693-21cat19:35:380
28406992217,3cyclictest11309-21/usr/sbin/munin20:00:390
2839799223,12cyclictest12-21ksoftirqd/022:10:200
28397992217,3cyclictest23665-21grep21:55:410
28397992214,6cyclictest0-21swapper/022:30:480
2839799221,17cyclictest849-21ls19:45:400
28411992116,3cyclictest9900-21sort19:55:340
28411992116,3cyclictest10773-21sort19:25:270
28406992118,2cyclictest25347-21latency_hist20:15:010
2841199201,17cyclictest27968-21idleruntime23:40:250
2840699209,9cyclictest20765-21kthreadcore23:15:350
28406992013,5cyclictest0-21swapper/020:20:400
28406992013,5cyclictest0-21swapper/019:20:420
2840699200,16cyclictest31103-21cut20:55:280
2839799202,11cyclictest3272-21apt-get22:45:210
28397992011,6cyclictest20175-21sshd22:15:300
28411991914,3cyclictest25484-21sort20:15:190
28411991914,3cyclictest23990-21cut21:15:450
28411991913,4cyclictest0-21swapper/021:20:550
28406991912,5cyclictest0-21swapper/022:20:240
2839799191,2cyclictest131rcu_preempt20:45:200
28411991812,4cyclictest14933-21cut00:35:360
28411991812,4cyclictest0-21swapper/020:30:380
28411991812,4cyclictest0-21swapper/019:30:300
28397991810,5cyclictest0-21swapper/020:40:010
2841199172,9cyclictest0-21swapper/019:50:190
28406991713,3cyclictest7904-21latency_hist21:05:010
2839799173,11cyclictest29324-21cron19:45:000
2839799171,10cyclictest600-21rngd20:25:210
2839799151,11cyclictest28387-21cyclictest19:10:010
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional