You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 03:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sat Apr 25, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
236200399696,20cyclictest0-21swapper/023:20:010
236200799658,41cyclictest0-21swapper/220:40:012
236200699651,43cyclictest0-21swapper/123:20:011
236200399651,51cyclictest0-21swapper/021:40:130
236200799642,14cyclictest2385532-21/usr/sbin/munin21:25:192
2362007996310,23cyclictest0-21swapper/223:45:012
2362007996118,29cyclictest0-21swapper/221:40:012
236200799596,23cyclictest2371838-21/usr/sbin/munin20:05:192
2362007995839,11cyclictest2367412-21sendmail19:40:012
2362007995817,12cyclictest0-21swapper/200:15:022
2362007995737,13cyclictest2411694-21sendmail00:00:002
2362007995718,16cyclictest0-21swapper/222:20:182
236200399566,20cyclictest15-21rcuc/021:15:010
2362006995544,7cyclictest2416122-21apt-key00:25:011
2362003995541,10cyclictest131ktimers/000:35:130
2362007995419,19cyclictest2365619-21kworker/u8:2+flush-179:9619:30:052
2362003995312,38cyclictest0-21swapper/023:35:280
2362007995231,13cyclictest2379107-21/usr/sbin/munin20:45:282
2362007995139,8cyclictest2407835-21cut23:35:202
2362007995139,8cyclictest2397586-21/usr/sbin/munin22:35:232
2362007995138,9cyclictest2376699-21tail20:30:282
2362007995125,18cyclictest2406982-21grep23:30:202
2362007995113,31cyclictest0-21swapper/200:15:232
2362003995142,4cyclictest0-21swapper/019:45:200
2362007995041,7cyclictest0-21swapper/221:15:022
2362007995034,10cyclictest2410540-21cut23:50:252
2362007995033,11cyclictest2409973-21/usr/sbin/munin23:45:292
2362007995032,11cyclictest2390261-21/usr/sbin/munin21:50:282
2362007995029,13cyclictest2371455-21wc20:00:272
2362007995028,16cyclictest2402923-21ptp4l23:05:252
2362007995028,16cyclictest2402923-21ptp4l23:05:252
2362007995027,16cyclictest2395770-21lsblk22:25:202
2362007995027,13cyclictest2374538-21/usr/sbin/munin20:20:172
2362006995032,13cyclictest231ktimers/122:20:101
2362007994937,8cyclictest2405481-21cut23:20:272
2362007994932,12cyclictest0-21swapper/223:10:102
2362007994932,10cyclictest2368882-21tail19:45:272
2362007994932,10cyclictest2365519-21grep19:25:282
2362007994931,12cyclictest2412492-21head00:00:282
2362007994931,11cyclictest2375915-21head20:25:312
2362007994931,11cyclictest2375915-21head20:25:302
2362007994931,10cyclictest2364686-21grep19:20:282
2362007994930,12cyclictest2381768-21grep21:00:272
2362007994917,26cyclictest0-21swapper/219:55:262
2362003994929,16cyclictest15-21rcuc/021:25:120
236200799488,13cyclictest0-21swapper/222:55:002
2362007994833,10cyclictest2406290-21/usr/sbin/munin23:25:252
2362007994832,11cyclictest2386512-21cut21:30:202
2362007994831,9cyclictest2396876-21grep22:30:272
2362007994831,11cyclictest2417474-21cut00:30:252
2362007994827,12cyclictest2398540-21phc2sys22:40:262
2362007994816,26cyclictest0-21swapper/200:05:262
2362007994733,9cyclictest2363928-21cron19:19:592
2362007994728,10cyclictest0-21swapper/220:50:132
2362007994727,13cyclictest2392895-21sed22:05:292
2362007994727,13cyclictest2381029-21latency_hist21:00:012
2362007994726,13cyclictest0-21swapper/220:20:012
2362007994726,12cyclictest2393126-21munin-node22:10:102
236200399475,18cyclictest15-21rcuc/020:45:010
236200399473,42cyclictest0-21swapper/022:30:300
236200399472,42cyclictest0-21swapper/022:55:210
2362007994640,2cyclictest2384762-21/usr/sbin/munin21:20:162
2362007994640,2cyclictest2384762-21/usr/sbin/munin21:20:152
2362007994634,8cyclictest2415717-21cut00:20:262
2362007994633,7cyclictest2418210-21/usr/sbin/munin00:35:212
2362007994629,11cyclictest2390589-21/usr/sbin/munin21:55:122
2362007994629,11cyclictest2384305-21/usr/sbin/munin21:15:292
2362007994629,10cyclictest2394135-21fschecks_time22:15:202
2362007994629,10cyclictest2394135-21fschecks_time22:15:202
2362007994628,8cyclictest2372814-21/usr/sbin/munin20:10:162
2362007994628,12cyclictest2382205-21fschecks_time21:05:182
2362007994628,12cyclictest2369596-21kernelversion19:50:232
2362007994627,10cyclictest2363025-21latency_hist19:15:012
2362007994627,10cyclictest2363025-21latency_hist19:15:012
236200699468,22cyclictest2362827-21munin-node19:15:011
236200699468,22cyclictest2362827-21munin-node19:15:011
236200699461,27cyclictest0-21swapper/121:15:011
236200399467,18cyclictest131ktimers/023:15:010
2362003994628,12cyclictest0-21swapper/019:30:010
236200399461,42cyclictest2393575-21find22:10:260
236200399461,12cyclictest0-21swapper/019:55:010
2362007994539,3cyclictest2402029-21/usr/sbin/munin23:00:262
2362007994533,6cyclictest2401300-21/usr/sbin/munin22:55:262
2362007994530,8cyclictest2416727-21grep00:25:272
2362007994529,9cyclictest2389491-21unixbench_singl21:45:302
2362006994533,6cyclictest0-21swapper/120:35:291
2362006994528,9cyclictest0-21swapper/121:40:001
2362003994535,5cyclictest0-21swapper/021:15:280
2362003994529,14cyclictest167350irq/118-8000000.ethernet-tx022:20:150
2362003994525,15cyclictest15-21rcuc/021:50:120
236200399451,6cyclictest15-21rcuc/020:50:160
236200399451,5cyclictest2407432-21grep23:30:270
236200399451,41cyclictest2387382-21grep21:35:220
2362007994437,4cyclictest2377893-21/usr/sbin/munin20:40:152
2362007994430,8cyclictest2399131-21/usr/sbin/munin22:45:222
2362007994427,11cyclictest2391576-21/usr/sbin/munin22:00:212
2362007994424,15cyclictest2388068-21munin-node21:40:112
2362006994429,10cyclictest0-21swapper/122:40:281
2362006994427,10cyclictest0-21swapper/121:55:281
2362003994437,4cyclictest167350irq/118-8000000.ethernet-tx023:00:160
2362003994435,4cyclictest2375039-21grep20:20:270
2362003994433,8cyclictest0-21swapper/020:10:280
2362007994323,10cyclictest0-21swapper/219:40:142
2362003994336,4cyclictest167350irq/118-8000000.ethernet-tx022:25:270
2362003994335,5cyclictest0-21swapper/000:30:290
2362003994333,6cyclictest2368161-21grep19:40:280
236200399432,38cyclictest0-21swapper/023:20:210
2362007994222,11cyclictest2404356-21/usr/sbin/munin23:15:192
2362006994230,8cyclictest0-21swapper/119:55:271
236200399424,35cyclictest0-21swapper/021:30:210
2362003994231,7cyclictest2399801-21apt-key22:50:010
2362003994229,7cyclictest0-21swapper/000:20:280
2362006994133,5cyclictest0-21swapper/122:17:011
2362006994133,5cyclictest0-21swapper/122:17:001
2362006994125,9cyclictest0-21swapper/120:50:251
236200399413,35cyclictest0-21swapper/019:20:200
2362003994128,10cyclictest2394494-21grep22:15:290
2362003994128,10cyclictest2394494-21grep22:15:280
2362003994124,15cyclictest0-21swapper/020:30:160
236200399411,38cyclictest0-21swapper/020:15:250
236200399411,2cyclictest0-21swapper/019:15:280
2362006994025,11cyclictest0-21swapper/120:55:291
236200399406,32cyclictest0-21swapper/021:05:210
236200399404,7cyclictest15-21rcuc/023:55:300
2362003994028,8cyclictest131ktimers/019:35:000
2362003994027,10cyclictest15-21rcuc/020:35:180
236200399402,3cyclictest0-21swapper/023:50:110
236200399402,36cyclictest0-21swapper/022:05:110
236200399401,3cyclictest2363071-21cut19:15:010
2362003994013,24cyclictest0-21swapper/022:40:260
2362007993923,11cyclictest0-21swapper/219:10:012
2362006993930,5cyclictest0-21swapper/122:05:281
2362006993917,15cyclictest231ktimers/119:50:121
236200699391,31cyclictest0-21swapper/120:30:151
2362003993932,3cyclictest12-21ksoftirqd/019:10:260
2362003993931,5cyclictest131ktimers/020:45:300
2362003993931,4cyclictest0-21swapper/023:40:220
236200399391,3cyclictest0-21swapper/022:00:000
236200399391,36cyclictest0-21swapper/021:20:110
236200399391,36cyclictest0-21swapper/021:20:110
236200399391,34cyclictest0-21swapper/020:05:280
2362006993830,5cyclictest0-21swapper/123:30:271
2362006993830,4cyclictest0-21swapper/119:35:201
2362006993827,8cyclictest0-21swapper/121:25:291
236200399383,7cyclictest2411974-21/usr/sbin/munin00:00:170
2362003993832,3cyclictest2402958-21gunzip23:05:270
2362003993832,3cyclictest2402958-21gunzip23:05:270
2362003993831,4cyclictest167350irq/118-8000000.ethernet-tx000:10:270
2362003993831,4cyclictest0-21swapper/019:35:100
2362003993827,8cyclictest131ktimers/020:55:230
2362003993825,8cyclictest0-21swapper/022:00:280
236200399381,4cyclictest0-21swapper/022:35:180
236200399381,35cyclictest0-21swapper/000:15:210
236200399381,34cyclictest0-21swapper/023:25:170
236200699376,12cyclictest2389750-21/usr/sbin/munin21:50:191
2362006993728,5cyclictest0-21swapper/120:45:301
2362006993724,8cyclictest0-21swapper/123:25:281
2362006993723,8cyclictest0-21swapper/123:10:261
2362006993719,11cyclictest0-21swapper/120:15:211
236200699371,30cyclictest2388068-21/usr/sbin/munin21:40:241
2362003993728,7cyclictest15-21rcuc/023:45:210
2362003993723,12cyclictest131ktimers/019:55:120
2362003993721,14cyclictest0-21swapper/000:05:120
236200399371,2cyclictest0-21swapper/021:45:280
236200399371,2cyclictest0-21swapper/000:30:010
236200699366,10cyclictest2410202-21/usr/sbin/munin23:50:181
2362006993629,4cyclictest2389552-21munin-plugin-st21:50:001
2362006993629,4cyclictest2362000-21cyclictest22:10:201
2362006993628,4cyclictest0-21swapper/120:20:261
2362006993621,7cyclictest0-21swapper/100:05:271
2362006993621,10cyclictest0-21swapper/123:55:171
2362006993617,9cyclictest0-21swapper/121:30:291
2362006993614,16cyclictest0-21swapper/120:10:011
2362003993630,4cyclictest0-21swapper/020:00:160
2362003993610,4cyclictest0-21swapper/020:30:010
2362003993610,4cyclictest0-21swapper/020:30:010
2362006993521,6cyclictest0-21swapper/123:05:271
2362006993521,6cyclictest0-21swapper/123:05:271
2362006993521,6cyclictest0-21swapper/122:55:211
2362006993521,6cyclictest0-21swapper/119:25:001
236200699351,28cyclictest2395796-21sshd22:25:201
2362006993512,13cyclictest2397348-21/usr/sbin/munin22:35:191
2362003993527,5cyclictest131ktimers/022:50:050
2362003993521,9cyclictest0-21swapper/021:05:010
2362006993426,5cyclictest2378370-21grep20:40:271
2362006993425,4cyclictest2416933-21cron00:30:001
2362006993422,6cyclictest0-21swapper/119:30:281
2362006993415,10cyclictest0-21swapper/100:30:291
236200399341,5cyclictest0-21swapper/019:10:000
2362006993325,4cyclictest0-21swapper/123:40:301
2362006993323,6cyclictest0-21swapper/121:20:271
2362006993323,6cyclictest0-21swapper/121:20:261
2362006993321,8cyclictest0-21swapper/100:10:281
2362006993223,5cyclictest0-21swapper/100:15:301
2362006993220,8cyclictest0-21swapper/100:00:271
2362006993220,6cyclictest0-21swapper/121:00:231
2362006993219,8cyclictest0-21swapper/122:50:021
2362006993218,9cyclictest0-21swapper/121:05:281
236200699321,26cyclictest0-21swapper/123:20:251
236200699321,25cyclictest2375927-21sshd20:26:211
236200699321,25cyclictest2375927-21sshd20:26:211
2362006993124,3cyclictest0-21swapper/123:00:291
2362006993123,4cyclictest0-21swapper/100:35:191
2362006993120,6cyclictest0-21swapper/122:00:221
2362006993117,7cyclictest0-21swapper/119:45:191
2362006993021,6cyclictest2409987-21dropbear23:47:201
2362006993017,9cyclictest0-21swapper/119:30:011
2362006993015,4cyclictest2364773-21kworker/u8:1-ext4-rsv-conversion20:05:011
236200699282,15cyclictest2396506-21/usr/sbin/munin22:30:191
2362006992821,5cyclictest2372765-21/usr/sbin/munin20:10:261
2362006992818,7cyclictest2408300-21cron23:40:011
2362006992816,7cyclictest0-21swapper/121:15:221
236200699281,25cyclictest0-21swapper/122:50:211
2362006992617,5cyclictest0-21swapper/119:40:281
2362006992616,7cyclictest0-21swapper/119:15:291
2362006992519,3cyclictest2362132-21latency_hist19:10:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional