You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 19:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Mon Nov 03, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2304266996616,26cyclictest0-21swapper/007:30:010
2304266996225,31cyclictest2323405-21/usr/sbin/munin08:55:290
2304266996225,31cyclictest2323405-21/usr/sbin/munin08:55:290
2304270996141,11cyclictest0-21swapper/209:04:592
2304266996038,15cyclictest0-21swapper/009:55:140
2304266995915,16cyclictest2350239-21apt-key11:35:020
2304266995827,5cyclictest2344985-21users11:00:310
2304266995827,5cyclictest2344985-21users11:00:300
2304268995713,21cyclictest2355473-21gpgv12:05:011
2304266995735,15cyclictest0-21swapper/008:35:160
2304266995735,15cyclictest0-21swapper/008:35:160
2304266995721,9cyclictest2335275-21unixbench_multi10:05:290
2304266995719,3cyclictest2311564-21apt-get07:50:130
2304266995636,12cyclictest0-21swapper/007:35:140
2304266995632,13cyclictest0-21swapper/010:40:180
2304266995617,9cyclictest2325589-21sh09:10:230
2304266995520,28cyclictest2316120-21/usr/sbin/munin08:15:220
2304266995434,14cyclictest0-21swapper/007:15:120
2304266995426,3cyclictest2327269-21ssh09:20:210
2304266995417,3cyclictest0-21swapper/009:20:000
2304270995335,12cyclictest311ktimers/208:15:122
2304266995333,14cyclictest0-21swapper/011:50:140
2304266995323,24cyclictest2331405-21/usr/sbin/munin09:45:170
230426899522,10cyclictest0-21swapper/110:10:011
2304266995237,9cyclictest0-21swapper/012:30:140
2304266995233,14cyclictest0-21swapper/010:10:140
2304266995226,15cyclictest0-21swapper/007:45:170
2304266995223,3cyclictest2348898-21memory11:25:290
2304266995136,10cyclictest0-21swapper/012:00:130
2304266995035,12cyclictest2357803-21/usr/sbin/munin12:15:280
2304270994937,7cyclictest2333623-21unixbench_singl09:55:272
2304268994937,8cyclictest0-21swapper/108:10:301
2304266994932,11cyclictest2359062-21/usr/sbin/munin12:25:180
2304266994930,14cyclictest0-21swapper/008:45:150
2304270994834,9cyclictest0-21swapper/211:30:302
2304270994834,8cyclictest0-21swapper/207:15:012
2304268994838,7cyclictest2361321-21munin-plugin-st12:40:011
2304268994838,7cyclictest2361321-21munin-plugin-st12:40:011
2304266994838,6cyclictest0-21swapper/011:40:290
2304266994834,11cyclictest2310240-21/usr/sbin/munin07:40:260
2304266994832,8cyclictest2360676-21apt-get12:35:170
2304266994832,8cyclictest2360676-21apt-get12:35:170
2304266994830,13cyclictest0-21swapper/008:20:150
2304266994830,13cyclictest0-21swapper/008:20:140
2304266994829,15cyclictest2350702-21/usr/sbin/munin11:35:270
2304266994828,12cyclictest2342809-21/usr/sbin/munin10:50:220
2304266994826,10cyclictest0-21swapper/009:30:140
2304266994817,26cyclictest0-21swapper/009:50:280
2304266994816,26cyclictest0-21swapper/007:21:280
2304268994736,6cyclictest2333621-21grep09:55:271
2304268994734,8cyclictest0-21swapper/108:35:311
2304268994734,8cyclictest0-21swapper/108:35:311
2304266994740,4cyclictest2313042-21apt08:00:010
2304266994733,9cyclictest2337996-21munin-plugin-st10:25:000
2304266994733,9cyclictest0-21swapper/011:55:130
2304266994732,11cyclictest2320195-21apt-get08:40:180
2304266994728,3cyclictest2318569-21diskstats08:30:210
2304266994715,4cyclictest2356152-21sshd12:07:280
2304270994626,13cyclictest311ktimers/210:20:152
2304268994633,8cyclictest0-21swapper/110:25:311
2304268994628,12cyclictest0-21swapper/112:30:301
2304266994639,4cyclictest20850irq/251-8000000.ethernet08:25:240
2304266994631,9cyclictest2334509-21sshd10:02:300
2304266994630,12cyclictest0-21swapper/008:10:170
2304266994626,10cyclictest2346257-21/usr/sbin/munin11:10:210
2304266994620,3cyclictest2338807-21users10:25:310
230427099458,13cyclictest30-21rcuc/211:40:012
2304268994535,5cyclictest0-21swapper/107:35:301
2304268994531,9cyclictest0-21swapper/109:40:321
2304266994529,13cyclictest2346897-21/usr/sbin/munin11:15:110
2304266994529,13cyclictest2346897-21/usr/sbin/munin11:15:110
2304266994518,3cyclictest2329951-21memory09:35:280
2304266994518,3cyclictest2324048-21meminfo09:00:260
2304266994517,3cyclictest2313328-21df_inode08:00:190
2304270994433,7cyclictest2311365-21munin-plugin-st07:50:002
2304270994429,8cyclictest0-21swapper/208:00:282
2304270994428,12cyclictest311ktimers/210:05:142
2304268994429,9cyclictest0-21swapper/112:05:301
2304268994429,9cyclictest0-21swapper/109:05:211
2304266994436,5cyclictest2340254-21/usr/sbin/munin10:35:250
2304266994432,8cyclictest2331018-21/usr/sbin/munin09:40:320
2304266994431,9cyclictest2339433-21/usr/sbin/munin10:30:270
2304266994431,9cyclictest2339433-21/usr/sbin/munin10:30:260
2304266994429,11cyclictest2343827-21/usr/sbin/munin10:55:270
2304266994424,16cyclictest2348191-21/usr/sbin/munin11:20:270
2304270994336,3cyclictest2338829-21cron10:30:002
2304270994333,5cyclictest0-21swapper/207:55:302
2304270994326,12cyclictest311ktimers/210:00:172
2304268994328,8cyclictest0-21swapper/112:10:341
2304268994328,8cyclictest0-21swapper/109:10:311
230426899431,38cyclictest0-21swapper/109:30:021
2304268994311,26cyclictest2327287-21sh09:20:231
230426899431,11cyclictest0-21swapper/111:00:001
230426899431,10cyclictest0-21swapper/111:10:001
2304266994337,3cyclictest2356660-21/usr/sbin/munin12:10:280
2304266994331,8cyclictest0-21swapper/009:30:000
2304266994330,9cyclictest2336927-21/usr/sbin/munin10:15:290
2304266994311,29cyclictest2308941-21latency_hist07:35:010
2304270994235,3cyclictest2330290-21latency_hist09:39:592
2304268994230,8cyclictest0-21swapper/108:30:321
2304268994228,8cyclictest2350031-21grep11:30:311
2304266994234,5cyclictest0-21swapper/011:09:590
2304266994231,7cyclictest2358313-21grep12:20:200
2304266994221,18cyclictest2314336-21sh08:05:220
2304266994210,29cyclictest2304496-21dropbear07:10:170
2304270994133,4cyclictest2317454-21cron08:25:012
2304270994133,4cyclictest2317454-21cron08:25:002
2304270994133,4cyclictest0-21swapper/212:00:292
2304270994131,7cyclictest2307033-21grep07:20:302
2304268994127,8cyclictest0-21swapper/107:30:291
2304268994126,9cyclictest0-21swapper/107:45:321
230426899412,4cyclictest0-21swapper/110:25:021
2304268994124,11cyclictest2313797-21grep08:00:281
2304268994110,3cyclictest2314607-21ptp4l08:05:281
2304266994127,8cyclictest2352063-21apt-get11:45:120
2304266994126,11cyclictest2342286-21tail10:45:260
2304266994121,16cyclictest2324822-21/usr/sbin/munin09:05:250
2304270994030,5cyclictest0-21swapper/212:25:302
2304270994026,9cyclictest0-21swapper/211:15:272
2304270994026,9cyclictest0-21swapper/211:15:272
2304270994020,14cyclictest311ktimers/210:30:122
2304270994020,14cyclictest311ktimers/210:30:122
2304268994032,4cyclictest2307887-21grep07:25:271
2304268994028,7cyclictest0-21swapper/110:00:301
2304268994028,6cyclictest0-21swapper/112:15:291
230426899401,11cyclictest0-21swapper/110:45:021
230427099399,7cyclictest2340599-21apt-get10:40:012
2304270993930,5cyclictest0-21swapper/212:30:302
2304270993930,5cyclictest0-21swapper/209:30:282
2304270993927,8cyclictest2320777-21grep08:40:322
2304268993929,6cyclictest0-21swapper/110:20:001
2304268993926,8cyclictest0-21swapper/110:35:301
2304268993924,9cyclictest231ktimers/108:15:111
2304268993923,9cyclictest0-21swapper/111:55:271
2304268993922,9cyclictest0-21swapper/108:55:281
2304268993922,9cyclictest0-21swapper/108:55:281
2304266993924,12cyclictest2322397-21tail08:50:270
230427099383,19cyclictest0-21swapper/212:25:012
2304270993829,5cyclictest0-21swapper/207:35:292
2304270993827,5cyclictest0-21swapper/207:50:282
2304270993825,9cyclictest2345559-21phc2sys-jitter11:05:282
2304270993823,8cyclictest0-21swapper/207:30:312
2304270993823,7cyclictest0-21swapper/208:45:202
230427099381,9cyclictest2319060-21sed08:30:322
230426899385,20cyclictest231ktimers/107:20:201
2304268993829,5cyclictest0-21swapper/111:35:301
2304268993825,5cyclictest0-21swapper/108:25:201
2304268993824,10cyclictest0-21swapper/107:15:021
2304268993816,15cyclictest2304431-21/usr/sbin/munin07:10:191
2304270993727,5cyclictest0-21swapper/207:40:302
2304270993726,6cyclictest2343109-21sed10:50:272
2304270993725,7cyclictest0-21swapper/209:25:302
2304270993723,9cyclictest0-21swapper/209:00:012
2304270993723,9cyclictest0-21swapper/209:00:012
2304268993730,4cyclictest166150irq/127-8000000.ethernet-tx109:35:321
2304268993725,8cyclictest0-21swapper/108:45:291
2304270993613,17cyclictest311ktimers/211:20:122
230427099361,28cyclictest0-21swapper/208:35:302
230427099361,28cyclictest0-21swapper/208:35:302
230426899362,4cyclictest0-21swapper/109:55:001
230426699361,7cyclictest0-21swapper/007:10:020
2304270993526,5cyclictest0-21swapper/211:15:012
2304270993525,4cyclictest0-21swapper/209:40:312
2304268993526,6cyclictest2326265-21/usr/sbin/munin09:15:201
2304268993526,4cyclictest0-21swapper/111:45:281
2304268993526,4cyclictest0-21swapper/108:40:311
2304268993524,7cyclictest0-21swapper/111:10:281
2304268993524,6cyclictest0-21swapper/107:50:291
230426899351,29cyclictest0-21swapper/107:55:251
230427099342,5cyclictest2354386-21munin-run12:00:002
2304270993425,5cyclictest2361264-21grep12:35:292
2304270993425,5cyclictest2361264-21grep12:35:292
2304270993425,5cyclictest0-21swapper/211:45:202
2304270993424,5cyclictest0-21swapper/207:25:192
2304270993422,9cyclictest0-21swapper/207:15:292
2304270993421,9cyclictest0-21swapper/211:25:302
2304270993419,11cyclictest311ktimers/212:05:142
2304270993417,14cyclictest311ktimers/210:35:132
230427099341,2cyclictest0-21swapper/211:05:012
230427099341,2cyclictest0-21swapper/211:05:012
2304268993426,4cyclictest166150irq/127-8000000.ethernet-tx112:20:291
2304268993425,3cyclictest0-21swapper/111:25:001
2304268993424,5cyclictest14-21rcu_preempt11:25:241
2304268993422,9cyclictest0-21swapper/108:55:001
2304268993421,8cyclictest0-21swapper/110:50:211
230426899341,2cyclictest0-21swapper/111:20:011
230426899341,2cyclictest0-21swapper/111:20:011
230427099335,24cyclictest30-21rcuc/212:15:132
2304270993326,5cyclictest166250irq/135-8000000.ethernet-tx211:51:112
2304270993325,5cyclictest2344103-21grep10:55:292
2304270993325,4cyclictest0-21swapper/208:50:202
2304270993318,12cyclictest311ktimers/209:10:162
2304270993315,14cyclictest311ktimers/209:50:112
230426899335,24cyclictest0-21swapper/108:25:001
230426899335,24cyclictest0-21swapper/108:25:001
2304268993326,4cyclictest166150irq/127-8000000.ethernet-tx111:50:291
2304268993320,8cyclictest0-21swapper/109:00:291
2304268993319,9cyclictest0-21swapper/109:45:201
230426899331,4cyclictest0-21swapper/109:30:021
230426899331,26cyclictest0-21swapper/111:00:191
230426899331,26cyclictest0-21swapper/111:00:191
230426899331,10cyclictest0-21swapper/110:50:011
2304270993224,4cyclictest0-21swapper/209:15:272
2304270993220,8cyclictest0-21swapper/209:45:282
2304268993222,7cyclictest1646-21snmpd12:25:291
2304270993121,6cyclictest0-21swapper/208:05:292
2304270993120,7cyclictest0-21swapper/209:25:012
2304270993120,7cyclictest0-21swapper/208:10:282
2304270993021,5cyclictest0-21swapper/211:40:002
2304270993019,8cyclictest0-21swapper/210:15:312
2304270993010,3cyclictest27250irq/343-s-wl18xx10:49:542
2304268993020,7cyclictest0-21swapper/110:05:291
2304270992920,6cyclictest0-21swapper/209:05:312
2304270992919,7cyclictest0-21swapper/208:25:222
2304268992921,6cyclictest0-21swapper/107:40:271
2304270992817,7cyclictest0-21swapper/212:10:342
2304270992414,7cyclictest311ktimers/210:10:162
2304270992414,6cyclictest0-21swapper/207:10:012
230426899247,13cyclictest231ktimers/110:30:131
230426899247,13cyclictest231ktimers/110:30:131
2304268992415,6cyclictest0-21swapper/107:10:011
230426899241,4cyclictest1646-21snmpd11:40:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional