You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 20:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Thu Dec 11, 2025 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2383733991077,9cyclictest2395882-21apt-get08:20:021
2383733999013,7cyclictest2385880-21/usr/sbin/munin07:20:191
238373399825,32cyclictest2413266-21/usr/sbin/munin10:00:191
2383733998016,8cyclictest2431796-21apt-config11:50:011
2383733998016,8cyclictest2431796-21apt-config11:50:011
238373399701,2cyclictest0-21swapper/107:50:001
238373399683,25cyclictest0-21swapper/109:00:021
2383733996829,33cyclictest0-21swapper/107:10:281
2383733996623,37cyclictest0-21swapper/109:25:221
2383733996623,37cyclictest0-21swapper/109:25:221
2383733996524,37cyclictest0-21swapper/108:55:331
2383733996420,34cyclictest0-21swapper/110:20:211
2383733996420,34cyclictest0-21swapper/110:20:211
238373499637,20cyclictest32-21ksoftirqd/209:55:002
2383733996352,6cyclictest2385672-21sendmail07:20:001
238373399618,18cyclictest2388193-21apt-get07:35:011
2383733995723,28cyclictest0-21swapper/108:50:221
238373399571,49cyclictest0-21swapper/107:25:281
238373399571,29cyclictest2425155-21latency_hist11:10:021
238373399571,29cyclictest2425155-21latency_hist11:10:021
238373399553,8cyclictest0-21swapper/109:45:011
2383733995517,4cyclictest0-21swapper/111:20:281
2383733995517,4cyclictest0-21swapper/111:20:281
2383733995513,7cyclictest0-21swapper/108:20:201
238373399551,27cyclictest0-21swapper/109:35:251
238373399551,25cyclictest2397868-21/usr/sbin/munin08:30:251
238373399543,4cyclictest2420760-21grep10:45:011
2383733995430,20cyclictest168350irq/126-8000000.ethernet-tx107:40:111
2383733995419,5cyclictest0-21swapper/109:30:211
2383733995418,4cyclictest0-21swapper/110:05:181
2383733995414,10cyclictest0-21swapper/112:00:211
2383733995412,7cyclictest0-21swapper/112:10:251
238373399541,26cyclictest0-21swapper/111:55:231
2383730995447,4cyclictest131ktimers/011:10:200
238373099541,17cyclictest15-21rcuc/008:50:000
238373399531,26cyclictest0-21swapper/110:50:121
238373399521,2cyclictest0-21swapper/108:30:011
2383730995211,14cyclictest2419815-21apt-get10:40:020
2383733995121,4cyclictest0-21swapper/107:56:281
238373399511,2cyclictest0-21swapper/108:45:011
2383734995034,11cyclictest311ktimers/209:35:132
2383733995028,18cyclictest2393312-21grep08:00:291
2383733995016,8cyclictest2401262-21cat08:50:011
2383733994927,18cyclictest168350irq/126-8000000.ethernet-tx109:50:141
238373099491,38cyclictest0-21swapper/011:25:150
2383733994814,9cyclictest0-21swapper/109:15:171
238373499475,16cyclictest30-21rcuc/209:25:012
2383734994737,5cyclictest2408831-21munin-plugin-st09:35:002
2383733994724,18cyclictest0-21swapper/107:30:261
2383733994722,2cyclictest0-21swapper/111:10:191
2383730994742,3cyclictest2395888-21sendmail08:20:000
2383733994626,16cyclictest168350irq/126-8000000.ethernet-tx112:30:211
2383734994534,7cyclictest0-21swapper/211:30:302
2383734994526,13cyclictest311ktimers/208:15:152
2383733994527,15cyclictest0-21swapper/109:55:271
2383730994534,8cyclictest2395044-21munin-plugin-st08:15:010
238373099451,7cyclictest0-21swapper/007:15:010
2383734994435,6cyclictest2395042-21munin-run08:15:002
2383734994433,6cyclictest2417234-21grep10:20:302
2383734994433,6cyclictest2417234-21grep10:20:302
2383734994432,5cyclictest0-21swapper/208:40:302
2383734994430,9cyclictest0-21swapper/211:50:302
2383734994430,9cyclictest0-21swapper/211:50:302
2383734994428,10cyclictest0-21swapper/209:05:282
2383734994425,13cyclictest311ktimers/207:20:112
2383730994431,9cyclictest0-21swapper/007:55:000
2383730994423,19cyclictest131ktimers/008:40:250
238373099441,4cyclictest0-21swapper/010:05:200
2383734994336,4cyclictest2387358-21munin-plugin-st07:30:002
2383734994334,5cyclictest2393255-21grep08:00:292
2383734994334,5cyclictest0-21swapper/210:25:302
2383734994331,8cyclictest0-21swapper/208:24:592
2383734994327,12cyclictest311ktimers/208:30:142
2383734994327,11cyclictest0-21swapper/207:30:252
2383734994322,15cyclictest311ktimers/207:55:142
2383733994319,7cyclictest2436241-21/usr/sbin/munin12:15:181
238373099437,2cyclictest0-21swapper/009:50:010
2383730994328,9cyclictest0-21swapper/012:35:310
2383730994328,9cyclictest0-21swapper/012:35:310
238373499428,4cyclictest0-21swapper/207:10:012
2383734994235,4cyclictest2394204-21munin-plugin-st08:09:592
2383734994228,8cyclictest0-21swapper/211:40:012
2383734994225,11cyclictest0-21swapper/211:00:262
2383730994228,11cyclictest131ktimers/010:15:230
238373099422,37cyclictest0-21swapper/012:30:200
238373099421,4cyclictest0-21swapper/009:00:290
238373099421,24cyclictest2427497-21kworker/u8:4+events_power_efficient11:40:020
238373499418,22cyclictest32-21ksoftirqd/212:20:012
2383734994132,5cyclictest0-21swapper/209:55:282
2383734994129,8cyclictest2416436-21sendmail10:20:002
2383734994123,9cyclictest0-21swapper/209:45:292
2383733994126,9cyclictest0-21swapper/109:45:301
238373399411,4cyclictest0-21swapper/112:30:011
2383730994134,4cyclictest2388110-21unixbench_multi07:30:290
2383730994132,6cyclictest131ktimers/007:55:300
2383734994030,5cyclictest0-21swapper/212:05:312
2383734994028,8cyclictest0-21swapper/208:50:012
2383734994028,7cyclictest0-21swapper/211:20:282
2383734994028,7cyclictest0-21swapper/211:20:282
2383733994029,6cyclictest0-21swapper/109:10:011
238373099407,7cyclictest2402145-21rm08:55:010
2383730994031,5cyclictest0-21swapper/012:20:270
2383730994031,5cyclictest0-21swapper/012:20:260
2383730994030,7cyclictest2431738-21munin-plugin-st11:50:000
2383730994030,7cyclictest2431738-21munin-plugin-st11:49:590
2383730994025,8cyclictest0-21swapper/009:25:280
2383730994025,8cyclictest0-21swapper/009:25:280
2383730994023,10cyclictest0-21swapper/010:50:280
238373099401,36cyclictest2390445-21irqstats07:45:230
2383734993932,4cyclictest2437747-21munin-run12:25:002
2383734993932,4cyclictest2437747-21munin-run12:25:002
2383734993929,6cyclictest2391584-21grep07:50:292
2383734993929,5cyclictest0-21swapper/209:20:012
2383734993925,10cyclictest2402820-21unixbench_multi08:55:332
2383734993924,6cyclictest0-21swapper/211:55:292
2383733993923,12cyclictest0-21swapper/110:45:271
2383730993931,5cyclictest131ktimers/009:05:290
2383730993929,7cyclictest2423168-21grep10:55:280
2383730993926,9cyclictest0-21swapper/011:55:300
238373099391,36cyclictest0-21swapper/009:55:160
2383734993831,5cyclictest2389889-21grep07:40:292
2383734993829,4cyclictest0-21swapper/210:35:292
2383734993828,6cyclictest2438529-21grep12:25:312
2383734993828,4cyclictest0-21swapper/207:15:022
2383734993826,9cyclictest0-21swapper/208:25:302
2383734993825,8cyclictest0-21swapper/209:40:292
2383734993823,9cyclictest0-21swapper/208:55:022
238373499382,30cyclictest2390668-21/usr/sbin/munin07:45:292
2383734993818,14cyclictest311ktimers/208:35:132
2383733993818,17cyclictest867-21systemd-resolve11:05:011
238373099384,27cyclictest0-21swapper/007:20:010
2383730993834,3cyclictest0-21swapper/010:25:210
2383730993831,5cyclictest2426540-21grep11:15:290
2383730993828,7cyclictest2424934-21unixbench_singl11:05:290
2383730993828,7cyclictest2424934-21unixbench_singl11:05:280
2383730993827,7cyclictest0-21swapper/009:35:290
2383730993826,8cyclictest0-21swapper/010:10:280
2383730993821,15cyclictest0-21swapper/008:55:270
238373099381,34cyclictest131ktimers/010:20:240
238373099381,34cyclictest131ktimers/010:20:240
2383734993727,7cyclictest0-21swapper/210:10:282
2383734993727,6cyclictest2435980-21unixbench_singl12:10:292
2383734993727,4cyclictest0-21swapper/211:25:212
2383734993726,5cyclictest0-21swapper/211:10:292
2383734993725,7cyclictest0-21swapper/210:55:282
2383734993723,10cyclictest2426674-21sendmail11:20:002
238373399371,29cyclictest2428053-21grep11:25:261
2383730993726,7cyclictest0-21swapper/012:00:290
2383730993724,8cyclictest0-21swapper/009:20:290
238373099372,32cyclictest2389489-21sh07:40:210
2383734993628,6cyclictest311ktimers/207:15:302
2383734993627,5cyclictest0-21swapper/210:00:272
2383730993629,4cyclictest21250irq/208-8000000.ethernet11:50:030
2383730993629,4cyclictest21250irq/208-8000000.ethernet11:50:030
2383730993625,6cyclictest0-21swapper/008:20:280
2383730993622,9cyclictest0-21swapper/010:40:290
2383730993622,9cyclictest0-21swapper/008:05:270
2383734993521,8cyclictest2405425-21sshd09:10:402
2383733993527,5cyclictest0-21swapper/111:40:281
2383733993519,8cyclictest0-21swapper/112:20:191
2383733993519,8cyclictest0-21swapper/112:20:191
2383730993530,3cyclictest21250irq/208-8000000.ethernet12:05:290
2383730993529,4cyclictest21250irq/208-8000000.ethernet09:40:230
2383730993529,3cyclictest0-21swapper/010:00:160
238373099352,8cyclictest0-21swapper/007:25:010
2383730993526,6cyclictest131ktimers/010:45:250
238373099351,2cyclictest2427050-21ssh11:20:210
238373099351,2cyclictest2427050-21ssh11:20:210
238373499345,4cyclictest14-21rcu_preempt11:05:242
238373499345,4cyclictest14-21rcu_preempt11:05:242
2383734993428,4cyclictest168450irq/134-8000000.ethernet-tx211:40:292
238373499341,28cyclictest0-21swapper/212:35:292
238373499341,28cyclictest0-21swapper/212:35:292
2383733993427,4cyclictest168350irq/126-8000000.ethernet-tx108:35:281
238373099344,3cyclictest0-21swapper/007:30:020
2383730993427,4cyclictest0-21swapper/012:20:000
2383730993426,4cyclictest0-21swapper/007:35:280
2383730993424,7cyclictest0-21swapper/012:25:310
2383730993423,8cyclictest0-21swapper/008:30:280
2383730993423,7cyclictest0-21swapper/008:35:290
238373099341,31cyclictest0-21swapper/009:30:150
238373099341,28cyclictest2405378-21grep09:10:290
238373499333,16cyclictest2414107-21/usr/sbin/munin10:05:202
2383734993325,4cyclictest0-21swapper/207:35:302
2383734993323,7cyclictest2403667-21unixbench_multi09:00:272
2383734993321,4cyclictest0-21swapper/210:55:012
238373399339,13cyclictest2434563-21/usr/sbin/munin12:05:211
2383733993323,7cyclictest2406507-21/usr/sbin/munin09:20:181
2383733993323,7cyclictest0-21swapper/109:10:301
2383730993325,5cyclictest2427497-21kworker/u8:4+events_power_efficient11:30:220
2383730993324,6cyclictest131ktimers/010:30:280
2383730993317,8cyclictest0-21swapper/009:55:010
2383730993315,17cyclictest0-21swapper/011:44:460
238373099331,4cyclictest0-21swapper/011:05:000
238373099331,30cyclictest0-21swapper/012:10:250
2383733993224,4cyclictest0-21swapper/111:20:001
238373399321,6cyclictest22-21rcuc/108:05:251
238373399321,2cyclictest0-21swapper/110:20:011
2383734993120,7cyclictest0-21swapper/211:50:012
2383734993120,7cyclictest0-21swapper/211:50:012
2383734993119,9cyclictest1668-21snmpd12:33:522
2383734993119,8cyclictest2407907-21grep09:25:292
2383734993119,8cyclictest2407907-21grep09:25:292
2383733993124,4cyclictest168350irq/126-8000000.ethernet-tx110:10:121
2383733993122,4cyclictest0-21swapper/111:00:011
238373399311,24cyclictest0-21swapper/111:35:161
2383730993124,4cyclictest20050irq/27-20000000.i2c08:00:180
238373099311,5cyclictest2397670-21munin-run08:30:010
238373499301,2cyclictest0-21swapper/210:50:012
2383733993020,7cyclictest0-21swapper/107:50:201
2383733993020,6cyclictest0-21swapper/111:30:261
238373399301,3cyclictest2432853-21cut11:55:021
2383734992917,8cyclictest0-21swapper/210:30:222
238373399296,9cyclictest2419916-21cat10:40:011
2383733992920,6cyclictest0-21swapper/112:35:311
2383733992920,6cyclictest0-21swapper/112:35:311
2383733992916,9cyclictest0-21swapper/111:50:231
238373099292,4cyclictest2405717-21df_inode09:15:190
2383734992820,4cyclictest0-21swapper/210:40:262
2383733992717,6cyclictest0-21swapper/110:35:001
238373399271,2cyclictest2417490-21apt-get10:25:161
238373499267,13cyclictest311ktimers/212:00:142
2383733992619,4cyclictest22-21rcuc/108:10:191
238373099251,19cyclictest0-21swapper/007:10:000
2383733992112,4cyclictest0-21swapper/107:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional