You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 17:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Wed Mar 18, 2026 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2747201995914,12cyclictest2749347-21/usr/sbin/munin07:20:202
274719799587,21cyclictest0-21swapper/010:25:010
2747200995741,12cyclictest231ktimers/109:25:121
2747197995611,8cyclictest14-21rcu_preempt11:20:010
2747197995611,8cyclictest14-21rcu_preempt11:20:010
2747200995541,9cyclictest2766929-21grep09:00:281
2747197995520,9cyclictest14-21rcu_preempt12:05:010
274720199547,34cyclictest0-21swapper/208:25:012
274719799541,51cyclictest0-21swapper/010:40:110
274719799511,5cyclictest0-21swapper/009:20:010
2747200994934,10cyclictest2764361-21grep08:45:291
2747200994916,28cyclictest231ktimers/111:40:241
2747197994937,9cyclictest0-21swapper/011:55:270
2747201994835,9cyclictest0-21swapper/210:10:272
2747200994829,10cyclictest0-21swapper/110:45:261
2747200994828,16cyclictest231ktimers/107:45:111
2747197994834,9cyclictest0-21swapper/011:00:020
2747200994730,8cyclictest0-21swapper/111:25:251
2747200994726,15cyclictest0-21swapper/109:20:211
274719799471,3cyclictest2764322-21grep08:45:280
2747200994631,7cyclictest0-21swapper/108:35:201
2747200994629,12cyclictest0-21swapper/109:35:191
2747200994622,12cyclictest231ktimers/107:30:191
2747197994639,4cyclictest2761805-21munin-plugin-st08:35:000
2747200994534,7cyclictest2765180-21grep08:50:281
2747200994528,7cyclictest0-21swapper/110:50:201
2747200994525,11cyclictest231ktimers/111:05:141
2747197994537,5cyclictest20850irq/208-8000000.ethernet08:55:260
2747197994531,10cyclictest0-21swapper/009:10:270
2747201994435,5cyclictest0-21swapper/209:20:292
2747201994430,8cyclictest311ktimers/207:30:122
2747201994428,9cyclictest0-21swapper/208:15:292
2747201994428,9cyclictest0-21swapper/208:15:292
274720099448,19cyclictest2747192-21cyclictest07:50:111
2747200994434,7cyclictest0-21swapper/109:15:281
2747200994433,7cyclictest2787324-21grep11:00:281
2747200994432,8cyclictest2752445-21grep07:35:271
2747200994432,8cyclictest2752445-21grep07:35:261
2747200994432,8cyclictest0-21swapper/111:30:281
2747200994432,8cyclictest0-21swapper/111:30:281
2747200994430,8cyclictest0-21swapper/110:20:281
2747200994429,8cyclictest0-21swapper/112:30:191
2747200994426,10cyclictest0-21swapper/108:40:271
2747200994425,6cyclictest0-21swapper/108:10:191
2747197994436,4cyclictest20850irq/208-8000000.ethernet12:20:280
2747197994433,7cyclictest0-21swapper/009:45:280
2747197994428,11cyclictest0-21swapper/008:40:270
2747201994336,5cyclictest2792465-21munin-plugin-st11:35:002
2747201994336,5cyclictest2792465-21munin-plugin-st11:35:002
2747200994333,7cyclictest231ktimers/107:15:281
2747200994331,8cyclictest231ktimers/110:10:111
2747200994328,7cyclictest0-21swapper/108:00:201
2747200994326,11cyclictest0-21swapper/111:10:201
2747197994336,4cyclictest2800068-21sendmail12:20:000
2747197994331,8cyclictest0-21swapper/007:20:300
274719799432,9cyclictest0-21swapper/008:25:000
2747201994227,10cyclictest2786377-21grep10:55:272
2747200994230,7cyclictest231ktimers/112:00:261
2747200994226,9cyclictest2775363-21grep09:50:281
2747200994225,8cyclictest0-21swapper/112:20:281
2747200994224,10cyclictest0-21swapper/111:20:271
2747197994229,7cyclictest0-21swapper/010:30:270
2747197994227,9cyclictest0-21swapper/010:45:270
2747197994226,10cyclictest0-21swapper/012:10:280
2747197994226,10cyclictest0-21swapper/012:10:280
274719799421,2cyclictest0-21swapper/009:05:010
2747201994132,5cyclictest2773721-21munin-plugin-st09:45:002
2747201994128,9cyclictest0-21swapper/210:45:272
2747201994127,9cyclictest0-21swapper/211:35:282
2747201994125,10cyclictest0-21swapper/211:25:012
2747200994127,6cyclictest0-21swapper/110:55:251
2747200994127,10cyclictest0-21swapper/110:05:271
2747200994126,8cyclictest0-21swapper/110:30:011
2747200994123,10cyclictest0-21swapper/107:20:291
2747200994119,11cyclictest0-21swapper/112:10:201
2747200994119,11cyclictest0-21swapper/112:10:201
2747197994131,6cyclictest0-21swapper/011:10:260
2747197994126,9cyclictest0-21swapper/008:20:010
2747197994126,9cyclictest0-21swapper/008:20:010
274719799411,3cyclictest0-21swapper/009:10:000
274720199407,23cyclictest30-21rcuc/212:30:012
2747200994028,6cyclictest0-21swapper/111:35:171
2747200994023,9cyclictest0-21swapper/107:25:281
274720099401,4cyclictest0-21swapper/108:59:591
274719799403,35cyclictest0-21swapper/008:50:240
2747197994032,5cyclictest20850irq/208-8000000.ethernet11:25:270
2747197994030,6cyclictest0-21swapper/007:44:590
2747197994029,7cyclictest0-21swapper/009:30:280
2747197994029,7cyclictest0-21swapper/009:30:280
2747197994025,11cyclictest0-21swapper/011:40:180
2747197994024,10cyclictest0-21swapper/007:55:260
274719799401,37cyclictest0-21swapper/009:55:260
2747201993928,8cyclictest0-21swapper/210:45:002
2747201993925,10cyclictest0-21swapper/208:00:192
2747200993928,4cyclictest0-21swapper/112:05:251
274720099392,22cyclictest2748021-21munin-node07:15:011
274720099392,22cyclictest2748021-21munin-node07:15:011
2747200993921,10cyclictest0-21swapper/111:45:221
2747197993928,8cyclictest0-21swapper/009:20:290
2747197993928,7cyclictest0-21swapper/007:10:280
2747197993928,7cyclictest0-21swapper/007:10:270
2747197993917,20cyclictest19750irq/27-20000000.i2c11:30:170
2747197993917,20cyclictest19750irq/27-20000000.i2c11:30:170
274719799391,3cyclictest0-21swapper/010:35:270
274719799391,3cyclictest0-21swapper/010:35:270
2747201993826,9cyclictest0-21swapper/210:35:272
2747201993826,9cyclictest0-21swapper/210:35:272
2747201993824,10cyclictest0-21swapper/210:50:292
2747200993828,7cyclictest231ktimers/110:15:211
2747200993827,5cyclictest0-21swapper/109:55:191
2747200993817,12cyclictest231ktimers/109:45:131
2747197993831,5cyclictest20850irq/208-8000000.ethernet07:25:160
2747197993828,6cyclictest2793214-21grep11:35:280
2747197993827,8cyclictest2776819-21proc_pri10:00:260
2747197993824,10cyclictest0-21swapper/009:40:280
274719799381,35cyclictest0-21swapper/007:50:120
2747201993729,5cyclictest0-21swapper/207:35:272
2747201993729,5cyclictest0-21swapper/207:35:272
2747201993728,5cyclictest0-21swapper/209:25:272
2747201993726,5cyclictest0-21swapper/207:55:262
2747201993717,16cyclictest311ktimers/210:15:172
2747200993728,4cyclictest0-21swapper/110:35:211
2747200993728,4cyclictest0-21swapper/110:35:211
2747200993725,6cyclictest0-21swapper/109:40:271
2747200993723,5cyclictest0-21swapper/107:40:161
2747200993718,11cyclictest2771657-21uname09:30:231
2747200993718,11cyclictest2771657-21uname09:30:231
2747197993731,4cyclictest20850irq/208-8000000.ethernet10:20:000
2747197993730,4cyclictest20850irq/208-8000000.ethernet11:05:260
2747197993726,8cyclictest0-21swapper/007:35:270
2747197993726,8cyclictest0-21swapper/007:35:270
274719799372,31cyclictest2803246-21find12:35:260
274719799372,31cyclictest2803246-21find12:35:260
274719799371,3cyclictest0-21swapper/008:10:240
274719799371,34cyclictest2786764-21apt-get11:00:070
2747201993627,5cyclictest0-21swapper/211:25:272
2747201993627,5cyclictest0-21swapper/209:05:282
2747201993627,4cyclictest0-21swapper/210:00:282
2747201993626,6cyclictest0-21swapper/208:40:262
2747200993629,4cyclictest231ktimers/108:20:251
2747200993628,5cyclictest231ktimers/111:15:111
2747200993628,5cyclictest231ktimers/111:15:111
2747200993628,4cyclictest0-21swapper/109:05:251
2747200993627,7cyclictest231ktimers/110:30:211
2747200993627,5cyclictest2803440-21munin-plugin-st12:40:001
2747200993627,5cyclictest2803440-21munin-plugin-st12:40:001
2747200993625,7cyclictest231ktimers/108:30:271
2747200993625,5cyclictest231ktimers/112:15:121
2747200993624,8cyclictest0-21swapper/110:00:281
2747200993623,7cyclictest0-21swapper/108:30:011
2747197993629,4cyclictest20850irq/208-8000000.ethernet07:45:170
2747197993625,8cyclictest0-21swapper/007:15:300
2747197993625,7cyclictest0-21swapper/011:20:280
2747197993623,8cyclictest0-21swapper/011:50:280
274719799361,4cyclictest0-21swapper/012:30:150
274719799361,33cyclictest0-21swapper/008:25:240
2747201993524,7cyclictest0-21swapper/209:45:292
2747201993524,7cyclictest0-21swapper/209:30:282
2747201993524,7cyclictest0-21swapper/209:30:282
274720099354,19cyclictest2757512-21sed08:05:271
2747200993528,4cyclictest231ktimers/110:40:221
2747200993524,7cyclictest47-21kauditd08:00:001
2747200993517,10cyclictest231ktimers/111:55:111
274719799352,4cyclictest2796950-21df12:00:160
274719799351,4cyclictest0-21swapper/009:50:130
274719799351,3cyclictest0-21swapper/009:35:190
274719799351,32cyclictest0-21swapper/010:54:400
274719799351,32cyclictest0-21swapper/008:35:270
2747201993426,5cyclictest2776150-21unixbench_multi09:55:282
2747201993424,6cyclictest0-21swapper/211:50:262
2747201993424,6cyclictest0-21swapper/207:50:172
2747201993423,8cyclictest0-21swapper/208:45:292
2747201993423,6cyclictest2794900-21grep11:45:292
274720099346,19cyclictest24-21ksoftirqd/107:10:011
274720099342,8cyclictest0-21swapper/109:15:011
274719799346,25cyclictest0-21swapper/008:05:220
2747197993426,4cyclictest0-21swapper/009:30:010
2747197993426,3cyclictest2756550-21find08:00:270
274719799341,4cyclictest0-21swapper/010:05:140
274719799341,31cyclictest0-21swapper/011:45:250
274719799341,27cyclictest2747353-21latency_hist07:10:000
2747201993322,8cyclictest0-21swapper/210:30:252
2747201993321,8cyclictest0-21swapper/208:05:272
2747201993319,8cyclictest311ktimers/212:30:142
2747201993315,13cyclictest311ktimers/209:10:112
2747201993315,13cyclictest0-21swapper/208:10:292
2747200993325,5cyclictest231ktimers/108:15:231
2747200993325,5cyclictest231ktimers/108:15:221
2747200993324,6cyclictest22-21rcuc/112:25:241
2747197993321,7cyclictest15-21rcuc/012:25:240
274719799331,30cyclictest2778453-21/usr/sbin/munin10:10:260
274719799331,30cyclictest0-21swapper/007:30:180
274720199329,10cyclictest2764627-21/usr/sbin/munin08:50:192
2747201993226,4cyclictest2766323-21/usr/sbin/munin09:00:192
2747201993223,6cyclictest311ktimers/210:05:132
2747201993223,6cyclictest0-21swapper/207:15:002
2747201993223,6cyclictest0-21swapper/207:15:002
2747201993222,7cyclictest0-21swapper/211:55:272
2747201993222,6cyclictest0-21swapper/212:20:282
2747201993221,7cyclictest311ktimers/208:30:112
2747201993219,8cyclictest0-21swapper/211:10:292
2747200993222,6cyclictest231ktimers/111:50:151
274719799321,5cyclictest2780941-21perl10:25:200
2747201993125,4cyclictest14-21rcu_preempt09:50:282
2747201993123,4cyclictest0-21swapper/211:00:162
2747201993123,4cyclictest0-21swapper/208:55:222
2747201993122,6cyclictest2797486-21grep12:00:282
2747201993122,6cyclictest0-21swapper/208:25:282
274720199311,28cyclictest0-21swapper/207:45:262
2747201993022,5cyclictest2803365-21grep12:35:282
2747201993022,5cyclictest2803365-21grep12:35:282
2747201993021,4cyclictest0-21swapper/211:15:212
2747201993021,4cyclictest0-21swapper/211:15:212
2747201993017,9cyclictest0-21swapper/210:20:262
2747201993016,10cyclictest2752728-21apt-get07:40:122
2747201993010,13cyclictest167550irq/134-8000000.ethernet-tx209:36:182
2747201992921,6cyclictest2797736-21/usr/sbin/munin12:05:162
274720199291,25cyclictest2781022-21irqstats10:25:222
2747201992912,13cyclictest311ktimers/207:25:142
2747201992911,15cyclictest167550irq/134-8000000.ethernet-tx207:17:232
2747201992911,13cyclictest311ktimers/211:40:112
2747201992821,4cyclictest0-21swapper/212:15:272
274720199281,25cyclictest0-21swapper/209:15:262
274720199278,13cyclictest167550irq/134-8000000.ethernet-tx208:37:192
2747201992719,6cyclictest311ktimers/211:05:212
2747201992719,5cyclictest2799109-21grep12:10:292
2747201992719,5cyclictest2799109-21grep12:10:282
2747201992618,5cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional