You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-26 - 16:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Tue Aug 26, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
583028998916,17cyclictest586857-21/usr/sbin/munin07:30:181
58303399861,40cyclictest0-21swapper/312:05:193
58303199655,52cyclictest30-21rcuc/210:25:002
58302799657,14cyclictest583970-21munin-node07:15:010
583028996211,33cyclictest22-21rcuc/108:45:021
58302799592,16cyclictest0-21swapper/010:50:010
58302899575,15cyclictest616492-21apt-get10:25:011
583027995751,4cyclictest0-21swapper/012:20:170
58303199569,21cyclictest601211-21/usr/sbin/munin08:55:212
58302799568,15cyclictest20950irq/209-8000000.ethernet12:00:010
583027995445,5cyclictest0-21swapper/007:45:120
583028995344,5cyclictest607950-21munin-plugin-st09:35:001
583028995245,5cyclictest0-21swapper/109:20:011
583028995233,14cyclictest231ktimers/111:05:151
583028995228,16cyclictest231ktimers/108:30:151
58302799529,18cyclictest0-21swapper/011:10:000
583027995142,6cyclictest639366-21tail12:35:290
583028995012,33cyclictest621549-21unixbench_multi10:50:281
583027995015,26cyclictest620997-21/usr/sbin/munin10:50:190
583031994933,8cyclictest0-21swapper/209:15:302
58302799497,6cyclictest0-21swapper/012:05:010
58302799497,6cyclictest0-21swapper/012:05:010
58302799491,8cyclictest0-21swapper/011:15:010
583027994912,2cyclictest0-21swapper/007:30:010
583027994912,2cyclictest0-21swapper/007:30:010
583031994835,8cyclictest0-21swapper/207:30:282
583028994731,11cyclictest0-21swapper/107:40:201
583028994731,11cyclictest0-21swapper/107:40:201
583028994730,13cyclictest231ktimers/112:10:201
583027994739,4cyclictest0-21swapper/011:35:130
58303199461,19cyclictest0-21swapper/211:55:012
583028994636,7cyclictest618264-21munin-plugin-st10:35:001
583028994632,9cyclictest594990-21grep08:15:321
583028994632,10cyclictest0-21swapper/108:05:311
583028994631,12cyclictest231ktimers/112:15:151
583028994625,13cyclictest231ktimers/109:20:141
58302799469,13cyclictest14-21rcu_preempt08:40:010
58302799469,13cyclictest14-21rcu_preempt08:40:010
583028994530,9cyclictest0-21swapper/108:55:221
583028994528,11cyclictest231ktimers/107:20:141
583028994526,13cyclictest231ktimers/108:00:131
583028994513,21cyclictest612474-21/usr/sbin/munin10:00:201
58303199442,34cyclictest592772-21/usr/sbin/munin08:05:212
583031994321,12cyclictest311ktimers/212:25:112
583028994331,7cyclictest0-21swapper/107:15:311
583028994329,9cyclictest47-21kauditd10:40:001
583028994323,14cyclictest231ktimers/111:25:151
583031994230,6cyclictest592477-21grep08:00:302
583031994229,9cyclictest0-21swapper/210:30:352
583031994227,10cyclictest0-21swapper/212:35:292
583031994226,10cyclictest0-21swapper/207:15:012
583028994230,8cyclictest0-21swapper/112:00:281
583028994230,8cyclictest0-21swapper/112:00:281
583028994229,8cyclictest0-21swapper/109:00:301
583028994223,13cyclictest231ktimers/110:45:131
583028994223,11cyclictest0-21swapper/110:10:301
583028994222,13cyclictest231ktimers/111:20:151
58302799422,9cyclictest15-21rcuc/009:20:010
58302799421,35cyclictest0-21swapper/009:55:030
583031994130,8cyclictest0-21swapper/207:50:282
583031994130,6cyclictest621557-21grep10:50:282
583031994124,11cyclictest0-21swapper/211:00:322
583031994124,11cyclictest0-21swapper/211:00:322
583028994128,8cyclictest231ktimers/108:10:131
583028994124,10cyclictest0-21swapper/112:30:331
583027994129,8cyclictest0-21swapper/012:15:290
58302799411,7cyclictest0-21swapper/009:40:010
58302799411,7cyclictest0-21swapper/009:40:010
583031994032,5cyclictest591683-21grep07:55:302
583031994026,10cyclictest0-21swapper/208:25:272
583028994030,7cyclictest0-21swapper/112:25:281
583028994030,5cyclictest0-21swapper/107:55:301
583028994028,9cyclictest0-21swapper/111:30:311
583028994027,9cyclictest0-21swapper/107:50:281
583028994025,9cyclictest0-21swapper/112:35:291
583028994024,10cyclictest231ktimers/108:20:111
583028994022,13cyclictest231ktimers/109:40:121
583027994034,4cyclictest20950irq/209-8000000.ethernet08:00:270
583027994031,5cyclictest609641-21cron09:45:000
583027994029,6cyclictest20750irq/251-8000000.ethernet08:10:300
58302799402,4cyclictest626380-21meminfo11:20:250
58302799401,7cyclictest593129-21/usr/sbin/munin08:05:290
58302799401,4cyclictest0-21swapper/008:40:200
58302799401,33cyclictest0-21swapper/008:50:170
583031993930,6cyclictest311ktimers/207:15:042
583031993929,6cyclictest624122-21grep11:05:282
583031993928,7cyclictest311ktimers/209:45:262
583031993924,10cyclictest0-21swapper/211:35:312
583031993923,11cyclictest311ktimers/209:35:152
583031993923,11cyclictest311ktimers/209:35:152
58303199391,2cyclictest0-21swapper/211:35:012
58302899396,11cyclictest631227-21/usr/sbin/munin11:50:191
583028993927,8cyclictest0-21swapper/108:40:291
583028993924,10cyclictest0-21swapper/108:35:301
583028993924,10cyclictest0-21swapper/108:35:291
583028993922,9cyclictest0-21swapper/108:50:301
583028993914,9cyclictest616492-21apt-get10:25:011
58302899391,2cyclictest0-21swapper/109:15:011
583027993934,3cyclictest601002-21kworker/u8:4+events_power_efficient11:25:120
583027993925,9cyclictest0-21swapper/012:05:260
58302799392,33cyclictest0-21swapper/012:30:340
58302799391,4cyclictest629727-21grep11:40:220
58302799391,33cyclictest0-21swapper/009:30:260
58302799391,22cyclictest630905-21/usr/sbin/munin11:45:340
583031993832,3cyclictest14-21rcu_preempt11:10:212
583031993827,7cyclictest0-21swapper/209:00:292
583028993823,10cyclictest0-21swapper/111:45:331
58302799387,10cyclictest0-21swapper/008:30:010
583027993827,6cyclictest0-21swapper/010:55:300
583031993728,5cyclictest0-21swapper/208:10:302
583031993728,5cyclictest0-21swapper/207:45:172
583031993727,6cyclictest612168-21grep09:55:322
583031993726,8cyclictest0-21swapper/212:15:292
583031993725,7cyclictest0-21swapper/208:35:302
583031993725,7cyclictest0-21swapper/208:35:302
583031993724,9cyclictest0-21swapper/209:40:272
583031993724,8cyclictest311ktimers/210:25:122
583028993729,4cyclictest0-21swapper/111:55:271
583028993728,5cyclictest0-21swapper/108:25:281
583028993725,8cyclictest0-21swapper/109:35:291
583028993725,8cyclictest0-21swapper/109:35:291
583028993725,8cyclictest0-21swapper/109:05:341
58302799374,13cyclictest14-21rcu_preempt09:25:010
583027993732,3cyclictest0-21swapper/007:15:310
583027993729,4cyclictest0-21swapper/009:05:010
583027993727,5cyclictest131ktimers/011:15:290
58302799371,7cyclictest603587-21unixbench_singl09:05:340
58302799371,4cyclictest610961-21uname09:50:230
58302799371,34cyclictest131ktimers/008:55:300
583027993710,22cyclictest131ktimers/010:40:010
583031993629,4cyclictest14-21rcu_preempt11:45:312
583031993628,5cyclictest615638-21run-parts10:20:002
583031993627,6cyclictest311ktimers/211:15:252
583031993627,5cyclictest14-21rcu_preempt10:55:222
583031993622,9cyclictest0-21swapper/210:05:292
583028993623,9cyclictest0-21swapper/111:15:311
583028993623,8cyclictest0-21swapper/110:55:301
583028993622,7cyclictest0-21swapper/111:35:321
583027993629,4cyclictest20950irq/209-8000000.ethernet09:50:000
583027993629,4cyclictest0-21swapper/011:04:280
583027993629,4cyclictest0-21swapper/011:04:270
583027993625,8cyclictest0-21swapper/007:40:260
583027993625,8cyclictest0-21swapper/007:40:260
583027993624,7cyclictest0-21swapper/009:25:280
583027993613,7cyclictest0-21swapper/010:42:320
583031993529,4cyclictest14-21rcu_preempt12:30:282
583031993528,4cyclictest168450irq/135-8000000.ethernet-tx208:45:022
583031993528,4cyclictest0-21swapper/208:35:002
583031993525,7cyclictest588298-21grep07:35:302
583031993525,7cyclictest311ktimers/207:25:132
583031993525,7cyclictest311ktimers/207:25:132
583031993524,6cyclictest0-21swapper/208:20:292
583031993522,9cyclictest0-21swapper/210:45:012
58303199351,28cyclictest0-21swapper/209:05:212
58302899359,17cyclictest609846-21/usr/sbin/munin09:45:191
583028993520,8cyclictest0-21swapper/107:10:001
58302899351,6cyclictest634272-21threads12:05:281
583027993530,3cyclictest0-21swapper/010:05:220
583027993527,6cyclictest0-21swapper/007:20:250
583027993527,4cyclictest20950irq/209-8000000.ethernet12:25:260
583027993526,6cyclictest0-21swapper/007:55:300
583027993523,8cyclictest0-21swapper/010:00:300
58302799351,29cyclictest15-21rcuc/009:10:300
58302799351,28cyclictest617511-21sort10:30:000
583031993428,3cyclictest311ktimers/211:25:202
583031993423,6cyclictest311ktimers/208:55:002
583031993419,8cyclictest311ktimers/211:55:112
583028993422,8cyclictest589765-21sshd07:45:261
583028993422,8cyclictest0-21swapper/107:35:281
58302899341,4cyclictest0-21swapper/110:45:011
583027993427,4cyclictest19950irq/27-20000000.i2c11:35:000
583027993426,5cyclictest597544-21grep08:30:290
58302799342,28cyclictest618206-21unixbench_singl10:30:350
583027993421,8cyclictest0-21swapper/010:20:280
58302799341,10cyclictest0-21swapper/008:50:010
58303199339,3cyclictest27350irq/343-s-wl18xx11:20:132
583031993328,3cyclictest600137-21unixbench_singl08:45:282
583031993324,5cyclictest30-21rcuc/208:15:242
583031993323,7cyclictest311ktimers/211:40:122
583031993322,8cyclictest0-21swapper/210:35:242
583031993320,8cyclictest0-21swapper/209:30:252
58303199331,26cyclictest0-21swapper/212:20:142
583028993322,7cyclictest0-21swapper/111:40:291
583028993322,7cyclictest0-21swapper/111:00:321
583028993322,7cyclictest0-21swapper/111:00:321
583028993321,8cyclictest0-21swapper/111:10:311
583028993319,9cyclictest0-21swapper/110:05:301
583027993327,4cyclictest20950irq/209-8000000.ethernet08:20:000
583027993327,4cyclictest20750irq/251-8000000.ethernet07:30:210
583027993327,3cyclictest0-21swapper/007:50:140
583027993323,5cyclictest588483-21latency_hist07:40:010
58302799331,20cyclictest0-21swapper/011:50:310
583031993224,5cyclictest311ktimers/212:10:232
583031993224,4cyclictest614678-21grep10:10:292
583031993223,5cyclictest30-21rcuc/209:30:002
583031993221,6cyclictest311ktimers/209:10:312
583031993219,9cyclictest0-21swapper/207:40:262
583031993219,9cyclictest0-21swapper/207:40:262
583028993222,7cyclictest0-21swapper/107:15:001
583028993220,9cyclictest0-21swapper/109:55:321
583027993224,5cyclictest0-21swapper/012:10:330
58302799321,28cyclictest615153-21lsblk10:15:250
58302799321,25cyclictest0-21swapper/010:15:010
583031993125,4cyclictest620256-21ssh10:45:212
583031993122,5cyclictest633475-21grep12:00:292
583031993122,5cyclictest633475-21grep12:00:282
583028993116,11cyclictest231ktimers/110:15:151
58302899311,2cyclictest0-21swapper/112:25:001
58302899311,2cyclictest0-21swapper/107:30:011
58302899311,2cyclictest0-21swapper/107:30:011
583031993021,7cyclictest311ktimers/212:05:262
583031993021,6cyclictest311ktimers/209:20:162
583031993017,9cyclictest0-21swapper/210:00:302
583028993017,9cyclictest0-21swapper/109:25:211
58302799301,4cyclictest595384-21diskstats08:20:180
583028992925,2cyclictest0-21swapper/109:50:261
58302799291,4cyclictest0-21swapper/007:10:000
583031992822,4cyclictest14-21rcu_preempt07:20:142
583031992821,4cyclictest0-21swapper/209:50:192
583031992719,6cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional