You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 00:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sun May 04, 2025 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36836699721,57cyclictest0-21swapper/008:50:130
36837099681,46cyclictest0-21swapper/208:30:012
36836699659,20cyclictest25250irq/422-mmc107:25:020
36836699601,3cyclictest0-21swapper/011:50:120
368366995951,5cyclictest370298-21munin-plugin-st07:20:000
368366995551,2cyclictest0-21swapper/007:45:000
36836799542,13cyclictest379631-21gpgv08:15:011
36836799542,13cyclictest379631-21gpgv08:15:001
368366995443,8cyclictest0-21swapper/007:50:000
368367995238,10cyclictest231ktimers/107:10:161
368370994934,11cyclictest383938-21sendmail08:40:012
36836699494,9cyclictest0-21swapper/012:40:010
368366994934,11cyclictest0-21swapper/007:25:000
368366994914,30cyclictest0-21swapper/011:05:300
368366994910,35cyclictest0-21swapper/009:55:350
36836699485,14cyclictest369186-21munin-node07:15:010
368370994735,7cyclictest404322-21sendmail10:40:002
368367994737,6cyclictest400882-21grep10:15:301
368367994716,26cyclictest22-21rcuc/112:00:321
36836799471,18cyclictest384775-21kworker/u8:3+ext4-rsv-conversion09:25:011
368366994724,20cyclictest20750irq/251-8000000.ethernet12:20:250
36836699471,4cyclictest0-21swapper/009:15:200
368370994639,4cyclictest420320-21munin-plugin-st12:14:592
368366994637,4cyclictest20950irq/209-8000000.ethernet11:15:000
36836699461,8cyclictest0-21swapper/009:10:000
368370994530,9cyclictest0-21swapper/207:10:302
368367994538,4cyclictest0-21swapper/109:15:001
368367994533,7cyclictest382223-21grep08:25:311
368366994528,10cyclictest0-21swapper/011:40:010
368370994436,5cyclictest311ktimers/210:40:202
368367994418,13cyclictest231ktimers/112:20:171
36836799441,4cyclictest0-21swapper/108:35:011
368366994436,4cyclictest20950irq/209-8000000.ethernet08:20:220
368370994335,5cyclictest422943-21munin-plugin-st12:30:012
368367994333,6cyclictest420238-21grep12:10:301
368367994328,7cyclictest0-21swapper/111:50:301
368367994328,10cyclictest0-21swapper/109:50:311
368367994317,13cyclictest231ktimers/109:30:171
368366994322,4cyclictest0-21swapper/012:00:190
36836699431,40cyclictest0-21swapper/008:25:140
368370994235,4cyclictest372821-21munin-plugin-st07:35:002
368370994233,5cyclictest0-21swapper/207:55:012
368370994225,12cyclictest14-21rcu_preempt12:00:162
368370994210,27cyclictest311ktimers/211:00:312
368367994233,5cyclictest378606-21unixbench_multi08:05:301
36836699427,2cyclictest0-21swapper/008:00:010
368366994232,6cyclictest0-21swapper/009:30:140
36836699421,35cyclictest0-21swapper/010:35:160
36837099418,22cyclictest393396-21/usr/sbin/munin09:35:202
368370994126,11cyclictest0-21swapper/207:45:322
36837099411,31cyclictest0-21swapper/209:05:292
368367994132,6cyclictest383864-21grep08:35:291
368367994131,6cyclictest376953-21grep07:55:301
368367994129,9cyclictest397491-21sendmail10:00:001
36836699414,6cyclictest377846-21sed08:00:320
368366994136,2cyclictest0-21swapper/010:25:130
368370994032,4cyclictest419483-21munin-plugin-st12:10:002
368370994032,3cyclictest400961-21sendmail10:20:002
368370994031,5cyclictest0-21swapper/208:50:002
368370994031,5cyclictest0-21swapper/208:50:002
36837099401,33cyclictest0-21swapper/211:30:232
36837099401,32cyclictest422044-21unixbench_singl12:20:312
368367994031,5cyclictest0-21swapper/107:50:311
368367994029,6cyclictest0-21swapper/108:55:001
368367994028,7cyclictest405080-21grep10:40:301
368366994033,5cyclictest0-21swapper/007:35:300
36836699401,5cyclictest372235-21df07:30:180
368370993931,4cyclictest168450irq/135-8000000.ethernet-tx209:45:262
368370993930,4cyclictest168450irq/135-8000000.ethernet-tx210:20:232
368367993930,4cyclictest0-21swapper/111:45:291
368367993928,6cyclictest0-21swapper/112:30:011
36836799391,5cyclictest0-21swapper/108:05:011
36836799391,2cyclictest0-21swapper/110:50:011
368366993933,4cyclictest0-21swapper/010:30:140
368366993931,5cyclictest20950irq/209-8000000.ethernet09:35:300
368366993921,9cyclictest0-21swapper/008:15:010
368366993921,9cyclictest0-21swapper/008:15:010
368370993830,5cyclictest0-21swapper/209:00:302
368370993824,9cyclictest423776-21apt12:35:002
368367993832,4cyclictest14-21rcu_preempt12:15:201
368367993831,5cyclictest14-21rcu_preempt11:30:201
368367993827,5cyclictest0-21swapper/109:45:231
368367993825,9cyclictest22-21rcuc/108:40:301
368367993824,7cyclictest231ktimers/111:20:251
368366993829,6cyclictest0-21swapper/009:00:300
36836699381,4cyclictest398005-21meminfo10:00:270
368370993729,5cyclictest168450irq/135-8000000.ethernet-tx208:40:292
36837099372,6cyclictest378043-21latency_hist08:05:022
368370993726,8cyclictest0-21swapper/211:55:272
368370993722,8cyclictest0-21swapper/207:55:302
368370993718,14cyclictest311ktimers/209:15:142
36837099371,29cyclictest371967-21sshd07:27:342
36836799373,14cyclictest423976-21/usr/sbin/munin12:35:211
368367993730,4cyclictest168350irq/127-8000000.ethernet-tx111:20:011
368367993727,6cyclictest414389-21grep11:35:301
368367993725,8cyclictest0-21swapper/111:55:301
368366993733,2cyclictest0-21swapper/011:35:010
368366993732,2cyclictest0-21swapper/012:15:160
368366993730,4cyclictest0-21swapper/010:10:150
368366993729,4cyclictest0-21swapper/011:00:000
368366993729,3cyclictest0-21swapper/012:15:000
368366993726,7cyclictest0-21swapper/011:40:280
36836699372,24cyclictest25250irq/422-mmc108:50:010
36836699372,24cyclictest25250irq/422-mmc108:50:010
368370993630,4cyclictest168450irq/135-8000000.ethernet-tx211:15:272
368370993628,4cyclictest0-21swapper/209:10:202
368370993623,8cyclictest0-21swapper/210:10:292
36837099361,29cyclictest0-21swapper/208:55:292
36836799363,12cyclictest22-21rcuc/108:20:151
368367993629,5cyclictest14-21rcu_preempt07:45:251
368367993628,5cyclictest0-21swapper/112:30:301
368367993628,4cyclictest0-21swapper/107:25:301
368367993627,5cyclictest0-21swapper/110:05:211
368367993622,10cyclictest0-21swapper/111:10:291
368367993620,11cyclictest231ktimers/110:25:121
368367993619,12cyclictest231ktimers/110:30:141
36836799361,29cyclictest0-21swapper/110:35:171
368366993630,4cyclictest20950irq/209-8000000.ethernet10:15:190
36836699361,33cyclictest0-21swapper/008:20:000
36836699361,32cyclictest396025-21lsblk09:50:220
368370993528,4cyclictest168450irq/135-8000000.ethernet-tx211:25:302
36837099351,5cyclictest399118-21unixbench_singl10:05:302
36837099351,30cyclictest391299-21ptp4l09:20:292
36837099351,27cyclictest380816-21dropbear08:20:212
368367993526,5cyclictest0-21swapper/107:15:291
368367993524,7cyclictest0-21swapper/111:05:321
36836699352,8cyclictest394706-21wc09:40:320
368366993528,4cyclictest20950irq/209-8000000.ethernet12:25:120
368366993528,4cyclictest20950irq/209-8000000.ethernet11:15:240
368366993523,7cyclictest0-21swapper/008:35:290
36836699351,8cyclictest401901-21latency_hist10:25:010
36836699351,32cyclictest387151-21run-parts08:55:270
36836699351,2cyclictest378079-21apt-get08:05:150
36836699351,2cyclictest0-21swapper/010:05:300
368370993426,5cyclictest414434-21sendmail11:40:012
368370993425,4cyclictest405881-21threads10:45:302
368370993423,8cyclictest0-21swapper/212:15:222
368367993426,5cyclictest387303-21munin-plugin-st09:00:001
368367993425,5cyclictest0-21swapper/111:40:201
368367993424,7cyclictest393983-21grep09:35:301
368367993423,6cyclictest419420-21grep12:05:301
368367993422,8cyclictest0-21swapper/108:15:341
368367993421,7cyclictest231ktimers/109:05:231
368367993417,11cyclictest231ktimers/109:25:151
36836799341,4cyclictest0-21swapper/111:00:011
368366993428,4cyclictest20950irq/209-8000000.ethernet10:50:250
368366993427,5cyclictest20950irq/209-8000000.ethernet11:55:180
368366993427,4cyclictest19950irq/27-20000000.i2c10:45:000
36836699341,26cyclictest376318-21latency_hist07:55:020
36837099332,9cyclictest14-21rcu_preempt09:55:012
368370993324,5cyclictest0-21swapper/208:30:282
368370993323,6cyclictest0-21swapper/210:50:192
368370993323,5cyclictest409311-21grep11:05:322
368370993322,6cyclictest30-21rcuc/210:00:312
36837099331,26cyclictest0-21swapper/209:30:222
36837099331,17cyclictest0-21swapper/212:35:142
368367993325,5cyclictest231ktimers/109:40:311
368367993324,5cyclictest0-21swapper/109:00:281
368367993321,9cyclictest390677-21sendmail09:20:001
368366993328,3cyclictest20950irq/209-8000000.ethernet11:00:310
368366993327,4cyclictest20950irq/209-8000000.ethernet09:20:240
368366993327,4cyclictest0-21swapper/010:45:190
368366993326,4cyclictest20950irq/209-8000000.ethernet09:10:150
368366993318,4cyclictest395388-1kworker/0:1H+kblockd11:25:010
36836699331,30cyclictest0-21swapper/012:05:250
36837099329,16cyclictest396851-21/usr/sbin/munin09:55:242
368370993221,7cyclictest0-21swapper/208:10:282
368370993221,7cyclictest0-21swapper/208:10:282
368370993219,9cyclictest0-21swapper/211:45:262
36837099321,29cyclictest0-21swapper/208:50:202
36837099321,27cyclictest378694-21sshd08:06:342
368367993224,5cyclictest405990-21kworker/u8:0-ext4-rsv-conversion10:55:011
368367993224,5cyclictest0-21swapper/110:00:231
368367993217,12cyclictest1666-21snmpd10:21:341
368366993225,4cyclictest0-21swapper/008:45:000
368366993223,5cyclictest0-21swapper/012:30:290
368366993222,7cyclictest0-21swapper/009:25:280
36837099315,4cyclictest0-21swapper/207:10:012
368370993120,7cyclictest394793-21grep09:40:332
36837099311,2cyclictest0-21swapper/207:25:012
368367993121,6cyclictest22-21rcuc/107:40:291
368367993113,16cyclictest1666-21snmpd11:28:211
36836799311,28cyclictest0-21swapper/107:35:191
36836699313,26cyclictest0-21swapper/011:45:160
368366993123,5cyclictest0-21swapper/009:45:290
36836699311,25cyclictest0-21swapper/011:25:120
368370993020,7cyclictest411609-21phc2sys11:20:272
368370993020,7cyclictest0-21swapper/209:25:202
36836799301,4cyclictest0-21swapper/107:10:011
36836799301,24cyclictest0-21swapper/108:45:211
36836799301,24cyclictest0-21swapper/108:45:211
36836699301,4cyclictest383067-21users08:30:300
368370992923,4cyclictest0-21swapper/210:55:122
368370992922,4cyclictest168450irq/135-8000000.ethernet-tx211:10:142
368370992919,6cyclictest0-21swapper/210:30:292
368370992916,9cyclictest311ktimers/207:40:132
36837099291,4cyclictest0-21swapper/208:20:012
36837099291,4cyclictest0-21swapper/207:35:202
368367992920,4cyclictest0-21swapper/110:15:001
368367992918,8cyclictest0-21swapper/107:20:301
36836799291,14cyclictest0-21swapper/107:30:071
368370992819,6cyclictest311ktimers/211:50:232
368367992819,6cyclictest22-21rcuc/111:00:301
368366992819,6cyclictest0-21swapper/007:10:010
36837099274,16cyclictest311ktimers/207:15:152
368370992721,4cyclictest0-21swapper/211:40:252
368370992620,3cyclictest0-21swapper/210:25:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional