You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 09:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Sat Nov 29, 2025 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3962047999386,4cyclictest30-21rcuc/223:50:012
396204399779,38cyclictest21250irq/208-8000000.ethernet22:25:180
396204399779,38cyclictest21250irq/208-8000000.ethernet22:25:180
3962047995949,6cyclictest3964110-21apt-key19:20:012
3962047995949,6cyclictest3964110-21apt-key19:20:002
396204399552,13cyclictest15-21rcuc/019:40:010
396204399552,13cyclictest15-21rcuc/019:40:000
3962043995144,4cyclictest3988844-21munin-plugin-st21:45:000
3962047995033,11cyclictest3990504-21grep21:50:292
3962047994936,7cyclictest3994771-21grep22:15:282
3962047994931,13cyclictest311ktimers/200:30:152
396204399495,8cyclictest3975522-21sh20:25:210
3962047994824,16cyclictest311ktimers/220:30:142
3962046994836,8cyclictest0-21swapper/119:20:011
3962046994836,8cyclictest0-21swapper/119:20:011
3962043994840,4cyclictest21250irq/208-8000000.ethernet21:55:270
3962046994734,9cyclictest0-21swapper/119:15:011
3962043994728,12cyclictest131ktimers/023:00:130
3962047994627,13cyclictest311ktimers/219:40:102
3962043994634,9cyclictest4008512-21latency_hist23:40:000
3962046994536,5cyclictest3981142-21munin-plugin-st21:00:011
3962046994532,9cyclictest231ktimers/123:10:141
396204399458,35cyclictest0-21swapper/021:00:170
3962043994532,9cyclictest0-21swapper/023:15:010
3962043994524,15cyclictest131ktimers/019:40:100
396204399451,10cyclictest0-21swapper/020:05:010
396204799444,31cyclictest0-21swapper/222:35:292
3962047994436,5cyclictest0-21swapper/222:25:012
3962047994431,8cyclictest0-21swapper/220:40:272
3962047994425,9cyclictest0-21swapper/220:00:272
3962047994424,15cyclictest311ktimers/222:40:142
3962047994424,15cyclictest311ktimers/222:40:142
3962046994437,4cyclictest4008464-21unixbench_singl23:35:301
3962046994434,7cyclictest0-21swapper/100:20:001
396204699443,10cyclictest4000739-21apt-get22:55:011
3962043994434,4cyclictest0-21swapper/020:30:140
396204399443,36cyclictest3999843-21grep22:45:280
3962047994335,4cyclictest3975981-21cron20:30:012
3962043994335,4cyclictest21050irq/252-8000000.ethernet00:35:050
3962043994333,7cyclictest3979298-21grep20:45:300
3962047994234,4cyclictest3982836-21munin-plugin-st21:10:002
3962047994229,8cyclictest0-21swapper/222:50:292
3962047994226,10cyclictest0-21swapper/219:45:212
3962047994223,12cyclictest14-21rcu_preempt23:25:002
3962047994220,15cyclictest311ktimers/200:20:142
3962046994225,8cyclictest0-21swapper/100:05:271
3962043994233,5cyclictest21250irq/208-8000000.ethernet22:00:280
3962043994227,11cyclictest131ktimers/000:30:120
3962043994214,7cyclictest0-21swapper/022:55:300
3962047994127,11cyclictest4011136-21munin-plugin-st23:55:002
3962047994126,9cyclictest0-21swapper/221:40:292
3962047994111,15cyclictest311ktimers/221:25:122
3962046994134,5cyclictest22-21rcuc/119:30:191
3962046994133,4cyclictest14-21rcu_preempt20:25:011
3962046994131,5cyclictest0-21swapper/121:10:281
3962043994137,2cyclictest0-21swapper/019:25:010
3962043994137,2cyclictest0-21swapper/019:25:010
3962043994133,4cyclictest21250irq/208-8000000.ethernet00:15:160
3962047994023,11cyclictest311ktimers/221:35:162
3962047994022,14cyclictest311ktimers/223:25:122
3962047994022,14cyclictest311ktimers/223:25:122
3962046994031,6cyclictest231ktimers/123:55:111
3962046994029,5cyclictest0-21swapper/121:40:271
3962046994028,8cyclictest0-21swapper/121:50:301
3962046994027,8cyclictest0-21swapper/100:25:291
3962046994020,8cyclictest231ktimers/100:30:121
396204699401,33cyclictest0-21swapper/121:05:271
3962043994035,3cyclictest0-21swapper/023:15:110
3962043994034,3cyclictest21050irq/252-8000000.ethernet22:40:200
3962043994034,3cyclictest21050irq/252-8000000.ethernet22:40:200
3962043994029,7cyclictest4013633-21grep00:05:280
3962043994028,8cyclictest0-21swapper/022:10:220
396204399401,37cyclictest0-21swapper/019:30:270
396204799393,21cyclictest30-21rcuc/220:20:212
3962047993930,5cyclictest0-21swapper/200:05:292
3962047993929,6cyclictest4004172-21unixbench_singl23:10:302
3962047993927,8cyclictest0-21swapper/221:15:012
3962047993924,10cyclictest0-21swapper/219:30:212
3962047993923,9cyclictest0-21swapper/222:45:282
396204699397,26cyclictest24-21ksoftirqd/121:30:191
3962046993929,7cyclictest231ktimers/120:10:301
3962046993928,7cyclictest22-21rcuc/121:35:281
3962046993928,6cyclictest3993042-21grep22:05:281
396204399393,6cyclictest1-21systemd22:30:280
3962043993928,6cyclictest0-21swapper/023:05:260
3962043993920,6cyclictest3634606-1kworker/0:2H+mmc_complete23:55:010
396204399391,6cyclictest3985268-21grep21:20:280
3962043993913,17cyclictest0-21swapper/000:00:010
3962047993831,5cyclictest3962040-21cyclictest19:30:002
3962047993825,8cyclictest0-21swapper/220:45:302
396204699385,5cyclictest231ktimers/119:20:181
396204699385,5cyclictest231ktimers/119:20:181
3962046993830,4cyclictest168350irq/126-8000000.ethernet-tx122:20:131
3962046993827,6cyclictest0-21swapper/121:55:271
3962046993826,6cyclictest3968496-21/usr/sbin/munin19:45:241
3962046993823,8cyclictest231ktimers/122:40:261
3962046993823,8cyclictest231ktimers/122:40:261
396204699382,12cyclictest39620401cyclictest00:10:151
396204699381,2cyclictest0-21swapper/122:15:011
3962043993834,2cyclictest0-21swapper/022:25:010
3962043993832,2cyclictest0-21swapper/020:25:020
3962043993830,5cyclictest3969029-21grep19:45:290
3962043993824,7cyclictest0-21swapper/022:55:010
3962047993728,7cyclictest3981353-21/usr/sbin/munin21:00:212
3962047993726,8cyclictest0-21swapper/222:05:282
3962047993725,9cyclictest0-21swapper/222:55:302
3962047993724,8cyclictest0-21swapper/220:10:292
3962046993731,4cyclictest14-21rcu_preempt21:25:271
3962046993730,4cyclictest168350irq/126-8000000.ethernet-tx120:50:161
3962046993730,4cyclictest168350irq/126-8000000.ethernet-tx120:50:151
3962046993727,5cyclictest0-21swapper/122:30:281
3962046993722,10cyclictest231ktimers/123:15:121
3962046993721,8cyclictest0-21swapper/123:45:011
3962046993721,8cyclictest0-21swapper/123:45:011
3962043993729,5cyclictest15-21rcuc/020:55:140
3962043993726,7cyclictest3978396-21sshd20:40:280
396204399371,34cyclictest0-21swapper/000:25:230
396204799363,22cyclictest877-21avahi-daemon19:55:012
396204799363,22cyclictest877-21avahi-daemon19:55:002
3962047993628,5cyclictest0-21swapper/200:35:212
3962047993626,5cyclictest0-21swapper/221:55:162
3962047993624,8cyclictest0-21swapper/222:30:282
3962047993621,9cyclictest0-21swapper/223:15:282
3962047993621,10cyclictest0-21swapper/221:20:282
3962046993627,5cyclictest3972462-21grep20:05:281
3962046993627,5cyclictest3972462-21grep20:05:271
3962046993627,5cyclictest168350irq/126-8000000.ethernet-tx121:45:031
3962046993626,5cyclictest3974202-21latency_hist20:20:001
3962046993625,7cyclictest0-21swapper/119:40:261
3962046993624,9cyclictest3977391-21proc_pri20:35:281
3962046993616,11cyclictest231ktimers/123:25:131
3962046993616,11cyclictest231ktimers/123:25:121
396204699361,29cyclictest0-21swapper/121:20:241
396204699361,28cyclictest0-21swapper/122:45:171
3962043993632,2cyclictest0-21swapper/020:35:290
3962043993630,4cyclictest21250irq/208-8000000.ethernet20:15:230
396204399362,9cyclictest3964038-21latency_hist19:20:010
396204399362,9cyclictest3964038-21latency_hist19:20:010
3962043993629,4cyclictest21250irq/208-8000000.ethernet23:45:010
3962043993629,4cyclictest21250irq/208-8000000.ethernet23:45:000
3962043993628,4cyclictest3992675-21fschecks_time22:05:200
3962043993627,6cyclictest4005896-21grep23:20:300
3962043993627,6cyclictest0-21swapper/021:15:270
3962043993626,4cyclictest0-21swapper/023:50:010
3962043993617,17cyclictest0-21swapper/021:35:250
396204399361,4cyclictest15-21rcuc/021:30:530
3962047993526,6cyclictest3974140-21grep20:15:302
3962047993524,5cyclictest0-21swapper/220:05:282
3962047993524,5cyclictest0-21swapper/220:05:282
3962047993522,9cyclictest0-21swapper/220:35:292
3962047993520,11cyclictest0-21swapper/223:05:202
3962047993516,8cyclictest0-21swapper/220:55:012
3962047993516,8cyclictest0-21swapper/220:55:012
3962046993529,3cyclictest14-21rcu_preempt22:15:201
3962046993526,5cyclictest231ktimers/120:30:291
396204699351,28cyclictest0-21swapper/119:29:591
3962043993528,4cyclictest0-21swapper/021:10:160
3962043993524,8cyclictest0-21swapper/019:50:300
3962043993524,8cyclictest0-21swapper/019:50:300
396204399351,5cyclictest4007638-21/usr/sbin/munin23:30:280
396204399351,3cyclictest3998088-21grep22:35:290
396204399351,32cyclictest0-21swapper/000:00:120
3962047993425,5cyclictest0-21swapper/220:55:182
3962047993424,6cyclictest0-21swapper/200:25:302
3962047993419,11cyclictest0-21swapper/223:55:282
3962046993427,4cyclictest0-21swapper/123:00:301
3962046993426,4cyclictest0-21swapper/122:25:191
3962046993426,4cyclictest0-21swapper/122:25:191
3962046993424,5cyclictest3984409-21sed21:15:291
3962046993422,8cyclictest3978413-21grep20:40:281
3962046993422,8cyclictest0-21swapper/123:50:001
3962046993421,9cyclictest0-21swapper/119:40:011
3962046993421,9cyclictest0-21swapper/119:40:011
396204699341,26cyclictest4012490-21/usr/sbin/munin00:00:241
396204399343,4cyclictest3970504-21phc2sys19:55:260
3962043993428,4cyclictest21250irq/208-8000000.ethernet22:15:110
3962043993427,5cyclictest21250irq/208-8000000.ethernet20:50:260
3962043993427,5cyclictest21250irq/208-8000000.ethernet20:50:260
3962047993324,4cyclictest0-21swapper/219:35:162
3962047993324,4cyclictest0-21swapper/219:35:162
3962047993321,9cyclictest0-21swapper/222:25:262
3962047993321,9cyclictest0-21swapper/222:25:262
3962047993321,8cyclictest0-21swapper/221:50:022
3962047993321,7cyclictest14-21rcu_preempt00:20:012
3962047993317,10cyclictest0-21swapper/223:30:272
396204799331,15cyclictest0-21swapper/222:15:012
3962046993327,4cyclictest14-21rcu_preempt23:55:001
3962046993325,5cyclictest3979119-21processes20:45:281
3962046993325,5cyclictest231ktimers/122:35:201
3962046993324,6cyclictest231ktimers/121:00:111
3962046993322,6cyclictest0-21swapper/119:50:231
3962046993322,6cyclictest0-21swapper/119:50:231
3962043993327,4cyclictest21250irq/208-8000000.ethernet19:10:160
3962043993327,4cyclictest14-21rcu_preempt21:45:210
3962043993327,4cyclictest14-21rcu_preempt19:25:250
3962043993326,4cyclictest14-21rcu_preempt00:20:290
3962043993325,5cyclictest3982829-21cron21:09:590
3962043993324,5cyclictest3990514-21grep21:50:290
3962047993218,9cyclictest0-21swapper/223:35:292
3962047993218,8cyclictest0-21swapper/222:00:292
396204699325,23cyclictest22-21rcuc/100:20:131
3962046993223,6cyclictest4002725-21/usr/sbin/munin23:05:191
3962046993223,5cyclictest0-21swapper/123:30:161
3962046993223,4cyclictest0-21swapper/120:25:281
396204699321,27cyclictest0-21swapper/122:55:161
3962043993226,4cyclictest14-21rcu_preempt20:05:250
3962043993226,4cyclictest14-21rcu_preempt20:05:250
3962043993217,3cyclictest3634606-1kworker/0:2H+kblockd19:10:020
3962043993215,11cyclictest131ktimers/000:10:120
3962047993122,5cyclictest0-21swapper/200:10:212
3962047993121,7cyclictest0-21swapper/221:30:282
3962047993121,6cyclictest0-21swapper/219:10:292
3962047993118,9cyclictest0-21swapper/220:00:012
3962046993124,4cyclictest22-21rcuc/100:35:161
396204699311,4cyclictest0-21swapper/120:00:151
3962043993125,4cyclictest131ktimers/020:10:250
3962043993122,6cyclictest131ktimers/021:25:150
3962043993121,7cyclictest4006202-21wc23:25:170
3962043993121,7cyclictest4006202-21wc23:25:170
3962047993018,8cyclictest0-21swapper/223:00:302
396204799301,5cyclictest4009236-21mailstats23:40:282
396204799301,5cyclictest4009236-21mailstats23:40:282
3962047992924,3cyclictest0-21swapper/219:20:182
3962047992924,3cyclictest0-21swapper/219:20:182
3962046992923,4cyclictest168350irq/126-8000000.ethernet-tx123:20:141
3962046992921,5cyclictest0-21swapper/120:00:001
396204699291,3cyclictest0-21swapper/122:05:011
3962047992817,5cyclictest0-21swapper/221:15:292
396204799281,25cyclictest4012809-21sshd00:01:282
3962047992616,7cyclictest0-21swapper/219:10:012
3962046992417,5cyclictest0-21swapper/119:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional