You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-27 - 08:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6s.osadl.org (updated Wed Sep 27, 2023 00:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19429799902,84cyclictest0-21swapper/020:10:010
194297997534,7cyclictest0-21swapper/022:10:340
19429799739,34cyclictest242930-21kworker/u8:223:50:020
194297997231,6cyclictest14850irq/28-2000000021:10:320
194297997019,34cyclictest218334-21/usr/sbin/munin21:25:270
194297996819,25cyclictest200823-21/usr/sbin/munin19:45:290
194297996815,33cyclictest221742-21/usr/sbin/munin21:45:280
19429799672,38cyclictest928-21dropbear20:25:290
194297996719,31cyclictest249131-21/usr/sbin/munin00:25:250
19430099612,3cyclictest131rcu_preempt22:05:371
194300996044,12cyclictest23-21ksoftirqd/120:00:201
194297996021,20cyclictest208675-21/usr/sbin/munin20:30:270
194297996021,20cyclictest208675-21/usr/sbin/munin20:30:270
19430099585,3cyclictest131rcu_preempt00:10:351
19430099582,3cyclictest131rcu_preempt19:30:361
19430099574,3cyclictest131rcu_preempt20:25:191
19430099574,3cyclictest131rcu_preempt00:15:371
19430099573,3cyclictest131rcu_preempt21:40:401
19430099573,3cyclictest131rcu_preempt21:40:391
194300995721,5cyclictest23-21ksoftirqd/123:20:401
19430099565,3cyclictest131rcu_preempt21:55:351
19430099565,3cyclictest131rcu_preempt00:35:341
19430099563,3cyclictest131rcu_preempt21:35:281
194297995646,7cyclictest18950irq/34-mmc119:35:010
19429799553,28cyclictest131rcu_preempt21:30:340
19430099544,3cyclictest131rcu_preempt23:30:341
19430099544,3cyclictest131rcu_preempt23:30:331
19430099544,3cyclictest131rcu_preempt22:30:291
19430099543,3cyclictest131rcu_preempt19:20:191
19430099542,27cyclictest131rcu_preempt19:35:361
19430099541,3cyclictest131rcu_preempt00:30:351
19430099541,3cyclictest131rcu_preempt00:30:341
19430099534,25cyclictest131rcu_preempt20:30:371
19430099534,25cyclictest131rcu_preempt20:30:371
19430099531,3cyclictest131rcu_preempt23:10:211
19429799531,49cyclictest0-21swapper/019:20:290
19430099522,3cyclictest131rcu_preempt23:15:361
19430099521,3cyclictest131rcu_preempt21:30:211
19430099521,27cyclictest131rcu_preempt22:20:261
19429799524,3cyclictest131rcu_preempt21:40:020
19430099514,26cyclictest131rcu_preempt21:15:331
19430099511,3cyclictest131rcu_preempt20:35:311
194300995015,4cyclictest23-21ksoftirqd/100:20:351
19430099501,3cyclictest131rcu_preempt21:25:321
19429799504,36cyclictest211187-21mktemp20:45:010
19429799501,43cyclictest0-21swapper/022:30:190
19429799485,32cyclictest131rcu_preempt19:50:270
194297994815,26cyclictest239742-21/usr/sbin/munin23:30:280
194297994815,26cyclictest239742-21/usr/sbin/munin23:30:270
19430099475,8cyclictest131rcu_preempt21:45:211
19430099475,7cyclictest131rcu_preempt20:05:201
194300994730,14cyclictest23-21ksoftirqd/123:55:291
19429799472,40cyclictest197471-21dropbear19:25:280
19430099461,41cyclictest201844-21dropbear19:50:301
19430099461,40cyclictest928-21dropbear19:55:301
19430099461,23cyclictest131rcu_preempt00:25:341
194297994632,10cyclictest231325-21fschecks_time22:40:290
19429799462,40cyclictest928-21dropbear00:00:320
194297994620,3cyclictest131rcu_preempt23:25:240
194297994616,25cyclictest0-21swapper/019:55:370
19429799461,22cyclictest131rcu_preempt20:15:280
19430099454,4cyclictest131rcu_preempt21:00:011
194297994538,4cyclictest16950irq/224-800000020:20:350
19429799452,35cyclictest243742-21unixbench_singl23:50:360
194297994515,26cyclictest0-21swapper/023:05:270
19429799451,40cyclictest228670-21dropbear22:25:260
19429799451,39cyclictest195658-21dropbear19:15:240
19430099442,38cyclictest928-21dropbear22:35:231
19430099442,37cyclictest928-21dropbear19:10:291
19430099441,3cyclictest131rcu_preempt21:05:251
19430099441,38cyclictest224451-21dropbear22:00:281
194300994410,5cyclictest23-21ksoftirqd/122:15:361
19429799449,22cyclictest237170-21/usr/sbin/munin23:15:270
194297994437,4cyclictest16950irq/224-800000000:30:280
194297994437,4cyclictest16950irq/224-800000000:30:280
19429799442,3cyclictest131rcu_preempt00:20:010
19429799442,39cyclictest928-21dropbear22:15:300
19429799442,37cyclictest209643-21dropbear20:35:270
19429799442,14cyclictest199365-21irqstats19:35:300
19429799441,39cyclictest928-21dropbear22:50:250
19429799441,39cyclictest928-21dropbear22:50:240
19429799441,39cyclictest928-21dropbear22:35:280
19430099438,11cyclictest23-21ksoftirqd/120:19:271
19430099432,8cyclictest131rcu_preempt23:50:201
19430099432,8cyclictest131rcu_preempt21:10:211
19430099432,6cyclictest131rcu_preempt23:40:231
194300994311,3cyclictest23-21ksoftirqd/119:15:321
194297994335,5cyclictest16950irq/224-800000023:00:050
19429799432,38cyclictest244158-21dropbear23:55:340
194297994315,23cyclictest12-21ksoftirqd/023:40:210
19429799431,37cyclictest928-21dropbear21:05:270
194297994310,10cyclictest131rcu_preempt20:45:270
19430099426,5cyclictest131rcu_preempt20:50:281
19430099423,3cyclictest131rcu_preempt22:55:291
19430099423,3cyclictest131rcu_preempt20:45:311
194300994214,6cyclictest131rcu_preempt20:40:281
19430099421,36cyclictest200078-21dropbear19:40:301
194300994210,5cyclictest131rcu_preempt19:25:181
19429799428,30cyclictest228463-21latency_hist22:25:000
19429799427,8cyclictest205792-21sshd20:13:280
194297994235,4cyclictest16950irq/224-800000021:50:380
194297994231,8cyclictest234384-21apt-config23:00:000
19429799422,36cyclictest236483-21dropbear23:10:140
194297994213,7cyclictest210480-21kworker/u8:021:15:210
19429799421,36cyclictest0-21swapper/000:35:250
19430099417,8cyclictest23-21ksoftirqd/122:25:231
19430099412,4cyclictest131rcu_preempt23:35:191
194300994124,12cyclictest217889-21cut21:20:341
19430099411,3cyclictest131rcu_preempt00:00:251
19429799414,23cyclictest151rcuc/022:50:020
194297994135,4cyclictest16950irq/224-800000000:05:320
194297994135,4cyclictest16950irq/224-800000000:05:320
194297994134,4cyclictest16950irq/224-800000022:00:240
194297994134,4cyclictest16950irq/224-800000020:55:260
19429799412,35cyclictest928-21dropbear21:40:290
19429799412,35cyclictest928-21dropbear21:40:290
19429799411,36cyclictest928-21dropbear21:20:260
19430099403,5cyclictest131rcu_preempt23:05:241
194300994034,4cyclictest156250irq/142-800000023:45:291
19430099403,3cyclictest131rcu_preempt22:50:241
19430099403,3cyclictest131rcu_preempt22:50:241
19430099402,34cyclictest207146-21dropbear20:20:281
19430099402,33cyclictest234694-21dropbear23:00:371
194300994019,15cyclictest23-21ksoftirqd/121:00:181
19430099401,35cyclictest231193-21dropbear22:40:251
194297994033,4cyclictest16950irq/224-800000023:25:010
194297994033,4cyclictest16950irq/224-800000020:50:260
194297994033,4cyclictest14850irq/28-2000000000:20:340
194297994030,7cyclictest12-21ksoftirqd/019:10:010
194297994025,10cyclictest12-21ksoftirqd/023:35:230
19430099394,3cyclictest131rcu_preempt00:10:021
19430099393,6cyclictest131rcu_preempt21:50:191
19430099392,3cyclictest131rcu_preempt22:10:371
19430099391,5cyclictest131rcu_preempt20:10:231
19429799397,9cyclictest12-21ksoftirqd/019:15:020
194297993933,4cyclictest16950irq/224-800000021:55:220
19429799392,33cyclictest246748-21grep00:10:340
19430099383,3cyclictest131rcu_preempt00:05:341
19430099382,32cyclictest928-21dropbear23:25:291
19429799386,22cyclictest131rcu_preempt20:00:320
19429799382,8cyclictest225731-21grep22:05:380
194300993726,7cyclictest232078-21dropbear22:45:231
19429799372,8cyclictest200619-21munin-run19:45:000
194297993715,3cyclictest131rcu_preempt21:05:010
19430099357,3cyclictest131rcu_preempt19:45:301
194303993025,3cyclictest0-21swapper/220:55:282
19430399301,26cyclictest0-21swapper/222:26:162
19430399301,26cyclictest0-21swapper/221:40:362
19430399301,26cyclictest0-21swapper/221:40:352
19430399301,26cyclictest0-21swapper/221:02:072
19430099302,3cyclictest131rcu_preempt19:10:011
19430399294,18cyclictest0-21swapper/219:55:022
19430399291,24cyclictest0-21swapper/223:00:052
19430399281,3cyclictest0-21swapper/220:06:552
19430399281,24cyclictest0-21swapper/220:15:272
19430399281,24cyclictest0-21swapper/219:11:462
194303992722,3cyclictest0-21swapper/222:45:282
19430399271,23cyclictest0-21swapper/223:25:292
19430399271,23cyclictest0-21swapper/222:40:352
19430399271,23cyclictest0-21swapper/221:17:272
19430399271,23cyclictest0-21swapper/219:25:292
19430399271,22cyclictest0-21swapper/221:50:322
194303992621,3cyclictest0-21swapper/223:55:342
194303992621,3cyclictest0-21swapper/221:05:272
194303992621,3cyclictest0-21swapper/220:45:362
194303992620,4cyclictest0-21swapper/222:32:252
19430399261,23cyclictest0-21swapper/222:50:232
19430399261,23cyclictest0-21swapper/222:50:232
19430399261,22cyclictest0-21swapper/221:47:282
19430399261,22cyclictest0-21swapper/221:32:132
19430399261,22cyclictest0-21swapper/221:27:122
19430399261,22cyclictest0-21swapper/221:20:302
19430399261,22cyclictest0-21swapper/220:20:252
19430399261,22cyclictest0-21swapper/220:00:312
19430399261,22cyclictest0-21swapper/219:55:282
194303992520,3cyclictest0-21swapper/220:40:002
194303992519,4cyclictest0-21swapper/223:05:192
194303992519,4cyclictest0-21swapper/219:20:282
19430399251,21cyclictest0-21swapper/223:35:302
19430399251,21cyclictest0-21swapper/221:38:282
19430399251,21cyclictest0-21swapper/200:00:392
194303992419,3cyclictest0-21swapper/222:23:292
194303992418,4cyclictest0-21swapper/220:40:372
194303992417,5cyclictest0-21swapper/222:00:352
19430399241,20cyclictest0-21swapper/223:16:272
19430399241,20cyclictest0-21swapper/222:13:262
19430399241,20cyclictest0-21swapper/221:59:282
194303992317,4cyclictest0-21swapper/220:10:352
194303992116,3cyclictest0-21swapper/223:46:292
194303992116,3cyclictest0-21swapper/223:20:342
194303992115,4cyclictest0-21swapper/200:06:292
194303992115,4cyclictest0-21swapper/200:06:282
19430399211,17cyclictest0-21swapper/219:48:282
194303992015,3cyclictest0-21swapper/223:00:012
194303992015,3cyclictest0-21swapper/200:22:462
19430399201,3cyclictest0-21swapper/222:16:142
19430399201,3cyclictest0-21swapper/200:31:432
19430399201,3cyclictest0-21swapper/200:31:422
19430399201,17cyclictest0-21swapper/219:40:452
19430399201,16cyclictest0-21swapper/220:25:542
19430399201,16cyclictest0-21swapper/200:29:332
194303991914,3cyclictest0-21swapper/223:13:282
19430399191,15cyclictest0-21swapper/223:34:322
19430399191,15cyclictest0-21swapper/223:34:322
19430399181,15cyclictest0-21swapper/220:33:272
19430399181,15cyclictest0-21swapper/220:33:272
194303991712,3cyclictest0-21swapper/219:35:272
194303991712,3cyclictest0-21swapper/200:35:182
19430399171,14cyclictest0-21swapper/219:15:402
194303991711,3cyclictest0-21swapper/222:05:242
194303991611,3cyclictest0-21swapper/223:44:282
19430399151,11cyclictest0-21swapper/200:10:222
19430399141,11cyclictest0-21swapper/220:52:052
19430399141,11cyclictest0-21swapper/200:15:382
19430399135,5cyclictest0-21swapper/219:10:002
19430399121,9cyclictest0-21swapper/223:54:292
19430399115,4cyclictest0-21swapper/221:10:362
19430399112,7cyclictest0-21swapper/219:35:012
19430399101,7cyclictest0-21swapper/222:35:272
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional