You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 06:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot5s.osadl.org (updated Fri Apr 19, 2024 00:43:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
811320,0rcu_preempt19-21ksoftirqd/119:39:311
81780,0rcu_preempt21851-21kworker/0:022:09:300
81760,0rcu_preempt3-21ksoftirqd/021:59:550
81740,0rcu_preempt3-21ksoftirqd/022:59:390
81730,0rcu_preempt9433-21kworker/0:123:47:220
81720,0rcu_preempt3-21ksoftirqd/022:49:590
81720,0rcu_preempt3-21ksoftirqd/021:36:480
81720,0rcu_preempt14085-21ssh00:24:420
81720,0rcu_preempt14085-21ssh00:24:420
81700,0rcu_preempt9650-21kworker/0:221:49:490
81700,0rcu_preempt25717-21kworker/0:021:46:270
81700,0rcu_preempt21851-21kworker/0:022:23:000
81700,0rcu_preempt18314-21kworker/0:223:55:550
81700,0rcu_preempt11966-21kworker/0:019:54:580
81690,0rcu_preempt9433-21kworker/0:123:41:540
81690,0rcu_preempt3-21ksoftirqd/022:29:360
81690,0rcu_preempt15037-21kworker/0:200:36:570
81690,0rcu_preempt1006-21kworker/0:023:06:320
81680,0rcu_preempt3-21ksoftirqd/020:04:410
9950670,0irq/345-484840019-21ksoftirqd/123:52:041
81670,0rcu_preempt548-21kworker/0:123:22:580
81670,0rcu_preempt3-21ksoftirqd/023:49:520
81670,0rcu_preempt3-21ksoftirqd/022:54:570
81670,0rcu_preempt3-21ksoftirqd/022:45:400
81670,0rcu_preempt3-21ksoftirqd/020:49:490
81670,0rcu_preempt3-21ksoftirqd/020:09:440
81670,0rcu_preempt0-21swapper/023:12:150
81660,0rcu_preempt3-21ksoftirqd/023:33:540
81660,0rcu_preempt3-21ksoftirqd/021:20:240
81660,0rcu_preempt3-21ksoftirqd/020:59:500
81660,0rcu_preempt3-21ksoftirqd/019:19:580
81660,0rcu_preempt28248-21kworker/0:100:01:360
81650,0rcu_preempt3-21ksoftirqd/020:29:500
81650,0rcu_preempt3-21ksoftirqd/000:08:150
81640,0rcu_preempt3-21ksoftirqd/022:41:360
81640,0rcu_preempt3-21ksoftirqd/020:22:430
81640,0rcu_preempt3-21ksoftirqd/020:15:040
81640,0rcu_preempt10189-21apt-get00:19:390
81630,0rcu_preempt3-21ksoftirqd/023:24:410
81630,0rcu_preempt3-21ksoftirqd/021:57:400
81630,0rcu_preempt3-21ksoftirqd/021:57:400
81630,0rcu_preempt3-21ksoftirqd/021:40:590
81630,0rcu_preempt3-21ksoftirqd/021:30:210
81630,0rcu_preempt3-21ksoftirqd/021:26:000
81630,0rcu_preempt3-21ksoftirqd/021:14:380
81630,0rcu_preempt3-21ksoftirqd/019:46:330
81630,0rcu_preempt0-21swapper/022:25:250
81620,0rcu_preempt3-21ksoftirqd/022:35:350
81620,0rcu_preempt3-21ksoftirqd/022:09:390
81620,0rcu_preempt3-21ksoftirqd/021:13:010
81620,0rcu_preempt3-21ksoftirqd/020:34:530
81620,0rcu_preempt3-21ksoftirqd/000:29:440
81620,0rcu_preempt3-21ksoftirqd/000:16:500
81620,0rcu_preempt29582-21kworker/0:023:38:420
81620,0rcu_preempt0-21swapper/000:11:540
10050620,0irq/346-484840054-21kswapd023:19:311
81610,0rcu_preempt3-21ksoftirqd/023:14:440
81610,0rcu_preempt3-21ksoftirqd/022:18:480
81610,0rcu_preempt3-21ksoftirqd/020:54:440
81610,0rcu_preempt3-21ksoftirqd/020:44:560
81610,0rcu_preempt3-21ksoftirqd/020:44:560
81610,0rcu_preempt3-21ksoftirqd/020:39:490
81600,0rcu_preempt3-21ksoftirqd/020:24:500
81600,0rcu_preempt3-21ksoftirqd/019:59:560
81600,0rcu_preempt3-21ksoftirqd/019:49:470
81600,0rcu_preempt3-21ksoftirqd/019:33:140
81600,0rcu_preempt3-21ksoftirqd/019:09:420
81600,0rcu_preempt0-21swapper/019:14:580
10050600,0irq/346-484840054-21kswapd022:39:521
81590,0rcu_preempt3-21ksoftirqd/021:05:220
81590,0rcu_preempt19-21ksoftirqd/121:15:001
81570,0rcu_preempt3-21ksoftirqd/019:42:490
81570,0rcu_preempt3-21ksoftirqd/019:35:420
81560,0rcu_preempt19-21ksoftirqd/100:00:001
81560,0rcu_preempt1749-21kworker/1:000:34:391
10050560,0irq/346-48484008116-1kworker/1:0H00:19:431
10050560,0irq/346-484840013575-1kworker/1:3H21:59:471
81540,0rcu_preempt19-21ksoftirqd/119:45:001
10050530,0irq/346-484840054-21kswapd021:30:501
10050530,0irq/346-48484002835-21munin-node1
10050510,0irq/346-484840019522-21runrttasks23:13:431
10050500,0irq/346-48484004975-21ssh22:19:311
10050500,0irq/346-484840015839-21wc21:54:301
81490,0rcu_preempt3-21ksoftirqd/019:24:430
10050490,0irq/346-484840054-21kswapd022:46:331
10050490,0irq/346-4848400109242sleep123:40:201
10050480,0irq/346-48484000-21swapper/123:08:101
81470,0rcu_preempt3-21ksoftirqd/019:04:510
81470,0rcu_preempt19-21ksoftirqd/100:14:421
10050470,0irq/346-484840054-21kswapd021:24:071
10050470,0irq/346-484840054-21kswapd020:19:311
10050470,0irq/346-484840054-21kswapd000:05:331
10050470,0irq/346-484840024129-21chrt21:24:531
10050460,0irq/346-48484009074-1kworker/1:3H23:04:121
10050460,0irq/346-48484000-21swapper/123:28:441
10050460,0irq/346-48484000-21swapper/122:36:561
10050460,0irq/346-48484000-21swapper/122:23:471
9950450,0irq/345-48484000-21swapper/123:46:441
10050450,0irq/346-484840054-21kswapd021:58:301
10050450,0irq/346-484840054-21kswapd021:58:301
10050450,0irq/346-48484004058-21cyclictest23:29:561
10050450,0irq/346-48484000-21swapper/122:34:151
9950430,0irq/345-48484000-21swapper/122:09:521
81430,0rcu_preempt19-21ksoftirqd/100:29:421
10050430,0irq/346-48484007297-21seq23:36:281
10050430,0irq/346-48484000-21swapper/122:52:421
10050420,0irq/346-48484000-21swapper/120:39:321
9950410,0irq/345-48484007342-21ping19:34:311
81410,0rcu_preempt4058-21cyclictest22:24:441
81410,0rcu_preempt19-21ksoftirqd/121:44:301
81410,0rcu_preempt19-21ksoftirqd/119:07:041
10050410,0irq/346-48484000-21swapper/123:54:531
9950400,0irq/345-48484007449-21latency_hist19:19:321
10050400,0irq/346-484840027161-21ssh22:06:591
10050400,0irq/346-484840022101-21ssh23:15:571
10050400,0irq/346-484840017452-21ssh00:29:311
10050400,0irq/346-484840017452-21ssh00:29:311
81390,0rcu_preempt0-21swapper/119:29:311
10050390,0irq/346-484840013426-21ssh21:11:271
81380,0rcu_preempt0-21swapper/120:19:501
10050380,0irq/346-48484003951-21ssh00:10:591
9950370,0irq/345-48484005825-1kworker/1:2H21:45:021
81370,0rcu_preempt20443-21sendmail-msp19:59:311
81360,0rcu_preempt4058-21cyclictest21:09:311
81350,0rcu_preempt0-21swapper/120:32:221
14362350,0chrt30095-1kworker/1:2H21:36:251
10050350,0irq/346-484840054-21kswapd020:10:021
81340,0rcu_preempt19-21ksoftirqd/120:59:311
81340,0rcu_preempt19-21ksoftirqd/120:54:301
76952340,0chrt7447-1kworker/1:0H20:59:231
185222340,0sleep110333-1kworker/1:2H19:51:491
10050340,0irq/346-484840013913-21sendmail-msp19:39:321
10050330,0irq/346-484840018495-1kworker/1:0H19:59:321
10050330,0irq/346-48484001154-21sendmail-msp20:39:311
10050330,0irq/346-48484000-21swapper/120:24:421
9950320,0irq/345-48484007335-21latency_hist19:19:301
10050300,0irq/346-484840022702-21if_eth320:04:511
10050290,0irq/346-48484004442-21munin-run20:49:291
10050290,0irq/346-48484004442-21munin-run20:49:291
406099272,0cyclictest10050irq/346-484840019:09:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional