You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-31 - 04:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI

ARM TI AM5728 @1000 MHz, Linux 4.4.12-rt17-osadl-g86c9060003 (Profile)

Latency plot of shadow in rack #a, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot5s.osadl.org (updated Tue Jan 31, 2023 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
81960,0rcu_preempt3-21ksoftirqd/000:03:470
81740,0rcu_preempt4428-21kworker/1:021:32:461
81740,0rcu_preempt4428-21kworker/1:021:32:461
81720,0rcu_preempt19-21ksoftirqd/120:20:321
81670,0rcu_preempt3-21ksoftirqd/000:28:490
81670,0rcu_preempt19-21ksoftirqd/100:21:071
81660,0rcu_preempt54-21kswapd022:32:221
81650,0rcu_preempt19-21ksoftirqd/119:39:221
9950630,0irq/345-4848400181ktimersoftd/122:42:121
81630,0rcu_preempt54-21kswapd019:48:290
81630,0rcu_preempt3-21ksoftirqd/022:04:000
81630,0rcu_preempt3-21ksoftirqd/021:39:120
81630,0rcu_preempt19-21ksoftirqd/121:27:131
81620,0rcu_preempt19-21ksoftirqd/123:50:091
81620,0rcu_preempt19-21ksoftirqd/122:56:521
81600,0rcu_preempt8258-21cyclictest20:25:471
81600,0rcu_preempt3-21ksoftirqd/023:19:200
10050590,0irq/346-484840028708-21ssh21:24:310
9950580,0irq/345-484840015054-21diskmemload22:26:050
9950580,0irq/345-484840015054-21diskmemload22:26:050
10050580,0irq/346-48484000-21swapper/021:23:350
9950570,0irq/345-48484009177-1kworker/0:0H00:22:470
81570,0rcu_preempt9260-21sed23:39:390
81570,0rcu_preempt9260-21sed23:39:390
81560,0rcu_preempt7067-21wget20:43:580
81560,0rcu_preempt30111-1kworker/1:2H23:29:111
81560,0rcu_preempt20229-21meminfo21:54:090
81550,0rcu_preempt9950irq/345-484840022:18:441
81550,0rcu_preempt3-21ksoftirqd/023:34:290
81550,0rcu_preempt3-21ksoftirqd/019:03:580
10050550,0irq/346-484840054-21kswapd023:53:420
10050540,0irq/346-484840054-21kswapd021:49:270
10050540,0irq/346-484840018546-21runrttasks22:32:360
81530,0rcu_preempt3-21ksoftirqd/022:13:410
81530,0rcu_preempt3-21ksoftirqd/020:59:050
81530,0rcu_preempt19-21ksoftirqd/122:34:431
81530,0rcu_preempt17071-21meminfo19:34:180
10050530,0irq/346-48484004019-21ls21:34:150
10050530,0irq/346-48484000-21swapper/023:29:290
81520,0rcu_preempt3-21ksoftirqd/022:48:550
9950510,0irq/345-484840032202-21ls21:29:100
9950510,0irq/345-484840032202-21ls21:29:100
81510,0rcu_preempt3-21ksoftirqd/022:44:310
81510,0rcu_preempt19-21ksoftirqd/123:19:381
13250510,0irq/301-480200011066-21rm00:24:010
10050510,0irq/346-484840054-21kswapd023:16:230
10050510,0irq/346-48484000-21swapper/023:09:460
10050500,0irq/346-484840054-21kswapd021:44:310
10050500,0irq/346-484840054-21kswapd021:44:310
9950490,0irq/345-48484004344-21ls00:14:260
10050490,0irq/346-484840054-21kswapd023:03:390
81480,0rcu_preempt19-21ksoftirqd/119:08:411
10050480,0irq/346-48484005763-1kworker/0:1H22:19:230
10050480,0irq/346-484840054-21kswapd023:44:330
10050480,0irq/346-484840054-21kswapd022:39:360
10050480,0irq/346-48484000-21swapper/021:10:290
9950470,0irq/345-48484000-21swapper/019:29:360
9950470,0irq/345-48484000-21swapper/019:29:360
10050470,0irq/346-484840054-21kswapd023:49:280
10050470,0irq/346-484840025233-21ls23:59:130
10050470,0irq/346-484840023089-21ssh21:18:300
81460,0rcu_preempt3-21ksoftirqd/022:33:540
81460,0rcu_preempt3-21ksoftirqd/021:58:570
81460,0rcu_preempt3-21ksoftirqd/021:58:570
81460,0rcu_preempt3-21ksoftirqd/000:09:090
81460,0rcu_preempt3-21ksoftirqd/000:09:090
10050460,0irq/346-484840054-21kswapd020:06:480
10050460,0irq/346-48484002940-21ssh22:13:370
10050460,0irq/346-484840011411-21ping19:43:180
10050460,0irq/346-48484000-21swapper/020:09:280
81450,0rcu_preempt3-21ksoftirqd/022:54:190
81450,0rcu_preempt3-21ksoftirqd/020:00:490
10050450,0irq/346-48484000-21swapper/021:08:390
10050450,0irq/346-48484000-21swapper/020:34:250
10050450,0irq/346-48484000-21swapper/019:24:090
81440,0rcu_preempt20421-21ps21:54:171
1599440,0migration/024154-21runrttasks19:55:010
9950430,0irq/345-484840031562-21munin-node0
9950430,0irq/345-48484001592-21runrttasks20:25:070
81430,0rcu_preempt3-21ksoftirqd/020:13:560
10050430,0irq/346-484840054-21kswapd023:25:430
10050430,0irq/346-484840054-21kswapd023:25:430
10050430,0irq/346-484840019134-21ls00:34:130
10050430,0irq/346-484840011415-21run-parts19:18:390
81420,0rcu_preempt22290-21ls19:49:210
81420,0rcu_preempt19-21ksoftirqd/123:59:161
10050420,0irq/346-484840014786-21ssh23:08:120
9950410,0irq/345-484840019159-21ssh00:34:141
81410,0rcu_preempt8858-21diskstats20:49:000
81410,0rcu_preempt2662-21meminfo20:29:090
81400,0rcu_preempt10943-21tr20:54:150
81400,0rcu_preempt0-21swapper/019:09:130
9950390,0irq/345-48484000-21swapper/119:48:551
8259993912,0cyclictest11411-21ping19:19:370
9950380,0irq/345-484840029577-21taskset20:13:571
81380,0rcu_preempt0-21swapper/122:01:061
81380,0rcu_preempt0-21swapper/122:01:061
81370,0rcu_preempt19-21ksoftirqd/123:14:171
81370,0rcu_preempt19-21ksoftirqd/122:09:221
81370,0rcu_preempt19-21ksoftirqd/119:04:051
1699370,0migration/113628-21runrttasks21:45:521
1699370,0migration/113628-21runrttasks21:45:521
10050370,0irq/346-48484004292-21ls21:34:231
10050370,0irq/346-484840017435-1kworker/1:0H21:52:111
10050370,0irq/346-484840015399-21rm00:29:111
9950360,0irq/345-48484005402-21chrt22:15:541
9950360,0irq/345-484840012192-21munin-node1
9950360,0irq/345-484840012192-21munin-node1
81360,0rcu_preempt3-21ksoftirqd/020:39:030
81360,0rcu_preempt19-21ksoftirqd/123:44:011
81360,0rcu_preempt19-21ksoftirqd/100:09:461
81360,0rcu_preempt19-21ksoftirqd/100:09:461
286392360,0sleep125917-1kworker/1:0H20:09:221
1699360,0migration/14367-21runrttasks00:14:281
10050360,0irq/346-48484008017-21ssh23:39:021
10050360,0irq/346-48484008017-21ssh23:39:021
10050360,0irq/346-484840021873-1kworker/1:1H21:20:091
10050360,0irq/346-484840016966-21ssh23:09:501
10050360,0irq/346-484840014833-1kworker/1:1H21:09:271
9950350,0irq/345-48484001247-21snmpd00:26:521
9950350,0irq/345-484840011576-21munin-node1
81350,0rcu_preempt19-21ksoftirqd/123:04:061
81350,0rcu_preempt19-21ksoftirqd/121:40:221
108422350,0chrt9172-1kworker/1:2H23:03:301
10050350,0irq/346-484840030992-21rm22:08:071
10050350,0irq/346-484840030292-1kworker/1:0H00:07:151
10050350,0irq/346-484840029500-1kworker/1:1H22:48:351
10050350,0irq/346-484840020125-21ssh21:14:121
9950340,0irq/345-48484005410-21grep20:39:001
81340,0rcu_preempt29089-1kworker/1:1H20:34:071
81340,0rcu_preempt19-21ksoftirqd/123:54:501
81340,0rcu_preempt19-21ksoftirqd/122:53:311
81340,0rcu_preempt19-21ksoftirqd/120:29:141
10050340,0irq/346-48484005447-21ssh23:34:591
10050340,0irq/346-484840028731-21ls23:24:121
10050340,0irq/346-484840028731-21ls23:24:121
10050340,0irq/346-48484000-21swapper/120:54:091
9950330,0irq/345-48484008499-21idleruntime-cro20:48:391
9950330,0irq/345-48484000-21swapper/121:04:281
81330,0rcu_preempt9950irq/345-484840019:44:331
259522330,0sleep125917-1kworker/1:0H20:01:331
10050320,0irq/346-484840014839-21munin-node1
10050320,0irq/346-484840014839-21munin-node1
9950310,0irq/345-48484000-21swapper/119:24:291
81310,0rcu_preempt4428-21kworker/1:020:04:431
10050310,0irq/346-48484009917-21sshd20:51:271
10050310,0irq/346-484840012110-21ssh20:58:571
9950300,0irq/345-484840011411-21ping19:34:391
10050300,0irq/346-484840022627-1kworker/1:0H19:54:141
9950290,0irq/345-48484000-21swapper/119:13:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional