You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-14 - 05:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot5s.osadl.org (updated Tue Oct 14, 2025 00:43:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
811450,0rcu_preempt3-21ksoftirqd/020:05:460
811000,0rcu_preempt3-21ksoftirqd/021:07:270
135512890,0sleep09950irq/345-484840019:40:560
81870,0rcu_preempt3-21ksoftirqd/022:20:390
81810,0rcu_preempt3-21ksoftirqd/023:45:160
81810,0rcu_preempt3-21ksoftirqd/021:40:430
81750,0rcu_preempt3-21ksoftirqd/023:52:480
81750,0rcu_preempt3-21ksoftirqd/000:15:290
81740,0rcu_preempt3-21ksoftirqd/023:30:440
81720,0rcu_preempt3-21ksoftirqd/021:30:450
81720,0rcu_preempt19-21ksoftirqd/123:55:401
81710,0rcu_preempt1050-21cyclictest23:25:450
81690,0rcu_preempt19-21ksoftirqd/100:10:441
81680,0rcu_preempt3-21ksoftirqd/000:03:020
81680,0rcu_preempt19-21ksoftirqd/122:21:531
81660,0rcu_preempt19-21ksoftirqd/123:40:381
81640,0rcu_preempt3-21ksoftirqd/000:10:350
81620,0rcu_preempt54-21kswapd022:14:290
81620,0rcu_preempt3-21ksoftirqd/022:55:270
81600,0rcu_preempt19-21ksoftirqd/120:00:171
9950590,0irq/345-4848400181ktimersoftd/100:05:431
81590,0rcu_preempt19-21ksoftirqd/121:58:251
81590,0rcu_preempt19-21ksoftirqd/121:34:411
81580,0rcu_preempt19-21ksoftirqd/122:35:301
81580,0rcu_preempt19-21ksoftirqd/122:35:301
81570,0rcu_preempt27519-21apt-get20:25:281
81570,0rcu_preempt19-21ksoftirqd/123:30:441
81550,0rcu_preempt3-21ksoftirqd/022:38:300
81550,0rcu_preempt3-21ksoftirqd/022:38:300
116132550,0chrt9950irq/345-484840021:12:291
81540,0rcu_preempt30616-21munin-node1
81540,0rcu_preempt19-21ksoftirqd/123:15:281
81530,0rcu_preempt3-21ksoftirqd/022:25:420
81530,0rcu_preempt3-21ksoftirqd/020:41:190
9950520,0irq/345-48484000-21swapper/000:22:280
81520,0rcu_preempt3-21ksoftirqd/022:30:270
81510,0rcu_preempt3-21ksoftirqd/021:15:170
81500,0rcu_preempt3-21ksoftirqd/022:40:360
81500,0rcu_preempt3-21ksoftirqd/021:55:350
81500,0rcu_preempt3-21ksoftirqd/019:00:370
81500,0rcu_preempt19-21ksoftirqd/120:40:291
81500,0rcu_preempt1050-21cyclictest23:03:320
81490,0rcu_preempt3-21ksoftirqd/023:45:290
81490,0rcu_preempt3-21ksoftirqd/021:55:030
10050490,0irq/346-48484004103-1kworker/0:1H21:17:270
81480,0rcu_preempt3-21ksoftirqd/022:15:480
81480,0rcu_preempt19-21ksoftirqd/123:21:321
81480,0rcu_preempt19-21ksoftirqd/100:30:291
81480,0rcu_preempt16202-21df_inode19:50:331
10050480,0irq/346-484840029012-21diskmemload00:05:460
10050480,0irq/346-484840023727-1kworker/0:1H20:20:340
81470,0rcu_preempt4492-1kworker/1:1H21:46:281
81470,0rcu_preempt3-21ksoftirqd/021:24:150
81470,0rcu_preempt29020-21munin-node1
81470,0rcu_preempt18485-21irqstats21:20:401
10050470,0irq/346-48484008827-1kworker/0:2H21:49:040
10050470,0irq/346-484840027741-1kworker/0:1H22:50:450
10050470,0irq/346-484840025312-21ssh21:28:550
81460,0rcu_preempt3-21ksoftirqd/022:05:360
81460,0rcu_preempt19-21ksoftirqd/121:40:431
10050460,0irq/346-48484005251-21proc_pri19:15:500
81450,0rcu_preempt6070-21diskmemload23:55:340
81450,0rcu_preempt3-21ksoftirqd/023:10:280
81450,0rcu_preempt3-21ksoftirqd/022:00:450
81450,0rcu_preempt3-21ksoftirqd/022:00:450
81450,0rcu_preempt3-21ksoftirqd/020:15:470
81450,0rcu_preempt27110-21ssh23:25:381
81450,0rcu_preempt19-21ksoftirqd/123:05:471
10050450,0irq/346-48484008296-21irqstats19:25:450
10050450,0irq/346-484840028674-1kworker/0:2H20:30:450
10050450,0irq/346-48484000-21swapper/022:47:290
81440,0rcu_preempt19-21ksoftirqd/122:25:391
81440,0rcu_preempt19-21ksoftirqd/100:21:081
81440,0rcu_preempt19-21ksoftirqd/100:00:291
10050440,0irq/346-48484002176-21ls20:50:170
9950430,0irq/345-48484006070-21diskmemload23:15:360
9950430,0irq/345-48484003-21ksoftirqd/019:56:460
81430,0rcu_preempt19-21ksoftirqd/123:45:351
81430,0rcu_preempt19-21ksoftirqd/122:15:411
81430,0rcu_preempt19-21ksoftirqd/120:30:331
81430,0rcu_preempt19-21ksoftirqd/120:05:451
81430,0rcu_preempt19-21ksoftirqd/100:15:311
81430,0rcu_preempt15411-21kernelversion00:30:390
10050430,0irq/346-48484002776-21sendmail20:55:150
10050430,0irq/346-484840015594-1kworker/0:0H19:50:410
10050430,0irq/346-48484000-21swapper/023:10:080
81420,0rcu_preempt3572-21ps19:10:430
81420,0rcu_preempt19-21ksoftirqd/123:35:361
81420,0rcu_preempt19-21ksoftirqd/123:13:191
81420,0rcu_preempt19-21ksoftirqd/122:33:241
81420,0rcu_preempt19-21ksoftirqd/122:01:391
81420,0rcu_preempt19-21ksoftirqd/122:01:391
81420,0rcu_preempt11958-21ntp_states00:25:421
10050420,0irq/346-48484005522-21runrttasks21:00:430
10050420,0irq/346-484840020785-21idleruntime-cro20:05:160
10050420,0irq/346-48484001945-21rm21:39:480
9950410,0irq/345-48484004369-21ssh23:36:330
81410,0rcu_preempt19-21ksoftirqd/122:50:401
119552411,0sleep012012-21rm00:25:430
10050410,0irq/346-484840054-21kswapd023:22:120
10050410,0irq/346-484840010661-1kworker/0:0H19:35:530
81400,0rcu_preempt19-21ksoftirqd/123:50:491
105199402,0cyclictest0-21swapper/020:10:440
105199402,0cyclictest0-21swapper/020:10:440
10050400,0irq/346-484840013955-1kworker/0:1H19:45:400
81390,0rcu_preempt3-21ksoftirqd/019:30:520
81390,0rcu_preempt19-21ksoftirqd/122:58:521
81390,0rcu_preempt19-21ksoftirqd/122:40:361
81390,0rcu_preempt19-21ksoftirqd/119:02:571
10050390,0irq/346-48484006333-21df19:20:340
10050390,0irq/346-48484002444-1kworker/0:0H20:55:160
308852380,0chrt30642-1kworker/0:0H20:36:120
81370,0rcu_preempt19-21ksoftirqd/123:00:401
81370,0rcu_preempt19-21ksoftirqd/122:06:211
81370,0rcu_preempt19-21ksoftirqd/121:50:281
81370,0rcu_preempt19-21ksoftirqd/121:25:251
287312370,0sleep028674-1kworker/0:2H20:27:270
9950360,0irq/345-48484000-21swapper/019:05:430
81360,0rcu_preempt19-21ksoftirqd/122:47:061
81360,0rcu_preempt19-21ksoftirqd/120:20:491
81360,0rcu_preempt19-21ksoftirqd/119:33:561
1699360,0migration/131321-21latency_hist20:40:161
10050360,0irq/346-4848400966-21lighttpd19:43:051
81350,0rcu_preempt19-21ksoftirqd/121:07:131
81350,0rcu_preempt19-21ksoftirqd/120:15:391
81350,0rcu_preempt19-21ksoftirqd/119:25:471
57452350,0chrt5744-1kworker/1:1H21:01:561
157402350,0chrt15595-1kworker/1:2H19:49:151
81340,0rcu_preempt19-21ksoftirqd/120:45:341
81340,0rcu_preempt19-21ksoftirqd/119:15:391
15642340,0sleep1649-1kworker/1:1H19:05:351
10050340,0irq/346-484840013792-21df21:15:311
9950330,0irq/345-48484002969-21tr20:55:241
123302330,0chrt12317-1kworker/1:0H19:37:511
81320,0rcu_preempt19-21ksoftirqd/120:10:321
81320,0rcu_preempt19-21ksoftirqd/120:10:321
81320,0rcu_preempt19-21ksoftirqd/120:01:111
23492320,0sleep11829-1kworker/1:2H20:50:541
81310,0rcu_preempt4356-21ping19:21:321
81300,0rcu_preempt19-21ksoftirqd/119:10:381
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional