You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 23:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot5s.osadl.org (updated Fri Nov 21, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
81890,0rcu_preempt19-21ksoftirqd/107:39:361
70772820,0sleep09950irq/345-484840012:36:350
81680,0rcu_preempt19-21ksoftirqd/111:35:461
81670,0rcu_preempt19-21ksoftirqd/110:09:261
81670,0rcu_preempt19-21ksoftirqd/110:01:371
81660,0rcu_preempt19-21ksoftirqd/111:46:311
81660,0rcu_preempt19-21ksoftirqd/111:14:481
81650,0rcu_preempt54-21kswapd010:16:071
81640,0rcu_preempt19-21ksoftirqd/111:14:121
81640,0rcu_preempt19-21ksoftirqd/111:14:121
81630,0rcu_preempt19-21ksoftirqd/112:28:401
270652630,0sleep19950irq/345-484840009:27:341
81620,0rcu_preempt19-21ksoftirqd/112:24:181
81620,0rcu_preempt19-21ksoftirqd/111:19:491
81620,0rcu_preempt19-21ksoftirqd/111:07:291
81620,0rcu_preempt19-21ksoftirqd/110:21:381
81620,0rcu_preempt19-21ksoftirqd/109:43:391
81610,0rcu_preempt8825-21ssh11:59:511
81610,0rcu_preempt19-21ksoftirqd/111:53:321
81610,0rcu_preempt19-21ksoftirqd/110:10:271
81610,0rcu_preempt19-21ksoftirqd/109:44:491
81610,0rcu_preempt19-21ksoftirqd/109:37:181
81610,0rcu_preempt19-21ksoftirqd/109:19:441
81610,0rcu_preempt19-21ksoftirqd/109:19:441
81610,0rcu_preempt19-21ksoftirqd/109:10:081
321672610,0sleep010050irq/346-484840008:24:570
81600,0rcu_preempt19-21ksoftirqd/112:08:351
81600,0rcu_preempt19-21ksoftirqd/110:58:191
81600,0rcu_preempt19-21ksoftirqd/110:35:271
81600,0rcu_preempt19-21ksoftirqd/110:26:251
81600,0rcu_preempt19-21ksoftirqd/109:52:231
81600,0rcu_preempt0-21swapper/107:48:381
81590,0rcu_preempt19-21ksoftirqd/110:42:371
81590,0rcu_preempt19-21ksoftirqd/109:55:441
81590,0rcu_preempt19-21ksoftirqd/109:34:301
81590,0rcu_preempt19-21ksoftirqd/107:31:151
9950580,0irq/345-4848400181ktimersoftd/111:30:031
81580,0rcu_preempt19-21ksoftirqd/111:41:451
81580,0rcu_preempt19-21ksoftirqd/111:28:181
81580,0rcu_preempt19-21ksoftirqd/109:14:521
308162580,0chrt9950irq/345-484840008:20:081
81570,0rcu_preempt54-21kswapd011:12:590
81570,0rcu_preempt54-21kswapd011:12:590
81570,0rcu_preempt19-21ksoftirqd/110:29:501
280552570,0sleep010050irq/346-484840008:11:550
246492570,0sleep010050irq/346-484840008:00:240
81560,0rcu_preempt3-21ksoftirqd/011:15:410
58302560,0sleep09950irq/345-484840009:43:080
81550,0rcu_preempt3-21ksoftirqd/011:49:140
81550,0rcu_preempt3-21ksoftirqd/010:54:390
81550,0rcu_preempt17861-21kworker/1:110:59:491
81540,0rcu_preempt3-21ksoftirqd/009:33:480
81540,0rcu_preempt0-21swapper/112:30:541
10050540,0irq/346-484840030854-1kworker/0:0H12:31:310
54492530,0sleep19950irq/345-484840012:34:561
296042530,0sleep010050irq/346-484840008:16:020
10050530,0irq/346-48484006753-1kworker/0:0H07:06:400
81520,0rcu_preempt19-21ksoftirqd/107:27:551
215542520,0sleep09950irq/345-484840010:48:470
215542520,0sleep09950irq/345-484840010:48:470
9950510,0irq/345-484840013949-21diskmemload10:04:000
81510,0rcu_preempt3-21ksoftirqd/007:50:060
81510,0rcu_preempt19-21ksoftirqd/108:00:061
239892510,0chrt9950irq/345-484840010:51:140
150682510,0chrt9950irq/345-484840009:55:010
10050510,0irq/346-484840016444-1kworker/0:0H11:29:330
9950500,0irq/345-484840025396-21awk12:19:580
81500,0rcu_preempt23081-21ping08:24:551
81500,0rcu_preempt12469-21apt-get09:04:491
81500,0rcu_preempt1169-21kworker/0:008:34:550
81500,0rcu_preempt1169-21kworker/0:008:34:550
10050490,0irq/346-484840019945-1kworker/0:3H11:31:310
10050490,0irq/346-48484000-21swapper/009:14:080
81480,0rcu_preempt24182-21kworker/0:211:53:060
81480,0rcu_preempt10323-21ping07:34:470
10050480,0irq/346-48484000-21swapper/010:32:320
9950470,0irq/345-484840023081-21ping07:59:360
9950470,0irq/345-484840010323-21ping07:40:180
9950470,0irq/345-48484000-21swapper/012:04:490
81470,0rcu_preempt3-21ksoftirqd/010:21:320
81470,0rcu_preempt29270-21apt-get10:59:470
81470,0rcu_preempt19-21ksoftirqd/108:09:441
81470,0rcu_preempt19-21ksoftirqd/108:04:591
81470,0rcu_preempt1478-21kworker/0:109:45:170
81470,0rcu_preempt13994-21kworker/dying11:21:190
10050470,0irq/346-484840024792-21munin-node0
10050470,0irq/346-484840018630-1kworker/0:1H12:12:550
9950460,0irq/345-48484009889-21ssh12:00:120
9950460,0irq/345-484840011632-21ssh10:34:520
9950460,0irq/345-484840010668-21basename08:59:350
81460,0rcu_preempt3-21ksoftirqd/012:25:160
81460,0rcu_preempt3-21ksoftirqd/011:39:550
81460,0rcu_preempt3-21ksoftirqd/009:38:460
81460,0rcu_preempt24716-21kworker/0:108:04:510
81460,0rcu_preempt21408-21kworker/0:112:18:200
81460,0rcu_preempt19-21ksoftirqd/112:15:061
81460,0rcu_preempt19-21ksoftirqd/111:55:031
81460,0rcu_preempt19-21ksoftirqd/108:14:591
81460,0rcu_preempt13994-21kworker/0:010:28:130
10050460,0irq/346-484840023596-1kworker/0:1H10:07:380
10050460,0irq/346-484840010323-21ping07:24:500
10050460,0irq/346-48484000-21swapper/010:39:390
81450,0rcu_preempt19-21ksoftirqd/107:19:491
81450,0rcu_preempt18551-21apt-get10:44:461
81450,0rcu_preempt18551-21apt-get10:44:461
1599450,0migration/012798-21taskset09:52:080
10050450,0irq/346-48484006512-1kworker/0:0H11:57:260
10050450,0irq/346-484840023596-1kworker/0:1H10:14:470
9950440,0irq/345-484840025606-21munin-node0
9950440,0irq/345-484840010366-21latency_hist07:19:361
9950440,0irq/345-484840010366-21latency_hist07:19:361
9950440,0irq/345-48484000-21swapper/007:45:030
9950440,0irq/345-48484000-21swapper/007:32:300
81440,0rcu_preempt3-21ksoftirqd/011:38:190
81440,0rcu_preempt3-21ksoftirqd/008:23:140
81440,0rcu_preempt21912-21apt-get07:54:451
81440,0rcu_preempt19-21ksoftirqd/112:12:391
10050440,0irq/346-484840021286-21ssh09:19:360
10050440,0irq/346-484840021286-21ssh09:19:360
10050440,0irq/346-484840019845-1kworker/0:4H09:19:200
10050440,0irq/346-48484001767-1kworker/0:0H11:06:500
10050440,0irq/346-484840010323-21ping07:42:571
81430,0rcu_preempt3-21ksoftirqd/008:30:370
81430,0rcu_preempt3-21ksoftirqd/007:19:550
81430,0rcu_preempt19-21ksoftirqd/110:52:551
10050430,0irq/346-484840012060-1kworker/0:1H09:04:570
81420,0rcu_preempt5035-21ps08:40:020
81420,0rcu_preempt3-21ksoftirqd/008:59:590
81420,0rcu_preempt3-21ksoftirqd/008:59:590
81420,0rcu_preempt3-21ksoftirqd/008:47:180
10050410,0irq/346-48484007133-1kworker/0:2H08:50:030
81400,0rcu_preempt5899-21munin-node1
81400,0rcu_preempt3-21ksoftirqd/007:10:010
81400,0rcu_preempt19-21ksoftirqd/108:51:561
81400,0rcu_preempt19-21ksoftirqd/107:50:201
81400,0rcu_preempt19-21ksoftirqd/107:09:511
81400,0rcu_preempt19-21ksoftirqd/107:08:521
81400,0rcu_preempt0-21swapper/108:37:421
81400,0rcu_preempt0-21swapper/108:37:421
10050400,0irq/346-48484009004-21ssh07:14:500
10050400,0irq/346-48484009004-21ssh07:14:500
81390,0rcu_preempt19-21ksoftirqd/108:59:351
81390,0rcu_preempt19-21ksoftirqd/108:33:321
81380,0rcu_preempt19-21ksoftirqd/108:59:371
81380,0rcu_preempt19-21ksoftirqd/108:59:371
81370,0rcu_preempt19-21ksoftirqd/108:39:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional