You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 02:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Apr 10, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2222224637,0sleep20-21swapper/218:55:082
2222524331,0sleep00-21swapper/018:55:100
304450350,0irq/25-eth10-21swapper/318:56:223
2218023322,0sleep10-21swapper/118:54:431
339960,0migration/38728-21sh00:09:393
339960,0migration/3473-21sh00:04:273
339960,0migration/33406-21sh21:25:133
339960,0migration/32942-21sh23:08:323
339960,0migration/328292-21sh22:03:393
339960,0migration/326476-21needreboot21:39:123
339960,0migration/318113-21sh23:57:463
339960,0migration/316918-21sh00:15:073
29725060,0irq/27-eth0-tx-17127-21munin-node19:19:180
29725060,0irq/27-eth0-tx-14208-21munin-node20:54:100
29715060,0irq/26-eth0-rx-9935-21cut21:09:133
29715060,0irq/26-eth0-rx-21934-21gltestperf21:19:093
29715060,0irq/26-eth0-rx-20439-21ssh22:39:083
29715060,0irq/26-eth0-rx-19795-21interrupts23:59:093
29715060,0irq/26-eth0-rx-14004-21cut22:14:123
29715060,0irq/26-eth0-rx-13265-21irqrtprio22:34:133
226169966,0cyclictest0-21swapper/023:53:590
149960,0migration/04137-21sh21:27:130
8215050,0irq/24-0000:00:3604-21cat19:08:552
4150,0ktimersoftd/00-21swapper/021:53:410
339950,0migration/3826-21munin-node20:19:113
339950,0migration/38158-21kthreadcore20:24:113
339950,0migration/38026-21kthreadcore19:09:123
339950,0migration/36930-21runrttasks19:59:093
339950,0migration/33454-21df_abs23:29:083
339950,0migration/331842-21kthreadcore23:24:123
339950,0migration/330156-21kthreadcore20:39:123
339950,0migration/328296-21latency_hist22:23:553
339950,0migration/327002-21taskset22:20:483
339950,0migration/32569-21kthreadcore19:54:103
339950,0migration/322122-21kthreadcore23:19:103
339950,0migration/32143-21munin-node21:44:173
339950,0migration/317873-21gltestperf19:19:093
339950,0migration/310159-21sh22:29:193
29725050,0irq/27-eth0-tx-32701-21cut21:04:142
29725050,0irq/27-eth0-tx-32264-21munin-node20:19:170
29725050,0irq/27-eth0-tx-28362-21munin-node22:24:182
29725050,0irq/27-eth0-tx-21115-21kthreadcore23:19:102
29725050,0irq/27-eth0-tx-10775-21munin-node23:54:052
29725050,0irq/27-eth0-tx-0-21swapper/223:29:092
29725050,0irq/27-eth0-tx-0-21swapper/223:04:132
29725050,0irq/27-eth0-tx-0-21swapper/222:45:522
29725050,0irq/27-eth0-tx-0-21swapper/221:39:192
29725050,0irq/27-eth0-tx-0-21swapper/200:04:082
29725050,0irq/27-eth0-tx-0-21swapper/020:49:130
29725050,0irq/27-eth0-tx-0-21swapper/020:32:470
29715050,0irq/26-eth0-rx-9589-21kthreadcore21:29:123
29715050,0irq/26-eth0-rx-9540-21unixbench_singl23:09:173
29715050,0irq/26-eth0-rx-26481-21munin-node00:24:103
29715050,0irq/26-eth0-rx-21168-21kthreadcore22:59:113
29715050,0irq/26-eth0-rx-19540-21grep00:19:103
29715050,0irq/26-eth0-rx-19016-21ssh23:18:273
29715050,0irq/26-eth0-rx-12685-21kthreadcore19:39:113
29715050,0irq/26-eth0-rx-11770-21aten_r1power_cu22:54:053
29715050,0irq/26-eth0-rx-0-21swapper/323:46:113
29715050,0irq/26-eth0-rx-0-21swapper/323:39:253
29715050,0irq/26-eth0-rx-0-21swapper/322:12:263
29715050,0irq/26-eth0-rx-0-21swapper/322:04:123
29715050,0irq/26-eth0-rx-0-21swapper/321:50:073
29715050,0irq/26-eth0-rx-0-21swapper/321:35:243
29715050,0irq/26-eth0-rx-0-21swapper/321:14:073
29715050,0irq/26-eth0-rx-0-21swapper/321:04:143
259950,0migration/29298-21sh00:11:182
259950,0migration/26746-21kthreadcore19:34:132
259950,0migration/23218-21sh21:24:422
259950,0migration/226946-21fschecks_count00:24:052
259950,0migration/226822-21munin-node21:59:202
259950,0migration/223374-21missed_timers19:44:142
259950,0migration/214113-21kthreadcore22:54:112
259950,0migration/213668-21kthreadcore23:14:112
259950,0migration/212087-21kthreadcore19:14:112
259950,0migration/211092-21sh21:09:252
259950,0migration/211030-21sh22:10:522
249950,0watchdog/215256-21tr00:14:122
226189955,0cyclictest20639-21diskmemload23:42:112
226189955,0cyclictest0-21swapper/221:31:112
226189950,0cyclictest0-21swapper/222:37:052
226189950,0cyclictest0-21swapper/222:17:412
226189950,0cyclictest0-21swapper/221:51:002
226189950,0cyclictest0-21swapper/220:19:172
226179955,0cyclictest0-21swapper/123:33:551
226179950,0cyclictest0-21swapper/123:48:061
226179950,0cyclictest0-21swapper/121:10:081
226169955,0cyclictest0-21swapper/023:14:340
226169955,0cyclictest0-21swapper/022:46:400
226169955,0cyclictest0-21swapper/021:36:400
226169955,0cyclictest0-21swapper/000:23:180
226169950,0cyclictest0-21swapper/022:04:340
19150,0ktimersoftd/10-21swapper/123:33:291
179950,0migration/131896-21munin-node00:24:111
179950,0migration/129504-21kthreadcore23:24:111
179950,0migration/117401-21sh00:16:301
169950,0watchdog/114984-21kthreadcore22:14:131
149950,0migration/07132-21kthreadcore19:34:130
149950,0migration/06242-21kthreadcore22:09:120
149950,0migration/05879-21sh21:29:090
149950,0migration/05461-21kthreadcore20:44:130
149950,0migration/04987-21kthreadcore23:29:120
149950,0migration/03492-21aten_r1power_fr23:09:050
149950,0migration/029843-21kthreadcore20:14:130
149950,0migration/029702-21munin-node19:04:070
149950,0migration/02353-21taskset23:27:490
149950,0migration/023216-21kthreadcore23:59:110
149950,0migration/022847-21kthreadcore20:34:120
149950,0migration/022543-21kernelversion21:19:130
149950,0migration/022345-21kthreadcore20:59:130
149950,0migration/020999-21kthreadcore20:09:110
149950,0migration/019975-21cpuspeed_turbos22:59:060
149950,0migration/019311-21cpuspeed_turbos23:39:070
149950,0migration/018562-21taskset20:07:240
149950,0migration/017817-21sh23:36:010
149950,0migration/01732-21runrttasks23:05:040
149950,0migration/015609-21kthreadcore00:14:120
149950,0migration/014695-21kthreadcore22:34:140
149950,0migration/014451-21kthreadcore21:14:120
149950,0migration/011477-21munin-node19:14:100
149950,0migration/010441-21munin-node21:09:150
8215040,0irq/24-0000:00:0-21swapper/222:18:552
339940,0migration/35669-21kthreadcore23:49:113
339940,0migration/331752-21ksmtuned20:15:503
339940,0migration/329915-21kthreadcore22:44:093
339940,0migration/322517-21kthreadcore20:34:123
339940,0migration/320220-21taskset20:54:183
339940,0migration/312044-21kthreadcore20:49:123
29725040,0irq/27-eth0-tx-26545-21munin-node20:39:060
29725040,0irq/27-eth0-tx-26061-21ssh22:59:512
29725040,0irq/27-eth0-tx-0-21swapper/223:59:292
29725040,0irq/27-eth0-tx-0-21swapper/223:49:052
29725040,0irq/27-eth0-tx-0-21swapper/223:33:552
29725040,0irq/27-eth0-tx-0-21swapper/223:24:422
29725040,0irq/27-eth0-tx-0-21swapper/222:49:132
29725040,0irq/27-eth0-tx-0-21swapper/221:55:362
29725040,0irq/27-eth0-tx-0-21swapper/221:19:062
29725040,0irq/27-eth0-tx-0-21swapper/019:49:170
29715040,0irq/26-eth0-rx-0-21swapper/323:34:303
29715040,0irq/26-eth0-rx-0-21swapper/322:50:383
29715040,0irq/26-eth0-rx-0-21swapper/321:54:083
29715040,0irq/26-eth0-rx-0-21swapper/320:59:083
29715040,0irq/26-eth0-rx-0-21swapper/320:04:063
29715040,0irq/26-eth0-rx-0-21swapper/319:49:123
259940,0migration/28857-21kthreadcore22:29:122
259940,0migration/25639-21kthreadcore20:44:132
259940,0migration/24406-21ntp_offset19:54:122
259940,0migration/23699-21latency_hist19:08:552
259940,0migration/228200-21kthreadcore20:39:112
259940,0migration/227845-21kthreadcore18:59:122
259940,0migration/217741-21kthreadcore20:54:112
259940,0migration/215832-21kthreadcore21:14:122
259940,0migration/211530-21unixbench-2d19:59:162
249940,0watchdog/225388-21cat22:39:132
249940,0watchdog/222889-21kthreadcore20:59:132
249940,0watchdog/20-21swapper/221:34:132
226189944,0cyclictest0-21swapper/222:04:082
226189943,0cyclictest4319-21awk23:09:092
226189943,0cyclictest3556-21lldpd20:32:472
226189943,0cyclictest3556-21lldpd19:32:172
226189943,0cyclictest3514-21snmpd19:21:252
226189943,0cyclictest3241-21irqbalance21:44:032
226189943,0cyclictest27950-21awk23:44:082
226189943,0cyclictest26599-21awk20:14:112
226189943,0cyclictest20769-21awk20:34:102
226189943,0cyclictest19360-21awk00:19:082
226189943,0cyclictest13147-21awk20:04:102
226179944,0cyclictest0-21swapper/122:05:371
226179944,0cyclictest0-21swapper/121:54:161
226179943,0cyclictest655-21awk20:19:101
226179943,0cyclictest5624-21awk21:49:101
226179943,0cyclictest4386-21sadc21:48:551
226179943,0cyclictest3556-21lldpd23:49:491
226179943,0cyclictest3556-21lldpd23:23:191
226179943,0cyclictest3556-21lldpd23:13:191
226179943,0cyclictest3556-21lldpd23:01:481
226179943,0cyclictest3556-21lldpd22:43:471
226179943,0cyclictest3556-21lldpd21:06:461
226179943,0cyclictest3556-21lldpd20:54:471
226179943,0cyclictest3556-21lldpd20:45:471
226179943,0cyclictest3556-21lldpd20:24:171
226179943,0cyclictest3556-21lldpd19:27:471
226179943,0cyclictest3556-21lldpd19:04:471
226179943,0cyclictest3514-21snmpd22:49:131
226179943,0cyclictest3514-21snmpd21:39:121
226179943,0cyclictest21280-21awk22:19:101
226179943,0cyclictest19392-21awk00:19:091
226179943,0cyclictest17979-21awk19:19:101
226179943,0cyclictest14078-21awk21:14:111
226179943,0cyclictest13264-21awk20:04:111
226179943,0cyclictest12622-21awk22:54:091
226179943,0cyclictest10852-21sensors21:29:171
226169944,0cyclictest0-21swapper/023:20:140
226169943,0cyclictest4898-21awk22:29:090
226169943,0cyclictest4638-21awk19:09:100
226169943,0cyclictest3556-21lldpd23:47:190
226169943,0cyclictest3514-21snmpd22:49:430
226169943,0cyclictest3241-21irqbalance22:22:030
226169943,0cyclictest3241-21irqbalance00:04:130
226169943,0cyclictest15835-21tail21:54:120
226169943,0cyclictest13237-21awk22:14:100
179940,0migration/18008-21fschecks_count20:49:081
179940,0migration/14422-21aten2.4-expect22:09:061
179940,0migration/131635-21kthreadcore21:24:111
179940,0migration/124070-21kthreadcore20:34:131
179940,0migration/12354-21taskset23:06:511
179940,0migration/123265-21kthreadcore20:59:131
179940,0migration/123227-21kthreadcore21:59:121
179940,0migration/123202-21kthreadcore23:39:131
179940,0migration/123154-21df18:59:071
179940,0migration/120279-21kthreadcore23:59:101
179940,0migration/118661-21fschecks_time19:44:091
179940,0migration/117022-21latency_hist19:18:551
179940,0migration/11651-21kthreadcore19:29:121
179940,0migration/113182-21irqcore22:34:131
179940,0migration/111166-21perf19:38:551
179940,0migration/11034-21missed_timers22:44:111
169940,0watchdog/130335-21kthreadcore00:04:121
169940,0watchdog/118765-21ssh23:17:451
169940,0watchdog/118674-21ntpq20:29:131
169940,0watchdog/11769-21kthreadcore19:54:091
169940,0watchdog/111491-21aten_r1power_po19:39:051
169940,0watchdog/10-21swapper/123:54:001
169940,0watchdog/10-21swapper/121:34:211
169940,0watchdog/10-21swapper/120:14:091
169940,0watchdog/10-21swapper/120:09:171
149940,0migration/08955-21sh00:10:190
149940,0migration/029442-21df_inode21:04:080
149940,0migration/022264-21kthreadcore21:59:110
149940,0migration/019889-21kthreadcore19:44:120
339930,0migration/324426-21runrttasks19:48:393
339930,0migration/316515-21runrttasks19:14:403
29715030,0irq/26-eth0-rx-0-21swapper/320:44:083
29715030,0irq/26-eth0-rx-0-21swapper/320:29:123
29715030,0irq/26-eth0-rx-0-21swapper/319:34:083
29715030,0irq/26-eth0-rx-0-21swapper/319:32:053
29715030,0irq/26-eth0-rx-0-21swapper/319:24:063
29715030,0irq/26-eth0-rx-0-21swapper/319:04:063
226189933,0cyclictest7557-21awk20:24:102
226189933,0cyclictest3556-21lldpd20:10:472
226189932,0cyclictest30321-21sensors19:49:162
226189932,0cyclictest23719-21sed19:23:552
226189932,0cyclictest12924-21needreboot20:49:142
226189932,0cyclictest12362-21awk19:39:092
226179932,0cyclictest6539-21awk19:59:081
226179932,0cyclictest3556-21lldpd21:19:171
226179932,0cyclictest28856-21fschecks_count22:24:081
226169933,0cyclictest8279-21kworker/0:200:24:290
226169933,0cyclictest14635-21kworker/0:123:49:100
226169933,0cyclictest14635-21kworker/0:122:54:020
226169933,0cyclictest14635-21kworker/0:122:39:000
226169933,0cyclictest14635-21kworker/0:122:24:000
226169933,0cyclictest14635-21kworker/0:121:43:580
226169933,0cyclictest14635-21kworker/0:121:39:020
226169933,0cyclictest14635-21kworker/0:120:23:560
226169933,0cyclictest14635-21kworker/0:119:58:570
226169933,0cyclictest14635-21kworker/0:119:54:030
226169933,0cyclictest14635-21kworker/0:119:38:570
226169933,0cyclictest14635-21kworker/0:119:28:570
226169933,0cyclictest14635-21kworker/0:119:24:030
226169933,0cyclictest14635-21kworker/0:118:59:070
179930,0migration/132606-21runrttasks20:39:201
169930,0watchdog/120639-21diskmemload22:29:571
169930,0watchdog/10-21swapper/119:10:501
169930,0watchdog/10-21swapper/100:09:121
339920,0migration/325899-21kthreadcore18:59:123
29715020,0irq/26-eth0-rx-0-21swapper/320:09:073
226179921,0cyclictest24467-21latency_hist19:48:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional