You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 07:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Jul 26, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3044501040,0irq/25-eth10-21swapper/318:47:513
2773627776,0sleep20-21swapper/218:48:092
2660023725,0sleep10-21swapper/118:44:031
2754923228,0sleep00-21swapper/018:45:540
339960,0migration/3731-21sh21:53:593
339960,0migration/331793-21sh21:51:523
339960,0migration/328723-21missed_timers19:34:053
339960,0migration/328486-21munin-node00:13:573
339960,0migration/320080-21sh23:25:013
339960,0migration/31089-21munin-node18:49:053
29715060,0irq/26-eth0-rx-5171-21yum22:34:093
29715060,0irq/26-eth0-rx-10398-21munin-node23:59:073
29715060,0irq/26-eth0-rx-10219-21cut19:23:583
278649960,0cyclictest0-21swapper/123:39:291
8215050,0irq/24-0000:00:30856-21basename20:03:452
8215050,0irq/24-0000:00:15928-21latency_hist22:03:442
4150,0ktimersoftd/00-21swapper/022:01:200
35150,0ktimersoftd/30-21swapper/322:01:203
35150,0ktimersoftd/30-21swapper/319:11:233
339950,0migration/38689-21kthreadcore23:39:033
339950,0migration/37738-21aten_r1power_po22:18:563
339950,0migration/36002-21kthreadcore21:34:023
339950,0migration/3391-21idleruntime20:29:003
339950,0migration/328673-21runrttasks23:10:053
339950,0migration/325444-21taskset21:08:013
339950,0migration/324718-21munin-node22:29:023
339950,0migration/323756-21taskset21:46:213
339950,0migration/323557-21timerandwakeup19:54:083
339950,0migration/323499-21fschecks_time22:48:573
339950,0migration/32269-21kthreadcore23:34:023
339950,0migration/321126-21taskset22:44:203
339950,0migration/314682-21kthreadcore00:04:013
339950,0migration/310238-21irqrtprio18:59:013
339950,0migration/310211-21fschecks_time21:18:593
29725050,0irq/27-eth0-tx-6559-21runrttasks22:56:012
29725050,0irq/27-eth0-tx-21957-21iostat23:48:592
29725050,0irq/27-eth0-tx-19043-21iostat_ios21:04:002
29725050,0irq/27-eth0-tx-12165-21ssh23:41:502
29725050,0irq/27-eth0-tx-0-21swapper/222:40:242
29725050,0irq/27-eth0-tx-0-21swapper/222:21:212
29725050,0irq/27-eth0-tx-0-21swapper/222:09:042
29725050,0irq/27-eth0-tx-0-21swapper/221:47:072
29725050,0irq/27-eth0-tx-0-21swapper/221:02:442
29725050,0irq/27-eth0-tx-0-21swapper/020:29:100
29715050,0irq/26-eth0-rx-9900-21ssh20:58:493
29715050,0irq/26-eth0-rx-7235-21cpuspeed_turbos22:38:553
29715050,0irq/26-eth0-rx-5811-21aten2.4-expect23:18:553
29715050,0irq/26-eth0-rx-31106-21grep23:54:033
29715050,0irq/26-eth0-rx-21731-21hwlatdetect23:48:573
29715050,0irq/26-eth0-rx-20582-21kthreadcore20:19:023
29715050,0irq/26-eth0-rx-17278-21grep22:24:033
29715050,0irq/26-eth0-rx-13865-21kthreadcore21:39:023
29715050,0irq/26-eth0-rx-0-21swapper/323:18:213
29715050,0irq/26-eth0-rx-0-21swapper/323:04:003
29715050,0irq/26-eth0-rx-0-21swapper/322:14:033
29715050,0irq/26-eth0-rx-0-21swapper/321:27:143
29715050,0irq/26-eth0-rx-0-21swapper/321:10:323
29715050,0irq/26-eth0-rx-0-21swapper/320:50:163
29715050,0irq/26-eth0-rx-0-21swapper/319:49:033
29715050,0irq/26-eth0-rx-0-21swapper/319:49:033
29715050,0irq/26-eth0-rx-0-21swapper/300:11:543
278659955,0cyclictest0-21swapper/219:24:122
278659954,0cyclictest3514-21snmpd19:39:212
278659950,0cyclictest0-21swapper/223:27:472
278659950,0cyclictest0-21swapper/222:45:512
278659950,0cyclictest0-21swapper/222:24:152
278659950,0cyclictest0-21swapper/222:00:552
278649955,0cyclictest0-21swapper/123:44:511
278649955,0cyclictest0-21swapper/122:30:541
278649955,0cyclictest0-21swapper/121:19:581
278649955,0cyclictest0-21swapper/120:51:351
278649950,0cyclictest0-21swapper/122:07:151
278649950,0cyclictest0-21swapper/121:09:431
278649950,0cyclictest0-21swapper/121:05:271
278639950,0cyclictest0-21swapper/023:08:210
278639950,0cyclictest0-21swapper/021:16:160
27150,0ktimersoftd/20-21swapper/223:45:452
259950,0migration/222542-21cpuspeed_turbos23:08:572
259950,0migration/218754-21switchtime20:39:082
249950,0watchdog/213682-21kthreadcore19:49:032
249950,0watchdog/213682-21kthreadcore19:49:032
179950,0migration/18487-21kthreadcore23:19:011
179950,0migration/16270-21taskset22:37:291
179950,0migration/131568-21kthreadcore23:54:031
179950,0migration/126698-21munin-node21:29:021
179950,0migration/11324-21kthreadcore23:14:021
169950,0watchdog/17036-21cat19:44:031
169950,0watchdog/111286-21kthreadcore20:59:031
169950,0watchdog/10-21swapper/100:03:581
149950,0migration/0974-21fschecks_time21:53:590
149950,0migration/08719-21kthreadcore19:44:040
149950,0migration/05267-21runrttasks23:18:140
149950,0migration/0463-21kthreadcore22:34:000
149950,0migration/0404-21taskset21:33:040
149950,0migration/032142-21vmstat21:09:100
149950,0migration/030749-21kthreadcore20:49:020
149950,0migration/027635-21unixbench_multi23:29:080
149950,0migration/022661-21cpuspeed_turbos19:08:570
149950,0migration/022158-21sh22:25:430
149950,0migration/020015-21kthreadcore19:54:020
149950,0migration/01486-21kthreadcore22:14:010
149950,0migration/012365-21irqstats19:49:020
149950,0migration/012365-21irqstats19:49:020
149950,0migration/010655-21kthreadcore23:19:020
339940,0migration/38427-21taskset18:54:113
339940,0migration/35981-21fschecks_time20:08:593
339940,0migration/331067-21pmu-power21:29:063
339940,0migration/330742-21kthreadcore19:14:023
339940,0migration/329068-21kthreadcore19:59:033
339940,0migration/316357-21kthreadcore20:39:033
339940,0migration/310957-21kthreadcore20:34:033
29725040,0irq/27-eth0-tx-6543-21netstat21:34:032
29725040,0irq/27-eth0-tx-29800-21ssh22:51:342
29725040,0irq/27-eth0-tx-15012-21missed_timers21:19:042
29725040,0irq/27-eth0-tx-0-21swapper/223:54:402
29725040,0irq/27-eth0-tx-0-21swapper/223:33:592
29725040,0irq/27-eth0-tx-0-21swapper/223:18:522
29725040,0irq/27-eth0-tx-0-21swapper/222:58:522
29725040,0irq/27-eth0-tx-0-21swapper/221:23:572
29725040,0irq/27-eth0-tx-0-21swapper/221:09:082
29725040,0irq/27-eth0-tx-0-21swapper/220:53:572
29725040,0irq/27-eth0-tx-0-21swapper/220:51:152
29725040,0irq/27-eth0-tx-0-21swapper/200:08:582
29725040,0irq/27-eth0-tx-0-21swapper/019:08:130
29725040,0irq/27-eth0-tx-0-21swapper/018:58:570
29715040,0irq/26-eth0-rx-24932-21idleruntime22:09:013
29715040,0irq/26-eth0-rx-22400-21ssh22:04:233
29715040,0irq/26-eth0-rx-0-21swapper/323:44:003
29715040,0irq/26-eth0-rx-0-21swapper/323:29:033
29715040,0irq/26-eth0-rx-0-21swapper/322:59:093
29715040,0irq/26-eth0-rx-0-21swapper/322:53:583
29715040,0irq/26-eth0-rx-0-21swapper/321:14:513
29715040,0irq/26-eth0-rx-0-21swapper/320:54:133
29715040,0irq/26-eth0-rx-0-21swapper/320:03:573
278659944,0cyclictest0-21swapper/222:14:002
278659944,0cyclictest0-21swapper/218:54:052
278659943,0cyclictest9853-21awk21:38:592
278659943,0cyclictest3556-21lldpd23:04:462
278659943,0cyclictest3556-21lldpd22:34:152
278659943,0cyclictest3556-21lldpd20:25:452
278659943,0cyclictest3556-21lldpd19:12:452
278659943,0cyclictest3556-21lldpd19:04:152
278659943,0cyclictest3556-21lldpd19:01:452
278659943,0cyclictest3556-21lldpd00:13:472
278659943,0cyclictest3241-21irqbalance23:14:322
278659943,0cyclictest3241-21irqbalance21:49:232
278659943,0cyclictest3241-21irqbalance21:29:232
278659943,0cyclictest3241-21irqbalance19:34:232
278659943,0cyclictest2389-21awk21:14:002
278659943,0cyclictest18647-21awk19:54:002
278659943,0cyclictest12975-21awk20:14:012
278659943,0cyclictest1166-21awk21:54:002
278649944,0cyclictest0-21swapper/122:11:501
278649944,0cyclictest0-21swapper/121:50:521
278649943,0cyclictest460-21awk20:29:001
278649943,0cyclictest3556-21lldpd20:53:451
278649943,0cyclictest3556-21lldpd20:04:151
278649943,0cyclictest3556-21lldpd19:19:151
278649943,0cyclictest3556-21lldpd19:15:441
278649943,0cyclictest3514-21snmpd23:49:521
278649943,0cyclictest3514-21snmpd23:35:071
278649943,0cyclictest3514-21snmpd22:54:371
278649943,0cyclictest22465-21awk23:28:591
278649943,0cyclictest19574-21awk20:19:001
278649943,0cyclictest18632-21awk19:54:001
278649943,0cyclictest18491-21sadc20:18:451
278649943,0cyclictest18478-21awk21:24:011
278639944,0cyclictest0-21swapper/023:39:530
278639944,0cyclictest0-21swapper/022:30:410
278639944,0cyclictest0-21swapper/021:50:280
278639943,0cyclictest7317-21awk22:58:590
278639943,0cyclictest4238-21awk19:19:140
278639943,0cyclictest3556-21lldpd22:48:460
278639943,0cyclictest3530-21sadc00:18:440
278639943,0cyclictest3514-21snmpd23:35:220
278639943,0cyclictest3514-21snmpd19:14:210
278639943,0cyclictest3514-21snmpd00:11:370
278639943,0cyclictest3241-21irqbalance22:12:230
278639943,0cyclictest3241-21irqbalance21:24:030
278639943,0cyclictest3241-21irqbalance21:18:530
278639943,0cyclictest3241-21irqbalance20:33:530
278639943,0cyclictest3241-21irqbalance20:23:530
278639943,0cyclictest3241-21irqbalance20:14:130
278639943,0cyclictest3241-21irqbalance20:10:030
278639943,0cyclictest31778-21awk22:54:010
278639943,0cyclictest3169-21awk18:54:000
278639943,0cyclictest25257-21awk19:59:000
278639943,0cyclictest24352-21awk19:34:020
278639943,0cyclictest20573-21awk20:44:000
278639943,0cyclictest19630-21awk20:19:000
278639943,0cyclictest18899-21awk21:03:590
278639943,0cyclictest17154-21awk22:04:000
278639943,0cyclictest14659-21awk23:24:000
278639943,0cyclictest14011-21awk23:44:020
278639943,0cyclictest10808-21awk20:59:000
259940,0migration/26371-21runrttasks20:33:532
259940,0migration/23254-21kthreadcore20:04:032
259940,0migration/232278-21munin-node20:28:582
259940,0migration/231069-21kthreadcore19:14:022
249940,0watchdog/29119-21tr23:59:022
249940,0watchdog/24409-21irqcore19:19:152
249940,0watchdog/223353-21kthreadcore20:19:032
249940,0watchdog/213134-21gltestperf00:03:582
249940,0watchdog/20-21swapper/223:29:022
249940,0watchdog/20-21swapper/222:29:022
249940,0watchdog/20-21swapper/219:44:032
249940,0watchdog/20-21swapper/218:49:032
19140,0ktimersoftd/10-21swapper/122:25:471
19140,0ktimersoftd/10-21swapper/121:53:471
179940,0migration/19311-21kthreadcore20:34:021
179940,0migration/16673-21kthreadcore23:59:011
179940,0migration/1513-21kthreadcore19:39:031
179940,0migration/131910-21kthreadcore18:49:031
179940,0migration/126828-21kthreadcore22:49:011
179940,0migration/120814-21irqcore20:44:011
179940,0migration/119200-21kthreadcore21:44:031
179940,0migration/119071-21kthreadcore19:29:011
179940,0migration/117249-21kthreadcore22:44:021
179940,0migration/116997-21taskset19:04:021
179940,0migration/116030-21kthreadcore20:39:031
179940,0migration/115421-21sh21:40:071
179940,0migration/114501-21aten2.4-expect23:03:541
179940,0migration/112190-21kthreadcore19:24:031
169940,0watchdog/15232-21kthreadcore21:14:031
169940,0watchdog/125984-21kthreadcore23:09:021
169940,0watchdog/124724-21kthreadcore19:34:031
169940,0watchdog/113646-21ssh22:40:341
169940,0watchdog/10-21swapper/123:24:581
169940,0watchdog/10-21swapper/122:58:461
169940,0watchdog/10-21swapper/118:54:031
169940,0watchdog/10-21swapper/100:13:581
169940,0watchdog/10-21swapper/100:08:581
149940,0migration/030617-21kthreadcore18:49:020
149940,0migration/029517-21fschecks_time23:53:590
149940,0migration/026088-21kthreadcore23:09:020
149940,0migration/02128-21cpuspeed_turbos20:53:590
149940,0migration/018311-21kthreadcore19:29:000
149940,0migration/014832-21kthreadcore20:39:020
29715030,0irq/26-eth0-rx-0-21swapper/320:43:563
29715030,0irq/26-eth0-rx-0-21swapper/320:23:573
29715030,0irq/26-eth0-rx-0-21swapper/320:13:593
29715030,0irq/26-eth0-rx-0-21swapper/319:47:213
29715030,0irq/26-eth0-rx-0-21swapper/319:39:023
29715030,0irq/26-eth0-rx-0-21swapper/319:28:563
29715030,0irq/26-eth0-rx-0-21swapper/319:23:383
278659932,0cyclictest6559-21runrttasks19:33:112
278659932,0cyclictest10964-21pmu-power20:09:062
278659930,0cyclictest24129-21cut20:44:032
278649932,0cyclictest6568-21irqrtprio20:09:021
278649932,0cyclictest510-21awk22:14:001
278649932,0cyclictest31058-21sensors20:24:071
278649932,0cyclictest24442-21aten_r1power_cu19:58:561
278649932,0cyclictest22467-21aten2.4-expect19:08:561
278649930,0cyclictest9002-21latency_hist18:58:451
278639933,0cyclictest3556-21lldpd23:59:460
278639933,0cyclictest3556-21lldpd00:03:470
278639932,0cyclictest9893-21grep22:39:000
278639932,0cyclictest9819-21awk21:38:590
278639932,0cyclictest3556-21lldpd21:47:150
278639932,0cyclictest3514-21snmpd22:19:520
278639932,0cyclictest30595-21tune2fs19:39:000
278639932,0cyclictest2669-21kthreadcore21:34:010
278639932,0cyclictest22577-21sadc22:48:440
278639932,0cyclictest13872-21kthreadcore19:24:030
278639931,0cyclictest0-21swapper/023:49:000
278639930,0cyclictest31679-21perl20:03:590
179930,0migration/11915-21if_eth121:33:591
169930,0watchdog/10-21swapper/122:18:581
169930,0watchdog/10-21swapper/121:59:021
169930,0watchdog/10-21swapper/119:49:031
169930,0watchdog/10-21swapper/119:49:031
29715020,0irq/26-eth0-rx-0-21swapper/319:04:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional