You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 09:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Jun 23, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450740,0irq/25-eth10-21swapper/318:50:173
1845023724,0sleep10-21swapper/118:48:351
1839623522,0sleep00-21swapper/018:47:540
1856923026,0sleep20-21swapper/218:49:562
35160,0ktimersoftd/30-21swapper/323:55:213
35160,0ktimersoftd/30-21swapper/323:55:213
339960,0migration/332419-21sh21:00:093
339960,0migration/315671-21timerwakeupswit21:27:143
29725060,0irq/27-eth0-tx-17088-21latency_hist22:31:532
29725060,0irq/27-eth0-tx-1016-21munin-node21:02:082
29715060,0irq/26-eth0-rx-886-21date21:01:543
188109965,0cyclictest7441-21grep19:07:061
188099960,0cyclictest8316-21ssh21:23:420
149960,0migration/024373-21sh20:55:280
149960,0migration/01658-21sh21:42:060
8215050,0irq/24-0000:00:9449-21munin-run20:21:542
8215050,0irq/24-0000:00:16998-21munin-run20:51:542
339950,0migration/39094-21aten_r1power_en23:07:043
339950,0migration/39073-21kthreadcore19:07:093
339950,0migration/36681-21munin-node23:22:163
339950,0migration/36667-21kthreadcore19:52:123
339950,0migration/36213-21latency19:27:113
339950,0migration/36166-21kthreadcore20:42:113
339950,0migration/34051-21kthreadcore21:22:093
339950,0migration/332017-21taskset19:01:103
339950,0migration/331159-21kthreadcore19:22:113
339950,0migration/329383-21gltestperf20:12:073
339950,0migration/329170-21kthreadcore23:57:123
339950,0migration/328625-21if_eth1.319:47:103
339950,0migration/32831-21kthreadcore22:42:113
339950,0migration/327487-21kthreadcore00:17:113
339950,0migration/325383-21aten_r1power_po22:57:053
339950,0migration/323469-21taskset00:15:453
339950,0migration/322312-21kthreadcore23:12:123
339950,0migration/32231-21munin-node22:02:083
339950,0migration/322184-21kthreadcore22:52:113
339950,0migration/319046-21kthreadcore22:12:103
339950,0migration/317803-21aten_r1power_vo21:52:063
339950,0migration/317472-21munin-node20:27:103
339950,0migration/316771-21aten_r1power_cu23:32:043
339950,0migration/316771-21aten_r1power_cu23:32:043
339950,0migration/314712-21munin-node19:37:063
339950,0migration/314345-21timerwakeupswit23:47:163
339950,0migration/313775-21taskset19:33:243
29725050,0irq/27-eth0-tx-877-21munin-node19:27:070
29725050,0irq/27-eth0-tx-30709-21ssh00:18:312
29725050,0irq/27-eth0-tx-17702-21ssh21:12:022
29725050,0irq/27-eth0-tx-13232-21tr22:07:082
29725050,0irq/27-eth0-tx-0-21swapper/020:31:270
29715050,0irq/26-eth0-rx-5224-21cut00:02:103
29715050,0irq/26-eth0-rx-447-21cpu23:42:043
29715050,0irq/26-eth0-rx-31379-21python22:17:173
29715050,0irq/26-eth0-rx-27216-21tr22:37:103
29715050,0irq/26-eth0-rx-21860-21kthreadcore20:52:123
29715050,0irq/26-eth0-rx-14590-21ssh00:08:163
29715050,0irq/26-eth0-rx-13951-21kthreadcore21:07:103
29715050,0irq/26-eth0-rx-10239-21irqcore22:47:093
29715050,0irq/26-eth0-rx-0-21swapper/323:40:383
29715050,0irq/26-eth0-rx-0-21swapper/323:30:473
29715050,0irq/26-eth0-rx-0-21swapper/323:17:163
29715050,0irq/26-eth0-rx-0-21swapper/322:27:203
29715050,0irq/26-eth0-rx-0-21swapper/322:25:433
29715050,0irq/26-eth0-rx-0-21swapper/321:48:243
29715050,0irq/26-eth0-rx-0-21swapper/321:43:173
29715050,0irq/26-eth0-rx-0-21swapper/321:37:253
29715050,0irq/26-eth0-rx-0-21swapper/321:34:573
29715050,0irq/26-eth0-rx-0-21swapper/321:12:413
259950,0migration/2371-21runrttasks21:39:512
259950,0migration/229646-21kthreadcore23:17:112
259950,0migration/226683-21kthreadcore23:37:092
259950,0migration/22667-21kthreadcore23:02:102
259950,0migration/225836-21fschecks_count22:37:062
259950,0migration/224780-21sh22:15:232
259950,0migration/217623-21cpuspeed_turbos22:32:042
259950,0migration/217579-21latency_hist21:51:542
259950,0migration/216267-21if_eth1.320:02:092
188119955,0cyclictest0-21swapper/221:11:522
188109955,0cyclictest0-21swapper/123:52:141
188109955,0cyclictest0-21swapper/123:52:141
188109950,0cyclictest0-21swapper/123:43:251
188109950,0cyclictest0-21swapper/122:46:011
188099955,0cyclictest0-21swapper/021:17:140
188099950,0cyclictest0-21swapper/023:22:160
179950,0migration/131689-21timerandwakeup21:37:151
179950,0migration/131218-21sh23:59:181
179950,0migration/124791-21taskset21:55:111
179950,0migration/124080-21sh21:32:391
179950,0migration/119791-21kthreadcore20:27:111
179950,0migration/118261-21kthreadcore23:32:101
179950,0migration/118261-21kthreadcore23:32:101
179950,0migration/118133-21fschecks_time22:12:071
179950,0migration/114931-21kthreadcore19:12:101
179950,0migration/114181-21munin-node23:47:151
179950,0migration/112217-21kthreadcore21:07:101
179950,0migration/111461-21kthreadcore22:27:101
169950,0watchdog/129463-21idleruntime20:12:081
149950,0migration/0728-21latency_hist21:01:540
149950,0migration/07092-21taskset23:43:480
149950,0migration/05241-21kthreadcore21:02:110
149950,0migration/04511-21kthreadcore22:22:100
149950,0migration/032432-21taskset21:58:580
149950,0migration/032363-21sh23:00:010
149950,0migration/031921-21sh23:40:220
149950,0migration/030537-21kthreadcore20:12:100
149950,0migration/029548-21latency_hist20:36:540
149950,0migration/029302-21kthreadcore19:47:110
149950,0migration/029169-21kthreadcore22:37:110
149950,0migration/028081-21kthreadcore00:17:110
149950,0migration/026741-21timerandwakeup19:42:190
149950,0migration/021853-21kthreadcore22:52:110
149950,0migration/020839-21kthreadcore23:12:110
149950,0migration/019185-21kthreadcore21:32:100
149950,0migration/019100-21kthreadcore21:52:110
149950,0migration/018060-21kthreadcore23:52:100
149950,0migration/018060-21kthreadcore23:52:100
149950,0migration/017093-21kthreadcore19:12:110
149950,0migration/016748-21taskset20:49:150
149950,0migration/015815-21sh21:07:490
149950,0migration/014692-21taskset00:08:330
149950,0migration/012273-21kthreadcore22:47:110
149950,0migration/01163-21cpuspeed_turbos23:02:050
339940,0migration/3709-21latency_hist23:01:533
339940,0migration/327719-21kthreadcore21:57:103
29725040,0irq/27-eth0-tx-9802-21hddtemp_smartct23:07:062
29725040,0irq/27-eth0-tx-17686-21latency_hist21:31:542
29725040,0irq/27-eth0-tx-16420-21munin-node23:52:142
29725040,0irq/27-eth0-tx-16420-21munin-node23:52:142
29725040,0irq/27-eth0-tx-15107-21ssh00:09:452
29725040,0irq/27-eth0-tx-0-21swapper/223:27:112
29725040,0irq/27-eth0-tx-0-21swapper/222:57:572
29725040,0irq/27-eth0-tx-0-21swapper/222:43:222
29725040,0irq/27-eth0-tx-0-21swapper/222:22:142
29725040,0irq/27-eth0-tx-0-21swapper/221:48:052
29725040,0irq/27-eth0-tx-0-21swapper/221:21:552
29725040,0irq/27-eth0-tx-0-21swapper/220:56:572
29725040,0irq/27-eth0-tx-0-21swapper/020:11:330
29725040,0irq/27-eth0-tx-0-21swapper/018:52:130
29715040,0irq/26-eth0-rx-0-21swapper/322:31:553
29715040,0irq/26-eth0-rx-0-21swapper/322:08:343
29715040,0irq/26-eth0-rx-0-21swapper/321:17:193
29715040,0irq/26-eth0-rx-0-21swapper/320:32:133
29715040,0irq/26-eth0-rx-0-21swapper/320:02:113
259940,0migration/28832-21munin-node23:47:062
259940,0migration/27242-21kthreadcore20:42:112
259940,0migration/26016-21pmu-power23:42:152
259940,0migration/2580-21taskset23:21:582
259940,0migration/228386-21kthreadcore21:17:112
259940,0migration/227775-21kthreadcore21:57:102
259940,0migration/22758-21kthreadcore19:27:102
259940,0migration/225928-21kthreadcore20:07:122
259940,0migration/225647-21kthreadcore20:32:102
259940,0migration/22485-21fschecks_time19:52:082
259940,0migration/221813-21kthreadcore22:52:112
259940,0migration/221601-21kthreadcore19:17:112
259940,0migration/22139-21kthreadcore00:02:092
259940,0migration/219624-21fschecks_time18:52:082
259940,0migration/219042-21kthreadcore00:12:112
259940,0migration/218569-21kthreadcore23:32:102
259940,0migration/218569-21kthreadcore23:32:102
259940,0migration/216654-21kthreadcore19:12:112
259940,0migration/211396-21kthreadcore20:22:102
259940,0migration/210685-21if_eth1.321:27:062
249940,0watchdog/26921-21needreboot22:02:122
249940,0watchdog/221961-21python20:27:162
249940,0watchdog/221430-21tr23:12:112
249940,0watchdog/217247-21munin-node20:52:082
249940,0watchdog/21403-21ssh21:42:002
188119943,0cyclictest8599-21awk19:32:092
188119943,0cyclictest3556-21lldpd19:48:522
188119943,0cyclictest3556-21lldpd19:41:222
188119943,0cyclictest3556-21lldpd19:08:222
188119943,0cyclictest3556-21lldpd19:06:222
188119943,0cyclictest30581-21awk20:37:102
188119943,0cyclictest29504-21awk20:12:082
188119943,0cyclictest26510-21awk18:57:082
188119943,0cyclictest26446-21awk22:17:092
188119943,0cyclictest25317-21awk23:57:092
188119943,0cyclictest10175-21awk22:47:092
188109944,0cyclictest0-21swapper/123:24:101
188109944,0cyclictest0-21swapper/122:21:541
188109944,0cyclictest0-21swapper/122:02:301
188109943,0cyclictest3556-21lldpd21:42:231
188109943,0cyclictest3556-21lldpd19:53:521
188109943,0cyclictest3556-21lldpd19:49:221
188109943,0cyclictest3556-21lldpd18:59:531
188109943,0cyclictest3556-21lldpd00:18:521
188109943,0cyclictest3514-21snmpd22:37:031
188109943,0cyclictest3514-21snmpd21:12:471
188109943,0cyclictest26492-21awk22:17:091
188109943,0cyclictest26445-21sadc19:21:541
188109943,0cyclictest26235-21awk22:57:091
188109943,0cyclictest2215-21cut21:02:101
188109943,0cyclictest1741-21awk23:02:071
188099944,0cyclictest0-21swapper/021:28:070
188099944,0cyclictest0-21swapper/000:14:080
188099943,0cyclictest8535-21awk19:32:090
188099943,0cyclictest8258-21sh22:04:130
188099943,0cyclictest4770-21awk20:42:090
188099943,0cyclictest3241-21irqbalance22:16:520
188099943,0cyclictest3241-21irqbalance21:16:220
188099943,0cyclictest2811-21awk19:52:100
188099943,0cyclictest27629-21awk19:22:090
188099943,0cyclictest26789-21awk21:37:080
188099943,0cyclictest17251-21sadc22:11:540
188099943,0cyclictest16160-21awk20:02:080
188099943,0cyclictest10003-21awk23:07:080
179940,0migration/18654-21runrttasks19:56:581
179940,0migration/17909-21cpuspeed_turbos19:32:061
179940,0migration/17212-21runrttasks00:04:561
179940,0migration/17027-21kthreadcore20:42:111
179940,0migration/14611-21kthreadcore20:17:091
179940,0migration/130418-21idleruntime20:37:091
179940,0migration/125674-21fschecks_count20:57:071
179940,0migration/125582-21latency_hist21:56:541
179940,0migration/118405-21irqcore20:52:101
179940,0migration/117275-21kthreadcore20:02:101
179940,0migration/116627-21diskmemload21:29:271
179940,0migration/115220-21sh23:28:131
179940,0migration/110111-21irqcore23:07:091
169940,0watchdog/1393-21chrt19:24:361
169940,0watchdog/130282-21kthreadcore21:17:121
169940,0watchdog/124661-21ssh22:55:591
169940,0watchdog/122947-21munin-node20:32:041
169940,0watchdog/115824-21ssh21:47:321
169940,0watchdog/114979-21python22:47:151
169940,0watchdog/112221-21kthreadcore22:07:081
169940,0watchdog/10-21swapper/123:19:151
169940,0watchdog/10-21swapper/100:12:071
169940,0watchdog/10-21swapper/100:07:151
149940,0migration/04938-21kthreadcore20:17:100
149940,0migration/028586-21kthreadcore18:57:100
149940,0migration/028078-21kthreadcore23:17:100
149940,0migration/025649-21aten_r1power_en22:17:050
149940,0migration/02100-21kthreadcore19:02:100
149940,0migration/020799-21hwlatdetect19:17:080
149940,0migration/019359-21kthreadcore23:32:100
149940,0migration/019359-21kthreadcore23:32:100
149940,0migration/013245-21kthreadcore22:27:110
339930,0migration/322540-21fschecks_time20:07:083
29725030,0irq/27-eth0-tx-0-21swapper/020:23:270
29715030,0irq/26-eth0-rx-0-21swapper/320:47:073
29715030,0irq/26-eth0-rx-0-21swapper/320:37:053
29715030,0irq/26-eth0-rx-0-21swapper/320:22:053
29715030,0irq/26-eth0-rx-0-21swapper/319:57:043
29715030,0irq/26-eth0-rx-0-21swapper/319:42:183
29715030,0irq/26-eth0-rx-0-21swapper/319:12:063
29715030,0irq/26-eth0-rx-0-21swapper/319:02:043
29715030,0irq/26-eth0-rx-0-21swapper/318:52:053
249930,0watchdog/20-21swapper/219:57:122
188119932,0cyclictest27511-21awk19:22:082
188109933,0cyclictest21865-21awk19:42:091
188109932,0cyclictest9977-21tr20:22:051
188109932,0cyclictest23586-21kthreadcore18:52:121
188109932,0cyclictest16995-21diskmemload22:31:561
188109932,0cyclictest14716-21diskstats19:37:061
188109932,0cyclictest11901-21sed20:47:121
188109930,0cyclictest1955-21diskstats21:22:051
188099932,0cyclictest8308-21grep19:07:090
188099932,0cyclictest6416-21sh00:02:410
188099932,0cyclictest3514-21snmpd23:57:150
188099932,0cyclictest23929-21awk20:32:080
188099932,0cyclictest23109-21sensors22:32:140
188099932,0cyclictest1976-21awk22:42:100
188099932,0cyclictest14540-21sensors23:27:150
188099932,0cyclictest10607-21awk21:47:100
188099930,0cyclictest14835-21grep19:37:070
188099930,0cyclictest0-21swapper/019:57:060
169930,0watchdog/10-21swapper/123:37:031
169930,0watchdog/10-21swapper/123:12:111
169930,0watchdog/10-21swapper/120:07:081
169930,0watchdog/10-21swapper/119:30:561
169930,0watchdog/10-21swapper/119:02:041
149930,0migration/015952-21sh23:51:210
29715020,0irq/26-eth0-rx-0-21swapper/320:17:043
29715020,0irq/26-eth0-rx-0-21swapper/319:17:083
188119921,0cyclictest20922-21cat19:41:542
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional