You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 08:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu Jun 11, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
192023723,0sleep00-21swapper/018:49:290
304450350,0irq/25-eth10-21swapper/318:48:573
170823425,0sleep20-21swapper/218:48:272
215723324,0sleep10-21swapper/118:52:141
23029976,0cyclictest26264-21tr21:08:171
23019976,0cyclictest6772-21ssh23:35:560
339960,0migration/37777-21runrttasks23:38:083
339960,0migration/3572-21munin-node20:28:173
339960,0migration/323188-21sh23:05:543
339960,0migration/316600-21sh21:22:043
339960,0migration/315423-21sh22:40:593
29715060,0irq/26-eth0-rx-8856-21grep19:18:203
29715060,0irq/26-eth0-rx-6572-21ntpq21:13:223
29715060,0irq/26-eth0-rx-3130-21kthreadcore21:33:193
29715060,0irq/26-eth0-rx-16669-21dump-pmu-power21:03:023
29715060,0irq/26-eth0-rx-16025-40yum-updatesd-he21:40:583
29715060,0irq/26-eth0-rx-1211-21cat00:13:173
29715060,0irq/26-eth0-rx-0-21swapper/323:13:183
29715060,0irq/26-eth0-rx-0-21swapper/322:36:543
23039966,0cyclictest0-21swapper/220:53:232
23039960,0cyclictest0-21swapper/222:03:192
23029964,0cyclictest3514-21snmpd23:33:161
23029960,0cyclictest0-21swapper/118:53:131
23019960,0cyclictest0-21swapper/021:32:190
149960,0migration/07550-21latency_hist23:58:020
149960,0migration/032099-21sh21:50:510
149960,0migration/023085-21sh22:44:530
149960,0migration/022352-21sh23:03:320
8215050,0irq/24-0000:00:9992-21latency_hist19:23:032
35150,0ktimersoftd/30-21swapper/320:54:273
35150,0ktimersoftd/30-21swapper/300:09:193
339950,0migration/39969-21needreboot19:43:223
339950,0migration/39064-21kthreadcore20:33:193
339950,0migration/38900-21sh21:58:113
339950,0migration/38645-21aten_r1power_cu22:18:123
339950,0migration/38443-21cpuspeed_turbos22:58:133
339950,0migration/332433-21latency_hist22:33:023
339950,0migration/330881-21missed_timers20:23:223
339950,0migration/327326-21idleruntime20:48:173
339950,0migration/323845-21munin-node19:08:183
339950,0migration/322672-21munin-node22:03:233
339950,0migration/318718-21kthreadcore21:23:193
339950,0migration/311416-21munin-node20:08:253
339950,0migration/311027-21kthreadcore18:58:203
29725050,0irq/27-eth0-tx-9262-21munin-node18:58:150
29725050,0irq/27-eth0-tx-7082-21ssh21:53:392
29725050,0irq/27-eth0-tx-6475-21munin-node20:33:180
29725050,0irq/27-eth0-tx-445-21munin-node22:13:142
29725050,0irq/27-eth0-tx-32231-21munin-node23:13:212
29725050,0irq/27-eth0-tx-32042-21ssh21:30:252
29725050,0irq/27-eth0-tx-23547-21munin-node19:33:190
29725050,0irq/27-eth0-tx-17223-21munin-node21:23:242
29725050,0irq/27-eth0-tx-16950-21munin-node21:03:142
29725050,0irq/27-eth0-tx-15415-40yum-updatesd-he22:40:582
29725050,0irq/27-eth0-tx-11264-21munin-node19:48:170
29725050,0irq/27-eth0-tx-0-21swapper/223:39:402
29725050,0irq/27-eth0-tx-0-21swapper/223:36:312
29725050,0irq/27-eth0-tx-0-21swapper/222:52:472
29725050,0irq/27-eth0-tx-0-21swapper/222:45:402
29725050,0irq/27-eth0-tx-0-21swapper/222:34:512
29725050,0irq/27-eth0-tx-0-21swapper/221:37:052
29725050,0irq/27-eth0-tx-0-21swapper/020:48:580
29715050,0irq/26-eth0-rx-6559-21runrttasks00:00:013
29715050,0irq/26-eth0-rx-31914-21kthreadcore19:13:183
29715050,0irq/26-eth0-rx-29759-21ntp_kernel_pll_23:08:223
29715050,0irq/26-eth0-rx-23728-21sh21:04:573
29715050,0irq/26-eth0-rx-16400-21diskstats23:23:153
29715050,0irq/26-eth0-rx-14635-21ssh23:19:583
29715050,0irq/26-eth0-rx-0-21swapper/323:55:053
29715050,0irq/26-eth0-rx-0-21swapper/323:44:103
29715050,0irq/26-eth0-rx-0-21swapper/323:32:143
29715050,0irq/26-eth0-rx-0-21swapper/322:48:223
29715050,0irq/26-eth0-rx-0-21swapper/322:24:573
29715050,0irq/26-eth0-rx-0-21swapper/321:54:533
29715050,0irq/26-eth0-rx-0-21swapper/321:43:193
29715050,0irq/26-eth0-rx-0-21swapper/320:43:183
29715050,0irq/26-eth0-rx-0-21swapper/319:38:143
29715050,0irq/26-eth0-rx-0-21swapper/300:03:043
27150,0ktimersoftd/20-21swapper/221:20:112
259950,0migration/29398-21df_abs21:38:142
259950,0migration/28957-21cpuspeed_turbos22:18:142
259950,0migration/222652-21sh23:24:562
259950,0migration/216914-21latency_hist21:43:022
259950,0migration/216677-21hwlatdetect19:03:152
259950,0migration/213658-21munin-node22:58:202
23039955,0cyclictest0-21swapper/222:24:452
23039955,0cyclictest0-21swapper/222:00:292
23039955,0cyclictest0-21swapper/221:13:492
23039955,0cyclictest0-21swapper/221:01:402
23039950,0cyclictest0-21swapper/222:55:212
23039950,0cyclictest0-21swapper/222:12:562
23019955,0cyclictest0-21swapper/023:30:340
23019955,0cyclictest0-21swapper/023:18:260
23019950,0cyclictest0-21swapper/023:02:020
19150,0ktimersoftd/10-21swapper/122:39:571
19150,0ktimersoftd/10-21swapper/121:20:111
179950,0migration/18453-21sh21:16:491
179950,0migration/17991-21sh21:35:561
179950,0migration/132671-21taskset20:50:271
179950,0migration/127295-21kthreadcore22:48:171
179950,0migration/124154-21munin-node23:28:131
179950,0migration/123549-21sh21:04:321
179950,0migration/117398-21kthreadcore20:38:201
179950,0migration/116879-21sendmail_mailst19:48:231
179950,0migration/113572-21kthreadcore18:58:201
179950,0migration/111125-21latency_hist19:48:031
169950,0watchdog/132083-21cpu00:13:121
169950,0watchdog/128542-21vmstat19:08:251
169950,0watchdog/116061-21cpu19:03:131
149950,0migration/09137-21cpu21:58:140
149950,0migration/07115-21runrttasks21:53:440
149950,0migration/0616-21turbostat21:13:020
149950,0migration/032313-21fschecks_count00:13:130
149950,0migration/028603-21kthreadcore23:48:180
149950,0migration/027427-21kthreadcore22:08:180
149950,0migration/026950-21sh00:08:170
149950,0migration/026151-21fschecks_time20:23:160
149950,0migration/023645-21irqcore19:08:180
149950,0migration/023315-21uptime21:23:260
149950,0migration/020566-21kthreadcore20:18:180
149950,0migration/020561-21kthreadcore23:43:180
149950,0migration/020558-21gltestperf20:43:150
149950,0migration/018417-21taskset20:15:360
149950,0migration/017170-21cpuspeed_turbos22:03:130
149950,0migration/016625-21taskset22:23:090
149950,0migration/01306-21kthreadcore19:38:200
149950,0migration/011696-21kthreadcore23:58:190
149950,0migration/010423-21kthreadcore22:38:190
8215040,0irq/24-0000:00:0-21swapper/220:38:022
339940,0migration/3971-21kthreadcore20:03:183
339940,0migration/33780-21kthreadcore22:53:183
339940,0migration/328956-21kthreadcore21:48:183
339940,0migration/325126-21taskset20:21:153
339940,0migration/322958-21taskset19:28:593
29725040,0irq/27-eth0-tx-26056-21if_err_eth021:08:162
29725040,0irq/27-eth0-tx-24056-21ssh23:28:132
29725040,0irq/27-eth0-tx-23927-21ssh23:48:082
29725040,0irq/27-eth0-tx-22418-21ssh23:03:422
29725040,0irq/27-eth0-tx-14722-21ssh23:20:142
29725040,0irq/27-eth0-tx-0-21swapper/223:43:062
29725040,0irq/27-eth0-tx-0-21swapper/221:48:082
29725040,0irq/27-eth0-tx-0-21swapper/200:13:342
29725040,0irq/27-eth0-tx-0-21swapper/200:08:052
29725040,0irq/27-eth0-tx-0-21swapper/020:53:180
29725040,0irq/27-eth0-tx-0-21swapper/020:28:140
29725040,0irq/27-eth0-tx-0-21swapper/020:03:120
29715040,0irq/26-eth0-rx-0-21swapper/323:50:043
29715040,0irq/26-eth0-rx-0-21swapper/323:33:133
29715040,0irq/26-eth0-rx-0-21swapper/322:45:543
29715040,0irq/26-eth0-rx-0-21swapper/322:13:303
29715040,0irq/26-eth0-rx-0-21swapper/322:08:123
29715040,0irq/26-eth0-rx-0-21swapper/321:28:403
29715040,0irq/26-eth0-rx-0-21swapper/321:11:183
29715040,0irq/26-eth0-rx-0-21swapper/319:03:243
29715040,0irq/26-eth0-rx-0-21swapper/300:18:123
259940,0migration/29021-21irqrtprio23:58:182
259940,0migration/25903-21runrttasks23:53:452
259940,0migration/23095-21fschecks_time18:53:152
259940,0migration/229181-21kthreadcore20:23:202
259940,0migration/226974-21kthreadcore22:28:182
249940,0watchdog/261322sleep220:32:012
249940,0watchdog/20-21swapper/219:43:212
23039944,0cyclictest0-21swapper/200:18:072
23039943,0cyclictest446-21sadc20:53:022
23039943,0cyclictest3556-21lldpd20:34:292
23039943,0cyclictest3556-21lldpd19:52:582
23039943,0cyclictest3556-21lldpd19:29:282
23039943,0cyclictest3556-21lldpd18:59:572
23039943,0cyclictest3514-21snmpd20:08:462
23039943,0cyclictest3514-21snmpd20:03:312
23039943,0cyclictest3514-21snmpd19:33:302
23039943,0cyclictest25149-21awk23:08:172
23039943,0cyclictest19721-21awk20:18:162
23039943,0cyclictest16650-21awk00:03:162
23029943,0cyclictest663-21awk20:28:181
23029943,0cyclictest407-21awk23:53:151
23029943,0cyclictest3556-21lldpd20:36:591
23029943,0cyclictest3556-21lldpd00:02:581
23029943,0cyclictest3514-21snmpd20:19:011
23029943,0cyclictest3514-21snmpd20:01:011
23029943,0cyclictest3514-21snmpd19:54:011
23029943,0cyclictest3514-21snmpd19:24:001
23029943,0cyclictest3241-21irqbalance21:01:011
23029943,0cyclictest16739-21awk23:43:151
23029943,0cyclictest13152-21awk20:13:161
23029940,0cyclictest0-21swapper/122:21:471
23019944,0cyclictest0-21swapper/022:55:150
23019943,0cyclictest6500-21awk20:08:170
23019943,0cyclictest3514-21snmpd21:47:160
23019943,0cyclictest3241-21irqbalance21:41:410
23019943,0cyclictest30941-21sadc20:03:030
23019943,0cyclictest25593-21awk22:28:160
23019943,0cyclictest2005-21kworker/0:219:45:100
23019943,0cyclictest1819-21awk21:13:170
23019943,0cyclictest17754-21awk19:28:170
23019942,0cyclictest0-21swapper/019:03:150
23019940,0cyclictest2647-21kauditd19:23:030
23019940,0cyclictest10748-21kthreadcore21:18:180
179940,0migration/19425-21timerwakeupswit19:18:241
179940,0migration/19201-21kthreadcore00:18:181
179940,0migration/16537-21diskmemload22:54:151
179940,0migration/15255-21latency23:13:191
179940,0migration/13732-21kthreadcore22:33:201
179940,0migration/131411-21sh21:48:521
179940,0migration/130752-21sh00:10:371
179940,0migration/125249-21sh21:28:131
179940,0migration/124824-21kernelversion19:33:181
179940,0migration/121996-21sh00:03:381
179940,0migration/120243-21kthreadcore22:23:181
179940,0migration/118670-21kthreadcore23:03:181
179940,0migration/117155-21irqcore23:23:181
179940,0migration/114871-21taskset23:00:101
179940,0migration/112882-21kthreadcore23:18:191
179940,0migration/111434-21kthreadcore21:38:181
179940,0migration/111336-21sh23:38:201
169940,0watchdog/16698-21timerandwakeup20:53:251
169940,0watchdog/16559-21runrttasks22:29:121
169940,0watchdog/15504-21munin-node20:08:131
169940,0watchdog/131704-21ssh23:12:201
169940,0watchdog/130388-21ssh23:49:201
169940,0watchdog/123118-21ssh22:45:001
169940,0watchdog/10-21swapper/122:07:521
169940,0watchdog/10-21swapper/121:58:081
169940,0watchdog/10-21swapper/121:56:481
149940,0migration/0797-21fschecks_time22:33:150
149940,0migration/06591-21kthreadcore18:53:190
149940,0migration/027202-21kthreadcore22:48:170
149940,0migration/022117-21vmstat23:23:260
149940,0migration/011163-21kthreadcore22:18:190
149940,0migration/010788-21fschecks_time19:23:160
8215030,0irq/24-0000:00:0-21swapper/219:23:092
29715030,0irq/26-eth0-rx-0-21swapper/320:14:023
29715030,0irq/26-eth0-rx-0-21swapper/319:48:133
29715030,0irq/26-eth0-rx-0-21swapper/319:33:133
29715030,0irq/26-eth0-rx-0-21swapper/319:26:443
29715030,0irq/26-eth0-rx-0-21swapper/318:53:123
259930,0migration/223891-21kthreadcore19:08:182
259930,0migration/219957-21aten_r1power_vo20:43:142
24191230,0sleep00-21swapper/023:08:090
249930,0watchdog/20-21swapper/220:13:172
23039933,0cyclictest0-21swapper/219:53:052
23039933,0cyclictest0-21swapper/219:40:192
23039930,0cyclictest0-21swapper/219:13:232
23029932,0cyclictest32101-21awk20:03:161
23029932,0cyclictest32045-21kthreadcore19:38:201
23029932,0cyclictest31115-21kthreadcore19:13:181
23029932,0cyclictest26128-21perl20:23:161
23029932,0cyclictest18557-21kthreadcore19:28:191
23029932,0cyclictest18123-21awk21:23:171
23029930,0cyclictest17753-21gltestperf21:43:151
23019933,0cyclictest2005-21kworker/0:222:13:140
23019933,0cyclictest2005-21kworker/0:221:33:060
23019933,0cyclictest2005-21kworker/0:220:38:100
23019933,0cyclictest2005-21kworker/0:219:53:060
23019933,0cyclictest2005-21kworker/0:219:13:100
23019932,0cyclictest9682-21awk20:58:170
23019932,0cyclictest8514-21awk00:18:160
23019932,0cyclictest21553-21sensors00:03:230
23019932,0cyclictest2005-21kworker/0:223:38:050
23019930,0cyclictest406-21tune2fs23:13:140
169930,0watchdog/124996-21munin-node22:08:121
169930,0watchdog/10-21swapper/122:13:121
149930,0migration/016903-21sh21:03:050
339920,0migration/324940-21diskstats19:58:153
29715020,0irq/26-eth0-rx-0-21swapper/320:38:043
29715020,0irq/26-eth0-rx-0-21swapper/319:53:143
249920,0watchdog/20-21swapper/219:58:052
23029921,0cyclictest0-21swapper/120:43:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional