You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 04:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Jun 21, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450540,0irq/25-eth10-21swapper/318:48:363
1452423626,0sleep20-21swapper/218:47:422
1477023522,0sleep00-21swapper/018:50:320
1480722622,0sleep10-21swapper/118:51:011
339960,0migration/36778-21sh00:07:233
339960,0migration/35005-21sh21:26:363
339960,0migration/319106-21sh22:12:413
339960,0migration/318875-21sh00:17:033
339960,0migration/311984-21sh22:31:243
339960,0migration/311761-21sh21:48:433
339960,0migration/310895-21sh22:48:493
29725060,0irq/27-eth0-tx-4739-21munin-node19:57:210
29715060,0irq/26-eth0-rx-31760-21kthreadcore22:42:213
29715060,0irq/26-eth0-rx-21815-21diskstats20:57:183
29715060,0irq/26-eth0-rx-20683-21perl23:17:173
29715060,0irq/26-eth0-rx-18681-21users22:32:303
149960,0migration/028076-21sh21:59:370
149960,0migration/02063-21sh23:44:210
149960,0migration/019633-21sh23:16:410
8215050,0irq/24-0000:00:30217-21munin-run19:52:062
8215050,0irq/24-0000:00:20058-21perf22:57:042
339950,0migration/35782-21cpuspeed_turbos21:07:183
339950,0migration/332440-21munin-node20:42:163
339950,0migration/332093-21kthreadcore19:27:213
339950,0migration/331302-21proc_pri20:37:253
339950,0migration/328851-21taskset22:22:153
339950,0migration/328073-21fschecks_time00:02:203
339950,0migration/325716-21munin-node20:12:193
339950,0migration/325180-21unixbench_multi00:17:273
339950,0migration/324998-21unixbench-2d20:32:283
339950,0migration/324438-21kthreadcore19:22:213
339950,0migration/323881-21kthreadcore21:17:223
339950,0migration/323683-21kthreadcore23:37:213
339950,0migration/323196-21run-parts19:43:063
339950,0migration/322271-21kthreadcore20:07:233
339950,0migration/318719-21diskmemload22:53:133
339950,0migration/315935-21kthreadcore21:52:233
339950,0migration/315432-21cpuspeed_turbos18:52:183
339950,0migration/314862-21munin-node21:12:213
339950,0migration/313667-21cpuspeed_turbos20:52:173
339950,0migration/31183-21kthreadcore19:52:223
339950,0migration/311320-21latency_hist20:02:063
339950,0migration/310364-21runrttasks23:49:593
29725050,0irq/27-eth0-tx-4175-21sed22:47:042
29725050,0irq/27-eth0-tx-4046-21cat00:07:212
29725050,0irq/27-eth0-tx-29596-21munin-node21:02:232
29725050,0irq/27-eth0-tx-29596-21munin-node21:02:232
29725050,0irq/27-eth0-tx-24964-21ntpq23:57:242
29725050,0irq/27-eth0-tx-18984-21ssh23:56:362
29725050,0irq/27-eth0-tx-17932-21ssh00:14:172
29725050,0irq/27-eth0-tx-12862-21munin-node22:12:192
29725050,0irq/27-eth0-tx-11429-21munin-node20:02:200
29725050,0irq/27-eth0-tx-10254-21sendmail_mailst22:27:262
29725050,0irq/27-eth0-tx-0-21swapper/223:39:452
29725050,0irq/27-eth0-tx-0-21swapper/223:12:282
29725050,0irq/27-eth0-tx-0-21swapper/222:32:202
29725050,0irq/27-eth0-tx-0-21swapper/020:37:270
29725050,0irq/27-eth0-tx-0-21swapper/020:17:010
29725050,0irq/27-eth0-tx-0-21swapper/019:22:070
29725050,0irq/27-eth0-tx-0-21swapper/019:01:460
29725050,0irq/27-eth0-tx-0-21swapper/018:56:360
29715050,0irq/26-eth0-rx-5803-21kthreadcore19:07:223
29715050,0irq/26-eth0-rx-4151-21cpu23:07:173
29715050,0irq/26-eth0-rx-31606-21kthreadcore21:02:223
29715050,0irq/26-eth0-rx-31606-21kthreadcore21:02:223
29715050,0irq/26-eth0-rx-29392-21ssh21:42:083
29715050,0irq/26-eth0-rx-29184-21if_err_eth023:02:193
29715050,0irq/26-eth0-rx-28725-21gltestperf23:22:183
29715050,0irq/26-eth0-rx-27101-21ssh22:17:453
29715050,0irq/26-eth0-rx-20897-21sed22:37:183
29715050,0irq/26-eth0-rx-13941-21kthreadcore23:52:223
29715050,0irq/26-eth0-rx-0-21swapper/323:59:423
29715050,0irq/26-eth0-rx-0-21swapper/321:38:563
29715050,0irq/26-eth0-rx-0-21swapper/321:34:453
259950,0migration/25695-21idleruntime22:07:192
259950,0migration/24531-21sh21:46:022
259950,0migration/230694-21kthreadcore22:42:212
259950,0migration/227897-21latency_hist23:22:042
259950,0migration/227723-21sh23:01:102
259950,0migration/227582-21latency_hist23:42:042
259950,0migration/22546-21munin-node19:27:252
259950,0migration/220371-21sh21:55:312
259950,0migration/219831-21fschecks_time00:17:172
259950,0migration/21788-21switchtime19:02:272
259950,0migration/217090-21latency_hist19:42:062
249950,0watchdog/20-21swapper/219:57:282
179950,0migration/14558-21fschecks_time23:07:181
179950,0migration/130090-21kthreadcore23:42:211
179950,0migration/130042-21fschecks_time19:27:171
179950,0migration/127066-21kernelversion20:37:211
179950,0migration/121087-21munin-node22:17:161
179950,0migration/117113-21kthreadcore21:12:221
179950,0migration/112666-21latency_hist22:12:051
179950,0migration/110281-21idleruntime19:12:201
149729955,0cyclictest0-21swapper/222:04:212
149729955,0cyclictest0-21swapper/221:32:302
149709955,0cyclictest0-21swapper/123:57:241
149709950,0cyclictest0-21swapper/123:49:591
149709950,0cyclictest0-21swapper/123:32:291
149709950,0cyclictest0-21swapper/122:13:111
149699950,0cyclictest0-21swapper/023:31:420
149950,0migration/07574-21idleruntime20:47:180
149950,0migration/04867-21sh21:06:140
149950,0migration/04867-21sh21:06:140
149950,0migration/04673-21if_eth019:32:210
149950,0migration/031275-21kthreadcore22:02:220
149950,0migration/030782-21df_abs19:52:180
149950,0migration/030658-21kthreadcore23:22:220
149950,0migration/029184-21fschecks_time22:42:170
149950,0migration/028155-21gltestperf00:02:200
149950,0migration/026439-21kthreadcore19:47:210
149950,0migration/024295-21kthreadcore23:37:210
149950,0migration/022766-21kthreadcore23:57:220
149950,0migration/022668-21irqcore21:37:210
149950,0migration/020273-21sh22:57:070
149950,0migration/019118-21aten_r1power_en20:32:160
149950,0migration/018953-21sh23:35:420
149950,0migration/01829-21kthreadcore21:42:230
149950,0migration/017925-21pmu-power22:52:230
149950,0migration/017564-21kthreadcore20:52:230
149950,0migration/010926-21taskset22:48:550
149950,0migration/010881-21taskset22:28:110
339940,0migration/36357-21kthreadcore23:27:213
339940,0migration/331821-21kthreadcore19:02:223
339940,0migration/328524-21idleruntime23:42:183
339940,0migration/324329-21kthreadcore18:57:223
339940,0migration/311969-21cpuspeed_turbos23:32:183
339940,0migration/310790-21kthreadcore20:22:223
29725040,0irq/27-eth0-tx-25810-21kthreadcore20:57:232
29725040,0irq/27-eth0-tx-18131-21sshd20:27:290
29725040,0irq/27-eth0-tx-13536-21ssh21:12:102
29725040,0irq/27-eth0-tx-0-21swapper/223:47:372
29725040,0irq/27-eth0-tx-0-21swapper/223:18:292
29725040,0irq/27-eth0-tx-0-21swapper/223:02:402
29725040,0irq/27-eth0-tx-0-21swapper/222:17:342
29725040,0irq/27-eth0-tx-0-21swapper/221:57:142
29725040,0irq/27-eth0-tx-0-21swapper/221:37:132
29725040,0irq/27-eth0-tx-0-21swapper/221:22:222
29725040,0irq/27-eth0-tx-0-21swapper/019:12:250
29715040,0irq/26-eth0-rx-29605-21munin-node22:02:183
29715040,0irq/26-eth0-rx-28964-21kthreadcore19:47:223
29715040,0irq/26-eth0-rx-24329-21kthreadcore21:57:223
29715040,0irq/26-eth0-rx-16734-40yum-updatesd-he19:40:273
29715040,0irq/26-eth0-rx-0-21swapper/323:12:543
29715040,0irq/26-eth0-rx-0-21swapper/322:58:503
29715040,0irq/26-eth0-rx-0-21swapper/322:07:513
29715040,0irq/26-eth0-rx-0-21swapper/321:29:163
259940,0migration/29873-21kthreadcore21:47:242
259940,0migration/2876-21kthreadcore20:17:212
259940,0migration/25796-21cpuspeed_turbos21:07:182
259940,0migration/25030-21irqrtprio19:32:222
259940,0migration/24851-21kthreadcore20:42:222
259940,0migration/24233-21cpuspeed_turbos23:07:172
259940,0migration/232100-21runrttasks20:41:262
259940,0migration/227064-21latency21:17:232
259940,0migration/222138-21cpuspeed_turbos18:57:172
259940,0migration/218210-21aten_r1power_po20:07:172
259940,0migration/217444-21kthreadcore18:52:222
259940,0migration/21653-21kthreadcore19:52:222
259940,0migration/211964-21kthreadcore19:37:222
259940,0migration/211242-21kthreadcore19:12:222
249940,0watchdog/24596-21if_eth123:27:192
249940,0watchdog/213186-21diskmemload20:52:272
249940,0watchdog/213055-21fschecks_time20:27:202
249940,0watchdog/20-21swapper/223:32:232
249940,0watchdog/20-21swapper/222:37:232
249940,0watchdog/20-21swapper/221:27:152
179940,0migration/14975-21unixbench_singl20:17:281
179940,0migration/129517-21aten_r1power_fr21:42:171
179940,0migration/128440-21sendmail_mailqu19:22:251
179940,0migration/127102-21munin-node21:17:231
179940,0migration/123326-21kthreadcore23:17:211
179940,0migration/119708-21taskset23:16:551
179940,0migration/116177-21kthreadcore23:52:231
179940,0migration/110745-21kthreadcore21:07:241
179940,0migration/110514-21aten2.4-expect19:37:171
169940,0watchdog/17773-21iostat_ios20:47:201
169940,0watchdog/13500-21ssh23:06:311
169940,0watchdog/129924-21chrt19:48:561
169940,0watchdog/116461-21kthreadcore22:32:231
169940,0watchdog/10-21swapper/122:52:191
169940,0watchdog/10-21swapper/121:51:591
169940,0watchdog/10-21swapper/121:27:151
169940,0watchdog/10-21swapper/121:02:231
169940,0watchdog/10-21swapper/121:02:231
169940,0watchdog/10-21swapper/120:22:161
169940,0watchdog/10-21swapper/120:12:201
149729943,0cyclictest7622-21awk20:47:182
149729943,0cyclictest6558-21awk20:22:192
149729943,0cyclictest3514-21snmpd20:36:172
149729943,0cyclictest3514-21snmpd20:04:472
149729943,0cyclictest3514-21snmpd19:22:472
149729943,0cyclictest3514-21snmpd19:08:312
149729943,0cyclictest29834-21awk22:22:202
149729943,0cyclictest28375-21awk00:02:212
149709944,0cyclictest0-21swapper/100:09:321
149709943,0cyclictest3556-21lldpd23:27:391
149709943,0cyclictest3556-21lldpd22:44:381
149709943,0cyclictest3556-21lldpd22:37:381
149709943,0cyclictest3556-21lldpd22:22:071
149709943,0cyclictest3556-21lldpd22:00:381
149709943,0cyclictest3556-21lldpd21:52:381
149709943,0cyclictest3556-21lldpd21:38:381
149709943,0cyclictest3556-21lldpd21:32:081
149709943,0cyclictest3556-21lldpd20:30:081
149709943,0cyclictest3556-21lldpd20:09:381
149709943,0cyclictest3556-21lldpd19:34:081
149709943,0cyclictest3556-21lldpd19:01:361
149709943,0cyclictest3514-21snmpd00:15:031
149709943,0cyclictest21306-21awk22:57:211
149709943,0cyclictest18049-21awk19:42:191
149709943,0cyclictest14278-21awk20:52:201
149709940,0cyclictest0-21swapper/121:25:341
149699943,0cyclictest3241-21irqbalance23:19:130
149699943,0cyclictest3241-21irqbalance21:56:330
149699943,0cyclictest3241-21irqbalance21:32:340
149699943,0cyclictest3241-21irqbalance21:07:140
149699943,0cyclictest30390-21awk19:27:190
149699943,0cyclictest29349-21awk19:02:190
149699943,0cyclictest27914-21ssh22:20:080
149699943,0cyclictest20063-21awk00:17:180
149699943,0cyclictest17985-21awk19:42:190
149699943,0cyclictest12051-21awk00:12:190
149699940,0cyclictest31365-21munin-node20:17:180
149699940,0cyclictest0-21swapper/023:04:260
149940,0migration/07503-21kthreadcore22:07:210
149940,0migration/04555-21kthreadcore19:07:220
149940,0migration/031811-21kthreadcore21:22:220
149940,0migration/017716-21kthreadcore22:32:230
29725030,0irq/27-eth0-tx-16281-21aten2.4-expect19:17:170
29715030,0irq/26-eth0-rx-0-21swapper/320:47:163
29715030,0irq/26-eth0-rx-0-21swapper/320:18:283
29715030,0irq/26-eth0-rx-0-21swapper/320:02:283
249930,0watchdog/227633-21kthreadcore20:12:202
19130,0ktimersoftd/10-21swapper/100:17:061
179930,0migration/132318-21latency_hist20:42:061
179930,0migration/110884-21sh22:28:121
169930,0watchdog/123169-1kworker/1:1H00:02:231
169930,0watchdog/10-21swapper/122:47:191
169930,0watchdog/10-21swapper/122:02:151
169930,0watchdog/10-21swapper/120:57:231
169930,0watchdog/10-21swapper/119:17:281
169930,0watchdog/10-21swapper/119:07:201
169930,0watchdog/10-21swapper/118:52:201
149729930,0cyclictest16440-21expr19:17:182
149709932,0cyclictest5577-21awk19:57:201
149709932,0cyclictest3556-21lldpd23:37:081
149709932,0cyclictest30808-21kthreadcore19:02:221
149709932,0cyclictest28935-21awk23:22:201
149709932,0cyclictest19903-21awk20:32:201
149709932,0cyclictest14882-21kthreadcore20:02:221
149709931,0cyclictest0-21swapper/119:52:221
149699933,0cyclictest703-21kworker/0:123:52:120
149699933,0cyclictest703-21kworker/0:122:37:560
149699933,0cyclictest703-21kworker/0:122:15:160
149699933,0cyclictest703-21kworker/0:121:12:310
149699933,0cyclictest703-21kworker/0:120:22:110
149699933,0cyclictest703-21kworker/0:120:07:350
149699933,0cyclictest703-21kworker/0:100:07:120
149699932,0cyclictest9701-21kthreadcore21:27:220
149699932,0cyclictest6222-21kthreadcore23:07:220
149699932,0cyclictest6082-21awk21:47:210
149699932,0cyclictest3514-21snmpd21:17:110
149699932,0cyclictest3241-21irqbalance20:57:140
149699932,0cyclictest30193-21tail22:22:210
149699932,0cyclictest1603-21grep20:42:210
149699932,0cyclictest11391-21awk19:37:210
149699930,0cyclictest3751-21diskstats23:47:180
339920,0migration/313395-21iostat_ios20:27:223
29715020,0irq/26-eth0-rx-0-21swapper/319:32:143
29715020,0irq/26-eth0-rx-0-21swapper/319:17:173
29715020,0irq/26-eth0-rx-0-21swapper/319:12:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional