You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 01:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Jun 25, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450740,0irq/25-eth10-21swapper/318:48:493
336423521,0sleep00-21swapper/018:51:350
318423026,0sleep10-21swapper/118:49:401
302422723,0sleep20-21swapper/218:47:492
34539965,0cyclictest4462-21latency_hist19:16:432
34539965,0cyclictest16809-40yum-updatesd-he23:40:122
34529966,0cyclictest11243-21irqstats20:57:001
34529960,0cyclictest0-21swapper/123:29:081
339960,0migration/3813-21sh23:30:543
339960,0migration/3326-21sh22:28:083
339960,0migration/325818-21sh22:26:093
339960,0migration/319300-21munin-node19:26:583
339960,0migration/317419-21sh22:20:063
339960,0migration/31192-21sh21:09:313
29715060,0irq/26-eth0-rx-18873-21diskstats22:01:553
249960,0watchdog/22569-21perl22:31:562
149960,0migration/032107-21sh23:07:080
8215050,0irq/24-0000:00:19864-21cat20:16:432
8215050,0irq/24-0000:00:19864-21cat20:16:432
8215050,0irq/24-0000:00:11756-21diskstats19:21:552
34529955,0cyclictest0-21swapper/100:15:391
34529954,0cyclictest2830-21awk22:31:571
34529950,0cyclictest0-21swapper/123:51:121
34529950,0cyclictest0-21swapper/123:32:461
34529950,0cyclictest0-21swapper/123:25:311
34529950,0cyclictest0-21swapper/122:06:501
34529950,0cyclictest0-21swapper/118:57:111
34519955,0cyclictest23544-21kworker/0:222:12:430
34519955,0cyclictest23544-21kworker/0:222:07:290
34519955,0cyclictest23544-21kworker/0:220:48:060
34519955,0cyclictest23544-21kworker/0:220:45:040
34519955,0cyclictest23544-21kworker/0:220:28:280
34519955,0cyclictest23544-21kworker/0:220:16:460
34519955,0cyclictest23544-21kworker/0:220:05:440
34519955,0cyclictest23544-21kworker/0:219:05:380
34519955,0cyclictest23544-21kworker/0:218:57:500
34519955,0cyclictest23544-21kworker/0:218:52:300
34519950,0cyclictest0-21swapper/020:59:520
339950,0migration/3950-21switchtime20:47:053
339950,0migration/3941-21irqcore20:01:593
339950,0migration/38533-21munin-node21:52:053
339950,0migration/37388-21munin-node20:06:543
339950,0migration/36686-21munin-node00:11:593
339950,0migration/36254-21fschecks_time19:41:553
339950,0migration/36139-21kthreadcore23:51:583
339950,0migration/34717-21aten_r1power_cu19:16:543
339950,0migration/33703-21irqcore21:31:573
339950,0migration/33673-21taskset18:51:483
339950,0migration/330600-21unixbench-2d19:32:053
339950,0migration/32961-21irqcore22:31:593
339950,0migration/328945-21kthreadcore22:46:573
339950,0migration/327007-21aten_r1power_vo21:26:543
339950,0migration/326742-21aten_r1power_en21:46:523
339950,0migration/326322-21missed_timers20:42:003
339950,0migration/326240-21gltestperf00:06:543
339950,0migration/325684-21taskset21:44:383
339950,0migration/325242-21latency20:16:593
339950,0migration/320674-21kthreadcore23:41:593
339950,0migration/32026-21irqcore20:26:593
339950,0migration/320206-21kthreadcore23:21:583
339950,0migration/318733-21kthreadcore19:01:583
339950,0migration/318320-21munin-node22:41:543
339950,0migration/317058-21taskset21:38:003
339950,0migration/314899-21latency23:36:573
339950,0migration/313764-21kthreadcore20:57:013
339950,0migration/310018-21aten2.4-expect22:56:533
29725050,0irq/27-eth0-tx-31159-21proc_pri00:07:012
29725050,0irq/27-eth0-tx-27153-21tune2fs21:46:542
29725050,0irq/27-eth0-tx-25469-21ssh23:26:362
29725050,0irq/27-eth0-tx-23596-21ntp_kernel_pll_22:42:012
29725050,0irq/27-eth0-tx-13325-21munin-node20:12:010
29725050,0irq/27-eth0-tx-13325-21munin-node20:12:010
29725050,0irq/27-eth0-tx-12909-21cut21:16:592
29725050,0irq/27-eth0-tx-10635-21munin-node21:36:582
29725050,0irq/27-eth0-tx-0-21swapper/223:59:542
29725050,0irq/27-eth0-tx-0-21swapper/222:57:032
29725050,0irq/27-eth0-tx-0-21swapper/221:32:492
29725050,0irq/27-eth0-tx-0-21swapper/200:05:272
29725050,0irq/27-eth0-tx-0-21swapper/020:00:240
29715050,0irq/26-eth0-rx-4757-21munin-node23:11:583
29715050,0irq/26-eth0-rx-3206-21if_err_eth021:11:563
29715050,0irq/26-eth0-rx-26893-21irqrtprio23:46:563
29715050,0irq/26-eth0-rx-2515-21diskstats22:11:533
29715050,0irq/26-eth0-rx-19821-21kthreadcore21:01:563
29715050,0irq/26-eth0-rx-17438-21ssh00:01:453
29715050,0irq/26-eth0-rx-16899-21ssh22:39:113
29715050,0irq/26-eth0-rx-14219-21cut23:16:593
29715050,0irq/26-eth0-rx-11033-21cut00:16:583
29715050,0irq/26-eth0-rx-0-21swapper/323:01:553
29715050,0irq/26-eth0-rx-0-21swapper/322:51:553
29715050,0irq/26-eth0-rx-0-21swapper/321:56:523
29715050,0irq/26-eth0-rx-0-21swapper/321:23:033
29715050,0irq/26-eth0-rx-0-21swapper/320:56:123
29715050,0irq/26-eth0-rx-0-21swapper/320:12:043
29715050,0irq/26-eth0-rx-0-21swapper/320:12:043
259950,0migration/28701-21sh22:13:082
259950,0migration/232142-21munin-node22:07:032
259950,0migration/228874-21kthreadcore23:06:572
259950,0migration/228539-21taskset22:26:582
259950,0migration/224534-21sh23:03:252
259950,0migration/219093-21idleruntime22:21:552
259950,0migration/21878-21kthreadcore19:36:592
259950,0migration/210513-21aten_r1power_po18:56:542
179950,0migration/19679-21kthreadcore19:17:011
179950,0migration/15298-21taskset19:40:051
179950,0migration/132662-21smart_sdb21:27:041
179950,0migration/130973-21kthreadcore22:46:581
179950,0migration/130393-21munin-node19:11:541
179950,0migration/128576-21kthreadcore00:06:581
179950,0migration/128182-21kthreadcore21:06:581
179950,0migration/124217-21munin-node21:22:001
179950,0migration/123010-21kthreadcore22:41:591
179950,0migration/120802-21idleruntime20:16:561
179950,0migration/116818-21munin-node19:22:011
179950,0migration/114985-21munin-node00:17:021
179950,0migration/113722-21munin-node20:11:561
179950,0migration/113722-21munin-node20:11:561
149950,0migration/0924-21sh23:31:100
149950,0migration/08392-21hddtemp_smartct20:31:560
149950,0migration/05492-21kthreadcore21:31:580
149950,0migration/03016-21irqcore20:51:580
149950,0migration/028862-21kthreadcore19:06:590
149950,0migration/028647-21kthreadcore22:26:580
149950,0migration/028315-21kthreadcore20:21:590
149950,0migration/027718-21irqrtprio21:06:570
149950,0migration/026928-21cpuspeed_turbos21:46:530
149950,0migration/026221-21aten2.4-expect22:46:520
149950,0migration/025715-21taskset22:25:520
149950,0migration/025519-21munin-run23:26:410
149950,0migration/024946-21unixbench-2d19:52:040
149950,0migration/024760-21timerwakeupswit21:22:040
149950,0migration/019343-21irqrtprio22:41:580
149950,0migration/018518-21taskset19:48:280
149950,0migration/018111-21sh21:20:290
149950,0migration/017612-21aten_r1power_vo00:01:530
149950,0migration/015083-21munin-node20:36:540
149950,0migration/014957-21kthreadcore19:21:590
149950,0migration/011982-21taskset19:44:320
149950,0migration/010651-21fschecks_time22:36:550
8215040,0irq/24-0000:00:0-21swapper/221:01:422
34539943,0cyclictest7571-21awk20:06:552
34539943,0cyclictest724-21awk20:01:572
34539943,0cyclictest6569-21awk19:41:572
34539943,0cyclictest3514-21snmpd21:26:492
34539943,0cyclictest3514-21snmpd20:40:042
34539943,0cyclictest3514-21snmpd19:08:332
34539943,0cyclictest26609-21awk23:46:552
34539943,0cyclictest19372-21awk22:01:572
34539943,0cyclictest18900-21awk19:26:562
34529944,0cyclictest0-21swapper/121:47:361
34529944,0cyclictest0-21swapper/100:02:051
34529943,0cyclictest6535-21awk19:41:571
34529943,0cyclictest3556-21lldpd19:35:101
34529943,0cyclictest3514-21snmpd23:02:191
34529943,0cyclictest3514-21snmpd20:50:491
34529943,0cyclictest3491-21awk21:31:571
34529943,0cyclictest2992-21awk22:11:551
34529943,0cyclictest26920-21awk23:06:561
34529943,0cyclictest17635-21sadc23:01:411
34519944,0cyclictest23544-21kworker/0:222:00:150
34519944,0cyclictest23544-21kworker/0:221:40:550
34519944,0cyclictest23544-21kworker/0:200:18:030
34519943,0cyclictest5599-21awk19:16:580
34519943,0cyclictest3556-21lldpd23:46:080
34519943,0cyclictest3556-21lldpd21:43:390
34519943,0cyclictest3556-21lldpd21:12:390
34519943,0cyclictest2931-21awk22:31:580
34519943,0cyclictest2451-21awk23:11:550
34519943,0cyclictest23544-21kworker/0:222:21:330
34519943,0cyclictest18850-21awk23:01:550
34519943,0cyclictest10813-21awk22:56:570
34519940,0cyclictest0-21swapper/023:53:550
339940,0migration/330919-21fschecks_time19:11:563
339940,0migration/330056-21kthreadcore20:22:003
339940,0migration/314682-21kthreadcore18:57:003
339940,0migration/31461-21aten2.4-expect23:31:523
339940,0migration/314361-21aten_r1power_en20:36:513
339940,0migration/310638-21latency_hist21:16:423
29725040,0irq/27-eth0-tx-8576-21ssh21:52:092
29725040,0irq/27-eth0-tx-5936-21cut22:51:592
29725040,0irq/27-eth0-tx-30228-21taskset23:26:592
29725040,0irq/27-eth0-tx-2320-21ssh21:11:492
29725040,0irq/27-eth0-tx-0-21swapper/223:31:512
29725040,0irq/27-eth0-tx-0-21swapper/223:16:582
29725040,0irq/27-eth0-tx-0-21swapper/223:11:462
29725040,0irq/27-eth0-tx-0-21swapper/222:46:522
29725040,0irq/27-eth0-tx-0-21swapper/222:16:482
29725040,0irq/27-eth0-tx-0-21swapper/221:57:492
29725040,0irq/27-eth0-tx-0-21swapper/221:41:462
29725040,0irq/27-eth0-tx-0-21swapper/221:21:422
29725040,0irq/27-eth0-tx-0-21swapper/221:06:542
29725040,0irq/27-eth0-tx-0-21swapper/200:17:032
29715040,0irq/26-eth0-rx-9436-21munin-node23:57:003
29715040,0irq/26-eth0-rx-0-21swapper/323:06:563
29715040,0irq/26-eth0-rx-0-21swapper/322:09:263
29715040,0irq/26-eth0-rx-0-21swapper/319:48:413
259940,0migration/28142-21fschecks_count20:31:552
259940,0migration/24398-21gltestperf18:51:552
259940,0migration/230654-21kthreadcore20:22:002
259940,0migration/229257-21kthreadcore19:57:002
259940,0migration/22468-21irqcore23:51:572
259940,0migration/219197-21kthreadcore23:41:592
259940,0migration/218556-21kthreadcore19:01:582
259940,0migration/210697-21fschecks_time22:36:552
249940,0watchdog/27118-21sed00:12:042
249940,0watchdog/227743-21cut20:46:522
249940,0watchdog/20-21swapper/220:57:002
249940,0watchdog/20-21swapper/220:54:122
19140,0ktimersoftd/10-21swapper/120:35:051
179940,0migration/18798-21sh20:54:291
179940,0migration/15361-21missed_timers20:02:011
179940,0migration/12849-21fschecks_count21:51:551
179940,0migration/12677-21kthreadcore23:51:571
179940,0migration/125255-21runrttasks19:54:071
179940,0migration/122793-21kthreadcore20:41:581
179940,0migration/120939-21kthreadcore22:21:571
179940,0migration/119890-21kthreadcore19:26:581
179940,0migration/11926-21df_abs23:11:531
179940,0migration/117350-21cpuspeed_turbos19:01:531
179940,0migration/117329-21latency_hist00:01:411
179940,0migration/116017-21kthreadcore19:46:581
179940,0migration/113165-21kthreadcore22:36:591
179940,0migration/113091-21kthreadcore22:16:581
179940,0migration/112665-21kthreadcore21:57:001
179940,0migration/111360-21fschecks_time21:16:561
179940,0migration/110606-21kthreadcore20:06:581
169940,0watchdog/130308-21kthreadcore19:57:011
169940,0watchdog/120750-21kthreadcore21:01:561
169940,0watchdog/119138-21sort21:41:561
169940,0watchdog/118370-21gltestperf23:41:561
169940,0watchdog/11651-21diskmemload22:56:281
169940,0watchdog/116025-21grep20:36:561
169940,0watchdog/113183-21kthreadcore21:37:001
169940,0watchdog/10-21swapper/123:36:561
169940,0watchdog/10-21swapper/122:28:361
169940,0watchdog/10-21swapper/120:27:001
149940,0migration/08076-21sh21:52:030
149940,0migration/05019-21kthreadcore00:11:580
149940,0migration/04714-21kthreadcore22:51:590
149940,0migration/025855-21aten_r1power_vo23:46:520
149940,0migration/020006-21kthreadcore21:01:560
149940,0migration/016704-21sh00:00:180
8215030,0irq/24-0000:00:0-21swapper/219:56:432
34539932,0cyclictest7770-21kthreadcore19:17:002
34539932,0cyclictest3514-21snmpd20:41:492
34539932,0cyclictest3514-21snmpd19:36:192
34539932,0cyclictest20851-21awk20:16:562
34539932,0cyclictest13673-21irqstats19:46:572
34529933,0cyclictest10569-21awk23:16:561
34529932,0cyclictest8211-21sensors21:12:031
34529932,0cyclictest26699-21aten_r1power_en20:21:541
34519933,0cyclictest23544-21kworker/0:223:31:510
34519933,0cyclictest23544-21kworker/0:223:16:430
34519933,0cyclictest23544-21kworker/0:221:26:570
34519933,0cyclictest23544-21kworker/0:220:06:520
34519933,0cyclictest23544-21kworker/0:219:37:000
34519933,0cyclictest23544-21kworker/0:200:06:490
34519932,0cyclictest3676-21which19:12:040
34519932,0cyclictest25597-21awk19:31:570
34519932,0cyclictest21625-21sed22:01:590
34519932,0cyclictest10521-21awk23:36:550
339930,0migration/327840-21kthreadcore19:06:593
29725030,0irq/27-eth0-tx-0-21swapper/019:26:530
29715030,0irq/26-eth0-rx-0-21swapper/320:31:433
29715030,0irq/26-eth0-rx-0-21swapper/319:56:553
29715030,0irq/26-eth0-rx-0-21swapper/319:51:463
29715030,0irq/26-eth0-rx-0-21swapper/319:21:533
249930,0watchdog/20-21swapper/220:27:002
179930,0migration/130082-21runrttasks19:11:201
179930,0migration/124580-21unixbench_singl22:02:051
339920,0migration/332371-21iostat_ios19:36:583
169920,0watchdog/10-21swapper/118:51:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional