You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 02:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Sep 17, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450970,0irq/25-eth10-21swapper/318:43:213
1096625453,0sleep00-21swapper/018:38:580
1637223523,0sleep20-21swapper/218:42:242
1624623324,0sleep10-21swapper/118:40:551
339960,0migration/332284-21irqcore21:13:593
339960,0migration/330515-21sh20:52:543
339960,0migration/324871-21kthreadcore21:08:583
339960,0migration/322269-21sh21:28:123
339960,0migration/320299-21sh22:26:563
339960,0migration/319922-21munin-node21:44:023
339960,0migration/319173-21sh22:44:583
29715060,0irq/26-eth0-rx-8146-21sed20:38:423
29715060,0irq/26-eth0-rx-29380-21kthreadcore19:13:583
19160,0ktimersoftd/10-21swapper/123:41:261
165599966,0cyclictest0-21swapper/222:23:252
165599960,0cyclictest0-21swapper/223:29:012
8215050,0irq/24-0000:00:24161-21perf19:13:422
4150,0ktimersoftd/00-21swapper/023:43:530
339950,0migration/39951-21sendmail_mailtr22:59:023
339950,0migration/37927-21kthreadcore21:58:583
339950,0migration/35744-21kthreadcore23:18:583
339950,0migration/35681-21kernelversion18:58:563
339950,0migration/332228-21aten_r1power_vo19:43:533
339950,0migration/332213-21kthreadcore22:13:563
339950,0migration/331493-21munin-node20:53:533
339950,0migration/328257-21kthreadcore20:03:583
339950,0migration/320682-21kthreadcore19:33:583
339950,0migration/32011-21runrttasks23:14:383
339950,0migration/319836-21munin-node20:19:053
339950,0migration/319461-21taskset19:58:233
339950,0migration/317099-21kthreadcore20:43:593
339950,0migration/316660-21processes19:04:023
339950,0migration/314266-21kthreadcore23:43:573
339950,0migration/313963-21sh21:22:043
339950,0migration/313364-21kernelversion19:28:573
339950,0migration/312492-21taskset19:50:033
339950,0migration/310616-21latency22:18:593
29725050,0irq/27-eth0-tx-6377-21munin-node19:49:050
29725050,0irq/27-eth0-tx-4402-21munin-node18:58:570
29725050,0irq/27-eth0-tx-3974-21ssh21:54:172
29725050,0irq/27-eth0-tx-31638-21grep22:33:572
29725050,0irq/27-eth0-tx-31113-21munin-node20:53:592
29725050,0irq/27-eth0-tx-30275-21kthreadcore22:53:562
29725050,0irq/27-eth0-tx-24918-21vmstat00:09:042
29725050,0irq/27-eth0-tx-21251-21ssh20:44:330
29725050,0irq/27-eth0-tx-173792chrt23:44:032
29725050,0irq/27-eth0-tx-16767-21munin-node18:44:050
29725050,0irq/27-eth0-tx-14578-21ssh21:03:062
29725050,0irq/27-eth0-tx-10459-21ssh23:42:152
29725050,0irq/27-eth0-tx-0-21swapper/222:42:512
29725050,0irq/27-eth0-tx-0-21swapper/222:30:112
29725050,0irq/27-eth0-tx-0-21swapper/222:03:422
29725050,0irq/27-eth0-tx-0-21swapper/221:23:262
29715050,0irq/26-eth0-rx-6998-21cut23:39:023
29715050,0irq/26-eth0-rx-6690-21df_abs21:38:533
29715050,0irq/26-eth0-rx-4730-21cut20:08:583
29715050,0irq/26-eth0-rx-31447-21idleruntime21:33:543
29715050,0irq/26-eth0-rx-22452-21hwlatdetect22:08:553
29715050,0irq/26-eth0-rx-16101-21if_eth1.221:03:563
29715050,0irq/26-eth0-rx-0-21swapper/323:57:243
29715050,0irq/26-eth0-rx-0-21swapper/323:34:013
29715050,0irq/26-eth0-rx-0-21swapper/323:25:293
29715050,0irq/26-eth0-rx-0-21swapper/323:07:423
29715050,0irq/26-eth0-rx-0-21swapper/322:38:443
29715050,0irq/26-eth0-rx-0-21swapper/322:30:033
29715050,0irq/26-eth0-rx-0-21swapper/321:57:263
29715050,0irq/26-eth0-rx-0-21swapper/321:31:263
27150,0ktimersoftd/20-21swapper/222:44:242
259950,0migration/24666-21sh22:17:532
259950,0migration/22901-21aten2.4-expect23:58:522
259950,0migration/211556-21latency_hist23:23:402
259950,0migration/210171-21timerandwakeup18:59:022
179950,0migration/15203-21taskset21:36:171
179950,0migration/132009-21kthreadcore22:33:571
179950,0migration/128119-21missed_timers21:28:591
179950,0migration/127137-21munin-node20:03:551
179950,0migration/125547-21taskset23:09:001
179950,0migration/124208-21missed_timers00:08:591
179950,0migration/117903-21munin-node23:04:011
179950,0migration/114323-21aten_r1power_po21:43:531
179950,0migration/111621-21taskset19:26:111
179950,0migration/110262-21timerwakeupswit18:59:021
165599955,0cyclictest0-21swapper/223:38:192
165599950,0cyclictest0-21swapper/223:53:362
165599950,0cyclictest0-21swapper/223:15:272
165599950,0cyclictest0-21swapper/221:49:032
165599950,0cyclictest0-21swapper/219:13:552
165589955,0cyclictest0-21swapper/122:06:411
165589955,0cyclictest0-21swapper/121:03:091
165589950,0cyclictest0-21swapper/123:55:191
165589950,0cyclictest0-21swapper/122:01:571
165589950,0cyclictest0-21swapper/121:57:141
165589950,0cyclictest0-21swapper/119:33:451
165579955,0cyclictest0-21swapper/023:58:230
165579954,0cyclictest3556-21lldpd21:05:470
165579954,0cyclictest22206-21sed22:28:590
165579954,0cyclictest21472-21sh21:25:460
165579950,0cyclictest0-21swapper/023:17:040
165579950,0cyclictest0-21swapper/021:43:350
165579950,0cyclictest0-21swapper/021:32:420
165579950,0cyclictest0-21swapper/000:10:310
169950,0watchdog/11233-21grep21:14:001
149950,0migration/09086-21kthreadcore22:58:590
149950,0migration/07498-21kthreadcore21:58:570
149950,0migration/06354-21kthreadcore23:18:580
149950,0migration/0595-21kthreadcore18:53:590
149950,0migration/04623-21sh21:34:350
149950,0migration/026590-21unixbench-2d20:24:050
149950,0migration/025952-21sh23:50:450
149950,0migration/02163-21kthreadcore19:43:580
149950,0migration/014757-21irqcore22:03:560
149950,0migration/013011-21unixbench_singl20:59:040
149950,0migration/012802-21timerwakeupswit21:19:020
339940,0migration/38800-21fschecks_count20:38:563
339940,0migration/331434-21taskset19:39:053
339940,0migration/328671-21sh21:50:163
339940,0migration/320207-21aten_r1power_po23:08:533
339940,0migration/318766-21diskmemload00:08:433
339940,0migration/317397-21fschecks_time18:43:553
339940,0migration/310889-21aten_r1power_fr00:03:543
29725040,0irq/27-eth0-tx-23217-21ssh21:08:452
29725040,0irq/27-eth0-tx-20689-21munin-node22:48:582
29725040,0irq/27-eth0-tx-13648-21ssh22:03:502
29725040,0irq/27-eth0-tx-10805-21munin-node00:03:552
29725040,0irq/27-eth0-tx-0-21swapper/223:08:502
29725040,0irq/27-eth0-tx-0-21swapper/222:59:022
29725040,0irq/27-eth0-tx-0-21swapper/221:43:442
29725040,0irq/27-eth0-tx-0-21swapper/221:38:462
29725040,0irq/27-eth0-tx-0-21swapper/221:33:462
29725040,0irq/27-eth0-tx-0-21swapper/221:28:492
29725040,0irq/27-eth0-tx-0-21swapper/221:23:422
29715040,0irq/26-eth0-rx-9400-21kthreadcore19:23:593
29715040,0irq/26-eth0-rx-25385-21yum23:49:053
29715040,0irq/26-eth0-rx-23076-21kthreadcore19:58:583
29715040,0irq/26-eth0-rx-0-21swapper/323:59:223
29715040,0irq/26-eth0-rx-0-21swapper/323:29:193
29715040,0irq/26-eth0-rx-0-21swapper/322:53:473
29715040,0irq/26-eth0-rx-0-21swapper/322:49:173
29715040,0irq/26-eth0-rx-0-21swapper/322:37:173
29715040,0irq/26-eth0-rx-0-21swapper/322:03:423
29715040,0irq/26-eth0-rx-0-21swapper/320:59:013
29715040,0irq/26-eth0-rx-0-21swapper/320:28:593
29715040,0irq/26-eth0-rx-0-21swapper/320:23:593
29715040,0irq/26-eth0-rx-0-21swapper/320:13:533
259940,0migration/26413-21irqcore19:23:582
259940,0migration/231577-21kthreadcore23:53:582
259940,0migration/22818-21kthreadcore20:08:582
259940,0migration/226521-21aten_r1power_po20:03:532
259940,0migration/226402-21runrttasks20:24:042
259940,0migration/223616-21fschecks_time20:48:562
259940,0migration/222041-21kthreadcore19:58:582
259940,0migration/221895-21cpuspeed_turbos22:08:532
259940,0migration/220715-21kthreadcore19:33:582
259940,0migration/217572-21kthreadcore21:03:572
259940,0migration/213635-21kthreadcore19:28:582
259940,0migration/212882-21kthreadcore19:03:582
259940,0migration/21068-21kthreadcore19:43:582
249940,0watchdog/230457-21kthreadcore20:29:002
249940,0watchdog/217699-21awk18:43:562
249940,0watchdog/213143-21iostat23:03:552
249940,0watchdog/2130512sleep219:53:522
249940,0watchdog/21228-21ssh21:14:002
249940,0watchdog/20-21swapper/223:18:592
249940,0watchdog/20-21swapper/220:39:002
249940,0watchdog/20-21swapper/218:53:562
179940,0migration/19639-21kthreadcore22:18:591
179940,0migration/1636-21aten_r1power_en20:08:521
179940,0migration/13744-21sh22:15:081
179940,0migration/12938-21kthreadcore20:33:571
179940,0migration/128813-21kthreadcore20:28:591
179940,0migration/128581-21runrttasks22:32:581
179940,0migration/124302-21kthreadcore20:23:591
179940,0migration/123182-21latency_hist21:08:421
179940,0migration/122411-21cpuspeed_turbos21:48:571
179940,0migration/117537-21sh19:29:011
179940,0migration/115478-21kthreadcore20:18:591
179940,0migration/111573-21kthreadcore21:18:571
165599943,0cyclictest7352-21awk19:49:002
165599943,0cyclictest3556-21lldpd20:44:162
165599943,0cyclictest3556-21lldpd19:41:152
165599943,0cyclictest3556-21lldpd19:22:162
165599943,0cyclictest2427-21awk20:33:552
165599943,0cyclictest24258-21awk18:48:572
165599942,0cyclictest18112-21kthreadcore22:23:582
165589944,0cyclictest0-21swapper/123:17:571
165589943,0cyclictest8232-21awk20:13:551
165589943,0cyclictest3514-21snmpd22:44:481
165589943,0cyclictest3514-21snmpd22:28:031
165589943,0cyclictest3241-21irqbalance23:44:191
165589943,0cyclictest3241-21irqbalance21:03:501
165589943,0cyclictest32048-21awk20:53:551
165589943,0cyclictest32013-21awk19:18:581
165589943,0cyclictest29818-21sadc18:53:421
165589943,0cyclictest26290-21awk19:38:551
165589943,0cyclictest17620-21awk18:43:561
165589943,0cyclictest16032-21awk20:43:571
165589943,0cyclictest13889-21awk19:53:561
165589943,0cyclictest12818-21sadc19:53:421
165589943,0cyclictest12634-21awk23:23:551
165589943,0cyclictest11981-21awk19:03:571
165579943,0cyclictest9225-21awk20:38:580
165579943,0cyclictest8249-21awk20:13:550
165579943,0cyclictest3556-21lldpd21:44:180
165579943,0cyclictest3556-21lldpd20:51:470
165579943,0cyclictest3514-21snmpd19:53:480
165579943,0cyclictest3241-21irqbalance23:59:290
165579943,0cyclictest3241-21irqbalance23:39:290
165579943,0cyclictest3241-21irqbalance23:23:490
165579943,0cyclictest3241-21irqbalance22:58:090
165579943,0cyclictest3241-21irqbalance22:43:500
165579943,0cyclictest3241-21irqbalance22:41:300
165579943,0cyclictest3241-21irqbalance22:18:500
165579943,0cyclictest3241-21irqbalance22:15:000
165579943,0cyclictest3241-21irqbalance21:54:400
165579943,0cyclictest3241-21irqbalance20:58:200
165579943,0cyclictest3241-21irqbalance20:04:300
165579943,0cyclictest3241-21irqbalance19:58:500
165579943,0cyclictest3241-21irqbalance19:33:500
165579943,0cyclictest3241-21irqbalance19:24:100
165579943,0cyclictest3241-21irqbalance19:19:300
165579943,0cyclictest3241-21irqbalance19:14:300
165579943,0cyclictest3241-21irqbalance19:04:400
165579943,0cyclictest29821-21sadc21:53:420
165579943,0cyclictest27823-21sadc23:13:400
165579943,0cyclictest14200-21awk22:23:560
165579943,0cyclictest13011-21awk19:28:560
169940,0watchdog/19036-21kthreadcore23:18:591
169940,0watchdog/15516-21cat22:38:551
169940,0watchdog/130860-21idleruntime18:53:561
169940,0watchdog/128890-21grep22:53:511
169940,0watchdog/120996-21sshd21:24:201
169940,0watchdog/119624-21ssh23:28:431
169940,0watchdog/118027-21ssh00:07:111
169940,0watchdog/110887-21ssh23:00:471
169940,0watchdog/10-21swapper/123:50:591
169940,0watchdog/10-21swapper/123:33:591
169940,0watchdog/10-21swapper/121:38:561
169940,0watchdog/10-21swapper/120:39:001
169940,0watchdog/10-21swapper/119:13:521
149940,0migration/032508-21kthreadcore23:33:590
149940,0migration/029158-21kthreadcore19:38:580
149940,0migration/027666-21kthreadcore18:49:000
149940,0migration/026090-21kthreadcore22:08:590
149940,0migration/026009-21latency22:49:000
149940,0migration/024318-21kthreadcore23:28:580
149940,0migration/02361-21kthreadcore20:08:570
149940,0migration/019673-21taskset20:19:030
149940,0migration/017969-21cpu19:08:530
149940,0migration/017108-21taskset00:04:260
149940,0migration/014479-21kthreadcore23:03:560
35130,0ktimersoftd/30-21swapper/319:20:453
29715030,0irq/26-eth0-rx-0-21swapper/318:54:183
29715030,0irq/26-eth0-rx-0-21swapper/318:48:433
19130,0ktimersoftd/128301-21ssh22:10:371
179930,0migration/123504-21fschecks_count20:48:561
165599932,0cyclictest13283-21grep20:14:032
165599931,0cyclictest17446-21kthreadcore20:18:592
165589932,0cyclictest5541-21cut23:58:571
165589932,0cyclictest1145-21cat19:43:581
165579933,0cyclictest29944-21kworker/0:221:11:330
165579932,0cyclictest30386-21sed22:33:560
165579932,0cyclictest28210-21awk20:28:570
165579932,0cyclictest2548-21awk20:33:560
169930,0watchdog/10-21swapper/122:48:551
169930,0watchdog/10-21swapper/120:03:321
149930,0migration/031223-21runrttasks21:13:520
339920,0migration/318147-21diskstats19:08:543
169920,0watchdog/10-21swapper/119:08:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional