You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 11:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Aug 07, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
271620,0ktimersoftd/211911-21perf18:47:262
304450550,0irq/25-eth10-21swapper/318:43:193
1845023324,0sleep10-21swapper/118:47:241
1807922622,0sleep00-21swapper/018:43:030
4160,0ktimersoftd/030747-21ssh21:34:410
339960,0migration/39634-21kthreadcore21:42:523
339960,0migration/33801-21sh22:59:263
339960,0migration/329313-21switchtime21:52:593
339960,0migration/328896-21sh22:34:323
339960,0migration/327017-21munin-node22:52:563
339960,0migration/315337-21sh21:25:543
339960,0migration/314007-21cpuspeed_turbos22:47:473
29725060,0irq/27-eth0-tx-2612-21munin-node20:12:540
29725060,0irq/27-eth0-tx-25429-21munin-node18:52:560
29715060,0irq/26-eth0-rx-16641-21perl20:22:503
259960,0migration/21153-21kthreadcore21:57:532
185449966,0cyclictest0-21swapper/222:47:562
185419966,0cyclictest0-21swapper/021:40:310
185419960,0cyclictest0-21swapper/023:21:250
149960,0migration/027152-21sh23:34:520
149960,0migration/014450-21sh21:23:100
149960,0migration/013044-21sh22:24:270
8215050,0irq/24-0000:00:28109-21sadc20:07:362
4150,0ktimersoftd/00-21swapper/021:03:560
339950,0migration/38018-21kthreadcore22:42:533
339950,0migration/37696-21sh21:21:433
339950,0migration/36936-21fschecks_count22:22:493
339950,0migration/36795-21taskset19:23:583
339950,0migration/36173-21pmu-power20:58:013
339950,0migration/33747-21fschecks_count00:02:493
339950,0migration/332476-21taskset19:18:523
339950,0migration/3306-21kthreadcore23:37:543
339950,0migration/330548-21kthreadcore23:17:533
339950,0migration/327492-21kthreadcore21:12:533
339950,0migration/326371-21kthreadcore20:52:513
339950,0migration/325995-21fschecks_time18:52:503
339950,0migration/325481-21munin-node19:12:583
339950,0migration/323633-21taskset21:10:093
339950,0migration/322990-21taskset20:27:463
339950,0migration/321546-21munin-node21:27:553
339950,0migration/318679-21kthreadcore20:47:523
339950,0migration/318082-21kthreadcore21:47:523
339950,0migration/317829-21kthreadcore19:32:543
339950,0migration/315843-21munin-node22:07:513
339950,0migration/31570-21rt-features20:07:563
339950,0migration/315129-21gltestperf22:27:503
339950,0migration/314506-21taskset19:55:083
339950,0migration/313409-21kthreadcore00:07:533
339950,0migration/312233-21kthreadcore21:02:543
339950,0migration/311539-21kthreadcore19:27:543
29725050,0irq/27-eth0-tx-9296-21interrupts21:22:522
29725050,0irq/27-eth0-tx-7049-21munin-node22:02:582
29725050,0irq/27-eth0-tx-6440-21munin-node22:22:512
29725050,0irq/27-eth0-tx-4778-21cpuspeed_turbos23:22:472
29725050,0irq/27-eth0-tx-407-21munin-node20:58:022
29725050,0irq/27-eth0-tx-27874-21cpu23:57:482
29725050,0irq/27-eth0-tx-24072-21munin-node21:32:482
29725050,0irq/27-eth0-tx-17199-21iostat21:27:532
29725050,0irq/27-eth0-tx-16036-21munin-node20:22:530
29725050,0irq/27-eth0-tx-0-21swapper/223:33:412
29725050,0irq/27-eth0-tx-0-21swapper/222:30:102
29725050,0irq/27-eth0-tx-0-21swapper/222:18:272
29725050,0irq/27-eth0-tx-0-21swapper/222:08:142
29725050,0irq/27-eth0-tx-0-21swapper/220:55:252
29725050,0irq/27-eth0-tx-0-21swapper/200:04:102
29725050,0irq/27-eth0-tx-0-21swapper/019:12:470
29715050,0irq/26-eth0-rx-5122-21ssh23:02:463
29715050,0irq/26-eth0-rx-30834-21kthreadcore23:57:543
29715050,0irq/26-eth0-rx-18888-21kthreadcore19:57:533
29715050,0irq/26-eth0-rx-18675-21gzip19:07:573
29715050,0irq/26-eth0-rx-15628-21kthreadcore23:27:543
29715050,0irq/26-eth0-rx-11600-21latency_hist23:47:353
29715050,0irq/26-eth0-rx-10379-21aten_r1power_cu20:42:473
29715050,0irq/26-eth0-rx-0-21swapper/323:53:493
29715050,0irq/26-eth0-rx-0-21swapper/323:33:383
29715050,0irq/26-eth0-rx-0-21swapper/322:37:523
29715050,0irq/26-eth0-rx-0-21swapper/322:17:303
29715050,0irq/26-eth0-rx-0-21swapper/322:02:523
29715050,0irq/26-eth0-rx-0-21swapper/322:00:273
29715050,0irq/26-eth0-rx-0-21swapper/321:40:073
29715050,0irq/26-eth0-rx-0-21swapper/320:37:543
29715050,0irq/26-eth0-rx-0-21swapper/300:14:373
259950,0migration/26294-21irqcore23:02:512
259950,0migration/229065-21gltestperf23:37:492
259950,0migration/219619-21kthreadcore21:07:542
259950,0migration/218868-21kthreadcore19:32:542
259950,0migration/218023-21munin-node23:27:552
259950,0migration/21518-21kthreadcore21:37:522
249950,0watchdog/24402-21fschecks_count23:42:492
185449954,0cyclictest3514-21snmpd21:57:282
185449950,0cyclictest0-21swapper/222:54:522
185449950,0cyclictest0-21swapper/221:51:292
185439950,0cyclictest0-21swapper/123:46:381
185419955,0cyclictest0-21swapper/022:53:020
185419954,0cyclictest28317-21awk19:42:520
185419950,0cyclictest0-21swapper/023:02:580
185419950,0cyclictest0-21swapper/021:52:110
185419950,0cyclictest0-21swapper/021:29:380
185419950,0cyclictest0-21swapper/018:57:480
179950,0migration/15224-21aten_r1power_po23:02:461
179950,0migration/14202-21run-parts22:38:351
179950,0migration/13934-21missed_timers22:17:561
179950,0migration/13047-21kthreadcore19:47:531
179950,0migration/119931-21munin-node22:27:571
169950,0watchdog/19611-21kthreadcore21:22:541
169950,0watchdog/18910-21kthreadcore22:22:541
169950,0watchdog/128128-21hddtemp_smartct19:42:501
149950,0migration/09131-21ntp_offset20:37:550
149950,0migration/08557-21cpuspeed_turbos19:52:470
149950,0migration/03716-21taskset22:59:110
149950,0migration/032754-21latency_hist20:57:360
149950,0migration/032734-21aten_r1power_fr21:17:480
149950,0migration/032595-21kthreadcore23:57:540
149950,0migration/031465-21fschecks_time22:17:510
149950,0migration/031112-21kthreadcore20:32:510
149950,0migration/026884-21kthreadcore21:52:530
149950,0migration/026451-21kthreadcore21:12:520
149950,0migration/025705-21kthreadcore22:12:520
149950,0migration/025356-21kthreadcore20:27:510
149950,0migration/025211-21kthreadcore20:02:510
149950,0migration/022202-21missed_timers21:07:550
149950,0migration/022009-21kthreadcore18:47:530
149950,0migration/020699-21aten_r1power_cu19:37:480
149950,0migration/018914-21kthreadcore20:47:520
149950,0migration/017260-21kthreadcore23:07:520
149950,0migration/016568-21kthreadcore00:07:540
149950,0migration/015570-21kthreadcore19:32:530
149950,0migration/01437-21munin-node20:07:560
149950,0migration/013326-21kthreadcore23:47:510
149950,0migration/010986-21sh23:23:560
339940,0migration/38258-21proc_pri20:12:593
339940,0migration/37781-21taskset19:49:033
339940,0migration/312336-21kthreadcore20:17:513
339940,0migration/311185-21kthreadcore19:02:543
29725040,0irq/27-eth0-tx-5769-21ssh22:42:412
29725040,0irq/27-eth0-tx-27197-21ssh23:13:102
29725040,0irq/27-eth0-tx-0-21swapper/223:52:592
29725040,0irq/27-eth0-tx-0-21swapper/223:07:452
29725040,0irq/27-eth0-tx-0-21swapper/222:39:002
29725040,0irq/27-eth0-tx-0-21swapper/222:13:092
29725040,0irq/27-eth0-tx-0-21swapper/221:42:392
29725040,0irq/27-eth0-tx-0-21swapper/221:17:432
29725040,0irq/27-eth0-tx-0-21swapper/221:12:402
29725040,0irq/27-eth0-tx-0-21swapper/200:13:332
29725040,0irq/27-eth0-tx-0-21swapper/019:22:470
29725040,0irq/27-eth0-tx-0-21swapper/019:17:540
29715040,0irq/26-eth0-rx-4570-21fschecks_time23:42:493
29715040,0irq/26-eth0-rx-21006-21aten_r1power_cu23:12:453
29715040,0irq/26-eth0-rx-19047-21expr18:47:483
29715040,0irq/26-eth0-rx-0-21swapper/323:09:153
29715040,0irq/26-eth0-rx-0-21swapper/322:17:493
29715040,0irq/26-eth0-rx-0-21swapper/321:33:273
29715040,0irq/26-eth0-rx-0-21swapper/320:37:273
29715040,0irq/26-eth0-rx-0-21swapper/318:57:543
259940,0migration/24680-21irqcore20:37:522
259940,0migration/231184-21kthreadcore23:17:532
259940,0migration/229480-21runrttasks20:32:462
259940,0migration/216226-21kthreadcore00:07:542
259940,0migration/216169-21aten_r1power_vo20:22:482
259940,0migration/212684-21idleruntime23:47:482
259940,0migration/212072-21kthreadcore20:17:512
249940,0watchdog/23874-21sed20:12:542
249940,0watchdog/20-21swapper/221:02:502
249940,0watchdog/20-21swapper/220:47:502
185449943,0cyclictest7304-21awk19:02:522
185449943,0cyclictest3556-21lldpd19:52:372
185449943,0cyclictest3556-21lldpd19:28:372
185449943,0cyclictest3556-21lldpd19:21:062
185449943,0cyclictest3556-21lldpd18:55:362
185449943,0cyclictest3514-21snmpd22:59:142
185449943,0cyclictest3514-21snmpd19:26:432
185449943,0cyclictest3514-21snmpd19:00:282
185449943,0cyclictest29195-21awk20:07:502
185449943,0cyclictest23205-21awk22:32:502
185449943,0cyclictest19734-21awk18:47:512
185449943,0cyclictest16781-21sh20:47:362
185439943,0cyclictest9283-21awk19:52:501
185439943,0cyclictest3594-21awk20:12:531
185439943,0cyclictest3556-21lldpd19:31:361
185439943,0cyclictest3514-21snmpd23:34:291
185439943,0cyclictest3514-21snmpd20:48:281
185439943,0cyclictest32402-21awk21:57:511
185439943,0cyclictest30301-21awk20:32:501
185439943,0cyclictest26281-21awk18:52:511
185439943,0cyclictest22555-21awk20:02:491
185439943,0cyclictest21924-21awk23:12:501
185439943,0cyclictest17645-21awk21:07:511
185439943,0cyclictest15847-21awk19:57:501
185439943,0cyclictest1317-21awk20:57:541
185439943,0cyclictest12263-21awk00:07:521
185439943,0cyclictest10226-21awk20:17:491
185439940,0cyclictest16787-21diskmemload21:45:521
185439940,0cyclictest0-21swapper/122:15:591
185419944,0cyclictest0-21swapper/019:47:570
185419944,0cyclictest0-21swapper/000:16:170
185419943,0cyclictest3556-21lldpd20:53:380
185419943,0cyclictest3514-21snmpd23:40:140
185419943,0cyclictest3514-21snmpd22:44:290
185419943,0cyclictest3241-21irqbalance23:47:230
185419943,0cyclictest31179-21awk22:37:500
185419943,0cyclictest21327-21kworker/0:222:07:310
185419943,0cyclictest13358-21awk23:27:510
179940,0migration/18864-21kthreadcore23:22:521
179940,0migration/17151-21kthreadcore20:37:531
179940,0migration/17149-21gltestperf19:02:501
179940,0migration/17002-21kthreadcore00:02:531
179940,0migration/14748-21kthreadcore18:57:541
179940,0migration/14200-21kthreadcore21:37:521
179940,0migration/131142-21runrttasks21:13:531
179940,0migration/128884-21fschecks_time20:07:491
179940,0migration/128654-21cpuspeed_turbos23:37:481
179940,0migration/123970-21kthreadcore18:47:531
179940,0migration/122467-21latency_hist20:27:361
179940,0migration/119424-21kthreadcore21:47:531
179940,0migration/119128-21latency_hist00:12:351
179940,0migration/117219-21kthreadcore22:07:531
179940,0migration/11025-21hddtemp_smartct21:17:501
169940,0watchdog/18854-21kthreadcore22:42:531
169940,0watchdog/131298-21cat22:57:531
169940,0watchdog/130295-21netstat20:52:541
169940,0watchdog/128031-21kthreadcore21:52:541
169940,0watchdog/127619-21kthreadcore21:32:541
169940,0watchdog/126921-21sh23:56:051
169940,0watchdog/123288-21kthreadcore19:37:541
169940,0watchdog/121785-21ls21:27:581
169940,0watchdog/121662-21ssh22:52:411
169940,0watchdog/116787-21diskmemload23:18:251
169940,0watchdog/114635-21if_err_eth1.222:47:491
169940,0watchdog/112756-21sendmail_mailqu22:02:581
169940,0watchdog/10-21swapper/123:27:491
169940,0watchdog/10-21swapper/121:02:501
149940,0migration/09593-21kthreadcore21:42:520
149940,0migration/09083-21kthreadcore19:27:530
149940,0migration/025218-21kthreadcore22:32:530
149940,0migration/013503-21kthreadcore20:42:530
29715030,0irq/26-eth0-rx-0-21swapper/323:22:463
29715030,0irq/26-eth0-rx-0-21swapper/320:02:463
29715030,0irq/26-eth0-rx-0-21swapper/319:42:503
29715030,0irq/26-eth0-rx-0-21swapper/319:37:493
185449932,0cyclictest4583-21kthreadcore19:47:532
185449932,0cyclictest3514-21snmpd19:42:432
185449932,0cyclictest22826-21cpu20:27:462
185449932,0cyclictest20694-21sensors19:57:562
185449930,0cyclictest20106-21diskstats19:12:482
185449930,0cyclictest0-21swapper/219:37:502
185439933,0cyclictest3556-21lldpd20:44:371
185439932,0cyclictest27269-21awk19:17:511
185439932,0cyclictest25370-21sensors19:12:571
185439932,0cyclictest23572-21awk20:27:491
185439932,0cyclictest1553-21awk19:22:511
185439932,0cyclictest14031-21awk19:07:511
185439932,0cyclictest12865-21awk23:47:501
185419933,0cyclictest21327-21kworker/0:223:53:260
185419933,0cyclictest21327-21kworker/0:222:47:510
185419933,0cyclictest21327-21kworker/0:222:27:430
185419933,0cyclictest21327-21kworker/0:221:57:410
185419933,0cyclictest21327-21kworker/0:200:02:400
185419933,0cyclictest16462-21kworker/0:119:57:550
185419933,0cyclictest16462-21kworker/0:119:02:580
185419932,0cyclictest3514-21snmpd20:17:580
185419932,0cyclictest20365-21mdstat22:07:540
185419932,0cyclictest13935-21awk19:07:510
185419930,0cyclictest21643-21perl23:12:480
169930,0watchdog/10-21swapper/123:57:531
169930,0watchdog/10-21swapper/123:08:011
169930,0watchdog/10-21swapper/122:36:421
169930,0watchdog/10-21swapper/119:32:501
185449920,0cyclictest0-21swapper/219:07:362
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional