You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 07:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Jun 05, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450460,0irq/25-eth10-21swapper/318:52:123
1365123623,0sleep00-21swapper/018:53:270
1338623624,0sleep20-21swapper/218:50:202
1348023222,0sleep10-21swapper/118:51:271
35160,0ktimersoftd/30-21swapper/319:28:573
339960,0migration/35346-21fschecks_time21:28:503
339960,0migration/331205-21sh23:43:533
339960,0migration/319112-21sh22:15:453
339960,0migration/318641-21sh23:37:123
339960,0migration/318418-21sh23:15:523
339960,0migration/31524-21sh23:24:173
339960,0migration/311557-21sh22:32:513
339960,0migration/311298-21sh23:13:333
29715060,0irq/26-eth0-rx-29543-21if_err_eth1.321:03:523
29715060,0irq/26-eth0-rx-20716-21df22:18:493
29715060,0irq/26-eth0-rx-20478-21cut23:58:533
29715060,0irq/26-eth0-rx-13148-21iostat_ios22:33:533
137429960,0cyclictest0-21swapper/222:05:482
137419966,0cyclictest11952-21diskmemload23:43:191
137419960,0cyclictest24163-21kthreadcore21:18:541
137419960,0cyclictest0-21swapper/121:25:501
137409960,0cyclictest0-21swapper/023:24:480
137409960,0cyclictest0-21swapper/000:11:550
8215050,0irq/24-0000:00:4305-21latency_hist20:23:362
339950,0migration/3949-21munin-node23:03:553
339950,0migration/37571-21kthreadcore23:48:553
339950,0migration/35902-21kthreadcore22:08:543
339950,0migration/3561-21kthreadcore20:43:533
339950,0migration/34604-21irqcore19:58:513
339950,0migration/34293-21fschecks_count22:48:493
339950,0migration/33847-21fschecks_count23:28:493
339950,0migration/330556-21kthreadcore21:43:553
339950,0migration/329072-21kthreadcore19:03:543
339950,0migration/328653-21cpuspeed_turbos22:23:483
339950,0migration/328444-21kthreadcore20:13:543
339950,0migration/327655-21taskset21:40:483
339950,0migration/327269-21taskset23:02:333
339950,0migration/325728-21taskset23:39:333
339950,0migration/322629-21munin-node19:23:523
339950,0migration/322629-21munin-node19:23:523
339950,0migration/321950-21kthreadcore22:38:543
339950,0migration/318354-21munin-node21:33:553
339950,0migration/318192-21munin-node20:08:523
339950,0migration/31791-21diskmemload22:03:553
339950,0migration/312748-21munin-node22:53:503
339950,0migration/310400-21kthreadcore20:48:543
29725050,0irq/27-eth0-tx-5182-21df_inode21:28:492
29725050,0irq/27-eth0-tx-29512-21grep21:43:522
29725050,0irq/27-eth0-tx-2933-21munin-node00:09:032
29725050,0irq/27-eth0-tx-19079-21munin-node00:18:552
29725050,0irq/27-eth0-tx-18264-21ssh23:56:372
29725050,0irq/27-eth0-tx-11447-21ssh21:10:582
29725050,0irq/27-eth0-tx-11400-21ssh21:50:502
29725050,0irq/27-eth0-tx-0-21swapper/222:54:502
29725050,0irq/27-eth0-tx-0-21swapper/222:52:072
29725050,0irq/27-eth0-tx-0-21swapper/200:15:112
29725050,0irq/27-eth0-tx-0-21swapper/200:07:012
29715050,0irq/26-eth0-rx-7700-21kthreadcore00:08:553
29715050,0irq/26-eth0-rx-28601-21ps00:03:533
29715050,0irq/26-eth0-rx-24608-21grep18:58:533
29715050,0irq/26-eth0-rx-21507-21irqcore20:58:533
29715050,0irq/26-eth0-rx-2134-21missed_timers21:23:553
29715050,0irq/26-eth0-rx-14758-21cut20:53:543
29715050,0irq/26-eth0-rx-0-21swapper/321:59:293
29715050,0irq/26-eth0-rx-0-21swapper/321:50:193
29715050,0irq/26-eth0-rx-0-21swapper/321:16:343
29715050,0irq/26-eth0-rx-0-21swapper/300:15:523
259950,0migration/24598-21timerandwakeup20:43:592
259950,0migration/228690-21cpuspeed_turbos22:23:482
259950,0migration/228371-21fschecks_count23:03:492
259950,0migration/228275-21munin-node19:28:472
259950,0migration/226337-21taskset22:39:062
259950,0migration/223446-21kthreadcore22:18:532
259950,0migration/222169-21kthreadcore23:38:542
259950,0migration/219855-21unixbench_multi18:54:002
259950,0migration/218057-21sh23:14:492
259950,0migration/213212-21munin-node20:53:532
179950,0migration/128141-21gltestperf23:43:491
179950,0migration/127330-21sh22:21:191
179950,0migration/120818-21latency_hist21:38:361
179950,0migration/116746-21idleruntime19:43:501
179950,0migration/110399-21switchtime21:09:001
169950,0watchdog/122593-21kthreadcore23:58:541
169950,0watchdog/114973-21munin-node19:18:511
169950,0watchdog/111097-21ssh22:52:101
137429955,0cyclictest0-21swapper/223:24:562
137429955,0cyclictest0-21swapper/222:36:232
137429955,0cyclictest0-21swapper/221:08:052
137429955,0cyclictest0-21swapper/221:02:152
137429950,0cyclictest0-21swapper/223:49:512
137429950,0cyclictest0-21swapper/223:11:422
137429950,0cyclictest0-21swapper/221:56:482
137429950,0cyclictest0-21swapper/220:20:382
137419955,0cyclictest27048-21ssh21:00:181
137419955,0cyclictest0-21swapper/123:15:531
137419955,0cyclictest0-21swapper/122:17:331
137419955,0cyclictest0-21swapper/121:50:541
137419955,0cyclictest0-21swapper/120:54:281
137419950,0cyclictest0-21swapper/123:48:401
137419950,0cyclictest0-21swapper/123:06:351
137419950,0cyclictest0-21swapper/122:35:121
137419950,0cyclictest0-21swapper/100:23:031
137419950,0cyclictest0-21swapper/100:12:381
137409955,0cyclictest0-21swapper/023:58:560
137409954,0cyclictest3556-21lldpd23:13:090
137409953,0cyclictest3556-21lldpd00:23:090
137409953,0cyclictest13684-21awk21:13:510
339940,0migration/38903-21kthreadcore20:23:533
339940,0migration/329754-21latency20:38:523
339940,0migration/322497-21kthreadcore23:18:533
339940,0migration/319311-21needreboot18:53:553
29725040,0irq/27-eth0-tx-7502-21kthreadcore22:08:542
29725040,0irq/27-eth0-tx-26538-21munin-node21:58:592
29725040,0irq/27-eth0-tx-19197-21ssh23:58:382
29725040,0irq/27-eth0-tx-0-21swapper/223:28:432
29725040,0irq/27-eth0-tx-0-21swapper/222:43:422
29725040,0irq/27-eth0-tx-0-21swapper/221:38:552
29725040,0irq/27-eth0-tx-0-21swapper/221:33:432
29725040,0irq/27-eth0-tx-0-21swapper/221:24:002
29725040,0irq/27-eth0-tx-0-21swapper/221:18:522
29715040,0irq/26-eth0-rx-0-21swapper/323:53:523
29715040,0irq/26-eth0-rx-0-21swapper/322:45:553
29715040,0irq/26-eth0-rx-0-21swapper/321:55:483
29715040,0irq/26-eth0-rx-0-21swapper/321:18:523
29715040,0irq/26-eth0-rx-0-21swapper/321:08:483
29715040,0irq/26-eth0-rx-0-21swapper/319:48:493
29715040,0irq/26-eth0-rx-0-21swapper/300:18:493
259940,0migration/28441-21timerandwakeup19:33:592
259940,0migration/28191-21kthreadcore19:58:532
259940,0migration/26318-21idleruntime20:48:512
259940,0migration/224543-21kthreadcore23:18:532
259940,0migration/220010-21kthreadcore19:43:542
259940,0migration/214117-21kthreadcore22:13:532
259940,0migration/211471-21cpuspeed_turbos20:28:482
249940,0watchdog/28647-21kthreadcore22:28:552
249940,0watchdog/225339-21missed_timers22:58:542
249940,0watchdog/224896-21df_abs20:38:472
249940,0watchdog/211370-21ssh23:33:422
249940,0watchdog/20-21swapper/219:39:352
179940,0migration/1630-21kthreadcore20:18:541
179940,0migration/129114-21fschecks_time22:23:491
179940,0migration/128828-21latency_hist21:43:361
179940,0migration/128053-21hddtemp_smartct00:03:501
179940,0migration/127937-21taskset19:27:311
179940,0migration/127937-21taskset19:27:311
179940,0migration/124633-21kthreadcore19:48:541
179940,0migration/122892-21kthreadcore20:33:541
179940,0migration/120586-21if_eth123:18:511
179940,0migration/120049-21taskset21:37:011
179940,0migration/113727-21kthreadcore20:03:541
179940,0migration/111734-21fschecks_count20:28:491
179940,0migration/11045-21kthreadcore19:28:541
169940,0watchdog/129576-21df19:53:471
169940,0watchdog/12713-21ssh22:04:511
169940,0watchdog/126173-21ssh21:58:551
169940,0watchdog/114832-21if_err_eth1.318:53:511
169940,0watchdog/111842-21ssh22:53:381
169940,0watchdog/10-21swapper/123:53:461
169940,0watchdog/10-21swapper/123:33:541
169940,0watchdog/10-21swapper/123:28:541
169940,0watchdog/10-21swapper/122:58:541
169940,0watchdog/10-21swapper/120:38:511
137429943,0cyclictest9130-21awk19:13:502
137429943,0cyclictest3514-21snmpd23:43:552
137429943,0cyclictest3514-21snmpd21:13:392
137429943,0cyclictest3514-21snmpd18:58:392
137429943,0cyclictest28167-21awk19:03:522
137429943,0cyclictest24538-21awk20:13:522
137429943,0cyclictest22507-21awk19:23:512
137429943,0cyclictest22507-21awk19:23:512
137419943,0cyclictest3556-21lldpd22:09:081
137419943,0cyclictest3556-21lldpd21:29:091
137419943,0cyclictest3514-21snmpd23:11:401
137419943,0cyclictest3241-21irqbalance22:44:351
137419943,0cyclictest3241-21irqbalance22:28:451
137419943,0cyclictest28625-21awk23:23:511
137419943,0cyclictest24490-21awk20:13:511
137419943,0cyclictest21507-21awk18:58:511
137419943,0cyclictest21037-21awk22:38:521
137419943,0cyclictest17793-21awk20:08:511
137419943,0cyclictest11987-21awk00:13:491
137419943,0cyclictest10132-21awk19:38:501
137409944,0cyclictest0-21swapper/022:53:590
137409944,0cyclictest0-21swapper/022:39:380
137409944,0cyclictest0-21swapper/018:54:010
137409943,0cyclictest8062-21sadc19:13:370
137409943,0cyclictest6559-21runrttasks20:23:440
137409943,0cyclictest5761-21awk21:28:520
137409943,0cyclictest3556-21lldpd23:55:390
137409943,0cyclictest3556-21lldpd23:28:390
137409943,0cyclictest3556-21lldpd23:17:090
137409943,0cyclictest3556-21lldpd22:45:080
137409943,0cyclictest3556-21lldpd22:18:390
137409943,0cyclictest3556-21lldpd21:54:090
137409943,0cyclictest3556-21lldpd21:19:090
137409943,0cyclictest3556-21lldpd20:18:380
137409943,0cyclictest3556-21lldpd20:04:380
137409943,0cyclictest3556-21lldpd20:00:380
137409943,0cyclictest3556-21lldpd19:52:080
137409943,0cyclictest3556-21lldpd19:20:370
137409943,0cyclictest3556-21lldpd19:16:370
137409943,0cyclictest3514-21snmpd22:58:550
137409943,0cyclictest3514-21snmpd22:48:400
137409943,0cyclictest3514-21snmpd22:33:100
137409943,0cyclictest3514-21snmpd22:08:550
137409943,0cyclictest3514-21snmpd22:04:250
137409943,0cyclictest3514-21snmpd21:59:100
137409943,0cyclictest3514-21snmpd21:50:100
137409943,0cyclictest3514-21snmpd21:45:100
137409943,0cyclictest3514-21snmpd21:27:090
137409943,0cyclictest3514-21snmpd21:07:540
137409943,0cyclictest3514-21snmpd20:53:390
137409943,0cyclictest3514-21snmpd19:44:390
137409943,0cyclictest3514-21snmpd00:14:250
137409943,0cyclictest3241-21irqbalance23:44:040
137409943,0cyclictest3241-21irqbalance23:39:140
137409943,0cyclictest3241-21irqbalance23:33:540
137409943,0cyclictest3241-21irqbalance23:04:250
137409943,0cyclictest3241-21irqbalance22:34:050
137409943,0cyclictest3241-21irqbalance22:13:450
137409943,0cyclictest3241-21irqbalance20:48:450
137409943,0cyclictest3241-21irqbalance20:45:150
137409943,0cyclictest3241-21irqbalance20:39:450
137409943,0cyclictest3241-21irqbalance20:34:050
137409943,0cyclictest3241-21irqbalance20:29:050
137409943,0cyclictest3241-21irqbalance20:13:450
137409943,0cyclictest3241-21irqbalance20:08:550
137409943,0cyclictest29417-21awk22:23:510
137409943,0cyclictest28244-21awk00:03:510
137409943,0cyclictest27300-21munin-node19:03:500
137409943,0cyclictest22555-21awk19:23:520
137409943,0cyclictest22555-21awk19:23:520
137409943,0cyclictest21871-21awk21:38:530
137409943,0cyclictest19645-21munin-node23:18:530
137409943,0cyclictest13782-21awk21:33:510
137409941,0cyclictest0-21swapper/019:35:050
137409940,0cyclictest20601-21munin-node18:58:560
137409940,0cyclictest0-21swapper/021:01:440
339930,0migration/314939-21munin-node19:38:583
29715030,0irq/26-eth0-rx-0-21swapper/320:33:473
29715030,0irq/26-eth0-rx-0-21swapper/320:28:453
29715030,0irq/26-eth0-rx-0-21swapper/320:18:483
29715030,0irq/26-eth0-rx-0-21swapper/320:04:153
29715030,0irq/26-eth0-rx-0-21swapper/319:53:573
29715030,0irq/26-eth0-rx-0-21swapper/319:43:483
29715030,0irq/26-eth0-rx-0-21swapper/319:18:473
29715030,0irq/26-eth0-rx-0-21swapper/319:13:483
29715030,0irq/26-eth0-rx-0-21swapper/319:09:383
249930,0watchdog/228266-21python19:48:592
249930,0watchdog/20-21swapper/220:03:592
249930,0watchdog/20-21swapper/219:18:512
179930,0migration/19082-21hwlatdetect19:13:501
179930,0migration/14001-21kthreadcore19:08:531
169930,0watchdog/10-21swapper/121:53:511
169930,0watchdog/10-21swapper/121:03:511
137429933,0cyclictest0-21swapper/220:35:372
137429932,0cyclictest23326-21sadc20:13:362
137429932,0cyclictest2332-21wc19:08:502
137419932,0cyclictest8576-21unixbench_multi19:33:591
137419932,0cyclictest3556-21lldpd21:14:391
137419932,0cyclictest3514-21snmpd20:48:391
137419932,0cyclictest32332-21ps20:43:521
137419932,0cyclictest32272-21cut19:03:551
137409932,0cyclictest3514-21snmpd23:49:090
137409932,0cyclictest28310-21basename19:28:470
137409932,0cyclictest12627-21kthreadcore19:38:530
137409931,0cyclictest0-21swapper/021:08:540
137409930,0cyclictest0-21swapper/019:53:570
29715020,0irq/26-eth0-rx-0-21swapper/319:33:443
169920,0watchdog/10-21swapper/119:58:471
137429921,0cyclictest29023-21latency_hist19:53:372
137419920,0cyclictest4445-21latency_hist20:23:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional