You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 04:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu Apr 02, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450350,0irq/25-eth10-21swapper/318:54:493
757323430,0sleep20-21swapper/218:58:042
739123020,0sleep10-21swapper/118:55:551
735822925,0sleep00-21swapper/018:55:300
77909966,0cyclictest0-21swapper/223:43:382
77909960,0cyclictest0-21swapper/223:37:482
77889966,0cyclictest5996-21diskmemload00:24:440
77889966,0cyclictest0-21swapper/023:27:400
77889960,0cyclictest0-21swapper/023:07:480
339960,0migration/36006-21taskset21:18:433
339960,0migration/35425-21sh21:36:543
339960,0migration/34125-21sh22:15:313
339960,0migration/327241-21timerandwakeup22:50:023
339960,0migration/320792-21sh21:05:453
339960,0migration/318643-21sh23:25:193
339960,0migration/317461-21sh00:26:113
29715060,0irq/26-eth0-rx-9035-21cut23:39:573
29715060,0irq/26-eth0-rx-6693-21df_inode21:59:523
29715060,0irq/26-eth0-rx-24366-21tr22:09:573
29715060,0irq/26-eth0-rx-18095-21grep23:04:583
29715060,0irq/26-eth0-rx-15847-21munin-node21:24:543
29715060,0irq/26-eth0-rx-15458-21tr22:44:563
29715060,0irq/26-eth0-rx-11958-40yum-updatesd-he23:44:483
29715060,0irq/26-eth0-rx-11573-21processes22:20:013
29715060,0irq/26-eth0-rx-10397-21entropy19:49:533
77909955,0cyclictest271ktimersoftd/223:12:062
77909955,0cyclictest271ktimersoftd/221:16:132
77909955,0cyclictest271ktimersoftd/221:10:232
77909955,0cyclictest0-21swapper/223:50:152
77909955,0cyclictest0-21swapper/222:50:212
77909955,0cyclictest0-21swapper/222:36:002
77909955,0cyclictest0-21swapper/222:36:002
77909955,0cyclictest0-21swapper/222:31:442
77909954,0cyclictest0-21swapper/221:22:032
77909952,0cyclictest1571-21yum23:55:032
77909952,0cyclictest0-21swapper/222:15:002
77909950,0cyclictest0-21swapper/200:12:572
77899955,0cyclictest0-21swapper/122:35:041
77899955,0cyclictest0-21swapper/122:35:041
77899955,0cyclictest0-21swapper/119:15:001
77899950,0cyclictest0-21swapper/121:16:421
77899950,0cyclictest0-21swapper/100:15:481
77889955,0cyclictest0-21swapper/023:47:320
77889955,0cyclictest0-21swapper/021:26:160
77889950,0cyclictest0-21swapper/022:10:060
77889950,0cyclictest0-21swapper/020:25:060
4150,0ktimersoftd/00-21swapper/023:12:130
339950,0migration/36464-21kthreadcore19:44:583
339950,0migration/36140-21idleruntime22:39:543
339950,0migration/33646-21munin-node20:05:033
339950,0migration/33436-21aten_r1power_cu23:59:473
339950,0migration/329196-21latency_hist22:54:403
339950,0migration/327944-21fschecks_time00:14:503
339950,0migration/32521-21sh23:36:243
339950,0migration/324672-21kthreadcore19:59:553
339950,0migration/323777-21runrttasks21:29:533
339950,0migration/323649-21kthreadcore19:34:573
339950,0migration/322668-21kthreadcore00:09:553
339950,0migration/320357-21taskset23:29:463
339950,0migration/317196-21kthreadcore19:29:563
339950,0migration/312918-21kthreadcore00:04:563
339950,0migration/31120-21kthreadcore20:29:563
29725050,0irq/27-eth0-tx-25239-21munin-node20:49:570
29725050,0irq/27-eth0-tx-0-21swapper/021:00:050
29725050,0irq/27-eth0-tx-0-21swapper/019:24:580
29715050,0irq/26-eth0-rx-4499-21ssh21:55:103
29715050,0irq/26-eth0-rx-28033-21telnet19:14:503
29715050,0irq/26-eth0-rx-27664-21chrt19:13:293
29715050,0irq/26-eth0-rx-2444-21unixbench_singl23:15:013
29715050,0irq/26-eth0-rx-22782-21ssh21:49:513
29715050,0irq/26-eth0-rx-19283-21nfs4_client22:24:583
29715050,0irq/26-eth0-rx-17868-21kthreadcore21:44:573
29715050,0irq/26-eth0-rx-0-21swapper/323:57:113
29715050,0irq/26-eth0-rx-0-21swapper/323:53:553
29715050,0irq/26-eth0-rx-0-21swapper/323:19:523
29715050,0irq/26-eth0-rx-0-21swapper/323:09:433
29715050,0irq/26-eth0-rx-0-21swapper/322:59:503
29715050,0irq/26-eth0-rx-0-21swapper/322:36:023
29715050,0irq/26-eth0-rx-0-21swapper/322:36:023
29715050,0irq/26-eth0-rx-0-21swapper/322:29:553
29715050,0irq/26-eth0-rx-0-21swapper/321:43:533
29715050,0irq/26-eth0-rx-0-21swapper/321:22:513
29715050,0irq/26-eth0-rx-0-21swapper/320:59:543
29715050,0irq/26-eth0-rx-0-21swapper/300:24:123
179950,0migration/18457-21taskset19:21:051
179950,0migration/13111-21latency_hist19:44:401
179950,0migration/128499-21kthreadcore20:49:571
179950,0migration/121853-21munin-node23:09:541
179950,0migration/112714-21latency_hist23:04:401
179950,0migration/112648-21fschecks_time23:44:531
169950,0watchdog/128009-21sensors_volt22:10:021
169950,0watchdog/114939-21perl22:04:541
149950,0migration/09335-21munin-node19:45:040
149950,0migration/08207-21kthreadcore22:19:560
149950,0migration/06435-21aten_r1power_vo21:59:510
149950,0migration/06220-21kthreadcore23:39:560
149950,0migration/05813-21sh21:59:100
149950,0migration/04325-21aten_r1power_cu20:09:510
149950,0migration/031390-21kthreadcore22:54:570
149950,0migration/029137-21hddtemp_smartct23:34:520
149950,0migration/02878-21kthreadcore20:29:570
149950,0migration/025264-21kthreadcore19:59:550
149950,0migration/024193-21kthreadcore21:49:560
149950,0migration/022464-21gltestperf22:29:530
149950,0migration/022449-21timerandwakeup19:55:030
149950,0migration/022419-21kthreadcore00:09:550
149950,0migration/022293-21latency_hist19:34:400
149950,0migration/016432-21sh19:29:540
149950,0migration/015671-21irqrtprio21:04:580
149950,0migration/015622-21kthreadcore22:44:560
149950,0migration/013477-21sh21:21:350
149950,0migration/012846-21kthreadcore19:49:580
149950,0migration/012199-21gltestperf00:04:530
149950,0migration/01166-21munin-node23:54:590
77909943,0cyclictest3556-21lldpd19:54:572
77909943,0cyclictest3514-21snmpd22:00:302
77909943,0cyclictest3514-21snmpd20:09:452
77909943,0cyclictest3514-21snmpd19:42:302
77909943,0cyclictest3514-21snmpd19:03:302
77909943,0cyclictest3241-21irqbalance21:44:482
77909943,0cyclictest32053-21iostat_ios21:34:562
77909943,0cyclictest31245-21uname20:04:562
77909943,0cyclictest3111-21awk19:19:542
77909943,0cyclictest21344-21awk23:29:532
77909943,0cyclictest19462-21awk20:44:552
77909943,0cyclictest15530-21awk19:04:552
77909942,0cyclictest7295-21cut21:39:532
77909942,0cyclictest6128-21df22:19:522
77909942,0cyclictest6022-21sh20:34:522
77909942,0cyclictest5702-21diskstats22:39:522
77909942,0cyclictest5000-21aten2.4-expect22:59:502
77909942,0cyclictest4461-21iostat_ios23:59:522
77909942,0cyclictest3683-21forks19:44:542
77909942,0cyclictest3611-21perl00:19:542
77909942,0cyclictest31933-21iostat_ios20:29:552
77909942,0cyclictest30845-21aten2.4-expect21:54:512
77909942,0cyclictest302-21if_err_eth020:54:542
77909942,0cyclictest28022-21grep00:14:502
77909942,0cyclictest25657-21fschecks_count20:49:532
77909942,0cyclictest25276-21iostat_ios20:24:562
77909942,0cyclictest23632-21tune2fs21:29:532
77909942,0cyclictest23242-21sh22:09:562
77909942,0cyclictest22368-21aten2.4-expect19:34:522
77909942,0cyclictest21927-21tune2fs19:09:522
77909942,0cyclictest2150-21sensors_volt23:15:002
77909942,0cyclictest21361-21cat19:30:022
77909942,0cyclictest18441-21hwlatdetect20:19:542
77909942,0cyclictest15362-21diskstats21:24:522
77909942,0cyclictest14623-21df22:04:532
77909942,0cyclictest14360-21sh21:04:412
77909942,0cyclictest13894-21aten2.4-expect22:24:502
77909942,0cyclictest13428-21tune2fs23:04:542
77909942,0cyclictest13374-21aten2.4-expect22:44:512
77909942,0cyclictest12387-21diskstats23:44:522
77909942,0cyclictest11944-21aten_r1power_cu20:39:502
77909942,0cyclictest11434-21fschecks_count20:14:532
77909942,0cyclictest10821-21seq23:20:412
77909942,0cyclictest10324-21df19:49:532
77909942,0cyclictest10001-21iostat19:24:542
77909941,0cyclictest8012-21kthreadcore20:59:572
77909941,0cyclictest2364-21missed_timers22:54:592
77909941,0cyclictest18187-21ssh23:25:012
77909941,0cyclictest12304-21if_err_eth100:04:542
77909941,0cyclictest10894-21cat00:24:392
77909941,0cyclictest1022-21ntpq19:14:592
77909940,0cyclictest0-21swapper/221:51:432
77899943,0cyclictest6772-21awk22:19:551
77899943,0cyclictest4160-21awk19:44:561
77899943,0cyclictest3556-21lldpd21:56:281
77899943,0cyclictest3556-21lldpd21:05:581
77899943,0cyclictest3514-21snmpd19:31:151
77899943,0cyclictest3514-21snmpd00:03:161
77899943,0cyclictest3241-21irqbalance20:05:091
77899943,0cyclictest3241-21irqbalance00:06:281
77899943,0cyclictest29800-21awk23:14:541
77899943,0cyclictest23874-21awk21:29:541
77899943,0cyclictest23630-21awk21:49:551
77899943,0cyclictest23243-21awk19:34:561
77899943,0cyclictest20253-21awk00:09:531
77899940,0cyclictest0-21swapper/121:35:561
77889944,0cyclictest0-21swapper/022:36:440
77889944,0cyclictest0-21swapper/022:36:440
77889944,0cyclictest0-21swapper/000:23:570
77889943,0cyclictest3556-21lldpd22:14:580
77889943,0cyclictest3556-21lldpd21:48:290
77889943,0cyclictest3556-21lldpd21:12:580
77889943,0cyclictest3556-21lldpd20:22:270
77889943,0cyclictest29700-21awk23:14:530
77889943,0cyclictest23906-21awk21:29:550
339940,0migration/35140-21if_err_eth020:09:553
339940,0migration/319693-21kthreadcore19:04:583
339940,0migration/318418-21kthreadcore19:54:583
339940,0migration/314660-21kthreadcore20:39:563
339940,0migration/313000-21kthreadcore20:14:573
29725040,0irq/27-eth0-tx-29033-21aten2.4-expect19:39:530
29725040,0irq/27-eth0-tx-0-21swapper/020:55:030
29725040,0irq/27-eth0-tx-0-21swapper/020:14:510
29725040,0irq/27-eth0-tx-0-21swapper/020:08:310
29715040,0irq/26-eth0-rx-0-21swapper/322:04:533
29715040,0irq/26-eth0-rx-0-21swapper/321:10:043
29715040,0irq/26-eth0-rx-0-21swapper/319:21:463
19140,0ktimersoftd/10-21swapper/120:32:301
179940,0migration/17159-21kthreadcore20:34:551
179940,0migration/16854-21fschecks_time20:59:541
179940,0migration/16763-21kthreadcore20:09:571
179940,0migration/16660-21kthreadcore23:39:571
179940,0migration/131883-21kthreadcore23:34:561
179940,0migration/125557-21kthreadcore19:09:571
179940,0migration/123023-21taskset19:59:081
179940,0migration/120248-21latency21:24:571
179940,0migration/118912-21irqrtprio20:19:561
179940,0migration/116264-21taskset19:52:521
179940,0migration/116180-21kthreadcore23:04:581
179940,0migration/113819-21runrttasks21:42:541
179940,0migration/113624-21kthreadcore20:14:571
179940,0migration/112839-21munin-node20:39:541
179940,0migration/111087-21sh23:21:281
179940,0migration/110198-21kthreadcore21:59:571
169940,0watchdog/125865-21cat23:50:021
169940,0watchdog/119364-21gltestperf20:44:541
169940,0watchdog/118678-21ssh23:25:261
169940,0watchdog/111726-21kthreadcore19:24:551
169940,0watchdog/110839-21needreboot22:39:581
169940,0watchdog/10-21swapper/122:54:581
169940,0watchdog/10-21swapper/122:49:501
169940,0watchdog/10-21swapper/122:34:341
169940,0watchdog/10-21swapper/121:19:581
169940,0watchdog/10-21swapper/121:10:021
169940,0watchdog/10-21swapper/119:05:031
169940,0watchdog/10-21swapper/118:59:591
169940,0watchdog/10-21swapper/100:24:501
169940,0watchdog/10-21swapper/100:19:541
149940,0migration/09796-21kthreadcore18:59:580
149940,0migration/09323-21kthreadcore22:59:560
149940,0migration/05443-21aten_r1power_vo22:39:510
149940,0migration/05411-21kthreadcore23:59:530
149940,0migration/032611-21kthreadcore21:14:570
149940,0migration/027591-21taskset22:50:240
149940,0migration/026798-21taskset23:52:190
149940,0migration/025536-21kthreadcore23:29:560
149940,0migration/023660-21kthreadcore20:44:580
149940,0migration/014527-21kthreadcore20:39:560
149940,0migration/010291-21kthreadcore21:39:570
149940,0migration/010217-21kthreadcore20:34:560
77909931,0cyclictest23239-21cat19:59:402
77899933,0cyclictest0-21swapper/120:54:571
77899932,0cyclictest28971-21sensors20:00:001
77899932,0cyclictest28794-21awk23:54:531
77899930,0cyclictest0-21swapper/121:44:491
77889933,0cyclictest0-21swapper/023:20:150
77889933,0cyclictest0-21swapper/022:04:440
77889932,0cyclictest3556-21lldpd00:14:580
77889932,0cyclictest3514-21snmpd22:26:000
77889932,0cyclictest3514-21snmpd19:13:150
77889932,0cyclictest3228-21awk19:19:550
77889932,0cyclictest32030-21awk21:34:550
77889932,0cyclictest28071-21aten_r1power_fr19:14:500
77889932,0cyclictest20327-21sensors19:05:010
339930,0migration/330305-21runrttasks20:25:173
29715030,0irq/26-eth0-rx-0-21swapper/320:56:593
29715030,0irq/26-eth0-rx-0-21swapper/320:49:113
29715030,0irq/26-eth0-rx-0-21swapper/320:35:393
29715030,0irq/26-eth0-rx-0-21swapper/320:19:523
29715030,0irq/26-eth0-rx-0-21swapper/319:41:413
29715030,0irq/26-eth0-rx-0-21swapper/319:24:543
29715030,0irq/26-eth0-rx-0-21swapper/319:00:113
169930,0watchdog/113326-40yum-updatesd-he22:44:501
169930,0watchdog/10-21swapper/123:29:501
169930,0watchdog/10-21swapper/122:27:261
169930,0watchdog/10-21swapper/122:15:381
169930,0watchdog/10-21swapper/120:27:261
29715020,0irq/26-eth0-rx-0-21swapper/320:49:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional