You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 07:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun May 24, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
334123823,0sleep00-21swapper/018:53:030
322823727,0sleep30-21swapper/318:51:503
332523626,0sleep20-21swapper/218:52:532
311323329,0sleep10-21swapper/118:50:321
339970,0migration/39174-21sh20:57:433
339970,0migration/38859-21sh21:15:353
339970,0migration/327442-21munin-node21:50:013
4160,0ktimersoftd/00-21swapper/019:20:010
35869960,0cyclictest0-21swapper/122:37:141
35869960,0cyclictest0-21swapper/122:04:541
35859966,0cyclictest0-21swapper/021:05:010
339960,0migration/38234-21sh22:36:143
339960,0migration/323715-21sh23:05:113
339960,0migration/322288-21needreboot00:05:043
339960,0migration/311766-21kthreadcore22:40:023
339960,0migration/310493-21sh23:00:023
29725060,0irq/27-eth0-tx-21049-21munin-node20:45:060
29715060,0irq/26-eth0-rx-4039-21grep18:54:573
29715060,0irq/26-eth0-rx-1476-21if_eth1.300:15:003
29715060,0irq/26-eth0-rx-0-21swapper/323:20:363
149960,0migration/025755-21sh22:49:470
35879955,0cyclictest0-21swapper/223:04:552
35879955,0cyclictest0-21swapper/221:54:552
35879955,0cyclictest0-21swapper/220:29:572
35879950,0cyclictest0-21swapper/223:51:072
35879950,0cyclictest0-21swapper/223:49:422
35869955,0cyclictest0-21swapper/123:10:391
35869950,0cyclictest0-21swapper/123:54:481
35869950,0cyclictest0-21swapper/123:24:221
35869950,0cyclictest0-21swapper/122:32:391
35869950,0cyclictest0-21swapper/122:15:471
35869950,0cyclictest0-21swapper/121:50:241
35869950,0cyclictest0-21swapper/121:23:551
35859955,0cyclictest0-21swapper/023:57:580
35859950,0cyclictest17501-21crond22:44:450
35859950,0cyclictest0-21swapper/023:13:400
35859950,0cyclictest0-21swapper/023:01:410
339950,0migration/36968-21irqrtprio19:45:023
339950,0migration/36407-21missed_timers20:30:043
339950,0migration/3496-21kthreadcore19:15:023
339950,0migration/34081-21kthreadcore22:55:023
339950,0migration/330622-21kthreadcore20:00:053
339950,0migration/330322-21kthreadcore22:10:023
339950,0migration/327978-21kthreadcore19:10:033
339950,0migration/326685-21runrttasks21:29:503
339950,0migration/326111-21taskset20:20:173
339950,0migration/323050-21munin-node23:45:083
339950,0migration/320926-21kthreadcore21:45:033
339950,0migration/319631-21fschecks_count19:54:573
339950,0migration/319631-21fschecks_count19:54:573
339950,0migration/318651-21cpuspeed_turbos21:04:573
339950,0migration/316354-21diskmemload00:24:433
29725050,0irq/27-eth0-tx-9993-21if_eth023:40:002
29725050,0irq/27-eth0-tx-4717-21ssh23:55:032
29725050,0irq/27-eth0-tx-3804-21munin-node18:54:570
29725050,0irq/27-eth0-tx-25909-21df_abs23:09:572
29725050,0irq/27-eth0-tx-23639-21ssh23:25:412
29725050,0irq/27-eth0-tx-0-21swapper/222:57:422
29725050,0irq/27-eth0-tx-0-21swapper/222:40:012
29725050,0irq/27-eth0-tx-0-21swapper/222:23:352
29725050,0irq/27-eth0-tx-0-21swapper/222:02:392
29725050,0irq/27-eth0-tx-0-21swapper/221:49:142
29725050,0irq/27-eth0-tx-0-21swapper/020:54:550
29725050,0irq/27-eth0-tx-0-21swapper/020:00:000
29725050,0irq/27-eth0-tx-0-21swapper/019:50:080
29725050,0irq/27-eth0-tx-0-21swapper/019:41:530
29725050,0irq/27-eth0-tx-0-21swapper/019:14:570
29715050,0irq/26-eth0-rx-818-21latency_hist23:34:453
29715050,0irq/26-eth0-rx-6559-21runrttasks21:26:253
29715050,0irq/26-eth0-rx-32192-21ssh23:52:563
29715050,0irq/26-eth0-rx-29474-21tr19:35:043
29715050,0irq/26-eth0-rx-28498-21cut22:50:013
29715050,0irq/26-eth0-rx-26985-21diskstats21:09:583
29715050,0irq/26-eth0-rx-26721-21ssh22:30:013
29715050,0irq/26-eth0-rx-19491-21kthreadcore23:25:023
29715050,0irq/26-eth0-rx-16266-21python21:40:073
29715050,0irq/26-eth0-rx-16007-21ssh23:42:293
29715050,0irq/26-eth0-rx-10080-21munin-node22:19:563
29715050,0irq/26-eth0-rx-0-21swapper/323:54:483
29715050,0irq/26-eth0-rx-0-21swapper/323:15:033
29715050,0irq/26-eth0-rx-0-21swapper/322:44:483
29715050,0irq/26-eth0-rx-0-21swapper/322:27:183
29715050,0irq/26-eth0-rx-0-21swapper/322:15:053
29715050,0irq/26-eth0-rx-0-21swapper/322:05:043
29715050,0irq/26-eth0-rx-0-21swapper/321:21:583
29715050,0irq/26-eth0-rx-0-21swapper/321:00:093
29715050,0irq/26-eth0-rx-0-21swapper/319:25:033
29715050,0irq/26-eth0-rx-0-21swapper/300:03:133
259950,0migration/230908-21kthreadcore20:50:032
259950,0migration/225560-21cpuspeed_turbos23:29:582
259950,0migration/224841-21runrttasks22:47:472
259950,0migration/224036-21cpuspeed_turbos19:09:582
249950,0watchdog/20-21swapper/221:00:042
179950,0migration/14275-21kthreadcore21:15:011
179950,0migration/132500-21taskset23:53:501
179950,0migration/126460-21fschecks_time22:49:581
179950,0migration/119870-21kthreadcore00:05:031
179950,0migration/118655-21aten_r1power_vo21:44:581
179950,0migration/118363-21irqrtprio19:05:021
179950,0migration/113272-21kthreadcore21:00:041
179950,0migration/110591-21timerandwakeup19:20:081
169950,0watchdog/19025-21diskstats00:19:591
169950,0watchdog/131676-21ssh23:30:511
149950,0migration/08811-21turbostat23:39:450
149950,0migration/08019-21missed_timers21:15:030
149950,0migration/04744-21kthreadcore23:15:040
149950,0migration/04401-21kthreadcore22:35:020
149950,0migration/032097-21sh23:52:410
149950,0migration/031952-21latency21:10:040
149950,0migration/03035-21fschecks_time21:34:580
149950,0migration/027954-21kthreadcore19:10:030
149950,0migration/026036-21turbostat22:09:450
149950,0migration/025572-21sh21:47:420
149950,0migration/025343-21aten_r1power_cu23:29:570
149950,0migration/020711-21kthreadcore23:05:010
149950,0migration/020651-21kthreadcore22:45:020
149950,0migration/020506-21munin-node20:19:570
149950,0migration/019482-21taskset20:15:130
149950,0migration/018813-21fschecks_time19:30:000
149950,0migration/016942-21sh22:22:290
149950,0migration/016433-21sendmail_mailtr21:20:070
149950,0migration/015592-21taskset00:22:320
149950,0migration/015591-21sh00:02:010
149950,0migration/014957-21kthreadcore21:40:030
149950,0migration/01475-21latency_hist22:34:450
149950,0migration/01170-21timerwakeupswit20:50:090
149950,0migration/010280-21aten_r1power_cu21:59:570
8215040,0irq/24-0000:00:9246-21latency_hist22:59:452
35879944,0cyclictest0-21swapper/220:54:512
35879943,0cyclictest878-21awk20:05:022
35879943,0cyclictest19117-21awk19:30:022
35879943,0cyclictest11678-21awk21:20:012
35879943,0cyclictest11387-21awk19:00:012
35879940,0cyclictest0-21swapper/223:35:022
35869944,0cyclictest0-21swapper/123:44:521
35869944,0cyclictest0-21swapper/121:32:451
35869943,0cyclictest8608-21awk20:35:001
35869943,0cyclictest3556-21lldpd00:13:141
35869943,0cyclictest3264-21awk21:34:591
35869943,0cyclictest32350-21awk19:40:011
35869943,0cyclictest20949-21awk20:19:591
35869943,0cyclictest1923-21awk23:35:001
35869940,0cyclictest0-21swapper/119:31:301
35859944,0cyclictest0-21swapper/000:11:500
35859943,0cyclictest3556-21lldpd21:50:140
35859943,0cyclictest3241-21irqbalance22:10:030
35859943,0cyclictest2877-21awk22:15:000
35859943,0cyclictest27577-21awk20:24:590
35859943,0cyclictest18881-21awk22:24:590
35859943,0cyclictest18183-21awk23:25:000
35859943,0cyclictest17839-21awk00:05:010
35859943,0cyclictest1003-21munin-node20:29:580
35859940,0cyclictest0-21swapper/021:02:110
339940,0migration/37839-21irqcore20:10:013
339940,0migration/327321-21kthreadcore00:10:023
339940,0migration/326776-21aten_r1power_en20:24:563
339940,0migration/317410-21kthreadcore20:40:023
29725040,0irq/27-eth0-tx-8573-21ssh00:19:502
29725040,0irq/27-eth0-tx-26287-21ssh22:09:522
29725040,0irq/27-eth0-tx-10426-21ssh21:39:512
29725040,0irq/27-eth0-tx-0-21swapper/223:59:472
29725040,0irq/27-eth0-tx-0-21swapper/223:19:532
29725040,0irq/27-eth0-tx-0-21swapper/222:49:552
29725040,0irq/27-eth0-tx-0-21swapper/222:29:522
29725040,0irq/27-eth0-tx-0-21swapper/222:05:162
29725040,0irq/27-eth0-tx-0-21swapper/221:35:172
29725040,0irq/27-eth0-tx-0-21swapper/221:30:032
29725040,0irq/27-eth0-tx-0-21swapper/221:24:552
29725040,0irq/27-eth0-tx-0-21swapper/221:15:072
29725040,0irq/27-eth0-tx-0-21swapper/221:06:162
29725040,0irq/27-eth0-tx-0-21swapper/200:14:582
29725040,0irq/27-eth0-tx-0-21swapper/200:04:492
29725040,0irq/27-eth0-tx-0-21swapper/020:09:590
29725040,0irq/27-eth0-tx-0-21swapper/019:45:060
29725040,0irq/27-eth0-tx-0-21swapper/019:24:590
29715040,0irq/26-eth0-rx-31089-21smartctl23:30:083
29715040,0irq/26-eth0-rx-0-21swapper/323:10:023
29715040,0irq/26-eth0-rx-0-21swapper/322:00:323
29715040,0irq/26-eth0-rx-0-21swapper/321:55:053
29715040,0irq/26-eth0-rx-0-21swapper/321:34:573
29715040,0irq/26-eth0-rx-0-21swapper/320:35:003
29715040,0irq/26-eth0-rx-0-21swapper/320:04:593
29715040,0irq/26-eth0-rx-0-21swapper/319:30:023
29715040,0irq/26-eth0-rx-0-21swapper/318:59:573
259940,0migration/29925-21kthreadcore19:20:032
259940,0migration/29094-21latency18:55:022
259940,0migration/23807-21kthreadcore22:35:012
259940,0migration/231943-21latency21:10:042
259940,0migration/231913-21kthreadcore20:25:022
259940,0migration/227427-21munin-node21:50:012
259940,0migration/226368-21fschecks_time20:00:002
259940,0migration/225237-21kthreadcore20:20:022
259940,0migration/222979-21kthreadcore22:25:022
259940,0migration/222907-21kthreadcore19:55:012
259940,0migration/222907-21kthreadcore19:55:012
259940,0migration/219754-21runrttasks20:18:242
259940,0migration/216333-21kthreadcore19:25:042
249940,0watchdog/27773-21python22:15:072
249940,0watchdog/23852-21switchtime19:15:082
249940,0watchdog/232215-21hdparm19:40:002
249940,0watchdog/229596-21kthreadcore19:35:042
249940,0watchdog/222938-21timerwakeupswit19:05:082
249940,0watchdog/20-21swapper/223:14:512
249940,0watchdog/20-21swapper/220:39:562
249940,0watchdog/20-21swapper/219:45:042
249940,0watchdog/20-21swapper/200:10:032
19140,0ktimersoftd/10-21swapper/121:44:071
179940,0migration/19640-21munin-node22:59:581
179940,0migration/17246-21kthreadcore21:55:021
179940,0migration/129522-21kthreadcore22:10:021
179940,0migration/127276-21fschecks_count20:24:581
179940,0migration/123736-21kthreadcore20:45:011
179940,0migration/121761-21kthreadcore22:25:021
179940,0migration/118774-21aten_r1power_fr21:24:561
179940,0migration/113138-21kthreadcore22:20:021
179940,0migration/110909-21irqcore22:40:011
169940,0watchdog/19872-21ssh20:59:321
169940,0watchdog/13542-21lldpd19:57:441
169940,0watchdog/13542-21lldpd19:57:441
169940,0watchdog/127772-21cut20:00:041
169940,0watchdog/11809-21ssh21:13:511
169940,0watchdog/114436-21hostname20:39:561
169940,0watchdog/114411-21latency23:40:031
169940,0watchdog/11425-21cpu23:14:591
169940,0watchdog/10-21swapper/123:24:591
169940,0watchdog/10-21swapper/122:00:031
169940,0watchdog/10-21swapper/120:50:001
169940,0watchdog/10-21swapper/119:35:041
169940,0watchdog/10-21swapper/100:00:151
149940,0migration/05073-21kthreadcore00:15:020
149940,0migration/04834-21kthreadcore21:55:010
149940,0migration/03313-21kthreadcore20:05:040
149940,0migration/027499-21kthreadcore19:35:030
149940,0migration/019843-21irqcore21:25:010
149940,0migration/019609-21kthreadcore20:40:020
149940,0migration/019465-21kthreadcore19:05:020
149940,0migration/017657-21fschecks_time23:44:580
149940,0migration/015536-21sh23:20:330
149940,0migration/015367-21kthreadcore19:00:040
149940,0migration/012294-21kthreadcore23:40:020
149940,0migration/010271-21kthreadcore20:35:020
8215030,0irq/24-0000:00:0-21swapper/219:49:582
35879932,0cyclictest7651-21awk20:10:002
35869933,0cyclictest3514-21snmpd19:15:001
35869933,0cyclictest0-21swapper/120:30:001
35869932,0cyclictest4686-21awk18:54:591
35869932,0cyclictest3556-21lldpd21:05:141
35869932,0cyclictest3556-21lldpd00:15:141
35869932,0cyclictest3241-21irqbalance22:46:231
35869932,0cyclictest24715-21awk19:10:011
35869932,0cyclictest23329-21sensors23:05:061
35869932,0cyclictest14447-21irqcore20:15:001
35869932,0cyclictest13208-21sadc20:14:461
35869932,0cyclictest12418-21awk19:25:021
35869932,0cyclictest11363-21awk19:00:011
35859932,0cyclictest3514-21snmpd22:55:110
35859932,0cyclictest27636-21awk21:30:030
35859932,0cyclictest19041-21cut19:54:460
35859932,0cyclictest19041-21cut19:54:460
29715030,0irq/26-eth0-rx-0-21swapper/320:50:143
29715030,0irq/26-eth0-rx-0-21swapper/319:40:043
29715030,0irq/26-eth0-rx-0-21swapper/319:20:073
29715030,0irq/26-eth0-rx-0-21swapper/319:09:373
249930,0watchdog/20-21swapper/220:35:002
169930,0watchdog/18087-21ssh22:56:231
169930,0watchdog/10-21swapper/120:05:041
169930,0watchdog/10-21swapper/119:45:041
35879920,0cyclictest20816-21latency_hist20:44:452
29715020,0irq/26-eth0-rx-0-21swapper/320:45:043
29715020,0irq/26-eth0-rx-0-21swapper/320:15:283
29715020,0irq/26-eth0-rx-0-21swapper/319:49:473
169920,0watchdog/10-21swapper/119:49:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional