You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 19:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Jul 14, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2582523627,0sleep30-21swapper/306:46:013
2591823531,0sleep00-21swapper/006:47:070
2576023324,0sleep10-21swapper/106:45:151
2576622622,0sleep20-21swapper/206:45:202
339960,0migration/36856-21sh10:36:143
339960,0migration/36185-21sh11:35:393
339960,0migration/315093-21sh11:43:013
29715060,0irq/26-eth0-rx-8908-21fschecks_count10:40:033
29715060,0irq/26-eth0-rx-32340-21diskstats12:15:023
29715060,0irq/26-eth0-rx-25652-21if_err_eth1.310:10:053
29715060,0irq/26-eth0-rx-1945-21cut09:35:083
29715060,0irq/26-eth0-rx-14783-21ssh11:21:413
262299960,0cyclictest0-21swapper/212:04:372
149960,0migration/014291-21unixbench-2d11:00:150
8215050,0irq/24-0000:00:7225-21latency_hist06:59:512
339950,0migration/39655-21kthreadcore12:00:073
339950,0migration/38564-21cpuspeed_turbos11:00:033
339950,0migration/331204-21taskset09:50:493
339950,0migration/329213-21idleruntime07:40:043
339950,0migration/328070-21munin-node09:30:063
339950,0migration/326074-21kthreadcore10:50:063
339950,0migration/324608-21latency_hist08:49:513
339950,0migration/32011-21kthreadcore09:55:083
339950,0migration/318674-21kthreadcore10:05:073
339950,0migration/317191-21kthreadcore07:30:093
339950,0migration/317156-21idleruntime11:05:043
339950,0migration/316119-21munin-node07:55:023
339950,0migration/314309-21needreboot09:20:083
339950,0migration/314144-21kthreadcore07:50:083
339950,0migration/31059-21kthreadcore11:55:073
29725050,0irq/27-eth0-tx-8377-21diskstats11:40:032
29725050,0irq/27-eth0-tx-8242-21munin-node11:00:122
29725050,0irq/27-eth0-tx-6690-21vmstat09:55:162
29725050,0irq/27-eth0-tx-6112-21ssh11:35:272
29725050,0irq/27-eth0-tx-25329-21df_inode09:30:012
29725050,0irq/27-eth0-tx-11497-21cut10:20:082
29725050,0irq/27-eth0-tx-0-21swapper/211:25:072
29725050,0irq/27-eth0-tx-0-21swapper/210:32:502
29725050,0irq/27-eth0-tx-0-21swapper/210:02:182
29725050,0irq/27-eth0-tx-0-21swapper/209:40:382
29725050,0irq/27-eth0-tx-0-21swapper/008:49:550
29725050,0irq/27-eth0-tx-0-21swapper/006:49:530
29715050,0irq/26-eth0-rx-29244-21grep11:50:083
29715050,0irq/26-eth0-rx-21587-21expr12:05:113
29715050,0irq/26-eth0-rx-16499-21df_abs11:25:013
29715050,0irq/26-eth0-rx-15180-21runrttasks09:41:003
29715050,0irq/26-eth0-rx-14427-21df07:05:043
29715050,0irq/26-eth0-rx-13685-21cut10:00:073
29715050,0irq/26-eth0-rx-12274-21kthreadcore10:20:083
29715050,0irq/26-eth0-rx-0-21swapper/312:10:073
29715050,0irq/26-eth0-rx-0-21swapper/311:19:333
29715050,0irq/26-eth0-rx-0-21swapper/311:10:443
29715050,0irq/26-eth0-rx-0-21swapper/310:57:213
29715050,0irq/26-eth0-rx-0-21swapper/310:25:023
29715050,0irq/26-eth0-rx-0-21swapper/310:18:533
29715050,0irq/26-eth0-rx-0-21swapper/309:45:013
29715050,0irq/26-eth0-rx-0-21swapper/309:15:303
29715050,0irq/26-eth0-rx-0-21swapper/309:09:353
29715050,0irq/26-eth0-rx-0-21swapper/308:00:063
29715050,0irq/26-eth0-rx-0-21swapper/307:45:013
29715050,0irq/26-eth0-rx-0-21swapper/307:20:553
262299955,0cyclictest0-21swapper/210:47:312
262299955,0cyclictest0-21swapper/209:21:552
262299955,0cyclictest0-21swapper/208:55:252
262299955,0cyclictest0-21swapper/208:02:272
262299955,0cyclictest0-21swapper/207:30:082
262299954,0cyclictest2494-21awk07:20:052
262299950,0cyclictest0-21swapper/211:54:412
262299950,0cyclictest0-21swapper/211:47:352
262299950,0cyclictest0-21swapper/209:06:472
262299950,0cyclictest0-21swapper/208:51:382
262289950,0cyclictest0-21swapper/111:43:591
262269955,0cyclictest0-21swapper/011:35:110
262269952,0cyclictest0-21swapper/007:24:510
262269950,0cyclictest0-21swapper/010:40:470
262269950,0cyclictest0-21swapper/007:05:160
259950,0migration/28824-21munin-node10:40:032
259950,0migration/2610-21sh09:14:512
259950,0migration/24699-21kthreadcore11:15:092
259950,0migration/23668-21munin-node08:10:022
259950,0migration/23298-21fschecks_time07:45:032
259950,0migration/229398-21aten2.4-expect08:05:032
259950,0migration/228333-21kthreadcore09:10:072
259950,0migration/223306-21missed_timers08:45:102
259950,0migration/218648-21kthreadcore07:55:082
259950,0migration/217314-21fschecks_time10:05:032
259950,0migration/214769-21sh09:00:302
249950,0watchdog/214060-21fgrep07:25:132
179950,0migration/19186-21kthreadcore12:00:071
179950,0migration/1778-21idleruntime11:15:061
179950,0migration/125041-21aten_r1power_vo09:10:021
179950,0migration/121509-21kthreadcore09:45:071
179950,0migration/116065-21switchtime08:15:111
179950,0migration/110358-21kthreadcore09:40:061
149950,0migration/09278-21fschecks_time10:00:030
149950,0migration/06010-21kthreadcore08:10:080
149950,0migration/04702-21aten_r1power_en08:35:020
149950,0migration/032296-21latency_hist11:14:490
149950,0migration/031342-21taskset09:30:560
149950,0migration/030086-21idleruntime-cro08:29:510
149950,0migration/029062-21kthreadcore07:15:080
149950,0migration/025169-21kthreadcore07:35:070
149950,0migration/022781-21kthreadcore07:10:070
149950,0migration/022715-21sh10:45:330
149950,0migration/022526-21taskset11:25:540
149950,0migration/02209-21kthreadcore09:35:080
149950,0migration/021098-21kthreadcore07:55:090
149950,0migration/019177-21kthreadcore10:25:060
149950,0migration/01899-21kthreadcore12:15:060
149950,0migration/018937-21kthreadcore11:05:080
149950,0migration/017324-21fschecks_count09:45:030
149950,0migration/015518-21sh09:21:450
149950,0migration/014642-21sh12:02:150
149950,0migration/014454-21sh09:00:130
149950,0migration/012789-21kthreadcore08:15:060
149950,0migration/011293-21kthreadcore07:25:090
8215040,0irq/24-0000:00:32646-21cat10:34:502
8215040,0irq/24-0000:00:302-21cat10:14:502
339940,0migration/39280-21kthreadcore08:35:083
339940,0migration/33696-21kthreadcore06:55:073
339940,0migration/330393-21sh11:30:203
339940,0migration/310060-21kthreadcore07:00:083
29725040,0irq/27-eth0-tx-30485-21ssh09:50:102
29725040,0irq/27-eth0-tx-22990-21users09:25:132
29725040,0irq/27-eth0-tx-0-21swapper/212:15:322
29725040,0irq/27-eth0-tx-0-21swapper/211:54:532
29725040,0irq/27-eth0-tx-0-21swapper/211:29:582
29725040,0irq/27-eth0-tx-0-21swapper/211:20:392
29725040,0irq/27-eth0-tx-0-21swapper/210:55:002
29725040,0irq/27-eth0-tx-0-21swapper/210:50:112
29725040,0irq/27-eth0-tx-0-21swapper/210:24:552
29725040,0irq/27-eth0-tx-0-21swapper/008:23:540
29725040,0irq/27-eth0-tx-0-21swapper/008:01:480
29725040,0irq/27-eth0-tx-0-21swapper/007:50:060
29725040,0irq/27-eth0-tx-0-21swapper/007:45:010
29725040,0irq/27-eth0-tx-0-21swapper/007:30:030
29715040,0irq/26-eth0-rx-0-21swapper/311:45:093
29715040,0irq/26-eth0-rx-0-21swapper/310:46:273
29715040,0irq/26-eth0-rx-0-21swapper/310:29:543
29715040,0irq/26-eth0-rx-0-21swapper/309:25:093
29715040,0irq/26-eth0-rx-0-21swapper/309:10:353
29715040,0irq/26-eth0-rx-0-21swapper/309:01:173
29715040,0irq/26-eth0-rx-0-21swapper/308:55:243
29715040,0irq/26-eth0-rx-0-21swapper/308:25:083
29715040,0irq/26-eth0-rx-0-21swapper/308:15:063
262299944,0cyclictest0-21swapper/210:10:192
262299944,0cyclictest0-21swapper/207:50:282
262299943,0cyclictest3556-21lldpd07:34:532
262299943,0cyclictest3556-21lldpd07:10:542
262299943,0cyclictest3556-21lldpd07:04:532
262299943,0cyclictest3556-21lldpd06:52:232
262289943,0cyclictest8323-21sadc10:19:491
262289943,0cyclictest473-21awk12:15:051
262289943,0cyclictest3556-21lldpd11:28:241
262289943,0cyclictest3556-21lldpd11:20:241
262289943,0cyclictest3514-21snmpd11:07:391
262289943,0cyclictest3514-21snmpd09:15:541
262289943,0cyclictest3514-21snmpd07:51:231
262289943,0cyclictest30386-21sort08:05:081
262289943,0cyclictest25556-21awk08:50:041
262289943,0cyclictest25376-21awk11:10:051
262289943,0cyclictest24993-21awk11:50:061
262289943,0cyclictest23565-21awk08:00:041
262289943,0cyclictest17853-21awk08:20:051
262289943,0cyclictest17720-21awk09:05:081
262289943,0cyclictest16742-21awk12:05:051
262289943,0cyclictest1582-21awk06:55:051
262289943,0cyclictest1037-21awk08:55:041
262269944,0cyclictest0-21swapper/011:41:380
262269944,0cyclictest0-21swapper/011:21:560
262269944,0cyclictest0-21swapper/011:11:030
262269944,0cyclictest0-21swapper/009:42:550
262269944,0cyclictest0-21swapper/009:19:260
262269943,0cyclictest3556-21lldpd07:40:230
262269943,0cyclictest3514-21snmpd10:56:240
262269943,0cyclictest25681-21awk10:10:060
262269943,0cyclictest25176-21awk11:30:060
262269943,0cyclictest25017-21awk11:50:060
262269943,0cyclictest16818-21awk12:05:060
262269940,0cyclictest0-21swapper/010:34:570
259940,0migration/25506-21munin-node08:35:052
259940,0migration/228476-21aten_r1power_fr07:40:002
259940,0migration/226306-21kthreadcore11:10:072
259940,0migration/219546-21kthreadcore09:45:072
259940,0migration/215971-21sh12:05:022
259940,0migration/211562-21cpuspeed_turbos08:40:022
249940,0watchdog/22741-21kthreadcore08:30:092
249940,0watchdog/224238-21df12:10:042
249940,0watchdog/219478-21kthreadcore11:05:082
249940,0watchdog/20-21swapper/209:35:042
179940,0migration/18696-21irqrtprio07:00:071
179940,0migration/16550-21ksmtuned10:35:241
179940,0migration/13564-21kthreadcore10:55:061
179940,0migration/132767-21fschecks_count11:35:031
179940,0migration/130850-21kthreadcore06:50:071
179940,0migration/130065-21kthreadcore07:40:061
179940,0migration/129753-21taskset08:26:191
179940,0migration/127652-21cpuspeed_turbos07:15:041
179940,0migration/127537-21kthreadcore10:10:081
179940,0migration/126454-21kthreadcore12:10:091
179940,0migration/126289-21kthreadcore07:35:071
179940,0migration/125311-21hwlatdetect10:50:041
179940,0migration/121976-21unixbench_multi07:55:151
179940,0migration/11715-21irqrtprio09:55:071
179940,0migration/115678-21taskset09:02:541
179940,0migration/115617-21kthreadcore07:05:081
179940,0migration/110358-21kthreadcore10:40:071
169940,0watchdog/19704-21cut08:35:081
169940,0watchdog/18852-21aten_r1power_cu09:20:001
169940,0watchdog/16663-21kthreadcore08:10:091
169940,0watchdog/15362-21ssh11:55:121
169940,0watchdog/132042-21ssh09:32:561
169940,0watchdog/131242-21ssh09:50:561
169940,0watchdog/122947-21ssh11:47:281
169940,0watchdog/121617-21if_eth007:10:051
169940,0watchdog/117596-21if_eth1.210:25:041
169940,0watchdog/110393-21kthreadcore11:00:081
169940,0watchdog/10-21swapper/110:00:041
169940,0watchdog/10-21swapper/109:35:041
169940,0watchdog/10-21swapper/108:45:041
169940,0watchdog/10-21swapper/107:25:131
149940,0migration/03544-21kthreadcore09:55:080
149940,0migration/030795-21sh09:10:130
149940,0migration/030730-21taskset12:12:120
149940,0migration/029321-21latency_hist08:04:510
149940,0migration/028576-21kthreadcore09:50:070
149940,0migration/022584-21timerandwakeup09:05:160
149940,0migration/019678-21kthreadcore09:25:060
149940,0migration/016787-21sh11:45:020
149940,0migration/01652-21irqrtprio10:15:050
149940,0migration/015693-21kthreadcore08:40:080
149940,0migration/013556-21taskset07:01:170
149940,0migration/013424-21kthreadcore10:20:080
371230,0sleep3420-21open_inodes07:15:123
29725030,0irq/27-eth0-tx-0-21swapper/008:30:020
29715030,0irq/26-eth0-rx-0-21swapper/308:45:023
29715030,0irq/26-eth0-rx-0-21swapper/308:40:013
29715030,0irq/26-eth0-rx-0-21swapper/308:30:013
29715030,0irq/26-eth0-rx-0-21swapper/308:20:063
29715030,0irq/26-eth0-rx-0-21swapper/308:10:043
29715030,0irq/26-eth0-rx-0-21swapper/308:04:523
29715030,0irq/26-eth0-rx-0-21swapper/307:35:053
29715030,0irq/26-eth0-rx-0-21swapper/307:26:323
29715030,0irq/26-eth0-rx-0-21swapper/306:50:003
262299932,0cyclictest8359-21awk07:00:062
262299932,0cyclictest3556-21lldpd07:14:542
262299930,0cyclictest0-21swapper/208:27:032
262289932,0cyclictest3412-21grep07:45:031
262289932,0cyclictest3241-21irqbalance09:25:181
262289932,0cyclictest25588-21awk10:30:061
262289932,0cyclictest22470-21sensors10:05:121
262289932,0cyclictest16044-21awk07:30:081
262289931,0cyclictest16470-21munin-node10:45:001
262289930,0cyclictest781-21grep08:30:081
262269932,0cyclictest3514-21snmpd08:56:590
262269932,0cyclictest24538-21aten_r1power_cu10:50:010
262269932,0cyclictest18826-21awk08:45:060
262269932,0cyclictest17699-21awk10:05:050
262269932,0cyclictest0-21swapper/006:55:020
262269930,0cyclictest5530-21python11:55:130
249930,0watchdog/210547-21cpu08:15:012
179930,0migration/11872-21cpu07:20:021
169930,0watchdog/10-21swapper/111:30:081
169930,0watchdog/10-21swapper/110:20:081
149930,0migration/024666-21sh10:29:570
29715020,0irq/26-eth0-rx-0-21swapper/307:10:023
249920,0watchdog/20-21swapper/208:19:532
169920,0watchdog/10-21swapper/108:39:521
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional