You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 16:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun May 17, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
960324738,0sleep10-21swapper/106:55:101
955323727,0sleep30-21swapper/306:54:323
932923425,0sleep20-21swapper/206:51:592
941823322,0sleep00-21swapper/006:53:010
96979960,0cyclictest0-21swapper/112:18:281
339960,0migration/34130-21timerandwakeup12:10:453
339960,0migration/323829-21sh09:24:233
339960,0migration/322552-21sh10:22:343
29725060,0irq/27-eth0-tx-30793-21munin-node07:35:350
29715060,0irq/26-eth0-rx-7916-21perl10:55:383
29715060,0irq/26-eth0-rx-20466-21yum12:20:453
259960,0migration/2415-21kthreadcore11:10:392
96989955,0cyclictest23201-21ssh09:22:302
96989955,0cyclictest0-21swapper/212:11:302
96989955,0cyclictest0-21swapper/211:52:262
96989955,0cyclictest0-21swapper/210:21:562
96989954,0cyclictest3514-21snmpd07:00:282
96989950,0cyclictest0-21swapper/211:47:512
96989950,0cyclictest0-21swapper/210:48:252
96989950,0cyclictest0-21swapper/209:44:532
96989950,0cyclictest0-21swapper/209:01:132
96979955,0cyclictest0-21swapper/110:32:411
96979955,0cyclictest0-21swapper/109:54:501
96979950,0cyclictest0-21swapper/111:42:311
96979950,0cyclictest0-21swapper/110:09:581
96969955,0cyclictest0-21swapper/011:51:230
96969954,0cyclictest7483-21awk11:55:370
96969950,0cyclictest0-21swapper/012:11:150
96969950,0cyclictest0-21swapper/011:08:490
96969950,0cyclictest0-21swapper/010:56:220
96969950,0cyclictest0-21swapper/010:46:540
4150,0ktimersoftd/00-21swapper/010:08:450
339950,0migration/38858-21munin-node09:55:383
339950,0migration/37632-21taskset09:34:383
339950,0migration/37118-21switchtime08:50:453
339950,0migration/3580-21if_eth110:10:373
339950,0migration/33953-21kthreadcore11:30:393
339950,0migration/332149-21irqrtprio11:50:373
339950,0migration/329968-21aten_r1power_po07:10:343
339950,0migration/329326-21taskset11:46:413
339950,0migration/326929-21kthreadcore10:05:393
339950,0migration/325445-21munin-node07:55:363
339950,0migration/321114-21taskset10:40:423
339950,0migration/321097-21fschecks_time08:40:363
339950,0migration/317938-21taskset07:47:053
339950,0migration/313002-21cpuspeed_turbos08:10:353
339950,0migration/311550-21kthreadcore09:35:403
339950,0migration/310382-21kthreadcore10:15:383
29725050,0irq/27-eth0-tx-8059-21latency_hist09:35:232
29725050,0irq/27-eth0-tx-3514-21snmpd07:17:220
29725050,0irq/27-eth0-tx-19419-21munin-node08:15:330
29725050,0irq/27-eth0-tx-13721-21munin-node08:35:440
29715050,0irq/26-eth0-rx-8200-21hostname08:55:333
29715050,0irq/26-eth0-rx-7794-21irqcore11:35:383
29715050,0irq/26-eth0-rx-6514-21ssh10:54:073
29715050,0irq/26-eth0-rx-5420-21df07:40:343
29715050,0irq/26-eth0-rx-4824-21ssh10:30:403
29715050,0irq/26-eth0-rx-3656-21cut09:50:383
29715050,0irq/26-eth0-rx-32317-21iostat11:10:383
29715050,0irq/26-eth0-rx-30347-21uptime09:45:483
29715050,0irq/26-eth0-rx-24682-21if_err_eth1.210:25:373
29715050,0irq/26-eth0-rx-23092-21grep12:05:353
29715050,0irq/26-eth0-rx-21253-21ssh11:41:403
29715050,0irq/26-eth0-rx-0-21swapper/311:15:443
29715050,0irq/26-eth0-rx-0-21swapper/311:05:363
29715050,0irq/26-eth0-rx-0-21swapper/310:00:393
29715050,0irq/26-eth0-rx-0-21swapper/309:41:563
29715050,0irq/26-eth0-rx-0-21swapper/309:25:433
29715050,0irq/26-eth0-rx-0-21swapper/309:15:013
29715050,0irq/26-eth0-rx-0-21swapper/309:03:523
29715050,0irq/26-eth0-rx-0-21swapper/308:34:103
29715050,0irq/26-eth0-rx-0-21swapper/308:25:383
29715050,0irq/26-eth0-rx-0-21swapper/307:20:343
259950,0migration/28724-21gltestperf09:55:372
249950,0watchdog/20-21swapper/210:15:322
179950,0migration/132285-21latency08:45:421
179950,0migration/132104-21taskset08:21:011
179950,0migration/127346-21kthreadcore07:30:401
179950,0migration/124054-21fschecks_count10:45:351
179950,0migration/116816-21kthreadcore11:00:391
179950,0migration/116455-21kthreadcore07:45:431
179950,0migration/116133-21latency_hist09:40:231
179950,0migration/114419-21kthreadcore08:10:391
179950,0migration/113561-21sh09:55:431
179950,0migration/110540-21munin-node07:40:411
149950,0migration/04294-21kthreadcore10:10:400
149950,0migration/031532-21sh09:08:270
149950,0migration/031321-21aten_r1power_cu11:10:330
149950,0migration/02986-21kthreadcore09:50:380
149950,0migration/024356-21irqcore07:05:380
149950,0migration/022377-21timerandwakeup09:20:450
149950,0migration/021633-21sh11:22:120
149950,0migration/021357-21munin-node08:40:380
149950,0migration/01810-21kthreadcore10:50:390
149950,0migration/017759-21kthreadcore10:20:380
149950,0migration/016047-21latency_hist09:40:230
149950,0migration/015685-21timerandwakeup06:55:460
149950,0migration/013353-21fschecks_time08:10:360
149950,0migration/013188-21sh11:36:300
149950,0migration/011367-21kthreadcore08:55:380
96989944,0cyclictest3556-21lldpd07:17:222
96989944,0cyclictest0-21swapper/207:41:262
96989943,0cyclictest9047-21awk08:55:362
96989943,0cyclictest7975-21awk11:15:372
96989943,0cyclictest7966-21awk08:30:372
96989943,0cyclictest3514-21snmpd09:25:302
96989943,0cyclictest3514-21snmpd09:19:302
96989943,0cyclictest3514-21snmpd07:51:142
96989943,0cyclictest3514-21snmpd07:39:282
96989943,0cyclictest3514-21snmpd07:20:282
96989943,0cyclictest3514-21snmpd07:10:282
96989943,0cyclictest3514-21snmpd06:55:282
96989943,0cyclictest3241-21irqbalance11:40:502
96989943,0cyclictest3241-21irqbalance08:41:012
96989943,0cyclictest3241-21irqbalance08:25:312
96989943,0cyclictest3241-21irqbalance08:20:312
96989943,0cyclictest3241-21irqbalance08:16:112
96989943,0cyclictest3241-21irqbalance08:10:512
96989943,0cyclictest3241-21irqbalance08:05:412
96989943,0cyclictest25144-21awk07:30:382
96989943,0cyclictest24765-21awk10:25:382
96989943,0cyclictest24144-21awk07:05:372
96989943,0cyclictest23522-21awk12:05:372
96989943,0cyclictest14573-21awk08:35:362
96989942,0cyclictest24053-21irqcore11:25:382
96979944,0cyclictest0-21swapper/111:47:051
96979944,0cyclictest0-21swapper/111:18:331
96979944,0cyclictest0-21swapper/111:12:051
96979943,0cyclictest8273-21awk10:55:401
96979943,0cyclictest7921-21awk08:30:371
96979943,0cyclictest3514-21snmpd10:29:011
96979943,0cyclictest3514-21snmpd10:04:311
96979943,0cyclictest3514-21snmpd09:30:301
96979943,0cyclictest3514-21snmpd09:27:301
96979943,0cyclictest3514-21snmpd08:57:301
96979943,0cyclictest3514-21snmpd08:53:151
96979943,0cyclictest3514-21snmpd08:25:291
96979943,0cyclictest3514-21snmpd08:16:291
96979943,0cyclictest3514-21snmpd07:56:291
96979943,0cyclictest3514-21snmpd07:28:281
96979943,0cyclictest3514-21snmpd07:17:281
96979943,0cyclictest3241-21irqbalance12:12:401
96979943,0cyclictest3241-21irqbalance11:51:401
96979943,0cyclictest3241-21irqbalance11:35:501
96979943,0cyclictest3241-21irqbalance09:17:311
96979943,0cyclictest300-21awk08:00:361
96979943,0cyclictest22257-21sadc12:05:211
96979943,0cyclictest15278-21awk12:20:361
96969943,0cyclictest960-21awk09:30:360
96969943,0cyclictest8642-21awk10:15:360
96969943,0cyclictest7951-21awk08:30:370
96969943,0cyclictest7014-21awk08:05:380
96969943,0cyclictest5843-21sadc08:05:230
96969943,0cyclictest3556-21lldpd11:42:540
96969943,0cyclictest3556-21lldpd11:31:240
96969943,0cyclictest3556-21lldpd11:26:240
96969943,0cyclictest3556-21lldpd10:41:240
96969943,0cyclictest3556-21lldpd10:32:240
96969943,0cyclictest3556-21lldpd10:26:540
96969943,0cyclictest3556-21lldpd10:03:540
96969943,0cyclictest3556-21lldpd09:55:540
96969943,0cyclictest3556-21lldpd09:29:230
96969943,0cyclictest3556-21lldpd07:45:530
96969943,0cyclictest3514-21snmpd08:27:590
96969943,0cyclictest3241-21irqbalance11:47:200
96969943,0cyclictest3241-21irqbalance11:18:400
96969943,0cyclictest3241-21irqbalance11:01:400
96969943,0cyclictest3241-21irqbalance08:45:510
96969943,0cyclictest3241-21irqbalance07:20:310
96969943,0cyclictest26922-21awk08:20:360
96969943,0cyclictest25137-21awk09:45:380
96969943,0cyclictest25047-21awk07:30:370
96969943,0cyclictest23400-21awk12:05:360
339940,0migration/34833-21fschecks_time07:15:353
339940,0migration/330347-21taskset07:33:043
339940,0migration/329552-21taskset07:09:343
339940,0migration/319830-21taskset08:36:323
339940,0migration/311152-21kthreadcore10:35:383
339940,0migration/310592-21kthreadcore08:05:403
29725040,0irq/27-eth0-tx-8457-21munin-node10:55:412
29725040,0irq/27-eth0-tx-21164-21ssh11:20:502
29725040,0irq/27-eth0-tx-16586-21munin-node07:00:360
29725040,0irq/27-eth0-tx-1309-21munin-node08:50:420
29725040,0irq/27-eth0-tx-12677-21ssh11:55:472
29725040,0irq/27-eth0-tx-0-21swapper/212:21:232
29725040,0irq/27-eth0-tx-0-21swapper/212:17:312
29725040,0irq/27-eth0-tx-0-21swapper/212:01:592
29725040,0irq/27-eth0-tx-0-21swapper/211:05:322
29725040,0irq/27-eth0-tx-0-21swapper/210:35:352
29725040,0irq/27-eth0-tx-0-21swapper/209:50:232
29725040,0irq/27-eth0-tx-0-21swapper/209:45:352
29725040,0irq/27-eth0-tx-0-21swapper/209:10:272
29725040,0irq/27-eth0-tx-0-21swapper/209:06:262
29725040,0irq/27-eth0-tx-0-21swapper/007:45:220
29715040,0irq/26-eth0-rx-0-21swapper/312:16:433
29715040,0irq/26-eth0-rx-0-21swapper/312:00:383
29715040,0irq/26-eth0-rx-0-21swapper/311:57:303
29715040,0irq/26-eth0-rx-0-21swapper/311:26:203
29715040,0irq/26-eth0-rx-0-21swapper/311:20:273
29715040,0irq/26-eth0-rx-0-21swapper/311:00:443
29715040,0irq/26-eth0-rx-0-21swapper/310:45:343
29715040,0irq/26-eth0-rx-0-21swapper/309:16:073
29715040,0irq/26-eth0-rx-0-21swapper/309:05:323
259940,0migration/24533-21kthreadcore10:10:402
259940,0migration/232740-21cpuspeed_turbos09:30:342
259940,0migration/230003-21kthreadcore08:45:412
259940,0migration/226538-21kthreadcore07:55:402
259940,0migration/219372-21kthreadcore11:00:402
259940,0migration/217936-21fschecks_count07:25:382
259940,0migration/217914-21kthreadcore10:00:382
259940,0migration/21757-21kthreadcore11:30:382
259940,0migration/214115-21kthreadcore07:45:432
249940,0watchdog/25589-21ssh10:51:242
249940,0watchdog/24944-21port_sshpriv08:00:412
249940,0watchdog/232573-21grep10:30:362
249940,0watchdog/229445-21sed10:05:402
249940,0watchdog/219892-21cut10:40:402
249940,0watchdog/20-21swapper/211:37:522
179940,0migration/18296-21fschecks_count10:15:341
179940,0migration/13880-21kthreadcore09:10:391
179940,0migration/131747-21if_eth1.207:35:371
179940,0migration/126832-21kthreadcore09:05:381
179940,0migration/122970-21taskset09:21:501
179940,0migration/122237-21kthreadcore08:40:391
179940,0migration/121090-21kthreadcore10:20:391
179940,0migration/120624-21kthreadcore07:50:401
179940,0migration/117096-21taskset07:23:371
179940,0migration/112326-21taskset08:08:081
169940,0watchdog/128781-21ssh12:06:041
169940,0watchdog/120491-21grep07:00:411
169940,0watchdog/119423-21kthreadcore11:20:401
169940,0watchdog/116998-21tune2fs09:00:371
169940,0watchdog/10-21swapper/111:30:361
169940,0watchdog/10-21swapper/110:40:401
169940,0watchdog/10-21swapper/110:39:201
169940,0watchdog/10-21swapper/109:45:401
169940,0watchdog/10-21swapper/108:35:451
169940,0watchdog/10-21swapper/106:55:371
149940,0migration/06782-21sh09:11:540
149940,0migration/026666-21kthreadcore07:55:400
149940,0migration/018039-21kthreadcore12:20:380
149940,0migration/01781-21kthreadcore07:10:400
149940,0migration/016725-21fschecks_count09:00:360
149940,0migration/013563-21kthreadcore09:15:390
96989932,0cyclictest3514-21snmpd08:50:302
96979932,0cyclictest488-21awk10:10:371
96979932,0cyclictest3514-21snmpd09:35:301
96979932,0cyclictest28588-21needreboot07:05:411
96979932,0cyclictest2173-21grep07:10:401
96969933,0cyclictest16566-21kworker/0:212:00:410
96969932,0cyclictest8456-21awk10:35:350
96969932,0cyclictest3514-21snmpd07:51:290
96969932,0cyclictest16701-21fschecks_count09:40:360
96969930,0cyclictest0-21swapper/007:25:380
35130,0ktimersoftd/30-21swapper/308:04:313
35130,0ktimersoftd/30-21swapper/307:52:473
339930,0migration/34798-21runrttasks07:39:413
29715030,0irq/26-eth0-rx-0-21swapper/308:45:353
29715030,0irq/26-eth0-rx-0-21swapper/308:20:363
29715030,0irq/26-eth0-rx-0-21swapper/307:01:483
169930,0watchdog/17827-21diskmemload11:25:241
169930,0watchdog/126420-21kthreadcore11:05:401
169930,0watchdog/10-21swapper/111:56:281
169930,0watchdog/10-21swapper/110:50:361
96969920,0cyclictest0-21swapper/012:15:230
29715020,0irq/26-eth0-rx-0-21swapper/308:15:333
29715020,0irq/26-eth0-rx-0-21swapper/307:25:443
29715020,0irq/26-eth0-rx-0-21swapper/306:55:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional