You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 18:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Wed Mar 25, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
855424738,0sleep20-21swapper/206:56:392
874823723,0sleep00-21swapper/006:58:530
881723627,0sleep30-21swapper/306:59:443
191360,0ktimersoftd/12189-21perf07:00:131
89489973,0cyclictest32011-21awk09:55:362
89489973,0cyclictest30039-21awk07:15:362
89489972,0cyclictest22994-21awk10:30:362
89489972,0cyclictest1438-21awk08:55:372
89489972,0cyclictest11041-21awk07:25:372
89489963,0cyclictest3556-21lldpd07:12:482
89489963,0cyclictest16510-21awk09:25:372
89489962,0cyclictest6722-21awk10:40:372
89489962,0cyclictest3556-21lldpd12:06:492
89489962,0cyclictest16028-21fschecks_time09:05:352
89489962,0cyclictest0-21swapper/211:10:362
89489962,0cyclictest0-21swapper/210:22:352
89489960,0cyclictest8888-21latency_hist07:00:232
89489960,0cyclictest6420-21kthreadcore11:20:382
89489960,0cyclictest30846-21cpuspeed_turbos10:15:342
89489960,0cyclictest28565-21grep10:10:462
89489960,0cyclictest25550-21kthreadcore10:50:402
89489960,0cyclictest25340-21missed_timers12:10:402
89489960,0cyclictest25175-21grep09:30:372
89489960,0cyclictest23132-21munin-node09:50:362
89489960,0cyclictest19892-21cpuspeed_turbos08:45:332
89489960,0cyclictest1585-21kthreadcore09:35:392
89489960,0cyclictest14694-21munin-node10:05:432
89489960,0cyclictest0-21swapper/212:29:072
89489960,0cyclictest0-21swapper/212:03:262
89489960,0cyclictest0-21swapper/211:49:012
89489960,0cyclictest0-21swapper/211:42:582
89489960,0cyclictest0-21swapper/211:28:002
89489960,0cyclictest0-21swapper/211:06:492
89489960,0cyclictest0-21swapper/211:00:102
89489960,0cyclictest0-21swapper/210:05:142
89489960,0cyclictest0-21swapper/209:17:332
89489960,0cyclictest0-21swapper/209:00:232
89489960,0cyclictest0-21swapper/208:20:232
89479960,0cyclictest0-21swapper/110:50:021
89469960,0cyclictest7062-21diskmemload09:36:370
339960,0migration/36200-21sh09:38:183
339960,0migration/329513-21sh10:12:543
339960,0migration/326146-21sh12:11:053
29715060,0irq/26-eth0-rx-3564-21awk10:56:093
29715060,0irq/26-eth0-rx-23158-21iostat10:30:373
29715060,0irq/26-eth0-rx-17769-21memory11:45:393
29715060,0irq/26-eth0-rx-14795-21perl10:25:353
29715060,0irq/26-eth0-rx-13116-21kthreadcore12:25:373
179960,0migration/111882-21munin-node10:40:451
149960,0migration/06925-21aten_r1power_vo10:00:330
149960,0migration/05704-21sh09:58:090
149960,0migration/03477-21sh11:38:370
149960,0migration/027040-21munin-node11:10:430
149960,0migration/012773-21kernelversion12:25:370
89489952,0cyclictest3556-21lldpd07:06:182
89489952,0cyclictest31970-21awk08:05:372
89489952,0cyclictest22414-21sensors07:30:432
89489952,0cyclictest11053-21sensors08:10:452
89489951,0cyclictest7289-21awk08:35:382
89489951,0cyclictest29393-21fschecks_time11:35:352
89489951,0cyclictest18921-21irqrtprio07:55:402
89489951,0cyclictest12503-21grep08:15:372
89489950,0cyclictest8638-21cut09:40:402
89489950,0cyclictest3359-21ssh12:20:232
89489950,0cyclictest30232-21ssh09:12:132
89489950,0cyclictest26832-21kthreadcore08:00:392
89489950,0cyclictest0-21swapper/212:15:392
89489950,0cyclictest0-21swapper/211:55:522
89489950,0cyclictest0-21swapper/211:50:302
89489950,0cyclictest0-21swapper/211:30:432
89489950,0cyclictest0-21swapper/211:15:322
89489950,0cyclictest0-21swapper/211:00:242
89489950,0cyclictest0-21swapper/210:45:342
89489950,0cyclictest0-21swapper/210:36:442
89489950,0cyclictest0-21swapper/210:25:572
89489950,0cyclictest0-21swapper/209:47:262
89489950,0cyclictest0-21swapper/209:22:072
89489950,0cyclictest0-21swapper/208:30:362
89489950,0cyclictest0-21swapper/208:25:342
89489950,0cyclictest0-21swapper/207:40:342
89489950,0cyclictest0-21swapper/207:35:392
89479955,0cyclictest0-21swapper/109:28:501
89479950,0cyclictest0-21swapper/107:15:271
89469955,0cyclictest0-21swapper/009:32:120
89469955,0cyclictest0-21swapper/009:19:260
89469950,0cyclictest0-21swapper/011:57:340
89469950,0cyclictest0-21swapper/010:40:470
89469950,0cyclictest0-21swapper/010:38:060
89469950,0cyclictest0-21swapper/010:19:490
339950,0migration/38358-21kthreadcore10:00:373
339950,0migration/36007-21kthreadcore12:00:383
339950,0migration/332512-21idleruntime09:15:363
339950,0migration/33186-21latency_hist07:20:233
339950,0migration/330988-21kthreadcore11:35:393
339950,0migration/33028-21runrttasks11:16:043
339950,0migration/324838-21irqrtprio09:30:373
339950,0migration/322573-21munin-node07:10:353
339950,0migration/320121-21fschecks_count08:45:343
339950,0migration/318732-21munin-node07:55:393
339950,0migration/318246-21taskset08:18:013
339950,0migration/316303-21latency07:50:393
339950,0migration/315984-21unixbench-2d07:25:453
339950,0migration/314617-21munin-node07:00:423
339950,0migration/313248-21munin-node11:25:333
339950,0migration/313070-21latency_hist11:05:213
339950,0migration/311540-21taskset08:12:213
339950,0migration/311008-21kthreadcore08:35:403
339950,0migration/310373-21timerwakeupswit11:40:443
29725050,0irq/27-eth0-tx-479-21munin-node08:55:350
29725050,0irq/27-eth0-tx-10134-21munin-node07:25:410
29725050,0irq/27-eth0-tx-0-21swapper/008:31:550
29725050,0irq/27-eth0-tx-0-21swapper/007:30:420
29715050,0irq/26-eth0-rx-6881-21irqcore10:40:373
29715050,0irq/26-eth0-rx-6437-21cut11:20:383
29715050,0irq/26-eth0-rx-4466-21iostat_ios12:20:373
29715050,0irq/26-eth0-rx-4221-21port_sshpriv08:05:423
29715050,0irq/26-eth0-rx-31989-21basename09:55:353
29715050,0irq/26-eth0-rx-26397-21port_sshpriv11:30:413
29715050,0irq/26-eth0-rx-1552-21port_sshpriv11:55:413
29715050,0irq/26-eth0-rx-14526-21hwlatdetect10:45:353
29715050,0irq/26-eth0-rx-13371-21aten2.4-expect11:05:333
29715050,0irq/26-eth0-rx-0-21swapper/312:15:353
29715050,0irq/26-eth0-rx-0-21swapper/312:05:463
29715050,0irq/26-eth0-rx-0-21swapper/310:50:563
29715050,0irq/26-eth0-rx-0-21swapper/310:36:533
29715050,0irq/26-eth0-rx-0-21swapper/310:16:573
29715050,0irq/26-eth0-rx-0-21swapper/309:50:413
29715050,0irq/26-eth0-rx-0-21swapper/309:47:243
29715050,0irq/26-eth0-rx-0-21swapper/309:14:123
29715050,0irq/26-eth0-rx-0-21swapper/307:45:393
28027250,0sleep028032-21sh11:34:070
179950,0migration/15962-21latency_hist10:20:211
179950,0migration/131875-21diskmemload11:15:371
179950,0migration/130388-21cpuspeed_turbos10:35:331
179950,0migration/12924-21kthreadcore09:15:391
179950,0migration/125378-21kthreadcore07:10:401
179950,0migration/124970-21kthreadcore12:10:391
179950,0migration/115434-21cpuspeed_turbos09:45:321
179950,0migration/113346-21fschecks_count11:25:341
179950,0migration/113170-21timerwakeupswit09:40:461
179950,0migration/112767-21needreboot09:00:411
179950,0migration/112620-21fschecks_time08:15:371
179950,0migration/112003-21sh11:23:421
179950,0migration/110038-21sh12:21:581
169950,0watchdog/120226-21cut07:05:411
149950,0migration/08924-21kthreadcore12:00:390
149950,0migration/08880-21kthreadcore09:40:400
149950,0migration/08044-21kthreadcore11:00:380
149950,0migration/07619-21kthreadcore11:20:380
149950,0migration/07518-21taskset09:20:330
149950,0migration/04632-21irqrtprio07:20:380
149950,0migration/03269-21latency_hist07:20:230
149950,0migration/031357-21cpuspeed_turbos08:05:340
149950,0migration/031174-21kthreadcore08:50:400
149950,0migration/029854-21fschecks_time11:15:330
149950,0migration/028301-21fschecks_count12:15:350
149950,0migration/026117-21hwlatdetect08:25:360
149950,0migration/025841-21munin-node11:50:400
149950,0migration/025467-21kthreadcore10:30:380
149950,0migration/024227-21fschecks_time09:10:370
149950,0migration/023503-21kthreadcore12:10:390
149950,0migration/023347-21gltestperf10:10:370
149950,0migration/022248-21taskset09:48:360
149950,0migration/021262-21munin-node07:05:430
149950,0migration/020519-21kthreadcore07:55:400
149950,0migration/019961-21sh10:46:080
149950,0migration/016247-21kthreadcore08:40:410
149950,0migration/015988-21fschecks_time09:05:350
149950,0migration/01521-21kthreadcore07:40:400
89489941,0cyclictest11858-21cat07:50:362
89489940,0cyclictest0-21swapper/208:50:392
89489940,0cyclictest0-21swapper/207:45:442
89489940,0cyclictest0-21swapper/207:20:402
89479944,0cyclictest0-21swapper/111:38:541
89479944,0cyclictest0-21swapper/110:00:321
89479943,0cyclictest6339-21awk08:10:391
89479943,0cyclictest5409-21ps11:40:371
89479943,0cyclictest3556-21lldpd12:17:191
89479943,0cyclictest3514-21snmpd07:00:471
89479943,0cyclictest30912-21awk07:40:371
89479943,0cyclictest26178-21awk08:25:361
89479943,0cyclictest23011-21awk10:30:361
89479943,0cyclictest20462-21awk08:45:351
89479943,0cyclictest15620-21awk10:05:371
89479943,0cyclictest14167-21awk11:05:361
89469943,0cyclictest3556-21lldpd10:55:490
89469943,0cyclictest3556-21lldpd10:55:190
89469943,0cyclictest3241-21irqbalance09:53:200
89469943,0cyclictest3241-21irqbalance09:25:510
89469943,0cyclictest3241-21irqbalance08:45:410
89469943,0cyclictest3241-21irqbalance08:20:410
89469943,0cyclictest24321-21awk07:35:370
89469943,0cyclictest15548-21awk10:05:370
89469943,0cyclictest15111-21awk10:25:360
89469943,0cyclictest14208-21awk11:05:370
89469943,0cyclictest12923-21awk12:05:360
89469943,0cyclictest12909-21awk08:15:390
89469943,0cyclictest10089-21awk07:00:370
339940,0migration/39993-21kthreadcore09:40:403
339940,0migration/38230-21kthreadcore07:20:393
339940,0migration/37260-21irqcore10:20:353
339940,0migration/35529-21kthreadcore08:55:393
339940,0migration/332266-21kthreadcore07:40:403
339940,0migration/327000-21kthreadcore07:35:403
339940,0migration/324534-21cpu08:00:343
339940,0migration/318283-21kthreadcore09:05:393
339940,0migration/31705-21kthreadcore08:30:383
29725040,0irq/27-eth0-tx-0-21swapper/009:00:280
29725040,0irq/27-eth0-tx-0-21swapper/008:35:420
29725040,0irq/27-eth0-tx-0-21swapper/008:00:420
29715040,0irq/26-eth0-rx-17304-21fschecks_time07:30:353
29715040,0irq/26-eth0-rx-0-21swapper/311:52:563
29715040,0irq/26-eth0-rx-0-21swapper/311:10:313
29715040,0irq/26-eth0-rx-0-21swapper/310:05:403
29715040,0irq/26-eth0-rx-0-21swapper/309:25:283
29715040,0irq/26-eth0-rx-0-21swapper/309:20:473
29715040,0irq/26-eth0-rx-0-21swapper/309:00:333
29715040,0irq/26-eth0-rx-0-21swapper/308:40:393
179940,0migration/17587-21kernelversion08:35:391
179940,0migration/16874-21kthreadcore11:00:381
179940,0migration/15359-21switchtime08:30:451
179940,0migration/129531-21run-parts09:51:221
179940,0migration/127341-21kthreadcore10:10:411
179940,0migration/127172-21sh11:52:501
179940,0migration/125473-21kthreadcore11:30:381
179940,0migration/124791-21fschecks_count08:00:361
179940,0migration/123926-21taskset07:58:071
179940,0migration/123741-21kthreadcore11:10:371
179940,0migration/118915-21kthreadcore07:30:381
179940,0migration/115950-21fschecks_time09:05:351
179940,0migration/11405-21kthreadcore09:55:381
179940,0migration/113918-21kthreadcore07:25:401
179940,0migration/113757-21kthreadcore11:45:381
179940,0migration/11065-21kthreadcore09:35:391
169940,0watchdog/130376-21ssh09:32:361
169940,0watchdog/126672-21cut10:50:401
169940,0watchdog/124109-21fschecks_time09:10:361
169940,0watchdog/113676-21ssh09:20:561
169940,0watchdog/10-21swapper/110:55:361
169940,0watchdog/10-21swapper/108:40:401
149940,0migration/06050-21gltestperf08:10:370
149940,0migration/04778-21kthreadcore12:20:380
149940,0migration/022482-21aten_r1power_cu07:10:340
89479933,0cyclictest3556-21lldpd07:55:181
89479933,0cyclictest0-21swapper/110:25:361
89479932,0cyclictest5355-21awk07:45:371
89479932,0cyclictest32185-21grep08:50:461
89479932,0cyclictest19529-21awk08:20:371
89479932,0cyclictest13721-21kthreadcore12:05:381
89479932,0cyclictest11500-21basename12:25:311
89479930,0cyclictest0-21swapper/108:09:321
89469933,0cyclictest30604-21kworker/0:011:45:270
89469933,0cyclictest30604-21kworker/0:011:40:250
89469933,0cyclictest30604-21kworker/0:011:25:270
89469933,0cyclictest30604-21kworker/0:010:20:230
89469933,0cyclictest30604-21kworker/0:007:50:300
89469933,0cyclictest30604-21kworker/0:007:45:260
29715030,0irq/26-eth0-rx-0-21swapper/308:50:343
29715030,0irq/26-eth0-rx-0-21swapper/308:25:333
29715030,0irq/26-eth0-rx-0-21swapper/308:20:343
249930,0watchdog/20-21swapper/208:40:402
179930,0migration/19040-21kthreadcore10:20:361
179930,0migration/16423-21timerwakeupswit08:55:441
169930,0watchdog/10-21swapper/112:00:441
169930,0watchdog/10-21swapper/111:55:321
169930,0watchdog/10-21swapper/107:35:411
169930,0watchdog/10-21swapper/107:20:331
29715020,0irq/26-eth0-rx-0-21swapper/307:05:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional