You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-06 - 23:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Jun 06, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450470,0irq/25-eth10-21swapper/306:51:313
1960923223,0sleep20-21swapper/206:52:152
1961722723,0sleep00-21swapper/006:52:210
1940822723,0sleep10-21swapper/106:49:541
339960,0migration/39229-21taskset11:07:133
339960,0migration/332733-21sh12:22:273
339960,0migration/332720-21sh11:20:313
339960,0migration/326293-21sh09:17:043
339960,0migration/325047-21sh08:55:313
339960,0migration/32501-21fschecks_count10:43:413
339960,0migration/324622-21sh11:35:523
29715060,0irq/26-eth0-rx-8778-21sh11:47:033
197839966,0cyclictest0-21swapper/012:18:270
19160,0ktimersoftd/117941-21diskmemload11:08:241
149960,0migration/018697-21sh11:33:420
339950,0migration/38628-21taskset11:26:023
339950,0migration/38468-21idleruntime07:08:443
339950,0migration/34505-21kthreadcore07:53:453
339950,0migration/33458-21irqcore10:23:443
339950,0migration/331060-21missed_timers11:58:483
339950,0migration/330227-21taskset08:37:353
339950,0migration/328534-21munin-node08:08:503
339950,0migration/328417-21kthreadcore06:58:453
339950,0migration/325189-21runrttasks10:56:193
339950,0migration/324923-21kthreadcore06:53:443
339950,0migration/324214-21kthreadcore07:43:443
339950,0migration/323743-21sh11:13:493
339950,0migration/320198-21unixbench-2d07:13:503
339950,0migration/318331-21munin-node12:13:433
339950,0migration/314608-21munin-node08:48:453
339950,0migration/314258-21kthreadcore08:23:473
339950,0migration/311828-21kthreadcore11:28:443
339950,0migration/311564-21hddtemp_smartct09:48:423
339950,0migration/311419-21kthreadcore07:33:443
339950,0migration/31101-21cpuspeed_turbos07:03:403
29725050,0irq/27-eth0-tx-26068-21ssh10:38:062
29725050,0irq/27-eth0-tx-18155-21df_abs11:33:402
29725050,0irq/27-eth0-tx-17313-21munin-node12:13:492
29725050,0irq/27-eth0-tx-116672sleep008:48:410
29725050,0irq/27-eth0-tx-1159-21runrttasks11:02:162
29725050,0irq/27-eth0-tx-10719-21sleep09:28:282
29725050,0irq/27-eth0-tx-10573-21munin-node10:08:402
29725050,0irq/27-eth0-tx-0-21swapper/211:59:062
29725050,0irq/27-eth0-tx-0-21swapper/211:44:042
29725050,0irq/27-eth0-tx-0-21swapper/211:32:462
29725050,0irq/27-eth0-tx-0-21swapper/211:19:362
29725050,0irq/27-eth0-tx-0-21swapper/211:13:422
29725050,0irq/27-eth0-tx-0-21swapper/210:39:022
29725050,0irq/27-eth0-tx-0-21swapper/209:37:402
29725050,0irq/27-eth0-tx-0-21swapper/209:23:202
29725050,0irq/27-eth0-tx-0-21swapper/209:16:272
29725050,0irq/27-eth0-tx-0-21swapper/008:53:380
29725050,0irq/27-eth0-tx-0-21swapper/008:13:430
29725050,0irq/27-eth0-tx-0-21swapper/007:38:410
29715050,0irq/26-eth0-rx-8360-21sort10:03:503
29715050,0irq/26-eth0-rx-8041-21cut09:23:453
29715050,0irq/26-eth0-rx-423-21unixbench_singl09:58:523
29715050,0irq/26-eth0-rx-31200-21missed_timers11:38:463
29715050,0irq/26-eth0-rx-2764-21munin-node09:03:413
29715050,0irq/26-eth0-rx-26730-21fschecks_count10:58:413
29715050,0irq/26-eth0-rx-18444-21aten_r1power_cu10:33:383
29715050,0irq/26-eth0-rx-1622-21entropy12:03:383
29715050,0irq/26-eth0-rx-12066-21tr09:08:453
29715050,0irq/26-eth0-rx-0-21swapper/311:53:443
29715050,0irq/26-eth0-rx-0-21swapper/311:48:503
29715050,0irq/26-eth0-rx-0-21swapper/311:12:453
29715050,0irq/26-eth0-rx-0-21swapper/310:38:473
29715050,0irq/26-eth0-rx-0-21swapper/310:29:053
29715050,0irq/26-eth0-rx-0-21swapper/310:13:493
29715050,0irq/26-eth0-rx-0-21swapper/309:33:463
29715050,0irq/26-eth0-rx-0-21swapper/309:29:123
29715050,0irq/26-eth0-rx-0-21swapper/309:21:073
29715050,0irq/26-eth0-rx-0-21swapper/308:38:453
27150,0ktimersoftd/20-21swapper/206:53:302
259950,0migration/28351-21unixbench-2d10:23:512
259950,0migration/232158-21ntp_offset10:18:462
259950,0migration/230800-21cpuspeed_turbos08:38:402
259950,0migration/225471-21taskset08:56:332
259950,0migration/224112-21cpuspeed_turbos08:33:402
259950,0migration/220224-21kthreadcore11:53:432
259950,0migration/218393-21munin-node08:28:452
259950,0migration/216868-21kthreadcore07:38:472
259950,0migration/210486-21aten_r1power_po10:28:392
249950,0watchdog/27902-21sh12:05:142
249950,0watchdog/217031-21ssh11:11:382
249950,0watchdog/212563-21tr12:08:462
197959955,0cyclictest17941-21diskmemload11:04:382
197959950,0cyclictest0-21swapper/211:51:562
197859955,0cyclictest0-21swapper/110:27:341
197859955,0cyclictest0-21swapper/108:43:501
197859950,0cyclictest0-21swapper/112:19:491
197859950,0cyclictest0-21swapper/112:06:061
197859950,0cyclictest0-21swapper/109:03:041
197839955,0cyclictest0-21swapper/011:52:260
197839955,0cyclictest0-21swapper/010:16:250
197839954,0cyclictest3241-21irqbalance09:03:560
197839954,0cyclictest2812-21awk07:28:440
197839950,0cyclictest0-21swapper/012:03:380
19150,0ktimersoftd/10-21swapper/110:12:541
179950,0migration/1878-21sh11:42:521
179950,0migration/125666-21sh11:18:221
179950,0migration/118870-21sh09:13:341
179950,0migration/118571-21sh10:33:391
169950,0watchdog/129474-21kthreadcore09:38:461
149950,0migration/09272-21taskset11:27:560
149950,0migration/08489-21kthreadcore08:18:450
149950,0migration/08249-21sh11:45:330
149950,0migration/0786-21latency_hist07:03:290
149950,0migration/032576-21sh11:40:490
149950,0migration/03227-21kthreadcore11:03:440
149950,0migration/03171-21cpuspeed_turbos09:23:400
149950,0migration/031507-21kthreadcore07:48:470
149950,0migration/030298-21dump-pmu-power08:38:230
149950,0migration/028993-21kthreadcore10:58:450
149950,0migration/025124-21sh09:14:050
149950,0migration/024627-21kthreadcore08:08:460
149950,0migration/023331-21kthreadcore09:53:460
149950,0migration/022980-21kthreadcore07:18:460
149950,0migration/022881-21munin-node12:13:460
149950,0migration/019917-21kthreadcore11:53:430
149950,0migration/016999-21kthreadcore07:13:440
149950,0migration/016543-21timerandwakeup09:08:520
149950,0migration/015348-21kthreadcore09:48:460
149950,0migration/015205-21kthreadcore10:08:450
149950,0migration/014920-21kthreadcore09:28:450
149950,0migration/011785-21kthreadcore10:28:450
339940,0migration/31332-21kthreadcore08:13:453
339940,0migration/311341-21latency_hist08:48:283
29725040,0irq/27-eth0-tx-3284-21munin-node09:03:432
29725040,0irq/27-eth0-tx-28874-21kthreadcore09:58:452
29725040,0irq/27-eth0-tx-0-21swapper/211:38:332
29725040,0irq/27-eth0-tx-0-21swapper/210:53:392
29725040,0irq/27-eth0-tx-0-21swapper/210:44:532
29725040,0irq/27-eth0-tx-0-21swapper/210:14:532
29725040,0irq/27-eth0-tx-0-21swapper/210:04:482
29725040,0irq/27-eth0-tx-0-21swapper/209:49:102
29725040,0irq/27-eth0-tx-0-21swapper/208:58:412
29725040,0irq/27-eth0-tx-0-21swapper/008:28:400
29725040,0irq/27-eth0-tx-0-21swapper/007:25:030
29715040,0irq/26-eth0-rx-0-21swapper/312:10:103
29715040,0irq/26-eth0-rx-0-21swapper/310:49:103
29715040,0irq/26-eth0-rx-0-21swapper/310:18:553
29715040,0irq/26-eth0-rx-0-21swapper/310:08:433
29715040,0irq/26-eth0-rx-0-21swapper/309:53:463
29715040,0irq/26-eth0-rx-0-21swapper/309:43:423
29715040,0irq/26-eth0-rx-0-21swapper/309:38:583
29715040,0irq/26-eth0-rx-0-21swapper/308:58:493
259940,0migration/25433-21kthreadcore07:53:452
259940,0migration/25112-21kthreadcore09:43:452
259940,0migration/227407-21kthreadcore12:18:432
259940,0migration/222923-21aten_r1power_cu08:08:402
259940,0migration/221973-21munin-node07:43:392
259940,0migration/216790-21kthreadcore07:13:442
259940,0migration/214072-21kthreadcore08:23:472
259940,0migration/212761-21irqrtprio08:48:442
259940,0migration/21026-21timerandwakeup07:23:512
259940,0migration/210249-21sh10:48:392
249940,0watchdog/231594-21cut07:48:472
249940,0watchdog/229473-21kthreadcore09:38:462
249940,0watchdog/220977-21munin-node07:18:432
249940,0watchdog/216942-21ssh09:28:502
249940,0watchdog/214653-21kthreadcore09:08:462
249940,0watchdog/20-21swapper/208:13:512
249940,0watchdog/20-21swapper/208:03:472
197959943,0cyclictest9485-21awk07:33:422
197959943,0cyclictest3514-21snmpd08:45:012
197959943,0cyclictest3514-21snmpd07:31:312
197959943,0cyclictest29720-21ps06:58:452
197959943,0cyclictest2500-21awk11:23:422
197959943,0cyclictest19823-21awk09:53:442
197859944,0cyclictest0-21swapper/112:13:401
197859944,0cyclictest0-21swapper/110:44:451
197859943,0cyclictest3556-21lldpd11:49:531
197859943,0cyclictest3556-21lldpd07:12:221
197859943,0cyclictest3556-21lldpd07:03:521
197859943,0cyclictest3556-21lldpd07:01:521
197859943,0cyclictest31393-21awk08:38:421
197859943,0cyclictest30431-21awk08:13:421
197859943,0cyclictest29462-21awk07:48:441
197859943,0cyclictest28563-21awk07:23:441
197859943,0cyclictest19716-21awk09:53:431
197859943,0cyclictest12515-21awk08:48:441
197839944,0cyclictest0-21swapper/010:45:450
197839944,0cyclictest0-21swapper/010:36:460
197839943,0cyclictest3514-21snmpd11:15:020
197839943,0cyclictest3514-21snmpd09:01:170
197839943,0cyclictest3241-21irqbalance09:38:460
197839943,0cyclictest3123-21awk10:23:430
197839943,0cyclictest27601-21awk06:58:430
197839943,0cyclictest26490-21awk11:58:440
197839943,0cyclictest11469-21awk08:23:440
197839943,0cyclictest10873-21awk11:08:430
197839943,0cyclictest10473-21awk07:58:430
179940,0migration/19966-21taskset08:19:211
179940,0migration/15024-21kthreadcore07:28:451
179940,0migration/14853-21kthreadcore09:23:441
179940,0migration/13402-21gltestperf09:43:421
179940,0migration/131637-21kthreadcore09:58:461
179940,0migration/131097-21needreboot11:58:481
179940,0migration/129987-21kthreadcore09:18:461
179940,0migration/129921-21kthreadcore11:18:441
179940,0migration/127679-21kthreadcore10:58:451
179940,0migration/127106-21taskset07:20:291
179940,0migration/126481-21kthreadcore08:08:471
179940,0migration/125529-21sh10:16:081
179940,0migration/124417-21fschecks_count08:33:411
179940,0migration/122659-21kthreadcore10:53:451
179940,0migration/12244-21latency_hist09:03:281
179940,0migration/121135-21kthreadcore09:33:451
179940,0migration/119528-21kthreadcore11:33:441
179940,0migration/119087-21kthreadcore08:28:451
179940,0migration/117415-21sh09:29:461
179940,0migration/115451-21kthreadcore10:48:451
179940,0migration/114691-21sshd07:13:401
179940,0migration/114246-21kthreadcore07:58:461
179940,0migration/113966-21kthreadcore09:48:451
179940,0migration/112867-21kthreadcore09:08:461
179940,0migration/111513-21if_eth1.208:23:451
179940,0migration/110301-21munin-node12:08:441
169940,0watchdog/17943-21munin-node10:03:461
169940,0watchdog/14997-21kthreadcore11:43:461
169940,0watchdog/126701-21ssh10:18:381
169940,0watchdog/10-21swapper/108:03:471
169940,0watchdog/10-21swapper/107:38:471
149940,0migration/03270-21df_inode07:53:410
149940,0migration/03087-21fschecks_count09:43:410
149940,0migration/024219-21kthreadcore06:53:440
29725030,0irq/27-eth0-tx-0-21swapper/008:43:500
29725030,0irq/27-eth0-tx-0-21swapper/008:03:400
29725030,0irq/27-eth0-tx-0-21swapper/007:43:400
29715030,0irq/26-eth0-rx-0-21swapper/308:28:353
29715030,0irq/26-eth0-rx-0-21swapper/308:18:383
29715030,0irq/26-eth0-rx-0-21swapper/307:58:443
29715030,0irq/26-eth0-rx-0-21swapper/307:38:423
29715030,0irq/26-eth0-rx-0-21swapper/307:25:543
249930,0watchdog/20-21swapper/207:58:512
249930,0watchdog/20-21swapper/207:08:472
197959932,0cyclictest9561-21sensors08:18:492
197859932,0cyclictest2484-21awk11:23:411
197859932,0cyclictest24030-21sensors08:53:501
197859932,0cyclictest22806-21awk07:43:421
197859930,0cyclictest3271-21diskstats07:53:411
197839932,0cyclictest9950-21fschecks_time12:08:420
197839932,0cyclictest3514-21snmpd07:36:290
197839932,0cyclictest3495-21awk10:03:430
197839932,0cyclictest32226-21sensors10:38:500
197839932,0cyclictest31531-21ntp_kernel_err11:18:460
197839932,0cyclictest27732-21awk09:58:430
197839932,0cyclictest19165-21awk10:53:430
197839932,0cyclictest17599-21latency_hist11:33:270
197839932,0cyclictest16012-21timerandwakeup10:48:500
197839930,0cyclictest30542-21munin-node08:38:420
197839930,0cyclictest27510-21diskstats09:18:410
169930,0watchdog/129256-21kthreadcore10:38:461
169930,0watchdog/10-21swapper/111:53:421
169930,0watchdog/10-21swapper/111:28:301
169930,0watchdog/10-21swapper/111:08:461
169930,0watchdog/10-21swapper/110:28:461
169930,0watchdog/10-21swapper/107:33:471
169930,0watchdog/10-21swapper/106:53:391
149930,0migration/013938-21runrttasks07:12:040
35120,0ktimersoftd/322629-21kthreadcore07:18:463
29715020,0irq/26-eth0-rx-0-21swapper/308:03:433
29715020,0irq/26-eth0-rx-0-21swapper/307:48:313
29715020,0irq/26-eth0-rx-0-21swapper/307:28:343
197959921,0cyclictest584-21latency_hist07:03:292
197839921,0cyclictest0-21swapper/010:18:310
197839921,0cyclictest0-21swapper/009:33:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional