You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 18:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Jul 18, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
464523725,0sleep30-21swapper/306:49:113
447723624,0sleep00-21swapper/006:47:120
466023526,0sleep20-21swapper/206:49:222
464923223,0sleep10-21swapper/106:49:131
47419960,0cyclictest10953-21ssh09:11:241
339960,0migration/37568-21latency10:44:453
339960,0migration/332608-21aten_r1power_fr07:34:393
339960,0migration/332553-21sh10:40:363
339960,0migration/331891-21irqrtprio09:44:413
339960,0migration/326863-21sh10:58:573
339960,0migration/320831-21sh09:36:413
339960,0migration/312411-21sh11:45:423
339960,0migration/312411-21sh11:45:423
339960,0migration/311933-21munin-node07:14:513
29715060,0irq/26-eth0-rx-0-21swapper/311:01:133
19160,0ktimersoftd/12771-21diskmemload10:41:351
149960,0migration/010265-21pmu-power11:24:480
47429955,0cyclictest2771-21diskmemload11:59:072
47429955,0cyclictest0-21swapper/211:26:582
47429955,0cyclictest0-21swapper/211:03:572
47429955,0cyclictest0-21swapper/210:48:582
47429950,0cyclictest0-21swapper/209:20:222
47419955,0cyclictest0-21swapper/110:54:501
47419955,0cyclictest0-21swapper/109:56:491
47419955,0cyclictest0-21swapper/109:01:091
47419950,0cyclictest0-21swapper/109:32:031
339950,0migration/332488-21munin-node07:09:443
339950,0migration/33116-21sh08:49:403
339950,0migration/328683-21fschecks_time09:04:403
339950,0migration/325393-21fschecks_time10:19:413
339950,0migration/317100-21kthreadcore08:34:453
339950,0migration/316853-21kthreadcore11:29:443
339950,0migration/31444-21kthreadcore10:04:453
339950,0migration/312270-21fschecks_time06:54:393
339950,0migration/311891-21kthreadcore10:29:453
339950,0migration/311808-21kthreadcore08:29:463
29725050,0irq/27-eth0-tx-4786-21cut11:04:432
29725050,0irq/27-eth0-tx-11456-21kthreadcore09:49:452
29725050,0irq/27-eth0-tx-0-21swapper/212:09:082
29725050,0irq/27-eth0-tx-0-21swapper/212:00:222
29725050,0irq/27-eth0-tx-0-21swapper/211:31:552
29725050,0irq/27-eth0-tx-0-21swapper/210:25:192
29725050,0irq/27-eth0-tx-0-21swapper/209:18:012
29725050,0irq/27-eth0-tx-0-21swapper/209:13:422
29725050,0irq/27-eth0-tx-0-21swapper/209:08:082
29725050,0irq/27-eth0-tx-0-21swapper/008:27:010
29725050,0irq/27-eth0-tx-0-21swapper/007:44:410
29725050,0irq/27-eth0-tx-0-21swapper/007:20:310
29725050,0irq/27-eth0-tx-0-21swapper/007:18:310
29715050,0irq/26-eth0-rx-5919-21kthreadcore11:04:443
29715050,0irq/26-eth0-rx-5148-21fschecks_time11:24:413
29715050,0irq/26-eth0-rx-29550-21kthreadcore08:19:443
29715050,0irq/26-eth0-rx-25782-21users08:59:503
29715050,0irq/26-eth0-rx-22233-21python10:14:513
29715050,0irq/26-eth0-rx-13680-21grep10:49:453
29715050,0irq/26-eth0-rx-13098-21grep07:19:413
29715050,0irq/26-eth0-rx-0-21swapper/312:17:313
29715050,0irq/26-eth0-rx-0-21swapper/312:10:223
29715050,0irq/26-eth0-rx-0-21swapper/312:02:313
29715050,0irq/26-eth0-rx-0-21swapper/311:54:503
29715050,0irq/26-eth0-rx-0-21swapper/311:22:273
29715050,0irq/26-eth0-rx-0-21swapper/311:15:473
29715050,0irq/26-eth0-rx-0-21swapper/311:13:283
29715050,0irq/26-eth0-rx-0-21swapper/310:35:103
29715050,0irq/26-eth0-rx-0-21swapper/310:28:583
29715050,0irq/26-eth0-rx-0-21swapper/310:09:423
29715050,0irq/26-eth0-rx-0-21swapper/309:59:513
29715050,0irq/26-eth0-rx-0-21swapper/309:57:263
29715050,0irq/26-eth0-rx-0-21swapper/309:49:453
29715050,0irq/26-eth0-rx-0-21swapper/309:39:403
29715050,0irq/26-eth0-rx-0-21swapper/309:19:453
29715050,0irq/26-eth0-rx-0-21swapper/309:14:543
29715050,0irq/26-eth0-rx-0-21swapper/309:13:283
29715050,0irq/26-eth0-rx-0-21swapper/308:24:473
29715050,0irq/26-eth0-rx-0-21swapper/307:29:453
259950,0migration/2830-21gltestperf07:34:412
249950,0watchdog/27160-21cut06:49:462
249950,0watchdog/225148-21netstat08:59:452
179950,0migration/16855-21sh10:07:191
179950,0migration/15920-21sh12:02:211
179950,0migration/15430-21idleruntime11:24:421
179950,0migration/132444-21kthreadcore11:39:471
179950,0migration/129809-21irqrtprio11:19:431
179950,0migration/12902-21idleruntime10:44:411
179950,0migration/123543-21switchtime10:34:511
179950,0migration/111967-21aten2.4-expect11:09:381
179950,0migration/110491-21kthreadcore07:14:451
169950,0watchdog/123247-21cut11:54:411
149950,0migration/09341-21kthreadcore09:49:450
149950,0migration/08967-21kthreadcore11:44:430
149950,0migration/08967-21kthreadcore11:44:430
149950,0migration/032018-21aten_r1power_fr10:04:390
149950,0migration/030336-21kthreadcore08:19:440
149950,0migration/030247-21munin-node09:24:430
149950,0migration/029985-21kthreadcore07:54:450
149950,0migration/029865-21kthreadcore09:04:430
149950,0migration/026990-21taskset10:59:150
149950,0migration/022534-21kthreadcore07:24:450
149950,0migration/019383-21kthreadcore12:09:440
149950,0migration/017269-21kthreadcore09:54:450
149950,0migration/017093-21fschecks_time10:14:420
149950,0migration/016209-21kthreadcore11:49:450
149950,0migration/015560-21kthreadcore09:34:450
149950,0migration/012975-21fschecks_count09:14:380
149950,0migration/012767-21unixbench_multi07:39:510
149950,0migration/012462-21kthreadcore10:29:450
8215040,0irq/24-0000:00:10307-21latency_hist10:49:272
8215040,0irq/24-0000:00:0-21swapper/212:14:272
8215040,0irq/24-0000:00:0-21swapper/211:34:272
47429943,0cyclictest6432-21awk09:29:422
47429943,0cyclictest3556-21lldpd10:04:332
47429943,0cyclictest3556-21lldpd09:39:322
47429943,0cyclictest3556-21lldpd08:55:322
47429943,0cyclictest3556-21lldpd08:45:012
47429943,0cyclictest3556-21lldpd08:01:312
47429943,0cyclictest3556-21lldpd07:43:312
47429943,0cyclictest30821-21awk11:39:452
47429943,0cyclictest29500-21awk11:19:422
47429943,0cyclictest21113-21awk11:14:412
47429943,0cyclictest18530-21awk10:34:432
47429943,0cyclictest15360-21awk08:09:442
47419943,0cyclictest7657-21awk09:49:421
47419943,0cyclictest6782-21awk11:44:411
47419943,0cyclictest6782-21awk11:44:411
47419943,0cyclictest3556-21lldpd12:05:031
47419943,0cyclictest3556-21lldpd06:52:311
47419943,0cyclictest32535-21awk07:09:441
47419943,0cyclictest3241-21irqbalance11:50:051
47419943,0cyclictest3241-21irqbalance11:32:451
47419943,0cyclictest31554-21awk09:44:401
47419943,0cyclictest26739-21awk07:29:421
47419943,0cyclictest24494-21awk09:59:411
47419943,0cyclictest23290-21awk09:39:421
47419943,0cyclictest21188-21awk11:14:411
47419943,0cyclictest17335-21awk10:14:441
47419943,0cyclictest14708-21grep08:29:521
47409943,0cyclictest8034-21awk12:04:420
47409943,0cyclictest3556-21lldpd08:44:310
47409943,0cyclictest31569-21awk09:44:400
47409943,0cyclictest26949-21awk10:39:420
339940,0migration/325346-21taskset07:26:023
339940,0migration/313932-21runrttasks07:44:413
29725040,0irq/27-eth0-tx-32538-21munin-node07:34:430
29725040,0irq/27-eth0-tx-21142-21munin-node08:14:440
29725040,0irq/27-eth0-tx-0-21swapper/212:09:422
29725040,0irq/27-eth0-tx-0-21swapper/211:49:382
29725040,0irq/27-eth0-tx-0-21swapper/211:44:372
29725040,0irq/27-eth0-tx-0-21swapper/211:44:372
29725040,0irq/27-eth0-tx-0-21swapper/211:09:312
29725040,0irq/27-eth0-tx-0-21swapper/210:19:022
29725040,0irq/27-eth0-tx-0-21swapper/209:59:282
29725040,0irq/27-eth0-tx-0-21swapper/209:55:272
29725040,0irq/27-eth0-tx-0-21swapper/209:44:332
29725040,0irq/27-eth0-tx-0-21swapper/208:49:582
29725040,0irq/27-eth0-tx-0-21swapper/008:01:580
29715040,0irq/26-eth0-rx-27615-21sshd07:54:413
29715040,0irq/26-eth0-rx-0-21swapper/312:04:413
29715040,0irq/26-eth0-rx-0-21swapper/311:49:493
29715040,0irq/26-eth0-rx-0-21swapper/311:39:323
29715040,0irq/26-eth0-rx-0-21swapper/311:34:303
29715040,0irq/26-eth0-rx-0-21swapper/309:29:523
29715040,0irq/26-eth0-rx-0-21swapper/309:24:293
29715040,0irq/26-eth0-rx-0-21swapper/308:55:033
29715040,0irq/26-eth0-rx-0-21swapper/308:09:463
29715040,0irq/26-eth0-rx-0-21swapper/306:59:443
259940,0migration/24717-21kthreadcore08:24:432
259940,0migration/232485-21kthreadcore09:24:462
259940,0migration/231679-21aten_r1power_po07:09:402
259940,0migration/230761-21timerwakeupswit07:04:492
259940,0migration/230253-21kthreadcore07:54:452
259940,0migration/228987-21kthreadcore07:29:452
259940,0migration/228430-21fschecks_time08:19:412
259940,0migration/227508-21munin-node08:39:482
259940,0migration/222401-21kthreadcore06:59:442
259940,0migration/222251-21irqcore08:14:412
259940,0migration/221484-21kthreadcore07:24:452
259940,0migration/219782-21sh10:54:422
259940,0migration/214717-21missed_timers10:29:462
259940,0migration/213732-21latency_hist09:34:272
259940,0migration/212462-21kthreadcore08:29:462
259940,0migration/210811-21kthreadcore10:09:442
259940,0migration/210228-21kthreadcore08:04:442
249940,0watchdog/213346-21munin-node07:19:422
249940,0watchdog/20-21swapper/210:39:372
249940,0watchdog/20-21swapper/210:19:412
249940,0watchdog/20-21swapper/208:34:452
179940,0migration/18338-21fschecks_time08:04:411
179940,0migration/14837-21kthreadcore08:49:461
179940,0migration/132452-21kthreadcore09:04:441
179940,0migration/131038-21taskset07:06:031
179940,0migration/12843-21kthreadcore07:59:441
179940,0migration/127473-21taskset08:18:481
179940,0migration/123553-21kthreadcore11:34:431
179940,0migration/118768-21taskset07:21:511
179940,0migration/118188-21kthreadcore08:34:451
179940,0migration/117361-21kthreadcore08:09:461
179940,0migration/113372-21kthreadcore06:54:421
169940,0watchdog/14130-21kthreadcore10:24:451
169940,0watchdog/130518-21kthreadcore10:59:451
169940,0watchdog/129814-21diskstats09:24:411
169940,0watchdog/127838-21ssh09:21:291
169940,0watchdog/121441-21irqrtprio07:49:461
169940,0watchdog/1142992sleep109:34:411
169940,0watchdog/112952-21kthreadcore10:29:451
169940,0watchdog/112933-21df_inode09:14:371
169940,0watchdog/112190-21grep10:49:451
169940,0watchdog/112148-21if_err_eth108:54:411
169940,0watchdog/10-21swapper/108:39:451
169940,0watchdog/10-21swapper/108:24:381
15821240,0sleep115983-21entropy12:09:401
149940,0migration/09656-21if_err_eth1.308:29:430
149940,0migration/07964-21taskset10:27:080
149940,0migration/05618-21taskset12:01:380
149940,0migration/031037-21taskset07:06:020
149940,0migration/027071-21kthreadcore12:14:450
149940,0migration/025702-21kthreadcore08:39:460
149940,0migration/024895-21kernelversion09:59:420
149940,0migration/022710-21irqrtprio11:34:430
149940,0migration/021774-21kthreadcore10:34:450
149940,0migration/020723-21mdstat08:34:470
149940,0migration/019476-21sh11:13:270
149940,0migration/019425-21irqcore06:59:430
149940,0migration/015605-21irqcore08:09:450
149940,0migration/011457-21kthreadcore08:04:450
47429932,0cyclictest3556-21lldpd07:14:322
47429932,0cyclictest15491-21grep06:54:432
47429932,0cyclictest13554-21aten_r1power_cu07:44:392
47419933,0cyclictest3556-21lldpd07:43:011
47419932,0cyclictest5832-21sensors07:34:491
47419932,0cyclictest4420-21awk11:04:421
47419930,0cyclictest27473-21perl07:54:411
47409932,0cyclictest5939-21cut09:29:400
47409932,0cyclictest4955-21munin-node06:49:520
47409932,0cyclictest4471-21irqcore11:04:430
47409932,0cyclictest4076-21munin-node09:09:410
47409932,0cyclictest3556-21lldpd11:29:320
47409932,0cyclictest3514-21snmpd11:39:480
47409932,0cyclictest24357-21cut09:19:450
47409932,0cyclictest23162-21awk09:39:410
47409932,0cyclictest20626-21awk08:59:420
47409932,0cyclictest0-21swapper/007:29:480
47409931,0cyclictest0-21swapper/010:59:440
47409930,0cyclictest8463-21diskstats10:09:390
47409930,0cyclictest4305-21munin-run11:24:270
47409930,0cyclictest25505-21perl10:19:410
47409930,0cyclictest0-21swapper/011:17:200
4130,0ktimersoftd/00-21swapper/008:57:200
339930,0migration/34287-21kthreadcore07:59:453
29725030,0irq/27-eth0-tx-0-21swapper/008:49:320
29725030,0irq/27-eth0-tx-0-21swapper/007:49:450
29725030,0irq/27-eth0-tx-0-21swapper/007:09:410
29725030,0irq/27-eth0-tx-0-21swapper/006:54:370
29715030,0irq/26-eth0-rx-0-21swapper/308:44:393
29715030,0irq/26-eth0-rx-0-21swapper/308:40:203
29715030,0irq/26-eth0-rx-0-21swapper/308:14:363
29715030,0irq/26-eth0-rx-0-21swapper/308:04:393
29715030,0irq/26-eth0-rx-0-21swapper/307:49:413
29715030,0irq/26-eth0-rx-0-21swapper/307:40:413
29715030,0irq/26-eth0-rx-0-21swapper/307:07:303
249930,0watchdog/221442-21irqrtprio07:49:462
179930,0migration/113872-21df_abs07:44:401
169930,0watchdog/12771-21diskmemload10:12:291
169930,0watchdog/10-21swapper/112:14:451
169930,0watchdog/10-21swapper/110:19:291
169930,0watchdog/10-21swapper/108:44:491
169930,0watchdog/10-21swapper/107:24:421
149930,0migration/029561-21runrttasks11:56:350
149930,0migration/016904-21sh10:50:110
47419921,0cyclictest3241-21irqbalance08:19:361
47409920,0cyclictest0-21swapper/010:44:320
35120,0ktimersoftd/35533-21fschecks_time06:49:423
169920,0watchdog/10-21swapper/106:59:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional