You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 21:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Aug 16, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450830,0irq/25-eth10-21swapper/306:45:423
3184628180,0sleep00-21swapper/006:43:060
2580424948,0sleep20-21swapper/206:41:442
3199723324,0sleep10-21swapper/106:44:511
339960,0migration/37135-21idleruntime08:51:573
339960,0migration/35552-21sh09:31:513
339960,0migration/34194-21aten_r1power_po08:26:543
339960,0migration/326080-21sh10:42:363
339960,0migration/323941-21idleruntime08:16:573
339960,0migration/32299-21sh10:27:533
339960,0migration/312054-21sh10:16:243
29715060,0irq/26-eth0-rx-9637-21ssh10:52:323
29715060,0irq/26-eth0-rx-8734-21cat11:12:043
29715060,0irq/26-eth0-rx-26454-21nfs_client10:02:013
19160,0ktimersoftd/113848-21kthreadcore11:37:001
8215050,0irq/24-0000:00:19534-21ls10:41:412
4150,0ktimersoftd/00-21swapper/011:52:170
4150,0ktimersoftd/00-21swapper/010:53:240
4150,0ktimersoftd/00-21swapper/009:35:020
339950,0migration/37380-21sh11:52:033
339950,0migration/34177-21kthreadcore07:11:593
339950,0migration/33787-21kthreadcore07:36:593
339950,0migration/332171-21kthreadcore08:46:583
339950,0migration/330605-21kthreadcore07:57:023
339950,0migration/32981-21kthreadcore12:11:573
339950,0migration/327247-21fschecks_count07:06:553
339950,0migration/325341-21kthreadcore09:22:003
339950,0migration/324652-21timerwakeupswit11:22:063
339950,0migration/322155-21kthreadcore11:41:593
339950,0migration/321139-21munin-node10:21:573
339950,0migration/319811-21kthreadcore07:47:003
339950,0migration/317653-21cpuspeed_turbos08:36:543
339950,0migration/314539-21kthreadcore09:56:593
339950,0migration/313400-21latency_hist06:56:423
339950,0migration/312785-21kthreadcore10:56:583
339950,0migration/311784-21latency_hist10:36:413
322329955,0cyclictest0-21swapper/210:20:412
322329955,0cyclictest0-21swapper/208:33:092
322329950,0cyclictest0-21swapper/211:57:002
322329950,0cyclictest0-21swapper/211:11:462
322329950,0cyclictest0-21swapper/210:45:452
322329950,0cyclictest0-21swapper/210:30:272
322329950,0cyclictest0-21swapper/210:25:342
322329950,0cyclictest0-21swapper/209:10:312
322309955,0cyclictest30525-21diskmemload09:24:441
322309955,0cyclictest0-21swapper/112:02:421
322309955,0cyclictest0-21swapper/110:12:011
322309950,0cyclictest0-21swapper/109:04:421
322299955,0cyclictest0-21swapper/010:38:440
322299955,0cyclictest0-21swapper/009:59:000
322299955,0cyclictest0-21swapper/009:30:000
29725050,0irq/27-eth0-tx-8543-21ssh11:32:292
29725050,0irq/27-eth0-tx-27700-21ssh09:42:142
29725050,0irq/27-eth0-tx-2482-21date11:11:412
29725050,0irq/27-eth0-tx-19173-21yum09:57:072
29725050,0irq/27-eth0-tx-12256-21kthreadcore11:37:002
29725050,0irq/27-eth0-tx-0-21swapper/212:12:022
29725050,0irq/27-eth0-tx-0-21swapper/211:04:532
29715050,0irq/26-eth0-rx-31628-21kthreadcore11:06:593
29715050,0irq/26-eth0-rx-26345-21cut09:42:013
29715050,0irq/26-eth0-rx-24429-21tr08:41:543
29715050,0irq/26-eth0-rx-20245-21irqcore11:01:573
29715050,0irq/26-eth0-rx-19222-21kthreadcore08:11:593
29715050,0irq/26-eth0-rx-17900-21idleruntime-cro11:41:403
29715050,0irq/26-eth0-rx-17771-21kthreadcore09:37:003
29715050,0irq/26-eth0-rx-15558-21kthreadcore10:17:003
29715050,0irq/26-eth0-rx-15312-21if_eth108:56:573
29715050,0irq/26-eth0-rx-11752-21iostat11:16:553
29715050,0irq/26-eth0-rx-1163-21grep09:27:013
29715050,0irq/26-eth0-rx-0-21swapper/312:07:013
29715050,0irq/26-eth0-rx-0-21swapper/312:03:103
29715050,0irq/26-eth0-rx-0-21swapper/311:31:583
29715050,0irq/26-eth0-rx-0-21swapper/311:28:173
29715050,0irq/26-eth0-rx-0-21swapper/310:50:393
29715050,0irq/26-eth0-rx-0-21swapper/310:34:123
29715050,0irq/26-eth0-rx-0-21swapper/309:53:563
29715050,0irq/26-eth0-rx-0-21swapper/309:49:133
29715050,0irq/26-eth0-rx-0-21swapper/309:17:003
29715050,0irq/26-eth0-rx-0-21swapper/309:11:583
29715050,0irq/26-eth0-rx-0-21swapper/309:09:343
27150,0ktimersoftd/20-21swapper/210:53:282
259950,0migration/231792-21irqcore08:46:582
259950,0migration/231096-21kthreadcore07:57:022
259950,0migration/227616-21latency_hist07:31:422
259950,0migration/213881-21latency_hist09:16:422
259950,0migration/213099-21kthreadcore11:16:562
249950,0watchdog/228440-21fschecks_time07:31:562
249950,0watchdog/20-21swapper/208:02:002
19150,0ktimersoftd/10-21swapper/111:52:171
179950,0migration/1720-21munin-node07:32:011
179950,0migration/132502-21kthreadcore08:46:591
179950,0migration/129105-21taskset09:46:311
179950,0migration/12734-21aten_r1power_cu11:11:511
179950,0migration/124891-21munin-node08:41:551
179950,0migration/114771-21kthreadcore09:56:591
179950,0migration/114498-21sh07:42:031
179950,0migration/112223-21timerwakeupswit08:52:051
179950,0migration/111610-21kthreadcore11:56:571
179950,0migration/111560-21idleruntime11:16:531
169950,0watchdog/17626-21ssh12:13:031
149950,0migration/07602-21latency_hist07:16:420
149950,0migration/05934-21kthreadcore08:01:590
149950,0migration/04395-21taskset10:11:450
149950,0migration/03996-21kthreadcore11:31:580
149950,0migration/03396-21taskset09:47:380
149950,0migration/032457-21taskset11:47:430
149950,0migration/032131-21kthreadcore08:46:580
149950,0migration/029631-21latency_hist08:21:420
149950,0migration/029491-21taskset09:05:010
149950,0migration/028519-21sh10:06:320
149950,0migration/02509-21fschecks_count07:36:550
149950,0migration/023313-21rt-features12:02:010
149950,0migration/021364-21kthreadcore11:22:000
149950,0migration/020424-21munin-node08:57:050
149950,0migration/019699-21latency07:22:010
149950,0migration/018409-21cpuspeed_turbos11:41:530
149950,0migration/018165-21gltestperf08:36:560
149950,0migration/014923-21kthreadcore06:56:590
149950,0migration/01380-21taskset11:08:310
149950,0migration/01307-21cpu12:11:520
149950,0migration/012663-21runrttasks09:56:350
149950,0migration/011894-21kthreadcore07:41:580
149950,0migration/010251-21sh11:16:040
871240,0sleep20-21swapper/210:47:022
339940,0migration/328801-21latency_hist10:06:423
339940,0migration/313038-21kthreadcore08:31:593
322329943,0cyclictest9710-21awk07:41:562
322329943,0cyclictest5925-21awk09:51:582
322329943,0cyclictest3556-21lldpd08:57:402
322329943,0cyclictest3556-21lldpd08:08:392
322329943,0cyclictest3556-21lldpd06:54:392
322329943,0cyclictest3241-21irqbalance10:56:592
322329943,0cyclictest3010-21awk07:36:572
322329943,0cyclictest25071-21awk08:41:572
322329943,0cyclictest21009-21awk07:01:582
322329940,0cyclictest0-21swapper/207:09:072
322309944,0cyclictest0-21swapper/110:49:041
322309943,0cyclictest3556-21lldpd11:22:111
322309943,0cyclictest3556-21lldpd10:32:111
322309943,0cyclictest3556-21lldpd07:27:391
322309943,0cyclictest3514-21snmpd07:12:471
322309943,0cyclictest31267-21awk09:06:571
322309943,0cyclictest27694-21awk07:06:571
322309943,0cyclictest24120-21awk08:16:581
322309943,0cyclictest21951-21awk10:01:571
322299944,0cyclictest0-21swapper/011:29:390
322299944,0cyclictest0-21swapper/009:14:140
322299944,0cyclictest0-21swapper/008:54:410
322299943,0cyclictest3556-21lldpd07:51:400
322299943,0cyclictest3556-21lldpd07:29:390
322299943,0cyclictest3241-21irqbalance10:28:300
322299943,0cyclictest31301-21awk09:06:580
322299943,0cyclictest23027-21awk07:51:580
322299943,0cyclictest22843-21awk09:21:580
322299943,0cyclictest21024-21awk07:01:580
322299943,0cyclictest1009-21awk06:46:580
322299940,0cyclictest16463-21munin-node08:11:550
322299940,0cyclictest0-21swapper/011:37:170
29725040,0irq/27-eth0-tx-32317-21ssh11:47:182
29725040,0irq/27-eth0-tx-29443-21munin-node09:46:592
29725040,0irq/27-eth0-tx-1638-21munin-node11:51:552
29725040,0irq/27-eth0-tx-0-21swapper/212:01:572
29725040,0irq/27-eth0-tx-0-21swapper/211:21:472
29725040,0irq/27-eth0-tx-0-21swapper/210:31:452
29725040,0irq/27-eth0-tx-0-21swapper/210:12:032
29725040,0irq/27-eth0-tx-0-21swapper/210:01:532
29725040,0irq/27-eth0-tx-0-21swapper/209:27:002
29725040,0irq/27-eth0-tx-0-21swapper/209:21:452
29725040,0irq/27-eth0-tx-0-21swapper/209:01:462
29725040,0irq/27-eth0-tx-0-21swapper/008:24:400
29725040,0irq/27-eth0-tx-0-21swapper/008:06:540
29715040,0irq/26-eth0-rx-18852-21grep07:22:013
29715040,0irq/26-eth0-rx-0-21swapper/311:56:553
29715040,0irq/26-eth0-rx-0-21swapper/311:47:003
29715040,0irq/26-eth0-rx-0-21swapper/309:01:433
29715040,0irq/26-eth0-rx-0-21swapper/307:51:553
29715040,0irq/26-eth0-rx-0-21swapper/307:28:433
259940,0migration/28330-21kthreadcore09:11:582
259940,0migration/27564-21perf07:16:422
259940,0migration/23698-21kthreadcore06:47:002
259940,0migration/227277-21fschecks_time11:26:552
259940,0migration/221650-21runrttasks07:48:332
259940,0migration/221462-21kthreadcore08:37:002
259940,0migration/218567-21df_inode11:41:542
259940,0migration/218013-21kthreadcore06:57:002
259940,0migration/217495-21irqcore08:11:582
259940,0migration/213682-21unixbench-2d07:17:042
259940,0migration/21293-21kthreadcore08:22:002
249940,0watchdog/29108-21grep08:52:002
249940,0watchdog/229012-21cpu10:06:512
249940,0watchdog/214252-21perl09:36:562
249940,0watchdog/210724-21kthreadcore09:32:002
249940,0watchdog/20-21swapper/212:06:552
179940,0migration/1607-21taskset11:49:351
179940,0migration/15443-21kthreadcore08:26:591
179940,0migration/14536-21taskset09:50:581
179940,0migration/130013-21kthreadcore10:26:581
179940,0migration/129852-21kthreadcore11:06:581
179940,0migration/12859-21fschecks_time11:31:551
179940,0migration/128209-21kthreadcore12:06:571
179940,0migration/128188-21kthreadcore11:26:591
179940,0migration/127756-21rt-features07:52:051
179940,0migration/126092-21taskset11:04:151
179940,0migration/124334-21kthreadcore10:22:011
179940,0migration/119345-21irqcore11:41:581
179940,0migration/117416-21if_eth1.208:11:571
179940,0migration/117305-21kthreadcore07:46:591
179940,0migration/114268-21kthreadcore10:56:591
179940,0migration/112357-21taskset09:33:571
169940,0watchdog/15221-21tr06:47:001
169940,0watchdog/128829-21aten_r1power_en07:56:561
169940,0watchdog/123169-1kworker/1:1H10:06:511
169940,0watchdog/120224-21ssh09:17:161
169940,0watchdog/117977-21vmstat10:37:071
169940,0watchdog/114876-21forks07:21:561
169940,0watchdog/113018-21perl10:16:551
169940,0watchdog/112432-21ssh09:12:521
169940,0watchdog/10-21swapper/109:37:001
169940,0watchdog/10-21swapper/109:27:001
169940,0watchdog/10-21swapper/108:22:001
169940,0watchdog/10-21swapper/107:02:001
149940,0migration/06715-21latency_hist06:51:420
149940,0migration/05687-21kthreadcore10:31:580
149940,0migration/021845-21kthreadcore10:22:000
149940,0migration/021836-21cpuspeed_turbos09:41:550
149940,0migration/021156-21kthreadcore10:41:590
149940,0migration/019662-21sh10:20:260
149940,0migration/018415-21idleruntime-cro11:21:400
149940,0migration/016511-21kthreadcore09:16:590
149940,0migration/012263-21if_eth1.210:56:570
149940,0migration/012205-21kthreadcore07:16:590
149940,0migration/010337-21fschecks_time11:56:540
35130,0ktimersoftd/30-21swapper/307:20:433
322329932,0cyclictest26654-21kthreadcore08:17:002
322329930,0cyclictest23162-21iostat_ios07:52:002
322309933,0cyclictest7669-21awk06:51:581
322309933,0cyclictest0-21swapper/108:32:041
322309932,0cyclictest8664-21awk07:16:561
322309932,0cyclictest3514-21snmpd08:08:531
322309932,0cyclictest3241-21irqbalance10:52:491
322309932,0cyclictest3092-21irqcore07:36:581
322309932,0cyclictest22995-21kthreadcore10:41:591
322309932,0cyclictest19157-21sensors06:57:041
322309932,0cyclictest15332-21awk08:56:571
322309932,0cyclictest10843-21sensors09:52:051
322299932,0cyclictest3241-21irqbalance11:01:590
322299932,0cyclictest30386-21kthreadcore12:06:580
322299932,0cyclictest29773-21awk10:06:550
322299932,0cyclictest26787-21munin-node07:06:550
322299932,0cyclictest15546-21grep09:36:590
322299932,0cyclictest11696-21awk08:31:570
322299930,0cyclictest28795-21munin-node07:56:570
322299930,0cyclictest1305-21sh10:47:040
29725030,0irq/27-eth0-tx-0-21swapper/008:41:530
29725030,0irq/27-eth0-tx-0-21swapper/008:26:550
29715030,0irq/26-eth0-rx-0-21swapper/308:21:533
29715030,0irq/26-eth0-rx-0-21swapper/308:09:533
29715030,0irq/26-eth0-rx-0-21swapper/308:01:543
29715030,0irq/26-eth0-rx-0-21swapper/307:31:543
29715030,0irq/26-eth0-rx-0-21swapper/307:02:583
29715030,0irq/26-eth0-rx-0-21swapper/306:48:353
249930,0watchdog/20-21swapper/208:26:562
249930,0watchdog/20-21swapper/207:21:562
169930,0watchdog/10-21swapper/108:36:561
169930,0watchdog/10-21swapper/108:02:001
322299921,0cyclictest0-21swapper/007:31:420
329920,0watchdog/312081-21munin-node06:52:013
29715020,0irq/26-eth0-rx-0-21swapper/307:41:503
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional