You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 15:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Jun 25, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1168126766,0sleep20-21swapper/206:50:332
304450350,0irq/25-eth10-21swapper/306:47:183
1148223425,0sleep10-21swapper/106:48:121
1149623120,0sleep00-21swapper/006:48:230
35160,0ktimersoftd/30-21swapper/310:08:073
339960,0migration/38721-21df_abs08:01:513
339960,0migration/319012-21sh09:52:413
339960,0migration/316912-21kthreadcore11:31:563
339960,0migration/315970-21munin-node08:06:553
339960,0migration/314172-21sh11:30:333
29715060,0irq/26-eth0-rx-8003-21perl12:06:513
19160,0ktimersoftd/10-21swapper/110:14:571
149960,0migration/07525-21cpu12:06:500
149960,0migration/06002-21kthreadcore09:46:540
149960,0migration/02783-21aten_r1power_en09:06:510
149960,0migration/023268-21latency_hist11:56:390
149960,0migration/019664-21munin-node07:42:020
149960,0migration/016458-21kthreadcore08:06:560
149960,0migration/013940-21sh10:51:440
149960,0migration/012929-21sh10:49:400
118479966,0cyclictest0-21swapper/112:11:561
118469965,0cyclictest28306-21ps07:51:550
118469960,0cyclictest0-21swapper/007:46:550
339950,0migration/39142-21kthreadcore07:11:563
339950,0migration/39136-21kthreadcore07:36:563
339950,0migration/33434-21sh09:44:593
339950,0migration/332715-21munin-node07:51:583
339950,0migration/332137-21missed_timers09:01:583
339950,0migration/332066-21fschecks_count12:01:513
339950,0migration/330766-21kthreadcore08:41:553
339950,0migration/329916-21sh11:19:583
339950,0migration/329680-21sh11:57:173
339950,0migration/324995-21mdstat07:21:583
339950,0migration/322825-21ksmtuned12:15:093
339950,0migration/321817-21munin-node09:56:543
339950,0migration/318923-21missed_timers10:31:573
339950,0migration/317235-21irqrtprio08:31:553
339950,0migration/31668-21aten_r1power_po07:56:523
339950,0migration/314326-21kthreadcore08:26:563
339950,0migration/312675-21taskset10:30:113
29725050,0irq/27-eth0-tx-3214-21ssh09:44:272
29725050,0irq/27-eth0-tx-31696-21kthreadcore11:01:562
29725050,0irq/27-eth0-tx-29279-21munin-node08:42:010
29725050,0irq/27-eth0-tx-23638-21munin-node12:16:532
29725050,0irq/27-eth0-tx-22591-21diskstats10:56:502
29725050,0irq/27-eth0-tx-12064-21munin-node06:51:570
29725050,0irq/27-eth0-tx-12064-21munin-node06:51:570
29725050,0irq/27-eth0-tx-0-21swapper/211:51:182
29725050,0irq/27-eth0-tx-0-21swapper/008:51:570
29725050,0irq/27-eth0-tx-0-21swapper/008:11:540
29725050,0irq/27-eth0-tx-0-21swapper/007:23:470
29725050,0irq/27-eth0-tx-0-21swapper/006:59:100
29715050,0irq/26-eth0-rx-28718-21sh10:58:083
29715050,0irq/26-eth0-rx-25888-21kthreadcore10:16:553
29715050,0irq/26-eth0-rx-24272-21irqrtprio11:36:543
29715050,0irq/26-eth0-rx-22614-21tr08:56:563
29715050,0irq/26-eth0-rx-21342-21ssh11:13:543
29715050,0irq/26-eth0-rx-19873-21aten_r1power_po09:16:503
29715050,0irq/26-eth0-rx-15119-21irqcore10:51:543
29715050,0irq/26-eth0-rx-14890-21ssh11:51:073
29715050,0irq/26-eth0-rx-0-21swapper/312:16:513
29715050,0irq/26-eth0-rx-0-21swapper/310:46:533
29715050,0irq/26-eth0-rx-0-21swapper/310:36:523
29715050,0irq/26-eth0-rx-0-21swapper/309:37:033
29715050,0irq/26-eth0-rx-0-21swapper/309:11:583
29715050,0irq/26-eth0-rx-0-21swapper/309:11:053
249950,0watchdog/232402-21if_err_eth112:01:532
19150,0ktimersoftd/10-21swapper/110:29:461
19150,0ktimersoftd/10-21swapper/109:49:531
179950,0migration/17107-21latency_hist12:06:391
179950,0migration/13975-21needreboot11:21:571
179950,0migration/13949-21run-parts10:42:391
179950,0migration/129126-21fschecks_time09:41:521
179950,0migration/125782-21kthreadcore12:16:551
179950,0migration/112138-21sh09:11:541
169950,0watchdog/131801-21ntpq07:26:581
149950,0migration/09704-21kthreadcore08:01:550
149950,0migration/07961-21kthreadcore09:26:560
149950,0migration/05003-21kthreadcore08:21:560
149950,0migration/04753-21kthreadcore07:56:570
149950,0migration/03976-21kthreadcore12:01:560
149950,0migration/03750-21sh10:04:370
149950,0migration/029640-21kthreadcore07:01:560
149950,0migration/029593-21kthreadcore07:26:550
149950,0migration/028357-21cpuspeed_turbos09:21:510
149950,0migration/027339-21sh09:20:220
149950,0migration/026191-21kthreadcore12:16:550
149950,0migration/023520-21aten_r1power_en11:56:500
149950,0migration/023331-21irqcore10:56:540
149950,0migration/023252-21sh12:16:170
149950,0migration/023166-21kthreadcore08:56:560
149950,0migration/020272-21sh11:12:010
149950,0migration/019503-21kthreadcore08:31:570
149950,0migration/019387-21sh10:32:010
149950,0migration/018771-21munin-node09:52:040
149950,0migration/01810-21runrttasks09:42:000
149950,0migration/012671-21sh10:30:100
149950,0migration/01206-21kthreadcore11:01:560
149950,0migration/011860-21taskset10:09:170
118519954,0cyclictest0-21swapper/207:56:572
118519950,0cyclictest0-21swapper/211:52:202
118519950,0cyclictest0-21swapper/210:42:202
118479955,0cyclictest0-21swapper/109:25:461
118479950,0cyclictest0-21swapper/111:59:101
118479950,0cyclictest0-21swapper/111:16:071
118479950,0cyclictest0-21swapper/110:51:221
118479950,0cyclictest0-21swapper/110:33:331
118479950,0cyclictest0-21swapper/109:52:241
118479950,0cyclictest0-21swapper/108:53:171
118469954,0cyclictest0-21swapper/011:39:180
339940,0migration/330736-21kthreadcore09:21:563
339940,0migration/324027-21kthreadcore08:36:563
339940,0migration/313196-21sh07:16:493
339940,0migration/313160-21sh10:11:503
29725040,0irq/27-eth0-tx-5726-21ssh10:46:452
29725040,0irq/27-eth0-tx-4485-21grep11:41:582
29725040,0irq/27-eth0-tx-29984-21fschecks_time10:21:512
29725040,0irq/27-eth0-tx-19861-21ssh09:16:502
29725040,0irq/27-eth0-tx-16664-21ssh08:53:042
29725040,0irq/27-eth0-tx-13008-21ssh11:27:282
29725040,0irq/27-eth0-tx-0-21swapper/211:40:142
29725040,0irq/27-eth0-tx-0-21swapper/211:21:422
29725040,0irq/27-eth0-tx-0-21swapper/211:07:012
29725040,0irq/27-eth0-tx-0-21swapper/210:51:432
29725040,0irq/27-eth0-tx-0-21swapper/210:32:262
29725040,0irq/27-eth0-tx-0-21swapper/210:16:442
29725040,0irq/27-eth0-tx-0-21swapper/210:11:402
29725040,0irq/27-eth0-tx-0-21swapper/210:07:312
29725040,0irq/27-eth0-tx-0-21swapper/209:51:422
29725040,0irq/27-eth0-tx-0-21swapper/209:46:422
29725040,0irq/27-eth0-tx-0-21swapper/209:36:462
29725040,0irq/27-eth0-tx-0-21swapper/209:26:442
29725040,0irq/27-eth0-tx-0-21swapper/209:01:392
29725040,0irq/27-eth0-tx-0-21swapper/208:56:502
29725040,0irq/27-eth0-tx-0-21swapper/007:31:510
29715040,0irq/26-eth0-rx-0-21swapper/311:55:143
29715040,0irq/26-eth0-rx-0-21swapper/311:43:183
29715040,0irq/26-eth0-rx-0-21swapper/311:24:023
29715040,0irq/26-eth0-rx-0-21swapper/311:07:003
29715040,0irq/26-eth0-rx-0-21swapper/311:01:453
29715040,0irq/26-eth0-rx-0-21swapper/310:42:383
29715040,0irq/26-eth0-rx-0-21swapper/310:21:403
29715040,0irq/26-eth0-rx-0-21swapper/310:01:463
29715040,0irq/26-eth0-rx-0-21swapper/309:46:533
29715040,0irq/26-eth0-rx-0-21swapper/309:32:523
29715040,0irq/26-eth0-rx-0-21swapper/309:26:443
29715040,0irq/26-eth0-rx-0-21swapper/308:52:533
29715040,0irq/26-eth0-rx-0-21swapper/308:21:573
29715040,0irq/26-eth0-rx-0-21swapper/308:12:413
29715040,0irq/26-eth0-rx-0-21swapper/307:41:573
259940,0migration/232573-21kthreadcore08:16:562
259940,0migration/230282-21runrttasks08:41:542
259940,0migration/228058-21runrttasks09:21:422
259940,0migration/221495-21timerwakeupswit12:12:012
259940,0migration/214783-21cpuspeed_turbos11:11:512
259940,0migration/213390-21runrttasks07:37:212
259940,0migration/212498-21munin-node09:31:512
249940,0watchdog/26008-21kthreadcore09:06:572
249940,0watchdog/25278-21ssh10:26:452
249940,0watchdog/219512-21kthreadcore11:31:572
249940,0watchdog/20-21swapper/210:36:572
179940,0migration/15387-21kthreadcore08:21:571
179940,0migration/132545-21irqrtprio11:41:541
179940,0migration/130455-21kthreadcore10:01:561
179940,0migration/129314-21kthreadcore09:01:561
179940,0migration/12801-21irqrtprio07:56:561
179940,0migration/127527-21latency10:56:561
179940,0migration/124098-21sensors_volt08:57:001
179940,0migration/123959-21kthreadcore09:16:561
179940,0migration/123261-21kthreadcore07:46:561
179940,0migration/12163-21kthreadcore07:06:561
179940,0migration/121160-21latency_hist10:16:391
179940,0migration/11414-21latency_hist07:56:391
179940,0migration/111946-21kthreadcore11:46:561
169940,0watchdog/14952-21ssh11:04:051
169940,0watchdog/13999-21sh09:26:491
169940,0watchdog/126627-21ssh09:37:251
169940,0watchdog/123941-21if_err_eth111:36:531
169940,0watchdog/119511-21kthreadcore11:31:571
169940,0watchdog/114739-21grep07:16:541
169940,0watchdog/112160-21munin-node09:31:531
169940,0watchdog/112085-21ssh10:09:531
169940,0watchdog/110048-21kthreadcore11:06:571
169940,0watchdog/10-21swapper/106:51:581
169940,0watchdog/10-21swapper/106:51:581
149940,0migration/09240-21kthreadcore11:26:540
149940,0migration/031982-21kthreadcore08:16:560
149940,0migration/021787-21fschecks_time10:16:500
149940,0migration/011418-21kthreadcore07:11:570
118519944,0cyclictest24312-21kthreadcore09:56:562
118519943,0cyclictest8358-21awk12:06:532
118519943,0cyclictest3556-21lldpd08:11:482
118519943,0cyclictest3556-21lldpd07:52:482
118519943,0cyclictest3556-21lldpd07:15:472
118519943,0cyclictest3556-21lldpd06:58:172
118519943,0cyclictest3556-21lldpd06:55:172
118519943,0cyclictest3556-21lldpd06:55:172
118519943,0cyclictest3514-21snmpd08:37:072
118519943,0cyclictest3514-21snmpd07:30:522
118519943,0cyclictest3514-21snmpd07:11:062
118519943,0cyclictest3390-21awk08:21:542
118519943,0cyclictest3241-21irqbalance11:56:572
118519943,0cyclictest23542-21awk11:16:522
118519943,0cyclictest21392-21sadc08:11:392
118519943,0cyclictest20579-21awk07:21:552
118519943,0cyclictest16904-21awk08:31:542
118519943,0cyclictest13970-21awk07:16:522
118519943,0cyclictest12249-21awk09:11:552
118519940,0cyclictest0-21swapper/210:03:242
118479944,0cyclictest0-21swapper/109:57:271
118479943,0cyclictest3556-21lldpd11:27:181
118479943,0cyclictest3556-21lldpd10:53:481
118479943,0cyclictest3556-21lldpd08:08:171
118479943,0cyclictest3556-21lldpd08:01:481
118479943,0cyclictest30287-21awk10:21:521
118479943,0cyclictest20549-21awk07:21:551
118479943,0cyclictest1517-21awk07:31:551
118469943,0cyclictest506-21awk07:06:540
118469943,0cyclictest4558-21awk08:46:540
118469943,0cyclictest3514-21snmpd11:31:520
118469943,0cyclictest3514-21snmpd10:21:520
118469943,0cyclictest3241-21irqbalance11:22:070
118469943,0cyclictest3241-21irqbalance11:16:470
118469943,0cyclictest3241-21irqbalance10:44:170
118469943,0cyclictest3241-21irqbalance09:57:470
118469943,0cyclictest3241-21irqbalance09:39:280
118469943,0cyclictest3241-21irqbalance08:37:080
118469943,0cyclictest3241-21irqbalance07:37:080
118469943,0cyclictest13922-21awk07:16:520
118469943,0cyclictest12273-21awk09:11:550
118469942,0cyclictest14653-21kworker/0:209:31:430
118469940,0cyclictest0-21swapper/010:15:540
339930,0migration/328505-21kthreadcore07:01:563
339930,0migration/320710-21kthreadcore06:56:553
29715030,0irq/26-eth0-rx-0-21swapper/308:16:533
29715030,0irq/26-eth0-rx-0-21swapper/307:50:553
29715030,0irq/26-eth0-rx-0-21swapper/307:35:433
29715030,0irq/26-eth0-rx-0-21swapper/307:27:013
29715030,0irq/26-eth0-rx-0-21swapper/307:10:123
29715030,0irq/26-eth0-rx-0-21swapper/306:53:023
29715030,0irq/26-eth0-rx-0-21swapper/306:53:023
259930,0migration/28374-21aten_r1power_en08:01:492
259930,0migration/226301-21sensors_temp07:47:002
249930,0watchdog/219654-21sensors07:42:022
249930,0watchdog/20-21swapper/207:01:422
179930,0migration/12188-21mdstat08:41:571
179930,0migration/114071-21kthreadcore08:26:561
169930,0watchdog/13233-21ssh09:06:531
169930,0watchdog/110067-21diskmemload12:06:491
169930,0watchdog/10-21swapper/111:16:451
118519932,0cyclictest3556-21lldpd08:26:482
118519930,0cyclictest0-21swapper/207:33:282
118479933,0cyclictest0-21swapper/107:36:491
118479932,0cyclictest3556-21lldpd08:46:471
118479932,0cyclictest3556-21lldpd08:12:181
118479932,0cyclictest29275-21awk08:16:541
118479932,0cyclictest27494-21sensors10:37:021
118479932,0cyclictest26230-21awk07:01:531
118479932,0cyclictest23497-21awk08:36:541
118479932,0cyclictest19689-21awk06:56:541
118479932,0cyclictest16952-21awk08:31:551
118479932,0cyclictest16359-21awk11:51:521
118479931,0cyclictest8259-21kthreadcore07:11:561
118469933,0cyclictest14653-21kworker/0:211:46:520
118469933,0cyclictest14653-21kworker/0:211:41:520
118469933,0cyclictest14653-21kworker/0:211:06:420
118469933,0cyclictest14653-21kworker/0:210:36:440
118469932,0cyclictest3241-21irqbalance08:26:480
118469932,0cyclictest27598-21awk09:01:540
29715020,0irq/26-eth0-rx-0-21swapper/308:46:473
249920,0watchdog/20-21swapper/208:46:502
118479921,0cyclictest13920-21sed07:41:391
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional