You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 23:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Aug 06, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1771829894,0sleep20-21swapper/206:47:162
304450400,0irq/25-eth10-21swapper/306:42:593
1740423324,0sleep10-21swapper/106:43:301
1766022915,0sleep00-21swapper/006:46:300
178309970,0cyclictest0-21swapper/111:19:021
339960,0migration/37105-21kthreadcore11:42:553
339960,0migration/35969-21sh09:40:183
339960,0migration/322332-21fschecks_count10:32:523
339960,0migration/311384-21sh11:04:153
29725060,0irq/27-eth0-tx-26585-21munin-node07:43:010
29715060,0irq/26-eth0-rx-2829-40yum-updatesd-he08:37:513
29715060,0irq/26-eth0-rx-28109-21cut09:12:563
29715060,0irq/26-eth0-rx-20378-21df_abs11:32:513
178309960,0cyclictest0-21swapper/109:47:551
178299966,0cyclictest0-21swapper/011:07:520
149960,0migration/030737-21taskset09:36:280
149960,0migration/021251-21taskset10:10:120
149960,0migration/011579-21sh10:43:120
8215050,0irq/24-0000:00:27339-21latency_hist08:07:392
4150,0ktimersoftd/00-21swapper/010:39:480
339950,0migration/39637-21kthreadcore09:02:553
339950,0migration/39012-21diskmemload12:03:263
339950,0migration/38502-21kthreadcore10:42:563
339950,0migration/38406-21latency_hist08:17:393
339950,0migration/36522-21latency_hist07:27:393
339950,0migration/3534-21kthreadcore11:17:553
339950,0migration/34318-21missed_timers06:57:563
339950,0migration/329347-21timerandwakeup09:33:023
339950,0migration/327266-21taskset08:06:583
339950,0migration/326534-21kthreadcore10:12:553
339950,0migration/326236-21fschecks_time07:17:513
339950,0migration/324046-21kthreadcore07:37:563
339950,0migration/32346-21kthreadcore10:17:553
339950,0migration/32342-21kthreadcore08:57:563
339950,0migration/322581-21taskset08:49:093
339950,0migration/321083-21kthreadcore11:52:523
339950,0migration/320489-21taskset08:00:473
339950,0migration/318337-21taskset07:08:023
339950,0migration/312919-21latency09:22:563
339950,0migration/311753-21taskset07:03:543
339950,0migration/311737-21cpuspeed_turbos11:47:503
29725050,0irq/27-eth0-tx-6416-21munin-node10:02:592
29725050,0irq/27-eth0-tx-5349-21munin-node10:42:542
29725050,0irq/27-eth0-tx-32350-21if_eth1.209:37:542
29725050,0irq/27-eth0-tx-27956-40yum-updatesd-he11:37:502
29725050,0irq/27-eth0-tx-22331-21munin-node10:12:522
29725050,0irq/27-eth0-tx-15975-21diskmemload10:37:582
29725050,0irq/27-eth0-tx-15217-21munin-node08:22:580
29725050,0irq/27-eth0-tx-14351-21iostat_ios10:47:542
29725050,0irq/27-eth0-tx-0-21swapper/211:28:032
29725050,0irq/27-eth0-tx-0-21swapper/209:49:042
29725050,0irq/27-eth0-tx-0-21swapper/208:57:292
29725050,0irq/27-eth0-tx-0-21swapper/008:49:170
29725050,0irq/27-eth0-tx-0-21swapper/008:35:300
29725050,0irq/27-eth0-tx-0-21swapper/007:23:590
29715050,0irq/26-eth0-rx-6601-21python07:48:003
29715050,0irq/26-eth0-rx-26423-21kthreadcore09:52:553
29715050,0irq/26-eth0-rx-22005-21grep10:52:523
29715050,0irq/26-eth0-rx-21899-21ssh10:12:123
29715050,0irq/26-eth0-rx-14824-21if_eth1.310:27:533
29715050,0irq/26-eth0-rx-14824-21if_eth1.310:27:533
29715050,0irq/26-eth0-rx-0-21swapper/312:07:533
29715050,0irq/26-eth0-rx-0-21swapper/311:42:183
29715050,0irq/26-eth0-rx-0-21swapper/311:22:543
29715050,0irq/26-eth0-rx-0-21swapper/311:07:553
29715050,0irq/26-eth0-rx-0-21swapper/310:58:023
29715050,0irq/26-eth0-rx-0-21swapper/310:27:123
29715050,0irq/26-eth0-rx-0-21swapper/310:27:123
29715050,0irq/26-eth0-rx-0-21swapper/310:02:563
29715050,0irq/26-eth0-rx-0-21swapper/309:32:283
29715050,0irq/26-eth0-rx-0-21swapper/309:17:403
29715050,0irq/26-eth0-rx-0-21swapper/308:52:523
259950,0migration/28398-21kthreadcore07:02:562
259950,0migration/24338-21kthreadcore12:02:542
259950,0migration/227892-21sh10:54:252
259950,0migration/218277-21kthreadcore09:27:542
249950,0watchdog/210491-21ssh11:23:282
19150,0ktimersoftd/10-21swapper/110:25:171
19150,0ktimersoftd/10-21swapper/110:25:171
178329955,0cyclictest0-21swapper/210:17:502
178329955,0cyclictest0-21swapper/210:09:572
178329955,0cyclictest0-21swapper/209:33:132
178329954,0cyclictest3241-21irqbalance11:59:362
178329950,0cyclictest0-21swapper/211:01:022
178329950,0cyclictest0-21swapper/209:43:192
178309955,0cyclictest0-21swapper/109:52:571
178309950,0cyclictest0-21swapper/112:05:141
178309950,0cyclictest0-21swapper/109:03:561
178309950,0cyclictest0-21swapper/107:52:401
178299950,0cyclictest0-21swapper/009:49:110
179950,0migration/132267-21taskset07:22:421
179950,0migration/130001-21munin-node09:13:011
179950,0migration/129165-21latency_hist10:57:391
179950,0migration/126296-21taskset07:42:071
179950,0migration/125656-21aten_r1power_en07:17:491
179950,0migration/124263-21idleruntime09:32:541
179950,0migration/112696-21taskset10:03:161
169950,0watchdog/117470-21ssh12:10:081
169950,0watchdog/110252-21grep09:42:571
149950,0migration/09553-21irqcore08:17:550
149950,0migration/08897-21kthreadcore07:27:560
149950,0migration/08841-21kthreadcore11:22:540
149950,0migration/07850-21kthreadcore10:22:550
149950,0migration/07850-21kthreadcore10:22:550
149950,0migration/07215-21taskset07:50:590
149950,0migration/06043-21irqrtprio11:02:530
149950,0migration/04722-21kthreadcore08:37:550
149950,0migration/03357-21latency_hist11:42:380
149950,0migration/029917-21latency06:52:560
149950,0migration/029318-21latency09:12:560
149950,0migration/029200-21kernelversion11:37:550
149950,0migration/029129-21fschecks_count11:17:500
149950,0migration/028934-21kthreadcore08:07:540
149950,0migration/02770-21aten_r1power_fr12:02:490
149950,0migration/027084-21latency_hist11:57:370
149950,0migration/024610-21fschecks_count08:52:490
149950,0migration/023565-21kthreadcore11:12:530
149950,0migration/022968-21aten_r1power_en09:52:490
149950,0migration/022304-21sh10:12:440
149950,0migration/020026-21timerandwakeup07:58:010
149950,0migration/019869-21taskset10:49:160
149950,0migration/019212-21kthreadcore09:07:560
149950,0migration/018571-21missed_timers07:32:590
149950,0migration/018452-21runrttasks11:50:450
149950,0migration/015423-21latency_hist09:27:390
149950,0migration/01222-21kthreadcore09:17:550
149950,0migration/011425-21kthreadcore08:42:560
149950,0migration/011220-21fschecks_time12:07:510
339940,0migration/332341-21timerandwakeup07:43:013
339940,0migration/329036-21kthreadcore06:52:553
339940,0migration/328851-21df_abs08:32:503
339940,0migration/314633-21taskset08:18:363
29725040,0irq/27-eth0-tx-5851-21munin-node10:22:512
29725040,0irq/27-eth0-tx-5851-21munin-node10:22:512
29725040,0irq/27-eth0-tx-28607-21ssh11:17:462
29725040,0irq/27-eth0-tx-21790-21munin-node10:32:562
29725040,0irq/27-eth0-tx-15917-21ssh09:07:392
29725040,0irq/27-eth0-tx-0-21swapper/211:55:282
29725040,0irq/27-eth0-tx-0-21swapper/211:47:532
29725040,0irq/27-eth0-tx-0-21swapper/211:44:152
29725040,0irq/27-eth0-tx-0-21swapper/211:32:502
29725040,0irq/27-eth0-tx-0-21swapper/211:13:072
29725040,0irq/27-eth0-tx-0-21swapper/209:55:162
29725040,0irq/27-eth0-tx-0-21swapper/209:17:572
29725040,0irq/27-eth0-tx-0-21swapper/209:13:432
29725040,0irq/27-eth0-tx-0-21swapper/209:03:192
29725040,0irq/27-eth0-tx-0-21swapper/208:57:562
29725040,0irq/27-eth0-tx-0-21swapper/008:16:280
29715040,0irq/26-eth0-rx-28017-21idleruntime11:57:513
29715040,0irq/26-eth0-rx-14182sleep308:11:143
29715040,0irq/26-eth0-rx-0-21swapper/311:28:063
29715040,0irq/26-eth0-rx-0-21swapper/311:13:123
29715040,0irq/26-eth0-rx-0-21swapper/310:47:513
29715040,0irq/26-eth0-rx-0-21swapper/310:40:103
29715040,0irq/26-eth0-rx-0-21swapper/309:57:463
29715040,0irq/26-eth0-rx-0-21swapper/309:47:533
29715040,0irq/26-eth0-rx-0-21swapper/309:42:543
29715040,0irq/26-eth0-rx-0-21swapper/309:07:503
29715040,0irq/26-eth0-rx-0-21swapper/308:22:553
29715040,0irq/26-eth0-rx-0-21swapper/307:34:313
29715040,0irq/26-eth0-rx-0-21swapper/306:47:493
259940,0migration/28553-21munin-node09:22:542
259940,0migration/2510-21kthreadcore09:57:542
259940,0migration/230122-21kthreadcore07:17:552
259940,0migration/226156-21kthreadcore08:27:572
259940,0migration/219747-21taskset07:57:582
259940,0migration/219692-21kthreadcore08:47:552
259940,0migration/218701-21aten_r1power_vo12:12:492
259940,0migration/213605-21runrttasks07:53:092
249940,0watchdog/2794-21munin-node07:47:532
249940,0watchdog/213321-21iostat_ios07:07:532
249940,0watchdog/210666-21telnet12:07:482
249940,0watchdog/20-21swapper/207:12:492
178329943,0cyclictest3556-21lldpd11:04:342
178329943,0cyclictest3556-21lldpd08:45:022
178329943,0cyclictest3556-21lldpd08:41:332
178329943,0cyclictest3556-21lldpd08:14:312
178329943,0cyclictest3556-21lldpd08:08:302
178329943,0cyclictest32250-21awk06:57:532
178329943,0cyclictest27541-21awk07:42:532
178329943,0cyclictest18876-21awk06:47:522
178329943,0cyclictest14751-21awk10:27:532
178329943,0cyclictest14751-21awk10:27:532
178329943,0cyclictest14094-21awk07:32:542
178329943,0cyclictest13734-21awk11:07:522
178309944,0cyclictest15975-21diskmemload12:17:031
178309944,0cyclictest0-21swapper/107:02:511
178309943,0cyclictest7575-21awk07:27:541
178309943,0cyclictest541-21sadc07:47:391
178309943,0cyclictest3556-21lldpd12:02:351
178309943,0cyclictest3556-21lldpd11:56:341
178309943,0cyclictest3556-21lldpd10:20:041
178309943,0cyclictest3556-21lldpd10:01:041
178309943,0cyclictest3556-21lldpd09:09:331
178309943,0cyclictest3556-21lldpd08:35:031
178309943,0cyclictest3556-21lldpd08:24:331
178309943,0cyclictest3556-21lldpd07:12:001
178309943,0cyclictest3514-21snmpd08:42:421
178309943,0cyclictest3241-21irqbalance11:12:461
178309943,0cyclictest3241-21irqbalance10:37:471
178299944,0cyclictest0-21swapper/011:52:570
178299944,0cyclictest0-21swapper/010:30:390
178299944,0cyclictest0-21swapper/010:30:390
178299944,0cyclictest0-21swapper/010:17:440
178299943,0cyclictest3514-21snmpd09:57:430
178299943,0cyclictest30198-21awk10:57:540
178299943,0cyclictest26190-21idleruntime-cro12:17:370
178299943,0cyclictest15472-21kthreadcore07:07:540
178299943,0cyclictest13022-21awk11:27:520
179940,0migration/17388-21kthreadcore10:42:551
179940,0migration/15987-21taskset08:58:201
179940,0migration/15508-21kthreadcore08:37:551
179940,0migration/15439-21irqrtprio11:22:531
179940,0migration/14894-21kthreadcore11:42:551
179940,0migration/131342-21taskset06:57:481
179940,0migration/129810-21kthreadcore06:52:551
179940,0migration/127808-21cpuspeed_turbos08:07:501
179940,0migration/12623-21kthreadcore09:37:561
179940,0migration/124576-21kthreadcore10:32:561
179940,0migration/124062-21runrttasks08:52:411
179940,0migration/123766-21kthreadcore10:12:541
179940,0migration/121946-21munin-node08:47:591
179940,0migration/121542-21fschecks_time08:02:511
179940,0migration/118729-21fschecks_time06:47:511
179940,0migration/113960-21kthreadcore11:27:541
179940,0migration/11354-21fschecks_count07:47:521
179940,0migration/113275-21kthreadcore11:47:541
179940,0migration/112715-21kthreadcore09:22:561
169940,0watchdog/16273-21tr08:12:571
169940,0watchdog/125582-21kthreadcore10:52:561
169940,0watchdog/122940-21kthreadcore11:32:561
169940,0watchdog/119886-21sh11:10:561
169940,0watchdog/119490-21fschecks_count07:12:491
169940,0watchdog/116635-21irqcore09:27:531
169940,0watchdog/111745-21ssh11:05:201
149940,0migration/08362-21fschecks_count09:02:510
149940,0migration/07793-21kthreadcore07:02:560
149940,0migration/04211-21kthreadcore08:57:560
149940,0migration/031324-21latency_hist09:37:390
149940,0migration/023979-21kthreadcore11:32:570
149940,0migration/022641-21kthreadcore06:47:550
149940,0migration/013554-21sh10:05:520
149940,0migration/011504-21kthreadcore09:22:560
339930,0migration/312944-21munin-node07:52:573
29715030,0irq/26-eth0-rx-0-21swapper/312:12:403
29715030,0irq/26-eth0-rx-0-21swapper/308:47:103
29715030,0irq/26-eth0-rx-0-21swapper/308:32:113
29715030,0irq/26-eth0-rx-0-21swapper/307:12:473
259930,0migration/211502-21kthreadcore08:17:562
249930,0watchdog/20-21swapper/207:37:412
178329933,0cyclictest3556-21lldpd06:57:302
178329933,0cyclictest0-21swapper/207:27:532
178329932,0cyclictest789-21awk07:22:542
178329932,0cyclictest3556-21lldpd08:26:032
178329932,0cyclictest29807-21kthreadcore08:32:542
178309933,0cyclictest0-21swapper/108:27:591
178309932,0cyclictest8641-21basename08:17:511
178309932,0cyclictest19618-21sensors10:27:591
178309932,0cyclictest19618-21sensors10:27:591
178309932,0cyclictest14631-21diskstats07:57:511
178309930,0cyclictest27956-40yum-updatesd-he11:37:501
178299933,0cyclictest12167-21kworker/0:110:52:440
178299933,0cyclictest12167-21kworker/0:110:32:540
178299933,0cyclictest12167-21kworker/0:109:42:400
178299933,0cyclictest12167-21kworker/0:108:27:520
178299933,0cyclictest12167-21kworker/0:108:02:500
178299933,0cyclictest12167-21kworker/0:107:53:000
178299933,0cyclictest12167-21kworker/0:107:22:160
178299933,0cyclictest12167-21kworker/0:106:57:500
178299932,0cyclictest19838-21awk07:12:510
178299930,0cyclictest19936-40yum-updatesd-he07:37:560
179930,0migration/14616-21kthreadcore09:17:561
179930,0migration/113956-21munin-node07:32:531
169930,0watchdog/10-21swapper/110:49:361
169930,0watchdog/10-21swapper/110:10:401
29715020,0irq/26-eth0-rx-0-21swapper/307:24:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional