You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-09 - 00:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Sep 08, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2223726766,0sleep30-21swapper/306:42:173
2208623526,0sleep20-21swapper/206:40:322
2223423426,0sleep00-21swapper/006:42:140
2223523223,0sleep10-21swapper/106:42:151
224999976,0cyclictest0-21swapper/107:54:451
339960,0migration/36737-21sh11:35:303
339960,0migration/332048-21sh11:33:293
339960,0migration/321247-21munin-node08:44:413
339960,0migration/318613-21sh10:03:543
339960,0migration/310209-21sh09:35:413
29725060,0irq/27-eth0-tx-31270-21munin-node07:39:480
29715060,0irq/26-eth0-rx-7349-21grep08:09:453
29715060,0irq/26-eth0-rx-6606-21iostat_ios07:44:473
29715060,0irq/26-eth0-rx-3581-21cut10:54:463
224989966,0cyclictest20778-21diskmemload10:25:400
224989960,0cyclictest0-21swapper/011:59:480
224989960,0cyclictest0-21swapper/010:31:590
339950,0migration/38252-21munin-node11:59:423
339950,0migration/33835-21kthreadcore08:29:453
339950,0migration/331951-21latency08:24:473
339950,0migration/330922-21kthreadcore08:49:473
339950,0migration/330301-21aten_r1power_cu07:14:423
339950,0migration/330301-21aten_r1power_cu07:14:423
339950,0migration/329398-21munin-node06:49:423
339950,0migration/329310-21kthreadcore10:49:473
339950,0migration/327351-21cpuspeed_turbos10:09:443
339950,0migration/327173-21kthreadcore07:09:473
339950,0migration/322687-21kthreadcore09:44:513
339950,0migration/321504-21kthreadcore07:54:493
339950,0migration/320764-21kthreadcore10:04:493
339950,0migration/320477-21kthreadcore11:04:463
339950,0migration/320410-21kthreadcore10:24:473
339950,0migration/320388-21kthreadcore07:29:483
339950,0migration/319900-21latency_hist08:19:303
339950,0migration/319236-21kthreadcore11:44:463
339950,0migration/318643-21missed_timers08:14:513
339950,0migration/313222-21diskmemload09:19:453
339950,0migration/313011-21kthreadcore10:59:463
29725050,0irq/27-eth0-tx-29855-21if_eth1.208:49:462
29725050,0irq/27-eth0-tx-27063-21irqcore10:49:452
29725050,0irq/27-eth0-tx-17965-21munin-node07:29:540
29725050,0irq/27-eth0-tx-16237-21kthreadcore08:59:472
29725050,0irq/27-eth0-tx-0-21swapper/211:13:232
29715050,0irq/26-eth0-rx-6559-21runrttasks12:09:473
29715050,0irq/26-eth0-rx-5373-21cat09:14:463
29715050,0irq/26-eth0-rx-3482-21grep11:14:473
29715050,0irq/26-eth0-rx-26393-21sh11:09:463
29715050,0irq/26-eth0-rx-24997-21df_abs07:34:423
29715050,0irq/26-eth0-rx-22075-21irqrtprio09:04:473
29715050,0irq/26-eth0-rx-18668-21gltestperf10:44:423
29715050,0irq/26-eth0-rx-18142-21cat08:59:483
29715050,0irq/26-eth0-rx-17414-21cut12:04:463
29715050,0irq/26-eth0-rx-1358-21ssh09:49:563
29715050,0irq/26-eth0-rx-11417-21cut11:19:473
29715050,0irq/26-eth0-rx-0-21swapper/311:53:433
29715050,0irq/26-eth0-rx-0-21swapper/311:24:463
29715050,0irq/26-eth0-rx-0-21swapper/310:34:083
29715050,0irq/26-eth0-rx-0-21swapper/309:43:213
29715050,0irq/26-eth0-rx-0-21swapper/309:29:483
27150,0ktimersoftd/20-21swapper/209:31:012
259950,0migration/216850-21aten2.4-expect11:24:402
249950,0watchdog/229072-21missed_timers12:09:472
225009955,0cyclictest28987-21kthreadcore10:09:482
225009955,0cyclictest0-21swapper/212:02:222
225009955,0cyclictest0-21swapper/210:33:372
225009955,0cyclictest0-21swapper/207:19:512
225009950,0cyclictest0-21swapper/212:08:122
225009950,0cyclictest0-21swapper/211:56:322
225009950,0cyclictest0-21swapper/211:01:212
224989955,0cyclictest0-21swapper/011:26:320
224989955,0cyclictest0-21swapper/008:49:020
224989955,0cyclictest0-21swapper/008:09:460
224989950,0cyclictest0-21swapper/010:54:320
224989950,0cyclictest0-21swapper/009:10:280
19150,0ktimersoftd/10-21swapper/110:39:211
179950,0migration/16974-21sh11:14:531
179950,0migration/124543-21kthreadcore09:24:481
179950,0migration/118754-21sh08:59:531
179950,0migration/114951-21kthreadcore07:49:461
179950,0migration/111454-21timerandwakeup07:44:531
169950,0watchdog/131401-21ssh11:53:081
169950,0watchdog/130083-21gltestperf06:49:451
169950,0watchdog/123927-21ls10:24:481
149950,0migration/09605-21munin-node06:54:540
149950,0migration/08590-21cpuspeed_turbos11:39:420
149950,0migration/0789-21latency_hist08:29:300
149950,0migration/0770-21kthreadcore08:49:480
149950,0migration/06579-21ksmtuned11:35:050
149950,0migration/04832-21kthreadcore08:29:450
149950,0migration/03995-21idleruntime09:54:420
149950,0migration/029824-21kthreadcore11:09:480
149950,0migration/029447-21smart_sda12:09:510
149950,0migration/027912-21kthreadcore07:59:480
149950,0migration/027118-21aten_r1power_en10:09:420
149950,0migration/026612-21taskset09:04:530
149950,0migration/026486-21taskset09:25:120
149950,0migration/026334-21sh09:46:260
149950,0migration/026326-21munin-node10:49:420
149950,0migration/024584-21missed_timers10:04:510
149950,0migration/019126-21kthreadcore07:04:500
149950,0migration/018463-21sh10:03:260
149950,0migration/01677-21timerandwakeup09:29:530
149950,0migration/016643-21df_abs11:44:410
149950,0migration/014735-21switchtime11:19:530
149950,0migration/014041-21kthreadcore09:19:470
149950,0migration/013630-21kthreadcore10:19:460
339940,0migration/39545-21taskset10:17:093
339940,0migration/314594-21diskmemload11:40:173
29725040,0irq/27-eth0-tx-8634-21memory09:54:462
29725040,0irq/27-eth0-tx-4402-21munin-node09:14:462
29725040,0irq/27-eth0-tx-24231-21ssh10:45:132
29725040,0irq/27-eth0-tx-24190-21munin-node11:49:412
29725040,0irq/27-eth0-tx-20778-21diskmemload11:30:002
29725040,0irq/27-eth0-tx-20778-21diskmemload10:57:132
29725040,0irq/27-eth0-tx-16253-21munin-node11:44:432
29725040,0irq/27-eth0-tx-14668-21ssh11:19:522
29725040,0irq/27-eth0-tx-0-21swapper/211:39:462
29725040,0irq/27-eth0-tx-0-21swapper/210:25:072
29725040,0irq/27-eth0-tx-0-21swapper/210:19:522
29725040,0irq/27-eth0-tx-0-21swapper/210:14:502
29725040,0irq/27-eth0-tx-0-21swapper/210:04:502
29725040,0irq/27-eth0-tx-0-21swapper/209:59:372
29725040,0irq/27-eth0-tx-0-21swapper/209:35:052
29725040,0irq/27-eth0-tx-0-21swapper/209:26:012
29725040,0irq/27-eth0-tx-0-21swapper/209:19:452
29725040,0irq/27-eth0-tx-0-21swapper/209:04:452
29725040,0irq/27-eth0-tx-0-21swapper/008:40:040
29725040,0irq/27-eth0-tx-0-21swapper/007:55:480
29715040,0irq/26-eth0-rx-0-21swapper/311:54:323
29715040,0irq/26-eth0-rx-0-21swapper/310:39:303
29715040,0irq/26-eth0-rx-0-21swapper/310:36:173
29715040,0irq/26-eth0-rx-0-21swapper/310:23:053
29715040,0irq/26-eth0-rx-0-21swapper/309:56:383
29715040,0irq/26-eth0-rx-0-21swapper/309:24:313
29715040,0irq/26-eth0-rx-0-21swapper/309:11:063
29715040,0irq/26-eth0-rx-0-21swapper/308:55:263
29715040,0irq/26-eth0-rx-0-21swapper/308:34:413
29715040,0irq/26-eth0-rx-0-21swapper/306:44:423
27140,0ktimersoftd/20-21swapper/206:47:512
259940,0migration/2997-21aten_r1power_vo11:14:422
259940,0migration/26904-21kernelversion07:44:472
259940,0migration/26096-21sendmail_mailst11:34:512
259940,0migration/224367-21munin-node07:54:512
259940,0migration/223150-21diskmemload11:04:502
259940,0migration/215518-21kthreadcore09:39:462
259940,0migration/215007-21kthreadcore06:59:472
259940,0migration/213043-21munin-node07:49:432
259940,0migration/212016-21kthreadcore10:39:462
249940,0watchdog/23253-21irqrtprio10:34:482
249940,0watchdog/226314-21fschecks_time07:59:442
249940,0watchdog/20-21swapper/209:44:322
249940,0watchdog/20-21swapper/208:19:482
225009943,0cyclictest3556-21lldpd07:04:332
225009943,0cyclictest3514-21snmpd08:04:392
225009943,0cyclictest3241-21irqbalance08:40:192
225009943,0cyclictest3241-21irqbalance08:35:292
225009943,0cyclictest3241-21irqbalance08:29:592
225009943,0cyclictest3241-21irqbalance08:24:592
225009943,0cyclictest3241-21irqbalance08:15:392
225009943,0cyclictest3241-21irqbalance07:40:192
225009943,0cyclictest3241-21irqbalance07:30:392
225009943,0cyclictest3241-21irqbalance07:25:392
225009943,0cyclictest3241-21irqbalance07:16:092
225009943,0cyclictest3241-21irqbalance07:16:092
225009943,0cyclictest3241-21irqbalance06:54:492
225009943,0cyclictest3241-21irqbalance06:49:492
225009943,0cyclictest29794-21awk09:09:472
225009943,0cyclictest28511-21awk09:49:462
225009943,0cyclictest25605-21awk07:34:452
225009943,0cyclictest24596-21awk07:09:452
225009943,0cyclictest21969-21awk08:44:452
224999943,0cyclictest3556-21lldpd11:31:351
224999943,0cyclictest3556-21lldpd09:55:331
224999943,0cyclictest3556-21lldpd08:34:341
224999943,0cyclictest3556-21lldpd08:31:341
224999943,0cyclictest3556-21lldpd08:09:041
224999943,0cyclictest3514-21snmpd07:59:541
224999943,0cyclictest3241-21irqbalance11:54:381
224999943,0cyclictest3241-21irqbalance10:33:081
224999943,0cyclictest27527-21awk08:24:441
224999943,0cyclictest26214-21awk11:09:451
224999943,0cyclictest24399-21sadc07:34:311
224999943,0cyclictest20667-21awk09:44:491
224999943,0cyclictest16879-21irqrtprio12:04:451
224999943,0cyclictest13342-21awk09:19:461
224999943,0cyclictest12169-21awk07:24:441
224999940,0cyclictest0-21swapper/111:39:341
224999940,0cyclictest0-21swapper/109:50:091
224989944,0cyclictest0-21swapper/010:14:480
224989943,0cyclictest8526-21awk08:34:440
224989943,0cyclictest3556-21lldpd11:02:340
224989943,0cyclictest3514-21snmpd07:01:230
224989943,0cyclictest2910-21awk10:34:460
224989943,0cyclictest25062-21awk11:49:430
224989943,0cyclictest18851-21ps12:04:460
224989943,0cyclictest13222-21awk07:49:440
224989943,0cyclictest12656-21awk09:39:440
224989943,0cyclictest10872-21awk10:39:430
179940,0migration/18253-21kthreadcore09:14:481
179940,0migration/15243-21kthreadcore06:54:471
179940,0migration/126860-21kthreadcore12:09:461
179940,0migration/126457-21fschecks_count10:49:431
179940,0migration/125563-21kthreadcore06:44:471
179940,0migration/12271-21switchtime09:09:541
179940,0migration/122619-21munin-node11:24:511
179940,0migration/120082-21kthreadcore10:44:451
179940,0migration/118668-21kthreadcore08:39:481
179940,0migration/116305-21kthreadcore08:14:491
179940,0migration/116034-21missed_timers10:19:481
179940,0migration/115397-21munin-node10:39:471
179940,0migration/11459-21kthreadcore07:39:471
179940,0migration/111845-21fschecks_time09:59:421
179940,0migration/111760-21kthreadcore11:59:461
179940,0migration/110385-21timerandwakeup07:19:521
169940,0watchdog/124424-21ssh11:07:321
169940,0watchdog/122938-21unixbench_singl07:04:571
169940,0watchdog/116245-21ssh11:01:521
169940,0watchdog/113040-21kthreadcore11:19:481
169940,0watchdog/10-21swapper/110:54:441
149940,0migration/09751-21kthreadcore09:14:480
149940,0migration/07928-21kthreadcore07:19:470
149940,0migration/05923-21irqrtprio08:54:470
149940,0migration/030743-21runrttasks07:36:080
149940,0migration/027996-21latency06:44:480
149940,0migration/025341-21fschecks_time11:29:430
149940,0migration/021611-21kthreadcore08:19:470
149940,0migration/020286-21kthreadcore10:44:460
149940,0migration/019442-21kthreadcore11:04:460
149940,0migration/017597-21taskset07:28:030
339930,0migration/320662-21runrttasks08:43:203
29725030,0irq/27-eth0-tx-0-21swapper/208:54:422
29725030,0irq/27-eth0-tx-0-21swapper/008:14:430
29725030,0irq/27-eth0-tx-0-21swapper/008:04:410
29725030,0irq/27-eth0-tx-0-21swapper/007:14:420
29725030,0irq/27-eth0-tx-0-21swapper/007:14:420
29715030,0irq/26-eth0-rx-0-21swapper/308:04:403
29715030,0irq/26-eth0-rx-0-21swapper/307:49:413
29715030,0irq/26-eth0-rx-0-21swapper/307:40:583
29715030,0irq/26-eth0-rx-0-21swapper/307:24:383
29715030,0irq/26-eth0-rx-0-21swapper/307:19:413
29715030,0irq/26-eth0-rx-0-21swapper/307:04:563
29715030,0irq/26-eth0-rx-0-21swapper/307:03:333
29715030,0irq/26-eth0-rx-0-21swapper/306:54:433
249930,0watchdog/20-21swapper/208:09:482
224999933,0cyclictest3556-21lldpd08:10:341
224999933,0cyclictest20813-21awk08:19:451
224999932,0cyclictest5531-21awk08:54:451
224999932,0cyclictest3598-21sensors07:14:521
224999932,0cyclictest3598-21sensors07:14:521
224999932,0cyclictest3456-21awk10:14:451
224999932,0cyclictest30101-21grep08:49:471
224999932,0cyclictest25557-21awk07:34:451
224999932,0cyclictest25188-21kthreadcore08:44:471
224989932,0cyclictest656-21awk11:54:430
224989932,0cyclictest5799-21grep11:14:480
224989932,0cyclictest28527-21awk09:49:470
224989932,0cyclictest23639-21munin-node07:09:450
224989932,0cyclictest0-21swapper/006:49:510
224989930,0cyclictest5582-21munin-node07:44:450
224989930,0cyclictest13122-21df08:59:420
179930,0migration/16535-21sh11:34:581
179930,0migration/111731-21taskset09:39:401
169930,0watchdog/132694-21ps10:09:521
169930,0watchdog/120778-21diskmemload09:04:481
169930,0watchdog/10-21swapper/111:44:481
169930,0watchdog/10-21swapper/110:04:441
169930,0watchdog/10-21swapper/109:34:441
169930,0watchdog/10-21swapper/109:29:441
169930,0watchdog/10-21swapper/107:09:451
169930,0watchdog/10-21swapper/106:59:411
29715020,0irq/26-eth0-rx-0-21swapper/308:01:283
224989921,0cyclictest3795-21aten_r1power_en09:34:390
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional