You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 03:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Jul 17, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450550,0irq/25-eth10-21swapper/318:48:093
3107023724,0sleep10-21swapper/118:46:411
3098923430,0sleep20-21swapper/218:45:462
3120423322,0sleep00-21swapper/018:48:120
313919976,0cyclictest0-21swapper/020:44:530
35160,0ktimersoftd/30-21swapper/319:04:363
339960,0migration/38416-21sh21:16:103
339960,0migration/35393-21munin-node00:09:483
339960,0migration/327470-21sh00:02:463
339960,0migration/315875-21munin-node20:14:493
313929960,0cyclictest0-21swapper/123:44:421
313919965,0cyclictest11699-21timerandwakeup18:54:590
29725060,0irq/27-eth0-tx-4309-21if_eth1.323:49:512
29715060,0irq/26-eth0-rx-7449-21gltestperf22:34:493
29715060,0irq/26-eth0-rx-31016-21cut21:49:533
29715060,0irq/26-eth0-rx-27251-21df21:29:473
29715060,0irq/26-eth0-rx-26805-21python22:04:593
29715060,0irq/26-eth0-rx-24701-21users21:25:033
29715060,0irq/26-eth0-rx-20164-21kthreadcore22:59:513
29715060,0irq/26-eth0-rx-12736-21aten_r1power_po21:59:473
27160,0ktimersoftd/20-21swapper/219:04:362
8215050,0irq/24-0000:00:27585-21perf19:59:362
4150,0ktimersoftd/00-21swapper/023:15:070
339950,0migration/38786-21missed_timers23:49:543
339950,0migration/36269-21runrttasks19:15:413
339950,0migration/35814-21cpuspeed_turbos20:54:493
339950,0migration/34789-21fschecks_time21:54:503
339950,0migration/34095-21kthreadcore23:29:523
339950,0migration/330809-21kthreadcore19:59:543
339950,0migration/328871-21aten_r1power_fr20:24:473
339950,0migration/327842-21fschecks_count23:44:523
339950,0migration/327355-21taskset19:57:073
339950,0migration/326526-21sshd19:34:053
339950,0migration/325997-21kthreadcore20:44:533
339950,0migration/324800-21kthreadcore21:04:523
339950,0migration/320549-21taskset19:50:033
339950,0migration/31883-21idleruntime19:39:503
339950,0migration/315016-21taskset22:39:393
339950,0migration/315015-21kthreadcore00:14:523
339950,0migration/314363-21fschecks_count22:19:493
313939955,0cyclictest0-21swapper/222:34:552
313939954,0cyclictest17376-21awk20:39:512
313939950,0cyclictest0-21swapper/223:49:102
313939950,0cyclictest0-21swapper/223:04:142
313939950,0cyclictest0-21swapper/222:03:332
313939950,0cyclictest0-21swapper/221:33:162
313939950,0cyclictest0-21swapper/220:54:102
313939950,0cyclictest0-21swapper/200:11:152
313929955,0cyclictest0-21swapper/122:34:521
313929955,0cyclictest0-21swapper/122:18:091
313929955,0cyclictest0-21swapper/121:46:091
313929955,0cyclictest0-21swapper/121:22:201
313929955,0cyclictest0-21swapper/121:15:531
313929955,0cyclictest0-21swapper/120:53:481
313929954,0cyclictest14425-21awk19:24:531
313929950,0cyclictest0-21swapper/121:59:041
313919955,0cyclictest0-21swapper/022:29:530
29725050,0irq/27-eth0-tx-9093-21sed22:54:522
29725050,0irq/27-eth0-tx-32296-21ssh22:49:502
29725050,0irq/27-eth0-tx-26771-21ps19:54:590
29725050,0irq/27-eth0-tx-23248-21munin-node22:24:532
29725050,0irq/27-eth0-tx-22171-21kthreadcore23:19:532
29725050,0irq/27-eth0-tx-20518-21ssh21:00:572
29725050,0irq/27-eth0-tx-19749-21munin-node21:44:472
29725050,0irq/27-eth0-tx-17642-21ssh21:40:172
29725050,0irq/27-eth0-tx-1681-21sh00:04:552
29725050,0irq/27-eth0-tx-15480-21munin-node20:14:580
29725050,0irq/27-eth0-tx-10140-21ssh21:37:252
29725050,0irq/27-eth0-tx-0-21swapper/223:56:212
29725050,0irq/27-eth0-tx-0-21swapper/223:25:552
29725050,0irq/27-eth0-tx-0-21swapper/221:50:592
29725050,0irq/27-eth0-tx-0-21swapper/221:24:552
29725050,0irq/27-eth0-tx-0-21swapper/221:12:362
29725050,0irq/27-eth0-tx-0-21swapper/220:57:012
29725050,0irq/27-eth0-tx-0-21swapper/020:19:580
29715050,0irq/26-eth0-rx-8940-21cat23:14:353
29715050,0irq/26-eth0-rx-8785-21cut22:14:543
29715050,0irq/26-eth0-rx-32320-21ssh23:25:193
29715050,0irq/26-eth0-rx-22125-21ssh22:24:363
29715050,0irq/26-eth0-rx-14820-21ssh22:56:443
29715050,0irq/26-eth0-rx-14500-21python20:09:593
29715050,0irq/26-eth0-rx-0-21swapper/323:59:213
29715050,0irq/26-eth0-rx-0-21swapper/323:41:343
29715050,0irq/26-eth0-rx-0-21swapper/323:34:463
29715050,0irq/26-eth0-rx-0-21swapper/323:19:493
29715050,0irq/26-eth0-rx-0-21swapper/323:14:493
29715050,0irq/26-eth0-rx-0-21swapper/322:52:113
29715050,0irq/26-eth0-rx-0-21swapper/322:47:493
29715050,0irq/26-eth0-rx-0-21swapper/322:31:263
29715050,0irq/26-eth0-rx-0-21swapper/322:09:553
29715050,0irq/26-eth0-rx-0-21swapper/321:45:023
29715050,0irq/26-eth0-rx-0-21swapper/321:40:063
29715050,0irq/26-eth0-rx-0-21swapper/321:34:533
29715050,0irq/26-eth0-rx-0-21swapper/320:51:383
29715050,0irq/26-eth0-rx-0-21swapper/320:29:533
29715050,0irq/26-eth0-rx-0-21swapper/300:04:383
27150,0ktimersoftd/20-21swapper/223:40:402
27150,0ktimersoftd/20-21swapper/223:15:072
259950,0migration/24488-21taskset22:30:052
259950,0migration/232275-21taskset23:08:232
259950,0migration/229384-21taskset22:09:442
259950,0migration/228725-21sh22:08:432
259950,0migration/223637-21munin-node22:44:472
259950,0migration/22269-21kthreadcore18:49:532
259950,0migration/213534-21fschecks_count00:14:482
259950,0migration/210111-21munin-node21:55:002
19150,0ktimersoftd/10-21swapper/123:15:071
179950,0migration/132053-21runrttasks21:10:331
179950,0migration/130436-21kthreadcore19:09:531
179950,0migration/128964-21unixbench-2d20:44:591
179950,0migration/128871-21gltestperf21:49:491
179950,0migration/121176-21unixbench_singl22:40:011
179950,0migration/121154-21latency_hist00:19:351
179950,0migration/12075-21switchtime20:24:591
179950,0migration/117556-21munin-node23:54:591
179950,0migration/115456-21latency_hist20:14:361
179950,0migration/114454-21rt-features20:09:581
169950,0watchdog/17008-21kthreadcore23:29:531
169950,0watchdog/114412-21ssh22:55:461
149950,0migration/04515-21latency18:49:540
149950,0migration/031135-21sh22:48:370
149950,0migration/027787-21taskset21:49:320
149950,0migration/022050-21latency_hist22:24:350
149950,0migration/014075-21aten_r1power_po20:59:480
339940,0migration/39924-21kthreadcore19:44:543
339940,0migration/35388-21taskset18:51:203
339940,0migration/330959-21kthreadcore19:09:533
339940,0migration/325056-21df_abs23:04:493
339940,0migration/321906-21open_inodes20:39:563
313939943,0cyclictest3514-21snmpd20:35:372
313939943,0cyclictest3514-21snmpd20:11:072
313939943,0cyclictest3514-21snmpd19:59:522
313939943,0cyclictest3514-21snmpd19:27:372
313939943,0cyclictest3514-21snmpd19:21:072
313939943,0cyclictest3514-21snmpd19:14:372
313939943,0cyclictest3001-21awk20:04:512
313939943,0cyclictest23019-21awk20:19:502
313939943,0cyclictest15385-21awk19:49:502
313929943,0cyclictest6452-21awk20:54:521
313929943,0cyclictest3908-21awk21:34:511
313929943,0cyclictest374-21awk22:49:521
313929943,0cyclictest3514-21snmpd23:06:221
313929943,0cyclictest3514-21snmpd22:45:371
313929943,0cyclictest3514-21snmpd20:42:071
313929943,0cyclictest3514-21snmpd20:34:521
313929943,0cyclictest3514-21snmpd20:29:521
313929943,0cyclictest3514-21snmpd19:35:221
313929943,0cyclictest3514-21snmpd19:30:071
313929943,0cyclictest3514-21snmpd19:15:521
313929943,0cyclictest3514-21snmpd18:58:071
313929943,0cyclictest3241-21irqbalance19:19:551
313929943,0cyclictest22090-21awk19:54:521
313929943,0cyclictest21020-21awk23:59:501
313929943,0cyclictest19481-21awk21:24:531
313919944,0cyclictest0-21swapper/021:12:370
313919944,0cyclictest0-21swapper/020:54:490
313919943,0cyclictest6628-21sadc19:19:360
313919943,0cyclictest5561-21awk00:09:500
313919943,0cyclictest3514-21snmpd23:31:520
313919943,0cyclictest3514-21snmpd22:37:220
313919943,0cyclictest3514-21snmpd19:05:070
313919943,0cyclictest3241-21irqbalance23:20:340
313919943,0cyclictest3241-21irqbalance23:10:240
313919943,0cyclictest3241-21irqbalance23:01:240
313919943,0cyclictest3241-21irqbalance22:55:540
313919943,0cyclictest3241-21irqbalance22:09:440
313919943,0cyclictest3241-21irqbalance21:49:540
313919943,0cyclictest3241-21irqbalance21:17:040
313919943,0cyclictest3241-21irqbalance18:59:450
313919943,0cyclictest28693-21awk19:59:510
313919943,0cyclictest28294-21awk23:44:540
313919943,0cyclictest26938-21awk23:24:510
313919943,0cyclictest26743-21awk19:09:500
313919943,0cyclictest21880-21awk22:04:510
313919943,0cyclictest16057-21awk22:39:520
313919943,0cyclictest15041-21ps22:19:530
313919943,0cyclictest12659-21awk23:54:510
313919943,0cyclictest10984-21awk21:19:490
313919940,0cyclictest0-21swapper/021:04:440
29725040,0irq/27-eth0-tx-28781-21munin-node20:24:490
29725040,0irq/27-eth0-tx-15066-21ssh22:39:472
29725040,0irq/27-eth0-tx-0-21swapper/223:34:402
29725040,0irq/27-eth0-tx-0-21swapper/223:09:532
29725040,0irq/27-eth0-tx-0-21swapper/222:19:372
29725040,0irq/27-eth0-tx-0-21swapper/221:14:472
29725040,0irq/27-eth0-tx-0-21swapper/020:49:490
29725040,0irq/27-eth0-tx-0-21swapper/019:39:590
29725040,0irq/27-eth0-tx-0-21swapper/019:34:550
29725040,0irq/27-eth0-tx-0-21swapper/019:29:480
29725040,0irq/27-eth0-tx-0-21swapper/019:26:330
29715040,0irq/26-eth0-rx-11090-21kthreadcore20:34:523
29715040,0irq/26-eth0-rx-0-21swapper/321:20:053
29715040,0irq/26-eth0-rx-0-21swapper/321:10:383
29715040,0irq/26-eth0-rx-0-21swapper/320:59:473
29715040,0irq/26-eth0-rx-0-21swapper/320:19:473
29715040,0irq/26-eth0-rx-0-21swapper/319:34:533
259940,0migration/26223-21gltestperf22:14:492
259940,0migration/228921-21aten_r1power_vo20:24:482
259940,0migration/227782-21munin-node21:04:542
259940,0migration/226912-21aten_r1power_po19:34:472
259940,0migration/226124-21cpuspeed_turbos19:09:472
259940,0migration/224687-21ntp_kernel_pll_19:04:542
259940,0migration/220039-21kthreadcore20:14:542
259940,0migration/212471-21kthreadcore21:19:522
259940,0migration/210823-21kthreadcore18:54:542
249940,0watchdog/27007-21cut23:29:532
249940,0watchdog/220101-21ssh23:59:412
249940,0watchdog/211797-21kthreadcore19:44:542
179940,0migration/18026-21kthreadcore00:09:521
179940,0migration/1490-21latency_hist23:09:351
179940,0migration/14194-21switchtime22:30:011
179940,0migration/131539-21kthreadcore22:09:521
179940,0migration/128330-21fschecks_count19:59:501
179940,0migration/12828-21kthreadcore18:49:541
179940,0migration/12768-21kthreadcore19:39:531
179940,0migration/127626-21fschecks_time21:29:491
179940,0migration/126403-21diskmemload23:24:481
179940,0migration/124122-21kthreadcore22:24:541
179940,0migration/123207-21irqcore20:19:511
179940,0migration/119933-21fschecks_time19:04:491
179940,0migration/118240-21fschecks_time23:19:491
179940,0migration/116651-21kthreadcore20:59:541
179940,0migration/113465-21kthreadcore21:39:531
179940,0migration/113000-21fschecks_count18:59:471
179940,0migration/112955-21df21:59:481
169940,0watchdog/19733-21ssh23:50:331
169940,0watchdog/128461-21ssh00:04:371
169940,0watchdog/124728-21ssh22:04:541
169940,0watchdog/118922-21munin-node23:39:491
169940,0watchdog/116632-21cpuspeed_turbos22:59:461
169940,0watchdog/10-21swapper/122:19:541
149940,0migration/06046-21kthreadcore23:49:520
149940,0migration/05998-21kthreadcore21:54:540
149940,0migration/03431-21sh00:07:400
149940,0migration/030935-21taskset23:05:110
149940,0migration/027021-21taskset00:01:420
149940,0migration/024051-21needreboot21:24:570
149940,0migration/018654-21kthreadcore20:39:520
149940,0migration/013217-21ksmtuned22:18:500
149940,0migration/012850-21munin-node21:59:480
8215030,0irq/24-0000:00:0-21swapper/220:29:362
8215030,0irq/24-0000:00:0-21swapper/219:39:592
313929933,0cyclictest0-21swapper/123:35:531
313919932,0cyclictest8686-21awk19:44:520
313919932,0cyclictest7746-21awk19:19:500
313919932,0cyclictest3556-21lldpd22:52:180
313919932,0cyclictest3514-21snmpd20:34:370
313919932,0cyclictest3074-21awk20:04:520
313919932,0cyclictest23270-21kthreadcore23:39:550
313919932,0cyclictest19034-21grep00:14:590
313919932,0cyclictest16332-21sensors23:34:580
313919932,0cyclictest15871-21grep19:49:520
313919932,0cyclictest14881-21grep21:39:540
313919930,0cyclictest3765-21perl20:29:490
29725030,0irq/27-eth0-tx-0-21swapper/020:09:480
29715030,0irq/26-eth0-rx-0-21swapper/319:24:503
29715030,0irq/26-eth0-rx-0-21swapper/319:21:093
29715030,0irq/26-eth0-rx-0-21swapper/319:07:223
29715030,0irq/26-eth0-rx-0-21swapper/318:54:493
249930,0watchdog/20-21swapper/220:44:502
249930,0watchdog/20-21swapper/219:33:182
179930,0migration/118193-21kthreadcore19:49:531
169930,0watchdog/10-21swapper/121:04:581
169930,0watchdog/10-21swapper/119:44:541
149930,0migration/010433-21sh21:38:050
339920,0migration/32469-21diskstats20:04:493
313929921,0cyclictest1841-21latency_hist20:04:361
313919920,0cyclictest0-21swapper/021:29:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional