You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 13:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Apr 12, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
531224736,0sleep00-21swapper/018:56:320
304450350,0irq/25-eth10-21swapper/318:54:183
519023223,0sleep20-21swapper/218:55:102
511523228,0sleep10-21swapper/118:54:131
339970,0migration/310954-21sh22:01:333
55839960,0cyclictest0-21swapper/223:40:202
55719966,0cyclictest0-21swapper/022:48:540
55719965,0cyclictest12568-21sed22:43:590
339960,0migration/327707-21sh21:12:343
339960,0migration/327200-21sh21:30:273
339960,0migration/325287-21sh00:11:393
339960,0migration/317931-21sh22:45:243
339960,0migration/31723-21sh22:56:043
339960,0migration/311980-21sh21:43:403
339960,0migration/310545-21sh21:00:273
29715060,0irq/26-eth0-rx-27039-21sh21:50:513
29715060,0irq/26-eth0-rx-24150-21pmu-power23:49:043
29715060,0irq/26-eth0-rx-11176-21perl23:43:573
29715060,0irq/26-eth0-rx-0-21swapper/323:27:123
19160,0ktimersoftd/116815-21ssh00:05:181
8215050,0irq/24-0000:00:18166-21cat00:08:432
8215050,0irq/24-0000:00:0-21swapper/220:43:442
8215050,0irq/24-0000:00:0-21swapper/219:18:442
55839955,0cyclictest0-21swapper/222:53:402
55839955,0cyclictest0-21swapper/221:40:122
55839950,0cyclictest0-21swapper/223:38:262
55839950,0cyclictest0-21swapper/222:38:512
55839950,0cyclictest0-21swapper/222:18:212
55839950,0cyclictest0-21swapper/221:14:112
55759955,0cyclictest3686-21diskmemload22:37:571
55759955,0cyclictest0-21swapper/123:13:161
55759955,0cyclictest0-21swapper/122:58:271
55759950,0cyclictest0-21swapper/123:31:241
55719955,0cyclictest0-21swapper/022:14:230
339950,0migration/38384-21latency22:59:013
339950,0migration/38040-21munin-node19:23:593
339950,0migration/37358-21kthreadcore20:34:033
339950,0migration/36272-21kthreadcore23:58:593
339950,0migration/34092-21kthreadcore19:19:003
339950,0migration/33598-21taskset20:58:003
339950,0migration/330454-21kthreadcore22:34:013
339950,0migration/329351-21kthreadcore00:14:013
339950,0migration/329327-21kthreadcore20:04:013
339950,0migration/328701-21munin-node20:28:553
339950,0migration/32764-21cpuspeed_turbos23:38:563
339950,0migration/324314-21kthreadcore19:34:023
339950,0migration/322480-21kthreadcore22:29:003
339950,0migration/319508-21sh21:47:223
339950,0migration/318184-21switchtime19:04:053
339950,0migration/315909-21taskset20:41:513
339950,0migration/312647-21kthreadcore00:24:003
29725050,0irq/27-eth0-tx-4884-21if_eth1.221:58:592
29725050,0irq/27-eth0-tx-28635-21munin-node20:28:560
29725050,0irq/27-eth0-tx-28043-21munin-run21:53:432
29725050,0irq/27-eth0-tx-27705-21munin-node20:04:020
29725050,0irq/27-eth0-tx-18841-21munin-node23:28:552
29725050,0irq/27-eth0-tx-15214-21grep22:04:012
29725050,0irq/27-eth0-tx-0-21swapper/223:24:012
29725050,0irq/27-eth0-tx-0-21swapper/222:28:432
29725050,0irq/27-eth0-tx-0-21swapper/222:11:042
29725050,0irq/27-eth0-tx-0-21swapper/019:34:000
29725050,0irq/27-eth0-tx-0-21swapper/019:18:190
29715050,0irq/26-eth0-rx-3763-21entropy22:38:563
29715050,0irq/26-eth0-rx-27677-21idleruntime23:33:573
29715050,0irq/26-eth0-rx-23346-21cut22:49:013
29715050,0irq/26-eth0-rx-16251-21unixbench-2d00:04:063
29715050,0irq/26-eth0-rx-1437-21load21:14:033
29715050,0irq/26-eth0-rx-0-21swapper/323:23:053
29715050,0irq/26-eth0-rx-0-21swapper/323:14:003
29715050,0irq/26-eth0-rx-0-21swapper/323:07:193
29715050,0irq/26-eth0-rx-0-21swapper/322:24:403
29715050,0irq/26-eth0-rx-0-21swapper/322:06:573
29715050,0irq/26-eth0-rx-0-21swapper/321:24:443
29715050,0irq/26-eth0-rx-0-21swapper/321:21:413
29715050,0irq/26-eth0-rx-0-21swapper/321:04:443
29715050,0irq/26-eth0-rx-0-21swapper/320:13:563
29715050,0irq/26-eth0-rx-0-21swapper/300:18:573
259950,0migration/2604-21needreboot20:04:032
259950,0migration/228542-21latency_hist20:28:442
259950,0migration/223474-21kthreadcore21:09:012
259950,0migration/221505-21munin-node21:28:582
259950,0migration/22053-21latency_hist23:58:432
259950,0migration/217743-21sh23:05:382
249950,0watchdog/25605-21grep22:19:012
249950,0watchdog/226673-21chrt23:13:172
179950,0migration/17787-21switchtime00:19:081
179950,0migration/126879-21fschecks_time00:13:571
179950,0migration/118145-21latency_hist00:08:431
179950,0migration/114953-21kthreadcore23:44:021
179950,0migration/112494-21kthreadcore20:39:011
179950,0migration/112250-21irqrtprio23:03:591
179950,0migration/111307-21latency_hist22:43:431
169950,0watchdog/18629-21kthreadcore20:59:021
149950,0migration/09302-21sh23:40:580
149950,0migration/06470-21kthreadcore21:39:000
149950,0migration/03736-21kthreadcore00:19:020
149950,0migration/03709-21kthreadcore20:08:580
149950,0migration/03182-21taskset21:36:380
149950,0migration/031424-21kthreadcore21:14:020
149950,0migration/027848-21gltestperf23:13:570
149950,0migration/024234-21kthreadcore22:09:010
149950,0migration/022846-21kthreadcore21:09:010
149950,0migration/021167-21kthreadcore00:08:590
149950,0migration/021139-21aten_r1power_po19:58:560
149950,0migration/020503-21kthreadcore23:09:000
149950,0migration/020177-21kthreadcore23:49:000
149950,0migration/019512-21munin-node19:08:550
149950,0migration/017460-21kthreadcore21:44:020
149950,0migration/017065-21kthreadcore19:29:000
149950,0migration/015056-21kthreadcore21:24:000
149950,0migration/013891-21kthreadcore22:24:010
8215040,0irq/24-0000:00:0-21swapper/219:43:442
55839943,0cyclictest5314-21awk21:18:592
55839943,0cyclictest3556-21lldpd23:14:012
55839943,0cyclictest3514-21snmpd20:30:562
55839943,0cyclictest3514-21snmpd20:11:112
55839943,0cyclictest3514-21snmpd19:24:562
55839943,0cyclictest3514-21snmpd19:18:562
55839943,0cyclictest3514-21snmpd19:08:562
55839943,0cyclictest3514-21snmpd18:58:562
55839943,0cyclictest27664-21awk19:38:592
55839943,0cyclictest17241-21awk20:43:592
55839943,0cyclictest12568-21awk22:23:592
55759944,0cyclictest3686-21diskmemload21:07:181
55759944,0cyclictest0-21swapper/122:12:341
55759944,0cyclictest0-21swapper/121:39:471
55759944,0cyclictest0-21swapper/121:29:411
55759943,0cyclictest4545-21awk22:18:591
55759943,0cyclictest3556-21lldpd22:02:301
55759943,0cyclictest3556-21lldpd19:29:001
55759943,0cyclictest3556-21lldpd19:02:301
55759943,0cyclictest3514-21snmpd23:53:561
55759943,0cyclictest3514-21snmpd23:18:561
55759943,0cyclictest3514-21snmpd22:14:261
55759943,0cyclictest29308-21sort21:13:591
55759943,0cyclictest17697-21sadc00:28:431
55759943,0cyclictest11791-21awk23:23:581
55719944,0cyclictest0-21swapper/022:55:220
55719944,0cyclictest0-21swapper/020:24:110
55719944,0cyclictest0-21swapper/019:18:540
55719943,0cyclictest9545-21awk20:13:590
55719943,0cyclictest8665-21awk19:48:580
55719943,0cyclictest5238-21awk21:18:590
55719943,0cyclictest3556-21lldpd22:00:000
55719943,0cyclictest3556-21lldpd21:07:300
55719943,0cyclictest3241-21irqbalance23:44:210
55719943,0cyclictest3241-21irqbalance22:40:320
55719943,0cyclictest3241-21irqbalance22:35:120
55719943,0cyclictest3241-21irqbalance22:18:520
55719943,0cyclictest3241-21irqbalance21:48:520
55719943,0cyclictest3241-21irqbalance21:28:520
55719943,0cyclictest3241-21irqbalance19:44:020
55719943,0cyclictest3241-21irqbalance19:03:520
55719943,0cyclictest27577-21awk19:38:590
55719943,0cyclictest11879-21awk23:03:580
55719943,0cyclictest11765-21awk23:23:580
55719943,0cyclictest10983-21awk00:23:590
55719943,0cyclictest10471-21awk20:38:580
339940,0migration/3638-21kthreadcore21:54:023
339940,0migration/3518-21taskset19:41:513
339940,0migration/332013-21taskset19:16:453
339940,0migration/32637-21kthreadcore19:44:013
339940,0migration/314738-21kthreadcore19:29:003
29725040,0irq/27-eth0-tx-3686-21diskmemload23:53:462
29725040,0irq/27-eth0-tx-11373-21munin-node22:43:582
29725040,0irq/27-eth0-tx-0-21swapper/223:51:322
29725040,0irq/27-eth0-tx-0-21swapper/223:43:482
29725040,0irq/27-eth0-tx-0-21swapper/223:18:562
29725040,0irq/27-eth0-tx-0-21swapper/222:58:442
29725040,0irq/27-eth0-tx-0-21swapper/222:34:232
29725040,0irq/27-eth0-tx-0-21swapper/221:53:512
29725040,0irq/27-eth0-tx-0-21swapper/221:34:402
29725040,0irq/27-eth0-tx-0-21swapper/221:23:562
29725040,0irq/27-eth0-tx-0-21swapper/221:03:502
29725040,0irq/27-eth0-tx-0-21swapper/200:23:462
29725040,0irq/27-eth0-tx-0-21swapper/200:18:562
29725040,0irq/27-eth0-tx-0-21swapper/020:59:270
29725040,0irq/27-eth0-tx-0-21swapper/019:54:030
29725040,0irq/27-eth0-tx-0-21swapper/019:24:050
29715040,0irq/26-eth0-rx-5778-21kthreadcore22:19:023
29715040,0irq/26-eth0-rx-0-21swapper/323:53:543
29715040,0irq/26-eth0-rx-0-21swapper/323:29:003
29715040,0irq/26-eth0-rx-0-21swapper/323:08:573
29715040,0irq/26-eth0-rx-0-21swapper/322:15:593
29715040,0irq/26-eth0-rx-0-21swapper/322:09:023
29715040,0irq/26-eth0-rx-0-21swapper/321:33:563
29715040,0irq/26-eth0-rx-0-21swapper/320:09:013
29715040,0irq/26-eth0-rx-0-21swapper/319:53:553
29715040,0irq/26-eth0-rx-0-21swapper/319:08:593
259940,0migration/28710-21aten_r1power_cu20:13:552
259940,0migration/27468-21kthreadcore20:34:032
259940,0migration/232028-21kthreadcore20:54:012
259940,0migration/228982-21kthreadcore00:14:012
259940,0migration/227962-21fschecks_time22:53:572
259940,0migration/227573-21kthreadcore20:49:022
259940,0migration/224368-21kthreadcore19:59:012
259940,0migration/220019-21latency_hist19:33:442
259940,0migration/213045-21gltestperf21:43:582
249940,0watchdog/20-21swapper/220:59:022
249940,0watchdog/20-21swapper/220:19:022
249940,0watchdog/20-21swapper/219:28:542
249940,0watchdog/20-21swapper/200:04:012
179940,0migration/16059-21kthreadcore21:19:001
179940,0migration/14767-21kthreadcore19:19:001
179940,0migration/13949-21kthreadcore19:44:021
179940,0migration/131319-21kthreadcore19:39:011
179940,0migration/131124-21kthreadcore23:34:001
179940,0migration/130378-21hddtemp_smartct20:53:581
179940,0migration/12893-21fschecks_time23:58:551
179940,0migration/125267-21kthreadcore19:34:021
179940,0migration/124644-21kthreadcore21:49:001
179940,0migration/123212-21kthreadcore19:59:011
179940,0migration/12179-21cpuspeed_turbos20:08:541
179940,0migration/120064-21taskset21:27:581
179940,0migration/119992-21cpuspeed_turbos22:28:551
179940,0migration/115687-21kernelversion19:54:001
179940,0migration/115285-21kthreadcore19:03:591
179940,0migration/114647-21kthreadcore22:24:011
179940,0migration/110600-21kthreadcore20:14:011
169940,0watchdog/19671-21ssh23:00:331
169940,0watchdog/18743-21ssh23:39:211
169940,0watchdog/15118-21grep20:34:021
169940,0watchdog/129045-21munin-node21:33:581
169940,0watchdog/126043-21python21:09:061
169940,0watchdog/119256-21ssh21:46:381
169940,0watchdog/116584-21cut20:19:021
169940,0watchdog/116306-21kthreadcore22:04:021
169940,0watchdog/10-21swapper/123:49:011
169940,0watchdog/10-21swapper/122:48:531
169940,0watchdog/10-21swapper/122:40:251
169940,0watchdog/10-21swapper/120:49:021
149940,0migration/06359-21kthreadcore20:34:020
149940,0migration/06131-21kthreadcore23:58:590
149940,0migration/031081-21kthreadcore00:14:010
149940,0migration/026928-21aten_r1power_fr23:33:540
149940,0migration/023517-21kthreadcore22:29:000
149940,0migration/020852-21kthreadcore20:44:010
55839932,0cyclictest3514-21snmpd19:57:262
55839932,0cyclictest3514-21snmpd19:48:562
55839932,0cyclictest3514-21snmpd19:03:562
55759933,0cyclictest0-21swapper/120:23:571
55759932,0cyclictest29248-21awk21:53:591
55759932,0cyclictest28660-21awk20:03:591
55759932,0cyclictest28028-21awk23:13:581
55759932,0cyclictest19988-21awk19:08:571
55759931,0cyclictest29200-21kthreadcore19:14:021
55719933,0cyclictest3556-21lldpd23:31:010
55719933,0cyclictest3556-21lldpd23:20:010
55719933,0cyclictest17748-21kworker/0:220:53:470
55719933,0cyclictest17748-21kworker/0:220:48:470
55719933,0cyclictest17748-21kworker/0:220:18:450
55719933,0cyclictest17748-21kworker/0:218:58:450
55719933,0cyclictest0-21swapper/000:03:570
55719932,0cyclictest3839-21awk22:58:570
55719932,0cyclictest3241-21irqbalance22:04:020
55719932,0cyclictest30349-21kthreadcore21:54:010
55719930,0cyclictest27289-21perl23:53:560
35130,0ktimersoftd/30-21swapper/320:22:153
339930,0migration/321334-21cpuspeed_turbos19:58:563
29715030,0irq/26-eth0-rx-0-21swapper/320:43:553
29715030,0irq/26-eth0-rx-0-21swapper/320:23:563
29715030,0irq/26-eth0-rx-0-21swapper/319:48:543
29715030,0irq/26-eth0-rx-0-21swapper/318:58:553
179930,0migration/11554-21missed_timers20:29:021
169930,0watchdog/10-21swapper/120:44:101
169930,0watchdog/10-21swapper/119:53:061
169930,0watchdog/10-21swapper/119:24:061
339920,0migration/323337-21diskstats20:48:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional