You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 03:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Jul 29, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450550,0irq/25-eth10-21swapper/318:46:293
2803323524,0sleep00-21swapper/018:45:200
2795722622,0sleep10-21swapper/118:44:251
2793022622,0sleep20-21swapper/218:44:062
2837399130,0cyclictest0-21swapper/020:50:360
339960,0migration/36309-21sh22:14:043
339960,0migration/322546-21sh22:25:213
339960,0migration/317015-21sh21:21:293
29725060,0irq/27-eth0-tx-3853-21munin-node19:18:500
29725060,0irq/27-eth0-tx-2843-21munin-node18:53:530
283749960,0cyclictest0-21swapper/123:04:471
283739965,0cyclictest29380-21munin-node23:53:460
27160,0ktimersoftd/20-21swapper/222:58:492
149960,0migration/04218-21sh23:35:300
149960,0migration/030124-21kthreadcore20:23:460
8215050,0irq/24-0000:00:7767-21ls22:18:272
8215050,0irq/24-0000:00:7319-21cat22:38:272
8215050,0irq/24-0000:00:0-21swapper/223:18:272
8215050,0irq/24-0000:00:0-21swapper/220:43:272
35150,0ktimersoftd/30-21swapper/323:52:273
339950,0migration/35975-21kthreadcore21:53:473
339950,0migration/34391-21kthreadcore21:13:443
339950,0migration/331790-21kthreadcore23:33:443
339950,0migration/331497-21taskset20:03:373
339950,0migration/327250-21kthreadcore22:48:453
339950,0migration/32603-21fschecks_count20:53:433
339950,0migration/325516-21gltestperf19:58:403
339950,0migration/323613-21kthreadcore20:43:443
339950,0migration/323027-21latency_hist22:48:273
339950,0migration/322677-21munin-node19:28:483
339950,0migration/322240-21sh23:08:113
339950,0migration/321894-21kthreadcore21:23:463
339950,0migration/318436-21munin-node20:13:513
339950,0migration/318232-21aten_r1power_cu19:53:403
339950,0migration/315742-21taskset19:00:323
339950,0migration/312653-21kthreadcore21:38:453
339950,0migration/312370-21pmu-power22:58:493
339950,0migration/311003-21taskset19:44:553
339950,0migration/310175-21kthreadcore21:58:443
29725050,0irq/27-eth0-tx-595-21munin-node21:53:522
29725050,0irq/27-eth0-tx-327262sleep221:31:102
29725050,0irq/27-eth0-tx-0-21swapper/223:19:382
29725050,0irq/27-eth0-tx-0-21swapper/222:48:542
29725050,0irq/27-eth0-tx-0-21swapper/222:43:302
29725050,0irq/27-eth0-tx-0-21swapper/221:24:172
29725050,0irq/27-eth0-tx-0-21swapper/221:12:052
29725050,0irq/27-eth0-tx-0-21swapper/221:03:072
29725050,0irq/27-eth0-tx-0-21swapper/019:58:420
29725050,0irq/27-eth0-tx-0-21swapper/019:08:380
29715050,0irq/26-eth0-rx-3568-21missed_timers23:13:463
29715050,0irq/26-eth0-rx-31979-21cat22:53:433
29715050,0irq/26-eth0-rx-31832-21unixbench-2d21:28:533
29715050,0irq/26-eth0-rx-24001-21munin-node21:03:483
29715050,0irq/26-eth0-rx-22342-21taskset19:04:563
29715050,0irq/26-eth0-rx-22342-21taskset19:04:563
29715050,0irq/26-eth0-rx-1898-21fschecks_time21:33:413
29715050,0irq/26-eth0-rx-12256-21pmu-power20:33:503
29715050,0irq/26-eth0-rx-11688-21ntp_states23:18:463
29715050,0irq/26-eth0-rx-0-21swapper/323:53:413
29715050,0irq/26-eth0-rx-0-21swapper/323:23:463
29715050,0irq/26-eth0-rx-0-21swapper/323:12:493
29715050,0irq/26-eth0-rx-0-21swapper/322:33:473
29715050,0irq/26-eth0-rx-0-21swapper/322:31:463
29715050,0irq/26-eth0-rx-0-21swapper/322:18:383
29715050,0irq/26-eth0-rx-0-21swapper/322:08:343
29715050,0irq/26-eth0-rx-0-21swapper/322:03:373
29715050,0irq/26-eth0-rx-0-21swapper/321:48:453
29715050,0irq/26-eth0-rx-0-21swapper/321:08:453
29715050,0irq/26-eth0-rx-0-21swapper/320:59:393
29715050,0irq/26-eth0-rx-0-21swapper/300:13:373
283769950,0cyclictest0-21swapper/223:52:252
283769950,0cyclictest0-21swapper/222:06:092
283769950,0cyclictest0-21swapper/220:57:532
283749955,0cyclictest0-21swapper/122:54:421
283749950,0cyclictest0-21swapper/123:48:371
283749950,0cyclictest0-21swapper/123:42:371
283749950,0cyclictest0-21swapper/121:03:041
283749950,0cyclictest0-21swapper/100:06:161
283739955,0cyclictest25528-21kworker/0:223:58:480
283739955,0cyclictest25528-21kworker/0:222:58:460
283739955,0cyclictest25528-21kworker/0:222:38:460
283739955,0cyclictest25528-21kworker/0:222:08:440
283739955,0cyclictest25528-21kworker/0:221:08:510
283739955,0cyclictest25528-21kworker/0:220:33:470
283739955,0cyclictest25528-21kworker/0:220:18:450
283739955,0cyclictest25528-21kworker/0:218:58:450
283739955,0cyclictest0-21swapper/019:48:280
283739955,0cyclictest0-21swapper/000:14:160
283739954,0cyclictest29442-21awk18:48:450
283739950,0cyclictest0-21swapper/021:35:400
259950,0migration/27819-21kthreadcore19:43:442
259950,0migration/228452-21kthreadcore20:48:452
259950,0migration/226100-21latency00:08:452
259950,0migration/224702-21idleruntime19:33:412
259950,0migration/217568-21sh21:23:112
259950,0migration/216149-21kthreadcore23:03:432
259950,0migration/211672-21kthreadcore18:58:452
259950,0migration/211242-21fschecks_time19:23:432
259950,0migration/210563-21kthreadcore22:18:442
19150,0ktimersoftd/10-21swapper/123:30:211
19150,0ktimersoftd/10-21swapper/121:14:441
19150,0ktimersoftd/10-21swapper/120:55:211
149950,0migration/07348-21kthreadcore21:13:450
149950,0migration/03575-21kthreadcore21:53:460
149950,0migration/030614-21aten_r1power_fr23:13:390
149950,0migration/029981-21fschecks_count19:13:400
149950,0migration/028174-21taskset23:28:590
149950,0migration/025997-21idleruntime21:48:410
149950,0migration/024978-21taskset21:26:340
149950,0migration/024729-21taskset21:04:180
149950,0migration/024659-21latency_hist19:58:270
149950,0migration/021304-21fschecks_count00:08:400
149950,0migration/021045-21taskset23:48:140
149950,0migration/018997-21kthreadcore19:28:450
149950,0migration/018908-21pmu-power20:38:470
149950,0migration/016138-21idleruntime22:43:440
149950,0migration/015153-21irqcore23:23:450
149950,0migration/014594-21kthreadcore20:13:440
8215040,0irq/24-0000:00:18089-21latency_hist21:03:272
339940,0migration/32323-21kthreadcore20:28:473
339940,0migration/318612-21diskmemload00:03:493
339940,0migration/312799-21irqrtprio19:48:443
29725040,0irq/27-eth0-tx-24941-21irqcore22:28:432
29725040,0irq/27-eth0-tx-23650-21ssh21:44:412
29725040,0irq/27-eth0-tx-0-21swapper/223:54:532
29725040,0irq/27-eth0-tx-0-21swapper/223:43:332
29725040,0irq/27-eth0-tx-0-21swapper/223:33:382
29725040,0irq/27-eth0-tx-0-21swapper/223:28:412
29725040,0irq/27-eth0-tx-0-21swapper/222:08:382
29725040,0irq/27-eth0-tx-0-21swapper/221:58:392
29725040,0irq/27-eth0-tx-0-21swapper/221:38:422
29725040,0irq/27-eth0-tx-0-21swapper/221:33:292
29725040,0irq/27-eth0-tx-0-21swapper/221:13:302
29725040,0irq/27-eth0-tx-0-21swapper/200:03:342
29725040,0irq/27-eth0-tx-0-21swapper/200:00:242
29725040,0irq/27-eth0-tx-0-21swapper/019:38:490
29715040,0irq/26-eth0-rx-24076-21irqrtprio19:08:433
29715040,0irq/26-eth0-rx-11894-21kthreadcore19:23:463
29715040,0irq/26-eth0-rx-0-21swapper/323:58:573
29715040,0irq/26-eth0-rx-0-21swapper/323:43:333
29715040,0irq/26-eth0-rx-0-21swapper/323:39:533
29715040,0irq/26-eth0-rx-0-21swapper/323:28:373
29715040,0irq/26-eth0-rx-0-21swapper/322:38:573
29715040,0irq/26-eth0-rx-0-21swapper/321:44:223
29715040,0irq/26-eth0-rx-0-21swapper/320:48:403
29715040,0irq/26-eth0-rx-0-21swapper/320:38:453
29715040,0irq/26-eth0-rx-0-21swapper/319:33:443
29715040,0irq/26-eth0-rx-0-21swapper/319:13:403
29715040,0irq/26-eth0-rx-0-21swapper/318:53:493
29715040,0irq/26-eth0-rx-0-21swapper/318:48:413
29715040,0irq/26-eth0-rx-0-21swapper/300:08:593
283769943,0cyclictest6795-21awk20:08:432
283769943,0cyclictest3556-21lldpd20:36:412
283769943,0cyclictest32382-21awk20:03:432
283769943,0cyclictest31147-21munin-node22:53:412
283769943,0cyclictest23816-21awk19:08:422
283769943,0cyclictest20893-21awk20:43:412
283769943,0cyclictest13453-21ps20:13:432
283769940,0cyclictest5469-21munin-node23:38:412
283749944,0cyclictest0-21swapper/122:26:471
283749944,0cyclictest0-21swapper/122:13:521
283749943,0cyclictest7762-21awk22:58:441
283749943,0cyclictest3556-21lldpd23:33:411
283749943,0cyclictest3556-21lldpd23:13:411
283749943,0cyclictest3556-21lldpd22:21:111
283749943,0cyclictest3556-21lldpd21:58:411
283749943,0cyclictest3514-21snmpd21:46:331
283749943,0cyclictest3514-21snmpd20:05:331
283749943,0cyclictest3241-21irqbalance22:40:051
283749943,0cyclictest3241-21irqbalance21:49:161
283749943,0cyclictest3241-21irqbalance21:29:061
283749943,0cyclictest3241-21irqbalance21:24:161
283749943,0cyclictest3241-21irqbalance21:08:361
283749943,0cyclictest3241-21irqbalance20:43:361
283749943,0cyclictest3241-21irqbalance20:39:061
283749943,0cyclictest3241-21irqbalance20:33:461
283749943,0cyclictest3241-21irqbalance20:29:261
283749943,0cyclictest3241-21irqbalance19:38:361
283749943,0cyclictest3241-21irqbalance19:33:361
283749943,0cyclictest3241-21irqbalance19:24:261
283749943,0cyclictest3241-21irqbalance19:19:261
283749943,0cyclictest3241-21irqbalance19:16:061
283749943,0cyclictest3241-21irqbalance19:08:361
283749943,0cyclictest3241-21irqbalance19:00:161
283749943,0cyclictest23531-21awk23:08:421
283749943,0cyclictest19967-21awk20:18:431
283749943,0cyclictest19293-21awk21:03:421
283749943,0cyclictest19154-21awk19:53:451
283749943,0cyclictest17163-21awk19:03:431
283749943,0cyclictest17163-21awk19:03:431
283749943,0cyclictest10303-21awk21:38:431
283749942,0cyclictest3556-21lldpd19:44:101
283739944,0cyclictest25528-21kworker/0:223:40:260
283739944,0cyclictest25528-21kworker/0:223:18:400
283739944,0cyclictest25528-21kworker/0:223:12:440
283739944,0cyclictest25528-21kworker/0:223:05:480
283739944,0cyclictest25528-21kworker/0:222:53:480
283739944,0cyclictest25528-21kworker/0:222:35:500
283739944,0cyclictest25528-21kworker/0:222:23:460
283739944,0cyclictest25528-21kworker/0:222:19:340
283739944,0cyclictest25528-21kworker/0:222:13:360
283739944,0cyclictest25528-21kworker/0:221:58:520
283739944,0cyclictest25528-21kworker/0:221:43:450
283739944,0cyclictest25528-21kworker/0:220:28:470
283739944,0cyclictest25528-21kworker/0:220:08:450
283739944,0cyclictest25528-21kworker/0:200:06:020
283739944,0cyclictest0-21swapper/022:52:270
283739944,0cyclictest0-21swapper/021:20:320
283739943,0cyclictest3556-21lldpd20:07:410
283739943,0cyclictest3241-21irqbalance20:58:360
283739943,0cyclictest3070-21awk20:53:450
283739943,0cyclictest26741-21awk21:28:440
283739943,0cyclictest20962-21awk20:43:420
283739943,0cyclictest17539-21awk22:03:400
259940,0migration/25302-21switchtime22:33:512
259940,0migration/24094-21cpuspeed_turbos19:18:402
259940,0migration/24086-21kthreadcore20:28:472
259940,0migration/228236-21kthreadcore21:48:442
259940,0migration/225975-21cpu20:23:412
259940,0migration/221191-21kthreadcore20:18:452
259940,0migration/217852-21kthreadcore23:23:462
259940,0migration/21560-21kthreadcore19:38:432
249940,0watchdog/25811-21kthreadcore18:53:462
249940,0watchdog/229513-21if_err_eth100:13:412
249940,0watchdog/224908-21sh19:58:382
249940,0watchdog/222901-21python19:28:502
249940,0watchdog/222272-21ssh22:24:292
249940,0watchdog/20-21swapper/223:08:452
179940,0migration/19686-21kthreadcore23:18:431
179940,0migration/127608-21kthreadcore20:23:451
179940,0migration/127307-21kthreadcore19:58:431
179940,0migration/125344-21kthreadcore22:28:431
179940,0migration/114500-21kthreadcore20:13:441
169940,0watchdog/19562-21kthreadcore23:58:451
169940,0watchdog/16559-21runrttasks23:54:411
169940,0watchdog/131447-21kthreadcore20:48:461
169940,0watchdog/126379-21cut22:48:451
169940,0watchdog/12013-21kthreadcore22:33:451
169940,0watchdog/10-21swapper/122:45:291
169940,0watchdog/10-21swapper/121:33:451
169940,0watchdog/10-21swapper/119:28:421
169940,0watchdog/10-21swapper/100:13:411
149940,0migration/030835-21sh22:31:300
149940,0migration/021168-21kthreadcore19:03:450
149940,0migration/021168-21kthreadcore19:03:450
339930,0migration/36873-21kthreadcore19:18:443
339930,0migration/311859-21runrttasks20:09:233
29715030,0irq/26-eth0-rx-0-21swapper/320:23:403
29715030,0irq/26-eth0-rx-0-21swapper/320:18:393
29715030,0irq/26-eth0-rx-0-21swapper/319:38:373
283769933,0cyclictest3556-21lldpd19:14:112
283769933,0cyclictest3556-21lldpd18:51:102
283769932,0cyclictest21882-21sensors19:03:492
283769932,0cyclictest21882-21sensors19:03:492
283769932,0cyclictest19106-21awk19:53:442
283749933,0cyclictest3556-21lldpd18:49:411
283749932,0cyclictest3556-21lldpd00:09:101
283749932,0cyclictest3241-21irqbalance22:03:351
283749932,0cyclictest14450-21awk23:43:451
283749932,0cyclictest12398-21awk19:48:431
283749932,0cyclictest11057-21awk21:18:421
283739933,0cyclictest25528-21kworker/0:223:48:340
283739933,0cyclictest25528-21kworker/0:221:38:370
283739933,0cyclictest25528-21kworker/0:219:23:310
283739932,0cyclictest24823-21awk19:33:420
283739930,0cyclictest0-21swapper/019:43:440
27130,0ktimersoftd/20-21swapper/219:52:152
19130,0ktimersoftd/10-21swapper/120:08:311
179930,0migration/118637-21kthreadcore23:23:471
169930,0watchdog/10-21swapper/122:08:571
169930,0watchdog/10-21swapper/121:53:491
169930,0watchdog/10-21swapper/118:57:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional