You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 20:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2s.osadl.org (updated Tue Nov 25, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
291350970,0irq/25-eth10-21swapper/306:39:163
220424334,0sleep10-21swapper/106:36:271
245923425,0sleep20-21swapper/206:39:202
213222824,0sleep00-21swapper/006:35:380
8225060,0irq/24-0000:00:4219-21latency_hist10:04:292
8225060,0irq/24-0000:00:12223-21munin-run07:59:302
339960,0migration/37780-21munin-node10:44:503
339960,0migration/37713-21sh11:06:253
339960,0migration/3468-21sh11:03:533
339960,0migration/325811-21irqcore07:44:463
339960,0migration/324030-21fschecks_time09:14:443
339960,0migration/318461-21kthreadcore07:14:453
339960,0migration/31686-21sh10:44:073
28415060,0irq/27-eth0-tx-7211-21munin-node11:49:452
28415060,0irq/27-eth0-tx-12165-21ssh09:46:522
28415060,0irq/27-eth0-tx-0-21swapper/211:59:392
28415060,0irq/27-eth0-tx-0-21swapper/211:42:522
28415060,0irq/27-eth0-tx-0-21swapper/211:35:112
28415060,0irq/27-eth0-tx-0-21swapper/210:58:052
28415060,0irq/27-eth0-tx-0-21swapper/210:52:552
28415060,0irq/27-eth0-tx-0-21swapper/210:45:272
28415060,0irq/27-eth0-tx-0-21swapper/210:43:532
28415060,0irq/27-eth0-tx-0-21swapper/210:35:422
28415060,0irq/27-eth0-tx-0-21swapper/210:27:002
28415060,0irq/27-eth0-tx-0-21swapper/210:18:242
28415060,0irq/27-eth0-tx-0-21swapper/210:06:112
28415060,0irq/27-eth0-tx-0-21swapper/209:32:442
28415060,0irq/27-eth0-tx-0-21swapper/209:24:402
28415060,0irq/27-eth0-tx-0-21swapper/209:15:232
28415060,0irq/27-eth0-tx-0-21swapper/209:08:372
28415060,0irq/27-eth0-tx-0-21swapper/008:39:530
28415060,0irq/27-eth0-tx-0-21swapper/007:31:510
28405060,0irq/26-eth0-rx-0-21swapper/311:20:553
28405060,0irq/26-eth0-rx-0-21swapper/309:37:133
25549965,0cyclictest24927-21grep09:34:482
25549960,0cyclictest0-21swapper/211:09:332
249960,0watchdog/2284150irq/27-eth0-tx-10:32:522
169960,0watchdog/128195-21grep09:14:481
169960,0watchdog/123668-21ssh11:17:361
149960,0migration/020510-21sh09:53:150
339950,0migration/37190-21taskset11:49:393
339950,0migration/34966-21cpuspeed_turbos07:29:453
339950,0migration/332128-21taskset08:13:373
339950,0migration/332018-21kthreadcore10:19:473
339950,0migration/331582-21aten_r1power_vo07:49:433
339950,0migration/32957-21munin-node09:39:493
339950,0migration/329463-21switchtime11:39:533
339950,0migration/329132-21kthreadcore08:34:473
339950,0migration/326603-21kthreadcore06:54:473
339950,0migration/32403-21kthreadcore08:14:463
339950,0migration/323029-21kthreadcore08:04:483
339950,0migration/319665-21taskset08:27:103
339950,0migration/318606-21kthreadcore09:29:473
339950,0migration/315825-21sh11:12:123
339950,0migration/315474-21kthreadcore07:59:473
339950,0migration/313771-21switchtime09:04:523
339950,0migration/31321-21kthreadcore07:24:483
339950,0migration/312487-21kthreadcore10:49:483
339950,0migration/311487-21taskset10:07:313
339950,0migration/310551-21aten_r1power_vo07:09:433
28415050,0irq/27-eth0-tx-7544-21ssh08:40:492
28415050,0irq/27-eth0-tx-6372-21iceccd08:29:170
28415050,0irq/27-eth0-tx-31746-21fschecks_time09:19:442
28415050,0irq/27-eth0-tx-29930-21grep10:19:462
28415050,0irq/27-eth0-tx-24786-21munin-node07:44:530
28415050,0irq/27-eth0-tx-21177-21munin-node09:54:482
28415050,0irq/27-eth0-tx-14847-21unixbench_singl08:44:552
28415050,0irq/27-eth0-tx-0-21swapper/212:09:172
28415050,0irq/27-eth0-tx-0-21swapper/211:54:322
28415050,0irq/27-eth0-tx-0-21swapper/211:45:332
28415050,0irq/27-eth0-tx-0-21swapper/211:32:302
28415050,0irq/27-eth0-tx-0-21swapper/211:16:092
28415050,0irq/27-eth0-tx-0-21swapper/211:04:512
28415050,0irq/27-eth0-tx-0-21swapper/210:11:592
28415050,0irq/27-eth0-tx-0-21swapper/209:52:442
28415050,0irq/27-eth0-tx-0-21swapper/209:11:392
28415050,0irq/27-eth0-tx-0-21swapper/209:01:052
28415050,0irq/27-eth0-tx-0-21swapper/208:54:402
28415050,0irq/27-eth0-tx-0-21swapper/008:29:440
28415050,0irq/27-eth0-tx-0-21swapper/007:59:410
28415050,0irq/27-eth0-tx-0-21swapper/007:49:420
28405050,0irq/26-eth0-rx-5535-21ssh11:45:253
28405050,0irq/26-eth0-rx-5335-21kthreadcore08:39:473
28405050,0irq/26-eth0-rx-4242-21iperf08:44:493
28405050,0irq/26-eth0-rx-31597-21diskstats09:19:443
28405050,0irq/26-eth0-rx-29814-21taskset07:20:433
28405050,0irq/26-eth0-rx-28676-21ssh09:59:153
28405050,0irq/26-eth0-rx-23410-21munin-node11:59:433
28405050,0irq/26-eth0-rx-23025-21kthreadcore10:34:483
28405050,0irq/26-eth0-rx-218882sleep311:35:033
28405050,0irq/26-eth0-rx-16897-21python10:29:543
28405050,0irq/26-eth0-rx-0-21swapper/311:32:493
28405050,0irq/26-eth0-rx-0-21swapper/311:24:483
28405050,0irq/26-eth0-rx-0-21swapper/310:54:483
28405050,0irq/26-eth0-rx-0-21swapper/310:14:233
28405050,0irq/26-eth0-rx-0-21swapper/309:46:143
28405050,0irq/26-eth0-rx-0-21swapper/309:24:503
28405050,0irq/26-eth0-rx-0-21swapper/309:03:393
28405050,0irq/26-eth0-rx-0-21swapper/308:55:443
27150,0ktimersoftd/20-21swapper/211:04:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional