You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 20:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2s.osadl.org (updated Thu Sep 18, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
834423824,0sleep00-21swapper/006:38:220
828323627,0sleep30-21swapper/306:37:413
860423430,0sleep20-21swapper/206:41:242
841123329,0sleep10-21swapper/106:39:071
249970,0watchdog/222026-21ssh09:31:472
87269966,0cyclictest6991-21diskmemload08:50:291
87249960,0cyclictest0-21swapper/010:42:290
8225060,0irq/24-0000:00:10706-21munin-run07:32:002
339960,0migration/39095-21kthreadcore11:22:183
339960,0migration/33908-21sh10:38:433
339960,0migration/321768-21sh09:30:583
339960,0migration/320134-21sh10:48:563
339960,0migration/312963-21sh09:45:123
339960,0migration/311812-21sh11:43:523
28415060,0irq/27-eth0-tx-19858-21ssh10:07:302
28415060,0irq/27-eth0-tx-0-21swapper/212:07:302
28415060,0irq/27-eth0-tx-0-21swapper/212:03:202
28415060,0irq/27-eth0-tx-0-21swapper/211:52:082
28415060,0irq/27-eth0-tx-0-21swapper/211:42:352
28415060,0irq/27-eth0-tx-0-21swapper/211:34:472
28415060,0irq/27-eth0-tx-0-21swapper/211:23:422
28415060,0irq/27-eth0-tx-0-21swapper/211:18:532
28415060,0irq/27-eth0-tx-0-21swapper/211:13:122
28415060,0irq/27-eth0-tx-0-21swapper/211:06:162
28415060,0irq/27-eth0-tx-0-21swapper/211:00:312
28415060,0irq/27-eth0-tx-0-21swapper/210:48:222
28415060,0irq/27-eth0-tx-0-21swapper/210:43:112
28415060,0irq/27-eth0-tx-0-21swapper/210:37:362
28415060,0irq/27-eth0-tx-0-21swapper/210:34:022
28415060,0irq/27-eth0-tx-0-21swapper/210:27:242
28415060,0irq/27-eth0-tx-0-21swapper/210:23:452
28415060,0irq/27-eth0-tx-0-21swapper/210:19:102
28415060,0irq/27-eth0-tx-0-21swapper/210:00:472
28415060,0irq/27-eth0-tx-0-21swapper/209:51:242
28415060,0irq/27-eth0-tx-0-21swapper/209:43:152
28415060,0irq/27-eth0-tx-0-21swapper/209:38:502
28415060,0irq/27-eth0-tx-0-21swapper/209:10:022
28415060,0irq/27-eth0-tx-0-21swapper/209:01:492
28415060,0irq/27-eth0-tx-0-21swapper/208:56:132
28415060,0irq/27-eth0-tx-0-21swapper/208:51:222
28415060,0irq/27-eth0-tx-0-21swapper/008:22:170
28415060,0irq/27-eth0-tx-0-21swapper/008:04:580
28415060,0irq/27-eth0-tx-0-21swapper/007:44:550
28415060,0irq/27-eth0-tx-0-21swapper/006:49:450
28405060,0irq/26-eth0-rx-10947-21python12:02:213
249960,0watchdog/218178-21load08:22:192
249960,0watchdog/20-21swapper/211:49:142
249960,0watchdog/20-21swapper/211:41:022
249960,0watchdog/20-21swapper/211:27:182
87269955,0cyclictest0-21swapper/111:39:291
87269955,0cyclictest0-21swapper/111:23:431
87269955,0cyclictest0-21swapper/109:24:221
87269950,0cyclictest0-21swapper/111:31:361
87269950,0cyclictest0-21swapper/110:36:541
87269950,0cyclictest0-21swapper/110:31:041
87269950,0cyclictest0-21swapper/109:44:241
87249955,0cyclictest0-21swapper/009:36:350
4150,0ktimersoftd/00-21swapper/011:17:150
339950,0migration/38769-21kthreadcore10:22:163
339950,0migration/34820-21runrttasks09:17:503
339950,0migration/34450-21taskset09:59:313
339950,0migration/3334-21latency_hist08:37:003
339950,0migration/331317-21munin-node07:47:133
339950,0migration/330657-21irqcore10:57:203
339950,0migration/330109-21cpuspeed_turbos07:22:133
339950,0migration/32995-21turbostat07:02:003
339950,0migration/328488-21sh10:34:293
339950,0migration/328193-21unixbench-2d06:52:233
339950,0migration/327435-21kthreadcore09:12:203
339950,0migration/326084-21idleruntime08:07:153
339950,0migration/322563-21irqcore10:52:173
339950,0migration/322177-21cpuspeed_turbos09:52:163
339950,0migration/321097-21munin-node06:47:213
339950,0migration/320355-21taskset11:50:143
339950,0migration/319985-21kthreadcore07:12:163
339950,0migration/318689-21kthreadcore09:07:203
339950,0migration/318625-21aten_r1power_en08:02:103
339950,0migration/318308-21munin-node07:37:153
339950,0migration/317110-21kthreadcore10:07:183
339950,0migration/315376-21kthreadcore07:32:183
339950,0migration/315146-21cpu08:47:163
28415050,0irq/27-eth0-tx-9715-21grep10:02:182
28415050,0irq/27-eth0-tx-26204-21munin-node08:32:190
28415050,0irq/27-eth0-tx-13611-21ssh08:43:320
28415050,0irq/27-eth0-tx-0-21swapper/211:57:142
28415050,0irq/27-eth0-tx-0-21swapper/211:57:142
28415050,0irq/27-eth0-tx-0-21swapper/210:55:172
28415050,0irq/27-eth0-tx-0-21swapper/209:35:562
28415050,0irq/27-eth0-tx-0-21swapper/209:22:072
28415050,0irq/27-eth0-tx-0-21swapper/209:12:272
28415050,0irq/27-eth0-tx-0-21swapper/209:04:492
28415050,0irq/27-eth0-tx-0-21swapper/208:45:202
28405050,0irq/26-eth0-rx-5800-21fschecks_count11:02:133
28405050,0irq/26-eth0-rx-4358-21ssh12:00:393
28405050,0irq/26-eth0-rx-4358-21ssh12:00:393
28405050,0irq/26-eth0-rx-31135-21grep11:17:173
28405050,0irq/26-eth0-rx-27238-21kthreadcore08:52:213
28405050,0irq/26-eth0-rx-13637-21cpuspeed_turbos11:27:143
28405050,0irq/26-eth0-rx-0-21swapper/311:52:213
28405050,0irq/26-eth0-rx-0-21swapper/311:38:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional