You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-29 - 12:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2s.osadl.org (updated Fri Aug 29, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2460325453,0sleep20-21swapper/218:41:592
291350430,0irq/25-eth10-21swapper/318:37:573
2453523521,0sleep00-21swapper/018:41:130
2463923324,0sleep10-21swapper/118:42:221
247439988,0cyclictest31628-21sensors19:08:090
28415070,0irq/27-eth0-tx-1231-21munin-node19:38:060
35160,0ktimersoftd/30-21swapper/322:41:403
35160,0ktimersoftd/30-21swapper/321:47:543
339960,0migration/36865-21sh21:12:273
339960,0migration/327908-21sh22:45:263
339960,0migration/327463-21sh23:05:303
339960,0migration/326494-21sh23:46:393
339960,0migration/322162-21sh21:00:243
339960,0migration/313534-21sh20:54:113
339960,0migration/312688-21sh21:54:203
339960,0migration/312439-21sh22:15:073
28415060,0irq/27-eth0-tx-22336-21munin-node20:18:060
28415060,0irq/27-eth0-tx-0-21swapper/223:52:252
28415060,0irq/27-eth0-tx-0-21swapper/223:30:482
28415060,0irq/27-eth0-tx-0-21swapper/223:11:332
28415060,0irq/27-eth0-tx-0-21swapper/223:06:322
28415060,0irq/27-eth0-tx-0-21swapper/222:49:322
28415060,0irq/27-eth0-tx-0-21swapper/222:43:332
28415060,0irq/27-eth0-tx-0-21swapper/222:25:162
28415060,0irq/27-eth0-tx-0-21swapper/222:18:082
28415060,0irq/27-eth0-tx-0-21swapper/222:17:142
28415060,0irq/27-eth0-tx-0-21swapper/222:10:362
28415060,0irq/27-eth0-tx-0-21swapper/222:05:192
28415060,0irq/27-eth0-tx-0-21swapper/221:49:562
28415060,0irq/27-eth0-tx-0-21swapper/221:45:332
28415060,0irq/27-eth0-tx-0-21swapper/221:33:372
28415060,0irq/27-eth0-tx-0-21swapper/221:30:032
28415060,0irq/27-eth0-tx-0-21swapper/221:17:542
28415060,0irq/27-eth0-tx-0-21swapper/221:04:102
28415060,0irq/27-eth0-tx-0-21swapper/220:52:482
28415060,0irq/27-eth0-tx-0-21swapper/220:48:142
28415060,0irq/27-eth0-tx-0-21swapper/200:01:572
28415060,0irq/27-eth0-tx-0-21swapper/020:42:540
28415060,0irq/27-eth0-tx-0-21swapper/020:40:000
28415060,0irq/27-eth0-tx-0-21swapper/018:43:100
28405060,0irq/26-eth0-rx-30147-21perl22:28:023
28405060,0irq/26-eth0-rx-0-21swapper/323:13:033
247459966,0cyclictest0-21swapper/220:43:112
247439966,0cyclictest3425-21lldpd21:16:310
247439960,0cyclictest0-21swapper/021:29:110
249960,0watchdog/211237-21ssh22:54:402
249960,0watchdog/20-21swapper/222:41:042
149960,0migration/025629-21kthreadcore21:03:040
149960,0migration/014367-21idleruntime-cro21:37:460
8225050,0irq/24-0000:00:4962-21cat22:32:462
4150,0ktimersoftd/00-21swapper/023:54:140
4150,0ktimersoftd/00-21swapper/022:01:160
339950,0migration/36923-21cpuspeed_turbos21:32:593
339950,0migration/35206-21taskset20:48:453
339950,0migration/330552-21kthreadcore19:58:063
339950,0migration/330060-21taskset21:04:403
339950,0migration/32906-21taskset20:26:113
339950,0migration/327346-21munin-node19:33:003
339950,0migration/327346-21munin-node19:33:003
339950,0migration/324773-21kthreadcore20:18:043
339950,0migration/323418-21munin-node22:03:073
339950,0migration/319263-21taskset19:02:553
339950,0migration/319035-21kthreadcore20:13:053
339950,0migration/318200-21kthreadcore20:38:063
339950,0migration/312599-21latency_hist18:57:473
28415050,0irq/27-eth0-tx-6165-21munin-node21:53:072
28415050,0irq/27-eth0-tx-5303-21ssh21:08:182
28415050,0irq/27-eth0-tx-20284-21munin-node19:28:090
28415050,0irq/27-eth0-tx-0-21swapper/223:54:232
28415050,0irq/27-eth0-tx-0-21swapper/223:43:542
28415050,0irq/27-eth0-tx-0-21swapper/223:38:562
28415050,0irq/27-eth0-tx-0-21swapper/223:37:282
28415050,0irq/27-eth0-tx-0-21swapper/222:58:042
28415050,0irq/27-eth0-tx-0-21swapper/221:58:022
28415050,0irq/27-eth0-tx-0-21swapper/221:40:032
28415050,0irq/27-eth0-tx-0-21swapper/221:13:082
28415050,0irq/27-eth0-tx-0-21swapper/221:00:152
28415050,0irq/27-eth0-tx-0-21swapper/200:07:492
28415050,0irq/27-eth0-tx-0-21swapper/019:57:470
28415050,0irq/27-eth0-tx-0-21swapper/019:52:580
28405050,0irq/26-eth0-rx-5499-21tr23:33:023
28405050,0irq/26-eth0-rx-4509-21ssh22:10:193
28405050,0irq/26-eth0-rx-26202-21grep22:23:063
28405050,0irq/26-eth0-rx-24399-21irqrtprio21:23:093
28405050,0irq/26-eth0-rx-21869-21ssh21:41:333
28405050,0irq/26-eth0-rx-0-21swapper/323:40:363
28405050,0irq/26-eth0-rx-0-21swapper/323:22:273
28405050,0irq/26-eth0-rx-0-21swapper/323:07:493
28405050,0irq/26-eth0-rx-0-21swapper/322:18:033
28405050,0irq/26-eth0-rx-0-21swapper/321:58:063
259950,0migration/23119-21munin-node20:03:022
259950,0migration/231106-21kthreadcore22:28:052
259950,0migration/224097-21kthreadcore20:18:042
259950,0migration/219208-21irqcore00:03:042
259950,0migration/214743-21switchtime20:08:092
259950,0migration/210159-21aten2.4-expect20:33:012
247459950,0cyclictest0-21swapper/223:20:212
247449955,0cyclictest0-21swapper/123:42:191
247449955,0cyclictest0-21swapper/123:14:251
247449955,0cyclictest0-21swapper/121:49:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional