You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-17 - 10:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2s.osadl.org (updated Mon Mar 17, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
291350440,0irq/25-eth10-21swapper/318:44:153
2582324333,0sleep20-21swapper/218:46:302
2584223221,0sleep00-21swapper/018:46:440
2592822925,0sleep10-21swapper/118:47:451
35160,0ktimersoftd/326681-21kthreadcore20:04:083
339960,0migration/38122-21sh22:14:333
339960,0migration/37843-21sh21:53:153
339960,0migration/329186-21sh23:20:353
339960,0migration/326307-21sh20:53:493
339960,0migration/326043-21sh22:30:003
339960,0migration/324780-21sh22:05:223
339960,0migration/320137-21sh22:52:123
339960,0migration/315284-21sh23:37:123
28415060,0irq/27-eth0-tx-28940-21munin-node19:44:130
28415060,0irq/27-eth0-tx-271712sleep222:33:252
28415060,0irq/27-eth0-tx-18559-21munin-node20:49:130
28415060,0irq/27-eth0-tx-18287-21diskmemload20:56:552
28415060,0irq/27-eth0-tx-0-21swapper/223:45:312
28415060,0irq/27-eth0-tx-0-21swapper/223:34:022
28415060,0irq/27-eth0-tx-0-21swapper/223:31:202
28415060,0irq/27-eth0-tx-0-21swapper/223:27:102
28415060,0irq/27-eth0-tx-0-21swapper/223:14:002
28415060,0irq/27-eth0-tx-0-21swapper/223:06:592
28415060,0irq/27-eth0-tx-0-21swapper/223:01:432
28415060,0irq/27-eth0-tx-0-21swapper/222:56:032
28415060,0irq/27-eth0-tx-0-21swapper/222:14:012
28415060,0irq/27-eth0-tx-0-21swapper/222:06:552
28415060,0irq/27-eth0-tx-0-21swapper/221:39:322
28415060,0irq/27-eth0-tx-0-21swapper/221:16:422
28415060,0irq/27-eth0-tx-0-21swapper/221:04:222
28415060,0irq/27-eth0-tx-0-21swapper/200:14:202
28415060,0irq/27-eth0-tx-0-21swapper/200:01:562
28415060,0irq/27-eth0-tx-0-21swapper/020:32:040
28415060,0irq/27-eth0-tx-0-21swapper/020:05:050
28415060,0irq/27-eth0-tx-0-21swapper/019:04:490
28405060,0irq/26-eth0-rx-8155-21port_sshpriv20:59:143
28405060,0irq/26-eth0-rx-27141-21grep20:54:073
28405060,0irq/26-eth0-rx-12652-21cat21:08:513
261059960,0cyclictest18287-21diskmemload23:58:272
260959966,0cyclictest0-21swapper/122:07:141
260959960,0cyclictest0-21swapper/100:07:511
249960,0watchdog/2327022chrt23:51:572
249960,0watchdog/215025-21seq19:29:542
249960,0watchdog/20-21swapper/223:09:142
249960,0watchdog/20-21swapper/222:51:142
249960,0watchdog/20-21swapper/222:36:422
249960,0watchdog/20-21swapper/221:29:022
149960,0migration/05937-21sh21:27:170
149960,0migration/022707-21sh21:59:540
149960,0migration/014589-21sh21:54:400
4150,0ktimersoftd/00-21swapper/022:49:120
4150,0ktimersoftd/00-21swapper/021:35:530
339950,0migration/39866-21kthreadcore23:09:053
339950,0migration/36907-21munin-node21:28:593
339950,0migration/35671-21fschecks_count20:39:123
339950,0migration/35024-21sh23:05:163
339950,0migration/34315-21munin-node20:14:023
339950,0migration/329551-21needreboot20:29:133
339950,0migration/329146-21taskset21:18:593
339950,0migration/328673-21sh21:18:203
339950,0migration/328630-21kthreadcore22:09:103
339950,0migration/323683-21kthreadcore19:09:123
339950,0migration/322795-21taskset20:01:293
339950,0migration/322368-21unixbench-2d21:59:163
339950,0migration/321302-21munin-node19:34:143
339950,0migration/319775-21timerandwakeup19:04:173
339950,0migration/313311-21kthreadcore23:59:103
28415050,0irq/27-eth0-tx-31198-21ssh21:45:182
28415050,0irq/27-eth0-tx-30080-21if_eth021:19:082
28415050,0irq/27-eth0-tx-18867-21grep00:09:042
28415050,0irq/27-eth0-tx-18559-21munin-node20:49:162
28415050,0irq/27-eth0-tx-0-21swapper/223:19:222
28415050,0irq/27-eth0-tx-0-21swapper/222:00:162
28415050,0irq/27-eth0-tx-0-21swapper/221:54:372
28415050,0irq/27-eth0-tx-0-21swapper/221:49:172
28415050,0irq/27-eth0-tx-0-21swapper/200:05:212
28415050,0irq/27-eth0-tx-0-21swapper/020:47:040
28415050,0irq/27-eth0-tx-0-21swapper/020:28:040
28415050,0irq/27-eth0-tx-0-21swapper/020:09:040
28415050,0irq/27-eth0-tx-0-21swapper/019:50:040
28415050,0irq/27-eth0-tx-0-21swapper/019:29:010
28415050,0irq/27-eth0-tx-0-21swapper/019:16:340
28415050,0irq/27-eth0-tx-0-21swapper/019:16:340
28405050,0irq/26-eth0-rx-6547-21runrttasks22:26:413
28405050,0irq/26-eth0-rx-31490-21ssh21:46:133
28405050,0irq/26-eth0-rx-2991-21grep19:19:093
28405050,0irq/26-eth0-rx-26962-21irqrtprio23:49:093
28405050,0irq/26-eth0-rx-17230-21ksmtuned00:05:093
28405050,0irq/26-eth0-rx-14638-21ssh21:54:493
28405050,0irq/26-eth0-rx-0-21swapper/323:31:403
28405050,0irq/26-eth0-rx-0-21swapper/323:16:033
28405050,0irq/26-eth0-rx-0-21swapper/322:44:303
28405050,0irq/26-eth0-rx-0-21swapper/322:39:083
28405050,0irq/26-eth0-rx-0-21swapper/322:34:093
28405050,0irq/26-eth0-rx-0-21swapper/321:38:523
28405050,0irq/26-eth0-rx-0-21swapper/321:34:103
28405050,0irq/26-eth0-rx-0-21swapper/321:08:043
28405050,0irq/26-eth0-rx-0-21swapper/300:14:053
260959955,0cyclictest0-21swapper/123:26:041
260959955,0cyclictest0-21swapper/122:43:391
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional