You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-04 - 20:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2s.osadl.org (updated Tue Nov 04, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
291350480,0irq/25-eth10-21swapper/306:36:043
2285923531,0sleep00-21swapper/006:39:110
2275923424,0sleep10-21swapper/106:38:001
2260923228,0sleep20-21swapper/206:36:172
230249970,0cyclictest7665-21kthreadcore09:35:351
339960,0migration/32596-21sh10:18:343
339960,0migration/324472-21sh10:53:513
339960,0migration/322861-21munin-node07:00:353
339960,0migration/319218-21sh10:08:103
339960,0migration/316838-21sh10:49:233
339960,0migration/314615-21sh11:29:303
339960,0migration/312969-21sh08:57:193
28415060,0irq/27-eth0-tx-28613-21ssh09:08:062
28415060,0irq/27-eth0-tx-0-21swapper/211:32:562
28415060,0irq/27-eth0-tx-0-21swapper/211:19:402
28415060,0irq/27-eth0-tx-0-21swapper/210:37:412
28415060,0irq/27-eth0-tx-0-21swapper/210:30:372
28415060,0irq/27-eth0-tx-0-21swapper/210:17:242
28415060,0irq/27-eth0-tx-0-21swapper/209:48:542
28415060,0irq/27-eth0-tx-0-21swapper/209:10:382
28415060,0irq/27-eth0-tx-0-21swapper/208:59:582
28415060,0irq/27-eth0-tx-0-21swapper/208:47:462
28415060,0irq/27-eth0-tx-0-21swapper/208:42:342
28415060,0irq/27-eth0-tx-0-21swapper/008:25:380
28405060,0irq/26-eth0-rx-3942-21python11:40:383
28405060,0irq/26-eth0-rx-11072-21grep10:25:163
28405060,0irq/26-eth0-rx-10051-21pmu-power10:00:433
27160,0ktimersoftd/20-21swapper/209:56:282
249960,0watchdog/231356-21grep09:50:382
249960,0watchdog/20-21swapper/210:42:542
249960,0watchdog/20-21swapper/207:00:102
230249960,0cyclictest0-21swapper/109:33:321
4150,0ktimersoftd/00-21swapper/011:44:100
4150,0ktimersoftd/00-21swapper/009:33:150
339950,0migration/38716-21kthreadcore07:15:323
339950,0migration/33743-21kthreadcore08:05:353
339950,0migration/33488-21kthreadcore10:40:343
339950,0migration/330046-21kthreadcore09:50:383
339950,0migration/325042-21idleruntime07:05:313
339950,0migration/324352-21cpuspeed_turbos11:15:303
339950,0migration/32424-21cpuspeed_turbos08:30:293
339950,0migration/323423-21kthreadcore07:55:333
339950,0migration/321722-21taskset08:40:433
339950,0migration/321697-21if_eth1.309:25:343
339950,0migration/321682-21cpu11:55:303
339950,0migration/321626-21sh11:31:563
339950,0migration/319909-21timerandwakeup09:00:403
339950,0migration/319568-21kthreadcore11:10:343
339950,0migration/317789-21munin-node09:40:403
339950,0migration/316628-21kthreadcore07:25:313
339950,0migration/315287-21fschecks_time08:15:313
339950,0migration/31526-21kthreadcore11:20:373
339950,0migration/315017-21kthreadcore11:50:353
339950,0migration/313726-21munin-node08:10:403
339950,0migration/311648-21kthreadcore11:05:363
28415050,0irq/27-eth0-tx-3387-21munin-node10:20:382
28415050,0irq/27-eth0-tx-21011-21ssh11:54:392
28415050,0irq/27-eth0-tx-17357-21ssh10:50:252
28415050,0irq/27-eth0-tx-13538-21grep09:40:332
28415050,0irq/27-eth0-tx-0-21swapper/212:01:332
28415050,0irq/27-eth0-tx-0-21swapper/211:47:422
28415050,0irq/27-eth0-tx-0-21swapper/211:41:362
28415050,0irq/27-eth0-tx-0-21swapper/211:21:102
28415050,0irq/27-eth0-tx-0-21swapper/211:10:212
28415050,0irq/27-eth0-tx-0-21swapper/210:12:472
28415050,0irq/27-eth0-tx-0-21swapper/210:02:502
28415050,0irq/27-eth0-tx-0-21swapper/209:37:582
28415050,0irq/27-eth0-tx-0-21swapper/209:30:232
28415050,0irq/27-eth0-tx-0-21swapper/209:20:302
28415050,0irq/27-eth0-tx-0-21swapper/209:15:182
28415050,0irq/27-eth0-tx-0-21swapper/008:05:380
28415050,0irq/27-eth0-tx-0-21swapper/007:57:040
28405050,0irq/26-eth0-rx-4034-21ssh10:00:073
28405050,0irq/26-eth0-rx-2613-21memory09:10:423
28405050,0irq/26-eth0-rx-23668-21tr10:10:363
28405050,0irq/26-eth0-rx-10136-21ssh10:22:323
28405050,0irq/26-eth0-rx-0-21swapper/312:00:333
28405050,0irq/26-eth0-rx-0-21swapper/311:48:153
28405050,0irq/26-eth0-rx-0-21swapper/311:02:093
28405050,0irq/26-eth0-rx-0-21swapper/310:39:503
28405050,0irq/26-eth0-rx-0-21swapper/309:49:333
28405050,0irq/26-eth0-rx-0-21swapper/309:22:043
28405050,0irq/26-eth0-rx-0-21swapper/309:15:343
249950,0watchdog/26547-21runrttasks10:07:142
249950,0watchdog/21674-21cut07:10:342
249950,0watchdog/213297-21kthreadcore10:45:342
249950,0watchdog/20-21swapper/212:05:342
249950,0watchdog/20-21swapper/211:39:462
249950,0watchdog/20-21swapper/211:00:422
249950,0watchdog/20-21swapper/210:55:262
249950,0watchdog/20-21swapper/210:27:422
249950,0watchdog/20-21swapper/209:27:142
249950,0watchdog/20-21swapper/208:51:102
249950,0watchdog/20-21swapper/208:25:382
249950,0watchdog/20-21swapper/208:15:342
249950,0watchdog/20-21swapper/208:05:342
249950,0watchdog/20-21swapper/208:02:582
249950,0watchdog/20-21swapper/207:55:582
249950,0watchdog/20-21swapper/207:50:222
249950,0watchdog/20-21swapper/207:40:302
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional