You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 11:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2s.osadl.org (updated Mon Nov 03, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
291350850,0irq/25-eth10-21swapper/318:36:483
1491327473,0sleep20-21swapper/218:38:052
1491225251,0sleep10-21swapper/118:38:041
1503323228,0sleep00-21swapper/018:39:320
151819977,0cyclictest13448-21diskmemload23:10:362
339960,0migration/39350-21sh23:59:413
339960,0migration/34488-21sh21:32:503
339960,0migration/33949-21sh20:51:183
339960,0migration/329171-21sh21:49:373
339960,0migration/319841-21sh22:01:273
28415060,0irq/27-eth0-tx-0-21swapper/223:52:012
28415060,0irq/27-eth0-tx-0-21swapper/223:30:532
28415060,0irq/27-eth0-tx-0-21swapper/223:23:422
28415060,0irq/27-eth0-tx-0-21swapper/223:16:102
28415060,0irq/27-eth0-tx-0-21swapper/223:08:042
28415060,0irq/27-eth0-tx-0-21swapper/223:02:042
28415060,0irq/27-eth0-tx-0-21swapper/222:51:262
28415060,0irq/27-eth0-tx-0-21swapper/222:47:212
28415060,0irq/27-eth0-tx-0-21swapper/222:29:482
28415060,0irq/27-eth0-tx-0-21swapper/222:17:452
28415060,0irq/27-eth0-tx-0-21swapper/221:59:012
28415060,0irq/27-eth0-tx-0-21swapper/221:48:272
28415060,0irq/27-eth0-tx-0-21swapper/221:35:472
28415060,0irq/27-eth0-tx-0-21swapper/221:09:212
28415060,0irq/27-eth0-tx-0-21swapper/221:03:012
28415060,0irq/27-eth0-tx-0-21swapper/220:55:552
28415060,0irq/27-eth0-tx-0-21swapper/220:46:492
28415060,0irq/27-eth0-tx-0-21swapper/200:05:512
28405060,0irq/26-eth0-rx-23164-21tr20:45:383
28405060,0irq/26-eth0-rx-21855-21diskstats22:05:323
28405060,0irq/26-eth0-rx-19493-21sh22:21:353
28405060,0irq/26-eth0-rx-15615-21which00:00:433
249960,0watchdog/20-21swapper/223:28:572
249960,0watchdog/20-21swapper/222:30:372
151819960,0cyclictest0-21swapper/223:55:322
151819960,0cyclictest0-21swapper/219:40:362
151729965,0cyclictest10856-21sed19:00:350
149960,0migration/06743-21idleruntime21:15:350
149960,0migration/031839-21latency23:50:370
149960,0migration/012987-21gltestperf23:00:340
35150,0ktimersoftd/30-21swapper/321:11:463
339950,0migration/39140-21kthreadcore21:15:383
339950,0migration/37742-21kthreadcore18:55:393
339950,0migration/36165-21timerwakeupswit20:30:423
339950,0migration/36016-21munin-node22:15:343
339950,0migration/34826-21latency_hist19:45:193
339950,0migration/331346-21kthreadcore23:10:353
339950,0migration/328291-21munin-node21:05:443
339950,0migration/327642-21irqcore23:50:353
339950,0migration/323649-21timerwakeupswit00:05:453
339950,0migration/323141-21aten_r1power_po19:10:323
339950,0migration/319553-21sh23:04:023
339950,0migration/319092-21kthreadcore21:20:373
339950,0migration/314039-21sh21:00:323
339950,0migration/313055-21taskset20:35:553
339950,0migration/312828-21kthreadcore19:00:363
339950,0migration/310128-21switchtime22:55:453
28415050,0irq/27-eth0-tx-23990-21munin-node19:35:370
28415050,0irq/27-eth0-tx-17395-21ssh23:41:472
28415050,0irq/27-eth0-tx-0-21swapper/222:20:522
28415050,0irq/27-eth0-tx-0-21swapper/221:52:072
28415050,0irq/27-eth0-tx-0-21swapper/221:25:482
28415050,0irq/27-eth0-tx-0-21swapper/221:21:152
28415050,0irq/27-eth0-tx-0-21swapper/220:54:102
28415050,0irq/27-eth0-tx-0-21swapper/200:00:472
28405050,0irq/26-eth0-rx-8831-21sensors23:35:423
28405050,0irq/26-eth0-rx-30412-21if_eth1.222:10:363
28405050,0irq/26-eth0-rx-26264-21cut22:25:403
28405050,0irq/26-eth0-rx-22475-21kthreadcore22:45:383
28405050,0irq/26-eth0-rx-11049-21latency21:35:423
28405050,0irq/26-eth0-rx-10390-21kthreadcore21:55:403
28405050,0irq/26-eth0-rx-0-21swapper/323:45:373
28405050,0irq/26-eth0-rx-0-21swapper/323:45:373
28405050,0irq/26-eth0-rx-0-21swapper/323:40:283
28405050,0irq/26-eth0-rx-0-21swapper/323:26:203
28405050,0irq/26-eth0-rx-0-21swapper/323:06:063
28405050,0irq/26-eth0-rx-0-21swapper/321:50:363
28405050,0irq/26-eth0-rx-0-21swapper/321:30:023
28405050,0irq/26-eth0-rx-0-21swapper/320:56:063
28405050,0irq/26-eth0-rx-0-21swapper/320:44:133
28405050,0irq/26-eth0-rx-0-21swapper/320:25:363
27150,0ktimersoftd/213448-21diskmemload21:11:462
259950,0migration/26494-21fschecks_time21:15:342
259950,0migration/227670-21sendmail_mailqu18:45:402
259950,0migration/210245-21timerwakeupswit22:55:452
249950,0watchdog/222323-21unixbench_singl19:05:422
249950,0watchdog/219162-21needreboot20:40:372
249950,0watchdog/20-21swapper/223:47:292
249950,0watchdog/20-21swapper/223:47:292
249950,0watchdog/20-21swapper/223:38:172
249950,0watchdog/20-21swapper/222:41:212
249950,0watchdog/20-21swapper/222:35:332
249950,0watchdog/20-21swapper/222:10:292
249950,0watchdog/20-21swapper/222:01:172
249950,0watchdog/20-21swapper/221:40:532
249950,0watchdog/20-21swapper/221:33:172
249950,0watchdog/20-21swapper/220:38:132
249950,0watchdog/20-21swapper/220:15:212
249950,0watchdog/20-21swapper/219:55:222
249950,0watchdog/20-21swapper/219:30:382
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional