You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-16 - 13:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Tue Sep 16, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33376952186162,15sleep30-21swapper/307:05:183
33383892152105,17sleep10-21swapper/107:05:521
33383732134103,22sleep00-21swapper/007:05:390
33385622133109,16sleep20-21swapper/207:08:062
357334221040,2sleep10-21swapper/110:25:201
3338953993025,3cyclictest726-21in:imuxsock12:40:003
3338953993025,2cyclictest3540193-21cron10:05:003
3338953992819,3cyclictest191rcu_preempt09:15:013
3338953992722,2cyclictest0-21swapper/309:30:153
3338953992614,8cyclictest3504938-21pluginstate09:40:003
333895399255,6cyclictest3671172-21sh11:33:143
3338953992519,4cyclictest0-21swapper/310:39:593
3338953992516,6cyclictest3567656-21sh10:22:213
333895399245,4cyclictest3714777-21sh12:02:333
3338953992414,7cyclictest3488630-21cat09:25:263
37431442231,17sleep23462970-21diskmemload12:20:462
333895399234,6cyclictest3752145-21sh12:28:153
3338953992319,2cyclictest0-21swapper/310:45:013
3338953992315,6cyclictest0-21swapper/312:15:273
3338953992313,6cyclictest736-21gdbus10:30:233
3338953992312,7cyclictest3557926-21tr10:15:173
333895399231,19cyclictest3702394-21irqstats11:55:163
333895399225,4cyclictest3656360-21sh11:23:043
3338953992218,2cyclictest0-21swapper/312:20:153
3338953992217,3cyclictest3676485-21pmu-power11:35:223
3338953992217,3cyclictest3676485-21pmu-power11:35:223
3338953992212,7cyclictest943-21runrttasks08:25:213
36938472211,2sleep20-21swapper/211:49:442
36695212211,14sleep23669693-21/usr/sbin/munin11:30:322
3338953992117,2cyclictest726-21in:imuxsock07:30:003
3338953992117,2cyclictest726-21in:imuxsock07:30:003
333895399211,6cyclictest3546837-21sh10:09:143
3338953992116,3cyclictest0-21swapper/310:55:003
3338953992115,4cyclictest511ktimers/309:52:563
3338953992112,6cyclictest3647179-21/usr/sbin/munin11:15:243
3338953992112,6cyclictest3615691-21sshd10:55:163
3338953992111,8cyclictest0-21swapper/311:50:193
3338953992110,7cyclictest3659333-21cut11:25:173
3338953992110,7cyclictest3366391-21basename07:35:003
333895399206,2cyclictest3628494-21/usr/sbin/munin11:05:143
333895399201,6cyclictest3760131-21ssh12:33:183
333895399201,6cyclictest3511004-21taskset09:44:033
3338953992016,2cyclictest0-21swapper/309:55:253
3338953992016,2cyclictest0-21swapper/309:20:003
3338953992015,4cyclictest511ktimers/309:20:063
3338953992011,8cyclictest3423133-21cpuspeed_turbos08:30:143
333895399201,16cyclictest3553171-21ssh10:12:273
333895399201,16cyclictest3355735-21/usr/sbin/munin07:20:263
3338953992010,8cyclictest3371315-40gst-plugin-scan07:38:023
3338953992010,6cyclictest3573263-21cat10:25:193
333895399200,16cyclictest3721982-21runrttasks12:07:373
37565332190,2sleep00-21swapper/012:30:170
34957692190,2sleep20-21swapper/209:30:292
333895399199,7cyclictest736-21gdbus08:00:013
333895399198,8cyclictest3516651-21seq09:45:343
333895399191,7cyclictest3401264-21grep08:05:183
3338953991911,6cyclictest943-21runrttasks11:46:473
3338953991911,6cyclictest3727331-21ntpq12:10:203
3338953991911,6cyclictest3686414-21sh11:44:103
3338953991911,6cyclictest3604391-21ssh10:46:073
333895399191,16cyclictest3407214-21chrt08:12:263
333895399191,11cyclictest3430850-21kthreadcore08:35:173
35913622180,3sleep10-21swapper/110:39:151
333895399189,6cyclictest3396522-21systemctl08:00:213
333895399181,5cyclictest3635830-21sh11:10:063
3338953991814,3cyclictest3386697-21unixbench_singl07:50:263
3338953991813,3cyclictest3448334-21fschecks_count08:55:143
3338953991811,5cyclictest3462192-21/usr/sbin/munin09:05:233
333895399180,7cyclictest3457953-21cron09:05:003
333895399180,16cyclictest3628025-21seq11:04:473
36553082171,12sleep13655319-21ssh11:21:041
36209482171,2sleep20-21swapper/210:59:412
3338953991713,3cyclictest3433241-21cpuspeed_turbos08:40:103
3338953991713,2cyclictest3343649-21unixbench_multi07:10:253
3338953991712,3cyclictest0-21swapper/308:55:003
333895399171,14cyclictest3377409-21/usr/sbin/munin07:45:163
333895399171,13cyclictest3417585-21cron08:25:003
3338953991710,5cyclictest3442029-21cut08:45:223
37129982160,2sleep20-21swapper/212:00:212
37057532161,11sleep23462970-21diskmemload11:55:212
36729832161,2sleep20-21swapper/211:35:172
36729832161,2sleep20-21swapper/211:35:172
36495742160,2sleep20-21swapper/211:19:052
35602382161,9sleep13560248-21ssh10:17:231
347661521611,2sleep10-21swapper/109:19:261
33912162161,11sleep13391270-21ntpq07:55:221
333895399165,7cyclictest715-21gpm07:17:153
333895399161,6cyclictest3412329-21taskset08:18:193
3338953991614,1cyclictest0-21swapper/307:40:193
36871402151,4sleep03462970-21diskmemload11:45:090
35180732152,6sleep134-21ksoftirqd/109:48:491
34900582151,3sleep00-21swapper/009:28:270
37499812141,7sleep23750061-21/usr/sbin/munin12:25:232
37224592141,8sleep03462970-21diskmemload12:08:500
36629822141,9sleep23662989-21ssh11:26:272
35477902141,9sleep23547863-21grep10:10:142
33906462141,9sleep23391113-21grep07:55:192
37081612131,8sleep13708173-21ssh11:58:571
36814622131,8sleep10-21swapper/111:40:171
36285172131,6sleep13628669-21df11:05:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional