You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 03:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot8s.osadl.org (updated Tue Nov 25, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26344079912531,1248cyclictest26742032sleep307:39:573
2634407994151,411cyclictest2768888-21turbostat08:59:563
2634407992670,263cyclictest2941764-21turbostat10:49:543
2634407992118,1cyclictest0-21swapper/309:40:013
2634407991815,1cyclictest0-21swapper/312:20:193
2634407991815,1cyclictest0-21swapper/310:15:243
190898180,4rtkit-daemon3094255-21ssh12:16:410
263440799176,8cyclictest2884998-21turbostat10:10:003
2634407991715,1cyclictest0-21swapper/308:40:003
2634407991714,1cyclictest0-21swapper/312:05:003
2634407991613,1cyclictest0-21swapper/311:45:173
2634407991613,1cyclictest0-21swapper/311:30:163
2634407991613,1cyclictest0-21swapper/310:34:593
263440799161,11cyclictest3039157-21turbostat11:45:013
263440799156,6cyclictest29569892sleep310:52:483
2634407991513,0cyclictest0-21swapper/311:56:393
2634407991512,1cyclictest0-21swapper/311:40:003
2634407991512,1cyclictest0-21swapper/309:13:253
263440799151,11cyclictest2994720-21taskset11:15:193
263440799151,11cyclictest2994720-21taskset11:15:183
263440799151,11cyclictest2982695-21taskset11:10:013
263440799151,11cyclictest2933621-21turbostat10:39:593
263440799151,11cyclictest2909543-21chrt10:25:023
263440799145,6cyclictest26494932sleep307:20:153
263440799144,7cyclictest2965030-21taskset10:57:473
263440799144,7cyclictest2743370-21taskset08:33:373
2634407991413,0cyclictest0-21swapper/312:36:493
2634407991413,0cyclictest0-21swapper/310:43:003
2634407991413,0cyclictest0-21swapper/308:23:553
2634407991413,0cyclictest0-21swapper/307:41:393
2634407991413,0cyclictest0-21swapper/307:14:113
2634407991412,1cyclictest0-21swapper/308:43:093
2634407991412,1cyclictest0-21swapper/308:05:013
2634407991412,0cyclictest0-21swapper/309:40:123
2634407991412,0cyclictest0-21swapper/309:09:213
263440799141,11cyclictest2860623-21chrt09:55:003
2634407991411,1cyclictest0-21swapper/309:30:113
2634407991411,1cyclictest0-21swapper/308:05:173
2634407991411,1cyclictest0-21swapper/307:50:143
2634407991411,1cyclictest0-21swapper/307:25:153
263440799141,10cyclictest3107654-21chrt12:25:193
263440799141,10cyclictest2860873-21taskset09:55:043
263440799141,10cyclictest2796397-21taskset09:15:043
263440799141,10cyclictest2775422-21taskset09:00:143
263440799141,10cyclictest2768823-21taskset08:54:293
263440799141,10cyclictest2732036-21chrt08:25:173
263440799140,11cyclictest3004933-21taskset11:20:393
26342142140,3sleep30-21swapper/307:09:323
263440799139,1cyclictest0-21swapper/309:25:133
263440799135,6cyclictest29036572sleep310:20:173
263440799131,9cyclictest3089739-21taskset12:15:173
263440799131,9cyclictest30071612sleep311:25:143
263440799131,9cyclictest2972560-21taskset11:00:473
263440799131,9cyclictest2804672-21chrt09:20:143
263440799131,9cyclictest2698917-21chrt07:55:353
2634407991312,0cyclictest0-21swapper/312:30:443
2634407991312,0cyclictest0-21swapper/312:12:203
2634407991311,1cyclictest0-21swapper/307:46:103
2634407991311,1cyclictest0-21swapper/307:30:013
263440799131,10cyclictest3079383-21taskset12:09:373
263440799131,10cyclictest2981113-21taskset11:06:543
263440799131,10cyclictest2762616-21turbostat08:50:003
263440799131,10cyclictest2648869-21chrt07:18:493
2634407991310,1cyclictest0-21swapper/311:50:243
263440799130,10cyclictest2885232-21taskset10:10:023
263440799130,10cyclictest2850107-21taskset09:45:233
190898130,9rtkit-daemon2973341-21ssh11:02:371
31020092120,1sleep10-21swapper/112:20:541
263440799121,8cyclictest2712385-21chrt08:10:013
263440799121,8cyclictest0-21swapper/310:00:143
26297242121,3sleep20-21swapper/207:05:182
26932422110,3sleep02693275-21apt-get07:55:130
263440799110,9cyclictest2718643-21chrt08:15:073
190898110,8rtkit-daemon81364-21packagekitd09:31:572
190898110,7rtkit-daemon2802211-21ssh09:15:271
190898110,6rtkit-daemon3085160-21ntp_states12:10:220
190898110,4rtkit-daemon2998538-21ssh11:19:411
190898110,4rtkit-daemon2998538-21ssh11:19:401
190898110,4rtkit-daemon2640800-21munin-node11:53:270
190898110,4rtkit-daemon1928-21sendmail-mta09:41:262
190898110,3rtkit-daemon2640800-21munin-node11:41:170
31199542101,6sleep13120012-21latency_hist12:34:591
29904932101,6sleep00-21swapper/011:15:010
26672852101,7sleep02667472-21/usr/sbin/munin07:30:250
190898100,6rtkit-daemon2794207-21ssh09:10:322
190898100,6rtkit-daemon2662438-21irqcore07:30:162
190898100,6rtkit-daemon2636053-21kthreadcore07:10:172
190898100,5rtkit-daemon3127885-21ssh12:39:340
190898100,3rtkit-daemon1928-21sendmail-mta11:34:370
2957068291,6sleep12957076-21ssh10:52:571
2941738290,6sleep12941774-21systemd-run10:45:011
2940632290,6sleep22940639-21sh10:42:332
2750094290,6sleep22750156-21/usr/sbin/munin08:40:152
2744130291,6sleep10-21swapper/108:35:171
2694695291,2sleep10-21swapper/107:55:181
19089890,5rtkit-daemon3057788-21kthreadcore11:55:180
19089890,5rtkit-daemon0-21swapper/010:06:520
19089890,4rtkit-daemon3101959-21ssh12:20:460
19089890,4rtkit-daemon3076849-21ssh12:05:170
19089890,4rtkit-daemon2999251-21diskstats11:20:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional