You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 16:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot8s.osadl.org (updated Sun Nov 23, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3376739913350,1330cyclictest3443582sleep307:15:013
3376739913080,1305cyclictest5878662sleep310:09:553
3376739912800,1277cyclictest7090052sleep311:25:013
3376739910401,1034cyclictest652109-21sleep10:50:003
337673992724,1cyclictest0-21swapper/311:10:003
337673992118,1cyclictest0-21swapper/308:15:183
337673992118,1cyclictest0-21swapper/307:15:023
337673992017,1cyclictest0-21swapper/309:55:243
337673991917,1cyclictest0-21swapper/309:25:243
337673991916,1cyclictest0-21swapper/311:00:003
337673991916,1cyclictest0-21swapper/310:50:153
337673991815,1cyclictest0-21swapper/308:35:013
33767399176,9cyclictest364877-21turbostat07:34:553
337673991715,1cyclictest0-21swapper/312:10:003
337673991715,1cyclictest0-21swapper/307:30:013
337673991714,1cyclictest0-21swapper/310:30:163
337673991714,1cyclictest0-21swapper/310:20:173
337673991714,1cyclictest0-21swapper/309:25:003
337673991714,1cyclictest0-21swapper/308:40:013
337673991714,1cyclictest0-21swapper/308:40:003
337673991714,1cyclictest0-21swapper/307:45:003
33767399164,9cyclictest741023-21turbostat11:49:553
337673991614,1cyclictest0-21swapper/312:20:153
337673991614,1cyclictest0-21swapper/312:10:263
337673991614,1cyclictest0-21swapper/308:45:003
337673991613,1cyclictest0-21swapper/312:35:263
337673991613,1cyclictest0-21swapper/308:30:003
337673991613,1cyclictest0-21swapper/308:05:003
33767399161,12cyclictest555695-21turbostat09:49:593
7901302156,6sleep0790389-21cut12:15:160
33767399155,7cyclictest579594-21taskset10:04:183
33767399155,7cyclictest4851852sleep309:05:143
337673991514,0cyclictest0-21swapper/307:40:013
337673991513,1cyclictest0-21swapper/311:55:253
337673991513,1cyclictest0-21swapper/311:41:523
337673991513,1cyclictest0-21swapper/311:15:203
337673991513,1cyclictest0-21swapper/308:20:183
337673991512,1cyclictest0-21swapper/312:25:123
337673991512,1cyclictest0-21swapper/312:04:583
337673991512,1cyclictest0-21swapper/311:00:263
337673991512,1cyclictest0-21swapper/310:15:163
337673991512,1cyclictest0-21swapper/309:35:123
337673991512,1cyclictest0-21swapper/309:20:013
337673991512,1cyclictest0-21swapper/308:50:163
5798142140,5sleep0579822-21ssh10:04:580
5634872141,2sleep20-21swapper/209:54:292
3805952140,1sleep0382749-21kthreadcore07:40:210
337673991413,0cyclictest0-21swapper/309:54:063
337673991412,1cyclictest0-21swapper/311:10:183
337673991412,1cyclictest0-21swapper/310:13:313
337673991412,1cyclictest0-21swapper/309:04:013
337673991412,0cyclictest0-21swapper/311:21:483
337673991412,0cyclictest0-21swapper/308:06:323
337673991412,0cyclictest0-21swapper/307:50:163
337673991411,1cyclictest0-21swapper/311:35:013
337673991411,1cyclictest0-21swapper/309:10:133
337673991411,1cyclictest0-21swapper/307:45:223
3372792140,3sleep30-21swapper/307:06:453
190898140,10rtkit-daemon364099-21sendmail_mailst07:25:210
33767399135,6cyclictest8197612sleep312:30:423
33767399135,6cyclictest4606992sleep308:45:173
33767399132,8cyclictest539870-21taskset09:40:023
33767399131,9cyclictest352577-21taskset07:20:063
337673991312,0cyclictest0-21swapper/311:50:083
337673991311,1cyclictest0-21swapper/310:40:133
337673991310,1cyclictest0-21swapper/312:15:153
337673991310,1cyclictest0-21swapper/311:35:153
337673991310,1cyclictest0-21swapper/308:10:203
33767399130,10cyclictest612226-21taskset10:25:023
3367192132,6sleep0336844-21python307:05:220
5399732121,8sleep0540027-21/usr/sbin/munin09:40:120
4988242121,8sleep2498832-21ssh09:14:132
33767399121,9cyclictest530383-21taskset09:32:063
33767399121,9cyclictest477604-21taskset08:55:183
337673991210,1cyclictest0-21swapper/310:35:293
190898120,8rtkit-daemon611456-21ssh10:23:470
190898120,6rtkit-daemon675423-21ssh11:02:220
5699852111,3sleep2569993-21ssh09:55:422
5232962111,7sleep2523326-21munin-run09:30:002
5156422112,5sleep1515661-21apt-get09:25:141
33767399119,1cyclictest0-21swapper/307:55:243
190898110,8rtkit-daemon473-21gmain07:45:190
190898110,8rtkit-daemon344055-21munin-node10:50:440
190898110,7rtkit-daemon725743-21interrupts11:35:160
8219592101,7sleep1821928-21/usr/sbin/munin12:35:141
8030092100,1sleep1803098-21/usr/sbin/munin12:20:221
7805032101,6sleep0780511-21ssh12:08:030
7670582100,8sleep0768767-21cut12:00:180
6374252101,6sleep2638546-21cut10:40:172
5962472101,2sleep00-21swapper/010:15:150
5762602100,7sleep2577181-21memory10:00:182
4097022102,4sleep0409735-21apt-get08:05:130
190898100,6rtkit-daemon812241-21ssh12:27:080
190898100,5rtkit-daemon676885-21apt-get11:05:120
190898100,5rtkit-daemon642411-21ssh10:41:040
190898100,3rtkit-daemon674-21lldpd11:54:112
190898100,3rtkit-daemon619421-21ssh10:28:360
821275291,2sleep20-21swapper/212:34:172
813483291,4sleep1813589-21sed12:30:011
707413291,5sleep1707421-21sh11:21:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional