You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-29 - 12:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7s.osadl.org (updated Fri Aug 29, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
123652670611,6680sleep212309-21kworker/u8:320:34:132
181832271120,2678sleep315042-21kworker/3:200:16:163
24242233911,2316sleep01260-21kworker/0:123:27:080
30663282718,790sleep030725-21/usr/sbin/munin19:49:090
1673525576,536sleep116770-21ntpq22:29:071
14866231122,265sleep314882-21cut22:23:563
283932277119,57sleep10-21swapper/123:07:021
5904227210,246sleep35940-21ntpq20:14:033
16802224935,197sleep116805-21cron00:13:361
16802224935,197sleep116805-21cron00:13:361
22159223249,166sleep122200-21ntp_kernel_err00:29:021
20882223139,79sleep121005-21timerwakeupswit00:24:101
31195222841,127sleep131393-21sed21:33:401
29014222833,174sleep129127-21grep21:24:231
17404221947,45sleep10-21swapper/119:09:001
10961221927,176sleep011037-21grep23:53:570
22925221845,59sleep10-21swapper/121:08:401
7291221662,118sleep16797-21apt-get20:18:421
7291221662,118sleep16797-21apt-get20:18:421
4384221642,127sleep14476-21latency_hist23:33:391
5591221510,84sleep15603-21fschecks_count20:13:571
32058221510,166sleep132100-21tr21:34:201
32402219613,166sleep132527-21timerwakeupswit19:54:111
10625218912,120sleep10-21swapper/120:28:591
29039217512,145sleep329038-21apt-get23:08:503
12048216846,26sleep10-21swapper/122:14:051
12022216815,137sleep212181-21latency_hist20:33:412
3245721648,137sleep132521-21latency23:19:011
12408216312,132sleep012545-21uptime22:14:120
2690216034,52sleep10-21swapper/121:44:051
13971215838,76sleep10-21swapper/100:03:511
2150221578,113sleep121557-21find22:44:051
2150221578,113sleep121557-21find22:44:051
5156215618,26sleep00-21swapper/023:34:060
1900215639,21sleep10-21swapper/123:24:101
2149221537,108sleep121619-21timerwakeupswit19:19:141
1709621537,80sleep10-21swapper/100:13:521
20802215238,75sleep120949-21latency_hist22:43:411
20657215213,77sleep10-21swapper/120:59:111
27020215110,84sleep10-21swapper/123:03:391
18961215132,56sleep10-21swapper/100:19:011
18461214922,57sleep10-21swapper/120:53:501
8639214612,119sleep18701-21grep22:04:001
1903821458,118sleep10-21swapper/119:13:441
19032214228,79sleep1362-21snmpd22:37:021
287221419,93sleep10-21swapper/120:04:081
10197214114,111sleep110311-21latency_hist20:28:391
13240214028,18sleep10-21swapper/122:18:581
2471921379,86sleep10-21swapper/121:13:571
1255213348,45sleep10-21swapper/121:39:091
1255213348,45sleep10-21swapper/121:39:091
675421329,87sleep16843-21latency_hist21:58:391
462321327,51sleep10-21swapper/123:33:511
4502213211,100sleep10-21swapper/120:09:091
23287213111,38sleep10-21swapper/121:09:001
23287213111,38sleep10-21swapper/121:09:001
16093213172,21sleep116146-21latency_hist22:28:391
1568021318,16sleep10-21swapper/120:44:011
1380421308,81sleep10-21swapper/120:38:521
930021288,80sleep10-21swapper/123:48:531
18666212515,44sleep20-21swapper/200:18:502
13806212220,83sleep313857-21sort20:38:553
10495212122,77sleep20-21swapper/222:09:022
10495212122,77sleep20-21swapper/222:09:022
20728212013,90sleep320802-21mailstats00:24:083
2808211913,84sleep22876-21mailstats21:44:112
4043211718,84sleep24045-21entropy20:08:572
22452211710,41sleep10-21swapper/119:23:541
852211515,77sleep3884-21tune2fs21:38:593
852211515,77sleep3884-21tune2fs21:38:593
413211311,83sleep2544-21/usr/sbin/munin23:19:102
24741211230,68sleep124867-21cat22:54:101
2382421120,6sleep30-21swapper/319:28:393
31108211116,79sleep331150-21systemd-run21:33:373
17588210813,73sleep017294-21/usr/sbin/munin19:09:030
11423210815,22sleep20-21swapper/223:54:072
7972210720,45sleep10-21swapper/123:44:001
2772210713,75sleep32928-21latency_hist23:28:403
23870210730,42sleep123891-21ls22:53:381
23870210730,42sleep123891-21ls22:53:381
26775210613,79sleep026836-21/usr/sbin/munin21:19:370
26775210613,79sleep026836-21/usr/sbin/munin21:19:370
12300210626,36sleep10-21swapper/120:33:561
30601210525,36sleep10-21swapper/123:13:531
20589210515,74sleep020656-21awk20:59:100
32305210419,72sleep032401-21sed19:54:090
20952210451,30sleep20-21swapper/219:19:022
30858210214,69sleep00-21swapper/023:14:000
995210113,72sleep01012-21latency_hist23:23:360
30309210127,58sleep130342-21awk23:13:361
17163210111,22sleep017186-21irqstats20:49:010
27845210013,69sleep127857-21munin-run21:23:381
27845210013,69sleep127857-21munin-run21:23:381
289002987,50sleep10-21swapper/119:44:011
2268529821,60sleep00-21swapper/021:06:250
131529841,41sleep117110-21cyclictest19:59:071
131529841,41sleep117110-21cyclictest19:59:071
269692979,75sleep327009-21/usr/sbin/munin23:03:373
2600729738,18sleep10-21swapper/119:34:081
2600729738,18sleep10-21swapper/119:34:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional