You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-15 - 10:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7s.osadl.org (updated Sat Feb 15, 2025 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16621282317,789sleep016685-21/usr/sbin/munin21:42:560
1065825138,493sleep110694-21ntpq19:23:081
7952246721,428sleep08089-21/usr/sbin/munin19:13:140
9216228010,252sleep19278-21grep19:18:111
21116227384,128sleep121222-21timerandwakeup19:58:121
12312222710,201sleep112373-21sendmail_mailqu19:28:131
12312222710,201sleep112373-21sendmail_mailqu19:28:131
4180221632,169sleep14332-21latency_hist23:42:421
16959220728,142sleep116995-21ntpq00:28:041
27693219735,27sleep10-21swapper/120:22:551
24563219673,67sleep124684-21latency_hist22:32:421
14711219211,165sleep114773-21latency_hist19:37:411
13042218918,157sleep213060-21fschecks_count21:23:122
13042218918,157sleep213060-21fschecks_count21:23:122
7270218424,135sleep30-21swapper/323:52:413
23809218229,134sleep123942-21latency_hist22:27:411
23809218229,134sleep123942-21latency_hist22:27:411
4487218037,83sleep10-21swapper/120:52:511
1980921776,39sleep10-21swapper/119:53:241
5726216846,80sleep15815-21cut19:08:021
8090216310,139sleep18105-21vmstat19:13:151
25864216117,92sleep00-21swapper/022:42:420
25864216117,92sleep00-21swapper/022:42:420
29485215827,119sleep129505-21apt-get23:07:591
1858321589,134sleep118793-21cut19:52:431
12101214913,56sleep10-21swapper/121:17:421
12101214913,56sleep10-21swapper/121:17:421
1360214714,17sleep10-21swapper/120:42:541
4124214116,81sleep10-21swapper/119:03:091
1690021409,117sleep117036-21date19:47:421
616321396,12sleep00-21swapper/020:57:590
7183213733,53sleep17227-40ogrotate23:52:391
14822213612,56sleep114882-21awk21:32:391
3266721357,52sleep10-21swapper/120:38:051
25275213416,100sleep225328-21fschecks_count20:13:032
23088213410,112sleep0370-21snmpd20:04:490
23972213232,63sleep124017-21awk20:08:061
23972213232,63sleep124017-21awk20:08:061
6282212711,101sleep06404-21cat19:08:130
31483212612,99sleep131632-21unixbench_singl20:33:131
2578021217,10sleep10-21swapper/122:42:311
2578021217,10sleep10-21swapper/122:42:311
1742521217,32sleep10-21swapper/121:49:021
20034211836,66sleep120046-21modprobe22:07:391
3504211730,68sleep13630-21latency_hist23:37:421
12442211716,83sleep312544-21timerandwakeup19:28:153
12442211716,83sleep312544-21timerandwakeup19:28:153
930321165,28sleep10-21swapper/100:01:151
2508721165,34sleep10-21swapper/122:36:501
29892211314,28sleep329912-21/usr/sbin/munin23:08:373
18794211169,22sleep218413-21apt-get19:52:442
32042211011,87sleep0370-21snmpd23:13:470
688621095,93sleep00-21swapper/023:48:510
2197821095,29sleep10-21swapper/122:14:091
10758210848,11sleep10-21swapper/100:05:071
5690210746,47sleep15765-21latency_hist23:47:431
5690210746,47sleep15765-21latency_hist23:47:431
1939021076,34sleep10-21swapper/122:02:301
22893210542,47sleep11-21systemd22:22:411
15701210515,76sleep315782-21cut19:42:563
2565721045,14sleep30-21swapper/320:13:123
9449210213,72sleep39543-21load21:08:033
16943210244,10sleep10-21swapper/121:45:591
14142210241,20sleep114285-21latency_hist00:17:421
16266210118,59sleep216411-21unixbench_multi19:43:072
12292210143,12sleep10-21swapper/100:09:511
29514210017,71sleep229584-21/usr/sbin/munin23:08:042
26291210038,18sleep10-21swapper/122:42:511
10955210013,70sleep310975-21latency_hist00:07:393
186929923,51sleep01-21systemd23:32:400
1260529947,11sleep10-21swapper/121:22:021
174972985,10sleep00-21swapper/021:49:580
2300629718,66sleep10-21swapper/120:03:451
956329627,52sleep10-21swapper/121:08:051
646029641,42sleep10-21swapper/120:58:041
372629411,69sleep23735-21/usr/sbin/munin19:02:582
142882947,69sleep10-21swapper/121:27:431
2255929318,60sleep222638-21awk20:03:142
1020129314,65sleep210210-21modprobe21:09:392
2664329210,64sleep126840-21apt-config20:17:421
2230129215,59sleep322452-21latency_hist22:17:423
1328729235,11sleep10-21swapper/121:24:031
478429117,57sleep30-21swapper/323:43:053
478429117,57sleep30-21swapper/323:43:053
313729111,67sleep03191-21interrupts20:48:020
2166029113,64sleep321681-21latency_hist22:12:423
2166029113,64sleep321681-21latency_hist22:12:423
1465929120,46sleep314661-21cron19:37:393
789529011,64sleep27907-21/usr/sbin/munin21:03:052
2043928933,45sleep120440-21diskstats22:08:201
2043928933,45sleep120440-21diskstats22:08:201
1532728937,42sleep10-21swapper/121:35:221
2676128816,52sleep326908-21latency_hist22:47:423
13362880,8sleep30-21swapper/320:42:433
263628734,33sleep32152-21/usr/sbin/munin23:32:593
774628615,57sleep27815-21switchtime19:13:122
600628624,30sleep20-21swapper/219:08:072
2650828622,47sleep026641-21latency_hist20:17:410
474628519,46sleep24783-21sed23:43:042
474628519,46sleep24783-21sed23:43:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional