You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-24 - 03:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s (updated Fri Feb 23, 2024 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14719295017,9483sleep17018-21kworker/1:110:37:301
25016269726,660sleep125022-21ntpq11:10:301
12045267716,647sleep212056-21/usr/sbin/munin08:45:382
1239245322,416sleep21221-21/usr/sbin/munin08:14:532
2587424028,381sleep125922-21unin-run07:49:521
2587424028,381sleep125922-21unin-run07:49:521
21252233724,292sleep021338-21latency_hist07:34:530
13423232122,275sleep213437-21grep07:10:202
4596226395,66sleep14640-21latency10:05:241
4596226395,66sleep14640-21latency10:05:241
1674422626,244sleep115508-21kworker/u8:310:45:021
32324225517,220sleep032389-21awk09:50:290
32324225517,220sleep032389-21awk09:50:290
10276225155,134sleep110417-21unixbench_multi08:40:321
205042224106,61sleep120571-21switchtime07:30:301
30128221743,57sleep10-21swapper/111:25:321
1600221525,76sleep11708-21fschecks_time08:15:241
22058221159,130sleep122127-21latency_hist09:19:531
2585220827,144sleep12596-21vmstat11:40:301
26857220312,168sleep126998-21unixbench_multi07:50:331
26857220312,168sleep126998-21unixbench_multi07:50:331
23293220342,150sleep11-21systemd09:21:311
23143219915,61sleep10-21swapper/111:05:211
19288218442,85sleep119351-21mailstats12:35:301
31062217653,68sleep130829-21/usr/sbin/munin08:05:231
26564216843,75sleep126077-21/usr/sbin/munin11:15:301
6072216551,49sleep10-21swapper/108:29:541
13128216449,50sleep10-21swapper/107:09:551
4954215620,20sleep15001-21ls11:50:191
11217215218,45sleep10-21swapper/108:45:201
8674214925,60sleep28702-21ls10:19:512
1651214810,19sleep10-21swapper/109:55:271
28934214739,54sleep128964-21idleruntime-cro11:24:511
2046521476,50sleep10-21swapper/109:14:521
16997214734,64sleep10-21swapper/112:29:521
1210221468,16sleep10-21swapper/110:30:161
16094214321,58sleep10-21swapper/109:00:231
24306214275,22sleep10-21swapper/109:25:301
1770321427,17sleep10-21swapper/109:05:191
1831821406,15sleep10-21swapper/110:50:101
9829213712,22sleep30-21swapper/312:05:233
5981213750,76sleep16058-21cut10:10:211
5981213750,76sleep16058-21cut10:10:211
9093213613,67sleep10-21swapper/110:20:221
9093213613,67sleep10-21swapper/110:20:221
8697213612,68sleep18846-21unixbench_multi08:35:311
8697213612,68sleep18846-21unixbench_multi08:35:311
3375213622,67sleep13429-21grep11:45:231
2721321369,59sleep10-21swapper/109:35:201
4329213119,20sleep20-21swapper/208:24:342
13946213021,89sleep313967-21munin-run08:54:513
22106212967,17sleep10-21swapper/107:35:311
22065212939,22sleep10-21swapper/111:00:321
1150212820,87sleep0666-21apt-get09:55:010
10768212729,58sleep110834-21date12:09:541
16834212634,63sleep016853-21apt-get07:20:110
13826212652,59sleep113888-21modprobe12:19:511
21932212423,83sleep30-21swapper/311:00:303
10601212310,14sleep10-21swapper/110:25:151
2898821218,76sleep10-21swapper/109:40:291
23945212123,79sleep224010-21sort09:25:232
19703212129,55sleep119833-21sort07:29:541
15358212116,87sleep215363-21/usr/sbin/munin07:15:212
16578212013,69sleep116730-21latency_hist10:44:531
2200521180,9sleep09662-1kworker/0:2H09:19:510
3060211559,39sleep10-21swapper/108:20:131
625211418,78sleep2702-21sshd11:35:302
17529211311,81sleep00-21swapper/012:30:240
740921127,58sleep1372-21snmpd11:57:381
23399211011,81sleep223432-21/usr/sbin/munin11:05:262
9217210918,63sleep10-21swapper/112:04:531
17154210917,76sleep317100-21latency_hist09:04:533
3727210714,69sleep23218-21/usr/sbin/munin11:45:322
1436210716,73sleep01452-21cat11:39:520
3085210630,47sleep03080-21apt-get08:20:160
18551210631,56sleep10-21swapper/112:34:531
25843210519,69sleep025860-21latency_hist11:14:530
17880210516,76sleep017893-21kernelversion09:05:220
3440210444,39sleep10-21swapper/110:00:321
31824210447,45sleep10-21swapper/109:50:061
31824210447,45sleep10-21swapper/109:50:061
1393921047,62sleep1372-21snmpd08:54:451
14281210117,59sleep214345-21fschecks_time12:20:202
4423210020,64sleep24527-21fschecks_time10:05:212
4423210020,64sleep24527-21fschecks_time10:05:212
935729915,69sleep09501-21latency_hist08:39:540
935729915,69sleep09501-21latency_hist08:39:540
2164929915,21sleep20-21swapper/211:00:212
1023429914,72sleep010236-21sshd10:24:370
1023429914,72sleep010236-21sshd10:24:370
310292987,78sleep131083-21sort11:30:201
2069629821,51sleep320847-21head07:30:323
166429818,62sleep31665-21/usr/sbin/munin11:40:083
157602987,56sleep115844-21mailstats07:15:321
136102984,12sleep00-21swapper/008:50:320
666229717,61sleep10-21swapper/108:30:301
3194229620,59sleep332035-21grep09:50:203
3194229620,59sleep332035-21grep09:50:203
2860629618,55sleep328638-21fschecks_count09:40:183
1185229618,63sleep311918-21cat10:29:533
1075629613,67sleep010767-21unin-run12:09:530
150772955,18sleep10-21swapper/112:20:361
2960129415,64sleep029629-21/usr/sbin/munin11:25:230
2699229414,66sleep327016-21df09:35:143
1721629313,63sleep217242-21ntp_states10:45:312
1528829249,10sleep10-21swapper/108:57:161
2884129143,38sleep1372-21snmpd07:58:161
2432429121,14sleep10-21swapper/107:44:521
1813229020,54sleep10-21swapper/107:24:531
1104429015,61sleep211122-21mailstats10:25:282
3052428911,62sleep230610-21rm11:29:532
454628813,54sleep00-21swapper/010:05:230
454628813,54sleep00-21swapper/010:05:230
3226628810,64sleep332270-21cron11:34:513
3044028822,18sleep10-21swapper/109:45:251
2610228810,60sleep326103-21/usr/sbin/munin11:15:163
1628328713,50sleep215796-21/usr/sbin/munin09:00:282
58522869,65sleep25854-21sshd11:52:302
1932628621,48sleep30-21swapper/309:10:223
145528544,27sleep11599-21latency_hist11:39:531
87512849,61sleep08835-21latency_hist10:19:530
323992849,17sleep10-21swapper/108:10:151
170928414,54sleep21750-21if_eth008:15:252
63628322,31sleep30-21swapper/308:10:343
323728316,54sleep23266-21ps10:00:282
1233428310,17sleep00-21swapper/012:14:530
262592828,12sleep00-21swapper/007:50:200
262592828,12sleep00-21swapper/007:50:200
203282829,18sleep10-21swapper/110:55:271
1341628220,47sleep10-21swapper/107:10:191
2730128115,17sleep20-21swapper/209:35:212
1810228123,31sleep30-21swapper/309:05:303
927428015,49sleep29417-21modprobe12:04:542
783928010,15sleep10-21swapper/110:15:301
385828010,53sleep03964-21ls11:45:340
2592427923,31sleep30-21swapper/307:49:543
2592427923,31sleep30-21swapper/307:49:543
1756027918,26sleep00-21swapper/010:45:370
1550527914,47sleep315600-21/usr/sbin/munin10:40:233
2538127834,31sleep10-21swapper/109:30:111
2239327824,26sleep30-21swapper/309:20:203
2985027738,17sleep10-21swapper/108:00:301
2197827720,37sleep321997-21apt09:19:513
1390927716,18sleep30-21swapper/312:19:533
958827613,37sleep20-21swapper/208:40:132
487527623,26sleep00-21swapper/011:50:180
2676227610,50sleep00-21swapper/009:34:540
223927619,27sleep20-21swapper/211:40:272
17512768,16sleep30-21swapper/308:15:263
1423627612,50sleep314238-21apt-get08:55:123
277202758,45sleep30-21swapper/307:55:153
1954727516,38sleep019689-21grep12:35:330
65432747,54sleep26310-21/usr/sbin/munin11:55:212
631227410,22sleep00-21swapper/011:55:110
324327412,47sleep33292-21cpuspeed11:45:163
311302746,15sleep30-21swapper/308:05:253
948827312,45sleep39545-21/usr/sbin/munin10:20:323
948827312,45sleep39545-21/usr/sbin/munin10:20:323
294702736,57sleep00-21swapper/009:41:000
3124027215,28sleep00-21swapper/011:30:270
223882720,6sleep20-21swapper/209:20:172
1962627216,15sleep30-21swapper/310:54:533
1645427213,43sleep216605-21sed12:25:332
1317027211,42sleep213228-21/usr/sbin/munin08:50:262
648727117,38sleep06594-21timerandwakeup10:10:320
648727117,38sleep06594-21timerandwakeup10:10:320
2786627123,26sleep20-21swapper/211:20:202
2281827122,28sleep30-21swapper/307:39:533
2004627124,29sleep220110-21modprobe12:39:512
1695127112,44sleep016996-21systemd-run12:29:510
536327015,37sleep0372-21snmpd08:25:330
1984827019,30sleep019867-21apt-get10:55:100
1226227015,41sleep212305-21systemd-run12:14:512
1212027021,25sleep30-21swapper/307:05:253
1123526923,28sleep00-21swapper/008:45:240
1119426925,22sleep00-21swapper/010:25:300
606126819,23sleep20-21swapper/210:10:222
606126819,23sleep20-21swapper/210:10:222
322426815,18sleep00-21swapper/010:00:260
3131626822,30sleep331338-21apt-get09:49:513
2932426832,19sleep30-21swapper/311:25:173
202952687,46sleep015895-1kworker/u9:109:13:140
1592226821,27sleep00-21swapper/010:40:320
1237226820,34sleep212452-21cat10:30:252
2580126721,29sleep225809-21modprobe11:14:512
1307126712,39sleep013127-21sed07:09:540
592626613,30sleep30-21swapper/308:29:523
2588026615,37sleep225939-21find09:30:282
1781026611,26sleep30-21swapper/312:30:313
1272226617,28sleep30-21swapper/310:30:343
777026519,25sleep00-21swapper/008:34:540
2624826513,33sleep226255-21diskstats07:50:182
2624826513,33sleep226255-21diskstats07:50:182
2333926512,13sleep30-21swapper/307:40:213
848726414,26sleep30-21swapper/312:00:313
2270626419,29sleep022712-21modprobe11:04:510
208726414,34sleep22096-21vmstat09:55:322
1849026424,25sleep318507-21uniq07:25:193
110922649,33sleep10-21swapper/112:10:181
2491826318,29sleep0231-21systemd-journal09:27:310
1742026314,26sleep20-21swapper/207:20:502
3219626217,29sleep00-21swapper/008:09:540
2741826220,26sleep327442-21modprobe07:54:513
2741826220,26sleep327442-21modprobe07:54:513
2735626218,20sleep20-21swapper/211:19:512
2119926217,26sleep2231-21systemd-journal07:34:512
1660526221,17sleep30-21swapper/307:19:543
1652826217,29sleep016554-21modprobe07:19:510
1284026225,22sleep00-21swapper/010:30:350
307152619,15sleep00-21swapper/009:45:320
2045326117,25sleep20-21swapper/210:55:332
1484826118,23sleep20-21swapper/208:55:312
1381526117,17sleep00-21swapper/007:10:300
1264826115,21sleep20-21swapper/212:15:202
788326016,27sleep37892-21/usr/sbin/munin10:15:323
275626018,24sleep02784-21modprobe08:19:510
1911726021,18sleep00-21swapper/007:25:320
1379826010,38sleep0372-21snmpd12:19:300
1234026010,32sleep3373-21sshd08:49:183
3212525916,28sleep232187-21wc09:50:232
3212525916,28sleep232187-21wc09:50:232
3055225914,26sleep330581-21munin-run08:04:523
2256525911,25sleep00-21swapper/007:37:320
1749125916,26sleep30-21swapper/307:20:513
1363325910,33sleep013636-21acpi10:35:110
567025817,19sleep30-21swapper/310:09:543
347525819,21sleep30-21swapper/308:20:273
303002586,43sleep00-21swapper/008:01:380
2841925815,28sleep028546-21unixbench_multi07:55:490
1857625814,20sleep20-21swapper/212:34:542
986325716,23sleep00-21swapper/008:40:230
816925711,19sleep20-21swapper/212:00:222
2490925716,24sleep224993-21memory07:45:252
2490925716,24sleep224993-21memory07:45:252
2300525714,25sleep022999-21apt-get11:05:160
2093325713,28sleep20-21swapper/209:15:222
1619425710,24sleep30-21swapper/312:25:303
140242576,12sleep20-21swapper/210:35:252
1101925712,17sleep30-21swapper/312:10:163
1090825716,24sleep311051-21latency_hist08:44:543
673725611,32sleep36783-21cat11:55:263
2385525614,25sleep323850-21apt-get09:25:163
2274925610,27sleep20-21swapper/207:39:522
1530825618,20sleep00-21swapper/008:57:310
1412625618,18sleep30-21swapper/310:35:313
849225518,20sleep20-21swapper/208:35:282
849225518,20sleep20-21swapper/208:35:282
478825515,23sleep34783-21apt-get11:50:133
38325518,19sleep30-21swapper/311:35:233
2929425513,25sleep229288-21apt-get08:00:152
2852125514,25sleep228517-21apt-get09:40:132
2795325518,20sleep00-21swapper/011:20:220
1925725512,26sleep319263-21ntp_states12:35:283
1687325515,26sleep316909-21fschecks_count10:45:243
1531125514,24sleep215317-21diskstats10:40:182
1434825518,20sleep30-21swapper/312:20:223
265822548,33sleep30-21swapper/309:34:043
2053725412,26sleep30-21swapper/310:55:343
857625317,21sleep08699-21sed12:00:320
3097125311,27sleep230983-21vmstat09:45:342
2771925313,25sleep227716-21apt-get07:55:142
2539925313,23sleep025393-21apt-get09:30:140
1582025313,22sleep015814-21apt-get09:00:140
933325217,19sleep30-21swapper/308:39:533
933325217,19sleep30-21swapper/308:39:533
642225213,22sleep35941-21apt-get08:30:003
479425217,22sleep34842-21processes10:05:303
467925212,24sleep24675-21apt-get08:25:142
3263625211,25sleep032668-21irqstats08:10:220
299325218,17sleep00-21swapper/011:44:530
2609825113,22sleep026095-21apt-get11:15:130
251925014,17sleep30-21swapper/309:59:533
2455525011,23sleep324550-21apt-get11:10:153
1926525018,15sleep20-21swapper/209:10:212
1457725012,21sleep014613-21ntp_states12:20:270
3160824915,15sleep20-21swapper/211:30:382
2308424912,20sleep323088-21diskstats11:05:193
2307524914,17sleep00-21swapper/007:40:140
1832724910,23sleep018321-21apt-get10:50:130
1405024912,22sleep30-21swapper/307:10:333
1221224916,17sleep20-21swapper/207:05:282
223122487,14sleep00-21swapper/009:20:160
647724712,18sleep20-21swapper/208:30:232
611824712,20sleep36143-21irqstats10:10:233
611824712,20sleep36143-21irqstats10:10:233
3111524710,18sleep20-21swapper/208:05:242
2355924714,18sleep20-21swapper/207:40:282
1832424713,16sleep20-21swapper/210:50:112
947224613,16sleep20-21swapper/210:20:312
947224613,16sleep20-21swapper/210:20:312
2809024613,15sleep30-21swapper/311:20:253
274324611,17sleep30-21swapper/310:00:093
2462624612,17sleep00-21swapper/007:45:150
2462624612,17sleep00-21swapper/007:45:150
176132437,18sleep20-21swapper/209:05:122
184052398,17sleep20-21swapper/207:25:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional