You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-04 - 21:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Sat May 04, 2024 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18630268715,653sleep225150-21kworker/u8:011:31:022
222426559,627sleep22252-21/usr/sbin/munin08:56:232
20014262017,586sleep020066-21sort08:11:010
20919244680,344sleep021028-21grep11:36:210
7632238410,174sleep07711-21timerandwakeup10:56:190
161023459,322sleep01676-21latency_hist07:10:480
31661231511,35sleep00-21swapper/010:30:590
31241231430,264sleep331334-21fschecks_time07:01:063
31241231430,264sleep331334-21fschecks_time07:01:063
7714231025,263sleep17855-21grep10:56:201
2981229012,266sleep03100-21unixbench_singl07:11:200
12139228891,175sleep00-21swapper/011:10:570
12139228891,175sleep00-21swapper/011:10:570
3605226925,192sleep03623-21idleruntime-cro10:45:450
29348226216,221sleep329493-21modprobe12:05:483
20214225824,221sleep320266-21idleruntime-cro09:55:453
20214225824,221sleep320266-21idleruntime-cro09:55:453
1562222548,151sleep00-21swapper/009:40:480
1562222548,151sleep00-21swapper/009:40:480
9960224360,26sleep00-21swapper/007:36:200
4591224334,189sleep04729-21unixbench_multi10:46:260
18220223652,163sleep018365-21apt-config11:30:470
27388222454,20sleep00-21swapper/011:56:480
1276221246,34sleep01300-21apt08:55:450
2341522119,164sleep023491-21fschecks_time11:46:060
890422078,160sleep08787-21/usr/sbin/munin11:01:110
2519219819,159sleep22650-21sed12:21:182
2519219819,159sleep22650-21sed12:21:182
11882218825,137sleep00-21swapper/011:10:490
6595218521,22sleep00-21swapper/009:11:080
28079218031,112sleep028170-21cut12:01:050
236432176107,17sleep00-21swapper/010:05:470
23824217330,85sleep023884-21cat08:21:240
19030217328,44sleep00-21swapper/009:51:010
19030217328,44sleep00-21swapper/009:51:010
3145217114,143sleep13169-21latency_hist09:00:471
8180216910,14sleep30-21swapper/309:16:073
32454216914,135sleep032612-21latency_hist12:15:470
32454216914,135sleep032612-21latency_hist12:15:470
1667121699,137sleep00-21swapper/008:00:480
1667121699,137sleep00-21swapper/008:00:480
6056216710,145sleep21166-21snmpd09:08:432
480221675,150sleep00-21swapper/007:17:140
9101216216,133sleep29102-21acpi07:35:542
27678215911,48sleep00-21swapper/010:16:210
2485221597,15sleep00-21swapper/011:50:590
26117215813,44sleep026242-21unixbench_multi10:11:170
11335215810,136sleep31166-21snmpd11:07:043
622221567,110sleep00-21swapper/007:21:220
1875821558,22sleep032516-21cyclictest08:06:130
30174215412,79sleep00-21swapper/008:41:190
1903721547,48sleep00-21swapper/011:31:240
15499215412,51sleep00-21swapper/011:21:060
32482215310,54sleep00-21swapper/007:05:470
32482215310,54sleep00-21swapper/007:05:470
2661721508,130sleep026652-21ntpq08:31:130
4579214556,57sleep34607-21munin-plugin-st12:30:443
4579214556,57sleep34607-21munin-plugin-st12:30:443
21991214212,114sleep20-21swapper/208:16:132
21991214212,114sleep20-21swapper/208:16:132
1118621418,61sleep00-21swapper/009:25:580
14114213810,45sleep00-21swapper/011:16:140
14114213810,45sleep00-21swapper/011:16:140
2602421378,37sleep00-21swapper/008:30:490
863521336,40sleep00-21swapper/009:16:210
385221337,38sleep00-21swapper/009:01:140
3837213311,40sleep00-21swapper/012:26:170
3837213311,40sleep00-21swapper/012:26:170
709212910,105sleep0766-21find12:16:150
709212910,105sleep0766-21find12:16:150
2388221299,40sleep00-21swapper/010:06:000
32410212831,78sleep232453-21awk07:05:452
32410212831,78sleep232453-21awk07:05:452
1583521258,54sleep00-21swapper/009:40:560
1583521258,54sleep00-21swapper/009:40:560
3096521217,96sleep00-21swapper/010:26:190
13417211929,68sleep313442-21munin-run11:15:443
13417211929,68sleep313442-21munin-run11:15:443
22130211820,73sleep20-21swapper/210:00:492
22130211820,73sleep20-21swapper/210:00:492
23013211710,93sleep01-21systemd11:45:460
23575211568,25sleep30-21swapper/311:46:093
2253211515,85sleep32271-21awk08:56:243
1485521156,98sleep00-21swapper/007:53:290
2911221148,42sleep00-21swapper/008:40:460
6204211210,84sleep06210-21munin-run12:35:460
29179211010,52sleep00-21swapper/010:21:180
22386211030,54sleep222319-21apt-get10:01:372
10897210910,16sleep00-21swapper/009:25:450
3222021088,85sleep032332-21date08:50:480
236321088,40sleep02407-21awk08:56:300
1737221086,39sleep00-21swapper/008:01:160
1737221086,39sleep00-21swapper/008:01:160
577621076,13sleep00-21swapper/010:51:100
522221079,14sleep00-21swapper/009:06:110
2215421070,50sleep10-21swapper/111:41:091
9624210610,35sleep30-21swapper/309:21:003
4120210619,69sleep24211-21unixbench_multi09:01:202
31928210614,76sleep331965-21grep10:31:063
3008021068,83sleep030138-21mailstats12:06:180
25161210514,77sleep225167-21ntpq08:26:182
21165210431,61sleep021215-21sed09:56:310
21165210431,61sleep021215-21sed09:56:310
17633210417,29sleep00-21swapper/009:46:090
6887210221,30sleep00-21swapper/007:25:540
22534210119,27sleep00-21swapper/008:16:390
22534210119,27sleep00-21swapper/008:16:390
1299321016,14sleep00-21swapper/009:31:110
4631210018,65sleep14721-21latency_hist12:30:461
4631210018,65sleep14721-21latency_hist12:30:461
888829829,53sleep09025-21latency_hist07:35:480
2127229822,49sleep321306-21awk08:15:453
183229815,29sleep00-21swapper/010:37:500
1160229815,29sleep00-21swapper/007:41:370
1160229815,29sleep00-21swapper/007:41:370
140529714,67sleep21481-21awk10:36:182
2936129621,20sleep10-21swapper/108:40:591
2872229519,50sleep228856-21unixbench_singl12:01:192
1582429517,64sleep215857-21ps07:56:172
1582429517,64sleep215857-21ps07:56:172
2982129425,53sleep329835-21idleruntime-cro10:25:453
39172936,12sleep30-21swapper/307:16:083
1165329315,61sleep311673-21/usr/sbin/munin09:26:133
27722925,11sleep00-21swapper/012:22:210
27722925,11sleep00-21swapper/012:22:210
121972926,29sleep00-21swapper/007:45:530
1509029114,60sleep115237-21cut11:20:471
1390029121,50sleep313949-21fschecks_time11:16:093
1390029121,50sleep313949-21fschecks_time11:16:093
785829013,63sleep27926-21users10:56:212
2633029014,53sleep126218-21/usr/sbin/munin08:31:061
2428929012,66sleep116098-1kworker/1:2H08:24:191
1007029023,41sleep110095-21modprobe11:05:451
270752880,10sleep20-21swapper/211:56:172
2536628818,48sleep324827-21/usr/sbin/munin11:51:183
1399328723,34sleep20-21swapper/209:35:452
3243428511,59sleep332455-21apt-get08:50:553
2377028511,52sleep223279-21/usr/sbin/munin11:46:162
2838728414,45sleep327958-21/usr/sbin/munin12:01:123
2191828416,53sleep321963-21fw_packets11:41:043
555928322,39sleep15697-21grep12:31:191
1904028312,55sleep119043-21entropy09:51:021
1904028312,55sleep119043-21entropy09:51:021
2805428111,54sleep128063-21df_inode12:01:021
262228111,54sleep32634-21kernelversion10:41:123
2056028132,30sleep120623-21swap08:11:191
1640428110,54sleep216455-21mailstats09:41:182
1640428110,54sleep216455-21mailstats09:41:182
211028013,51sleep32237-21latency_hist10:40:473
1813728021,20sleep30-21swapper/311:30:463
281827918,46sleep22327-21/usr/sbin/munin10:41:192
2466427912,50sleep324666-21/usr/sbin/munin08:25:553
3161827810,52sleep331687-21sensors12:11:173
3161827810,52sleep331687-21sensors12:11:173
2669927815,48sleep126722-21/usr/sbin/munin10:15:461
1446727816,46sleep214581-21sed07:51:292
1349927816,39sleep113581-21latency_hist11:15:461
1349927816,39sleep113581-21latency_hist11:15:461
223002778,18sleep10-21swapper/110:00:561
1607127716,27sleep30-21swapper/309:41:073
1607127716,27sleep30-21swapper/309:41:073
398827624,29sleep10-21swapper/110:46:061
1306327612,47sleep113129-21users07:46:191
3018227511,47sleep330191-21/usr/sbin/munin10:26:013
2047827523,27sleep10-21swapper/111:36:101
65627416,45sleep1756-21latency_hist10:35:491
2853627416,42sleep228662-21unixbench_multi08:36:242
2669927412,44sleep226706-21/usr/sbin/munin08:31:152
155962748,14sleep10-21swapper/107:56:081
155962748,14sleep10-21swapper/107:56:081
505827219,24sleep10-21swapper/109:06:081
390827220,29sleep30-21swapper/309:01:173
1988427211,45sleep119957-21systemd-run11:35:451
193232728,48sleep319417-21sed11:31:313
167432727,12sleep10-21swapper/108:00:491
167432727,12sleep10-21swapper/108:00:491
830327123,29sleep30-21swapper/311:00:463
2843427127,21sleep10-21swapper/108:36:231
2831127118,31sleep30-21swapper/308:36:213
2769227120,30sleep11-21systemd12:00:451
1870927118,38sleep118733-21sed09:50:461
878127023,26sleep20-21swapper/209:16:232
78272708,12sleep30-21swapper/307:26:223
409527019,25sleep20-21swapper/207:16:112
36827018,26sleep10-21swapper/107:06:041
358027022,22sleep30-21swapper/307:15:473
2928427014,36sleep129427-21grep10:21:191
2760027020,33sleep327669-21/usr/sbin/munin10:16:203
2670727016,28sleep30-21swapper/308:31:163
2327327012,15sleep30-21swapper/308:21:103
2226227012,25sleep20-21swapper/211:41:152
1873427016,22sleep20-21swapper/209:50:472
670026913,42sleep36725-21munin-run10:55:453
1266326913,16sleep20-21swapper/207:46:122
3226526813,35sleep232342-21awk10:31:172
231462687,44sleep20-21swapper/208:21:012
2061326819,26sleep10-21swapper/109:56:031
2061326819,26sleep10-21swapper/109:56:031
70326612,24sleep20-21swapper/208:51:182
612726622,26sleep30-21swapper/312:35:453
3209526612,39sleep232096-21sshd08:49:492
2221426619,25sleep10-21swapper/108:16:201
2221426619,25sleep10-21swapper/108:16:201
1577426618,30sleep115263-21/usr/sbin/munin11:21:161
608926518,21sleep30-21swapper/307:21:213
2533326512,28sleep20-21swapper/211:51:172
2172826511,40sleep321729-21sshd09:59:493
2172826511,40sleep321729-21sshd09:59:493
2029726524,25sleep20-21swapper/209:55:482
2029726524,25sleep20-21swapper/209:55:482
1893026417,23sleep10-21swapper/108:06:181
1094926424,24sleep20-21swapper/209:25:472
34432637,43sleep20-21swapper/207:15:022
3273626317,30sleep332732-21apt-get07:05:583
272526320,26sleep10-21swapper/107:11:171
2558326313,36sleep325648-21basename10:11:033
2514026311,35sleep125157-21modprobe10:10:451
1077126318,30sleep110862-21tune2fs07:41:101
1077126318,30sleep110862-21tune2fs07:41:101
805326210,38sleep18054-21sshd09:15:491
581626218,24sleep10-21swapper/110:51:111
410826211,23sleep30-21swapper/310:46:083
2971726218,28sleep129745-21/usr/sbin/munin12:06:061
1274226216,29sleep112809-21df09:31:031
98126115,28sleep21048-21timerwakeupswit07:06:302
777026114,29sleep17793-21munin-run09:15:451
3267526116,19sleep10-21swapper/112:16:001
3267526116,19sleep10-21swapper/112:16:001
3210426116,22sleep10-21swapper/112:12:451
3210426116,22sleep10-21swapper/112:12:451
1500226119,22sleep30-21swapper/309:36:223
1500226119,22sleep30-21swapper/309:36:223
1109826122,20sleep10-21swapper/111:06:211
107942617,11sleep10-21swapper/109:24:251
705626015,28sleep37125-21sensors_temp09:11:273
667626023,22sleep10-21swapper/107:25:471
557126017,22sleep30-21swapper/309:06:223
33042605,43sleep10-21swapper/110:41:501
174826013,18sleep30-21swapper/312:20:553
174826013,18sleep30-21swapper/312:20:553
152782607,10sleep20-21swapper/209:36:582
152782607,10sleep20-21swapper/209:36:582
1451126014,12sleep10-21swapper/109:36:081
1451126014,12sleep10-21swapper/109:36:081
3021125913,27sleep20-21swapper/212:06:202
2187025912,11sleep30-21swapper/308:16:103
2187025912,11sleep30-21swapper/308:16:103
163682596,41sleep30-21swapper/307:57:323
163682596,41sleep30-21swapper/307:57:323
157322598,36sleep215743-21ntp_states11:21:122
1009625915,25sleep210121-21munin-run11:05:462
3234525818,24sleep20-21swapper/212:15:452
3234525818,24sleep20-21swapper/212:15:452
311392586,10sleep10-21swapper/110:27:451
2982625814,27sleep329848-21/usr/sbin/munin08:41:143
18502586,11sleep10-21swapper/110:38:031
1565325812,13sleep30-21swapper/311:21:093
1063525817,19sleep20-21swapper/211:06:102
534025714,26sleep25342-21/usr/sbin/munin07:20:552
1012225718,22sleep310200-21latency_hist11:05:473
703625613,24sleep27122-21fw_packets07:26:042
495725613,30sleep24986-21grep12:31:042
376025614,20sleep10-21swapper/109:01:111
1038525618,18sleep10-21swapper/107:40:451
910625515,24sleep39120-21apt-get07:35:553
86062557,16sleep30-21swapper/307:33:083
605725514,19sleep20-21swapper/210:51:202
353225514,25sleep23572-21if_eth012:26:072
353225514,25sleep23572-21if_eth012:26:072
3112325513,19sleep10-21swapper/108:46:041
2702025511,18sleep20-21swapper/210:16:032
2642725517,25sleep326420-21apt-get11:55:593
2552225521,20sleep20-21swapper/210:11:022
2463925514,18sleep10-21swapper/111:50:481
2463325514,24sleep224726-21awk10:06:222
239225517,17sleep10-21swapper/112:21:171
239225517,17sleep10-21swapper/112:21:171
2151425516,20sleep20-21swapper/211:40:472
1740925513,25sleep317404-21apt-get09:46:003
1684225516,24sleep116909-21df11:26:001
153425513,18sleep30-21swapper/312:20:473
153425513,18sleep30-21swapper/312:20:473
85152545,14sleep10-21swapper/107:31:571
2938325419,17sleep20-21swapper/208:41:002
2701925412,26sleep127012-21apt-get10:16:021
2479225417,15sleep10-21swapper/108:26:051
1843925418,21sleep20-21swapper/208:05:592
1732425419,21sleep20-21swapper/208:01:142
1732425419,21sleep20-21swapper/208:01:142
1515225415,17sleep10-21swapper/107:55:481
1383525414,25sleep213898-21grep11:16:082
1383525414,25sleep213898-21grep11:16:082
1068125413,25sleep310676-21apt-get07:41:043
1068125413,25sleep310676-21apt-get07:41:043
3170025311,16sleep10-21swapper/107:01:241
3170025311,16sleep10-21swapper/107:01:241
1873825316,17sleep30-21swapper/308:06:123
1249825316,16sleep10-21swapper/109:30:471
1225125313,25sleep212264-21df_inode11:11:272
1225125313,25sleep212264-21df_inode11:11:272
880825215,21sleep28874-21modprobe07:35:462
49132525,37sleep10-21swapper/107:18:401
3056825216,21sleep230574-21ntp_states10:26:132
2042525217,16sleep30-21swapper/311:36:083
2010225218,15sleep20-21swapper/208:11:082
3100325112,15sleep30-21swapper/308:46:023
2485325114,17sleep10-21swapper/111:51:001
2472725113,23sleep323857-21/usr/sbin/munin10:06:233
2229725111,24sleep321816-21apt-get10:00:543
1825825118,16sleep30-21swapper/308:05:473
1704725117,16sleep20-21swapper/211:26:052
1127525118,19sleep20-21swapper/209:26:042
1371725013,15sleep10-21swapper/111:15:581
126802509,16sleep30-21swapper/307:46:133
656224911,23sleep26586-21df09:11:052
1661324912,16sleep10-21swapper/109:41:211
1661324912,16sleep10-21swapper/109:41:211
152324914,18sleep20-21swapper/212:20:462
152324914,18sleep20-21swapper/212:20:462
145822499,15sleep30-21swapper/307:51:303
825524813,18sleep10-21swapper/107:30:481
426524817,15sleep20-21swapper/210:46:112
1698424811,20sleep316990-21df_inode08:01:033
2864624611,17sleep20-21swapper/210:21:042
1198524616,17sleep20-21swapper/207:45:472
1198524616,17sleep20-21swapper/207:45:472
128172449,18sleep30-21swapper/309:31:053
6302418,17sleep10-21swapper/108:51:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional