You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-28 - 16:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-8145UE @2200 MHz, Linux 5.10.27-rt36 (Profile)

Latency plot of shadow in rack #e, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Sun May 28, 2023 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25017992920,4cyclictest18694-21diskmemload12:11:240
25017992820,4cyclictest18694-21diskmemload09:14:280
2501799280,2cyclictest7188-21ssh09:30:420
25017992721,5cyclictest0-21swapper/010:37:490
2501799270,2cyclictest8783-21ssh11:39:210
2501799270,21cyclictest0-21swapper/010:52:520
25031992620,5cyclictest12694-21apt-get10:40:003
2503199260,26cyclictest0-21swapper/311:30:413
2503199260,23cyclictest18694-21diskmemload12:21:473
2503199260,1cyclictest0-21swapper/309:36:363
2503199260,0cyclictest0-21swapper/311:59:453
2502599260,25cyclictest0-21swapper/209:59:522
25017992623,3cyclictest0-21swapper/011:47:420
25017992620,5cyclictest18694-21diskmemload12:26:180
2501799260,25cyclictest30677-21ssh09:53:090
2501799260,25cyclictest11897-21ssh11:10:360
25031992523,2cyclictest18694-21diskmemload09:15:333
25031992523,2cyclictest0-21swapper/310:28:463
25031992523,1cyclictest0-21swapper/311:39:453
25031992522,2cyclictest0-21swapper/310:02:213
25031992520,4cyclictest8547-21apt-get09:32:543
2503199250,24cyclictest22426-21ssh11:21:183
2503199250,22cyclictest11028-21ssh11:42:363
2503199250,1cyclictest18694-21diskmemload09:21:593
2503199250,1cyclictest18694-21diskmemload09:21:593
2503199250,1cyclictest0-21swapper/311:54:023
2502599250,24cyclictest911-21ssh12:35:492
2502599250,24cyclictest597-21dbus-daemon12:35:012
2502599250,24cyclictest11237-21apt-get11:42:542
2502599250,1cyclictest0-21swapper/212:18:212
2502199250,24cyclictest31355-21apt-get12:02:521
2502199250,24cyclictest18694-21diskmemload09:18:081
2502199250,24cyclictest10646-21ssh09:33:301
25017992522,3cyclictest0-21swapper/011:30:410
25017992522,3cyclictest0-21swapper/009:24:380
25017992522,3cyclictest0-21swapper/009:24:380
25017992521,4cyclictest18694-21diskmemload11:59:450
25017992520,5cyclictest0-21swapper/010:19:040
25017992520,4cyclictest30513-21ssh10:25:300
25017992519,5cyclictest30141-21ssh12:00:530
2501799250,25cyclictest0-21swapper/011:50:060
2501799250,24cyclictest0-21swapper/012:21:310
2501799250,24cyclictest0-21swapper/012:05:290
2501799250,21cyclictest0-21swapper/010:30:380
2501799250,1cyclictest4233-21rm12:38:240
2501799250,0cyclictest6312-21ssh10:02:020
2501799250,0cyclictest0-21swapper/011:03:280
25031992423,1cyclictest0-21swapper/311:08:543
25031992421,3cyclictest17571-21apt-get08:02:473
25031992421,3cyclictest0-21swapper/310:49:223
25031992421,2cyclictest18694-21diskmemload09:58:003
25031992420,4cyclictest18694-21diskmemload10:11:203
25031992420,3cyclictest0-21swapper/312:17:493
25031992420,3cyclictest0-21swapper/309:42:393
2503199240,24cyclictest0-21swapper/309:50:403
2503199240,23cyclictest22887-21ssh09:13:553
2503199240,23cyclictest0-21swapper/310:20:543
2503199240,23cyclictest0-21swapper/309:48:183
2503199240,20cyclictest0-21swapper/307:42:503
2503199240,1cyclictest17706-21ssh11:16:533
2503199240,0cyclictest0-21swapper/312:00:533
2503199240,0cyclictest0-21swapper/311:26:393
2503199240,0cyclictest0-21swapper/310:57:103
2503199240,0cyclictest0-21swapper/310:19:043
2503199240,0cyclictest0-21swapper/310:05:153
2502599240,24cyclictest0-21swapper/211:32:112
2502599240,23cyclictest0-21swapper/209:44:432
2502599240,0cyclictest18694-21diskmemload10:09:512
25021992422,1cyclictest0-21swapper/112:19:551
25021992422,1cyclictest0-21swapper/110:02:541
25021992422,1cyclictest0-21swapper/108:00:011
2502199240,2cyclictest8242-21ssh10:35:351
2502199240,24cyclictest0-21swapper/111:30:431
2502199240,23cyclictest23579-21tr11:22:531
2502199240,23cyclictest20052-21apt-get10:47:511
2502199240,23cyclictest18694-21diskmemload12:36:121
2502199240,0cyclictest0-21swapper/110:30:491
2502199240,0cyclictest0-21swapper/110:07:411
25017992424,0cyclictest18694-21diskmemload11:26:410
25017992423,1cyclictest18694-21diskmemload09:41:210
25017992421,2cyclictest27802-21ssh12:30:030
25017992415,5cyclictest18694-21diskmemload10:57:470
2501799240,24cyclictest0-21swapper/011:17:540
2501799240,23cyclictest0-21swapper/010:47:470
2501799240,23cyclictest0-21swapper/010:21:180
2501799240,21cyclictest18694-21diskmemload12:15:450
2501799240,21cyclictest0-21swapper/009:46:380
2501799240,20cyclictest0-21swapper/010:06:350
2501799240,0cyclictest18694-21diskmemload11:40:230
2501799240,0cyclictest0-21swapper/011:23:540
25031992321,1cyclictest21650irq/138-nvme0q410:45:003
25031992320,3cyclictest0-21swapper/312:05:533
2503199230,22cyclictest18694-21diskmemload12:35:473
2503199230,22cyclictest0-21swapper/309:25:263
2503199230,0cyclictest18694-21diskmemload12:25:093
2503199230,0cyclictest18694-21diskmemload11:02:463
2503199230,0cyclictest18694-21diskmemload10:31:033
2503199230,0cyclictest0-21swapper/312:33:383
2503199230,0cyclictest0-21swapper/310:50:323
2503199230,0cyclictest0-21swapper/308:42:503
25025992323,0cyclictest0-21swapper/212:22:112
25025992323,0cyclictest0-21swapper/212:01:082
25025992323,0cyclictest0-21swapper/211:12:412
25025992323,0cyclictest0-21swapper/211:05:342
25025992321,1cyclictest18694-21diskmemload10:40:012
25025992321,1cyclictest0-21swapper/210:12:022
25025992321,1cyclictest0-21swapper/208:22:512
2502599230,2cyclictest22885-21sh12:25:162
2502599230,23cyclictest18694-21diskmemload09:20:032
2502599230,23cyclictest18694-21diskmemload09:20:032
2502599230,23cyclictest0-21swapper/212:10:302
2502599230,23cyclictest0-21swapper/212:05:372
2502599230,23cyclictest0-21swapper/211:59:572
2502599230,23cyclictest0-21swapper/211:54:192
2502599230,23cyclictest0-21swapper/210:32:372
2502599230,22cyclictest20848-21sh10:16:092
2502599230,22cyclictest19308-21ssh10:46:392
2502599230,22cyclictest0-21swapper/210:28:512
2502599230,22cyclictest0-21swapper/209:52:262
2502599230,22cyclictest0-21swapper/209:30:572
2502599230,1cyclictest0-21swapper/209:25:582
2502599230,0cyclictest0-21swapper/211:28:172
2502599230,0cyclictest0-21swapper/211:22:402
2502599230,0cyclictest0-21swapper/211:18:332
2502599230,0cyclictest0-21swapper/210:01:162
2502599230,0cyclictest0-21swapper/209:17:272
2502599230,0cyclictest0-21swapper/209:10:122
25021992323,0cyclictest18694-21diskmemload12:25:371
25021992323,0cyclictest0-21swapper/111:41:241
25021992323,0cyclictest0-21swapper/110:26:541
25021992323,0cyclictest0-21swapper/110:21:301
25021992323,0cyclictest0-21swapper/109:35:401
25021992322,1cyclictest0-21swapper/112:32:531
25021992321,1cyclictest18694-21diskmemload09:48:051
25021992321,1cyclictest18694-21diskmemload09:10:221
25021992321,1cyclictest12429-21cron12:15:001
25021992321,1cyclictest0-21swapper/111:11:091
25021992321,1cyclictest0-21swapper/109:43:101
25021992320,2cyclictest27093-21ssh09:50:101
2502199230,23cyclictest0-21swapper/111:51:211
2502199230,23cyclictest0-21swapper/111:15:091
2502199230,23cyclictest0-21swapper/111:05:071
2502199230,23cyclictest0-21swapper/110:44:511
2502199230,22cyclictest4924-21sh11:35:591
2502199230,22cyclictest26684-21ls08:20:001
2502199230,22cyclictest20229-21ssh10:15:081
2502199230,22cyclictest18694-21diskmemload12:05:021
2502199230,22cyclictest16067-21seq10:11:331
2502199230,22cyclictest0-21swapper/112:22:511
2502199230,22cyclictest0-21swapper/111:25:581
2502199230,0cyclictest18694-21diskmemload11:46:511
2502199230,0cyclictest0-21swapper/111:03:311
2502199230,0cyclictest0-21swapper/110:50:151
2502199230,0cyclictest0-21swapper/109:25:401
25017992322,1cyclictest4399-21apt-get08:42:500
25017992321,2cyclictest0-21swapper/009:36:360
25017992321,2cyclictest0-21swapper/009:27:400
25017992321,2cyclictest0-21swapper/009:15:330
25017992321,1cyclictest16045-21sh10:11:300
25017992320,3cyclictest0-21swapper/010:41:450
25017992319,4cyclictest0-21swapper/007:42:500
2501799230,22cyclictest32700-21ssh09:55:310
25031992221,1cyclictest18694-21diskmemload11:45:153
25031992220,1cyclictest31999-21apt-get08:32:503
2503199220,21cyclictest31518-21turbostat08:30:003
2503199220,21cyclictest27381-21awk07:15:013
2503199220,21cyclictest19968-21apt-get08:07:473
2503199220,21cyclictest0-21swapper/308:52:503
2503199220,1cyclictest11646-21apt-get08:57:543
25025992222,0cyclictest0-21swapper/210:37:092
25025992222,0cyclictest0-21swapper/210:21:522
25025992220,1cyclictest18694-21diskmemload09:37:572
25025992220,1cyclictest14060-21apt-get09:02:532
25025992220,1cyclictest0-21swapper/211:35:222
2502599220,22cyclictest0-21swapper/209:48:162
2502599220,21cyclictest18694-21diskmemload10:56:112
2502599220,21cyclictest0-21swapper/211:45:032
2502599220,21cyclictest0-21swapper/208:32:492
2502599220,21cyclictest0-21swapper/208:00:022
2502599220,1cyclictest0-21swapper/210:50:102
2502199220,21cyclictest18694-21diskmemload10:55:311
2502199220,21cyclictest0-21swapper/108:02:471
2502199220,21cyclictest0-21swapper/107:37:481
2502199220,1cyclictest0-21swapper/111:57:451
25017992219,2cyclictest31521-21perf08:30:000
2503199210,20cyclictest2655-21apt-get07:32:493
2503199210,20cyclictest0-21swapper/307:37:483
25025992120,1cyclictest30268-21apt-get07:22:442
25025992120,1cyclictest16791-21apt-get09:07:482
25021992119,1cyclictest31498-21cron08:30:001
25021992119,1cyclictest1981-21apt-get08:37:491
25021992119,1cyclictest1981-21apt-get08:37:491
2502199210,21cyclictest14355-21perf07:55:011
2502199210,20cyclictest0-21swapper/108:22:511
25017992121,0cyclictest0-21swapper/009:07:490
25017992120,1cyclictest27844-21apt-get07:17:470
25017992119,1cyclictest597-21dbus-daemon07:55:010
25017992119,1cyclictest27379-21perf07:15:010
25017992119,1cyclictest0-21swapper/007:37:480
2501799210,1cyclictest0-21swapper/008:40:010
2501799210,1cyclictest0-21swapper/008:40:010
25031992019,0cyclictest0-21swapper/308:47:563
2503199200,0cyclictest0-21swapper/308:17:513
25025992018,1cyclictest0-21swapper/207:40:002
2502599200,0cyclictest0-21swapper/208:37:492
2502599200,0cyclictest0-21swapper/208:37:492
2502599200,0cyclictest0-21swapper/207:17:462
25021992020,0cyclictest0-21swapper/109:07:491
25021992020,0cyclictest0-21swapper/109:02:531
25021992018,1cyclictest0-21swapper/108:52:511
2502199200,0cyclictest0-21swapper/107:17:461
25017992020,0cyclictest0-21swapper/008:57:540
25017992020,0cyclictest0-21swapper/008:17:510
25017992019,0cyclictest9244-21apt-get08:52:500
25017992018,2cyclictest0-21swapper/008:02:470
25017992018,1cyclictest24281-21latency_hist08:15:000
2501799200,15cyclictest10019-21apt-get07:47:470
25031991919,0cyclictest1981-21apt-get08:37:493
25031991919,0cyclictest1981-21apt-get08:37:493
25031991918,1cyclictest0-21swapper/309:07:483
25031991912,2cyclictest16739-21sh08:00:013
25025991919,0cyclictest0-21swapper/208:27:512
25025991919,0cyclictest0-21swapper/208:07:472
25017991919,0cyclictest0-21swapper/008:07:470
25031991818,0cyclictest0-21swapper/308:12:493
25031991818,0cyclictest0-21swapper/307:17:463
25025991818,0cyclictest0-21swapper/208:42:502
25025991818,0cyclictest0-21swapper/207:27:502
25021991818,0cyclictest6854-21apt-get08:47:561
25021991818,0cyclictest0-21swapper/108:42:501
25021991818,0cyclictest0-21swapper/107:27:501
25017991818,0cyclictest0-21swapper/007:32:490
2501799180,0cyclictest0-21swapper/008:47:560
25025991714,2cyclictest597-21dbus-daemon08:50:012
25021991717,0cyclictest0-21swapper/107:12:511
2501799179,7cyclictest16740-21sendmail08:00:010
25017991717,0cyclictest0-21swapper/008:32:500
25031991616,0cyclictest0-21swapper/307:22:443
25031991614,1cyclictest29172-21cat08:25:003
2503199160,14cyclictest0-21swapper/307:47:483
25025991616,0cyclictest0-21swapper/207:52:552
25025991616,0cyclictest0-21swapper/207:32:492
25025991614,2cyclictest16781-21http08:00:012
2502599160,15cyclictest0-21swapper/207:12:512
25021991616,0cyclictest0-21swapper/108:12:481
25025991515,0cyclictest0-21swapper/208:52:502
25021991515,0cyclictest0-21swapper/107:22:441
25021991514,1cyclictest0-21swapper/107:42:501
25021991513,1cyclictest4576-21latency_hist07:35:001
25017991514,1cyclictest0-21swapper/009:03:240
25017991514,1cyclictest0-21swapper/007:21:210
2501799150,15cyclictest0-21swapper/007:25:470
2503199140,0cyclictest0-21swapper/309:00:283
2503199140,0cyclictest0-21swapper/307:25:093
2502599140,14cyclictest0-21swapper/208:55:592
2502599140,14cyclictest0-21swapper/208:17:042
2502599140,14cyclictest0-21swapper/207:40:332
2502599140,0cyclictest0-21swapper/208:10:012
2502199140,14cyclictest0-21swapper/108:05:081
2502199140,0cyclictest0-21swapper/108:55:211
25017991414,0cyclictest0-21swapper/008:20:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional