You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 02:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2s.osadl.org (updated Fri Aug 12, 2022 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2839799137135,1cyclictest0-21swapper/207:19:002
993321190,3sleep012-21ksoftirqd/011:09:470
1161321140,1sleep20-21swapper/211:40:552
373321120,1sleep10-21swapper/107:30:411
2330621080,0sleep00-21swapper/011:51:560
3189421060,0sleep10-21swapper/108:30:411
161121010,1sleep10-21swapper/112:30:571
28103210058,31sleep20-21swapper/207:15:112
28396999789,7cyclictest0-21swapper/107:19:001
2799729249,32sleep00-21swapper/007:13:490
2795029149,31sleep10-21swapper/107:13:141
2780829048,31sleep30-21swapper/307:11:233
28395996563,1cyclictest0-21swapper/007:19:000
28398995856,1cyclictest0-21swapper/307:15:283
116982410,1chrt11696-21ntp_states08:55:493
236802330,0sleep20-21swapper/212:21:282
243962270,0sleep30-21swapper/311:53:273
302832250,0sleep20-21swapper/211:58:592
2839599240,22cyclictest3638-21taskset07:30:400
2839599231,21cyclictest0-21swapper/011:15:460
2839599201,17cyclictest0-21swapper/008:20:510
2839899190,18cyclictest0-21swapper/310:10:443
28396991914,3cyclictest9779-21seq11:40:291
2839699190,18cyclictest0-21swapper/107:25:451
73992180,0sleep20-21swapper/211:37:272
28398991815,2cyclictest41650irq/33-enp3s0-r11:25:413
2839899176,6cyclictest10370-21diskstats11:40:453
28397991612,2cyclictest10391-21ssh12:10:462
2839699164,9cyclictest6590-21ssh10:35:381
2839799154,6cyclictest11470-21if_enp5s007:45:442
2839799151,2cyclictest19315-21ssh09:45:422
28396991510,3cyclictest5105-21ls11:05:281
2839899140,4cyclictest27471-21rm10:23:543
2839799144,5cyclictest0-21swapper/210:39:322
2839699144,5cyclictest0-21swapper/108:25:451
2839699144,5cyclictest0-21swapper/108:04:211
2839599147,6cyclictest0-21swapper/012:25:040
2839599147,6cyclictest0-21swapper/010:19:440
2839599145,8cyclictest0-21swapper/009:52:460
2839599144,5cyclictest0-21swapper/008:55:450
2839599140,9cyclictest3901-21ssh10:31:520
2839899136,5cyclictest17031-21ntpq12:15:523
2839899136,1cyclictest34-21ksoftirqd/311:31:203
2839899135,3cyclictest0-21swapper/311:38:573
2839899134,4cyclictest14128-21ssh10:41:383
2839899133,8cyclictest0-21swapper/312:38:263
2839799136,5cyclictest25609-21gdbus07:25:562
2839799135,4cyclictest20880-21ssh10:16:432
2839799134,4cyclictest27271-21ssh10:23:372
2839799131,7cyclictest0-21swapper/208:25:452
2839699135,6cyclictest3153-21cat09:30:281
2839699135,3cyclictest0-21swapper/110:05:461
2839699134,4cyclictest2708-21ssh12:03:041
2839699133,5cyclictest0-21swapper/111:28:061
2839699133,5cyclictest0-21swapper/109:17:021
2839599133,5cyclictest20355-21ssh12:19:410
2839599133,5cyclictest0-21swapper/011:27:030
2839599133,5cyclictest0-21swapper/010:45:450
2839599131,9cyclictest9175-21diskstats09:35:510
2839599131,5cyclictest20375-21idleruntime-cro11:50:270
2839599130,11cyclictest11940-21cut10:40:420
2839899127,3cyclictest3656-21grep09:30:443
2839899127,3cyclictest3656-21grep09:30:443
2839899127,3cyclictest12763-21sh07:50:273
2839899126,4cyclictest21602-21ls10:50:273
2839899126,4cyclictest15589-21tr07:55:403
2839899126,4cyclictest15589-21tr07:55:403
2839899125,5cyclictest0-21swapper/311:23:243
2839899124,6cyclictest0-21swapper/310:55:383
2839899124,3cyclictest0-21swapper/312:10:463
2839899124,3cyclictest0-21swapper/309:27:273
2839899124,3cyclictest0-21swapper/308:31:493
2839899124,3cyclictest0-21swapper/308:23:513
2839899124,2cyclictest0-21swapper/310:00:163
2839899123,4cyclictest0-21swapper/312:44:263
2839899123,4cyclictest0-21swapper/308:04:393
2839899122,5cyclictest0-21swapper/309:50:463
2839899121,9cyclictest32500-21gltestperf12:00:523
2839899121,8cyclictest75-21kswapd010:05:453
2839799129,2cyclictest0-21swapper/211:05:522
2839799128,2cyclictest7734-21unixbench_singl07:35:542
2839799128,2cyclictest20925-21ls12:20:272
2839799126,4cyclictest1427-21tr08:35:402
2839799125,5cyclictest28902-21unixbench_multi10:55:532
2839799124,6cyclictest0-21swapper/211:30:272
2839799124,6cyclictest0-21swapper/209:58:122
2839799124,3cyclictest0-21swapper/210:06:402
2839799124,3cyclictest0-21swapper/208:23:062
2839799124,2cyclictest0-21swapper/212:41:262
2839799124,2cyclictest0-21swapper/211:12:052
2839799124,2cyclictest0-21swapper/209:37:132
2839699125,5cyclictest28765-21awk12:25:531
2839699125,5cyclictest22701-21cat10:50:461
2839699125,5cyclictest22701-21cat10:50:461
2839699124,6cyclictest17063-21ssh11:45:551
2839699124,4cyclictest30448-21ssh11:59:131
2839699123,4cyclictest0-21swapper/108:48:521
2839699122,6cyclictest25601-21ssh10:21:041
2839699122,5cyclictest0-21swapper/110:30:461
2839699122,5cyclictest0-21swapper/109:03:441
2839699121,6cyclictest6025-21ntp_states12:05:521
2839699120,10cyclictest31759-21ssh11:30:411
2839599127,3cyclictest18785-21sendmail_mailqu09:10:530
2839599125,5cyclictest30723-21kworker/0:109:40:480
2839599125,5cyclictest0-21swapper/012:43:530
2839599125,5cyclictest0-21swapper/012:02:160
2839599124,7cyclictest0-21swapper/011:00:420
2839599124,7cyclictest0-21swapper/009:56:480
2839599124,3cyclictest0-21swapper/008:13:570
2839599123,8cyclictest0-21swapper/007:55:240
2839599121,6cyclictest0-21swapper/008:36:550
2839599121,5cyclictest2354-21ssh11:32:440
2839599120,4cyclictest5734-21dump-pmu-power08:45:270
2839599120,2cyclictest0-21swapper/011:25:050
2839599120,11cyclictest0-21swapper/008:15:440
120702120,1sleep20-21swapper/208:55:522
36222110,1sleep30-21swapper/311:03:163
2839899117,3cyclictest0-21swapper/308:06:573
2839899117,2cyclictest3309-21ssh10:00:473
2839899116,3cyclictest30183-21missed_timers08:25:483
2839899116,3cyclictest30059-21tr10:25:523
2839899116,3cyclictest26562-21sendmail12:25:283
2839899115,4cyclictest9871-21tr09:36:003
2839899115,4cyclictest3725-21tr07:30:413
2839899115,4cyclictest28745-21grep12:25:533
2839899115,4cyclictest22654-21sh09:17:113
2839899115,4cyclictest13484-21head09:00:433
2839899115,3cyclictest0-21swapper/312:10:043
2839899115,3cyclictest0-21swapper/307:43:413
2839899115,1cyclictest0-21swapper/310:51:353
2839899115,1cyclictest0-21swapper/310:51:353
2839899114,6cyclictest0-21swapper/311:17:573
2839899114,5cyclictest2172-21cat08:35:453
2839899113,3cyclictest0-21swapper/311:48:133
2839899113,3cyclictest0-21swapper/308:50:133
2839899112,4cyclictest0-21swapper/307:21:373
2839899111,9cyclictest0-21swapper/311:57:043
2839899111,8cyclictest13913-21sh09:40:313
2839899111,3cyclictest1609-21ssh10:30:433
2839799117,2cyclictest4338-21grep10:00:562
2839799116,3cyclictest15599-21timerandwakeup09:40:552
2839799115,4cyclictest25808-21find08:15:492
2839799115,4cyclictest22285-21wc10:50:432
2839799115,4cyclictest22285-21wc10:50:432
2839799115,4cyclictest16833-21date11:45:532
2839799114,5cyclictest13950-21hddtemp_smartct10:10:482
2839799114,5cyclictest0-21swapper/211:20:442
2839799114,2cyclictest0-21swapper/212:26:532
2839799113,6cyclictest4129-21in:imuxsock07:44:202
2839799113,6cyclictest0-21swapper/212:36:212
2839799113,3cyclictest0-21swapper/208:00:452
2839799113,2cyclictest0-21swapper/212:01:092
2839799111,8cyclictest12957-21sed10:40:482
2839799111,8cyclictest0-21swapper/209:30:442
2839799111,8cyclictest0-21swapper/209:30:442
2839799111,5cyclictest26567-21rm09:51:132
2839799111,5cyclictest0-21swapper/207:53:472
2839799111,4cyclictest21540-21timerandwakeup09:15:542
2839799110,5cyclictest1425-21which12:30:562
2839699116,3cyclictest1844-21uniq08:35:431
2839699115,5cyclictest0-21swapper/112:43:201
2839699115,5cyclictest0-21swapper/111:53:581
2839699115,5cyclictest0-21swapper/110:17:311
2839699115,4cyclictest6147-21if_eno112:35:491
2839699115,4cyclictest19605-21awk09:15:271
2839699115,4cyclictest0-21swapper/107:43:321
2839699115,3cyclictest0-21swapper/109:37:241
2839699114,5cyclictest0-21swapper/110:29:071
2839699114,4cyclictest0-21swapper/111:37:271
2839699113,7cyclictest0-21swapper/108:17:451
2839699113,6cyclictest14613-21ssh12:14:191
2839699112,8cyclictest0-21swapper/107:37:051
2839699110,5cyclictest21999-21latency_hist08:10:281
2839599117,2cyclictest8392-21apt07:40:380
2839599116,4cyclictest0-21swapper/008:50:420
2839599116,3cyclictest32104-21sed08:30:430
2839599115,4cyclictest24820-21ntpq10:20:490
2839599115,4cyclictest14686-21ssh12:14:260
2839599115,4cyclictest0-21swapper/009:18:320
2839599115,4cyclictest0-21swapper/007:46:080
2839599114,5cyclictest1795-21fschecks_count07:25:480
2839599114,5cyclictest1075-21pluginstate07:25:270
2839599114,5cyclictest0-21swapper/010:13:310
2839599113,5cyclictest0-21swapper/010:57:230
2839599113,4cyclictest0-21swapper/009:06:260
2839599112,8cyclictest0-21swapper/008:04:000
2839599111,8cyclictest26894-21grep11:55:440
2839599111,5cyclictest0-21swapper/012:35:490
2839599111,1cyclictest19588-21diskmemload11:42:540
2839599110,7cyclictest1814-21grep12:30:580
2839899106,3cyclictest34-21ksoftirqd/312:30:483
2839899106,2cyclictest19588-21diskmemload09:45:333
2839899105,3cyclictest2369-21needreboot07:25:533
2839899104,4cyclictest8326-21tr08:50:393
2839899104,4cyclictest7346-21which10:35:473
2839899104,4cyclictest19861-21processes10:15:533
2839899104,4cyclictest11817-21sh11:10:483
2839899104,4cyclictest0-21swapper/308:11:273
2839899103,5cyclictest708-21ntpd11:05:573
2839899101,4cyclictest0-21swapper/309:06:023
2839899101,3cyclictest17951-21df09:10:423
2839899100,8cyclictest25304-21cut09:20:483
2839899100,4cyclictest25851-21systemctl08:15:493
2839799105,4cyclictest5086-21cut12:05:452
2839799105,3cyclictest0-21swapper/210:25:462
2839799105,3cyclictest0-21swapper/208:45:522
2839799104,4cyclictest653-21entropy11:00:412
2839799104,4cyclictest3754-21snmpd09:11:022
2839799104,4cyclictest31325-21idleruntime09:25:522
2839799104,4cyclictest25680-21expr09:20:532
2839799104,4cyclictest21073-21grep11:50:482
2839799104,4cyclictest1987-21cut10:30:462
2839799104,4cyclictest17351-21df10:45:422
2839799104,4cyclictest0-21swapper/208:53:042
2839799104,4cyclictest0-21swapper/208:41:432
2839799101,7cyclictest0-21swapper/211:30:492
2839799101,5cyclictest0-21swapper/211:16:242
2839799100,9cyclictest0-21swapper/208:10:222
2839699108,1cyclictest0-21swapper/110:00:441
2839699107,2cyclictest4116-21hddtemp_smartct09:30:471
2839699107,2cyclictest4116-21hddtemp_smartct09:30:471
2839699106,3cyclictest25892-21sh11:25:091
2839699106,2cyclictest8203-21sh11:07:121
2839699105,4cyclictest0-21swapper/112:23:081
2839699105,4cyclictest0-21swapper/112:16:191
2839699105,4cyclictest0-21swapper/109:08:411
2839699105,4cyclictest0-21swapper/108:00:211
2839699105,4cyclictest0-21swapper/108:00:211
2839699105,4cyclictest0-21swapper/107:54:391
2839699105,4cyclictest0-21swapper/107:23:011
2839699105,3cyclictest30784-21sh09:55:551
2839699105,3cyclictest27775-21ssh10:55:441
2839699105,3cyclictest0-21swapper/109:21:141
2839699104,4cyclictest4480-21cat08:40:461
2839699104,4cyclictest27428-21grep08:20:441
2839699104,4cyclictest22293-21aten2_r8power_e08:10:411
2839699104,4cyclictest22065-21sh09:47:211
2839699104,4cyclictest19717-21sh10:47:321
2839699104,4cyclictest15467-21mailstats09:40:531
2839699104,4cyclictest0-21swapper/110:11:131
2839699103,6cyclictest13480-21cat10:40:531
2839699102,3cyclictest0-21swapper/107:45:441
2839699100,4cyclictest26330-21grep09:50:541
2839599107,2cyclictest30773-21cpuspeed_turbos09:25:470
2839599107,2cyclictest27457-21fschecks_count12:25:430
2839599106,2cyclictest7928-21sh11:38:140
2839599105,4cyclictest11332-21tune2fs11:10:450
2839599105,4cyclictest0-21swapper/008:49:400
2839599105,4cyclictest0-21swapper/008:10:180
2839599105,3cyclictest25519-21tr09:20:520
2839599104,5cyclictest0-21swapper/010:52:110
2839599104,5cyclictest0-21swapper/010:52:110
2839599104,5cyclictest0-21swapper/010:10:070
2839599104,5cyclictest0-21swapper/008:25:440
2839599104,4cyclictest7003-21cat10:35:450
2839599104,4cyclictest6212-21aten2_r8power_v07:35:430
2839599104,4cyclictest31698-21sh10:27:200
2839599104,4cyclictest19945-21grep09:45:460
2839599104,4cyclictest13335-21entropy09:00:420
2839599103,4cyclictest0-21swapper/007:59:030
2839599103,4cyclictest0-21swapper/007:59:030
2839599103,1cyclictest0-21swapper/010:03:280
2839599101,3cyclictest0-21swapper/009:30:440
2839599101,3cyclictest0-21swapper/009:30:440
283989996,2cyclictest4112-21forks08:40:433
283989995,2cyclictest7385-21mailstats07:35:523
283989993,4cyclictest3754-21snmpd07:54:353
283979997,1cyclictest0-21swapper/209:00:422
283979996,2cyclictest15298-21/usr/sbin/munin07:55:382
283979996,2cyclictest15298-21/usr/sbin/munin07:55:382
283979994,3cyclictest31321-21cpuspeed_turbos07:20:292
283979993,4cyclictest3754-21snmpd08:30:402
283979993,4cyclictest229-21systemd-journal09:05:392
283979991,7cyclictest0-21swapper/208:10:452
283979991,6cyclictest4704-21ntp_kernel_err07:30:482
283969995,2cyclictest11482-21head11:10:451
283969994,3cyclictest16134-21basename11:15:471
283969993,4cyclictest11421-21if_err_enp5s008:55:451
283969991,4cyclictest8274-21/usr/sbin/munin08:50:381
283959994,3cyclictest4891-21cut12:05:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional