You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-04-21 - 01:38

Intel(R) Core(TM) i5-6440EQ CPU @ 2.70GHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #5, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack5slot2.osadl.org (updated Tue Apr 20, 2021 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
170962221204,12sleep30-21swapper/307:05:263
171412198183,11sleep10-21swapper/107:06:001
173462185169,11sleep00-21swapper/007:08:400
173382176160,11sleep20-21swapper/207:08:332
299732480,0sleep20-21swapper/212:21:132
67972450,0sleep06801-21pmu-power10:00:220
191172450,0sleep10-21swapper/111:02:141
12342150,0sleep10-21swapper/111:46:521
1761399102,4cyclictest2767-21sh12:25:000
176139970,6cyclictest21936-21irqstats07:15:170
32030260,0sleep00-21swapper/008:40:180
176249960,5cyclictest18582-21sed12:15:142
176179960,1cyclictest0-21swapper/108:15:111
176139962,4cyclictest54750irq/130-eth009:26:170
176139960,6cyclictest0-21swapper/012:28:160
176139960,6cyclictest0-21swapper/010:29:410
176139960,6cyclictest0-21swapper/010:17:430
176139960,5cyclictest693-21diskstats12:05:190
176139960,5cyclictest29749-21irqstats09:55:150
176139960,5cyclictest237232sleep010:46:230
176139960,5cyclictest14230-21memory08:05:270
176139960,5cyclictest13676-21df_inode09:10:130
176139960,5cyclictest0-21swapper/012:12:090
176139960,5cyclictest0-21swapper/011:10:010
176139960,3cyclictest14363-21perf11:55:000
176139960,1cyclictest4293-21netstat08:50:180
176139960,1cyclictest1139-21df08:45:120
29260250,1sleep1211ktimersoftd/111:25:511
26792250,0sleep10-21swapper/110:30:231
176299951,2cyclictest0-21swapper/310:00:113
176299951,2cyclictest0-21swapper/307:55:103
176299950,5cyclictest0-21swapper/309:19:403
176299950,5cyclictest0-21swapper/308:40:113
176299950,4cyclictest5967-21ssh11:50:103
176299950,4cyclictest0-21swapper/309:45:123
176299950,4cyclictest0-21swapper/309:00:103
176299950,4cyclictest0-21swapper/308:30:013
176299950,4cyclictest0-21swapper/308:10:123
176299950,4cyclictest0-21swapper/307:50:113
176249955,0cyclictest32252-21kworker/2:008:37:012
176249955,0cyclictest32252-21kworker/2:007:52:172
176249955,0cyclictest32252-21kworker/2:007:29:512
176249955,0cyclictest0-21swapper/211:20:572
176249955,0cyclictest0-21swapper/209:30:572
176249950,5cyclictest0-21swapper/212:05:012
176249950,4cyclictest14067-21apt-get10:05:112
176249950,4cyclictest0-21swapper/211:25:112
176249950,4cyclictest0-21swapper/210:25:122
176249950,4cyclictest0-21swapper/209:40:142
176249950,4cyclictest0-21swapper/209:10:122
176249950,3cyclictest0-21swapper/209:25:102
176179951,2cyclictest0-21swapper/111:15:101
176179951,2cyclictest0-21swapper/109:05:141
176139952,3cyclictest17694-21ssh11:01:100
176139952,3cyclictest0-21swapper/011:56:160
176139952,3cyclictest0-21swapper/011:20:290
176139952,3cyclictest0-21swapper/011:05:280
176139952,3cyclictest0-21swapper/010:55:000
176139952,3cyclictest0-21swapper/010:30:360
176139952,3cyclictest0-21swapper/009:05:180
176139952,3cyclictest0-21swapper/007:55:000
176139952,3cyclictest0-21swapper/007:44:190
176139952,3cyclictest0-21swapper/007:30:010
176139951,4cyclictest0-21swapper/010:08:140
176139951,4cyclictest0-21swapper/009:17:550
176139950,5cyclictest8572-21sshd11:32:560
176139950,5cyclictest17699-21apt-get12:15:100
176139950,5cyclictest0-21swapper/012:35:030
176139950,5cyclictest0-21swapper/012:30:430
176139950,5cyclictest0-21swapper/012:00:230
176139950,5cyclictest0-21swapper/011:35:250
176139950,5cyclictest0-21swapper/011:16:210
176139950,5cyclictest0-21swapper/010:51:130
176139950,5cyclictest0-21swapper/010:42:110
176139950,5cyclictest0-21swapper/010:39:340
176139950,5cyclictest0-21swapper/010:20:370
176139950,5cyclictest0-21swapper/010:13:070
176139950,5cyclictest0-21swapper/009:47:530
176139950,5cyclictest0-21swapper/009:42:420
176139950,5cyclictest0-21swapper/009:30:120
176139950,5cyclictest0-21swapper/007:20:000
176139950,5cyclictest0-21swapper/007:10:270
176139950,1cyclictest0-21swapper/009:50:230
176139950,0cyclictest510-21ssh11:46:230
176139950,0cyclictest31309-21grep09:20:180
176139950,0cyclictest27886-21awk11:25:160
176139950,0cyclictest22845-21sed11:40:310
176299943,1cyclictest10373-21grep10:20:223
176299942,1cyclictest728-21snmpd08:48:473
176299942,1cyclictest31472-21ssh09:20:183
176299942,1cyclictest1522-21ssh09:40:023
176299941,2cyclictest0-21swapper/308:25:103
176299941,1cyclictest0-21swapper/311:40:173
176299940,4cyclictest12696-21diskmemload12:00:103
176299940,4cyclictest0-21swapper/311:38:003
176299940,4cyclictest0-21swapper/311:28:263
176299940,4cyclictest0-21swapper/311:10:123
176299940,4cyclictest0-21swapper/311:05:233
176299940,4cyclictest0-21swapper/310:50:123
176299940,4cyclictest0-21swapper/310:10:103
176299940,4cyclictest0-21swapper/308:50:113
176299940,3cyclictest9290-21/usr/sbin/munin12:10:133
176299940,3cyclictest4391-21/usr/sbin/munin11:30:173
176299940,3cyclictest31627-21ssh10:15:023
176299940,3cyclictest31092-21ssh12:22:013
176299940,3cyclictest2775-21ssh11:48:003
176299940,3cyclictest25841-21cut07:25:013
176299940,3cyclictest25209-21rm09:35:113
176299940,3cyclictest24013-21rm11:23:293
176299940,3cyclictest20289-21irqstats07:15:013
176299940,3cyclictest17702-21ssh12:15:113
176299940,3cyclictest17145-21chrt11:00:463
176299940,3cyclictest16128-21ssh09:30:033
176299940,3cyclictest14922-21ssh10:05:133
176299940,3cyclictest13051-21ssh11:16:573
176299940,3cyclictest12914-21ssh09:10:013
176299940,3cyclictest12000-21ssh12:30:113
176299940,3cyclictest0-21swapper/312:05:033
176299940,3cyclictest0-21swapper/310:35:053
176299940,3cyclictest0-21swapper/309:25:113
176299940,1cyclictest6058-21df08:55:133
176299940,0cyclictest0-21swapper/310:45:493
176299940,0cyclictest0-21swapper/310:41:083
176299940,0cyclictest0-21swapper/308:01:583
176249944,0cyclictest8407-21ssh10:01:132
176249944,0cyclictest32252-21kworker/2:010:17:482
176249944,0cyclictest0-21swapper/211:57:192
176249944,0cyclictest0-21swapper/211:50:202
176249944,0cyclictest0-21swapper/210:55:202
176249944,0cyclictest0-21swapper/210:42:052
176249944,0cyclictest0-21swapper/209:39:582
176249944,0cyclictest0-21swapper/208:30:152
176249942,1cyclictest2889-21ssh11:30:052
176249941,2cyclictest31858-21cat11:10:002
176249941,1cyclictest0-21swapper/210:45:152
176249940,4cyclictest0-21swapper/212:25:132
176249940,4cyclictest0-21swapper/211:45:412
176249940,4cyclictest0-21swapper/210:35:112
176249940,4cyclictest0-21swapper/210:11:352
176249940,4cyclictest0-21swapper/209:20:152
176249940,3cyclictest9235-21hddtemp_smartct10:20:142
176249940,3cyclictest8604-21ssh11:15:012
176249940,3cyclictest30722-21users09:55:212
176249940,3cyclictest29145-21ssh10:50:112
176249940,3cyclictest24704-21irqstats12:00:152
176249940,3cyclictest23814-21hddtemp_smartct08:25:142
176249940,3cyclictest21772-21ssh09:15:022
176249940,3cyclictest19426-21ssh09:50:012
176249940,3cyclictest11837-21sed09:45:172
176249940,3cyclictest10064-21memory12:10:172
176249940,3cyclictest0-21swapper/208:50:122
176179944,0cyclictest0-21swapper/111:24:111
176179944,0cyclictest0-21swapper/110:50:431
176179944,0cyclictest0-21swapper/110:44:291
176179944,0cyclictest0-21swapper/110:07:141
176179944,0cyclictest0-21swapper/109:32:181
176179944,0cyclictest0-21swapper/109:15:521
176179942,1cyclictest0-21swapper/107:15:121
176179941,2cyclictest0-21swapper/110:45:151
176179941,2cyclictest0-21swapper/110:25:101
176179941,2cyclictest0-21swapper/110:20:111
176179941,2cyclictest0-21swapper/109:50:011
176179941,2cyclictest0-21swapper/109:45:121
176179941,2cyclictest0-21swapper/109:35:151
176179941,2cyclictest0-21swapper/108:05:141
176179941,2cyclictest0-21swapper/107:50:121
176179941,2cyclictest0-21swapper/107:40:111
176179941,2cyclictest0-21swapper/107:25:111
176179941,1cyclictest0-21swapper/110:35:111
176179941,1cyclictest0-21swapper/110:15:171
176179940,4cyclictest0-21swapper/112:21:321
176179940,4cyclictest0-21swapper/111:41:131
176179940,4cyclictest0-21swapper/111:10:141
176179940,3cyclictest0-21swapper/112:00:111
176179940,2cyclictest0-21swapper/112:35:101
176179940,2cyclictest0-21swapper/108:10:111
176179940,0cyclictest0-21swapper/111:38:541
176139941,3cyclictest18042-21apt-get08:15:100
176139941,3cyclictest0-21swapper/008:25:010
176139941,3cyclictest0-21swapper/008:20:000
176139941,3cyclictest0-21swapper/008:10:010
176139941,3cyclictest0-21swapper/008:00:010
176139941,3cyclictest0-21swapper/007:45:010
176139941,3cyclictest0-21swapper/007:25:000
176139940,4cyclictest0-21swapper/009:35:040
176139940,4cyclictest0-21swapper/009:00:150
176139940,4cyclictest0-21swapper/008:55:150
176139940,4cyclictest0-21swapper/008:35:210
176139940,4cyclictest0-21swapper/008:30:170
176139940,4cyclictest0-21swapper/007:50:120
176139940,4cyclictest0-21swapper/007:35:010
19220230,0sleep10-21swapper/112:34:111
176299932,1cyclictest728-21snmpd09:06:193
176299932,1cyclictest728-21snmpd08:15:053
176299932,1cyclictest728-21snmpd07:45:063
176299932,1cyclictest728-21snmpd07:35:123
176299932,1cyclictest728-21snmpd07:10:063
176299932,1cyclictest3125-21ssh12:25:073
176299931,1cyclictest728-21snmpd10:30:043
176299931,1cyclictest17188-21apt-get10:25:113
176299930,3cyclictest0-21swapper/312:35:113
176299930,3cyclictest0-21swapper/311:55:103
176299930,3cyclictest0-21swapper/310:55:113
176299930,3cyclictest0-21swapper/309:55:023
176299930,3cyclictest0-21swapper/309:50:113
176299930,3cyclictest0-21swapper/308:35:153
176299930,3cyclictest0-21swapper/308:21:103
176299930,3cyclictest0-21swapper/308:05:153
176299930,3cyclictest0-21swapper/307:40:123
176299930,3cyclictest0-21swapper/307:30:003
176299930,3cyclictest0-21swapper/307:25:103
176249932,1cyclictest8205-21grep09:00:102
176249932,1cyclictest2195-21ssh11:10:292
176249931,1cyclictest12898-21cron08:05:002
176249931,1cyclictest0-21swapper/212:30:102
176249931,1cyclictest0-21swapper/211:40:162
176249931,1cyclictest0-21swapper/208:10:122
176249930,3cyclictest28859-21diskstats07:30:112
176249930,3cyclictest21387-21diskstats12:35:122
176249930,3cyclictest14501-21apt11:00:112
176249930,3cyclictest11601-21chrt11:35:002
176249930,3cyclictest0-21swapper/210:30:192
176249930,3cyclictest0-21swapper/209:05:152
176249930,3cyclictest0-21swapper/208:55:012
176249930,3cyclictest0-21swapper/208:45:112
176249930,3cyclictest0-21swapper/208:40:112
176249930,3cyclictest0-21swapper/208:20:122
176249930,3cyclictest0-21swapper/208:15:112
176249930,3cyclictest0-21swapper/208:00:112
176249930,3cyclictest0-21swapper/207:55:102
176249930,3cyclictest0-21swapper/207:45:172
176249930,3cyclictest0-21swapper/207:40:192
176249930,3cyclictest0-21swapper/207:35:162
176249930,3cyclictest0-21swapper/207:20:102
176249930,3cyclictest0-21swapper/207:15:012
176249930,3cyclictest0-21swapper/207:10:092
176179933,0cyclictest0-21swapper/109:21:501
176179931,2cyclictest0-21swapper/108:40:101
176179931,1cyclictest0-21swapper/112:25:141
176179931,1cyclictest0-21swapper/112:15:101
176179931,1cyclictest0-21swapper/112:10:111
176179931,1cyclictest0-21swapper/112:05:161
176179931,1cyclictest0-21swapper/110:55:101
176179931,1cyclictest0-21swapper/110:10:111
176179931,1cyclictest0-21swapper/110:00:121
176179931,1cyclictest0-21swapper/109:55:011
176179931,1cyclictest0-21swapper/109:25:101
176179931,1cyclictest0-21swapper/109:00:091
176179931,1cyclictest0-21swapper/108:55:101
176179931,1cyclictest0-21swapper/108:50:121
176179931,1cyclictest0-21swapper/108:45:111
176179931,1cyclictest0-21swapper/108:35:141
176179931,1cyclictest0-21swapper/108:30:101
176179931,1cyclictest0-21swapper/108:25:111
176179931,1cyclictest0-21swapper/107:55:111
176179931,1cyclictest0-21swapper/107:35:171
176179931,1cyclictest0-21swapper/107:20:091
176179930,2cyclictest0-21swapper/111:05:241
176179930,2cyclictest0-21swapper/109:10:121
176179930,2cyclictest0-21swapper/108:20:121
176179930,2cyclictest0-21swapper/108:00:121
176179930,2cyclictest0-21swapper/107:10:151
176179920,1cyclictest0-21swapper/111:55:111
176179920,1cyclictest0-21swapper/111:50:001
176179920,1cyclictest0-21swapper/111:30:021
176179920,1cyclictest0-21swapper/109:40:211
176179920,1cyclictest0-21swapper/107:45:101
176179920,1cyclictest0-21swapper/107:30:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional