You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-28 - 07:05

x86 Intel Core i5-6440EQ @2700 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #5, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Fri Jan 27, 2023 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28982216201,11sleep10-21swapper/107:08:291
27912195178,12sleep30-21swapper/307:07:053
27532172156,11sleep00-21swapper/007:06:350
2718210992,12sleep20-21swapper/207:06:092
261692510,0sleep30-21swapper/312:23:543
72602450,0sleep10-21swapper/109:34:401
133582150,0sleep00-21swapper/010:17:160
293772130,0sleep00-21swapper/012:05:300
90242100,0sleep10-21swapper/107:20:011
161062100,0sleep10-21swapper/110:39:111
31709982,3cyclictest19691-21perf12:39:590
31899970,6cyclictest0-21swapper/308:05:183
31759970,7cyclictest0-21swapper/112:30:101
31709971,3cyclictest1631-21munin-run11:10:010
31899960,5cyclictest0-21swapper/308:30:143
31899955,0cyclictest6375-21kworker/3:112:25:393
31899955,0cyclictest6375-21kworker/3:109:37:433
31899955,0cyclictest0-21swapper/311:39:233
31899953,1cyclictest16392-21ssh09:40:143
31899950,5cyclictest0-21swapper/312:08:553
31899950,5cyclictest0-21swapper/309:46:283
31899950,4cyclictest3772-21apt-get12:30:113
31899950,4cyclictest29163-21ssh10:07:063
31899950,4cyclictest0-21swapper/311:50:113
31849955,0cyclictest0-21swapper/209:55:142
31849950,5cyclictest0-21swapper/212:06:462
31849950,5cyclictest0-21swapper/211:39:342
31849950,5cyclictest0-21swapper/209:27:012
31849950,4cyclictest0-21swapper/207:55:142
31849950,0cyclictest0-21swapper/211:00:592
31759950,5cyclictest0-21swapper/111:25:261
31759950,5cyclictest0-21swapper/109:21:021
31709950,5cyclictest0-21swapper/011:20:230
31709950,5cyclictest0-21swapper/009:30:250
31709950,5cyclictest0-21swapper/009:20:130
31709950,4cyclictest0-21swapper/007:10:130
9598240,0sleep20-21swapper/207:20:172
31899944,0cyclictest6375-21kworker/3:109:26:353
31899944,0cyclictest6375-21kworker/3:107:45:473
31899944,0cyclictest0-21swapper/310:15:433
31899944,0cyclictest0-21swapper/307:12:303
31899943,1cyclictest0-21swapper/308:40:063
31899941,2cyclictest0-21swapper/308:15:163
31899940,4cyclictest0-21swapper/311:55:343
31899940,4cyclictest0-21swapper/311:45:103
31899940,4cyclictest0-21swapper/311:20:113
31899940,4cyclictest0-21swapper/310:55:163
31899940,4cyclictest0-21swapper/310:54:133
31899940,4cyclictest0-21swapper/310:45:153
31899940,4cyclictest0-21swapper/310:31:283
31899940,4cyclictest0-21swapper/310:20:163
31899940,4cyclictest0-21swapper/310:00:163
31899940,4cyclictest0-21swapper/308:55:153
31899940,4cyclictest0-21swapper/308:11:093
31899940,4cyclictest0-21swapper/307:58:373
31899940,3cyclictest8550-21rm09:55:063
31899940,3cyclictest7395-21ssh09:15:013
31899940,3cyclictest711-21/usr/sbin/munin09:50:183
31899940,3cyclictest5453-21ssh11:11:303
31899940,3cyclictest3591-21ssh09:31:443
31899940,3cyclictest31583-21ssh09:10:023
31899940,3cyclictest31203-21rm11:27:233
31899940,3cyclictest29151-21basename08:00:143
31899940,3cyclictest26340-21ssh11:05:163
31899940,3cyclictest25246-21ssh10:25:033
31899940,3cyclictest24150-21/usr/sbin/munin07:50:173
31899940,3cyclictest19191-21apt-get08:45:123
31899940,3cyclictest18079-21ssh11:00:103
31899940,3cyclictest17638-21ssh10:40:143
31899940,3cyclictest15936-21chrt07:30:233
31899940,3cyclictest13276-21ssh10:36:533
31899940,3cyclictest10050-21rm11:15:013
31899940,3cyclictest0-21swapper/312:15:003
31899940,3cyclictest0-21swapper/312:10:103
31899940,3cyclictest0-21swapper/312:00:123
31899940,3cyclictest0-21swapper/311:30:113
31899940,0cyclictest0-21swapper/308:27:183
31849944,0cyclictest0-21swapper/212:26:062
31849944,0cyclictest0-21swapper/211:29:232
31849944,0cyclictest0-21swapper/210:30:102
31849944,0cyclictest0-21swapper/209:33:162
31849942,2cyclictest31-21ksoftirqd/211:50:002
31849941,2cyclictest0-21swapper/212:15:142
31849941,2cyclictest0-21swapper/209:35:212
31849941,2cyclictest0-21swapper/209:20:152
31849941,2cyclictest0-21swapper/207:35:182
31849940,4cyclictest0-21swapper/212:20:122
31849940,4cyclictest0-21swapper/211:19:142
31849940,4cyclictest0-21swapper/211:10:162
31849940,4cyclictest0-21swapper/211:05:212
31849940,4cyclictest0-21swapper/210:45:152
31849940,4cyclictest0-21swapper/210:20:252
31849940,4cyclictest0-21swapper/210:15:142
31849940,4cyclictest0-21swapper/210:05:182
31849940,4cyclictest0-21swapper/209:50:152
31849940,4cyclictest0-21swapper/209:15:172
31849940,4cyclictest0-21swapper/208:40:182
31849940,4cyclictest0-21swapper/207:25:022
31849940,4cyclictest0-21swapper/207:25:022
31849940,3cyclictest8791-21cron07:20:002
31849940,3cyclictest740-21snmpd12:35:092
31849940,3cyclictest29621-21diskstats09:05:202
31849940,3cyclictest23503-21sh11:22:492
31849940,3cyclictest2228-21ntp_states10:10:222
31849940,3cyclictest20480-21ntp_states07:40:212
31849940,3cyclictest19526-21df_inode11:40:202
31849940,3cyclictest18583-21hddtemp_smartct10:40:202
31849940,3cyclictest16678-21ssh10:00:032
31849940,3cyclictest11109-21/usr/sbin/munin11:55:212
31849940,3cyclictest0-21swapper/210:35:012
31849940,1cyclictest29624-21df08:00:152
31849940,1cyclictest10771-21fschecks_time10:55:192
31759944,0cyclictest0-21swapper/112:15:291
31759944,0cyclictest0-21swapper/109:05:171
31759944,0cyclictest0-21swapper/107:35:231
31759941,2cyclictest0-21swapper/111:50:111
31759941,2cyclictest0-21swapper/111:40:131
31759941,2cyclictest0-21swapper/111:30:111
31759941,2cyclictest0-21swapper/111:15:121
31759941,2cyclictest0-21swapper/110:55:171
31759941,2cyclictest0-21swapper/110:45:141
31759941,2cyclictest0-21swapper/110:40:141
31759941,2cyclictest0-21swapper/109:50:011
31759941,2cyclictest0-21swapper/107:20:131
31759941,1cyclictest0-21swapper/111:20:121
31759940,4cyclictest0-21swapper/112:09:131
31759940,4cyclictest0-21swapper/111:37:121
31759940,4cyclictest0-21swapper/111:11:101
31759940,4cyclictest0-21swapper/110:29:071
31759940,4cyclictest0-21swapper/109:46:121
31759940,0cyclictest0-21swapper/108:06:491
31709944,0cyclictest0-21swapper/012:13:300
31709944,0cyclictest0-21swapper/011:32:120
31709944,0cyclictest0-21swapper/010:40:500
31709944,0cyclictest0-21swapper/010:11:260
31709944,0cyclictest0-21swapper/007:25:330
31709944,0cyclictest0-21swapper/007:25:320
31709942,2cyclictest740-21snmpd07:35:110
31709942,2cyclictest18820-21ssh11:59:580
31709942,1cyclictest9029-21grep08:24:590
31709942,1cyclictest740-21snmpd09:35:170
31709941,3cyclictest4756-21sh11:10:560
31709940,4cyclictest1232-21apt-get10:30:140
31709940,4cyclictest0-21swapper/012:30:220
31709940,4cyclictest0-21swapper/012:26:500
31709940,4cyclictest0-21swapper/011:40:430
31709940,4cyclictest0-21swapper/011:25:540
31709940,4cyclictest0-21swapper/010:57:070
31709940,4cyclictest0-21swapper/010:21:460
31709940,4cyclictest0-21swapper/010:05:170
31709940,4cyclictest0-21swapper/009:46:070
31709940,3cyclictest519-21apt09:50:160
31709940,3cyclictest31635-21ssh09:29:500
31709940,3cyclictest27977-21hddtemp_smartct11:45:140
31709940,3cyclictest27152-21diskstats09:00:200
31709940,3cyclictest26579-21cat10:45:200
31709940,3cyclictest25427-21ntp_states07:50:250
31709940,3cyclictest21618-21sed07:45:010
31709940,3cyclictest17629-21cat09:40:200
31709940,3cyclictest17475-21/usr/sbin/munin08:40:230
31709940,3cyclictest1430-21users09:10:250
31709940,2cyclictest0-21swapper/011:35:560
31709940,1cyclictest2851-21/usr/sbin/munin11:50:110
24024240,3sleep30-21swapper/311:42:563
14432240,2sleep2301ktimersoftd/207:30:152
31899933,0cyclictest0-21swapper/308:20:013
31899931,1cyclictest5866-21processes07:15:013
31899930,3cyclictest824-21apt-get10:10:153
31899930,3cyclictest0-21swapper/309:20:153
31899930,3cyclictest0-21swapper/309:05:183
31899930,3cyclictest0-21swapper/309:00:173
31899930,3cyclictest0-21swapper/308:50:123
31899930,3cyclictest0-21swapper/308:35:023
31899930,3cyclictest0-21swapper/307:40:153
31899930,3cyclictest0-21swapper/307:35:183
31899930,3cyclictest0-21swapper/307:25:153
31899930,3cyclictest0-21swapper/307:25:153
31899930,3cyclictest0-21swapper/307:20:143
31899930,1cyclictest0-21swapper/312:35:103
31849932,1cyclictest24482-21cpuspeed_turbos08:55:152
31849931,2cyclictest598-21kworker/2:009:10:062
31849931,1cyclictest0-21swapper/212:30:112
31849931,1cyclictest0-21swapper/209:00:172
31849931,1cyclictest0-21swapper/208:50:122
31849930,3cyclictest9616-21diskstats08:25:182
31849930,3cyclictest19904-21diskstats12:00:142
31849930,3cyclictest17074-21grep09:40:182
31849930,3cyclictest1622-21apt-get08:10:162
31849930,3cyclictest12593-21hddtemp_smartct08:30:172
31849930,3cyclictest0-21swapper/212:10:112
31849930,3cyclictest0-21swapper/211:50:092
31849930,3cyclictest0-21swapper/211:30:102
31849930,3cyclictest0-21swapper/210:25:132
31849930,3cyclictest0-21swapper/209:45:152
31849930,3cyclictest0-21swapper/208:45:132
31849930,3cyclictest0-21swapper/208:35:182
31849930,3cyclictest0-21swapper/208:20:192
31849930,3cyclictest0-21swapper/208:15:022
31849930,3cyclictest0-21swapper/208:05:172
31849930,3cyclictest0-21swapper/207:50:182
31849930,3cyclictest0-21swapper/207:10:132
31849930,2cyclictest0-21swapper/210:50:172
31849930,2cyclictest0-21swapper/207:45:152
31759933,0cyclictest0-21swapper/112:20:091
31759933,0cyclictest0-21swapper/112:02:581
31759933,0cyclictest0-21swapper/111:04:031
31759931,2cyclictest0-21swapper/110:50:171
31759931,2cyclictest0-21swapper/109:00:161
31759931,1cyclictest0-21swapper/112:35:111
31759931,1cyclictest0-21swapper/112:25:101
31759931,1cyclictest0-21swapper/112:10:201
31759931,1cyclictest0-21swapper/111:45:111
31759931,1cyclictest0-21swapper/110:30:151
31759931,1cyclictest0-21swapper/110:20:151
31759931,1cyclictest0-21swapper/109:55:161
31759931,1cyclictest0-21swapper/109:40:151
31759931,1cyclictest0-21swapper/109:25:141
31759931,1cyclictest0-21swapper/108:10:151
31759931,1cyclictest0-21swapper/107:50:171
31759931,1cyclictest0-21swapper/107:40:151
31759931,1cyclictest0-21swapper/107:25:141
31759931,1cyclictest0-21swapper/107:25:141
31759930,3cyclictest0-21swapper/108:50:451
31759930,3cyclictest0-21swapper/108:43:281
31759930,3cyclictest0-21swapper/107:30:091
31759930,2cyclictest9893-21taskset09:35:301
31759930,2cyclictest6052-21chrt08:16:211
31759930,2cyclictest33012sleep107:10:081
31759930,2cyclictest14183-21chrt11:56:141
31759930,2cyclictest12648-21chrt09:17:481
31759930,2cyclictest0-21swapper/110:05:181
31759930,2cyclictest0-21swapper/108:35:171
31759930,1cyclictest0-21swapper/110:00:161
31709932,1cyclictest740-21snmpd09:05:170
31709932,1cyclictest740-21snmpd07:30:100
31709932,1cyclictest16672-21ssh10:00:010
31709932,1cyclictest12314-21cat12:15:150
31709930,3cyclictest9577-21df07:20:180
31709930,3cyclictest32109-21df_inode08:05:200
31709930,3cyclictest0-21swapper/012:20:140
31709930,3cyclictest0-21swapper/012:00:120
31709930,3cyclictest0-21swapper/011:00:150
31709930,3cyclictest0-21swapper/010:50:160
31709930,3cyclictest0-21swapper/010:35:170
31709930,3cyclictest0-21swapper/009:15:020
31709930,3cyclictest0-21swapper/008:50:130
31709930,3cyclictest0-21swapper/008:45:120
31709930,3cyclictest0-21swapper/008:25:020
31709930,3cyclictest0-21swapper/008:15:140
31709930,3cyclictest0-21swapper/008:10:160
31709930,3cyclictest0-21swapper/008:00:140
31709930,3cyclictest0-21swapper/007:55:130
31709930,3cyclictest0-21swapper/007:45:030
31709930,3cyclictest0-21swapper/007:15:020
31709930,2cyclictest25305-21ssh10:25:040
31709930,2cyclictest14605-21cstates08:35:200
31709930,2cyclictest0-21swapper/011:15:110
31709930,2cyclictest0-21swapper/008:55:150
31709930,1cyclictest11675-21apt-config08:30:000
31709930,1cyclictest0-21swapper/009:55:090
26147230,0sleep10-21swapper/108:57:301
31759921,1cyclictest191872chrt08:45:121
31759921,1cyclictest0-21swapper/108:00:141
31759920,1cyclictest0-21swapper/111:05:201
31759920,1cyclictest0-21swapper/110:15:151
31759920,1cyclictest0-21swapper/110:10:151
31759920,1cyclictest0-21swapper/109:10:161
31759920,1cyclictest0-21swapper/108:30:011
31759920,1cyclictest0-21swapper/108:25:141
31759920,1cyclictest0-21swapper/108:20:191
31759920,1cyclictest0-21swapper/107:55:141
31759920,1cyclictest0-21swapper/107:45:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional