You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-20 - 06:48

x86 Intel Core i5-6440EQ @2700 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #5, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Fri May 20, 2022 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
53662201185,11sleep10-21swapper/119:09:521
51702193176,12sleep00-21swapper/019:07:220
53682179162,12sleep30-21swapper/319:09:543
50882172156,11sleep20-21swapper/219:06:202
83362500,0sleep30-21swapper/300:10:163
302842470,0sleep20-21swapper/219:55:202
243142130,0sleep10-21swapper/122:22:121
275362110,0sleep10-21swapper/121:45:131
63032100,0sleep20-21swapper/200:09:472
22392100,0sleep10-21swapper/121:30:121
104962100,0sleep00-21swapper/021:35:110
55639970,7cyclictest0-21swapper/323:15:113
55489965,1cyclictest0-21swapper/019:50:110
55489960,3cyclictest4495-21munin-run22:50:010
18637260,0sleep00-21swapper/022:58:140
6882250,0sleep30-21swapper/322:11:253
55639955,0cyclictest0-21swapper/323:00:123
55639951,2cyclictest0-21swapper/323:45:123
55639951,2cyclictest0-21swapper/319:55:113
55639950,5cyclictest0-21swapper/319:46:143
55639950,5cyclictest0-21swapper/319:29:393
55639950,5cyclictest0-21swapper/319:24:163
55639950,5cyclictest0-21swapper/300:26:123
55599955,0cyclictest0-21swapper/222:26:552
55599955,0cyclictest0-21swapper/219:25:192
55599954,1cyclictest16010-21date20:35:002
55599950,5cyclictest19324-21ssh22:58:472
55599950,5cyclictest0-21swapper/222:13:322
55599950,5cyclictest0-21swapper/222:06:152
55599950,5cyclictest0-21swapper/221:51:252
55599950,5cyclictest0-21swapper/200:15:362
55599950,0cyclictest0-21swapper/222:22:152
55489955,0cyclictest0-21swapper/021:43:330
55489951,4cyclictest1033-21diskmemload22:30:000
55489950,5cyclictest0-21swapper/023:37:020
55489950,5cyclictest0-21swapper/022:21:140
55489950,4cyclictest28745-21apt-get21:00:100
55489950,4cyclictest11398-21apt-get19:20:120
55489950,4cyclictest1033-21diskmemload22:35:100
55489950,4cyclictest0-21swapper/023:55:110
55489950,4cyclictest0-21swapper/021:25:110
55489950,0cyclictest0-21swapper/019:15:160
55639944,0cyclictest0-21swapper/323:58:593
55639944,0cyclictest0-21swapper/323:22:373
55639944,0cyclictest0-21swapper/323:13:093
55639944,0cyclictest0-21swapper/322:16:163
55639944,0cyclictest0-21swapper/322:00:073
55639944,0cyclictest0-21swapper/321:05:153
55639944,0cyclictest0-21swapper/320:45:193
55639944,0cyclictest0-21swapper/300:30:073
55639943,1cyclictest4369-21/usr/sbin/munin22:30:203
55639943,1cyclictest17055-21perl19:30:143
55639942,1cyclictest28772-21ssh21:25:403
55639941,2cyclictest4730-21sshd21:11:213
55639941,2cyclictest1008-21latency_hist20:05:003
55639941,2cyclictest0-21swapper/322:25:133
55639941,2cyclictest0-21swapper/320:52:223
55639941,2cyclictest0-21swapper/320:52:213
55639940,4cyclictest5573-21/usr/sbin/munin23:30:183
55639940,4cyclictest29057-21/usr/sbin/munin22:45:213
55639940,4cyclictest2253-21/usr/sbin/munin21:30:163
55639940,4cyclictest13319-21users21:55:213
55639940,4cyclictest0-21swapper/323:40:103
55639940,4cyclictest0-21swapper/322:57:263
55639940,4cyclictest0-21swapper/322:50:123
55639940,4cyclictest0-21swapper/322:40:213
55639940,4cyclictest0-21swapper/322:35:193
55639940,4cyclictest0-21swapper/321:50:113
55639940,4cyclictest0-21swapper/320:15:113
55639940,4cyclictest0-21swapper/319:35:103
55639940,4cyclictest0-21swapper/319:15:123
55639940,4cyclictest0-21swapper/300:00:013
55639940,3cyclictest6062-21sh23:50:023
55639940,3cyclictest32101-21hddtemp_smartct00:05:143
55639940,3cyclictest26254-21/usr/sbin/munin20:55:103
55639940,3cyclictest21290-21chrt19:40:083
55639940,3cyclictest21285-21ssh00:38:073
55639940,3cyclictest14161-21df20:30:133
55639940,3cyclictest12674-21sh21:16:053
55639940,3cyclictest0-21swapper/323:25:103
55639940,3cyclictest0-21swapper/320:10:103
55639940,1cyclictest8700-21/usr/sbin/munin20:20:153
55639940,1cyclictest11299-21perl21:35:153
55639940,0cyclictest0-21swapper/323:07:033
55639940,0cyclictest0-21swapper/322:05:043
55639940,0cyclictest0-21swapper/321:42:043
55599944,0cyclictest16067-21ssh23:15:482
55599944,0cyclictest0-21swapper/223:03:352
55599944,0cyclictest0-21swapper/222:32:532
55599942,2cyclictest1904-21ntpd00:25:342
55599942,1cyclictest3462-21ssh23:48:072
55599942,1cyclictest18117-21in:imuxsock20:05:002
55599940,4cyclictest6258-21dpkg23:50:112
55599940,4cyclictest5576-21apt-get23:30:102
55599940,4cyclictest11401-21systemctl21:15:192
55599940,4cyclictest1033-21diskmemload23:35:102
55599940,4cyclictest0-21swapper/222:45:122
55599940,4cyclictest0-21swapper/222:40:122
55599940,4cyclictest0-21swapper/222:35:102
55599940,4cyclictest0-21swapper/222:15:132
55599940,4cyclictest0-21swapper/221:55:122
55599940,4cyclictest0-21swapper/221:45:122
55599940,4cyclictest0-21swapper/221:25:112
55599940,4cyclictest0-21swapper/220:50:112
55599940,4cyclictest0-21swapper/220:50:112
55599940,4cyclictest0-21swapper/220:25:112
55599940,4cyclictest0-21swapper/200:35:062
55599940,4cyclictest0-21swapper/200:00:102
55599940,3cyclictest8135-21ntp_states19:15:012
55599940,3cyclictest20324-21python19:35:182
55599940,3cyclictest19947-21ssh23:58:062
55599940,1cyclictest6726-21sh20:15:122
55549944,0cyclictest0-21swapper/123:35:431
55549944,0cyclictest0-21swapper/123:28:181
55549944,0cyclictest0-21swapper/123:00:211
55549944,0cyclictest0-21swapper/122:45:401
55549941,2cyclictest0-21swapper/123:05:111
55549941,2cyclictest0-21swapper/122:15:121
55549941,2cyclictest0-21swapper/122:05:111
55549941,2cyclictest0-21swapper/121:00:101
55549941,2cyclictest0-21swapper/120:25:111
55549941,2cyclictest0-21swapper/119:10:111
55549941,2cyclictest0-21swapper/100:30:111
55549941,2cyclictest0-21swapper/100:25:171
55549941,2cyclictest0-21swapper/100:10:101
55549941,2cyclictest0-21swapper/100:00:011
55549941,1cyclictest0-21swapper/123:20:111
55549941,1cyclictest0-21swapper/122:00:111
55549941,1cyclictest0-21swapper/100:20:101
55549940,4cyclictest0-21swapper/122:38:151
55489944,0cyclictest0-21swapper/023:48:320
55489944,0cyclictest0-21swapper/023:31:390
55489944,0cyclictest0-21swapper/022:54:160
55489944,0cyclictest0-21swapper/021:10:490
55489944,0cyclictest0-21swapper/000:25:120
55489943,1cyclictest511-21grep21:05:200
55489943,1cyclictest27091-21hddtemp_smartct20:55:130
55489942,2cyclictest13823-21kworker/0:222:12:480
55489942,1cyclictest14049-21ssh23:15:120
55489940,4cyclictest0-21swapper/023:10:100
55489940,4cyclictest0-21swapper/023:00:120
55489940,4cyclictest0-21swapper/021:20:110
55489940,4cyclictest0-21swapper/000:00:010
55489940,3cyclictest8383-21ntp_states00:10:160
55489940,3cyclictest32394-21memory00:05:170
55489940,3cyclictest31702-21grep23:25:190
55489940,3cyclictest23540-21munin-run19:45:000
55489940,3cyclictest23090-21ntp_states23:20:170
55489940,3cyclictest22165-21memory20:45:160
55489940,3cyclictest21223-21sed19:40:000
55489940,3cyclictest2005-21ssh21:30:010
55489940,3cyclictest0-21swapper/019:30:110
55489940,1cyclictest25819-21latency_hist20:55:000
55489940,1cyclictest25819-21latency_hist20:55:000
4941240,0sleep20-21swapper/221:11:322
30205240,0sleep20-21swapper/200:24:092
23284240,0sleep30-21swapper/322:21:223
55639933,0cyclictest0-21swapper/300:15:113
55639932,1cyclictest54250irq/130-eth021:45:123
55639932,1cyclictest18067-21sh21:20:113
55639931,1cyclictest28745-21apt-get21:00:103
55639931,1cyclictest0-21swapper/320:40:103
55639930,3cyclictest11693-21df20:25:133
55639930,3cyclictest0-21swapper/323:35:013
55639930,3cyclictest0-21swapper/320:35:053
55639930,3cyclictest0-21swapper/320:05:113
55639930,3cyclictest0-21swapper/319:10:053
55639930,3cyclictest0-21swapper/300:20:103
55639930,2cyclictest27228-21irqstats19:50:163
55599931,1cyclictest740-21snmpd21:05:162
55599931,1cyclictest29699-21ssh23:25:032
55599931,1cyclictest21709-21apt-get23:20:112
55599931,1cyclictest0-21swapper/223:05:112
55599930,3cyclictest6234-21smartctl23:10:132
55599930,3cyclictest21297-21apt-get19:40:102
55599930,3cyclictest19951-21awk20:40:182
55599930,3cyclictest17074-21perl19:30:142
55599930,3cyclictest10038-21/usr/sbin/munin20:20:172
55599930,3cyclictest0-21swapper/223:40:102
55599930,3cyclictest0-21swapper/222:50:122
55599930,3cyclictest0-21swapper/222:00:112
55599930,3cyclictest0-21swapper/221:40:182
55599930,3cyclictest0-21swapper/221:35:122
55599930,3cyclictest0-21swapper/221:30:132
55599930,3cyclictest0-21swapper/221:20:122
55599930,3cyclictest0-21swapper/221:00:102
55599930,3cyclictest0-21swapper/220:55:102
55599930,3cyclictest0-21swapper/220:45:182
55599930,3cyclictest0-21swapper/220:35:172
55599930,3cyclictest0-21swapper/220:10:102
55599930,3cyclictest0-21swapper/220:05:092
55599930,3cyclictest0-21swapper/219:50:112
55599930,3cyclictest0-21swapper/219:45:052
55599930,3cyclictest0-21swapper/219:20:122
55599930,3cyclictest0-21swapper/219:10:112
55599930,3cyclictest0-21swapper/200:10:102
55599930,1cyclictest7383-21ssh00:30:002
55549933,0cyclictest0-21swapper/121:19:581
55549932,1cyclictest0-21swapper/122:10:111
55549932,1cyclictest0-21swapper/120:05:111
55549931,2cyclictest0-21swapper/119:55:121
55549931,1cyclictest0-21swapper/123:40:101
55549931,1cyclictest0-21swapper/123:30:101
55549931,1cyclictest0-21swapper/123:15:101
55549931,1cyclictest0-21swapper/122:50:131
55549931,1cyclictest0-21swapper/122:30:011
55549931,1cyclictest0-21swapper/121:55:121
55549931,1cyclictest0-21swapper/121:50:111
55549931,1cyclictest0-21swapper/121:25:111
55549931,1cyclictest0-21swapper/121:20:111
55549931,1cyclictest0-21swapper/121:10:121
55549931,1cyclictest0-21swapper/120:55:011
55549931,1cyclictest0-21swapper/120:45:111
55549931,1cyclictest0-21swapper/120:40:101
55549931,1cyclictest0-21swapper/120:30:111
55549931,1cyclictest0-21swapper/120:15:111
55549931,1cyclictest0-21swapper/120:10:101
55549931,1cyclictest0-21swapper/120:00:101
55549931,1cyclictest0-21swapper/119:35:111
55549931,1cyclictest0-21swapper/119:20:121
55549931,1cyclictest0-21swapper/100:35:121
55549931,1cyclictest0-21swapper/100:15:111
55549931,1cyclictest0-21swapper/100:05:111
55549930,3cyclictest0-21swapper/119:51:551
55549930,3cyclictest0-21swapper/119:18:101
55549930,2cyclictest30374-21chrt23:45:071
55549930,2cyclictest0-21swapper/123:50:111
55549930,2cyclictest0-21swapper/122:55:111
55549930,2cyclictest0-21swapper/121:35:121
55549930,2cyclictest0-21swapper/120:35:111
55549930,1cyclictest0-21swapper/121:40:181
55489933,0cyclictest13823-21kworker/0:220:30:070
55489932,1cyclictest740-21snmpd00:20:120
55489932,1cyclictest3-21ksoftirqd/020:00:100
55489930,3cyclictest6206-21apt-get20:15:100
55489930,3cyclictest2978-21/usr/sbin/munin21:50:130
55489930,3cyclictest22572-21cut23:40:110
55489930,3cyclictest19484-21sh22:00:070
55489930,3cyclictest1836-21fschecks_count20:05:150
55489930,3cyclictest11303-21apt-get21:55:120
55489930,3cyclictest10831-21irqstats21:15:160
55489930,3cyclictest0-21swapper/023:50:110
55489930,3cyclictest0-21swapper/023:05:100
55489930,3cyclictest0-21swapper/022:30:100
55489930,3cyclictest0-21swapper/022:15:120
55489930,3cyclictest0-21swapper/022:05:110
55489930,3cyclictest0-21swapper/021:45:120
55489930,3cyclictest0-21swapper/020:40:100
55489930,3cyclictest0-21swapper/020:35:110
55489930,3cyclictest0-21swapper/020:25:110
55489930,3cyclictest0-21swapper/020:20:100
55489930,3cyclictest0-21swapper/020:10:090
55489930,3cyclictest0-21swapper/019:55:060
55489930,3cyclictest0-21swapper/019:45:120
55489930,3cyclictest0-21swapper/019:25:110
55489930,3cyclictest0-21swapper/019:10:110
55489930,3cyclictest0-21swapper/000:35:120
55489930,3cyclictest0-21swapper/000:30:110
55489930,3cyclictest0-21swapper/000:15:110
55489930,2cyclictest20634-21ssh22:40:010
55549921,1cyclictest183632chrt19:32:291
55549921,1cyclictest0-21swapper/123:55:111
55549921,1cyclictest0-21swapper/123:10:101
55549921,1cyclictest0-21swapper/122:40:121
55549921,1cyclictest0-21swapper/119:40:101
55549920,2cyclictest31205-21chrt21:05:041
55549920,2cyclictest15841-21chrt19:26:531
55549920,1cyclictest24313-21chrt19:45:141
55549920,1cyclictest10790-21chrt20:23:171
55549920,1cyclictest0-21swapper/122:25:131
55549920,1cyclictest0-21swapper/120:50:111
55549920,1cyclictest0-21swapper/120:50:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional