You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-03 - 08:06

x86 Intel Core i5-6440EQ @2700 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #5, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot2.osadl.org (updated Sun Jul 03, 2022 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
268052196180,12sleep00-21swapper/019:09:440
267412194179,11sleep30-21swapper/319:08:553
265292188171,12sleep10-21swapper/119:06:121
267252180163,12sleep20-21swapper/219:08:432
205522710,0sleep30-21swapper/322:09:543
7282490,0sleep00-21swapper/023:19:170
220832460,0sleep00-21swapper/023:32:060
207122450,0sleep10-21swapper/122:10:001
84232440,0sleep30-21swapper/322:42:383
194762430,0sleep00-21swapper/000:11:390
194762430,0sleep00-21swapper/000:11:380
164132140,0sleep00-21swapper/023:49:480
2700299103,3cyclictest12196-21basename22:25:000
270129981,6cyclictest0-21swapper/220:30:112
270029983,4cyclictest15249-21apt-get19:50:000
270029980,4cyclictest22127-21munin-run00:35:000
270179960,1cyclictest0-21swapper/323:58:433
270179955,0cyclictest0-21swapper/323:15:033
270179955,0cyclictest0-21swapper/322:32:253
270179955,0cyclictest0-21swapper/322:11:123
270179955,0cyclictest0-21swapper/321:46:193
270179954,1cyclictest0-21swapper/321:38:533
270179951,3cyclictest21113-21expr21:05:133
270179950,5cyclictest15668-21apt-get19:50:013
270179950,5cyclictest0-21swapper/321:25:563
270179950,5cyclictest0-21swapper/300:24:453
270129955,0cyclictest0-21swapper/221:41:282
270129953,2cyclictest24340-21cut21:30:202
270129950,5cyclictest0-21swapper/223:00:202
270079951,2cyclictest0-21swapper/121:45:111
270079950,5cyclictest0-21swapper/123:35:481
270079950,5cyclictest0-21swapper/123:27:391
270079950,5cyclictest0-21swapper/123:11:561
270079950,5cyclictest0-21swapper/121:50:541
270029950,5cyclictest0-21swapper/021:12:460
270029950,5cyclictest0-21swapper/000:05:540
270029950,4cyclictest0-21swapper/023:55:120
270029950,0cyclictest0-21swapper/000:27:350
270179944,0cyclictest0-21swapper/323:51:523
270179944,0cyclictest0-21swapper/323:45:013
270179944,0cyclictest0-21swapper/323:40:403
270179944,0cyclictest0-21swapper/323:06:553
270179944,0cyclictest0-21swapper/322:48:433
270179942,2cyclictest0-21swapper/300:19:203
270179941,2cyclictest0-21swapper/323:35:113
270179940,4cyclictest0-21swapper/323:30:113
270179940,4cyclictest0-21swapper/322:55:393
270179940,4cyclictest0-21swapper/322:00:123
270179940,4cyclictest0-21swapper/321:55:123
270179940,4cyclictest0-21swapper/321:42:343
270179940,4cyclictest0-21swapper/320:40:103
270179940,4cyclictest0-21swapper/320:00:123
270179940,4cyclictest0-21swapper/319:20:113
270179940,4cyclictest0-21swapper/300:35:023
270179940,4cyclictest0-21swapper/300:30:113
270179940,4cyclictest0-21swapper/300:05:123
270179940,3cyclictest8035-21taskset19:35:023
270179940,3cyclictest7245-21ssh00:04:313
270179940,3cyclictest31369-21/usr/sbin/munin21:15:203
270179940,3cyclictest3072-21irqstats23:20:153
270179940,3cyclictest30070-21memory19:15:013
270179940,3cyclictest28849-21df22:35:133
270179940,3cyclictest25671-21aten2_r5power_v20:10:123
270179940,3cyclictest18428-21ssh23:10:023
270179940,3cyclictest17559-21sed23:30:013
270179940,3cyclictest11107-21expr20:45:123
270179940,3cyclictest0-21swapper/321:30:113
270129944,0cyclictest0-21swapper/223:30:272
270129944,0cyclictest0-21swapper/222:42:432
270129944,0cyclictest0-21swapper/222:03:532
270129944,0cyclictest0-21swapper/220:45:172
270129944,0cyclictest0-21swapper/200:35:382
270129944,0cyclictest0-21swapper/200:29:312
270129944,0cyclictest0-21swapper/200:17:532
270129943,1cyclictest20614-21/usr/sbin/munin21:05:142
270129942,1cyclictest3591-21find23:20:192
270129941,2cyclictest0-21swapper/223:15:112
270129941,2cyclictest0-21swapper/219:10:122
270129941,1cyclictest0-21swapper/219:40:122
270129940,4cyclictest7062-21apt-get21:20:222
270129940,4cyclictest17607-21ssh23:09:322
270129940,4cyclictest0-21swapper/223:47:202
270129940,4cyclictest0-21swapper/223:35:162
270129940,4cyclictest0-21swapper/222:55:122
270129940,4cyclictest0-21swapper/222:50:112
270129940,4cyclictest0-21swapper/221:50:122
270129940,4cyclictest0-21swapper/219:18:272
270129940,3cyclictest5864-21/usr/sbin/munin22:20:172
270129940,3cyclictest30420-21memory22:15:172
270129940,3cyclictest21200-21perl22:30:142
270129940,3cyclictest0-21swapper/200:20:142
270129940,1cyclictest25582-21/usr/sbin/munin20:10:212
270129940,1cyclictest16112-21ntp_states00:30:182
270129940,0cyclictest0-21swapper/223:42:582
270129940,0cyclictest0-21swapper/223:14:102
270129940,0cyclictest0-21swapper/221:59:322
270079944,0cyclictest0-21swapper/123:08:091
270079944,0cyclictest0-21swapper/123:04:221
270079944,0cyclictest0-21swapper/121:25:261
270079944,0cyclictest0-21swapper/100:11:281
270079944,0cyclictest0-21swapper/100:11:271
270079941,2cyclictest0-21swapper/123:55:111
270079941,2cyclictest0-21swapper/123:30:011
270079941,2cyclictest0-21swapper/122:35:111
270079941,2cyclictest0-21swapper/122:20:111
270079941,2cyclictest0-21swapper/121:10:131
270079941,2cyclictest0-21swapper/119:30:111
270079941,2cyclictest0-21swapper/119:25:121
270079941,2cyclictest0-21swapper/119:15:111
270079941,2cyclictest0-21swapper/100:35:011
270079941,1cyclictest0-21swapper/121:30:111
270079941,1cyclictest0-21swapper/100:05:121
270079940,4cyclictest0-21swapper/100:19:361
270079940,0cyclictest0-21swapper/123:54:341
270079940,0cyclictest0-21swapper/122:17:491
270029944,0cyclictest0-21swapper/023:10:540
270029944,0cyclictest0-21swapper/022:55:110
270029944,0cyclictest0-21swapper/022:43:160
270029944,0cyclictest0-21swapper/022:25:040
270029944,0cyclictest0-21swapper/021:46:230
270029944,0cyclictest0-21swapper/021:18:270
270029944,0cyclictest0-21swapper/020:34:370
270029944,0cyclictest0-21swapper/020:04:570
270029944,0cyclictest0-21swapper/000:24:320
270029943,1cyclictest30986-21cut19:15:140
270029942,2cyclictest29477-21kworker/0:200:19:350
270029942,1cyclictest8015-21munin-run20:40:000
270029942,1cyclictest13936-21head20:50:160
270029941,3cyclictest740-21snmpd21:52:310
270029941,2cyclictest0-21swapper/023:40:120
270029940,4cyclictest0-21swapper/023:50:120
270029940,4cyclictest0-21swapper/023:22:500
270029940,4cyclictest0-21swapper/022:50:110
270029940,4cyclictest0-21swapper/022:12:350
270029940,4cyclictest0-21swapper/022:05:120
270029940,4cyclictest0-21swapper/022:01:560
270029940,4cyclictest0-21swapper/021:25:020
270029940,4cyclictest0-21swapper/000:01:320
270029940,3cyclictest9140-21ssh23:03:580
270029940,3cyclictest9114-21munin-node19:15:000
270029940,3cyclictest6011-21cat21:40:000
270029940,3cyclictest30551-21/usr/sbin/munin20:20:110
270029940,3cyclictest28184-21taskset22:35:040
270029940,3cyclictest25739-21chrt00:36:170
270029940,3cyclictest11411-21perl20:45:130
270029940,3cyclictest10763-21ssh23:05:100
270029940,3cyclictest0-21swapper/020:25:120
270029940,1cyclictest172782switchtime19:50:210
270029940,1cyclictest0-21swapper/021:31:110
270029940,0cyclictest0-21swapper/022:45:090
270029940,0cyclictest0-21swapper/022:18:490
23163240,0sleep10-21swapper/122:31:001
270179932,1cyclictest15875-21rm00:10:043
270179932,1cyclictest15875-21rm00:10:033
270179931,1cyclictest740-21snmpd21:10:043
270179930,3cyclictest5578-21apt-get19:30:103
270179930,3cyclictest5236-21df22:20:123
270179930,3cyclictest3952-21perl20:30:153
270179930,3cyclictest32398-21users20:20:203
270179930,3cyclictest22583-21expr21:50:133
270179930,3cyclictest12569-21apt22:25:103
270179930,3cyclictest0-21swapper/323:00:033
270179930,3cyclictest0-21swapper/322:50:013
270179930,3cyclictest0-21swapper/322:15:053
270179930,3cyclictest0-21swapper/321:20:233
270179930,3cyclictest0-21swapper/321:00:103
270179930,3cyclictest0-21swapper/320:55:033
270179930,3cyclictest0-21swapper/320:50:033
270179930,3cyclictest0-21swapper/320:25:113
270179930,3cyclictest0-21swapper/320:15:103
270179930,3cyclictest0-21swapper/320:05:113
270179930,3cyclictest0-21swapper/319:55:103
270179930,3cyclictest0-21swapper/319:40:023
270179930,3cyclictest0-21swapper/319:25:003
270179930,3cyclictest0-21swapper/319:10:113
270179930,3cyclictest0-21swapper/300:25:113
270179930,2cyclictest29566-21munin-node20:35:103
270179930,2cyclictest0-21swapper/319:45:123
270129932,1cyclictest740-21snmpd21:15:042
270129932,1cyclictest14170-21/usr/sbin/munin21:45:132
270129932,1cyclictest14019-21hddtemp_smartct20:50:152
270129931,2cyclictest54250irq/130-eth021:25:032
270129931,1cyclictest30745-21apt-get21:35:122
270129931,1cyclictest0-21swapper/223:55:112
270129931,1cyclictest0-21swapper/220:40:112
270129930,3cyclictest20967-21ssh22:10:042
270129930,3cyclictest12175-21df22:45:142
270129930,3cyclictest0-21swapper/223:50:102
270129930,3cyclictest0-21swapper/223:25:112
270129930,3cyclictest0-21swapper/222:35:112
270129930,3cyclictest0-21swapper/222:25:112
270129930,3cyclictest0-21swapper/221:10:022
270129930,3cyclictest0-21swapper/221:00:042
270129930,3cyclictest0-21swapper/220:55:122
270129930,3cyclictest0-21swapper/220:35:052
270129930,3cyclictest0-21swapper/220:20:002
270129930,3cyclictest0-21swapper/220:15:042
270129930,3cyclictest0-21swapper/220:05:122
270129930,3cyclictest0-21swapper/220:00:112
270129930,3cyclictest0-21swapper/219:55:042
270129930,3cyclictest0-21swapper/219:50:102
270129930,3cyclictest0-21swapper/219:45:132
270129930,3cyclictest0-21swapper/219:35:102
270129930,3cyclictest0-21swapper/219:30:102
270129930,3cyclictest0-21swapper/219:20:112
270129930,3cyclictest0-21swapper/200:10:102
270129930,3cyclictest0-21swapper/200:10:102
270129930,3cyclictest0-21swapper/200:05:012
270129930,3cyclictest0-21swapper/200:00:122
270129930,2cyclictest3158-21aten2_r5power_p19:25:112
270129930,1cyclictest0-21swapper/222:05:052
270129930,0cyclictest327-21apt-get20:25:012
270079933,0cyclictest0-21swapper/121:55:161
270079931,2cyclictest0-21swapper/121:20:221
270079931,1cyclictest200612chrt19:55:561
270079931,1cyclictest0-21swapper/123:45:121
270079931,1cyclictest0-21swapper/123:40:131
270079931,1cyclictest0-21swapper/122:50:121
270079931,1cyclictest0-21swapper/122:40:121
270079931,1cyclictest0-21swapper/122:25:121
270079931,1cyclictest0-21swapper/121:40:111
270079931,1cyclictest0-21swapper/121:05:121
270079931,1cyclictest0-21swapper/120:55:111
270079931,1cyclictest0-21swapper/120:45:121
270079931,1cyclictest0-21swapper/120:35:111
270079931,1cyclictest0-21swapper/120:30:111
270079931,1cyclictest0-21swapper/120:10:121
270079931,1cyclictest0-21swapper/100:00:121
270079930,3cyclictest0-21swapper/119:44:181
270079930,2cyclictest9145-21chrt22:01:521
270079930,2cyclictest23338-21chrt22:10:321
270079930,2cyclictest0-21swapper/123:15:031
270079930,2cyclictest0-21swapper/121:35:131
270079930,2cyclictest0-21swapper/120:25:111
270079930,2cyclictest0-21swapper/119:20:121
270029933,0cyclictest29477-21kworker/0:219:40:030
270029932,1cyclictest740-21snmpd21:40:080
270029932,1cyclictest29477-21kworker/0:219:30:080
270029931,1cyclictest740-21snmpd22:30:080
270029930,3cyclictest9840-21ssh23:25:060
270029930,3cyclictest16032-21cat20:55:120
270029930,3cyclictest0-21swapper/023:35:050
270029930,3cyclictest0-21swapper/021:55:050
270029930,3cyclictest0-21swapper/021:20:220
270029930,3cyclictest0-21swapper/021:05:110
270029930,3cyclictest0-21swapper/021:00:100
270029930,3cyclictest0-21swapper/020:40:100
270029930,3cyclictest0-21swapper/020:15:100
270029930,3cyclictest0-21swapper/020:10:110
270029930,3cyclictest0-21swapper/020:05:240
270029930,3cyclictest0-21swapper/019:55:030
270029930,3cyclictest0-21swapper/019:35:110
270029930,3cyclictest0-21swapper/019:25:130
270029930,3cyclictest0-21swapper/019:20:150
270079921,1cyclictest0-21swapper/121:00:111
270079921,1cyclictest0-21swapper/120:20:101
270079921,1cyclictest0-21swapper/119:45:121
270079920,2cyclictest90042sleep100:25:251
270079920,1cyclictest291942sleep119:13:081
270079920,1cyclictest20192sleep123:20:111
270079920,1cyclictest0-21swapper/122:55:151
270079920,1cyclictest0-21swapper/122:45:111
270079920,1cyclictest0-21swapper/121:15:111
270079920,1cyclictest0-21swapper/120:50:111
270079920,1cyclictest0-21swapper/120:40:111
270079920,1cyclictest0-21swapper/120:15:111
270079920,1cyclictest0-21swapper/120:05:111
270079920,1cyclictest0-21swapper/120:00:111
270079920,1cyclictest0-21swapper/119:50:021
270079920,1cyclictest0-21swapper/119:35:101
270079920,1cyclictest0-21swapper/100:30:121
270079920,1cyclictest0-21swapper/100:20:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional