You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-27 - 00:36

x86 Intel Core i5-6440EQ @2700 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #5, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Sun Jun 26, 2022 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
223922202184,13sleep00-21swapper/007:05:060
242842200183,12sleep10-21swapper/107:05:431
246032187172,11sleep20-21swapper/207:09:502
245332186168,13sleep30-21swapper/307:08:583
154152510,0sleep00-21swapper/011:02:190
12142510,0sleep00-21swapper/009:36:120
47672500,0sleep10-21swapper/110:55:241
115442490,0sleep30-21swapper/311:20:003
18902420,0sleep10-21swapper/110:54:441
192602120,0sleep10-21swapper/112:03:061
317622100,0sleep10-21swapper/110:14:251
254242100,0sleep025425-21/usr/sbin/munin09:50:380
247849990,7cyclictest0-21swapper/010:30:120
247849971,3cyclictest5623-21idleruntime-cro07:35:000
247849970,4cyclictest9507-21awk10:40:010
247849960,5cyclictest0-21swapper/011:25:110
247849960,3cyclictest13352-21cron12:00:000
247989955,0cyclictest32154-21kworker/3:010:08:323
247989955,0cyclictest0-21swapper/312:37:343
247989955,0cyclictest0-21swapper/311:30:393
247989950,5cyclictest0-21swapper/312:20:423
247989950,5cyclictest0-21swapper/312:07:363
247989950,5cyclictest0-21swapper/312:00:103
247989950,5cyclictest0-21swapper/310:31:433
247989950,5cyclictest0-21swapper/307:45:163
247989950,4cyclictest0-21swapper/310:55:113
247989950,4cyclictest0-21swapper/309:50:223
247989950,4cyclictest0-21swapper/309:30:143
247989950,0cyclictest3876-21ssh11:54:143
247989950,0cyclictest0-21swapper/309:24:043
247949952,1cyclictest0-21swapper/208:30:102
247949950,5cyclictest0-21swapper/211:41:002
247949950,5cyclictest0-21swapper/210:45:072
247949950,5cyclictest0-21swapper/210:18:302
247949950,0cyclictest0-21swapper/209:31:562
247889951,2cyclictest0-21swapper/111:10:131
247889950,5cyclictest0-21swapper/111:49:051
247889950,5cyclictest0-21swapper/111:08:221
247889950,5cyclictest0-21swapper/109:44:421
247849955,0cyclictest0-21swapper/011:42:380
247849955,0cyclictest0-21swapper/010:25:400
247849954,1cyclictest30590-21latency_hist07:20:010
247849950,5cyclictest0-21swapper/012:27:180
247849950,5cyclictest0-21swapper/012:23:050
247849950,5cyclictest0-21swapper/010:47:300
247849950,5cyclictest0-21swapper/007:14:110
23741250,1sleep20-21swapper/209:50:162
4834240,0sleep00-21swapper/010:55:280
247989944,0cyclictest32154-21kworker/3:009:46:113
247989944,0cyclictest32154-21kworker/3:008:38:583
247989944,0cyclictest0-21swapper/311:26:523
247989944,0cyclictest0-21swapper/311:14:213
247989944,0cyclictest0-21swapper/310:47:003
247989944,0cyclictest0-21swapper/310:38:513
247989944,0cyclictest0-21swapper/310:15:433
247989944,0cyclictest0-21swapper/308:15:223
247989944,0cyclictest0-21swapper/307:10:023
247989942,1cyclictest32183-21grep07:20:183
247989941,1cyclictest0-21swapper/311:00:123
247989940,4cyclictest26686-21seq10:50:073
247989940,4cyclictest2234-21ssh12:31:353
247989940,4cyclictest19270-21hddtemp_smartct08:00:143
247989940,4cyclictest0-21swapper/312:15:163
247989940,4cyclictest0-21swapper/311:45:113
247989940,4cyclictest0-21swapper/311:35:103
247989940,4cyclictest0-21swapper/309:15:113
247989940,4cyclictest0-21swapper/309:10:133
247989940,4cyclictest0-21swapper/307:55:013
247989940,3cyclictest9979-21irqstats10:20:173
247989940,3cyclictest826-21latency_hist08:30:003
247989940,3cyclictest7335-21sh09:40:143
247989940,3cyclictest6268-21sort09:40:013
247989940,3cyclictest27561-21sed07:15:023
247989940,3cyclictest26695-21users10:10:233
247989940,3cyclictest23852-21irqstats12:25:153
247989940,3cyclictest2336-21ntp_states08:30:173
247989940,3cyclictest0-21swapper/311:55:013
247989940,3cyclictest0-21swapper/308:45:113
247989940,1cyclictest14264-21irqstats07:50:173
247989940,1cyclictest13139-21ntp_states11:20:183
247949944,0cyclictest0-21swapper/212:32:562
247949944,0cyclictest0-21swapper/211:31:592
247949944,0cyclictest0-21swapper/210:50:482
247949944,0cyclictest0-21swapper/210:43:142
247949944,0cyclictest0-21swapper/209:15:302
247949944,0cyclictest0-21swapper/207:35:222
247949943,1cyclictest9710-21needreboot08:45:182
247949942,1cyclictest6498-21find09:40:012
247949942,1cyclictest0-21swapper/208:40:122
247949940,4cyclictest8057-21ssh11:55:482
247949940,4cyclictest0-21swapper/212:35:112
247949940,4cyclictest0-21swapper/212:14:542
247949940,4cyclictest0-21swapper/212:08:212
247949940,4cyclictest0-21swapper/211:50:112
247949940,4cyclictest0-21swapper/211:35:102
247949940,4cyclictest0-21swapper/211:15:122
247949940,4cyclictest0-21swapper/211:00:132
247949940,4cyclictest0-21swapper/210:37:332
247949940,4cyclictest0-21swapper/210:25:032
247949940,4cyclictest0-21swapper/210:20:112
247949940,4cyclictest0-21swapper/209:35:132
247949940,4cyclictest0-21swapper/209:20:122
247949940,4cyclictest0-21swapper/208:55:112
247949940,4cyclictest0-21swapper/207:40:122
247949940,3cyclictest30201-21sh11:10:522
247949940,3cyclictest26371-21df08:15:172
247949940,3cyclictest21137-21/usr/sbin/munin11:45:122
247949940,1cyclictest881-21/usr/sbin/munin07:25:132
247949940,1cyclictest3533-21/usr/sbin/munin08:35:152
247949940,1cyclictest1074-21tr09:55:202
247949940,0cyclictest0-21swapper/209:47:302
247889944,0cyclictest0-21swapper/109:21:161
247889941,2cyclictest0-21swapper/112:20:111
247889941,2cyclictest0-21swapper/112:05:121
247889941,2cyclictest0-21swapper/111:55:011
247889941,2cyclictest0-21swapper/111:40:121
247889941,2cyclictest0-21swapper/111:25:111
247889941,2cyclictest0-21swapper/110:35:141
247889941,2cyclictest0-21swapper/109:00:111
247889941,2cyclictest0-21swapper/108:55:121
247889941,2cyclictest0-21swapper/108:25:121
247889941,2cyclictest0-21swapper/108:20:111
247889941,2cyclictest0-21swapper/108:10:111
247889941,2cyclictest0-21swapper/107:55:111
247889941,2cyclictest0-21swapper/107:45:111
247889941,1cyclictest0-21swapper/109:10:131
247889941,1cyclictest0-21swapper/107:40:121
247889940,4cyclictest0-21swapper/112:35:401
247889940,4cyclictest0-21swapper/109:55:101
247889940,4cyclictest0-21swapper/109:25:461
247889940,0cyclictest0-21swapper/110:05:391
247889940,0cyclictest0-21swapper/110:00:421
247889940,0cyclictest0-21swapper/107:35:031
247849944,0cyclictest0-21swapper/011:09:540
247849944,0cyclictest0-21swapper/010:51:160
247849944,0cyclictest0-21swapper/010:03:590
247849942,2cyclictest478-21irqbalance09:46:150
247849942,1cyclictest1753-21ssh11:52:320
247849941,2cyclictest0-21swapper/012:30:100
247849941,2cyclictest0-21swapper/007:35:110
247849940,4cyclictest6755-21ssh11:35:380
247849940,4cyclictest0-21swapper/012:10:110
247849940,4cyclictest0-21swapper/011:20:110
247849940,4cyclictest0-21swapper/011:18:380
247849940,4cyclictest0-21swapper/009:25:130
247849940,4cyclictest0-21swapper/009:18:350
247849940,4cyclictest0-21swapper/008:50:110
247849940,4cyclictest0-21swapper/008:45:110
247849940,4cyclictest0-21swapper/008:00:260
247849940,4cyclictest0-21swapper/007:55:010
247849940,4cyclictest0-21swapper/007:49:410
247849940,3cyclictest7661-21cat10:00:010
247849940,3cyclictest6079-21df_inode09:20:140
247849940,3cyclictest3112-21ssh10:15:490
247849940,3cyclictest15740-21date07:55:000
247849940,3cyclictest13358-21rm12:19:260
247849940,3cyclictest10565-21latency_hist07:45:000
247849940,0cyclictest29068-21perf09:15:010
17699240,0sleep30-21swapper/311:42:473
17481240,0sleep20-21swapper/209:26:372
16149240,0sleep10-21swapper/111:22:141
247989931,1cyclictest726-21runrttasks12:10:083
247989931,1cyclictest1607-21fschecks_time07:25:143
247989930,3cyclictest7889-21ssh10:00:093
247989930,3cyclictest3773-21expr07:30:133
247989930,3cyclictest32011-21apt-get09:55:133
247989930,3cyclictest23829-21cat08:10:143
247989930,3cyclictest18411-21apt-get09:05:113
247989930,3cyclictest13873-21apt-get09:25:133
247989930,3cyclictest0-21swapper/311:05:113
247989930,3cyclictest0-21swapper/310:40:123
247989930,3cyclictest0-21swapper/310:25:043
247989930,3cyclictest0-21swapper/309:00:063
247989930,3cyclictest0-21swapper/308:55:103
247989930,3cyclictest0-21swapper/308:50:123
247989930,3cyclictest0-21swapper/308:20:113
247989930,3cyclictest0-21swapper/308:05:103
247989930,3cyclictest0-21swapper/307:40:123
247989930,3cyclictest0-21swapper/307:35:103
247989930,2cyclictest6304-21/usr/sbin/munin08:40:133
247949932,1cyclictest740-21snmpd12:25:032
247949932,1cyclictest740-21snmpd08:20:022
247949932,1cyclictest740-21snmpd07:45:102
247949932,1cyclictest27582-21users07:15:012
247949931,1cyclictest3357-21/usr/sbin/munin07:30:152
247949931,1cyclictest0-21swapper/209:00:102
247949931,1cyclictest0-21swapper/207:20:102
247949930,3cyclictest6213-21ssh12:15:102
247949930,3cyclictest25739-21hddtemp_smartct07:10:142
247949930,3cyclictest0-21swapper/211:25:012
247949930,3cyclictest0-21swapper/211:20:112
247949930,3cyclictest0-21swapper/211:05:002
247949930,3cyclictest0-21swapper/210:55:122
247949930,3cyclictest0-21swapper/210:30:122
247949930,3cyclictest0-21swapper/209:10:032
247949930,3cyclictest0-21swapper/209:05:012
247949930,3cyclictest0-21swapper/208:50:112
247949930,3cyclictest0-21swapper/208:25:012
247949930,3cyclictest0-21swapper/208:10:112
247949930,3cyclictest0-21swapper/208:05:002
247949930,3cyclictest0-21swapper/208:00:112
247949930,3cyclictest0-21swapper/207:55:022
247949930,3cyclictest0-21swapper/207:50:232
247949930,1cyclictest7905-21ssh10:00:112
247949930,1cyclictest15933-21ntp_states12:20:172
247949930,1cyclictest0-21swapper/210:05:092
247949930,0cyclictest13804-21apt-get12:00:102
247949930,0cyclictest0-21swapper/210:10:122
247889933,0cyclictest0-21swapper/110:33:431
247889933,0cyclictest0-21swapper/109:31:531
247889931,2cyclictest0-21swapper/112:30:111
247889931,2cyclictest0-21swapper/109:45:131
247889931,1cyclictest0-21swapper/112:15:151
247889931,1cyclictest0-21swapper/111:00:121
247889931,1cyclictest0-21swapper/110:25:121
247889931,1cyclictest0-21swapper/110:15:111
247889931,1cyclictest0-21swapper/109:35:121
247889931,1cyclictest0-21swapper/109:05:111
247889931,1cyclictest0-21swapper/108:30:101
247889931,1cyclictest0-21swapper/108:15:141
247889931,1cyclictest0-21swapper/108:05:101
247889931,1cyclictest0-21swapper/108:00:121
247889931,1cyclictest0-21swapper/107:50:121
247889931,1cyclictest0-21swapper/107:30:121
247889931,1cyclictest0-21swapper/107:20:101
247889931,1cyclictest0-21swapper/107:10:111
247889930,2cyclictest0-21swapper/112:10:111
247889930,2cyclictest0-21swapper/111:35:111
247889930,2cyclictest0-21swapper/109:15:121
247889930,2cyclictest0-21swapper/108:45:111
247849932,1cyclictest740-21snmpd08:41:010
247849932,1cyclictest740-21snmpd08:30:050
247849932,1cyclictest21262-21aten2_r5power_v11:45:130
247849931,1cyclictest740-21snmpd11:10:050
247849931,1cyclictest740-21snmpd10:40:080
247849931,1cyclictest22250-21apt-get09:30:120
247849930,3cyclictest740-21snmpd12:35:110
247849930,3cyclictest6422-21apt-config09:40:010
247849930,3cyclictest32106-21ntp_states07:20:170
247849930,3cyclictest29613-21ntp_states08:20:190
247849930,3cyclictest22667-21rm12:05:130
247849930,3cyclictest13694-21ssh12:00:050
247849930,3cyclictest10291-21ntp_states10:20:180
247849930,3cyclictest0-21swapper/011:30:100
247849930,3cyclictest0-21swapper/010:10:120
247849930,3cyclictest0-21swapper/010:05:120
247849930,3cyclictest0-21swapper/009:05:110
247849930,3cyclictest0-21swapper/009:00:110
247849930,3cyclictest0-21swapper/008:55:130
247849930,3cyclictest0-21swapper/008:35:120
247849930,3cyclictest0-21swapper/008:25:010
247849930,3cyclictest0-21swapper/008:15:140
247849930,3cyclictest0-21swapper/008:10:110
247849930,3cyclictest0-21swapper/008:05:110
247849930,3cyclictest0-21swapper/007:25:110
23534230,0sleep10-21swapper/110:47:471
247889921,1cyclictest0-21swapper/112:25:101
247889921,1cyclictest0-21swapper/111:50:111
247889921,1cyclictest0-21swapper/108:35:111
247889920,1cyclictest32202sleep111:15:021
247889920,1cyclictest0-21swapper/111:30:101
247889920,1cyclictest0-21swapper/110:40:121
247889920,1cyclictest0-21swapper/110:20:011
247889920,1cyclictest0-21swapper/109:50:021
247889920,1cyclictest0-21swapper/108:50:121
247889920,1cyclictest0-21swapper/108:40:111
247889920,1cyclictest0-21swapper/107:25:111
247889920,1cyclictest0-21swapper/107:15:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional