You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-17 - 20:47

Intel(R) Core(TM) i3-2310E CPU @ 2.10GHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack8slot2.osadl.org (updated Fri Sep 17, 2021 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2386599117114,2cyclictest0-21swapper/307:15:033
2386299117115,1cyclictest0-21swapper/007:10:550
23459211345,31sleep20-21swapper/207:09:142
23445210946,31sleep30-21swapper/307:09:033
1442021090,1sleep20-21swapper/211:42:482
23314210445,47sleep10-21swapper/107:07:201
2678821020,0sleep00-21swapper/011:24:500
207542970,1sleep30-21swapper/311:18:563
307292960,0sleep10-21swapper/111:27:521
216662960,0sleep30-21swapper/308:16:213
2330329047,31sleep00-21swapper/007:07:110
23863997971,7cyclictest0-21swapper/107:10:551
23864996764,2cyclictest0-21swapper/207:15:032
225802420,1chrt22568-21apt-get11:21:071
23864993426,6cyclictest3219-21kworker/u8:111:01:592
23864993426,6cyclictest3219-21kworker/u8:111:01:592
12242320,0sleep20-21swapper/212:01:082
217732300,1chrt0-21swapper/309:19:503
2386599290,2cyclictest17365-21ssh10:46:083
55512260,1sleep30-21swapper/308:56:093
313312260,1sleep30-21swapper/309:28:083
2386399260,25cyclictest0-21swapper/108:36:061
234382260,1sleep20-21swapper/210:51:092
2386399251,1cyclictest0-21swapper/110:46:081
2386499231,12cyclictest13548-21grep09:41:212
243752220,0sleep00-21swapper/010:51:190
2386599221,1cyclictest0-21swapper/309:36:083
2386599220,21cyclictest0-21swapper/310:26:073
2386599210,1cyclictest0-21swapper/311:51:133
23863992111,5cyclictest11755-21diskmemload09:38:191
205212190,0chrt0-21swapper/109:18:081
2386499180,8cyclictest20000-21ssh12:18:102
2386499171,14cyclictest0-21swapper/210:36:102
2386299171,9cyclictest32767-21basename12:30:520
2386299171,9cyclictest22374-21munin-run10:20:520
2386499166,8cyclictest17685-21cpu09:16:072
2386499166,8cyclictest14432-21gltestperf08:01:092
2386499166,8cyclictest14432-21gltestperf08:01:092
2386499162,9cyclictest238-21systemd-journal08:51:222
2386499161,8cyclictest27116-21df07:16:112
2386499161,7cyclictest0-21swapper/211:21:182
2386499161,7cyclictest0-21swapper/209:11:072
2386499161,7cyclictest0-21swapper/209:06:122
2386499161,7cyclictest0-21swapper/208:31:152
2386499161,7cyclictest0-21swapper/207:41:142
2386499161,13cyclictest23489-21grep09:51:102
2386499160,9cyclictest17954-21df09:46:122
2386499160,1cyclictest0-21swapper/209:29:022
2386499160,15cyclictest15590-21kworker/u8:011:48:112
2386299161,8cyclictest22440-21munin-run09:50:520
2386299161,8cyclictest17962-21awk08:10:520
2386599155,6cyclictest15474-21ssh10:43:523
2386499155,9cyclictest238-21systemd-journal11:37:192
2386499153,9cyclictest7963-21grep07:46:132
2386499152,10cyclictest1279-21grep08:46:102
2386499151,9cyclictest2281-21latency09:31:152
2386499151,7cyclictest0-21swapper/210:22:392
2386499151,7cyclictest0-21swapper/210:11:172
2386499151,12cyclictest809-21dump-pmu-power08:45:522
2386499151,12cyclictest28964-21grep07:21:082
2386499151,12cyclictest2222-21cut10:31:152
2386499151,12cyclictest20108-21ls08:15:522
2386499151,12cyclictest0-21swapper/211:28:292
2386499151,12cyclictest0-21swapper/208:21:152
2386499151,12cyclictest0-21swapper/208:16:222
2386499150,8cyclictest0-21swapper/210:16:082
2386499150,13cyclictest9456-21munin-plugin-st09:05:522
2386499150,13cyclictest7864-21unixbench-2d12:06:222
2386499150,13cyclictest346-21ssh10:00:192
2386499150,13cyclictest28170-21/usr/sbin/munin10:56:112
2386499150,13cyclictest12511-21grep11:11:162
2386399158,6cyclictest31723-21kworker/u8:012:01:031
2386399157,7cyclictest0-21swapper/110:08:361
2386399150,13cyclictest23676-21cut09:21:151
2386299151,8cyclictest16975-21munin-run10:15:520
2386299150,8cyclictest846-21perf10:00:530
2386599144,5cyclictest0-21swapper/311:46:093
2386599144,5cyclictest0-21swapper/310:36:183
2386499145,7cyclictest1865-21latency11:31:132
2386499141,7cyclictest0-21swapper/210:06:092
2386499141,7cyclictest0-21swapper/208:36:212
2386499141,12cyclictest0-21swapper/211:10:292
2386499141,11cyclictest802-21sh12:31:082
2386499141,11cyclictest802-21sh12:31:082
2386499141,11cyclictest28731-21/usr/sbin/munin10:26:112
2386499141,11cyclictest28456-21sed11:56:112
2386499141,11cyclictest27385-21ls12:25:522
2386499141,11cyclictest13266-21grep12:11:232
2386499141,11cyclictest1199-21/usr/sbin/munin10:01:132
2386499141,11cyclictest11706-21apt-key10:40:522
2386499141,11cyclictest0-21swapper/212:25:572
2386499140,1cyclictest0-21swapper/207:56:062
2386499140,12cyclictest7348-21sed09:36:122
2386499140,12cyclictest5970-21ssh12:35:572
2386499140,12cyclictest32245-21ntpq07:26:162
2386499140,12cyclictest26710-21wc08:30:532
2386499140,12cyclictest23272-21grep09:21:122
2386499140,12cyclictest23004-21sort11:51:162
2386499140,12cyclictest1924-21grep07:31:172
2386499140,12cyclictest17214-21ssh11:16:062
2386399149,2cyclictest0-21swapper/109:05:391
2386399145,4cyclictest0-21swapper/107:18:501
2386399144,5cyclictest31756-21diskstats08:41:111
2386399144,5cyclictest26555-21sh11:54:431
2386399143,8cyclictest21792-21ssh11:50:351
23863991410,2cyclictest0-21swapper/110:16:351
2386299144,5cyclictest0-21swapper/011:16:130
2386299142,7cyclictest2752-21sh11:31:350
2386599134,4cyclictest6277-21apt-get11:36:053
2386599133,5cyclictest0-21swapper/312:17:063
2386599133,5cyclictest0-21swapper/307:37:463
2386599132,6cyclictest0-21swapper/308:23:173
2386499132,9cyclictest5586-21cut08:56:092
2386499131,10cyclictest16058-21aten2_r8power_c08:06:062
2386499130,8cyclictest11755-21diskmemload10:46:042
2386499130,11cyclictest9799-21grep07:51:092
2386499130,11cyclictest3526-21cut07:36:112
2386399138,4cyclictest0-21swapper/107:30:131
2386399137,5cyclictest0-21swapper/109:30:051
2386399136,5cyclictest7299-21tr09:00:521
2386399134,8cyclictest3321-21ssh11:32:231
2386399134,8cyclictest0-21swapper/111:11:571
2386399134,7cyclictest4243-21ssh10:03:111
2386399133,5cyclictest14843-21ssh12:13:291
2386399132,8cyclictest22-21ksoftirqd/108:23:411
2386299137,4cyclictest16644-21cron11:45:520
2386299133,5cyclictest1944-21ntp_states12:01:150
107932130,1chrt0-21swapper/011:09:590
2386599126,4cyclictest14336-21uniq08:01:083
2386599126,4cyclictest14336-21uniq08:01:083
2386599125,6cyclictest0-21swapper/311:13:563
2386599125,5cyclictest26617-21awk08:30:533
2386599124,5cyclictest0-21swapper/310:03:473
2386599124,3cyclictest0-21swapper/307:32:223
2386599123,7cyclictest238-21systemd-journal12:26:583
2386599122,6cyclictest27342-21ssh10:25:183
2386599121,6cyclictest0-21swapper/311:02:583
2386599121,6cyclictest0-21swapper/311:02:583
2386399127,3cyclictest12140-21sh09:41:111
2386399125,5cyclictest6327-21apt-get12:06:091
2386399125,5cyclictest11360-21grep09:06:221
2386399124,8cyclictest0-21swapper/112:37:471
2386399124,5cyclictest590-21snmpd08:34:331
2386399124,5cyclictest0-21swapper/110:29:111
2386399124,5cyclictest0-21swapper/109:51:191
2386399124,5cyclictest0-21swapper/109:47:291
2386399124,3cyclictest0-21swapper/111:09:431
2386399124,3cyclictest0-21swapper/110:21:091
2386399123,4cyclictest3697-21ssh09:32:211
2386399123,4cyclictest31539-21ssh11:59:111
2386399123,4cyclictest11316-21ssh10:40:461
2386399122,5cyclictest31217-21ssh09:58:071
2386399122,5cyclictest20794-21ssh12:19:161
2386399122,5cyclictest0-21swapper/107:34:131
2386399120,7cyclictest15377-21ssh09:13:271
2386299126,4cyclictest8480-21ntpq07:46:230
2386299126,4cyclictest6319-21tr11:36:060
2386299125,5cyclictest9238-21ssh12:38:220
2386299125,5cyclictest0-21swapper/010:48:550
2386299124,7cyclictest0-21swapper/009:39:200
2386299124,3cyclictest0-21swapper/012:06:150
2386299123,4cyclictest0-21swapper/012:20:190
2386299120,10cyclictest29037-21apt-config08:35:530
2386599117,2cyclictest3430-21grep08:51:093
2386599116,3cyclictest27948-21sh09:25:523
2386599115,5cyclictest0-21swapper/312:37:493
2386599114,6cyclictest0-21swapper/312:21:103
2386599114,5cyclictest24127-21cat11:21:233
2386599114,5cyclictest0-21swapper/312:01:573
2386599114,5cyclictest0-21swapper/311:43:263
2386599114,5cyclictest0-21swapper/309:34:013
2386599114,5cyclictest0-21swapper/309:14:433
2386599113,5cyclictest0-21swapper/310:20:093
2386599113,5cyclictest0-21swapper/309:54:383
2386599112,8cyclictest0-21swapper/311:32:473
2386599112,4cyclictest28167-21ssh09:56:023
2386599111,6cyclictest26032-21munin-node07:15:543
2386599111,3cyclictest7968-21grep12:06:233
2386599111,3cyclictest6847-21cpuspeed_turbos10:06:083
2386599110,4cyclictest29767-21unixbench_multi10:56:203
2386599110,4cyclictest17105-21ntpq08:06:133
2386599110,4cyclictest13473-21smicount10:11:213
2386399117,4cyclictest0-21swapper/110:34:071
2386399117,3cyclictest14850irq/32-ahci[00012:31:101
2386399117,3cyclictest14850irq/32-ahci[00012:31:101
2386399116,5cyclictest0-21swapper/108:12:211
2386399116,4cyclictest0-21swapper/107:56:091
2386399116,4cyclictest0-21swapper/107:53:331
2386399116,3cyclictest6303-21ntp_kernel_pll_07:41:211
2386399115,5cyclictest23640-21ssh10:51:111
2386399115,5cyclictest0-21swapper/108:55:151
2386399115,5cyclictest0-21swapper/108:09:091
2386399115,4cyclictest6513-21grep11:36:071
2386399115,4cyclictest21785-21grep08:16:211
2386399114,6cyclictest0-21swapper/110:57:531
2386399113,8cyclictest0-21swapper/112:21:171
2386399113,6cyclictest16378-21ssh10:45:071
2386399113,3cyclictest0-21swapper/111:04:161
2386399113,3cyclictest0-21swapper/111:04:161
2386399112,4cyclictest15406-21users08:01:191
2386399112,4cyclictest15406-21users08:01:191
2386399111,5cyclictest0-21swapper/111:41:091
2386399111,4cyclictest590-21snmpd12:26:581
2386299117,2cyclictest603-21runrttasks07:25:540
2386299116,4cyclictest0-21swapper/009:25:100
2386299116,3cyclictest11755-21diskmemload10:29:450
2386299115,5cyclictest0-21swapper/007:23:000
2386299115,4cyclictest6172-21ls07:41:190
2386299115,4cyclictest12739-21expr09:11:090
2386299115,4cyclictest12283-21head12:11:150
2386299115,4cyclictest11447-21http10:40:520
2386299114,5cyclictest32382-21ssh12:00:210
2386299114,5cyclictest26706-21cut07:16:090
2386299114,4cyclictest0-21swapper/008:47:090
2386299112,4cyclictest12562-21df10:41:220
2386299111,5cyclictest0-21swapper/010:04:500
2386299111,5cyclictest0-21swapper/007:53:340
2386299110,1cyclictest0-21swapper/007:36:180
2386599106,3cyclictest8266-21latency07:46:203
2386599106,2cyclictest11755-21diskmemload09:45:543
2386599105,4cyclictest0-21swapper/309:05:553
2386599105,3cyclictest31747-21gltestperf07:26:103
2386599105,3cyclictest27079-21cpuspeed_turbos08:31:093
2386599105,3cyclictest11451-21sh07:55:523
2386599104,5cyclictest0-21swapper/312:11:573
2386599104,5cyclictest0-21swapper/310:31:583
2386599104,5cyclictest0-21swapper/309:05:103
2386599104,5cyclictest0-21swapper/308:46:483
2386599104,4cyclictest5688-21fschecks_count07:41:153
2386599104,4cyclictest29741-21sh11:56:423
2386599104,4cyclictest27146-21sh10:54:593
2386599104,4cyclictest1060-21cstates12:31:083
2386599104,4cyclictest1060-21cstates12:31:083
2386599104,4cyclictest0-21swapper/307:22:033
2386599103,5cyclictest590-21snmpd08:14:173
2386599103,5cyclictest0-21swapper/309:41:563
2386599103,5cyclictest0-21swapper/307:56:023
2386599101,5cyclictest27914-21ssh11:26:043
2386599101,3cyclictest7706-21grep11:06:123
2386599100,5cyclictest0-21swapper/308:36:123
2386599100,4cyclictest31495-21cpu08:41:093
2386399105,5cyclictest0-21swapper/107:21:591
2386399105,4cyclictest0-21swapper/107:35:571
2386399104,5cyclictest0-21swapper/108:46:011
2386399104,4cyclictest7571-21tr07:46:101
2386399103,5cyclictest590-21snmpd10:11:301
2386399103,5cyclictest0-21swapper/108:29:391
2386399101,3cyclictest17773-21fschecks_time11:16:111
2386299107,2cyclictest23087-21cstates10:21:080
2386299107,2cyclictest1738-21kernelversion07:31:150
2386299106,2cyclictest916-21idleruntime-cro09:30:520
2386299106,2cyclictest2054-21if_eno109:31:130
2386299105,4cyclictest238-21systemd-journal08:44:080
2386299105,4cyclictest0-21swapper/011:03:070
2386299105,4cyclictest0-21swapper/011:03:070
2386299105,3cyclictest9045-21sh10:07:230
2386299105,3cyclictest6514-21tr08:56:170
2386299105,3cyclictest29097-21ntpq11:26:150
2386299105,3cyclictest2468-21awk10:31:180
2386299105,3cyclictest18827-21head08:11:120
2386299105,3cyclictest14135-21sh11:12:120
2386299104,5cyclictest0-21swapper/008:38:540
2386299104,5cyclictest0-21swapper/008:30:330
2386299104,4cyclictest29390-21sh10:56:170
2386299104,4cyclictest25376-21sh09:52:300
2386299104,4cyclictest23098-21grep11:51:160
2386299104,4cyclictest22996-21head12:21:100
2386299104,4cyclictest22808-21tr08:21:050
2386299104,4cyclictest20625-21grep08:16:100
2386299104,4cyclictest0-21swapper/009:08:520
2386299103,5cyclictest0-21swapper/008:51:270
2386299103,5cyclictest0-21swapper/008:01:110
2386299103,5cyclictest0-21swapper/008:01:110
2386299100,9cyclictest0-21swapper/011:47:130
238629995,3cyclictest10141-1kworker/u9:109:16:100
238629994,3cyclictest8993-21grep09:01:190
238629994,3cyclictest751-21cut12:31:070
238629994,3cyclictest751-21cut12:31:070
238629993,5cyclictest0-21swapper/007:56:120
238629993,4cyclictest14738-21rm09:42:410
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional