You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-05-12 - 13:20

Intel(R) Core(TM) i3-2310E CPU @ 2.10GHz, Linux 4.19.1-rt3 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Wed May 12, 2021 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1778799139135,2cyclictest22840-21apt-config19:29:470
1778999125122,1cyclictest0-21swapper/219:19:502
1778899125117,7cyclictest0-21swapper/119:19:501
2141721160,0sleep10-21swapper/122:45:021
1779099107105,1cyclictest0-21swapper/319:19:503
17299210745,20sleep30-21swapper/319:17:033
1194021070,1sleep00-21swapper/020:19:480
17318210444,20sleep20-21swapper/219:17:182
17354210242,19sleep00-21swapper/019:17:440
273521000,0sleep20-21swapper/200:09:092
1729728146,21sleep10-21swapper/119:17:011
166182590,1sleep09-21ksoftirqd/020:30:020
17788994031,8cyclictest0-21swapper/119:29:471
160942390,2sleep016092-21perl22:05:090
17789993836,1cyclictest0-21swapper/219:29:472
146072350,0sleep00-21swapper/023:46:140
74422320,4sleep31779099cyclictest23:05:013
11622320,0sleep10-21swapper/100:06:281
1778999300,2cyclictest30145-21ssh22:54:502
17787992924,2cyclictest2669-21munin-run00:44:470
125032280,0sleep10-21swapper/122:00:211
1778799251,22cyclictest7752-21ssh23:40:000
1778799250,23cyclictest17864-21ssh00:24:590
17787992321,1cyclictest0-21swapper/019:19:500
17790992119,1cyclictest0-21swapper/319:29:473
58632180,1sleep0111rcuc/021:54:470
1779099176,2cyclictest28192-21swap00:35:143
1779099171,5cyclictest0-21swapper/323:31:463
325802160,0sleep20-21swapper/221:05:152
1779099165,2cyclictest433-21sh21:48:513
1779099165,2cyclictest17709-21latency_hist00:24:483
1779099165,2cyclictest10110-21seq23:41:293
1779099164,2cyclictest4740-21ssh23:35:243
1779099164,2cyclictest4068-21tr20:00:023
1779099164,2cyclictest25505-21ssh00:32:553
1779099160,6cyclictest0-21swapper/319:35:043
1778799161,8cyclictest0-21swapper/020:29:470
1778799161,13cyclictest20701-21ssh22:44:580
76042150,1sleep07608-21wc22:30:060
1779099156,2cyclictest5557-21diskmemload00:47:093
1779099155,2cyclictest562-21runrttasks19:51:543
1779099155,2cyclictest562-21runrttasks19:51:543
1779099154,2cyclictest9549-21ssh21:23:463
1779099154,2cyclictest24913-21http20:49:473
1779099154,2cyclictest17574-21entropy23:50:023
1779099154,2cyclictest16305-21if_enp5s022:05:123
1779099154,2cyclictest16267-21cat20:29:473
1779099154,2cyclictest12984-21sed22:35:163
1779099154,2cyclictest12984-21sed22:35:163
1779099154,2cyclictest12812-21irqstats23:10:053
1779099154,1cyclictest0-21swapper/323:55:023
1779099154,1cyclictest0-21swapper/300:05:053
1779099153,2cyclictest31753-21gltestperf00:40:043
1779099153,2cyclictest28266-21ssh00:00:213
1779099153,2cyclictest28266-21ssh00:00:213
1779099153,2cyclictest21598-21ssh21:35:233
1779099150,6cyclictest17446-21ssh22:40:113
1779099150,5cyclictest18817-21/usr/sbin/munin20:35:003
1779099150,2cyclictest29301-21basename22:19:473
1779099150,1cyclictest0-21swapper/322:34:393
1778799157,4cyclictest30795-21ssh23:30:010
1778799153,9cyclictest15812-21chrt00:21:580
1779099146,1cyclictest0-21swapper/322:53:223
1779099145,2cyclictest6349-21if_enp4s020:05:043
1779099145,2cyclictest4075-21entropy21:15:013
1779099144,2cyclictest5557-21diskmemload22:58:023
1779099144,2cyclictest4431-21rm22:26:353
1779099144,2cyclictest26001-21if_enp5s020:50:053
1779099144,2cyclictest22591-21wc23:20:093
1779099144,2cyclictest21884-21open_inodes20:40:093
1779099144,2cyclictest15048-21sh21:29:533
1779099143,3cyclictest28176-21sh21:43:503
1779099143,3cyclictest2077-21cut21:10:013
1779099143,2cyclictest9938-21chrt20:14:543
1779099143,2cyclictest9098-21run-parts00:15:073
1779099143,2cyclictest539-21dbus-daemon21:55:133
1779099143,2cyclictest3235-21perf19:59:473
1779099143,2cyclictest32123-21sendmail-mta21:29:273
1779099143,2cyclictest21863-21sendmail_mailqu19:25:173
1779099143,2cyclictest16536-21ssh23:14:533
1779099143,2cyclictest0-21swapper/300:25:063
1779099140,5cyclictest0-21swapper/323:26:263
1779099140,2cyclictest13942-21ssh22:02:493
1778999144,5cyclictest0-21swapper/223:00:592
1778899145,7cyclictest0-21swapper/120:01:111
1778799149,1cyclictest29845-21diskstats19:45:010
1778799148,4cyclictest13350-21ssh21:27:210
1778799144,5cyclictest0-21swapper/022:53:250
1778799141,8cyclictest0-21swapper/019:51:170
1778799141,8cyclictest0-21swapper/019:51:170
1779099134,1cyclictest0-21swapper/323:46:383
1779099134,1cyclictest0-21swapper/323:02:183
1779099134,1cyclictest0-21swapper/322:49:083
1779099133,2cyclictest27709-21fschecks_count19:40:023
1779099132,3cyclictest28440-21snmpd22:23:043
1779099130,8cyclictest0-21swapper/321:06:223
1779099130,2cyclictest6700-21ssh00:12:463
1778999135,3cyclictest0-21swapper/220:20:032
1778999135,2cyclictest0-21swapper/222:09:032
1778999131,2cyclictest0-21swapper/223:05:022
1778999130,11cyclictest0-21swapper/219:59:582
1778899135,6cyclictest0-21swapper/120:29:571
1778899135,4cyclictest0-21swapper/119:54:381
1778899135,4cyclictest0-21swapper/119:54:381
1778899134,7cyclictest0-21swapper/122:15:521
1778899134,4cyclictest0-21swapper/123:56:331
1778899134,3cyclictest0-21swapper/123:37:001
1778899134,3cyclictest0-21swapper/122:26:041
17788991310,1cyclictest0-21swapper/121:56:271
1778899130,3cyclictest19854-21munin-run22:09:471
1778799139,2cyclictest16291-21ntp_states21:30:080
1778799134,6cyclictest0-21swapper/022:40:050
1778799134,5cyclictest2905-21ssh00:09:270
111982130,0sleep10-21swapper/123:09:121
1779099123,2cyclictest22277-21sh22:10:573
1778999127,3cyclictest31370-21tr00:40:022
1778999125,6cyclictest0-21swapper/200:20:072
1778999125,5cyclictest0-21swapper/223:53:152
1778999125,5cyclictest0-21swapper/223:43:392
1778999125,5cyclictest0-21swapper/223:22:332
1778999125,5cyclictest0-21swapper/221:50:042
1778999125,5cyclictest0-21swapper/221:19:082
1778999125,3cyclictest0-21swapper/221:56:452
1778999124,6cyclictest0-21swapper/223:30:042
1778999124,6cyclictest0-21swapper/222:25:052
1778999124,6cyclictest0-21swapper/221:30:372
1778999124,6cyclictest0-21swapper/200:12:162
1778999124,5cyclictest0-21swapper/221:45:412
1778999124,4cyclictest0-21swapper/222:37:582
1778999124,4cyclictest0-21swapper/222:37:582
1778999124,3cyclictest28711-21ssh22:52:592
1778999124,3cyclictest0-21swapper/222:44:312
1778999124,3cyclictest0-21swapper/200:46:502
1778999120,3cyclictest559-21avahi-daemon21:40:112
1778999120,2cyclictest0-21swapper/221:25:052
1778899125,3cyclictest0-21swapper/119:55:051
1778899124,6cyclictest0-21swapper/122:21:161
1778899124,6cyclictest0-21swapper/120:40:041
1778899124,6cyclictest0-21swapper/120:20:021
1778899124,6cyclictest0-21swapper/100:12:161
1778899124,4cyclictest0-21swapper/120:05:261
1778899124,3cyclictest0-21swapper/122:14:271
1778899124,3cyclictest0-21swapper/121:37:351
1778899124,3cyclictest0-21swapper/120:57:191
1778899124,3cyclictest0-21swapper/100:30:251
1778899124,2cyclictest0-21swapper/123:47:451
1778899123,3cyclictest0-21swapper/123:10:051
1778899120,10cyclictest0-21swapper/100:40:001
1778799128,2cyclictest20983-21ssh23:53:560
1778799127,4cyclictest0-21swapper/021:41:510
1778799127,3cyclictest2783-21grep23:00:000
1778799127,2cyclictest0-21swapper/020:03:550
1778799124,5cyclictest0-21swapper/019:35:050
1778799124,3cyclictest0-21swapper/022:35:370
1778799124,3cyclictest0-21swapper/022:35:370
1778799124,2cyclictest0-21swapper/022:17:450
1778799124,2cyclictest0-21swapper/020:56:070
1778799124,2cyclictest0-21swapper/020:07:430
1778799123,5cyclictest0-21swapper/020:46:330
1778799122,5cyclictest0-21swapper/023:21:500
1778799122,5cyclictest0-21swapper/023:10:110
1778799122,2cyclictest17785-21cyclictest00:31:550
1778799121,9cyclictest0-21swapper/021:15:030
1778799120,8cyclictest0-21swapper/021:08:340
82252110,0sleep00-21swapper/020:10:020
1778999117,2cyclictest1541-21cpuspeed_turbos19:55:012
1778999115,5cyclictest0-21swapper/223:12:382
1778999114,6cyclictest0-21swapper/223:59:062
1778999114,5cyclictest25347-21awk22:15:042
1778999114,5cyclictest0-21swapper/223:49:432
1778999114,5cyclictest0-21swapper/223:18:572
1778999114,5cyclictest0-21swapper/221:35:322
1778999114,5cyclictest0-21swapper/219:50:172
1778999114,5cyclictest0-21swapper/219:50:172
1778999114,5cyclictest0-21swapper/200:37:022
1778999114,5cyclictest0-21swapper/200:33:182
1778999114,5cyclictest0-21swapper/200:00:352
1778999114,5cyclictest0-21swapper/200:00:352
1778999113,6cyclictest0-21swapper/220:15:032
1778999113,5cyclictest0-21swapper/200:25:042
1778999113,4cyclictest0-21swapper/219:39:282
1778999112,6cyclictest23879-21memory20:45:102
1778999111,8cyclictest0-21swapper/222:46:382
1778999111,5cyclictest0-21swapper/222:30:052
1778999110,2cyclictest8062-21cpuspeed_turbos20:10:012
1778899117,2cyclictest18700-21unixbench_singl23:50:131
1778899116,3cyclictest5557-21diskmemload21:49:481
1778899116,3cyclictest5557-21diskmemload21:30:121
1778899116,3cyclictest31498-21basename21:04:471
1778899116,3cyclictest26406-21rm22:50:061
1778899116,3cyclictest17508-21idleruntime-cro00:24:481
1778899115,4cyclictest0-21swapper/119:46:081
1778899114,6cyclictest0-21swapper/122:58:171
1778899114,5cyclictest0-21swapper/121:28:501
1778899114,5cyclictest0-21swapper/121:15:281
1778899114,4cyclictest0-21swapper/123:02:291
1778899114,3cyclictest0-21swapper/120:28:481
1778899113,6cyclictest0-21swapper/123:20:041
1778899113,6cyclictest0-21swapper/120:45:071
1778899113,3cyclictest0-21swapper/123:25:021
1778899113,3cyclictest0-21swapper/120:37:331
1778899112,6cyclictest0-21swapper/100:27:521
1778899112,3cyclictest0-21swapper/122:39:461
1778899112,3cyclictest0-21swapper/122:39:461
1778899112,3cyclictest0-21swapper/100:36:191
1778899111,6cyclictest0-21swapper/119:36:551
1778899110,9cyclictest0-21swapper/122:40:001
1778799117,2cyclictest28347-21head00:35:150
1778799115,3cyclictest0-21swapper/022:19:490
1778799114,5cyclictest0-21swapper/020:23:000
1778799114,2cyclictest20192-21apt-get22:09:570
1778799113,5cyclictest0-21swapper/023:15:050
1778799113,3cyclictest0-21swapper/020:35:240
1778799113,3cyclictest0-21swapper/000:46:140
1778799112,5cyclictest0-21swapper/019:40:010
1778799111,5cyclictest0-21swapper/023:57:370
1778799111,5cyclictest0-21swapper/023:35:230
1778799111,5cyclictest0-21swapper/023:28:470
1778799111,5cyclictest0-21swapper/023:06:410
1778799111,5cyclictest0-21swapper/022:54:590
1778799111,5cyclictest0-21swapper/022:25:070
1778799111,5cyclictest0-21swapper/022:00:210
1778799111,5cyclictest0-21swapper/021:57:010
1778799111,5cyclictest0-21swapper/021:48:410
1778799111,5cyclictest0-21swapper/021:35:470
1778799111,5cyclictest0-21swapper/021:23:170
1778799111,5cyclictest0-21swapper/021:10:030
1778799111,5cyclictest0-21swapper/020:43:210
1778799111,5cyclictest0-21swapper/019:55:030
1778799111,5cyclictest0-21swapper/000:15:530
1778799111,5cyclictest0-21swapper/000:13:130
1778799111,5cyclictest0-21swapper/000:01:130
1778799111,5cyclictest0-21swapper/000:01:130
1779099106,2cyclictest3915-21sh21:51:453
1778999108,1cyclictest0-21swapper/223:35:022
1778999106,2cyclictest27530-21cut20:55:002
1778999105,3cyclictest25848-21tr20:50:042
1778999104,4cyclictest0-21swapper/223:25:552
1778999104,4cyclictest0-21swapper/222:00:022
1778999104,4cyclictest0-21swapper/221:20:472
1778999103,6cyclictest0-21swapper/220:25:102
1778999103,5cyclictest0-21swapper/222:19:502
1778999103,5cyclictest0-21swapper/219:48:052
1778999101,7cyclictest0-21swapper/222:09:592
1778999101,7cyclictest0-21swapper/221:10:092
1778999101,7cyclictest0-21swapper/220:39:592
1778999101,7cyclictest0-21swapper/200:14:592
1778999101,2cyclictest0-21swapper/220:30:112
1778899108,1cyclictest0-21swapper/123:39:571
1778899106,3cyclictest25982-21awk21:40:131
1778899106,2cyclictest8930-21grep20:10:111
1778899106,2cyclictest8565-21kworker/1:223:14:581
1778899106,2cyclictest27870-21grep19:40:031
1778899105,3cyclictest28440-21snmpd00:15:161
1778899105,3cyclictest1210-21idleruntime-cro21:09:471
1778899105,3cyclictest0-21swapper/122:31:311
1778899105,3cyclictest0-21swapper/100:00:331
1778899105,3cyclictest0-21swapper/100:00:331
1778899104,5cyclictest0-21swapper/119:25:121
1778899104,4cyclictest0-21swapper/121:14:251
1778899104,3cyclictest0-21swapper/123:31:061
1778899102,4cyclictest0-21swapper/120:49:551
1778899101,6cyclictest10801-21irqstats20:15:061
1778899101,3cyclictest0-21swapper/121:45:051
1778899101,3cyclictest0-21swapper/121:20:081
1778799104,5cyclictest0-21swapper/020:49:590
177909997,1cyclictest0-21swapper/320:13:523
177909995,2cyclictest27470-21tr20:55:003
177909995,2cyclictest12194-21aten2_r8power_p20:19:593
177909990,8cyclictest0-21swapper/319:47:423
177909990,1cyclictest0-21swapper/320:34:023
177899995,2cyclictest30054-21fschecks_count21:00:032
177899992,3cyclictest0-21swapper/219:39:582
177899991,3cyclictest0-21swapper/220:34:592
177899991,2cyclictest0-21swapper/220:05:012
177899991,2cyclictest0-21swapper/219:24:492
177889995,2cyclictest3005-21ssh00:44:591
177879995,2cyclictest101ktimersoftd/021:00:120
177879994,2cyclictest0-21swapper/019:24:510
177909984,2cyclictest29606-21grep21:00:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional