You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-08 - 04:19

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack8slot2.osadl.org (updated Wed Feb 08, 2023 00:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
124099125122,2cyclictest0-21swapper/320:16:193
31319211045,32sleep00-21swapper/019:06:250
123799106104,1cyclictest0-21swapper/019:11:330
1239999492,1cyclictest0-21swapper/219:11:332
41029340,41sleep30-21swapper/319:06:443
3132029250,31sleep10-21swapper/119:06:261
99062910,1sleep19903-21grep19:26:491
52328947,31sleep20-21swapper/219:07:552
1238998978,9cyclictest29935-21apt-get20:16:191
92312840,0sleep00-21swapper/022:01:390
162572840,0sleep30-21swapper/322:08:473
225952820,0sleep00-21swapper/023:16:500
316992810,0sleep30-21swapper/300:31:203
119625825,23sleep30-21swapper/319:11:213
84482320,1sleep20-21swapper/220:37:082
170162290,0sleep10-21swapper/122:41:241
321132280,0sleep20-21swapper/223:57:042
124099270,1cyclictest0-21swapper/300:01:183
231632240,0chrt0-21swapper/321:11:443
123899231,20cyclictest0-21swapper/120:01:331
8592210,1sleep10-21swapper/123:58:471
123999210,1cyclictest0-21swapper/221:01:332
124099200,10cyclictest23511-21apt-get22:16:273
124099194,14cyclictest0-21swapper/320:01:333
124099192,5cyclictest19031-21idleruntime22:11:373
124099191,9cyclictest1054-21ssh21:21:433
123799196,7cyclictest26833-21munin-run21:16:160
124099185,12cyclictest0-21swapper/300:21:353
124099182,12cyclictest0-21swapper/322:56:433
124099178,8cyclictest0-21swapper/300:16:353
124099175,10cyclictest3293-21iwlist20:26:413
124099173,10cyclictest0-21swapper/321:56:173
1240991710,6cyclictest0-21swapper/300:06:333
124099164,9cyclictest2151-21ssh00:00:433
124099161,5cyclictest0-21swapper/322:25:053
124099161,11cyclictest0-21swapper/319:23:533
123899161,5cyclictest0-21swapper/122:31:401
123799161,8cyclictest4491-21perf20:31:170
123799161,8cyclictest0-21swapper/020:51:170
124099156,8cyclictest0-21swapper/323:43:573
124099156,8cyclictest0-21swapper/322:41:373
124099155,8cyclictest0-21swapper/321:36:373
124099154,5cyclictest0-21swapper/319:16:333
124099151,1cyclictest0-21swapper/323:29:033
124099150,1cyclictest0-21swapper/323:07:333
123899155,5cyclictest0-21swapper/121:23:381
123799150,8cyclictest2600-21idleruntime-cro00:01:170
124099148,5cyclictest0-21swapper/323:16:053
124099148,5cyclictest0-21swapper/320:36:253
124099146,5cyclictest0-21swapper/323:32:093
124099146,5cyclictest0-21swapper/322:55:313
124099145,8cyclictest0-21swapper/322:26:593
124099145,8cyclictest0-21swapper/321:33:093
124099142,9cyclictest0-21swapper/300:11:303
123999140,7cyclictest28-21ksoftirqd/221:31:162
123999140,1cyclictest0-21swapper/200:36:142
123899147,5cyclictest12297-21cron00:11:171
123899144,5cyclictest0-21swapper/122:00:361
123899144,5cyclictest0-21swapper/121:51:241
1237991410,2cyclictest564-21runrttasks21:26:360
124099138,4cyclictest0-21swapper/320:51:353
124099137,5cyclictest0-21swapper/323:18:253
124099135,2cyclictest12973-21latency22:36:383
124099134,8cyclictest0-21swapper/323:50:233
124099134,8cyclictest0-21swapper/323:03:273
124099134,8cyclictest0-21swapper/322:31:273
124099134,8cyclictest0-21swapper/321:44:533
124099134,8cyclictest0-21swapper/321:26:493
124099134,8cyclictest0-21swapper/321:07:293
124099134,8cyclictest0-21swapper/319:29:353
124099133,9cyclictest0-21swapper/320:56:413
124099131,9cyclictest0-21swapper/300:29:253
1240991310,2cyclictest8493-21expr22:01:333
124099130,6cyclictest8099-21ssh00:41:053
124099130,1cyclictest0-21swapper/323:21:173
123999139,2cyclictest13526-21grep22:06:322
123999138,4cyclictest519-21dbus-daemon00:21:162
123999130,1cyclictest0-21swapper/223:16:482
123899137,4cyclictest5969-21cron19:21:161
123899137,4cyclictest11288-21sed21:31:421
123899134,8cyclictest0-21swapper/122:57:531
123899134,4cyclictest23740-21ssh23:18:301
123899133,8cyclictest0-21swapper/123:49:161
123899133,5cyclictest0-21swapper/120:40:281
123899133,5cyclictest0-21swapper/119:23:381
123799136,5cyclictest23502-21ntpq22:46:420
123799131,3cyclictest19528-21awk23:46:170
124099128,2cyclictest9681-21sed20:41:343
124099127,3cyclictest0-21swapper/320:21:293
124099126,5cyclictest0-21swapper/321:58:493
124099125,6cyclictest0-21swapper/320:14:353
124099125,6cyclictest0-21swapper/319:40:293
124099124,2cyclictest22285-21latency19:56:433
124099123,8cyclictest22156-21ssh22:46:213
124099123,8cyclictest0-21swapper/319:54:573
1240991210,1cyclictest0-21swapper/321:48:173
123999127,3cyclictest2826-21grep20:26:362
123999124,6cyclictest0-21swapper/221:51:352
123999121,2cyclictest14420-21latency_hist23:41:172
123999121,2cyclictest14420-21latency_hist23:41:172
123899128,2cyclictest4966-21tr20:31:351
123899127,3cyclictest313-21wc23:26:481
123899127,3cyclictest20460-21idleruntime-cro23:16:171
123899125,5cyclictest0-21swapper/120:48:341
123899123,8cyclictest0-21swapper/122:48:411
123899123,8cyclictest0-21swapper/120:14:331
123799127,3cyclictest3131-21aten2_r8power_c21:56:330
123799127,3cyclictest2173-21perf20:26:170
123799127,3cyclictest13592-21tr20:51:320
123799126,4cyclictest15833-21tr23:11:340
123799125,6cyclictest10992-21perf20:46:170
123799125,5cyclictest621-21lldpd20:06:280
123799125,4cyclictest0-21swapper/000:09:190
123799124,3cyclictest0-21swapper/022:51:380
123799123,4cyclictest0-21swapper/021:41:390
123799121,7cyclictest0-21swapper/020:56:410
123799120,11cyclictest0-21swapper/000:36:190
123799120,10cyclictest3520-21idleruntime-cro00:36:160
11922123,6sleep10-21swapper/119:11:191
124099119,1cyclictest0-21swapper/323:51:433
124099113,3cyclictest0-21swapper/321:16:323
124099113,3cyclictest0-21swapper/321:05:263
124099112,6cyclictest17069-21apt-get19:46:323
124099110,9cyclictest0-21swapper/323:36:373
124099110,9cyclictest0-21swapper/323:36:373
124099110,5cyclictest11005-21runrttasks19:31:373
123999116,4cyclictest519-21dbus-daemon22:41:162
123999116,4cyclictest32258-21if_enp4s023:26:422
123999116,4cyclictest23923-21tr20:01:342
123999115,5cyclictest1352-21awk20:21:392
123999115,4cyclictest6981-21awk22:31:362
123999115,4cyclictest6253-21apt19:21:322
123999115,4cyclictest5986-21fschecks_count23:01:372
123999115,4cyclictest586-21snmpd22:46:202
123999115,4cyclictest3525-21head19:16:222
123999115,4cyclictest32560-21grep21:21:362
123999115,4cyclictest20271-21cat21:06:332
123999115,4cyclictest15081-21cat21:36:282
123999115,4cyclictest13487-21cut20:51:312
123999114,1cyclictest0-21swapper/221:57:262
123999113,7cyclictest26206-21aten2_r8power_c23:21:372
123999110,5cyclictest22265-21wget21:11:362
123899116,3cyclictest5793-21tr23:01:361
123899116,3cyclictest22285-21latency19:56:431
123899115,5cyclictest0-21swapper/123:53:491
123899115,5cyclictest0-21swapper/123:42:091
123899115,5cyclictest0-21swapper/120:31:101
123899115,4cyclictest689-21uniq20:21:331
123899115,4cyclictest28641-21sed22:51:401
123899115,4cyclictest231-21systemd-journal23:41:171
123899115,4cyclictest231-21systemd-journal23:41:171
123899115,4cyclictest20398-21wc19:51:411
123899115,4cyclictest13380-21dpkg20:51:301
123899115,4cyclictest0-21swapper/122:25:041
123899114,5cyclictest3419-21ssh00:36:081
123899114,5cyclictest23427-21awk00:21:391
123899114,5cyclictest0-21swapper/121:04:561
123899112,8cyclictest0-21swapper/121:39:151
123899111,8cyclictest8187-21ssh22:01:311
123799117,2cyclictest564-21runrttasks20:31:330
123799117,2cyclictest21800-21diskmemload22:24:470
123799116,3cyclictest9129-21latency_hist23:36:170
123799116,3cyclictest16654-21unixbench_multi21:36:420
123799115,4cyclictest32592-21tr23:26:450
123799115,4cyclictest32384-21dpkg20:21:170
123799115,4cyclictest24897-21uname20:01:420
123799115,4cyclictest19605-21wc22:11:420
123799115,4cyclictest17808-21cut21:01:340
123799115,4cyclictest13521-21tr22:06:320
123799114,6cyclictest0-21swapper/022:56:200
123799114,6cyclictest0-21swapper/019:26:230
123799114,5cyclictest11518-21load19:31:420
123799113,6cyclictest564-21runrttasks22:34:040
123799113,5cyclictest4911-21ssh00:02:010
123799113,5cyclictest0-21swapper/023:23:360
123799112,6cyclictest31593-21ntp_states21:51:390
123799111,8cyclictest23551-21head00:21:410
123799111,8cyclictest20106-21cpuspeed_turbos21:06:330
123799110,3cyclictest28372-21munin-run22:21:170
240132100,0sleep10-21swapper/122:16:311
124099106,2cyclictest27789-21munin-run20:11:173
124099104,4cyclictest11692-21cut20:46:353
124099101,3cyclictest15354-21forks19:41:393
124099100,5cyclictest4810-21aten2_r8power_p20:31:343
123999108,1cyclictest0-21swapper/222:45:502
123999106,3cyclictest9246-21kworker/u8:021:41:402
123999106,3cyclictest7714-21sh00:06:262
123999106,3cyclictest13262-21sh23:08:122
123999105,4cyclictest8421-21apt-get19:26:372
123999105,4cyclictest1075-21awk22:56:412
123999105,3cyclictest26589-21open_inodes21:46:412
123999105,3cyclictest22089-21sh00:21:172
123999104,5cyclictest0-21swapper/222:30:262
123999104,4cyclictest586-21snmpd20:06:212
123999104,4cyclictest32413-21latency_hist20:21:172
123999104,4cyclictest20014-21tr23:46:332
123999104,4cyclictest18474-21unixbench-2d19:46:452
123999104,4cyclictest17623-21cat21:01:162
123999103,5cyclictest12691-21cut19:36:172
123999103,2cyclictest0-21swapper/223:42:322
123999103,2cyclictest0-21swapper/222:16:492
123999103,2cyclictest0-21swapper/200:27:232
123999103,1cyclictest0-21swapper/221:17:272
123999103,1cyclictest0-21swapper/200:37:022
123999100,5cyclictest11110-21ssh22:03:382
123999100,4cyclictest4781-21wget20:31:342
123999100,4cyclictest29912-21sshd20:16:082
123999100,4cyclictest28806-21/usr/sbin/munin22:21:472
123999100,4cyclictest28416-21if_err_enp5s022:51:392
123999100,4cyclictest12762-21wget19:36:342
123999100,1cyclictest18261-21ssh23:13:002
123899107,2cyclictest6389-21idleruntime-cro22:31:171
123899107,2cyclictest3561-21df00:01:351
123899105,3cyclictest26770-21grep23:21:401
123899105,3cyclictest10556-21head20:41:421
123899105,3cyclictest0-21swapper/120:56:321
123899104,5cyclictest0-21swapper/123:34:061
123899104,5cyclictest0-21swapper/122:07:451
123899104,5cyclictest0-21swapper/121:29:561
123899104,5cyclictest0-21swapper/121:06:531
123899104,5cyclictest0-21swapper/100:36:371
123899104,5cyclictest0-21swapper/100:17:011
123899104,4cyclictest28103-21if_enp5s021:16:461
123899104,4cyclictest27173-21apt-get00:26:341
123899104,4cyclictest16813-21cron19:46:161
123899104,4cyclictest13951-21wc00:11:411
123899104,4cyclictest13030-21seq19:36:351
123899103,5cyclictest0-21swapper/121:47:121
123899103,5cyclictest0-21swapper/121:42:121
123899103,5cyclictest0-21swapper/119:31:291
123899102,3cyclictest0-21swapper/122:11:381
123899100,1cyclictest0-21swapper/122:36:321
123799108,1cyclictest0-21swapper/022:41:380
123799106,3cyclictest12-21ksoftirqd/020:41:170
123799106,2cyclictest564-21runrttasks21:49:040
123799106,2cyclictest564-21runrttasks21:21:350
123799106,2cyclictest564-21runrttasks19:20:100
123799106,2cyclictest28747-21if_enp3s020:11:380
123799106,2cyclictest27750-21sh23:53:130
123799105,4cyclictest231-21systemd-journal19:56:170
123799105,4cyclictest0-21swapper/021:17:260
123799105,3cyclictest2191-21gltestperf22:26:400
123799105,3cyclictest12402-21sh23:38:280
123799105,3cyclictest12402-21sh23:38:280
123799105,3cyclictest10519-21sh23:06:230
123799105,3cyclictest0-21swapper/000:20:140
123799104,4cyclictest514-21systemd-logind19:23:220
123799104,4cyclictest13619-21grep22:36:440
123799104,4cyclictest10812-21if_enp4s021:31:370
123799103,6cyclictest0-21swapper/019:47:200
123799103,5cyclictest879-21ntpd00:11:390
123799103,5cyclictest586-21snmpd23:05:350
123799103,5cyclictest586-21snmpd19:51:170
123799103,5cyclictest586-21snmpd00:26:410
123799102,3cyclictest0-21swapper/023:46:370
123799100,9cyclictest0-21swapper/019:41:350
105762100,1sleep10-21swapper/123:06:291
12399996,2cyclictest4346-21ssh23:31:312
12399996,2cyclictest4002-21interrupts00:01:392
12399996,2cyclictest26357-21pmu-power23:51:452
12399996,2cyclictest22460-21ntp_offset19:56:452
12399995,3cyclictest19607-21cat19:51:332
12399995,3cyclictest13029-21expr00:11:332
12399995,2cyclictest15957-21nfs4_client19:41:432
12399994,4cyclictest10299-21grep21:31:332
12399994,3cyclictest18595-21grep22:11:332
12399993,5cyclictest9063-21apt-get20:41:312
12399993,4cyclictest11796-21grep20:46:352
12389994,3cyclictest22323-21basename21:11:361
12389993,5cyclictest0-21swapper/119:46:371
12389993,4cyclictest26031-21cpu20:06:321
12379992,5cyclictest13018-21grep19:36:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional