You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-26 - 12:46

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack8slot2.osadl.org (updated Sun Jun 26, 2022 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14290991440,143cyclictest0-21swapper/319:18:363
1263321060,1sleep0131rcuc/023:40:190
80872960,0sleep30-21swapper/322:28:303
14289999189,1cyclictest0-21swapper/219:18:362
14287993836,1cyclictest0-21swapper/019:18:360
4122370,0sleep00-21swapper/000:37:360
14288993627,8cyclictest0-21swapper/119:18:361
214062350,0chrt0-21swapper/222:41:362
34032310,0sleep20-21swapper/200:40:182
293522290,0sleep00-21swapper/000:34:270
211422260,1sleep20-21swapper/222:07:492
176672260,1sleep10-21swapper/122:38:181
1428899250,1cyclictest0-21swapper/100:30:101
48372240,0chrt0-21swapper/020:05:130
1428999240,22cyclictest0-21swapper/222:15:102
14290992220,1cyclictest0-21swapper/300:30:093
14288992220,1cyclictest0-21swapper/121:20:101
37812210,0sleep30-21swapper/320:01:593
1429099210,20cyclictest0-21swapper/321:10:103
1428799210,1cyclictest0-21swapper/020:15:090
1429099200,1cyclictest0-21swapper/322:30:093
1428799200,19cyclictest0-21swapper/021:35:100
1428999190,1cyclictest0-21swapper/219:55:092
1428799190,17cyclictest27509-21sh22:15:090
1429099185,3cyclictest0-21swapper/300:40:553
1428799181,9cyclictest18697-21awk22:39:580
61702170,0chrt0-21swapper/000:44:210
1429099173,9cyclictest22520-21irqstats21:35:163
14287991713,2cyclictest2370-21ssh21:15:080
195602160,1sleep20-21swapper/219:25:102
66962150,1sleep20-21swapper/222:26:092
313942150,0chrt0-21swapper/222:52:192
1428999154,6cyclictest23906-21ssh23:19:162
1428899151,9cyclictest2035-21diskmemload23:25:141
1428799151,7cyclictest25826-21munin-run20:54:580
1428799150,9cyclictest25125-21sh23:54:580
1429099147,2cyclictest34-21ksoftirqd/322:05:043
1429099146,1cyclictest34-21ksoftirqd/321:33:173
1429099144,5cyclictest8028-21ssh21:54:473
1429099143,8cyclictest28914-21python22:15:203
1429099143,6cyclictest0-21swapper/300:16:393
1428999145,4cyclictest0-21swapper/222:03:082
1428999144,5cyclictest0-21swapper/220:15:142
1428999141,8cyclictest0-21swapper/223:50:162
1428899145,7cyclictest7044-21cut23:35:131
1428799144,9cyclictest16782-21ssh23:45:230
1428799144,5cyclictest0-21swapper/022:32:540
1428799144,5cyclictest0-21swapper/022:05:170
1428799144,5cyclictest0-21swapper/020:55:140
1428799144,5cyclictest0-21swapper/019:31:210
1428799144,5cyclictest0-21swapper/019:26:470
1428799144,5cyclictest0-21swapper/000:27:400
1428799140,1cyclictest0-21swapper/019:55:090
1429099137,3cyclictest0-21swapper/300:20:363
1429099134,3cyclictest13474-21grep22:00:113
1429099133,5cyclictest0-21swapper/322:50:543
1429099132,6cyclictest7148-21unixbench_multi23:00:223
1428999134,4cyclictest0-21swapper/219:42:122
1428999133,4cyclictest26565-21ssh22:47:122
1428899136,6cyclictest0-21swapper/122:45:171
1428899136,5cyclictest538-21dbus-daemon20:50:201
1428899135,7cyclictest18716-21ssh23:47:151
1428899135,3cyclictest0-21swapper/123:31:261
1428899135,3cyclictest0-21swapper/100:06:061
1428899134,6cyclictest2035-21diskmemload00:18:331
1428899134,4cyclictest0-21swapper/120:31:411
1428899133,8cyclictest5325-21strings20:05:171
1428899131,10cyclictest0-21swapper/122:05:451
1428799138,3cyclictest25317-21grep23:20:130
1428799135,4cyclictest19922-21ssh23:15:100
1428799133,5cyclictest0-21swapper/023:35:020
1428799132,8cyclictest3470-21/usr/sbin/munin00:05:180
1429099127,3cyclictest15784-21grep23:10:123
1429099126,4cyclictest28677-21head19:45:133
1429099124,3cyclictest0-21swapper/323:32:413
1429099124,3cyclictest0-21swapper/320:32:083
1429099122,9cyclictest34-21ksoftirqd/320:05:143
1429099121,9cyclictest75-21kswapd000:25:083
1429099121,5cyclictest341ksoftirqd/321:48:253
1428999129,2cyclictest0-21swapper/223:46:122
1428999128,2cyclictest331-21grep21:10:112
1428999127,3cyclictest22810-21timerandwakeup19:30:202
1428999125,5cyclictest23986-21grep22:10:182
1428999124,6cyclictest0-21swapper/221:21:232
1428999124,6cyclictest0-21swapper/200:05:542
1428999124,4cyclictest15205-21ssh21:27:552
1428999124,3cyclictest0-21swapper/223:40:502
1428999124,3cyclictest0-21swapper/200:25:002
1428999123,7cyclictest29118-21kworker/u8:121:46:312
1428999123,4cyclictest24624-21ssh23:20:042
1428999123,4cyclictest0-21swapper/221:05:142
1428999122,5cyclictest0-21swapper/223:25:142
1428999121,9cyclictest5276-21munin-run22:59:582
1428999121,9cyclictest26705-21grep00:30:202
1428999121,9cyclictest0-21swapper/221:00:122
1428999121,8cyclictest75-21kswapd023:35:092
1428999121,8cyclictest75-21kswapd023:10:082
1428999121,7cyclictest0-21swapper/219:20:032
1428999121,6cyclictest0-21swapper/200:19:362
1428899126,4cyclictest29633-21grep21:00:221
1428899126,4cyclictest27154-21cron22:14:591
1428899126,4cyclictest17718-21sed19:20:131
1428899126,4cyclictest11523-21grep23:05:181
1428899126,4cyclictest1143-21tr21:10:171
1428899125,6cyclictest0-21swapper/122:56:551
1428899124,7cyclictest13831-21users21:25:431
1428899124,7cyclictest0-21swapper/122:01:411
1428899124,7cyclictest0-21swapper/121:07:111
1428899124,6cyclictest0-21swapper/120:28:561
1428899124,3cyclictest0-21swapper/123:02:101
1428899124,3cyclictest0-21swapper/100:38:251
1428899123,3cyclictest0-21swapper/119:27:321
1428899123,3cyclictest0-21swapper/100:20:121
1428799128,2cyclictest24457-21grep22:45:130
1428799126,5cyclictest3245-21awk21:49:580
1428799126,4cyclictest538-21dbus-daemon20:44:590
1428799125,5cyclictest19051-21basename19:24:580
1428799125,5cyclictest0-21swapper/023:12:160
1428799124,7cyclictest0-21swapper/019:40:480
1428799124,5cyclictest0-21swapper/020:23:130
1428799123,4cyclictest0-21swapper/019:54:240
1428799122,5cyclictest11488-21ssh00:15:000
1428799122,5cyclictest0-21swapper/000:11:420
1428799120,8cyclictest0-21swapper/023:55:140
1429099116,3cyclictest23036-21sendmail_mailtr20:45:243
1429099116,3cyclictest18230-21sort20:35:173
1429099115,4cyclictest28786-21head21:00:143
1429099115,4cyclictest238-21systemd-journal21:40:253
1429099115,4cyclictest22124-21smartctl23:50:213
1429099115,4cyclictest14464-21sh21:26:443
1429099115,4cyclictest1147-21tr22:55:123
1429099115,3cyclictest0-21swapper/300:35:163
1429099114,6cyclictest0-21swapper/322:20:203
1429099114,5cyclictest7414-21in:imuxsock21:59:583
1429099114,5cyclictest32523-21grep19:55:113
1429099114,5cyclictest17254-21tr23:45:283
1429099114,5cyclictest0-21swapper/323:55:443
1429099114,5cyclictest0-21swapper/321:23:463
1429099114,5cyclictest0-21swapper/320:40:323
1429099114,5cyclictest0-21swapper/320:26:383
1429099114,5cyclictest0-21swapper/319:22:323
1429099114,4cyclictest0-21swapper/319:50:453
1429099113,5cyclictest7923-21sed20:10:223
1429099113,5cyclictest7923-21sed20:10:223
1429099113,4cyclictest590-21snmpd23:24:343
1429099113,1cyclictest34-21ksoftirqd/321:19:483
1429099111,6cyclictest19478-21ssh22:40:123
1429099110,6cyclictest0-21swapper/319:34:243
1428999118,2cyclictest0-21swapper/200:35:132
1428999117,2cyclictest7719-21if_eno100:10:142
1428999115,5cyclictest31173-1kworker/u9:222:20:132
1428999115,4cyclictest4526-21tr20:05:112
1428999115,4cyclictest26088-21idleruntime-cro21:39:582
1428999115,4cyclictest21348-21idleruntime-cro20:44:592
1428999115,4cyclictest15736-21head20:30:132
1428999114,6cyclictest0-21swapper/222:31:002
1428999114,5cyclictest9799-21gzip21:55:202
1428999114,5cyclictest590-21snmpd23:06:492
1428999114,5cyclictest5697-21aten2_r8power_p23:00:112
1428999114,5cyclictest238-21systemd-journal22:35:352
1428999113,6cyclictest0-21swapper/221:30:492
1428999113,3cyclictest0-21swapper/219:46:422
1428999112,7cyclictest8314-21cat21:54:592
1428999111,8cyclictest0-21swapper/220:20:112
1428999111,5cyclictest30388-21tr00:00:102
1428999111,5cyclictest26621-21ntpq23:55:172
1428999111,2cyclictest0-21swapper/200:24:582
1428999110,5cyclictest26493-21ssh21:40:102
1428999110,5cyclictest25514-21latency_hist19:39:582
1428899116,4cyclictest22841-21grep20:45:211
1428899116,3cyclictest603-21runrttasks23:50:171
1428899116,3cyclictest2035-21diskmemload23:10:171
1428899116,2cyclictest603-21runrttasks20:15:441
1428899115,4cyclictest4981-21sh21:16:581
1428899115,4cyclictest4020-21cron20:04:581
1428899115,4cyclictest20695-21sh22:40:231
1428899115,4cyclictest20019-21grep20:40:131
1428899115,4cyclictest19289-21cat20:39:591
1428899115,4cyclictest17886-21wc21:30:201
1428899115,4cyclictest1214-21systemctl19:55:201
1428899115,4cyclictest0-21swapper/122:19:201
1428899115,3cyclictest0-21swapper/122:24:151
1428899114,5cyclictest27811-21wc19:44:581
1428899114,5cyclictest238-21systemd-journal21:35:241
1428899114,5cyclictest0-21swapper/123:24:131
1428899114,5cyclictest0-21swapper/121:52:531
1428899114,5cyclictest0-21swapper/120:10:101
1428899114,5cyclictest0-21swapper/120:10:101
1428899114,3cyclictest24683-21ntp_states19:35:181
1428899113,5cyclictest7581-21/usr/sbin/munin00:10:131
1428899111,8cyclictest26861-21/usr/sbin/munin20:55:151
1428799117,3cyclictest6979-21tune2fs20:10:130
1428799117,3cyclictest6979-21tune2fs20:10:130
1428799116,3cyclictest3805-21aten2_r8power_p21:50:100
1428799115,4cyclictest238-21systemd-journal20:35:110
1428799115,4cyclictest0-21swapper/021:05:360
1428799114,5cyclictest0-21swapper/021:33:160
1428799114,5cyclictest0-21swapper/020:30:110
1428799114,4cyclictest0-21swapper/022:56:400
1428799113,5cyclictest0-21swapper/000:23:420
1428799112,4cyclictest15009-21ssh22:00:350
1428799112,4cyclictest0-21swapper/019:45:140
1428799110,9cyclictest31899-21ssh22:53:090
93862100,0chrt0-21swapper/021:55:160
1429099106,2cyclictest34-21ksoftirqd/322:45:093
1429099106,2cyclictest12692-21latency_hist20:24:593
1429099105,4cyclictest0-21swapper/321:08:033
1429099105,3cyclictest3108-21gltestperf00:05:153
1429099105,3cyclictest203572sleep323:15:143
1429099105,3cyclictest20192-21latency19:25:153
1429099104,5cyclictest0-21swapper/322:36:213
1429099104,5cyclictest0-21swapper/320:55:123
1429099104,5cyclictest0-21swapper/319:35:093
1429099104,4cyclictest29813-21cron23:59:583
1429099104,4cyclictest26699-21cut19:40:153
1429099104,4cyclictest12864-21users23:40:213
1429099104,4cyclictest10969-21cut23:05:133
1429099104,4cyclictest0-21swapper/300:12:153
1429099103,6cyclictest141rcu_preempt22:11:223
1429099100,9cyclictest0-21swapper/323:25:093
1429099100,5cyclictest10083-21grep20:15:213
1429099100,4cyclictest7362-21if_err_enp5s023:35:153
1428999108,1cyclictest0-21swapper/220:29:122
1428999105,3cyclictest30338-21aten2_r8power_p19:50:112
1428999104,4cyclictest2740-21tail20:00:132
1428999104,4cyclictest2181-21diskstats23:30:122
1428999104,4cyclictest21780-21cut20:45:132
1428999103,5cyclictest238-21systemd-journal21:15:192
1428999101,5cyclictest0-21swapper/220:59:452
1428999100,4cyclictest25730-21sshd20:53:582
1428899106,2cyclictest9786-21processes21:55:201
1428899105,3cyclictest9549-21cpuspeed_turbos22:30:101
1428899105,3cyclictest5839-21tr22:25:191
1428899105,3cyclictest21916-21grep19:30:121
1428899105,3cyclictest2035-21diskmemload22:50:111
1428899105,3cyclictest0-21swapper/123:41:171
1428899104,5cyclictest0-21swapper/121:45:491
1428899104,4cyclictest31815-21sh00:00:251
1428899104,4cyclictest25675-21cat23:55:101
1428899104,4cyclictest20927-21cut00:25:091
1428899104,4cyclictest20022-21cut23:15:111
1428899104,4cyclictest11306-21sort20:20:131
1428899102,3cyclictest0-21swapper/100:44:161
1428799106,3cyclictest2035-21diskmemload22:40:470
1428799105,4cyclictest12-21ksoftirqd/023:30:170
1428799105,4cyclictest0-21swapper/022:14:050
1428799105,3cyclictest603-21runrttasks23:25:160
1428799105,3cyclictest32195-21sh22:20:040
1428799105,3cyclictest30138-21sendmail21:04:580
1428799104,5cyclictest2214-21awk20:00:100
1428799104,5cyclictest0-21swapper/022:28:210
1428799104,5cyclictest0-21swapper/021:20:510
1428799104,5cyclictest0-21swapper/019:35:330
1428799104,4cyclictest32713-21cpu21:10:110
1428799104,4cyclictest29291-21sh21:42:270
1428799104,4cyclictest12089-21sh21:25:200
1428799103,5cyclictest0-21swapper/020:25:150
142909994,3cyclictest24947-21cut20:50:173
142899994,3cyclictest17475-21cpuspeed_turbos20:35:112
142899990,3cyclictest6493-21wget20:10:102
142899990,3cyclictest6493-21wget20:10:102
142889995,2cyclictest28001-21readlink19:44:581
142889993,4cyclictest590-21snmpd19:50:091
142889993,4cyclictest27259-21cat21:40:151
142879994,4cyclictest0-21swapper/023:00:040
142879994,3cyclictest30331-21cpuspeed_turbos00:00:100
142879994,3cyclictest11518-21cat23:05:180
142879993,5cyclictest0-21swapper/020:45:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional