You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-22 - 01:39

Intel(R) Core(TM) i3-8145UE CPU @ 2.20GHz, Linux 5.10.27-rt36 (Profile)

Latency plot of system in rack #e, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q done
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Tue Sep 07, 2021 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22911993428,2cyclictest652-21grep20:40:143
2291199330,1cyclictest0-21swapper/323:05:183
2291199330,1cyclictest0-21swapper/322:30:153
2291199330,1cyclictest0-21swapper/300:35:213
22902993332,1cyclictest223-1kworker/1:2H19:15:211
22902993331,1cyclictest223-1kworker/1:2H19:35:151
22898993332,1cyclictest10736-21kworker/0:000:05:200
2289899330,1cyclictest0-21swapper/000:25:210
2291199320,31cyclictest0-21swapper/323:50:233
22907993232,0cyclictest10245-21kworker/2:023:30:192
22907993232,0cyclictest10245-21kworker/2:022:00:162
22907993230,1cyclictest15375-21kworker/2:020:00:222
2290799320,0cyclictest0-21swapper/222:40:182
2289899320,1cyclictest0-21swapper/020:15:230
2290799317,21cyclictest27893-21tune2fs21:50:162
22907993130,1cyclictest74-1kworker/2:1H23:15:172
22907993130,1cyclictest74-1kworker/2:1H20:55:172
22907993130,1cyclictest74-1kworker/2:1H20:30:192
22907993130,1cyclictest15375-21kworker/2:019:20:152
22902993130,1cyclictest223-1kworker/1:2H00:30:171
22898993130,1cyclictest144-1kworker/0:1H22:45:280
22898993129,1cyclictest144-1kworker/0:1H22:50:190
22907993029,1cyclictest10245-21kworker/2:000:35:212
22911992927,1cyclictest0-21swapper/322:35:173
22911992927,1cyclictest0-21swapper/300:10:163
2290799299,10cyclictest984-21tune2fs21:55:152
22902992928,1cyclictest223-1kworker/1:2H22:10:161
22902992928,1cyclictest223-1kworker/1:2H19:10:141
22898992927,1cyclictest0-21swapper/020:00:220
22911992826,1cyclictest0-21swapper/300:30:183
22902992827,1cyclictest223-1kworker/1:2H20:25:161
22902992826,1cyclictest223-1kworker/1:2H23:55:201
22911992727,0cyclictest0-21swapper/322:20:163
22911992726,1cyclictest0-21swapper/320:30:183
22911992725,1cyclictest29319-21grep00:15:203
22911992725,1cyclictest0-21swapper/321:25:153
22911992725,1cyclictest0-21swapper/319:55:143
2290799277,11cyclictest3013-21tune2fs19:35:152
22907992726,1cyclictest74-1kworker/2:1H21:00:162
22902992726,1cyclictest223-1kworker/1:2H23:50:231
22902992726,1cyclictest0-21swapper/121:25:151
2290799266,10cyclictest17761-21tune2fs00:05:202
22907992626,0cyclictest15375-21kworker/2:020:10:162
22902992625,1cyclictest223-1kworker/1:2H23:25:191
22898992625,1cyclictest26230-21kworker/0:021:30:140
22898992622,1cyclictest0-21swapper/023:06:480
22911992524,1cyclictest0-21swapper/323:25:193
22911992524,0cyclictest0-21swapper/320:50:213
22911992523,1cyclictest0-21swapper/322:40:193
22911992523,1cyclictest0-21swapper/321:16:393
2291199250,24cyclictest243352sleep322:45:063
2291199250,24cyclictest0-21swapper/323:18:023
22907992524,1cyclictest0-21swapper/221:15:142
2290799250,5cyclictest0-21swapper/222:51:382
2290799250,24cyclictest8623-21sh23:56:442
22902992525,0cyclictest0-21swapper/120:35:141
2290299250,24cyclictest12973-21cat00:30:011
2290299250,24cyclictest0-21swapper/122:30:471
22898992524,1cyclictest144-1kworker/0:1H23:00:200
22898992523,1cyclictest20391-21runrttasks22:11:510
22898992523,1cyclictest0-21swapper/021:25:150
2289899250,2cyclictest602-21rs:main0
2289899250,24cyclictest13811-21rm21:37:400
2289899250,24cyclictest13774-21diskmemload23:50:200
2289899250,24cyclictest0-21swapper/022:27:570
2289899250,24cyclictest0-21swapper/021:59:130
2289899250,24cyclictest0-21swapper/000:16:480
22911992422,1cyclictest0-21swapper/322:54:273
2291199240,23cyclictest16830-21ssh21:11:373
2291199240,23cyclictest0-21swapper/322:27:093
2291199240,23cyclictest0-21swapper/321:52:213
2291199240,23cyclictest0-21swapper/321:46:453
2291199240,23cyclictest0-21swapper/321:40:483
2291199240,23cyclictest0-21swapper/321:34:233
2290799245,9cyclictest21730-21tune2fs20:15:232
2290799244,10cyclictest0-21swapper/221:35:152
22907992423,0cyclictest0-21swapper/221:33:482
22907992421,2cyclictest20807-21ssh21:44:222
2290799240,23cyclictest17480-21grep23:35:282
2290799240,23cyclictest1412-21ssh21:26:322
2290799240,23cyclictest13774-21diskmemload23:45:252
2290799240,23cyclictest13774-21diskmemload22:08:062
2290799240,23cyclictest0-21swapper/222:11:542
22902992424,0cyclictest13774-21diskmemload23:17:241
22902992423,1cyclictest223-1kworker/1:2H23:05:181
22902992423,1cyclictest223-1kworker/1:2H21:10:141
22902992423,0cyclictest0-21swapper/122:00:141
22902992422,1cyclictest30988-21latency_hist21:25:011
22902992422,1cyclictest0-21swapper/121:17:351
2290299240,23cyclictest8726-21sh21:33:231
2290299240,23cyclictest13774-21diskmemload23:10:581
2290299240,23cyclictest0-21swapper/100:17:381
22898992423,1cyclictest13774-21diskmemload23:36:370
2289899240,23cyclictest7563-21cat22:00:240
2289899240,23cyclictest4597-21munin-run19:40:000
2289899240,23cyclictest18710-21diskmemload22:40:120
2289899240,23cyclictest13774-21diskmemload23:57:350
2289899240,23cyclictest13774-21diskmemload21:22:160
2289899240,23cyclictest0-21swapper/022:37:020
2289899240,23cyclictest0-21swapper/021:41:570
2289899240,23cyclictest0-21swapper/000:33:410
2289899240,23cyclictest0-21swapper/000:21:290
22911992323,0cyclictest0-21swapper/300:28:133
22911992323,0cyclictest0-21swapper/300:20:243
22911992321,1cyclictest0-21swapper/323:56:093
22911992321,1cyclictest0-21swapper/322:10:163
22911992321,1cyclictest0-21swapper/321:20:183
2291199231,21cyclictest21872-21kworker/u8:122:55:123
2291199230,2cyclictest23279-21sh23:12:133
2291199230,23cyclictest13774-21diskmemload22:18:123
2291199230,23cyclictest0-21swapper/323:23:143
2291199230,22cyclictest24036-21sh23:41:253
2291199230,22cyclictest13774-21diskmemload23:00:103
2291199230,22cyclictest0-21swapper/322:07:063
2291199230,22cyclictest0-21swapper/300:00:463
2291199230,1cyclictest151rcu_preempt22:01:153
2291199230,1cyclictest10622-21entropy23:30:193
2291199230,0cyclictest0-21swapper/321:36:573
22907992323,0cyclictest13774-21diskmemload22:35:482
22907992323,0cyclictest13774-21diskmemload22:23:492
22907992323,0cyclictest0-21swapper/223:51:412
22907992323,0cyclictest0-21swapper/223:40:232
22907992321,1cyclictest0-21swapper/200:20:302
22907992320,2cyclictest32354-21cron20:40:002
2290799230,2cyclictest5415-21ssh22:27:382
2290799230,2cyclictest31150-21ssh00:16:202
2290799230,23cyclictest0-21swapper/223:21:472
2290799230,23cyclictest0-21swapper/223:01:412
2290799230,23cyclictest0-21swapper/221:22:382
2290799230,23cyclictest0-21swapper/221:14:382
2290799230,23cyclictest0-21swapper/200:00:472
2290799230,22cyclictest9437-21sh22:30:322
2290799230,22cyclictest25170-21perf19:15:002
2290799230,22cyclictest0-21swapper/223:10:182
2290799230,22cyclictest0-21swapper/221:46:302
2290799230,22cyclictest0-21swapper/200:25:182
2290799230,0cyclictest0-21swapper/200:10:382
22902992323,0cyclictest13774-21diskmemload21:55:231
22902992323,0cyclictest0-21swapper/122:26:141
22902992323,0cyclictest0-21swapper/121:52:081
22902992323,0cyclictest0-21swapper/121:45:101
22902992323,0cyclictest0-21swapper/121:35:501
22902992323,0cyclictest0-21swapper/100:35:441
22902992323,0cyclictest0-21swapper/100:09:451
22902992322,1cyclictest25601-21ssh22:16:111
2290299230,23cyclictest2020-21sh23:22:101
2290299230,23cyclictest0-21swapper/123:40:121
2290299230,23cyclictest0-21swapper/122:50:131
2290299230,23cyclictest0-21swapper/122:47:361
2290299230,23cyclictest0-21swapper/122:21:221
2290299230,22cyclictest597-21dbus-daemon19:35:001
2290299230,22cyclictest4855-21apt-get19:40:121
2290299230,22cyclictest20323-21rm22:40:251
2290299230,22cyclictest18044-21sh23:36:071
2290299230,22cyclictest0-21swapper/122:06:461
2290299230,1cyclictest10400-21/usr/sbin/munin23:00:311
2290299230,1cyclictest0-21swapper/100:21:181
2290299230,0cyclictest13774-21diskmemload22:57:221
2290299230,0cyclictest13774-21diskmemload00:12:131
2290299230,0cyclictest0-21swapper/100:01:121
22898992323,0cyclictest0-21swapper/000:35:540
22898992322,1cyclictest0-21swapper/021:12:200
22898992321,1cyclictest20079-21apt-get23:10:160
22898992321,1cyclictest0-21swapper/022:20:150
22898992321,1cyclictest0-21swapper/022:05:440
22898992318,4cyclictest144-1kworker/0:1H19:20:150
2289899230,2cyclictest4480-21ssh23:25:100
2289899230,23cyclictest0-21swapper/023:45:500
2289899230,23cyclictest0-21swapper/022:16:360
2289899230,23cyclictest0-21swapper/021:46:250
2289899230,23cyclictest0-21swapper/000:11:430
2289899230,22cyclictest25158-21turbostat19:15:000
2289899230,22cyclictest13774-21diskmemload22:56:310
2289899230,0cyclictest0-21swapper/023:41:420
2289899230,0cyclictest0-21swapper/023:32:310
2289899230,0cyclictest0-21swapper/021:16:210
22911992222,0cyclictest0-21swapper/300:08:393
22911992219,2cyclictest27457-21turbostat19:20:013
2291199220,21cyclictest13774-21diskmemload23:45:173
2291199220,21cyclictest13774-21diskmemload23:35:053
2291199220,21cyclictest0-21swapper/321:59:263
22907992222,0cyclictest29965-21kworker/2:220:45:132
22907992222,0cyclictest13774-21diskmemload23:25:542
22907992222,0cyclictest0-21swapper/222:46:202
22907992222,0cyclictest0-21swapper/222:15:092
2290799222,10cyclictest0-21swapper/221:05:192
2290799220,22cyclictest0-21swapper/223:05:322
2290799220,21cyclictest13778-21perl00:30:172
22902992222,0cyclictest13774-21diskmemload22:35:101
22902992222,0cyclictest0-21swapper/123:30:261
22902992220,1cyclictest7155-21apt-get19:45:131
2290299220,21cyclictest0-21swapper/123:45:171
2290299220,21cyclictest0-21swapper/119:25:011
2290299220,0cyclictest0-21swapper/121:41:021
22898992222,0cyclictest0-21swapper/023:15:330
2289899220,21cyclictest597-21dbus-daemon20:50:010
2289899220,21cyclictest11487-21munin-run21:05:010
2289899220,21cyclictest0-21swapper/021:50:110
2289899220,21cyclictest0-21swapper/020:35:120
2289899220,21cyclictest0-21swapper/019:25:120
2289899220,1cyclictest22604-21systemd-journal21:10:000
2289899220,0cyclictest0-21swapper/000:00:310
2291199210,20cyclictest0-21swapper/320:20:143
22907992119,1cyclictest32680-21apt-get19:30:162
22902992121,0cyclictest0-21swapper/120:55:171
2290299210,0cyclictest16370-21apt-get20:05:121
22898992119,1cyclictest144-1kworker/0:1H20:55:170
22898992119,1cyclictest0-21swapper/020:30:180
22898992119,1cyclictest0-21swapper/019:45:160
2289899210,1cyclictest0-21swapper/020:45:000
2289899210,0cyclictest0-21swapper/019:40:120
2289899210,0cyclictest0-21swapper/019:30:160
22911992020,0cyclictest0-21swapper/320:45:113
22911992020,0cyclictest0-21swapper/320:13:303
22911992019,1cyclictest0-21swapper/320:55:133
22911992018,1cyclictest29761-21apt-get19:25:013
2291199200,20cyclictest0-21swapper/320:05:123
2291199200,0cyclictest0-21swapper/320:25:143
2290799203,4cyclictest0-21swapper/220:21:182
22907992020,0cyclictest15375-21kworker/2:019:50:132
22907992020,0cyclictest0-21swapper/220:40:122
2290799200,20cyclictest0-21swapper/219:25:012
2290799200,0cyclictest0-21swapper/219:45:122
22902992020,0cyclictest11744-21apt-get21:05:161
22902992020,0cyclictest0-21swapper/120:30:141
22902992018,1cyclictest4563-21grep20:50:011
2290299200,19cyclictest0-21swapper/120:15:211
2290299200,0cyclictest0-21swapper/120:50:181
22898992020,0cyclictest0-21swapper/020:13:300
2289899200,20cyclictest0-21swapper/019:15:130
22911991919,0cyclictest0-21swapper/319:20:133
22911991918,1cyclictest9439-21apt-get21:00:133
22911991918,1cyclictest23189-21grep20:20:003
22911991918,0cyclictest30350-21apt-get20:35:123
2291199190,0cyclictest0-21swapper/319:40:123
22907991919,0cyclictest0-21swapper/220:25:132
22902991919,0cyclictest0-21swapper/119:50:111
22902991911,6cyclictest223-1kworker/1:2H20:40:141
22898991919,0cyclictest0-21swapper/019:55:120
22911991818,0cyclictest0-21swapper/320:00:133
22911991818,0cyclictest0-21swapper/319:35:133
22911991816,1cyclictest0-21swapper/319:30:193
2290799184,14cyclictest0-21swapper/219:58:572
22902991818,0cyclictest4870-21kworker/1:021:00:161
22902991818,0cyclictest27746-21apt-get19:20:121
22902991818,0cyclictest0-21swapper/119:55:121
22911991716,1cyclictest0-21swapper/319:10:153
22907991715,1cyclictest25426-21apt-get19:15:132
22902991717,0cyclictest0-21swapper/120:10:131
22911991614,1cyclictest0-21swapper/319:45:133
22907991616,0cyclictest0-21swapper/219:40:122
22898991616,0cyclictest0-21swapper/020:25:130
22898991614,1cyclictest11478-21turbostat19:55:000
2289899160,16cyclictest0-21swapper/020:50:210
2291199150,14cyclictest10162-21modprobe19:50:153
2290799153,11cyclictest16758-21/usr/sbin/munin20:05:132
22911991412,1cyclictest0-21swapper/321:05:163
2290799143,10cyclictest5356-21tune2fs20:50:212
22902991414,0cyclictest23469-21apt-get20:20:141
2290299140,6cyclictest592-21irqbalance20:01:221
22898991414,0cyclictest0-21swapper/020:05:320
2289899140,0cyclictest0-21swapper/020:21:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional