You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-17 - 20:17

Intel(R) Core(TM) i3-8145UE CPU @ 2.20GHz, Linux 5.10.27-rt36 (Profile)

Latency plot of system in rack #e, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the alll highest latencies:
System rackeslot5.osadl.org (updated Tue Sep 07, 2021 00:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30518993426,6cyclictest0-21swapper/300:02:453
30518993426,4cyclictest23995-21diskmemload00:16:553
3051899340,33cyclictest0-21swapper/321:55:383
3051899340,1cyclictest0-21swapper/322:48:433
30516993432,1cyclictest100-1kworker/1:1H22:35:181
30518993328,4cyclictest0-21swapper/322:44:243
3051899330,32cyclictest0-21swapper/320:00:293
3051899330,29cyclictest23995-21diskmemload21:11:213
3051799330,32cyclictest0-21swapper/220:45:132
3051799330,32cyclictest0-21swapper/219:35:152
3051799330,0cyclictest0-21swapper/220:05:142
3051699330,32cyclictest21502-21fschecks_count22:30:151
3051299330,32cyclictest5738-21sort00:35:200
3051299330,32cyclictest0-21swapper/020:30:220
30518993229,3cyclictest23995-21diskmemload23:55:003
30518993229,2cyclictest804-21runrttasks22:05:273
30518993229,2cyclictest804-21runrttasks22:05:273
30518993228,4cyclictest23995-21diskmemload22:31:473
30518993228,3cyclictest0-21swapper/322:13:433
30518993227,4cyclictest30897-21ssh23:33:393
3051899320,31cyclictest22138-21idleruntime-cro20:00:003
3051899320,0cyclictest23995-21diskmemload00:12:203
3051899320,0cyclictest0-21swapper/323:20:473
30517993231,1cyclictest18718-21kworker/2:022:50:192
30517993228,4cyclictest9551-21ssh21:25:022
3051799320,32cyclictest0-21swapper/223:35:192
3051799320,31cyclictest0-21swapper/220:25:162
3051799320,31cyclictest0-21swapper/220:10:162
3051799320,31cyclictest0-21swapper/219:30:192
3051799320,31cyclictest0-21swapper/219:25:152
3051799320,28cyclictest0-21swapper/222:15:252
30516993231,1cyclictest100-1kworker/1:1H19:40:141
3051699320,32cyclictest0-21swapper/121:05:191
30518993130,1cyclictest36-1kworker/3:0H19:35:163
30518993129,1cyclictest12808-21apt-get19:40:133
30518993128,3cyclictest23995-21diskmemload22:36:453
3051899310,31cyclictest0-21swapper/323:47:493
3051899310,31cyclictest0-21swapper/323:26:103
3051899310,31cyclictest0-21swapper/321:48:423
3051899310,31cyclictest0-21swapper/300:37:483
3051899310,0cyclictest0-21swapper/323:14:093
3051899310,0cyclictest0-21swapper/323:02:343
3051899310,0cyclictest0-21swapper/321:35:133
30517993129,1cyclictest5847-21apt-get23:40:182
30517993129,1cyclictest5847-21apt-get23:40:172
30517993129,1cyclictest29143-21apt-get00:00:162
30517993127,3cyclictest9532-21df22:20:142
3051799310,30cyclictest0-21swapper/219:20:162
30516993130,1cyclictest100-1kworker/1:1H21:55:151
3051699310,30cyclictest544-21dbus-daemon19:55:011
3051699310,30cyclictest31707-21ssh21:15:191
3051699310,30cyclictest31707-21ssh21:15:191
3051699310,30cyclictest24034-21/usr/sbin/munin22:05:191
3051699310,30cyclictest24034-21/usr/sbin/munin22:05:191
3051699310,30cyclictest23995-21diskmemload00:05:271
3051699310,30cyclictest16295-21rm22:53:371
3051699310,30cyclictest10633-21ssh22:48:511
3051299310,30cyclictest19829-21systemd-journal22:35:010
3051299310,30cyclictest0-21swapper/021:47:230
3051299310,30cyclictest0-21swapper/021:32:500
3051299310,30cyclictest0-21swapper/021:21:320
3051299310,1cyclictest0-21swapper/023:14:160
30518993030,0cyclictest0-21swapper/300:27:173
30518993030,0cyclictest0-21swapper/300:27:163
30518993028,2cyclictest0-21swapper/321:26:233
30518993028,2cyclictest0-21swapper/300:22:013
30518993028,1cyclictest0-21swapper/323:15:593
30518993027,3cyclictest23995-21diskmemload23:43:323
30518993027,3cyclictest23995-21diskmemload23:43:323
30518993027,3cyclictest0-21swapper/323:37:173
3051899300,30cyclictest0-21swapper/322:25:083
3051899300,29cyclictest15569-21apt-get21:30:123
3051899300,29cyclictest0-21swapper/322:15:133
3051899300,1cyclictest7999-21sort21:50:223
3051899300,1cyclictest19829-21systemd-journal19:35:013
3051899300,1cyclictest0-21swapper/321:20:183
3051899300,0cyclictest0-21swapper/321:41:133
30517993029,1cyclictest74-1kworker/2:1H21:40:152
30517993029,1cyclictest22509-21kworker/2:223:30:182
30517993028,1cyclictest0-21swapper/222:29:522
30517993028,0cyclictest0-21swapper/221:37:272
30517993027,2cyclictest3676-21ssh21:46:462
30517993027,0cyclictest0-21swapper/223:28:572
3051799300,2cyclictest5309-21ssh00:06:402
3051799300,29cyclictest9272-21ssh21:51:302
3051799300,29cyclictest3621-21ssh22:42:192
3051799300,29cyclictest29886-21ssh22:10:112
3051799300,29cyclictest23995-21diskmemload22:55:152
3051799300,29cyclictest0-21swapper/223:00:452
3051799300,29cyclictest0-21swapper/221:30:112
3051799300,29cyclictest0-21swapper/220:20:182
3051799300,29cyclictest0-21swapper/200:24:402
3051799300,1cyclictest22168-21munin-run20:00:002
3051799300,1cyclictest0-21swapper/223:46:422
3051799300,1cyclictest0-21swapper/222:45:382
30516993030,0cyclictest0-21swapper/123:17:481
30516993029,1cyclictest100-1kworker/1:1H20:00:241
30516993028,1cyclictest2603-21apt-get20:25:131
30516993028,1cyclictest25337-21munin-run00:25:021
30516993028,1cyclictest0-21swapper/121:28:471
30516993028,1cyclictest0-21swapper/100:35:211
30516993028,1cyclictest0-21swapper/100:10:151
3051699300,29cyclictest4279-21diskstats21:20:171
3051699300,29cyclictest27693-21ssh23:30:231
3051699300,29cyclictest25817-21sort21:10:211
3051699300,29cyclictest23995-21diskmemload23:55:111
3051699300,29cyclictest23995-21diskmemload23:35:191
3051699300,29cyclictest23995-21diskmemload22:25:281
3051699300,29cyclictest23995-21diskmemload00:01:111
3051699300,29cyclictest18565-21smartctl22:55:181
3051699300,29cyclictest0-21swapper/122:15:511
3051699300,29cyclictest0-21swapper/121:39:131
3051699300,29cyclictest0-21swapper/120:40:121
3051699300,29cyclictest0-21swapper/100:17:521
3051699300,1cyclictest0-21swapper/122:40:191
3051699300,1cyclictest0-21swapper/119:35:131
30512993029,1cyclictest59050irq/126-eno121:15:470
30512993029,1cyclictest59050irq/126-eno121:15:470
30512993028,1cyclictest3055-21fschecks_count20:25:150
30512993028,1cyclictest0-21swapper/023:35:300
3051299300,30cyclictest16338-21ssh21:58:080
3051299300,30cyclictest0-21swapper/022:12:140
3051299300,29cyclictest9587-21munin-run20:40:010
3051299300,29cyclictest23995-21diskmemload00:15:030
3051299300,29cyclictest20774-21sort21:00:220
3051299300,29cyclictest141rcuc/021:50:130
3051299300,29cyclictest0-21swapper/023:00:150
3051299300,29cyclictest0-21swapper/022:45:270
3051299300,29cyclictest0-21swapper/019:35:130
3051299300,29cyclictest0-21swapper/000:10:020
3051299300,29cyclictest0-21swapper/000:01:310
3051299300,1cyclictest4415-21ntp_kernel_err22:15:180
3051299300,1cyclictest23602-21expr23:55:180
30518992929,0cyclictest23995-21diskmemload22:03:023
30518992928,1cyclictest1207-21uniq19:15:213
30518992928,1cyclictest0-21swapper/323:05:213
3051899290,29cyclictest0-21swapper/322:56:213
3051899290,28cyclictest0-21swapper/323:55:563
3051899290,28cyclictest0-21swapper/322:50:073
3051899290,0cyclictest23995-21diskmemload21:15:103
3051899290,0cyclictest23995-21diskmemload21:15:093
3051899290,0cyclictest0-21swapper/300:31:003
3051899290,0cyclictest0-21swapper/300:06:183
30517992929,0cyclictest74-1kworker/2:1H19:10:142
30517992929,0cyclictest23995-21diskmemload00:15:142
30517992928,1cyclictest23995-21diskmemload23:05:212
30517992928,0cyclictest0-21swapper/222:30:082
3051799290,29cyclictest23995-21diskmemload23:20:442
3051799290,29cyclictest23995-21diskmemload21:11:032
3051799290,29cyclictest0-21swapper/223:11:122
3051799290,29cyclictest0-21swapper/222:36:152
3051799290,29cyclictest0-21swapper/222:00:472
3051799290,29cyclictest0-21swapper/221:56:342
3051799290,29cyclictest0-21swapper/221:20:102
3051799290,29cyclictest0-21swapper/221:15:142
3051799290,29cyclictest0-21swapper/221:15:142
3051799290,28cyclictest9675-21sort00:10:222
3051799290,0cyclictest23995-21diskmemload23:50:092
3051799290,0cyclictest23995-21diskmemload00:30:352
3051799290,0cyclictest23995-21diskmemload00:25:172
3051799290,0cyclictest23995-21diskmemload00:25:172
3051799290,0cyclictest0-21swapper/223:55:232
3051799290,0cyclictest0-21swapper/222:06:072
3051799290,0cyclictest0-21swapper/222:06:072
3051799290,0cyclictest0-21swapper/200:35:282
30516992929,0cyclictest23995-21diskmemload22:20:571
30516992929,0cyclictest0-21swapper/123:45:141
30516992929,0cyclictest0-21swapper/121:45:141
30516992929,0cyclictest0-21swapper/121:41:131
30516992928,1cyclictest1479-21ssh00:30:431
3051699290,29cyclictest23995-21diskmemload23:50:021
3051699290,29cyclictest23995-21diskmemload23:10:201
3051699290,29cyclictest23995-21diskmemload21:32:081
3051699290,29cyclictest0-21swapper/123:41:151
3051699290,29cyclictest0-21swapper/123:41:151
3051699290,29cyclictest0-21swapper/123:25:221
3051699290,29cyclictest0-21swapper/123:05:401
3051699290,29cyclictest0-21swapper/123:01:291
3051699290,29cyclictest0-21swapper/122:10:111
3051699290,29cyclictest0-21swapper/122:00:201
3051699290,29cyclictest0-21swapper/121:50:191
3051699290,0cyclictest0-21swapper/123:20:161
3051699290,0cyclictest0-21swapper/100:27:101
3051699290,0cyclictest0-21swapper/100:27:091
30512992929,0cyclictest0-21swapper/023:40:280
30512992929,0cyclictest0-21swapper/023:40:280
30512992929,0cyclictest0-21swapper/022:00:190
30512992928,0cyclictest25770-21processes21:10:190
3051299290,29cyclictest59050irq/126-eno123:45:390
3051299290,29cyclictest23995-21diskmemload23:20:320
3051299290,29cyclictest23995-21diskmemload22:40:040
3051299290,29cyclictest23995-21diskmemload22:20:160
3051299290,29cyclictest23995-21diskmemload00:25:150
3051299290,29cyclictest23995-21diskmemload00:25:150
3051299290,29cyclictest0-21swapper/023:15:290
3051299290,29cyclictest0-21swapper/023:05:350
3051299290,29cyclictest0-21swapper/022:50:370
3051299290,29cyclictest0-21swapper/022:35:050
3051299290,29cyclictest0-21swapper/022:06:360
3051299290,29cyclictest0-21swapper/022:06:360
3051299290,29cyclictest0-21swapper/021:40:130
3051299290,29cyclictest0-21swapper/021:25:190
3051299290,29cyclictest0-21swapper/000:30:100
3051299290,1cyclictest0-21swapper/022:55:160
3051299290,1cyclictest0-21swapper/021:35:190
3051299290,0cyclictest23995-21diskmemload23:30:400
3051299290,0cyclictest23995-21diskmemload22:25:540
3051299290,0cyclictest23995-21diskmemload00:05:020
3051299290,0cyclictest0-21swapper/023:50:340
3051299290,0cyclictest0-21swapper/023:27:110
3051299290,0cyclictest0-21swapper/020:45:130
3051299290,0cyclictest0-21swapper/000:20:140
30518992828,0cyclictest0-21swapper/320:50:233
30518992828,0cyclictest0-21swapper/320:35:223
30518992826,2cyclictest0-21swapper/320:15:213
30518992826,1cyclictest11980-21perf20:45:023
30517992828,0cyclictest0-21swapper/219:40:142
30517992827,0cyclictest0-21swapper/219:15:222
3051799280,0cyclictest0-21swapper/220:15:302
30516992828,0cyclictest0-21swapper/119:25:231
30516992828,0cyclictest0-21swapper/119:15:281
30516992826,1cyclictest19479-21apt-get21:00:141
30512992828,0cyclictest24848-21apt-get20:05:120
30512992828,0cyclictest21888-21apt-get21:05:160
30512992828,0cyclictest0-21swapper/020:20:140
30512992828,0cyclictest0-21swapper/019:10:130
30512992826,2cyclictest0-21swapper/019:25:120
3051299280,0cyclictest0-21swapper/019:50:130
30518992727,0cyclictest1232-21sort20:20:223
30518992727,0cyclictest0-21swapper/320:30:203
30518992727,0cyclictest0-21swapper/320:25:143
30517992727,0cyclictest0-21swapper/221:05:242
30517992727,0cyclictest0-21swapper/220:55:182
30517992727,0cyclictest0-21swapper/220:40:142
30517992727,0cyclictest0-21swapper/219:45:172
30516992727,0cyclictest0-21swapper/120:15:311
30516992726,1cyclictest100-1kworker/1:1H19:45:171
30512992727,0cyclictest0-21swapper/020:15:300
30512992725,1cyclictest19186-21sendmail-msp21:00:000
30518992626,0cyclictest0-21swapper/320:05:203
30518992626,0cyclictest0-21swapper/319:50:193
30518992625,1cyclictest5573-21apt-get19:25:123
30517992626,0cyclictest0-21swapper/221:00:132
30517992626,0cyclictest0-21swapper/220:30:192
30516992626,0cyclictest0-21swapper/120:50:301
30516992625,0cyclictest0-21swapper/120:35:201
30512992626,0cyclictest28555-21sort20:10:220
30518992525,0cyclictest0-21swapper/321:05:243
30518992524,1cyclictest36-1kworker/3:0H19:10:143
30516992525,0cyclictest0-21swapper/120:20:151
30516992523,1cyclictest29417-21munin-run20:15:011
30512992525,0cyclictest0-21swapper/019:20:130
30518992424,0cyclictest0-21swapper/321:00:213
30518992423,1cyclictest0-21swapper/319:45:163
30516992424,0cyclictest0-21swapper/119:10:221
30512992424,0cyclictest0-21swapper/020:00:150
30517992323,0cyclictest0-21swapper/220:50:302
30516992323,0cyclictest0-21swapper/119:55:131
30517992121,0cyclictest0-21swapper/219:50:122
30516992121,0cyclictest0-21swapper/120:55:141
30512992121,0cyclictest0-21swapper/020:50:310
30518992020,0cyclictest0-21swapper/320:45:123
30516992020,0cyclictest0-21swapper/120:05:131
30512992018,1cyclictest17354-21perf19:50:010
30518991917,1cyclictest0-21swapper/319:25:003
30516991918,1cyclictest100-1kworker/1:1H19:20:161
30512991919,0cyclictest0-21swapper/019:15:140
3051799187,1cyclictest7998-21tune2fs20:35:152
30518991716,1cyclictest0-21swapper/320:55:173
30512991717,0cyclictest0-21swapper/019:55:130
30512991717,0cyclictest0-21swapper/019:40:120
3051299170,17cyclictest0-21swapper/020:40:140
30518991615,1cyclictest0-21swapper/320:10:153
30516991616,0cyclictest0-21swapper/120:45:121
30516991414,0cyclictest0-21swapper/119:30:161
3051699140,14cyclictest0-21swapper/120:30:021
30512991412,1cyclictest8943-21memory19:30:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional