You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-05-12 - 12:59

Intel(R) Core(TM) i3-8145UE CPU @ 2.20GHz, Linux 5.10.27-rt36 (Profile)

Latency plot of system in rack #e, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q done
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Wed May 12, 2021 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1893993928,8cyclictest221-1kworker/3:1H23:00:153
189299340,33cyclictest0-21swapper/222:40:142
189399330,32cyclictest0-21swapper/322:50:143
189299330,32cyclictest0-21swapper/221:40:242
189299330,32cyclictest0-21swapper/221:25:182
189299330,32cyclictest0-21swapper/200:30:182
1891993332,1cyclictest223-1kworker/1:2H20:15:211
189199330,32cyclictest0-21swapper/100:05:191
1890993332,1cyclictest30610-21kworker/0:120:10:130
1890993332,1cyclictest144-1kworker/0:1H21:30:160
1890993332,1cyclictest144-1kworker/0:1H00:20:160
189399320,31cyclictest0-21swapper/323:15:133
189399320,31cyclictest0-21swapper/321:55:213
189399320,1cyclictest0-21swapper/300:35:163
1892993230,1cyclictest74-1kworker/2:1H00:15:152
189299320,31cyclictest0-21swapper/223:40:162
189299320,31cyclictest0-21swapper/222:25:192
189299320,31cyclictest0-21swapper/221:20:162
189299320,0cyclictest0-21swapper/222:30:162
189299320,0cyclictest0-21swapper/220:35:192
1891993231,1cyclictest13456-21kworker/1:121:25:161
1890993231,1cyclictest32440-21kworker/0:123:55:200
189099320,31cyclictest0-21swapper/020:55:230
1893993131,0cyclictest9838-21kworker/3:223:45:183
189299316,14cyclictest31281-21tune2fs21:50:132
1892993130,1cyclictest74-1kworker/2:1H22:35:132
1892993130,1cyclictest16600-21kworker/2:023:15:132
189299310,30cyclictest0-21swapper/223:55:192
189299310,30cyclictest0-21swapper/223:45:182
189299310,30cyclictest0-21swapper/221:00:132
189299310,30cyclictest0-21swapper/200:05:182
1891993130,1cyclictest223-1kworker/1:2H23:55:191
1891993130,1cyclictest223-1kworker/1:2H19:50:141
189099310,30cyclictest0-21swapper/021:50:140
189399300,30cyclictest0-21swapper/322:00:133
1892993024,1cyclictest0-21swapper/221:15:192
1891993029,1cyclictest223-1kworker/1:2H21:15:191
189199300,29cyclictest0-21swapper/119:35:141
1890993030,0cyclictest144-1kworker/0:1H19:25:160
1890993029,1cyclictest32440-21kworker/0:100:25:180
1890993029,1cyclictest32440-21kworker/0:100:10:160
1890993028,1cyclictest144-1kworker/0:1H21:45:190
1893992928,1cyclictest9838-21kworker/3:223:05:143
189399290,22cyclictest11280-21sendmail-msp22:40:003
1892992928,1cyclictest0-21swapper/223:50:182
1892992927,1cyclictest6348-21fschecks_count20:25:142
1892992927,1cyclictest0-21swapper/222:00:142
1891992927,1cyclictest223-1kworker/1:2H20:25:151
1891992927,1cyclictest0-21swapper/122:45:151
1890992929,0cyclictest32440-21kworker/0:100:05:190
1893992826,1cyclictest221-1kworker/3:1H22:05:173
1893992826,1cyclictest0-21swapper/319:35:143
1893992826,1cyclictest0-21swapper/319:15:233
1892992827,1cyclictest0-21swapper/221:45:192
1892992827,1cyclictest0-21swapper/221:10:222
1892992827,1cyclictest0-21swapper/220:50:152
1892992827,0cyclictest0-21swapper/220:15:212
1892992826,1cyclictest0-21swapper/222:45:152
1891992827,1cyclictest223-1kworker/1:2H20:30:151
1890992826,1cyclictest32440-21kworker/0:122:50:140
1893992726,1cyclictest221-1kworker/3:1H20:30:143
189399270,26cyclictest0-21swapper/321:29:353
1892992726,1cyclictest0-21swapper/223:35:162
1892992726,1cyclictest0-21swapper/220:10:132
1892992725,1cyclictest22223-21fschecks_time22:15:162
1891992726,1cyclictest223-1kworker/1:2H20:10:131
1891992726,1cyclictest223-1kworker/1:2H00:35:151
1891992725,1cyclictest0-21swapper/121:35:141
1890992726,1cyclictest32440-21kworker/0:123:00:140
1893992623,3cyclictest0-21swapper/322:41:353
189399261,20cyclictest10706-21apt-get20:35:173
189399260,25cyclictest0-21swapper/323:28:333
189399260,21cyclictest0-21swapper/300:14:573
1892992625,1cyclictest0-21swapper/223:20:162
1892992625,1cyclictest0-21swapper/221:55:222
1892992624,1cyclictest0-21swapper/223:10:142
1892992624,1cyclictest0-21swapper/223:00:152
1892992624,1cyclictest0-21swapper/200:10:152
189299260,25cyclictest23000-21ssh23:28:332
1891992624,1cyclictest0-21swapper/123:10:141
1891992624,1cyclictest0-21swapper/120:05:151
1890992625,1cyclictest144-1kworker/0:1H21:55:210
1890992625,1cyclictest144-1kworker/0:1H19:40:150
1890992624,1cyclictest0-21swapper/019:45:150
1893992519,5cyclictest3641-21sh00:19:573
1893992519,3cyclictest0-21swapper/300:03:543
189399250,25cyclictest0-21swapper/322:27:073
189399250,24cyclictest26948-21diskmemload00:06:293
189399250,24cyclictest0-21swapper/321:51:403
1892992524,1cyclictest0-21swapper/220:20:162
1892992523,1cyclictest0-21swapper/219:35:132
189299250,21cyclictest0-21swapper/222:23:472
1891992524,1cyclictest223-1kworker/1:2H21:50:141
1891992524,1cyclictest223-1kworker/1:2H19:25:161
1891992522,2cyclictest602-21rs:main1
189199250,24cyclictest0-21swapper/121:11:011
189199250,1cyclictest600-21in:imuxsock22:05:011
1890992523,1cyclictest144-1kworker/0:1H23:25:170
189099250,24cyclictest0-21swapper/000:17:200
1893992422,1cyclictest0-21swapper/322:20:153
1893992422,1cyclictest0-21swapper/321:35:153
1893992420,3cyclictest26857-21ssh22:55:393
1893992420,3cyclictest0-21swapper/321:16:123
189399240,24cyclictest0-21swapper/321:10:583
189399240,23cyclictest0-21swapper/322:15:343
189399240,23cyclictest0-21swapper/300:21:223
189399240,20cyclictest0-21swapper/323:53:203
189399240,0cyclictest0-21swapper/323:55:463
189399240,0cyclictest0-21swapper/322:12:593
189399240,0cyclictest0-21swapper/322:12:593
1892992424,0cyclictest0-21swapper/221:39:542
1892992423,1cyclictest0-21swapper/222:05:172
189299240,24cyclictest0-21swapper/221:33:322
1891992423,1cyclictest223-1kworker/1:2H23:20:171
1891992422,1cyclictest0-21swapper/123:45:011
1891992422,1cyclictest0-21swapper/123:05:141
1891992421,2cyclictest4398-21sort21:20:141
189199240,23cyclictest10398-21rm00:25:281
189199240,1cyclictest9536-21ssh22:36:331
189199240,1cyclictest23074-1kworker/u9:000:16:081
189199240,0cyclictest0-21swapper/123:19:511
1890992423,0cyclictest26948-21diskmemload23:52:430
1890992422,2cyclictest0-21swapper/021:24:440
189099242,21cyclictest19265-21ssh21:35:360
189099240,24cyclictest0-21swapper/021:11:000
189099240,23cyclictest26948-21diskmemload22:04:400
1893992323,0cyclictest0-21swapper/322:46:323
1893992323,0cyclictest0-21swapper/300:30:523
1893992322,1cyclictest221-1kworker/3:1H20:15:223
1893992322,1cyclictest0-21swapper/321:30:173
1893992320,3cyclictest0-21swapper/323:42:343
1893992320,3cyclictest0-21swapper/323:12:223
1893992320,3cyclictest0-21swapper/321:47:173
1893992320,3cyclictest0-21swapper/321:43:123
1893992320,2cyclictest12676-21awk00:30:003
189399230,2cyclictest18803-21apt19:45:003
189399230,23cyclictest0-21swapper/321:22:433
189399230,22cyclictest4582-21ssh22:30:403
189399230,22cyclictest18113-21sh23:22:383
1892992322,1cyclictest0-21swapper/221:05:132
1892992321,1cyclictest26948-21diskmemload23:30:132
1892992321,1cyclictest0-21swapper/223:05:142
1892992321,1cyclictest0-21swapper/220:40:162
1892992321,1cyclictest0-21swapper/200:35:162
1892992319,3cyclictest0-21swapper/222:55:262
189299230,23cyclictest0-21swapper/200:00:292
189299230,20cyclictest0-21swapper/200:21:232
1891992323,0cyclictest0-21swapper/123:52:431
1891992323,0cyclictest0-21swapper/122:42:591
1891992321,1cyclictest28893-21ssh21:47:021
1891992321,1cyclictest17225-21ssh22:10:111
1891992321,1cyclictest17225-21ssh22:10:111
1891992321,1cyclictest0-21swapper/123:00:131
189199230,22cyclictest32502-21ssh22:25:371
189199230,22cyclictest27176-21ssh23:33:041
189199230,22cyclictest23695-21ssh21:40:331
189199230,22cyclictest16921-21sh00:34:391
189199230,0cyclictest0-21swapper/123:47:391
189199230,0cyclictest0-21swapper/121:31:321
189199230,0cyclictest0-21swapper/100:10:251
1890992323,0cyclictest0-21swapper/021:15:350
1890992322,1cyclictest1090-21sshd22:27:390
1890992321,1cyclictest885-21apt-get23:40:130
189099230,2cyclictest5278-21ssh23:45:100
189099230,23cyclictest26948-21diskmemload23:12:280
189099230,22cyclictest25944-21dump-pmu-power21:45:010
189099230,22cyclictest0-21swapper/023:20:120
189099230,0cyclictest62050irq/126-eno100:36:080
189099230,0cyclictest0-21swapper/023:19:520
189099230,0cyclictest0-21swapper/022:41:560
189099230,0cyclictest0-21swapper/022:33:060
189399220,21cyclictest0-21swapper/323:30:583
1892992220,1cyclictest0-21swapper/220:30:162
1892992220,1cyclictest0-21swapper/200:25:232
189299220,21cyclictest0-21swapper/220:00:142
189299220,1cyclictest0-21swapper/222:51:532
1891992221,1cyclictest0-21swapper/120:55:211
1891992220,1cyclictest19671-21apt-get23:25:141
1891992220,1cyclictest0-21swapper/122:50:151
189199220,22cyclictest0-21swapper/122:55:401
189199220,22cyclictest0-21swapper/122:08:391
189199220,1cyclictest6279-21rm00:21:191
189199220,1cyclictest23570-21ssh22:15:351
189199220,0cyclictest0-21swapper/122:20:401
1890992221,1cyclictest0-21swapper/022:55:150
1890992220,1cyclictest23418-21grep22:15:250
1890992220,1cyclictest2241-21kworker/u8:221:25:180
189099220,2cyclictest13254-21ssh00:30:150
189099220,22cyclictest0-21swapper/022:22:020
189099220,22cyclictest0-21swapper/022:08:390
189099220,21cyclictest8345-21apt-get20:30:120
189099220,21cyclictest26948-21diskmemload00:00:540
189099220,21cyclictest13079-21apt-get20:40:130
189099220,21cyclictest11639-21apt-get19:30:110
189099220,1cyclictest26948-21diskmemload22:10:220
189099220,1cyclictest26948-21diskmemload22:10:220
189099220,1cyclictest26093-21sh23:30:530
189099220,1cyclictest15994-21ssh22:45:020
189099220,1cyclictest10245-21ssh22:37:580
1893992120,0cyclictest0-21swapper/319:55:123
189399210,21cyclictest0-21swapper/320:05:143
189299218,0cyclictest0-21swapper/220:46:052
1892992119,1cyclictest0-21swapper/219:25:172
189299211,10cyclictest4989-21tune2fs19:15:232
189299210,21cyclictest0-21swapper/220:05:142
1891992120,1cyclictest28866-21apt-get23:35:141
1891992120,1cyclictest13737-21perf19:35:001
1891992118,2cyclictest12819-21awk20:40:001
189199210,21cyclictest0-21swapper/121:55:191
189199210,21cyclictest0-21swapper/100:02:011
189199210,20cyclictest24127-21apt-get19:55:131
189199210,0cyclictest4468-21apt-get19:15:221
189199210,0cyclictest0-21swapper/120:40:131
189099210,21cyclictest0-21swapper/023:05:210
189099210,20cyclictest5894-21apt-get20:25:130
189099210,20cyclictest26948-21diskmemload23:35:020
1893992020,0cyclictest0-21swapper/321:00:113
1893992020,0cyclictest0-21swapper/320:50:143
1893992020,0cyclictest0-21swapper/319:30:133
189399200,20cyclictest0-21swapper/320:25:123
1892992020,0cyclictest0-21swapper/219:55:132
1892992020,0cyclictest0-21swapper/219:30:122
1891992020,0cyclictest3544-21apt-get20:20:141
1891992020,0cyclictest15437-21apt-get20:45:121
189199200,0cyclictest0-21swapper/119:10:121
1890992020,0cyclictest0-21swapper/020:20:150
1890992020,0cyclictest0-21swapper/019:35:130
1890992018,1cyclictest30945-21perf20:10:000
189099200,0cyclictest0-21swapper/019:55:120
189099200,0cyclictest0-21swapper/019:10:120
1893991919,0cyclictest0-21swapper/321:05:113
1893991917,1cyclictest15173-21perf20:45:013
1893991917,1cyclictest0-21swapper/319:45:143
1892991919,0cyclictest0-21swapper/219:40:142
1891991918,1cyclictest0-21swapper/120:00:131
1890991919,0cyclictest0-21swapper/020:45:120
1890991918,1cyclictest12802-21perf20:40:000
1890991918,0cyclictest26505-21apt-get20:00:130
1892991816,1cyclictest0-21swapper/219:20:132
1890991816,1cyclictest22524-21apt-get21:00:120
1890991816,1cyclictest144-1kworker/0:1H20:50:160
1890991816,1cyclictest0-21swapper/021:05:140
1893991717,0cyclictest0-21swapper/320:45:133
1893991717,0cyclictest0-21swapper/319:50:113
1893991716,0cyclictest2102-21apt-get19:10:123
1892991717,0cyclictest0-21swapper/219:50:112
1893991616,0cyclictest0-21swapper/320:20:143
1893991616,0cyclictest0-21swapper/319:20:133
189399160,15cyclictest344-21unixbench_multi20:10:213
1892991616,0cyclictest0-21swapper/219:10:122
1891991616,0cyclictest0-21swapper/120:50:121
1890991614,1cyclictest23528-21/usr/sbin/munin19:55:000
1890991614,1cyclictest1154-21apt-get20:15:200
1890991614,1cyclictest0-21swapper/019:15:260
189399150,14cyclictest9286-21apt-get19:25:133
1892991514,1cyclictest0-21swapper/220:55:222
1892991513,1cyclictest0-21swapper/219:45:182
1891991515,0cyclictest0-21swapper/121:00:121
1891991515,0cyclictest0-21swapper/119:45:001
189399140,0cyclictest0-21swapper/320:55:523
189399140,0cyclictest0-21swapper/320:00:423
1891991414,0cyclictest0-21swapper/119:45:131
1891991413,0cyclictest0-21swapper/121:05:121
189199140,0cyclictest0-21swapper/119:20:331
189099140,14cyclictest0-21swapper/019:20:320
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional