You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-08-04 - 20:02

Intel(R) Core(TM) i3-8145UE CPU @ 2.20GHz, Linux 5.10.27-rt36 (Profile)

Latency plot of system in rack #e, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q done
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the alll highest latencies:
System rackeslot6.osadl.org (updated Wed Aug 04, 2021 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3631993730,6cyclictest74-1kworker/2:1H11:00:232
3632993432,1cyclictest221-1kworker/3:1H08:50:143
3623993433,1cyclictest8324-21kworker/0:209:55:170
3632993331,1cyclictest221-1kworker/3:1H10:45:293
363199330,1cyclictest0-21swapper/207:40:192
363099330,1cyclictest0-21swapper/108:20:191
3623993331,1cyclictest6707-21kworker/0:008:30:160
362399330,32cyclictest0-21swapper/008:10:170
3632993231,1cyclictest24840-21kworker/3:307:40:193
3632993231,1cyclictest221-1kworker/3:1H09:05:183
363299320,1cyclictest0-21swapper/308:15:193
3631993231,1cyclictest74-1kworker/2:1H11:20:162
3631993231,1cyclictest20542-21kworker/2:209:25:222
3630993231,1cyclictest223-1kworker/1:2H10:15:341
363099320,1cyclictest0-21swapper/111:25:211
3631993130,1cyclictest74-1kworker/2:1H10:40:212
3631993129,1cyclictest74-1kworker/2:1H07:50:172
3630993130,1cyclictest223-1kworker/1:2H08:05:191
3632993029,1cyclictest221-1kworker/3:1H09:20:163
3631993029,1cyclictest74-1kworker/2:1H10:25:222
3630993029,1cyclictest223-1kworker/1:2H09:05:171
3630993029,1cyclictest223-1kworker/1:2H08:40:181
3632992928,1cyclictest221-1kworker/3:1H08:55:193
3632992927,1cyclictest0-21swapper/307:35:183
363199299,10cyclictest8232-21tune2fs09:50:172
3623992927,1cyclictest0-21swapper/012:00:220
3623992927,1cyclictest0-21swapper/008:35:270
3631992827,1cyclictest74-1kworker/2:1H08:30:162
3630992827,1cyclictest223-1kworker/1:2H11:05:251
3623992827,1cyclictest8324-21kworker/0:211:30:180
3623992827,1cyclictest0-21swapper/010:10:210
363199276,11cyclictest18383-21tune2fs09:30:242
3631992726,1cyclictest74-1kworker/2:1H09:00:262
3631992726,1cyclictest74-1kworker/2:1H08:15:182
3631992726,1cyclictest0-21swapper/212:25:162
3630992726,1cyclictest223-1kworker/1:2H08:25:161
3630992726,1cyclictest0-21swapper/109:35:171
3630992725,1cyclictest0-21swapper/111:55:191
3630992725,1cyclictest0-21swapper/107:30:251
3632992624,1cyclictest0-21swapper/307:50:173
363199268,0cyclictest27069-21diskmemload09:37:162
363199266,10cyclictest6693-21tune2fs08:25:152
363199265,12cyclictest13102-21tune2fs12:20:182
3631992625,1cyclictest74-1kworker/2:1H08:05:192
3631992625,1cyclictest0-21swapper/210:00:172
363099264,2cyclictest6019-21sendmail-msp09:20:011
363099261,24cyclictest27069-21diskmemload12:33:521
363099260,25cyclictest15628-21ssh10:54:571
3623992625,1cyclictest62050irq/126-eno109:50:160
362399261,24cyclictest594-21cron08:00:000
3632992524,1cyclictest221-1kworker/3:1H11:20:153
3632992524,1cyclictest221-1kworker/3:1H09:15:183
3632992523,1cyclictest0-21swapper/309:45:173
363299250,24cyclictest27069-21diskmemload09:32:153
363199255,10cyclictest24200-21tune2fs12:30:232
363199250,24cyclictest32257-21ssh10:10:452
3630992524,1cyclictest223-1kworker/1:2H09:10:181
3630992524,1cyclictest223-1kworker/1:2H08:35:271
3630992522,3cyclictest2658-21kworker/1:111:20:161
3630992522,2cyclictest20624-21unixbench_multi10:00:241
363099250,25cyclictest0-21swapper/112:15:171
363099250,25cyclictest0-21swapper/112:15:171
363099250,24cyclictest0-21swapper/111:33:191
363099250,24cyclictest0-21swapper/110:25:591
363099250,24cyclictest0-21swapper/109:56:091
3623992525,0cyclictest24154-21kworker/0:107:10:170
3623992523,1cyclictest0-21swapper/011:27:330
3623992523,1cyclictest0-21swapper/010:35:170
3623992523,1cyclictest0-21swapper/009:30:240
362399250,25cyclictest0-21swapper/011:22:460
362399250,24cyclictest27069-21diskmemload09:28:590
362399250,1cyclictest0-21swapper/010:52:230
3632992422,1cyclictest23739-21ssh10:32:193
3632992422,1cyclictest0-21swapper/311:10:233
363299240,23cyclictest366-21ssh12:08:293
363299240,23cyclictest27069-21diskmemload12:30:143
363299240,23cyclictest27069-21diskmemload12:27:073
363299240,23cyclictest27069-21diskmemload11:32:463
363299240,23cyclictest27069-21diskmemload10:58:093
363299240,23cyclictest27069-21diskmemload09:26:173
363299240,23cyclictest0-21swapper/310:14:453
363299240,1cyclictest27069-21diskmemload12:00:103
363299240,1cyclictest0-21swapper/310:23:443
363199245,9cyclictest17615-21tune2fs11:25:222
3631992423,1cyclictest74-1kworker/2:1H09:40:172
3631992421,2cyclictest28993-21sort11:05:332
3631992421,0cyclictest0-21swapper/210:16:002
3631992411,13cyclictest32634-21ssh09:14:532
3631992410,13cyclictest26759-21tune2fs10:35:182
363199240,23cyclictest21997-21ssh11:58:282
363199240,23cyclictest13590-21ssh10:23:522
3630992424,0cyclictest0-21swapper/111:17:031
3630992423,1cyclictest32500-21ssh12:37:421
3630992422,1cyclictest31409-21cut10:10:301
3630992422,1cyclictest0-21swapper/112:20:181
363099241,22cyclictest21197-21sh10:59:481
363099241,22cyclictest0-21swapper/109:52:361
363099240,24cyclictest0-21swapper/111:39:501
363099240,24cyclictest0-21swapper/110:07:061
363099240,23cyclictest0-21swapper/109:46:581
363099240,1cyclictest0-21swapper/112:09:011
363099240,1cyclictest0-21swapper/111:41:331
3623992424,0cyclictest0-21swapper/012:36:320
3623992424,0cyclictest0-21swapper/012:05:180
3623992423,1cyclictest62050irq/126-eno112:15:200
3623992423,1cyclictest62050irq/126-eno112:15:200
3623992423,1cyclictest144-1kworker/0:1H11:45:200
3623992423,1cyclictest0-21swapper/008:00:160
3623992422,1cyclictest0-21swapper/012:21:220
3623992422,1cyclictest0-21swapper/010:55:180
3623992422,1cyclictest0-21swapper/010:15:340
362399240,24cyclictest0-21swapper/010:49:450
362399240,23cyclictest27069-21diskmemload12:27:300
362399240,23cyclictest27069-21diskmemload10:07:150
362399240,23cyclictest0-21swapper/011:36:560
362399240,23cyclictest0-21swapper/009:18:320
362399240,1cyclictest27069-21diskmemload09:45:180
3632992323,0cyclictest27069-21diskmemload09:50:273
3632992323,0cyclictest0-21swapper/312:23:063
3632992323,0cyclictest0-21swapper/310:25:133
3632992323,0cyclictest0-21swapper/310:02:133
3632992322,1cyclictest27069-21diskmemload10:52:303
3632992322,1cyclictest0-21swapper/310:41:093
3632992322,0cyclictest0-21swapper/312:17:143
3632992322,0cyclictest0-21swapper/312:17:143
3632992321,1cyclictest6029-21apt-get11:15:173
3632992321,1cyclictest32265-21ssh09:14:243
3632992320,2cyclictest5868-21perf07:15:003
3632992320,2cyclictest32551-21rm11:38:563
363299230,23cyclictest0-21swapper/312:36:073
363299230,23cyclictest0-21swapper/311:07:273
363299230,23cyclictest0-21swapper/310:07:503
363299230,22cyclictest27069-21diskmemload11:40:373
363299230,22cyclictest2641-21ssh12:10:223
363299230,22cyclictest25963-21rm11:03:463
363299230,22cyclictest24807-21grep09:05:013
363299230,22cyclictest17645-21rm09:58:533
363299230,21cyclictest0-21swapper/310:17:383
363299230,1cyclictest27069-21diskmemload11:29:043
363299230,1cyclictest26075-21ssh10:35:073
363299230,0cyclictest27069-21diskmemload11:56:533
363299230,0cyclictest0-21swapper/311:46:073
363299230,0cyclictest0-21swapper/309:40:553
363199239,4cyclictest4277-21tune2fs07:10:162
363199239,11cyclictest32217-21tune2fs08:10:162
3631992323,0cyclictest27069-21diskmemload12:15:132
3631992323,0cyclictest27069-21diskmemload12:15:132
3631992323,0cyclictest27069-21diskmemload12:05:022
3631992323,0cyclictest0-21swapper/211:40:512
3631992323,0cyclictest0-21swapper/209:55:142
3631992323,0cyclictest0-21swapper/209:15:042
3631992321,1cyclictest27069-21diskmemload11:50:382
3631992320,2cyclictest25896-21ssh12:01:212
363199230,23cyclictest9384-21ssh09:22:012
363199230,23cyclictest27069-21diskmemload11:12:102
363199230,22cyclictest27069-21diskmemload12:11:272
363199230,22cyclictest18564-21ssh10:56:232
363199230,22cyclictest0-21swapper/210:05:152
363199230,1cyclictest2042-21ssh09:45:062
363199230,0cyclictest0-21swapper/210:50:112
3630992323,0cyclictest0-21swapper/110:46:001
3630992323,0cyclictest0-21swapper/110:36:191
3630992321,2cyclictest0-21swapper/110:30:201
3630992321,1cyclictest27069-21diskmemload12:10:161
3630992321,1cyclictest27069-21diskmemload10:43:251
3630992321,1cyclictest0-21swapper/112:00:461
3630992320,2cyclictest24271-21rm11:01:261
3630992320,2cyclictest2076-21grep08:15:191
363099230,2cyclictest19244-21/usr/sbin/munin12:25:221
363099230,23cyclictest0-21swapper/111:10:571
363099230,23cyclictest0-21swapper/110:20:041
363099230,23cyclictest0-21swapper/109:42:011
363099230,23cyclictest0-21swapper/109:29:281
363099230,22cyclictest27069-21diskmemload09:30:281
363099230,0cyclictest0-21swapper/107:45:141
3623992323,0cyclictest27069-21diskmemload09:40:380
3623992323,0cyclictest0-21swapper/011:55:490
3623992321,2cyclictest4761-21sh11:42:360
3623992321,1cyclictest0-21swapper/012:11:170
3623992321,1cyclictest0-21swapper/009:23:310
362399230,2cyclictest25764-21ssh09:36:120
362399230,23cyclictest0-21swapper/011:11:340
362399230,22cyclictest27069-21diskmemload10:26:030
362399230,22cyclictest11116-21perf11:20:010
362399230,22cyclictest0-21swapper/011:00:220
362399230,22cyclictest0-21swapper/010:40:030
362399230,22cyclictest0-21swapper/010:30:080
362399230,1cyclictest0-21swapper/010:01:220
362399230,0cyclictest26143-21ssh12:31:310
3632992220,1cyclictest20073-21apt-get07:45:143
3632992220,1cyclictest15395-21apt-get08:45:123
3632992220,1cyclictest13105-21apt-get08:40:163
363299220,22cyclictest0-21swapper/309:35:023
363299220,21cyclictest8217-21munin-run08:30:003
3631992222,0cyclictest0-21swapper/211:45:262
3631992222,0cyclictest0-21swapper/210:45:212
3631992220,1cyclictest22758-21apt-get11:30:172
363199220,21cyclictest17692-21apt-get08:50:122
363199220,21cyclictest0-21swapper/211:15:192
363199220,1cyclictest27084-21awk09:10:012
363199220,0cyclictest0-21swapper/211:35:292
3630992221,1cyclictest0-21swapper/111:45:081
3630992220,1cyclictest8195-21munin-run07:20:011
3630992220,1cyclictest24515-21perf07:54:591
3623992220,2cyclictest9271-21/usr/sbin/munin10:20:320
3623992220,1cyclictest27106-21awk09:10:010
3623992220,1cyclictest0-21swapper/007:35:010
362399220,22cyclictest0-21swapper/011:08:320
363299210,21cyclictest0-21swapper/311:50:153
363299210,1cyclictest27107-21apt-get08:00:163
3631992121,0cyclictest74-1kworker/2:1H08:55:192
362399210,0cyclictest0-21swapper/007:40:150
363299200,0cyclictest0-21swapper/307:15:173
3631992020,0cyclictest0-21swapper/208:40:162
3631992020,0cyclictest0-21swapper/208:00:162
363099200,0cyclictest0-21swapper/108:45:121
3623992020,0cyclictest0-21swapper/008:05:170
3623992019,1cyclictest144-1kworker/0:1H07:50:160
3623992017,2cyclictest17504-21perf07:40:000
362399200,0cyclictest0-21swapper/008:25:140
363299190,0cyclictest0-21swapper/307:20:133
3631991917,1cyclictest6143-21apt-get07:15:162
3630991916,2cyclictest0-21swapper/109:05:001
3623991919,0cyclictest0-21swapper/007:15:170
3623991917,1cyclictest0-21swapper/008:50:110
3623991917,1cyclictest0-21swapper/007:20:140
363199187,10cyclictest25366-21tune2fs07:55:162
3631991818,0cyclictest0-21swapper/208:20:152
3631991818,0cyclictest0-21swapper/207:35:172
3631991818,0cyclictest0-21swapper/207:30:222
3631991817,1cyclictest8462-21apt-get07:20:132
3631991815,2cyclictest0-21swapper/208:45:122
3630991816,1cyclictest9707-21readlink08:30:211
3630991816,1cyclictest32088-21diskstats08:10:161
3630991816,1cyclictest0-21swapper/107:40:011
363099180,1cyclictest0-21swapper/107:10:081
363099180,0cyclictest0-21swapper/107:40:171
3623991818,0cyclictest0-21swapper/008:45:110
3623991818,0cyclictest0-21swapper/008:15:170
3632991717,0cyclictest0-21swapper/308:35:193
3630991716,1cyclictest0-21swapper/108:50:131
3630991716,1cyclictest0-21swapper/108:00:301
3623991717,0cyclictest0-21swapper/009:00:210
3623991717,0cyclictest0-21swapper/008:40:150
362399170,0cyclictest0-21swapper/007:25:200
363299160,0cyclictest0-21swapper/308:30:113
3630991616,0cyclictest0-21swapper/107:55:211
3630991614,2cyclictest0-21swapper/107:25:211
363099160,15cyclictest0-21swapper/108:55:201
3623991616,0cyclictest0-21swapper/007:45:130
362399160,15cyclictest0-21swapper/008:20:160
3632991515,0cyclictest0-21swapper/308:20:163
3631991515,0cyclictest0-21swapper/207:45:142
3632991414,0cyclictest0-21swapper/307:25:183
3632991413,0cyclictest0-21swapper/308:10:153
363299140,14cyclictest0-21swapper/308:05:473
363299140,14cyclictest0-21swapper/307:56:033
363299140,14cyclictest0-21swapper/307:30:173
363199140,14cyclictest0-21swapper/207:27:242
363199140,12cyclictest10791-21apt-get08:35:202
363099140,0cyclictest0-21swapper/107:20:301
362399140,0cyclictest0-21swapper/008:55:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional