You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-05 - 14:14

x86 Intel Core i3-8145UE @2200 MHz, Linux 5.10.27-rt36 (Profile)

Latency plot of system in rack #e, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackeslot5.osadl.org (updated Sun Feb 05, 2023 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15351993229,3cyclictest6939-21diskmemload21:42:092
15351993229,3cyclictest6939-21diskmemload21:32:302
15351993228,3cyclictest20272-21cat00:35:142
1535199320,31cyclictest0-21swapper/222:08:062
1535199320,29cyclictest0-21swapper/222:51:582
1535199320,0cyclictest0-21swapper/222:04:272
15346993226,5cyclictest14473-21cron23:25:010
1534699320,29cyclictest6939-21diskmemload22:01:020
1534699320,0cyclictest6939-21diskmemload21:11:050
1534699320,0cyclictest0-21swapper/021:51:120
1535699310,30cyclictest6939-21diskmemload23:58:073
1535699310,30cyclictest17865-21cat00:00:153
15351993128,2cyclictest0-21swapper/223:39:092
1535199310,0cyclictest6939-21diskmemload23:57:502
15347993129,1cyclictest0-21swapper/100:14:311
15346993128,3cyclictest6939-21diskmemload22:08:070
15346993127,4cyclictest0-21swapper/000:35:140
1534699310,31cyclictest0-21swapper/023:12:250
1534699310,0cyclictest6939-21diskmemload21:15:390
1534699310,0cyclictest0-21swapper/022:17:540
15356993028,1cyclictest0-21swapper/321:30:203
1535699300,30cyclictest6939-21diskmemload22:01:563
1535699300,29cyclictest6939-21diskmemload23:10:553
1535699300,29cyclictest6939-21diskmemload22:31:133
1535699300,29cyclictest6939-21diskmemload22:24:103
1535699300,29cyclictest6939-21diskmemload21:55:153
1535699300,29cyclictest6939-21diskmemload21:45:223
1535699300,29cyclictest6939-21diskmemload21:11:243
1535699300,29cyclictest6939-21diskmemload00:22:053
1535699300,29cyclictest32172-21perf00:15:013
1535699300,29cyclictest19980-21cron19:20:003
1535699300,29cyclictest14932-21apt-get23:25:123
1535699300,29cyclictest0-21swapper/323:21:043
1535699300,29cyclictest0-21swapper/322:35:213
1535699300,29cyclictest0-21swapper/300:25:513
1535699300,1cyclictest6939-21diskmemload21:36:013
1535699300,1cyclictest6438-21perf22:45:013
15351993027,3cyclictest6939-21diskmemload23:04:572
1535199300,30cyclictest0-21swapper/223:09:552
1535199300,30cyclictest0-21swapper/222:56:282
1535199300,30cyclictest0-21swapper/222:37:192
1535199300,29cyclictest6939-21diskmemload23:15:232
1535199300,29cyclictest6939-21diskmemload22:25:162
1535199300,29cyclictest6939-21diskmemload22:10:012
1535199300,29cyclictest6939-21diskmemload21:15:082
1535199300,29cyclictest6939-21diskmemload00:30:522
1535199300,29cyclictest0-21swapper/223:11:062
1535199300,29cyclictest0-21swapper/200:29:562
1535199300,29cyclictest0-21swapper/200:21:272
1535199300,1cyclictest6939-21diskmemload21:49:242
1535199300,0cyclictest0-21swapper/221:26:062
15347993029,1cyclictest0-21swapper/119:30:011
15347993028,1cyclictest20883-21munin-run21:55:001
1534799300,29cyclictest30071-21apt-get20:50:151
1534799300,29cyclictest20758-21apt-get20:30:131
1534799300,29cyclictest0-21swapper/122:30:131
1534799300,1cyclictest15033-21ssh22:20:181
1534799300,1cyclictest0-21swapper/120:25:011
15346993028,2cyclictest0-21swapper/023:01:320
15346993028,2cyclictest0-21swapper/022:56:280
15346993028,2cyclictest0-21swapper/022:51:570
15346993028,2cyclictest0-21swapper/000:05:360
1534699300,30cyclictest9227-21/usr/sbin/munin23:50:220
1534699300,30cyclictest6939-21diskmemload22:33:050
1534699300,30cyclictest0-21swapper/023:25:250
1534699300,30cyclictest0-21swapper/021:37:440
1534699300,30cyclictest0-21swapper/019:40:130
1534699300,1cyclictest6939-21diskmemload23:16:370
1534699300,1cyclictest4113-21cron19:55:010
15356992929,0cyclictest0-21swapper/300:39:133
15356992928,1cyclictest6939-21diskmemload22:57:363
1535699290,29cyclictest6939-21diskmemload21:51:393
1535699290,29cyclictest0-21swapper/323:54:003
1535699290,29cyclictest0-21swapper/323:42:113
1535699290,29cyclictest0-21swapper/323:30:343
1535699290,29cyclictest0-21swapper/323:00:253
1535699290,29cyclictest0-21swapper/322:25:023
1535699290,29cyclictest0-21swapper/322:15:093
1535699290,29cyclictest0-21swapper/322:11:263
1535699290,29cyclictest0-21swapper/322:05:083
1535699290,29cyclictest0-21swapper/321:40:363
1535699290,29cyclictest0-21swapper/321:18:223
1535699290,29cyclictest0-21swapper/300:15:103
1535699290,28cyclictest6790-21apt-get22:45:123
1535699290,28cyclictest25428-21apt-get20:40:133
1535699290,28cyclictest0-21swapper/321:05:143
1535699290,0cyclictest13705-21apt-get20:15:133
1535699290,0cyclictest0-21swapper/323:37:193
1535699290,0cyclictest0-21swapper/323:18:343
1535699290,0cyclictest0-21swapper/323:05:293
1535699290,0cyclictest0-21swapper/321:25:253
1535699290,0cyclictest0-21swapper/320:05:193
1535699290,0cyclictest0-21swapper/300:33:263
1535199290,29cyclictest6939-21diskmemload23:51:192
1535199290,29cyclictest0-21swapper/223:45:222
1535199290,29cyclictest0-21swapper/223:31:262
1535199290,29cyclictest0-21swapper/222:45:022
1535199290,29cyclictest0-21swapper/222:40:312
1535199290,29cyclictest0-21swapper/221:35:542
1535199290,29cyclictest0-21swapper/221:23:262
1535199290,29cyclictest0-21swapper/221:11:022
1535199290,29cyclictest0-21swapper/200:05:072
1535199290,28cyclictest6939-21diskmemload22:20:102
1535199290,28cyclictest0-21swapper/219:20:142
1535199290,1cyclictest0-21swapper/222:30:232
1535199290,0cyclictest6939-21diskmemload23:40:262
1535199290,0cyclictest6939-21diskmemload23:29:572
1535199290,0cyclictest6939-21diskmemload00:16:422
1535199290,0cyclictest0-21swapper/222:15:222
1535199290,0cyclictest0-21swapper/221:50:132
1535199290,0cyclictest0-21swapper/200:12:372
15347992929,0cyclictest0-21swapper/121:45:411
15347992927,1cyclictest561-21dbus-daemon19:35:001
15347992927,1cyclictest561-21dbus-daemon19:35:001
1534799290,29cyclictest0-21swapper/123:48:141
1534799290,29cyclictest0-21swapper/123:35:131
1534799290,29cyclictest0-21swapper/123:25:321
1534799290,29cyclictest0-21swapper/123:11:391
1534799290,29cyclictest0-21swapper/123:06:201
1534799290,29cyclictest0-21swapper/122:35:391
1534799290,29cyclictest0-21swapper/122:30:001
1534799290,29cyclictest0-21swapper/122:00:401
1534799290,29cyclictest0-21swapper/121:42:241
1534799290,29cyclictest0-21swapper/121:22:441
1534799290,29cyclictest0-21swapper/121:17:411
1534799290,29cyclictest0-21swapper/100:35:131
1534799290,29cyclictest0-21swapper/100:25:031
1534799290,29cyclictest0-21swapper/100:20:321
1534799290,28cyclictest12506-21apt-get23:55:131
1534799290,28cyclictest0-21swapper/123:40:131
1534799290,0cyclictest6939-21diskmemload23:16:121
1534799290,0cyclictest6939-21diskmemload22:51:131
1534799290,0cyclictest6939-21diskmemload21:33:141
1534799290,0cyclictest6939-21diskmemload00:15:231
1534799290,0cyclictest0-21swapper/123:50:141
1534799290,0cyclictest0-21swapper/123:33:071
1534799290,0cyclictest0-21swapper/123:20:141
1534799290,0cyclictest0-21swapper/122:56:211
1534799290,0cyclictest0-21swapper/122:45:061
1534799290,0cyclictest0-21swapper/122:41:241
1534799290,0cyclictest0-21swapper/122:10:011
1534799290,0cyclictest0-21swapper/122:05:571
1534799290,0cyclictest0-21swapper/121:57:501
1534799290,0cyclictest0-21swapper/121:37:201
1534799290,0cyclictest0-21swapper/121:27:381
1534799290,0cyclictest0-21swapper/121:10:201
1534799290,0cyclictest0-21swapper/100:33:401
1534799290,0cyclictest0-21swapper/100:07:511
1534799290,0cyclictest0-21swapper/100:01:571
15346992929,0cyclictest6939-21diskmemload22:21:310
15346992928,0cyclictest22787-21cron20:35:020
15346992927,2cyclictest0-21swapper/023:40:310
15346992927,2cyclictest0-21swapper/021:41:350
1534699290,29cyclictest6939-21diskmemload22:10:050
1534699290,29cyclictest6939-21diskmemload21:55:270
1534699290,29cyclictest6939-21diskmemload00:30:430
1534699290,29cyclictest6939-21diskmemload00:27:510
1534699290,29cyclictest6939-21diskmemload00:20:500
1534699290,29cyclictest58550irq/126-eno123:05:570
1534699290,29cyclictest0-21swapper/023:35:020
1534699290,29cyclictest0-21swapper/022:47:100
1534699290,29cyclictest0-21swapper/022:25:240
1534699290,29cyclictest0-21swapper/021:30:310
1534699290,29cyclictest0-21swapper/019:45:120
1534699290,29cyclictest0-21swapper/000:16:430
1534699290,0cyclictest6939-21diskmemload23:56:320
1534699290,0cyclictest6939-21diskmemload23:45:140
1534699290,0cyclictest6939-21diskmemload22:40:360
1534699290,0cyclictest6939-21diskmemload22:36:410
1534699290,0cyclictest6939-21diskmemload21:46:090
1534699290,0cyclictest6939-21diskmemload21:25:420
1534699290,0cyclictest6939-21diskmemload21:21:260
1534699290,0cyclictest0-21swapper/023:30:470
1534699290,0cyclictest0-21swapper/000:10:240
1534699290,0cyclictest0-21swapper/000:02:520
15356992828,0cyclictest2077-21apt-get19:50:123
15356992828,0cyclictest0-21swapper/320:00:133
15356992827,1cyclictest2377-21apt-get23:45:123
1535699280,28cyclictest0-21swapper/322:50:403
1535699280,0cyclictest6939-21diskmemload21:20:103
1535699280,0cyclictest0-21swapper/300:07:323
15351992828,0cyclictest23082-21apt-get20:35:132
15351992828,0cyclictest0-21swapper/200:01:012
15351992827,0cyclictest29311-21apt-get19:40:012
1535199280,28cyclictest0-21swapper/221:55:352
15347992828,0cyclictest6939-21diskmemload23:01:581
1534799280,0cyclictest0-21swapper/119:50:131
1534699280,28cyclictest0-21swapper/019:20:130
1534699280,0cyclictest2588-21apt-get21:00:140
15356992727,0cyclictest0-21swapper/320:10:163
15351992727,0cyclictest0-21swapper/221:00:142
15351992726,1cyclictest4134-21perf19:55:012
15347992727,0cyclictest0-21swapper/120:10:141
15356992626,0cyclictest26968-21perf19:35:013
15356992626,0cyclictest26968-21perf19:35:013
15356992626,0cyclictest0-21swapper/320:55:133
15356992626,0cyclictest0-21swapper/320:25:133
15347992626,0cyclictest27244-21apt-get19:35:161
15346992626,0cyclictest0-21swapper/020:35:130
15351992523,1cyclictest584-21gdbus21:00:002
15356992424,0cyclictest0-21swapper/319:10:123
15347992424,0cyclictest0-21swapper/121:05:131
15347992424,0cyclictest0-21swapper/119:55:131
15347992424,0cyclictest0-21swapper/119:15:011
15351992323,0cyclictest17923-21apt-get19:15:132
15346992322,1cyclictest2031-21sh21:00:000
15347992121,0cyclictest27748-21apt-get20:45:131
15347992121,0cyclictest0-21swapper/120:00:131
15346992121,0cyclictest0-21swapper/019:15:130
15347992018,1cyclictest561-21dbus-daemon21:04:591
15356991919,0cyclictest0-21swapper/321:00:143
15356991816,1cyclictest1779-21cron19:50:003
15347991818,0cyclictest0-21swapper/120:40:141
15356991515,0cyclictest0-21swapper/320:50:153
15356991515,0cyclictest0-21swapper/319:25:133
15356991513,1cyclictest25162-21munin-run20:40:003
1535199150,14cyclictest24914-21apt-get19:30:122
1535199150,14cyclictest24914-21apt-get19:30:122
1535199150,14cyclictest22591-21apt-get19:25:132
15347991514,1cyclictest561-21dbus-daemon19:20:011
1534699150,14cyclictest0-21swapper/020:23:250
1535699140,14cyclictest0-21swapper/320:32:513
1535699140,14cyclictest0-21swapper/319:42:513
1535699140,14cyclictest0-21swapper/319:35:513
1535699140,14cyclictest0-21swapper/319:20:263
1535699140,0cyclictest0-21swapper/320:45:043
1535699140,0cyclictest0-21swapper/320:20:113
1535699140,0cyclictest0-21swapper/319:56:063
15351991414,0cyclictest0-21swapper/220:15:502
15351991414,0cyclictest0-21swapper/220:00:132
15351991414,0cyclictest0-21swapper/219:47:432
15351991413,1cyclictest0-21swapper/220:40:232
1535199140,14cyclictest0-21swapper/221:05:022
1535199140,14cyclictest0-21swapper/220:51:262
1535199140,14cyclictest0-21swapper/220:47:052
1535199140,14cyclictest0-21swapper/220:30:182
1535199140,14cyclictest0-21swapper/220:25:252
1535199140,14cyclictest0-21swapper/220:21:042
1535199140,14cyclictest0-21swapper/219:35:052
1535199140,14cyclictest0-21swapper/219:11:382
1535199140,0cyclictest0-21swapper/220:10:362
1535199140,0cyclictest0-21swapper/220:06:402
1535199140,0cyclictest0-21swapper/219:57:162
15347991414,0cyclictest0-21swapper/120:55:121
15347991414,0cyclictest0-21swapper/120:35:221
15347991414,0cyclictest0-21swapper/120:26:571
15347991414,0cyclictest0-21swapper/120:15:121
1534799140,14cyclictest0-21swapper/119:46:141
1534799140,0cyclictest0-21swapper/120:05:101
1534799140,0cyclictest0-21swapper/119:40:551
1534799140,0cyclictest0-21swapper/119:20:501
15346991414,0cyclictest0-21swapper/020:51:250
15346991414,0cyclictest0-21swapper/019:35:060
15346991414,0cyclictest0-21swapper/019:30:120
15346991414,0cyclictest0-21swapper/019:30:120
1534699140,14cyclictest4399-21apt-get19:55:120
1534699140,14cyclictest0-21swapper/021:05:380
1534699140,14cyclictest0-21swapper/020:45:430
1534699140,14cyclictest0-21swapper/020:25:200
1534699140,14cyclictest0-21swapper/020:10:040
1534699140,14cyclictest0-21swapper/020:06:200
1534699140,14cyclictest0-21swapper/020:00:280
1534699140,14cyclictest0-21swapper/019:25:170
1534699140,14cyclictest0-21swapper/019:11:370
1534699140,0cyclictest0-21swapper/020:40:380
1534699140,0cyclictest0-21swapper/020:15:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional