You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-06 - 04:30

x86 Intel Core i3-8145UE @2200 MHz, Linux 5.10.27-rt36 (Profile)

Latency plot of system in rack #e, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Tue Jun 06, 2023 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22256993527,4cyclictest13784-21diskmemload00:27:082
22256993228,3cyclictest13784-21diskmemload00:31:002
22256993228,3cyclictest0-21swapper/222:42:132
22256993225,3cyclictest0-21swapper/223:03:412
2225699320,32cyclictest0-21swapper/222:39:232
2225699320,31cyclictest0-21swapper/221:33:562
2225699320,0cyclictest0-21swapper/223:52:382
2225699320,0cyclictest0-21swapper/221:39:012
2226099310,30cyclictest31334-21chrt23:00:593
22256993128,3cyclictest13784-21diskmemload21:44:342
2225699310,30cyclictest24819-21munin-run00:00:012
2225699310,0cyclictest0-21swapper/223:45:532
2225699310,0cyclictest0-21swapper/223:26:462
2225699310,0cyclictest0-21swapper/221:48:552
2225699310,0cyclictest0-21swapper/221:10:072
2225299310,30cyclictest5134-21cron22:05:001
2224599310,30cyclictest27122-21users00:00:310
22260993028,1cyclictest9765-21if_eno122:40:223
22260993028,1cyclictest24125-21needreboot00:30:313
22260993028,1cyclictest18001-21df21:45:203
22260993028,1cyclictest13819-21munin-run21:10:003
2226099300,29cyclictest8063-21/usr/sbin/munin21:35:223
2226099300,29cyclictest32048-21ssh00:38:503
2226099300,29cyclictest13784-21diskmemload23:55:063
2226099300,29cyclictest13784-21diskmemload22:58:553
2226099300,29cyclictest13784-21diskmemload22:10:003
2226099300,29cyclictest13784-21diskmemload00:20:173
2226099300,29cyclictest0-21swapper/322:35:173
2226099300,29cyclictest0-21swapper/322:03:223
2226099300,1cyclictest13784-21diskmemload22:28:103
2226099300,1cyclictest0-21swapper/320:15:133
22256993028,2cyclictest0-21swapper/222:50:172
22256993028,1cyclictest22622-21cron20:20:012
22256993027,3cyclictest13784-21diskmemload22:48:402
22256993027,3cyclictest0-21swapper/223:31:222
2225699300,30cyclictest0-21swapper/222:06:172
2225699300,30cyclictest0-21swapper/221:22:592
2225699300,29cyclictest29240-21sensors_temp21:55:272
2225699300,29cyclictest13784-21diskmemload22:01:402
2225699300,29cyclictest0-21swapper/200:20:202
22252993029,1cyclictest21769-21munin-run23:25:021
2225299300,29cyclictest28170-21apt-get00:35:191
2225299300,29cyclictest13784-21diskmemload23:03:151
2225299300,29cyclictest13784-21diskmemload22:07:461
2225299300,29cyclictest13784-21diskmemload21:45:291
2225299300,29cyclictest0-21swapper/122:50:241
2225299300,29cyclictest0-21swapper/122:40:191
2225299300,1cyclictest29974-21munin-run00:05:021
2225299300,1cyclictest0-21swapper/121:10:011
22245993028,2cyclictest13784-21diskmemload22:22:300
22245993028,1cyclictest2247-21apt-get21:30:210
22245993028,1cyclictest0-21swapper/023:00:000
2224599300,29cyclictest27133-21apt-get19:20:170
2224599300,29cyclictest13784-21diskmemload22:36:000
2224599300,29cyclictest13784-21diskmemload22:17:280
2224599300,29cyclictest0-21swapper/022:10:420
2224599300,29cyclictest0-21swapper/022:05:220
2224599300,29cyclictest0-21swapper/022:00:480
2224599300,29cyclictest0-21swapper/000:05:200
2224599300,1cyclictest13784-21diskmemload21:59:460
2224599300,1cyclictest13784-21diskmemload21:29:060
2224599300,1cyclictest13784-21diskmemload21:16:010
2224599300,1cyclictest0-21swapper/023:15:190
2224599300,0cyclictest0-21swapper/021:40:030
2226099290,29cyclictest13784-21diskmemload23:36:273
2226099290,29cyclictest13784-21diskmemload21:19:113
2226099290,29cyclictest13784-21diskmemload00:26:533
2226099290,29cyclictest13784-21diskmemload00:16:313
2226099290,29cyclictest13784-21diskmemload00:00:153
2226099290,29cyclictest0-21swapper/323:41:363
2226099290,29cyclictest0-21swapper/323:32:003
2226099290,29cyclictest0-21swapper/323:16:513
2226099290,29cyclictest0-21swapper/323:05:263
2226099290,29cyclictest0-21swapper/322:30:483
2226099290,29cyclictest0-21swapper/321:40:073
2226099290,29cyclictest0-21swapper/321:31:393
2226099290,29cyclictest0-21swapper/321:25:413
2226099290,29cyclictest0-21swapper/321:23:213
2226099290,29cyclictest0-21swapper/321:12:293
2226099290,29cyclictest0-21swapper/300:14:253
2226099290,1cyclictest13784-21diskmemload22:16:413
2226099290,0cyclictest22843-21apt-get21:50:183
2226099290,0cyclictest13784-21diskmemload23:51:303
2226099290,0cyclictest13784-21diskmemload23:48:203
2226099290,0cyclictest13784-21diskmemload23:25:263
2226099290,0cyclictest13784-21diskmemload22:50:093
2226099290,0cyclictest13784-21diskmemload21:55:373
2226099290,0cyclictest0-21swapper/322:22:493
22256992928,1cyclictest13784-21diskmemload00:15:462
22256992927,2cyclictest0-21swapper/222:31:172
22256992927,2cyclictest0-21swapper/222:10:292
22256992927,2cyclictest0-21swapper/200:00:372
2225699290,29cyclictest13784-21diskmemload23:36:352
2225699290,29cyclictest13784-21diskmemload21:51:202
2225699290,29cyclictest0-21swapper/223:41:502
2225699290,29cyclictest0-21swapper/223:10:212
2225699290,29cyclictest0-21swapper/223:05:572
2225699290,29cyclictest0-21swapper/222:22:032
2225699290,29cyclictest0-21swapper/200:36:112
2225699290,29cyclictest0-21swapper/200:12:062
2225699290,29cyclictest0-21swapper/200:07:432
2225699290,28cyclictest0-21swapper/220:00:162
2225699290,0cyclictest13784-21diskmemload23:20:022
2225699290,0cyclictest0-21swapper/222:55:172
2225699290,0cyclictest0-21swapper/222:25:432
2225699290,0cyclictest0-21swapper/221:15:002
22252992929,0cyclictest13784-21diskmemload23:31:031
22252992929,0cyclictest0-21swapper/123:10:191
22252992929,0cyclictest0-21swapper/121:55:171
22252992929,0cyclictest0-21swapper/121:42:571
22252992929,0cyclictest0-21swapper/121:17:491
2225299290,29cyclictest13784-21diskmemload23:41:351
2225299290,29cyclictest13784-21diskmemload22:55:451
2225299290,29cyclictest13784-21diskmemload22:15:091
2225299290,29cyclictest0-21swapper/123:50:581
2225299290,29cyclictest0-21swapper/123:45:261
2225299290,29cyclictest0-21swapper/123:36:331
2225299290,29cyclictest0-21swapper/123:25:051
2225299290,29cyclictest0-21swapper/122:45:271
2225299290,29cyclictest0-21swapper/122:34:571
2225299290,29cyclictest0-21swapper/122:27:311
2225299290,29cyclictest0-21swapper/122:10:451
2225299290,29cyclictest0-21swapper/121:36:341
2225299290,29cyclictest0-21swapper/121:26:081
2225299290,29cyclictest0-21swapper/121:21:181
2225299290,29cyclictest0-21swapper/100:25:011
2225299290,29cyclictest0-21swapper/100:05:351
2225299290,0cyclictest23079-21ssh00:30:211
2225299290,0cyclictest13784-21diskmemload22:37:571
2225299290,0cyclictest13784-21diskmemload00:15:251
2225299290,0cyclictest13784-21diskmemload00:11:481
2225299290,0cyclictest0-21swapper/123:55:011
2225299290,0cyclictest0-21swapper/123:05:361
2225299290,0cyclictest0-21swapper/121:50:361
2225299290,0cyclictest0-21swapper/121:33:401
2225299290,0cyclictest0-21swapper/119:25:181
2225299290,0cyclictest0-21swapper/100:22:221
22245992929,0cyclictest13784-21diskmemload22:30:190
22245992928,1cyclictest13784-21diskmemload21:35:110
22245992928,1cyclictest0-21swapper/023:45:490
2224599290,29cyclictest13784-21diskmemload23:50:100
2224599290,29cyclictest13784-21diskmemload22:25:080
2224599290,29cyclictest0-21swapper/023:28:170
2224599290,29cyclictest0-21swapper/023:02:470
2224599290,29cyclictest0-21swapper/021:50:140
2224599290,29cyclictest0-21swapper/021:45:010
2224599290,29cyclictest0-21swapper/021:20:110
2224599290,29cyclictest0-21swapper/000:35:050
2224599290,29cyclictest0-21swapper/000:25:060
2224599290,28cyclictest23073-21apt-get00:30:210
2224599290,0cyclictest13784-21diskmemload23:36:030
2224599290,0cyclictest13784-21diskmemload23:23:010
2224599290,0cyclictest13784-21diskmemload23:11:020
2224599290,0cyclictest13784-21diskmemload22:40:010
2224599290,0cyclictest13784-21diskmemload00:16:030
2224599290,0cyclictest0-21swapper/023:56:330
2224599290,0cyclictest0-21swapper/023:41:050
2224599290,0cyclictest0-21swapper/023:32:500
2224599290,0cyclictest0-21swapper/023:07:270
2224599290,0cyclictest0-21swapper/022:51:570
2224599290,0cyclictest0-21swapper/022:45:490
2224599290,0cyclictest0-21swapper/021:10:150
2224599290,0cyclictest0-21swapper/000:21:000
2224599290,0cyclictest0-21swapper/000:11:060
22260992828,0cyclictest0-21swapper/319:50:143
22260992828,0cyclictest0-21swapper/319:15:163
22260992828,0cyclictest0-21swapper/319:10:143
22260992825,2cyclictest1421-21cron19:35:003
2226099280,28cyclictest0-21swapper/322:05:423
2226099280,28cyclictest0-21swapper/300:05:233
2226099280,0cyclictest0-21swapper/323:10:063
2225699280,28cyclictest0-21swapper/221:25:162
2225699280,28cyclictest0-21swapper/220:40:122
22252992828,0cyclictest0-21swapper/123:15:281
22252992828,0cyclictest0-21swapper/120:35:141
22252992827,1cyclictest4769-21apt-get20:50:141
22252992826,1cyclictest0-21swapper/120:00:011
2225299280,0cyclictest0-21swapper/120:55:141
22245992828,0cyclictest0-21swapper/020:40:130
2224599280,28cyclictest0-21swapper/020:35:140
22252992727,0cyclictest0-21swapper/119:20:161
22252992726,1cyclictest24497-21cron19:15:011
22260992624,1cyclictest15691-21munin-run20:05:013
22256992626,0cyclictest0-21swapper/221:00:152
22256992626,0cyclictest0-21swapper/219:50:022
22252992626,0cyclictest0-21swapper/120:40:121
22252992625,0cyclictest1731-21apt-get19:35:201
22260992525,0cyclictest31552-21perf19:30:013
22252992524,1cyclictest2458-21apt-get20:45:181
22256992424,0cyclictest0-21swapper/220:20:182
22256992424,0cyclictest0-21swapper/219:20:162
22252992424,0cyclictest18265-21apt-get20:10:141
22245992424,0cyclictest0-21swapper/020:50:130
22245992424,0cyclictest0-21swapper/020:45:180
22256992323,0cyclictest0-21swapper/219:45:182
22252992323,0cyclictest0-21swapper/119:15:151
22245992323,0cyclictest0-21swapper/019:40:150
22256992222,0cyclictest0-21swapper/219:55:142
22245992222,0cyclictest0-21swapper/019:25:190
22260992120,0cyclictest4065-21apt-get19:40:163
22260992119,1cyclictest11460-21cron21:05:003
22256992121,0cyclictest0-21swapper/220:30:162
22260992018,1cyclictest2169-21cron20:45:013
22260991919,0cyclictest15952-21apt-get20:05:173
22252991919,0cyclictest0-21swapper/119:40:161
22256991818,0cyclictest0-21swapper/220:45:172
22256991715,1cyclictest0-21swapper/221:00:012
2226099160,15cyclictest28337-21processes19:20:233
22256991616,0cyclictest0-21swapper/220:10:132
22252991616,0cyclictest0-21swapper/120:15:121
22245991616,0cyclictest0-21swapper/020:10:130
22245991614,1cyclictest12188-21memory19:55:190
22260991515,0cyclictest0-21swapper/320:30:163
2226099150,1cyclictest0-21swapper/319:55:183
2226099150,14cyclictest2159-21diskstats19:35:233
2226099150,14cyclictest0-21swapper/320:35:013
22256991515,0cyclictest0-21swapper/220:25:242
22256991513,1cyclictest0-21swapper/219:40:202
2225699150,15cyclictest0-21swapper/219:12:352
22245991515,0cyclictest0-21swapper/019:10:130
2224599150,1cyclictest9594-21cut21:00:150
2224599150,14cyclictest0-21swapper/020:09:310
22260991414,0cyclictest0-21swapper/320:57:153
22260991412,1cyclictest0-21swapper/320:10:223
2226099140,14cyclictest29585-21kworker/3:120:45:553
2226099140,14cyclictest0-21swapper/320:25:143
2226099140,14cyclictest0-21swapper/320:20:153
2226099140,14cyclictest0-21swapper/319:45:013
22256991414,0cyclictest0-21swapper/221:05:132
2225699140,14cyclictest0-21swapper/220:54:312
2225699140,14cyclictest0-21swapper/220:37:212
2225699140,14cyclictest0-21swapper/220:08:392
2225699140,14cyclictest0-21swapper/219:16:032
2225699140,0cyclictest0-21swapper/219:36:392
2225699140,0cyclictest0-21swapper/219:32:372
22252991414,0cyclictest0-21swapper/121:01:081
22252991414,0cyclictest0-21swapper/119:52:211
2225299140,14cyclictest0-21swapper/121:08:011
2225299140,14cyclictest0-21swapper/120:30:241
2225299140,14cyclictest0-21swapper/120:26:041
2225299140,14cyclictest0-21swapper/120:21:281
2225299140,14cyclictest0-21swapper/120:07:011
2225299140,14cyclictest0-21swapper/119:46:411
2225299140,14cyclictest0-21swapper/119:30:101
2225299140,0cyclictest0-21swapper/120:00:101
22245991414,0cyclictest0-21swapper/021:09:420
22245991414,0cyclictest0-21swapper/020:55:140
22245991414,0cyclictest0-21swapper/020:01:060
2224599140,14cyclictest0-21swapper/020:25:060
2224599140,14cyclictest0-21swapper/020:20:240
2224599140,14cyclictest0-21swapper/020:15:180
2224599140,14cyclictest0-21swapper/019:45:160
2224599140,14cyclictest0-21swapper/019:37:070
2224599140,14cyclictest0-21swapper/019:16:260
2224599140,0cyclictest0-21swapper/020:30:100
2224599140,0cyclictest0-21swapper/019:50:550
2224599140,0cyclictest0-21swapper/019:32:510
2226099130,13cyclictest0-21swapper/320:50:153
2225699130,0cyclictest0-21swapper/219:26:292
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional