You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-28 - 15:05

x86 Intel Core i5-8265UE @1600 MHz, Linux 5.10.41-rt42 (Profile)

Latency plot of system in rack #a, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8.osadl.org (updated Sun May 28, 2023 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
277262303276,16sleep20-21swapper/207:09:542
276302294259,22sleep30-21swapper/307:08:503
275082284259,16sleep10-21swapper/107:07:151
273642274241,21sleep00-21swapper/007:05:300
49622600,0sleep00-21swapper/009:23:080
222032590,0sleep00-21swapper/009:54:320
316092570,0sleep00-21swapper/011:20:290
104152570,0sleep00-21swapper/011:07:570
40862560,0sleep00-21swapper/012:25:000
198962550,0sleep00-21swapper/011:34:190
116602550,0sleep20-21swapper/212:29:432
58312190,0sleep30-21swapper/311:25:213
284822190,0sleep20-21swapper/211:19:272
28932180,0sleep10-21swapper/107:25:011
195902160,0sleep10-21swapper/111:34:041
145972150,0sleep30-21swapper/311:10:233
106212140,0sleep20-21swapper/210:06:592
302542130,0sleep00-21swapper/010:40:050
2784799114,2cyclictest25948-21systemd-journal12:11:293
95092100,3sleep3341ksoftirqd/311:07:113
58202100,0sleep20-21swapper/208:40:342
5549290,0sleep20-21swapper/212:05:202
278479996,2cyclictest18544-21sh10:32:173
278479995,3cyclictest508-21dbus-daemon07:45:123
278479992,2cyclictest31981-21lldpd08:00:473
278449994,3cyclictest25948-21systemd-journal09:53:182
278449994,3cyclictest25948-21systemd-journal08:03:282
278449993,4cyclictest25948-21systemd-journal10:37:302
278359996,2cyclictest3758-21snmpd10:50:550
278359994,3cyclictest25948-21systemd-journal08:06:040
26526290,0sleep00-21swapper/009:56:320
29051280,1sleep20-21swapper/209:17:332
278479983,3cyclictest25948-21systemd-journal11:55:053
278479983,3cyclictest25948-21systemd-journal11:44:393
278449986,1cyclictest26152-21ssh10:16:392
278449984,3cyclictest25948-21systemd-journal11:37:352
278449984,3cyclictest25948-21systemd-journal11:31:442
278449984,3cyclictest25948-21systemd-journal10:48:222
278449983,4cyclictest0-21swapper/208:15:272
278449983,3cyclictest25948-21systemd-journal12:04:412
278449983,3cyclictest25948-21systemd-journal10:00:222
278399984,3cyclictest508-21dbus-daemon07:30:361
278399983,3cyclictest25948-21systemd-journal09:35:191
278479974,2cyclictest4326-21cron08:40:003
278479974,2cyclictest4307-21sh11:24:383
278479974,2cyclictest23494-21df08:10:193
278479973,3cyclictest8447-21ntpq09:45:233
278479973,3cyclictest6158-21ntpq11:45:243
278479973,3cyclictest508-21dbus-daemon07:40:003
278479973,3cyclictest29741-11brltty08:26:053
278479973,3cyclictest25948-21systemd-journal09:15:283
278479973,3cyclictest25948-21systemd-journal09:01:153
278479973,3cyclictest25948-21systemd-journal08:46:063
278479973,3cyclictest0-21swapper/310:51:343
278479973,3cyclictest0-21swapper/309:58:583
278479973,1cyclictest0-21swapper/312:27:063
278479973,1cyclictest0-21swapper/311:15:233
278479973,1cyclictest0-21swapper/311:04:473
278479973,1cyclictest0-21swapper/311:04:463
278479972,3cyclictest25948-21systemd-journal10:39:353
278479970,7cyclictest0-21swapper/309:50:553
278449976,1cyclictest17991-21diskmemload11:06:482
278449974,2cyclictest11736-21in:imuxsock09:12:232
278449974,2cyclictest11736-21in:imuxsock07:50:372
278449973,3cyclictest508-21dbus-daemon08:52:212
278449973,3cyclictest508-21dbus-daemon08:07:442
278449973,3cyclictest30854-21awk11:20:222
278449973,3cyclictest25948-21systemd-journal10:00:012
278449973,2cyclictest25948-21systemd-journal07:45:272
278449973,1cyclictest0-21swapper/210:51:192
278449970,4cyclictest4483-21idleruntime-cro11:45:012
278449970,1cyclictest28359-21ssh09:37:402
278399976,1cyclictest22-21ksoftirqd/109:20:001
278399974,2cyclictest508-21dbus-daemon10:10:481
278399974,2cyclictest508-21dbus-daemon09:08:131
278399974,2cyclictest508-21dbus-daemon09:08:131
278399973,3cyclictest508-21dbus-daemon08:55:431
278399973,3cyclictest31153-21smart_sda11:20:261
278399973,3cyclictest0-21swapper/112:32:481
278399973,3cyclictest0-21swapper/111:02:511
278399973,3cyclictest0-21swapper/111:02:511
278399973,2cyclictest25948-21systemd-journal12:28:271
278399973,2cyclictest25948-21systemd-journal09:31:191
278399973,1cyclictest0-21swapper/112:13:021
278399973,1cyclictest0-21swapper/112:02:241
278399973,1cyclictest0-21swapper/111:45:261
278399973,1cyclictest0-21swapper/111:25:361
278399973,1cyclictest0-21swapper/109:41:241
278399972,4cyclictest22439-21df10:55:181
278399972,4cyclictest14529-1kworker/u9:209:20:191
278399970,6cyclictest30354-21apt-get08:25:161
278399970,6cyclictest0-21swapper/108:45:191
278399970,3cyclictest30906-21rm10:20:161
278359974,2cyclictest508-21dbus-daemon07:27:410
278359973,3cyclictest3758-21snmpd07:11:090
278359973,3cyclictest29741-11brltty11:36:440
278359973,3cyclictest25948-21systemd-journal09:37:000
278359973,3cyclictest25948-21systemd-journal09:30:000
278359973,3cyclictest25948-21systemd-journal08:24:300
278359973,3cyclictest1-21systemd07:43:080
278359973,3cyclictest0-21swapper/012:18:350
278359973,3cyclictest0-21swapper/011:27:480
278359973,1cyclictest0-21swapper/012:25:190
278359973,1cyclictest0-21swapper/011:40:010
278359972,3cyclictest25948-21systemd-journal10:46:150
278359972,3cyclictest25948-21systemd-journal08:55:000
278359971,3cyclictest28086-21cron12:40:000
278359971,2cyclictest12-21ksoftirqd/008:04:550
278359970,4cyclictest25948-21systemd-journal12:33:030
2764270,0sleep00-21swapper/009:41:430
278479966,0cyclictest0-21swapper/311:35:263
278479964,1cyclictest5012-21df_inode08:40:203
278479963,2cyclictest6031-21cat07:30:243
278479963,2cyclictest508-21dbus-daemon10:46:163
278479963,2cyclictest3758-21snmpd08:06:383
278479963,2cyclictest3304-21ssh09:21:463
278479963,2cyclictest32022-21gdbus09:40:033
278479963,2cyclictest23880-21rm10:55:323
278479963,2cyclictest16456-21grep09:30:203
278479963,2cyclictest13491-21expr11:50:213
278479963,2cyclictest11736-21in:imuxsock12:15:023
278479963,2cyclictest1130-21df_inode07:20:203
278479962,3cyclictest9474-21diskstats08:50:243
278479962,3cyclictest8545-21tail09:25:213
278479962,3cyclictest508-21dbus-daemon09:09:533
278479962,3cyclictest508-21dbus-daemon09:09:533
278479962,3cyclictest3758-21snmpd12:22:153
278479962,3cyclictest3758-21snmpd12:00:033
278479962,3cyclictest3758-21snmpd10:43:103
278479962,3cyclictest3758-21snmpd10:08:493
278479962,3cyclictest3758-21snmpd09:35:223
278479962,3cyclictest3758-21snmpd08:55:363
278479962,3cyclictest3758-21snmpd08:30:203
278479962,3cyclictest3758-21snmpd08:17:453
278479962,3cyclictest3637-21cat07:25:213
278479962,3cyclictest31158-21expr07:15:203
278479962,3cyclictest31011-21sort10:20:173
278479962,3cyclictest21408-21cat12:35:253
278479962,3cyclictest1942-21sshd10:01:273
278479962,3cyclictest17693-21cat07:55:223
278479962,3cyclictest13856-21forks11:30:233
278479962,2cyclictest25948-21systemd-journal07:52:173
278479962,1cyclictest0-21swapper/310:26:543
278479962,1cyclictest0-21swapper/310:17:323
278479962,1cyclictest0-21swapper/310:11:223
278479962,1cyclictest0-21swapper/309:12:153
278479960,2cyclictest6127-21mailstats12:05:233
278479960,0cyclictest0-21swapper/312:30:173
278449966,0cyclictest0-21swapper/212:38:362
278449966,0cyclictest0-21swapper/211:47:492
278449963,2cyclictest508-21dbus-daemon10:30:242
278449963,2cyclictest3758-21snmpd08:26:172
278449963,2cyclictest32434-21ssh12:21:482
278449963,2cyclictest30337-21rm10:40:102
278449963,2cyclictest29807-21sh11:00:072
278449963,2cyclictest29807-21sh11:00:072
278449963,2cyclictest29741-11brltty09:20:182
278449963,2cyclictest29741-11brltty07:19:202
278449963,2cyclictest16403-21/usr/sbin/munin07:55:142
278449963,2cyclictest14529-1kworker/u9:212:15:132
278449962,3cyclictest7418-21apt-get07:35:142
278449962,3cyclictest6845-21expr10:25:172
278449962,3cyclictest3758-21snmpd12:11:002
278449962,3cyclictest3758-21snmpd11:51:352
278449962,3cyclictest3758-21snmpd10:22:092
278449962,3cyclictest3758-21snmpd10:10:122
278449962,3cyclictest3758-21snmpd07:44:192
278449962,3cyclictest3058-21cat08:35:342
278449962,3cyclictest29192-21grep08:20:262
278449962,3cyclictest26561-21ntpd11:10:262
278449962,3cyclictest25948-21systemd-journal09:31:342
278449962,3cyclictest25062-21cron08:15:012
278449962,3cyclictest14909-21date09:00:332
278449962,3cyclictest0-21swapper/209:46:562
278449962,2cyclictest25948-21systemd-journal09:09:042
278449962,2cyclictest25948-21systemd-journal09:09:032
278449962,1cyclictest0-21swapper/212:31:492
278449962,1cyclictest0-21swapper/211:25:322
278449962,1cyclictest0-21swapper/210:55:572
278449962,1cyclictest0-21swapper/209:41:272
278449962,1cyclictest0-21swapper/209:25:122
278449961,4cyclictest28069-21wc07:10:142
278449961,3cyclictest25948-21systemd-journal07:32:412
278449960,5cyclictest2418-21seq07:21:402
278449960,0cyclictest0-21swapper/211:57:482
278399966,0cyclictest0-21swapper/111:10:091
278399963,2cyclictest8681-21awk09:25:221
278399963,2cyclictest7894-21ssh11:05:521
278399963,2cyclictest23246-21rm11:35:331
278399963,2cyclictest13555-21sh11:50:201
278399963,2cyclictest1312-21sh10:00:561
278399963,2cyclictest0-21swapper/112:06:221
278399963,2cyclictest0-21swapper/110:07:031
278399963,0cyclictest141rcu_preempt08:00:171
278399962,3cyclictest7417-21apt-get09:45:181
278399962,3cyclictest5180-21grep08:40:211
278399962,3cyclictest508-21dbus-daemon08:16:291
278399962,3cyclictest3758-21snmpd09:01:421
278399962,3cyclictest3758-21snmpd08:36:541
278399962,3cyclictest3758-21snmpd08:31:391
278399962,3cyclictest3758-21snmpd08:20:111
278399962,3cyclictest3758-21snmpd07:50:191
278399962,3cyclictest3758-21snmpd07:37:221
278399962,3cyclictest3758-21snmpd07:15:461
278399962,3cyclictest3758-21snmpd07:14:481
278399962,3cyclictest3336-21expr07:25:171
278399962,3cyclictest25948-21systemd-journal11:15:541
278399962,3cyclictest23757-21expr09:55:171
278399962,3cyclictest22844-21cron08:10:001
278399962,3cyclictest20388-21sshd12:35:061
278399962,3cyclictest17644-21awk07:55:231
278399962,3cyclictest15472-21cat10:30:331
278399962,3cyclictest11054-21basename08:55:011
278399962,3cyclictest10975-21grep07:40:351
278399962,3cyclictest0-21swapper/110:46:201
278399962,3cyclictest0-21swapper/110:40:111
278399962,1cyclictest0-21swapper/111:56:081
278399962,1cyclictest0-21swapper/109:10:091
278399961,4cyclictest29418-21/usr/sbin/munin11:40:281
278399961,4cyclictest13022-21tr07:45:271
278399961,4cyclictest0-21swapper/112:15:071
278399961,4cyclictest0-21swapper/110:26:291
278399961,2cyclictest141rcu_preempt09:50:261
278399960,3cyclictest29768-21cat12:20:231
278399960,3cyclictest29026-21rm10:39:201
278399960,3cyclictest22655-21rm10:15:061
278359966,0cyclictest0-21swapper/010:00:050
278359963,3cyclictest31376-21processes11:00:300
278359963,3cyclictest31376-21processes11:00:300
278359963,2cyclictest9670-21ssh10:26:330
278359963,2cyclictest9037-21sshd07:35:590
278359963,2cyclictest6775-21taskset07:30:360
278359963,2cyclictest3979-21taskset08:35:510
278359963,2cyclictest3758-21snmpd10:05:390
278359963,2cyclictest30909-21wc12:00:350
278359963,2cyclictest15160-21seq10:30:280
278359963,2cyclictest14841-21sh10:10:120
278359963,1cyclictest0-21swapper/010:21:110
278359962,3cyclictest7532-21cat08:45:240
278359962,3cyclictest5522-21cat12:05:210
278359962,3cyclictest508-21dbus-daemon08:15:140
278359962,3cyclictest3758-21snmpd11:51:020
278359962,3cyclictest3758-21snmpd11:11:020
278359962,3cyclictest3758-21snmpd10:55:190
278359962,3cyclictest3758-21snmpd10:17:000
278359962,3cyclictest3758-21snmpd09:46:080
278359962,3cyclictest3758-21snmpd09:31:110
278359962,3cyclictest3758-21snmpd08:44:040
278359962,3cyclictest3758-21snmpd08:11:080
278359962,3cyclictest3758-21snmpd07:46:020
278359962,3cyclictest3758-21snmpd07:20:250
278359962,3cyclictest16645-21expr07:55:150
278359962,3cyclictest16250-21expr09:05:170
278359962,3cyclictest16250-21expr09:05:170
278359962,3cyclictest1-21systemd09:10:060
278359962,3cyclictest0-21swapper/011:45:120
278359962,1cyclictest0-21swapper/010:35:010
278359961,4cyclictest20951-21sh11:55:100
278359960,6cyclictest0-21swapper/011:15:310
278359960,4cyclictest25948-21systemd-journal09:03:120
278359960,4cyclictest25948-21systemd-journal07:19:200
278359960,3cyclictest14337-21cat12:10:250
17866260,0sleep10-21swapper/110:52:071
12231260,0sleep00-21swapper/008:55:210
278479952,2cyclictest28654-21sh07:10:153
278479952,2cyclictest28013-21cut08:20:193
278479951,3cyclictest508-21dbus-daemon07:40:123
278449952,2cyclictest6984-21tr08:45:212
278449952,2cyclictest11632-21expr08:55:162
278449950,4cyclictest2965-21apt-get07:25:162
278449950,3cyclictest25948-21systemd-journal08:30:152
278399952,2cyclictest23779-21cat08:10:211
278359952,2cyclictest24864-21ssh09:15:010
278359951,3cyclictest399-21cat08:30:200
278359951,3cyclictest3758-21snmpd08:25:080
278359950,3cyclictest25948-21systemd-journal07:50:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional