You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-04 - 23:49

x86 Intel Core i5-8265UE @1600 MHz, Linux 5.10.41-rt42 (Profile)

Latency plot of system in rack #a, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Sat Feb 04, 2023 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
200532291259,20sleep20-21swapper/207:07:562
201042281254,17sleep10-21swapper/107:08:351
201542258227,21sleep00-21swapper/007:09:140
200742247213,22sleep30-21swapper/307:08:143
217022750,0sleep10-21swapper/110:40:021
216202660,0sleep30-21swapper/309:16:263
116682590,0sleep10-21swapper/112:16:191
244932570,0sleep00-21swapper/012:04:330
16682200,0sleep2271rcuc/209:25:052
128182190,0sleep30-21swapper/312:37:553
5582160,0sleep20-21swapper/211:07:212
98332150,0sleep20-21swapper/211:55:102
264072150,1sleep10-21swapper/112:25:321
25162150,1sleep10-21swapper/109:45:321
257982140,0sleep20-21swapper/212:25:212
43282130,0sleep00-21swapper/010:49:410
82132120,0sleep20-21swapper/209:50:012
81032110,0sleep30-21swapper/311:12:063
2033199105,4cyclictest34-21ksoftirqd/308:10:003
2031799103,5cyclictest17013-21kworker/0:109:14:490
534290,0sleep10-21swapper/111:07:211
203179996,2cyclictest20368-21perf11:00:000
4501280,0sleep10-21swapper/112:11:521
203319986,1cyclictest0-21swapper/307:13:303
203319984,3cyclictest283-21systemd-journal10:29:153
203279986,1cyclictest11495-21diskstats11:35:152
203279984,3cyclictest283-21systemd-journal08:59:092
203279984,2cyclictest283-21systemd-journal12:10:162
203229984,3cyclictest508-21dbus-daemon12:30:121
203229981,5cyclictest283-21systemd-journal09:38:201
203179987,1cyclictest12-21ksoftirqd/007:35:000
203179983,3cyclictest283-21systemd-journal12:05:300
203179980,7cyclictest3729-21ssh12:11:120
13247280,0sleep10-21swapper/110:34:421
11551280,0sleep30-21swapper/308:00:143
25923270,0sleep20-21swapper/211:44:492
203319974,2cyclictest508-21dbus-daemon12:26:533
203319974,2cyclictest283-21systemd-journal12:15:163
203319974,2cyclictest24099-21ssh11:43:193
203319973,3cyclictest508-21dbus-daemon08:42:523
203319973,3cyclictest283-21systemd-journal08:17:293
203319973,2cyclictest283-21systemd-journal10:55:063
203319973,2cyclictest283-21systemd-journal10:25:013
203319973,2cyclictest283-21systemd-journal07:55:013
203279974,2cyclictest508-21dbus-daemon10:54:412
203279974,2cyclictest508-21dbus-daemon10:16:442
203279974,2cyclictest508-21dbus-daemon10:16:442
203279973,3cyclictest6051-21packagekitd10:30:012
203279973,3cyclictest308-21systemd-udevd12:09:192
203279973,3cyclictest308-21systemd-udevd10:59:192
203279973,3cyclictest1167-21snmpd12:01:512
203279973,3cyclictest1167-21snmpd07:53:162
203279973,2cyclictest283-21systemd-journal08:47:312
203279973,1cyclictest0-21swapper/212:36:532
203279971,4cyclictest10311-21ls11:35:012
203279970,6cyclictest283-21systemd-journal08:02:492
203229975,2cyclictest22-21ksoftirqd/108:25:001
203229974,2cyclictest508-21dbus-daemon12:03:311
203229974,2cyclictest508-21dbus-daemon11:00:001
203229974,2cyclictest508-21dbus-daemon10:09:131
203229974,2cyclictest508-21dbus-daemon08:03:151
203229974,2cyclictest283-21systemd-journal09:09:551
203229974,2cyclictest11961-21sshd10:54:301
203229974,2cyclictest10912-21cron08:00:001
203179977,0cyclictest121ksoftirqd/007:15:010
203179976,1cyclictest12-21ksoftirqd/011:30:000
203179973,3cyclictest6575-21seq09:27:510
203179973,3cyclictest283-21systemd-journal12:31:270
203179973,3cyclictest283-21systemd-journal11:45:350
203179973,3cyclictest283-21systemd-journal11:45:000
203179973,3cyclictest19116-21gdbus08:20:000
203179973,3cyclictest12581-21sshd12:37:450
203179973,3cyclictest1167-21snmpd08:27:410
203179973,2cyclictest283-21systemd-journal07:20:000
203179972,3cyclictest283-21systemd-journal07:30:000
203179970,4cyclictest22376-21munin-run08:25:010
26299260,0sleep10-21swapper/110:00:411
203319966,0cyclictest0-21swapper/307:16:313
203319964,1cyclictest32166-21cpuspeed_turbos10:05:143
203319964,1cyclictest20785-21df08:20:153
203319963,2cyclictest6326-21ssh11:31:433
203319963,2cyclictest508-21dbus-daemon10:16:193
203319963,2cyclictest508-21dbus-daemon10:16:193
203319963,2cyclictest508-21dbus-daemon09:52:073
203319963,2cyclictest283-21systemd-journal11:26:233
203319963,2cyclictest283-21systemd-journal10:46:223
203319963,2cyclictest24330-21ssh10:40:413
203319963,2cyclictest19403-21head12:00:213
203319963,2cyclictest18193-21ssh10:37:173
203319963,2cyclictest11736-21in:imuxsock08:49:473
203319963,1cyclictest0-21swapper/309:57:303
203319962,3cyclictest8161-21cat09:05:123
203319962,3cyclictest4112-21gltestperf08:55:143
203319962,3cyclictest3511-21sed08:55:003
203319962,3cyclictest328-21tune2fs07:35:163
203319962,3cyclictest25251-21sh09:40:023
203319962,3cyclictest20460-21head11:20:143
203319962,3cyclictest1167-21snmpd12:21:133
203319962,3cyclictest1167-21snmpd11:38:183
203319962,3cyclictest1167-21snmpd11:00:313
203319962,3cyclictest1167-21snmpd10:52:563
203319962,3cyclictest1167-21snmpd10:31:013
203319962,3cyclictest1167-21snmpd09:25:383
203319962,3cyclictest1167-21snmpd09:20:173
203319962,3cyclictest1167-21snmpd08:33:153
203319962,3cyclictest1167-21snmpd08:11:203
203319962,3cyclictest1167-21snmpd07:45:353
203319962,3cyclictest1167-21snmpd07:25:123
203319962,3cyclictest1167-21snmpd07:20:543
203319961,3cyclictest283-21systemd-journal12:31:033
203319961,3cyclictest283-21systemd-journal12:05:353
203319961,3cyclictest283-21systemd-journal10:02:343
203319961,3cyclictest283-21systemd-journal09:01:133
203319960,5cyclictest1918-21sshd12:10:173
203319960,3cyclictest3901-21sed11:10:003
203319960,3cyclictest29741-11brltty10:11:443
203319960,0cyclictest0-21swapper/311:56:473
203319960,0cyclictest0-21swapper/309:35:483
203279966,0cyclictest0-21swapper/209:56:022
203279965,1cyclictest10064-21diskmemload12:30:492
203279964,2cyclictest11736-21in:imuxsock07:31:332
203279964,1cyclictest27273-21unixbench_multi09:40:292
203279963,2cyclictest308-21systemd-udevd12:17:202
203279963,2cyclictest308-21systemd-udevd11:15:192
203279963,2cyclictest283-21systemd-journal10:45:052
203279963,2cyclictest283-21systemd-journal09:37:052
203279963,2cyclictest23386-21cat08:25:242
203279963,2cyclictest23010-21ssh09:17:352
203279963,2cyclictest22739-21perl10:40:152
203279963,2cyclictest11736-21in:imuxsock11:25:092
203279962,3cyclictest9817-21cut09:50:202
203279962,3cyclictest308-21systemd-udevd11:21:202
203279962,3cyclictest29612-21expr08:40:142
203279962,3cyclictest283-21systemd-journal11:51:002
203279962,3cyclictest27083-21sshd11:45:132
203279962,3cyclictest18637-21cat08:15:212
203279962,3cyclictest14990-21cat10:35:212
203279962,3cyclictest1-21systemd09:00:242
203279962,3cyclictest1-21systemd07:15:212
203279962,3cyclictest1167-21snmpd12:20:242
203279962,3cyclictest1167-21snmpd10:28:432
203279962,3cyclictest1167-21snmpd10:22:572
203279962,3cyclictest1167-21snmpd10:11:422
203279962,3cyclictest1167-21snmpd10:02:282
203279962,3cyclictest1167-21snmpd08:06:532
203279962,3cyclictest1167-21snmpd07:26:222
203279962,3cyclictest0-21swapper/211:02:282
203279962,1cyclictest0-21swapper/211:14:112
203279961,3cyclictest283-21systemd-journal10:05:032
203279961,3cyclictest283-21systemd-journal09:22:542
203279961,3cyclictest283-21systemd-journal08:52:222
203229964,2cyclictest11736-21in:imuxsock12:07:421
203229964,2cyclictest11736-21in:imuxsock10:13:241
203229963,2cyclictest508-21dbus-daemon08:06:351
203229963,2cyclictest30991-21ssh11:47:321
203229963,2cyclictest29418-21cron10:45:001
203229963,2cyclictest283-21systemd-journal11:10:081
203229963,2cyclictest283-21systemd-journal09:05:001
203229963,2cyclictest283-21systemd-journal08:40:301
203229963,2cyclictest26330-21cat07:20:231
203229963,2cyclictest24403-21sed07:15:211
203229963,2cyclictest19492-21basename11:40:151
203229963,2cyclictest1167-21snmpd12:37:491
203229962,3cyclictest9711-21awk09:30:131
203229962,3cyclictest7590-21lldpd08:10:351
203229962,3cyclictest508-21dbus-daemon09:40:011
203229962,3cyclictest3959-21seq07:41:531
203229962,3cyclictest283-21systemd-journal11:55:001
203229962,3cyclictest27069-21/usr/sbin/munin08:35:121
203229962,3cyclictest2616-21cat08:50:211
203229962,3cyclictest2203-21ssh11:29:471
203229962,3cyclictest12421-21sensors11:35:211
203229962,3cyclictest1167-21snmpd11:55:061
203229962,3cyclictest1167-21snmpd11:17:151
203229962,3cyclictest1167-21snmpd10:20:091
203229962,3cyclictest1167-21snmpd09:29:461
203229962,3cyclictest1167-21snmpd08:57:491
203229962,3cyclictest1167-21snmpd08:18:231
203229962,3cyclictest1167-21snmpd07:35:221
203229962,3cyclictest1167-21snmpd07:30:011
203229962,3cyclictest1167-21snmpd07:29:191
203229962,3cyclictest1167-21snmpd07:13:391
203229962,1cyclictest0-21swapper/111:31:061
203229962,1cyclictest0-21swapper/111:20:151
203229962,1cyclictest0-21swapper/109:20:471
203229962,1cyclictest0-21swapper/109:11:271
203229961,3cyclictest283-21systemd-journal10:25:051
203229961,3cyclictest283-21systemd-journal10:16:191
203229961,3cyclictest283-21systemd-journal10:16:191
203229960,5cyclictest508-21dbus-daemon09:56:441
203229960,4cyclictest283-21systemd-journal10:46:461
203229960,3cyclictest20848-21kagekitd11:00:001
203179965,1cyclictest12-21ksoftirqd/009:15:000
203179964,2cyclictest508-21dbus-daemon11:01:480
203179963,2cyclictest668-21runrttasks08:02:000
203179963,2cyclictest4468-21seq11:10:130
203179963,2cyclictest29167-21ssh10:44:480
203179963,2cyclictest27451-21ssh10:01:400
203179963,2cyclictest11736-21in:imuxsock10:35:550
203179963,2cyclictest1167-21snmpd08:50:000
203179963,2cyclictest1167-21snmpd08:45:400
203179963,2cyclictest11139-21ssh12:15:530
203179963,2cyclictest10656-21grep11:55:230
203179963,2cyclictest10040-21cat09:30:150
203179962,3cyclictest9211-21cat07:55:150
203179962,3cyclictest4409-21cat11:30:200
203179962,3cyclictest3479-21swap07:40:210
203179962,3cyclictest24030-21uname10:20:200
203179962,3cyclictest1167-21snmpd12:27:160
203179962,3cyclictest1167-21snmpd10:52:310
203179962,3cyclictest1167-21snmpd10:31:190
203179962,3cyclictest1167-21snmpd10:25:130
203179962,3cyclictest1167-21snmpd09:55:180
203179962,3cyclictest1167-21snmpd09:40:240
203179962,3cyclictest1167-21snmpd09:35:080
203179962,3cyclictest1167-21snmpd08:55:450
203179962,3cyclictest1167-21snmpd08:32:530
203179962,3cyclictest1167-21snmpd07:39:100
203179962,3cyclictest10519-21sshd09:50:310
203179962,1cyclictest0-21swapper/012:22:330
203179961,3cyclictest283-21systemd-journal08:09:290
203179961,2cyclictest16672-21kworker/u8:211:20:170
203179960,6cyclictest0-21swapper/011:15:310
203179960,6cyclictest0-21swapper/010:18:530
203179960,6cyclictest0-21swapper/010:18:530
203179960,6cyclictest0-21swapper/010:10:480
203179960,6cyclictest0-21swapper/009:48:560
203319952,2cyclictest27204-21wc08:35:133
203319952,2cyclictest23352-21uname08:25:253
203319952,2cyclictest2274-21dpkg07:40:143
203319952,2cyclictest10345-21ssh09:10:043
203319952,2cyclictest10142-21sort09:30:153
203319952,1cyclictest0-21swapper/311:50:153
203319951,3cyclictest7250-21head07:50:153
203319951,3cyclictest30122-21apt-get07:30:133
203319951,2cyclictest283-21systemd-journal11:15:083
203319950,4cyclictest26543-21sshd11:45:083
203319950,4cyclictest1054-21ssh09:45:233
203279952,2cyclictest975-21proc_pri07:35:202
203279952,2cyclictest9455-21cat09:05:212
203279952,2cyclictest27323-21cat08:35:132
203279952,2cyclictest26334-21if_err_enp4s007:20:222
203279952,2cyclictest21253-21cat08:20:192
203279952,2cyclictest16611-21ntpq08:10:192
203279952,2cyclictest11894-21ssh09:10:202
203279952,2cyclictest1167-21snmpd07:55:072
203279952,1cyclictest0-21swapper/209:30:252
203279951,3cyclictest2476-21/usr/sbin/munin07:40:152
203279951,3cyclictest20962-21uniq07:10:142
203279951,2cyclictest283-21systemd-journal07:45:182
203229952,2cyclictest8401-21rm09:50:051
203229952,2cyclictest4545-21grep07:45:121
203229952,2cyclictest32072-21cut08:45:151
203229952,2cyclictest25536-21cat08:30:161
203229952,2cyclictest18337-21gdbus09:15:001
203229952,2cyclictest16399-21ssh12:20:031
203229952,2cyclictest1167-21snmpd08:25:081
203229952,2cyclictest1167-21snmpd07:50:581
203179953,2cyclictest12-21ksoftirqd/007:50:130
203179952,3cyclictest15656-21apt-get08:10:120
203179952,2cyclictest8184-21grep09:05:120
203179952,2cyclictest6373-21expr09:00:140
203179952,2cyclictest2774-21cat11:50:160
203179952,2cyclictest27149-21ssh09:20:160
203179952,2cyclictest1-21systemd11:35:090
203179952,2cyclictest1167-21snmpd08:35:090
203179951,3cyclictest5172-21cat07:45:160
203179951,3cyclictest283-21systemd-journal08:40:020
203179951,3cyclictest1167-21snmpd10:05:120
203179951,3cyclictest1167-21snmpd07:19:450
203179951,3cyclictest0-21swapper/011:05:120
203279940,3cyclictest24822-21seq08:30:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional