You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-02 - 17:20

x86 Intel Core i5-8265UE @1600 MHz, Linux 5.10.41-rt42 (Profile)

Latency plot of system in rack #a, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackaslot8.osadl.org (updated Fri Jun 02, 2023 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114602282249,22sleep10-21swapper/107:06:011
116182279245,22sleep20-21swapper/207:08:032
116952272239,20sleep30-21swapper/307:08:493
117722268241,17sleep00-21swapper/007:09:430
112892600,0sleep30-21swapper/310:05:443
201862590,0sleep20-21swapper/211:01:242
123362570,0sleep30-21swapper/311:18:513
287882560,0sleep10-21swapper/108:55:221
125472550,0sleep00-21swapper/010:07:250
323982190,0sleep00-21swapper/011:32:010
321682190,0sleep10-21swapper/110:47:371
27852190,0sleep00-21swapper/012:33:560
231002140,0sleep00-21swapper/012:26:230
173912140,0sleep30-21swapper/312:05:003
86092130,0sleep30-21swapper/309:15:183
17112130,0chrt0-21swapper/111:55:201
11915991312,1cyclictest34-21ksoftirqd/307:20:013
164982120,0sleep10-21swapper/110:36:211
1191599129,2cyclictest34-21ksoftirqd/310:40:023
1191599119,1cyclictest34-21ksoftirqd/309:40:003
1191599118,2cyclictest34-21ksoftirqd/310:30:013
11915991110,1cyclictest34-21ksoftirqd/310:25:013
11915991110,1cyclictest34-21ksoftirqd/310:25:013
1191599107,2cyclictest34-21ksoftirqd/312:20:003
1191599107,2cyclictest34-21ksoftirqd/312:20:003
1191599107,2cyclictest34-21ksoftirqd/311:55:013
1191599102,4cyclictest34-21ksoftirqd/310:33:263
119159998,1cyclictest34-21ksoftirqd/311:00:013
119159997,2cyclictest34-21ksoftirqd/311:25:003
119159997,1cyclictest34-21ksoftirqd/310:15:023
119159996,2cyclictest34-21ksoftirqd/311:05:013
119159995,1cyclictest34-21ksoftirqd/311:44:203
119159993,4cyclictest141rcu_preempt10:40:223
119159991,5cyclictest34-21ksoftirqd/309:05:203
119099994,3cyclictest25948-21systemd-journal11:15:011
119099992,4cyclictest13635-21cron11:20:011
119049993,4cyclictest25948-21systemd-journal08:05:210
5514280,0chrt0-21swapper/208:05:222
1357280,0sleep31359-21fschecks_time11:55:193
119159987,1cyclictest34-21ksoftirqd/312:35:013
119159987,1cyclictest34-21ksoftirqd/310:05:013
119159987,1cyclictest34-21ksoftirqd/309:00:003
119159987,1cyclictest34-21ksoftirqd/307:15:003
119159987,1cyclictest331rcuc/309:34:593
119159986,1cyclictest34-21ksoftirqd/309:45:013
119159986,1cyclictest34-21ksoftirqd/307:45:003
119159986,1cyclictest31410-21dump-pmu-power11:10:013
119159985,2cyclictest34-21ksoftirqd/308:35:013
119159983,3cyclictest25948-21systemd-journal11:47:313
119159983,3cyclictest25948-21systemd-journal08:07:273
119159982,4cyclictest25948-21systemd-journal09:27:563
119159982,3cyclictest34-21ksoftirqd/310:50:193
119159982,1cyclictest141rcu_preempt12:25:223
119159981,5cyclictest34-21ksoftirqd/307:30:223
119129983,3cyclictest25948-21systemd-journal10:54:442
119099984,2cyclictest25948-21systemd-journal10:27:371
119099983,3cyclictest25948-21systemd-journal09:35:281
119099983,3cyclictest25948-21systemd-journal08:22:521
119049984,3cyclictest9034-21packagekitd12:05:060
119049984,3cyclictest18326-21apt-get08:35:160
119049980,4cyclictest28701-21ssh09:55:190
7104270,0sleep20-21swapper/210:30:012
21639270,6sleep021653-21cat07:30:130
119159976,1cyclictest34-21ksoftirqd/311:35:003
119159976,1cyclictest34-21ksoftirqd/310:20:003
119159976,1cyclictest34-21ksoftirqd/309:50:013
119159976,1cyclictest34-21ksoftirqd/308:40:003
119159976,1cyclictest34-21ksoftirqd/308:15:013
119159975,2cyclictest34-21ksoftirqd/307:40:013
119159975,1cyclictest34-21ksoftirqd/308:45:003
119159974,2cyclictest34-21ksoftirqd/311:35:173
119159974,2cyclictest34-21ksoftirqd/309:55:013
119159974,2cyclictest34-21ksoftirqd/308:30:013
119159974,2cyclictest34-21ksoftirqd/308:30:013
119159973,3cyclictest508-21dbus-daemon08:54:093
119159973,3cyclictest25948-21systemd-journal08:20:013
119159973,3cyclictest23996-21ntpq08:45:203
119159973,3cyclictest17223-21apt-get07:20:193
119159973,3cyclictest0-21swapper/310:45:593
119159973,1cyclictest141rcu_preempt09:00:343
119159972,3cyclictest3758-21snmpd08:22:023
119159972,3cyclictest25948-21systemd-journal12:14:483
119159972,3cyclictest25948-21systemd-journal07:58:373
119159971,4cyclictest34-21ksoftirqd/311:28:573
119159971,4cyclictest20846-21ssh09:24:373
119159971,1cyclictest141rcu_preempt12:39:013
119159970,6cyclictest1522-21diskmemload12:23:503
119159970,5cyclictest34-21ksoftirqd/309:10:213
119129974,2cyclictest25948-21systemd-journal09:35:002
119129974,2cyclictest11736-21in:imuxsock11:47:172
119129973,3cyclictest9227-21cat09:15:192
119129973,3cyclictest508-21dbus-daemon09:50:012
119129973,3cyclictest28305-21df10:45:172
119129973,3cyclictest19116-21gdbus10:15:002
119129973,3cyclictest1-21systemd09:43:492
119129973,3cyclictest0-21swapper/212:30:122
119129973,3cyclictest0-21swapper/211:24:552
119129973,2cyclictest502-21systemd-logind12:15:142
119129973,2cyclictest502-21systemd-logind12:15:142
119129973,2cyclictest31981-21lldpd07:22:092
119129973,1cyclictest0-21swapper/209:53:432
119129972,3cyclictest25948-21systemd-journal12:21:552
119129972,3cyclictest25948-21systemd-journal11:58:332
119129972,3cyclictest25948-21systemd-journal11:14:442
119129972,3cyclictest25948-21systemd-journal10:59:082
119129972,3cyclictest25948-21systemd-journal07:54:252
119129971,4cyclictest502-21systemd-logind11:31:012
119129970,4cyclictest25937-21cron07:40:002
119099975,2cyclictest22-21ksoftirqd/108:15:001
119099974,2cyclictest3758-21snmpd11:29:591
119099974,2cyclictest17419-21/usr/sbin/munin11:00:261
119099974,2cyclictest12502-21sh12:39:441
119099974,2cyclictest11378-21grep10:05:431
119099973,3cyclictest508-21dbus-daemon07:20:011
119099973,3cyclictest3758-21snmpd07:52:251
119099973,3cyclictest27647-21ntpq12:10:231
119099973,3cyclictest26389-21systemd-udevd09:09:191
119099973,3cyclictest25948-21systemd-journal09:30:021
119099973,3cyclictest25929-21cat07:39:561
119099973,2cyclictest26389-21systemd-udevd11:05:201
119099973,1cyclictest0-21swapper/109:10:341
119099972,4cyclictest0-21swapper/112:25:191
119099972,3cyclictest25948-21systemd-journal11:55:001
119099972,3cyclictest25948-21systemd-journal10:17:311
119099970,4cyclictest15842-21munin-run08:30:001
119099970,4cyclictest15842-21munin-run08:30:001
119099970,1cyclictest14940-21sh12:21:421
119049976,1cyclictest31094-21ssh10:22:590
119049976,1cyclictest31094-21ssh10:22:590
119049975,2cyclictest12-21ksoftirqd/010:45:010
119049974,2cyclictest508-21dbus-daemon09:45:000
119049974,2cyclictest508-21dbus-daemon09:23:470
119049974,2cyclictest19988-21cron10:40:010
119049974,2cyclictest11736-21in:imuxsock10:46:220
119049974,2cyclictest11736-21in:imuxsock07:47:510
119049973,3cyclictest7957-21ntpq11:15:280
119049973,3cyclictest508-21dbus-daemon08:25:450
119049973,3cyclictest508-21dbus-daemon08:25:450
119049973,3cyclictest3758-21snmpd10:28:180
119049973,3cyclictest25948-21systemd-journal09:10:260
119049973,3cyclictest24258-21df07:35:160
119049973,3cyclictest21832-21sed08:40:230
119049973,3cyclictest19116-21gdbus11:15:010
119049973,3cyclictest0-21swapper/011:26:300
119049973,3cyclictest0-21swapper/010:31:070
119049973,2cyclictest31981-21lldpd09:48:130
119049972,3cyclictest25948-21systemd-journal10:12:110
119049971,4cyclictest25948-21systemd-journal09:17:570
119049971,3cyclictest2839-21rm12:15:190
119049971,3cyclictest2839-21rm12:15:190
119049971,3cyclictest19514-21rm11:00:460
119049970,4cyclictest26509-21dump-pmu-power10:20:010
119159963,2cyclictest490-21needreboot11:10:253
119159963,2cyclictest30184-21timerwakeupswit09:55:273
119159962,3cyclictest3404-21cat08:00:193
119159962,3cyclictest30902-21cat07:50:233
119159962,3cyclictest25948-21systemd-journal07:48:403
119159962,1cyclictest0-21swapper/312:05:103
119159961,4cyclictest34-21ksoftirqd/307:25:143
119129964,1cyclictest10095-21irqstats08:15:222
119129963,2cyclictest3922-21awk10:00:222
119129963,2cyclictest3813-21ssh11:35:162
119129963,2cyclictest22060-21unixbench_multi10:15:242
119129963,2cyclictest1749-21sh09:10:012
119129963,2cyclictest1522-21diskmemload11:50:112
119129963,2cyclictest1-21systemd07:55:212
119129963,2cyclictest11736-21in:imuxsock07:50:002
119129963,2cyclictest11736-21in:imuxsock07:18:392
119129963,2cyclictest11191-21timerandwakeup10:05:432
119129962,3cyclictest508-21dbus-daemon10:20:292
119129962,3cyclictest508-21dbus-daemon10:20:282
119129962,3cyclictest3758-21snmpd12:29:422
119129962,3cyclictest3758-21snmpd12:05:352
119129962,3cyclictest3758-21snmpd11:41:112
119129962,3cyclictest3758-21snmpd11:15:242
119129962,3cyclictest3758-21snmpd09:20:212
119129962,3cyclictest3758-21snmpd09:05:182
119129962,3cyclictest3758-21snmpd08:56:302
119129962,3cyclictest3758-21snmpd08:45:122
119129962,3cyclictest3758-21snmpd08:43:202
119129962,3cyclictest3758-21snmpd08:32:132
119129962,3cyclictest3758-21snmpd08:00:192
119129962,3cyclictest3758-21snmpd07:14:212
119129962,3cyclictest29741-11brltty07:28:402
119129962,3cyclictest29419-21cat09:55:222
119129962,3cyclictest2701-21expr09:35:202
119129962,3cyclictest22402-21grep11:25:202
119129962,3cyclictest10370-21cat12:00:242
119129962,3cyclictest0-21swapper/210:37:062
119129962,2cyclictest25948-21systemd-journal08:53:452
119129962,1cyclictest0-21swapper/212:36:352
119129962,1cyclictest0-21swapper/212:10:102
119129962,1cyclictest0-21swapper/210:44:232
119129961,3cyclictest25948-21systemd-journal10:30:022
119129961,3cyclictest25948-21systemd-journal08:25:472
119129961,3cyclictest25948-21systemd-journal08:25:472
119129961,3cyclictest25948-21systemd-journal07:43:322
119129961,2cyclictest24620-21ssh11:05:132
119129960,5cyclictest22679-21/usr/sbin/munin07:30:202
119099966,0cyclictest0-21swapper/109:15:211
119099963,2cyclictest502-21systemd-logind08:31:141
119099963,2cyclictest4683-21awk10:50:291
119099963,2cyclictest3758-21snmpd10:22:091
119099963,2cyclictest3758-21snmpd10:22:091
119099963,2cyclictest3758-21snmpd09:04:381
119099963,2cyclictest27236-21cron08:55:001
119099963,2cyclictest19008-21cat08:35:221
119099963,2cyclictest13474-21sh11:40:561
119099963,2cyclictest11645-21awk10:55:291
119099962,3cyclictest9506-21cat09:40:241
119099962,3cyclictest508-21dbus-daemon10:30:321
119099962,3cyclictest3956-21sed12:15:251
119099962,3cyclictest3956-21sed12:15:251
119099962,3cyclictest3758-21snmpd10:40:461
119099962,3cyclictest3758-21snmpd10:10:031
119099962,3cyclictest3758-21snmpd08:09:411
119099962,3cyclictest3758-21snmpd08:04:111
119099962,3cyclictest3758-21snmpd07:55:011
119099962,3cyclictest3758-21snmpd07:31:241
119099962,3cyclictest3758-21snmpd07:25:111
119099962,3cyclictest3178-21expr10:00:171
119099962,3cyclictest29041-21expr11:30:181
119099962,3cyclictest22294-21fw_packets09:25:231
119099962,3cyclictest15581-21expr09:45:141
119099962,3cyclictest0-21swapper/112:30:021
119099962,3cyclictest0-21swapper/109:23:351
119099962,1cyclictest0-21swapper/112:05:061
119099962,1cyclictest0-21swapper/111:46:551
119099962,1cyclictest0-21swapper/109:56:351
119099961,3cyclictest25948-21systemd-journal08:45:241
119099961,3cyclictest25948-21systemd-journal07:21:591
119099961,2cyclictest25027-21ssh09:51:441
119099961,2cyclictest11432-21ssh12:00:361
119099960,5cyclictest11359-21idleruntime-cro08:20:001
119099960,2cyclictest20813-21/usr/sbin/munin08:40:211
119099960,0cyclictest0-21swapper/111:20:291
119049964,2cyclictest0-21swapper/008:59:590
119049963,2cyclictest508-21dbus-daemon08:12:520
119049963,2cyclictest32740-21sed09:05:170
119049963,2cyclictest22654-21sh09:25:260
119049963,2cyclictest18178-21gpgconf11:45:000
119049963,2cyclictest17832-21sshd08:32:310
119049963,2cyclictest16524-21sh10:59:410
119049963,2cyclictest11736-21in:imuxsock07:17:230
119049962,3cyclictest839-21apt-get11:55:170
119049962,3cyclictest3758-21snmpd12:10:180
119049962,3cyclictest3758-21snmpd12:01:420
119049962,3cyclictest3758-21snmpd11:40:100
119049962,3cyclictest3758-21snmpd11:36:100
119049962,3cyclictest3758-21snmpd11:05:250
119049962,3cyclictest3758-21snmpd09:01:020
119049962,3cyclictest3758-21snmpd08:21:470
119049962,3cyclictest3758-21snmpd08:16:130
119049962,3cyclictest3758-21snmpd08:03:190
119049962,3cyclictest3758-21snmpd07:40:310
119049962,3cyclictest3646-21cat10:00:210
119049962,3cyclictest26261-21cat11:50:220
119049962,3cyclictest25948-21systemd-journal09:35:020
119049962,3cyclictest17642-21cut07:20:200
119049962,3cyclictest1-21systemd08:49:350
119049962,3cyclictest0-21swapper/012:35:130
119049962,3cyclictest0-21swapper/012:20:030
119049962,3cyclictest0-21swapper/010:50:130
119049962,1cyclictest0-21swapper/009:50:070
119049961,3cyclictest25948-21systemd-journal07:27:240
119049960,4cyclictest25948-21systemd-journal11:20:110
119049960,4cyclictest25948-21systemd-journal07:53:360
119129952,2cyclictest7787-21smartctl08:10:222
119129952,2cyclictest3758-21snmpd09:25:062
119129952,2cyclictest30177-21fschecks_count09:00:232
119129951,3cyclictest19007-21cat08:35:212
119129951,3cyclictest12261-21hddtemp_smartct08:20:222
119099952,2cyclictest508-21dbus-daemon07:10:191
119099952,2cyclictest30120-21sshd07:46:311
119099952,2cyclictest26584-21cat07:40:171
119099950,2cyclictest3565-21ssh11:35:021
119049952,2cyclictest25965-21cat08:50:220
119049952,2cyclictest12331-21cstates07:10:190
119049952,1cyclictest0-21swapper/009:30:110
119049951,3cyclictest1161-21cat07:55:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional