You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-28 - 23:51

x86 Intel Core i5-8265UE @1600 MHz, Linux 5.10.41-rt42 (Profile)

Latency plot of system in rack #a, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackaslot8.osadl.org (updated Tue Mar 28, 2023 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
298862318288,19sleep20-21swapper/207:08:552
297082278247,20sleep10-21swapper/107:06:401
299852273242,20sleep00-21swapper/007:09:570
298232265233,21sleep30-21swapper/307:08:073
257772620,0sleep30-21swapper/311:15:013
141922610,0sleep00-21swapper/011:27:230
308202600,0sleep10-21swapper/111:58:071
91432590,0sleep30-21swapper/310:03:413
80702570,0sleep30-21swapper/310:43:333
222862570,0sleep20-21swapper/209:50:592
305722560,1sleep130574-21fschecks_count08:20:241
26402560,0sleep20-21swapper/212:00:202
169712540,0sleep10-21swapper/111:49:541
199372190,0sleep00-21swapper/012:11:110
187592190,0sleep00-21swapper/009:49:370
29642180,0sleep10-21swapper/112:20:291
57552150,0sleep00-21swapper/010:21:120
104062150,0sleep10-21swapper/109:44:211
286782140,0sleep20-21swapper/209:15:102
187002140,0sleep10-21swapper/109:29:141
179612140,0sleep20-21swapper/211:10:032
96702130,0sleep20-21swapper/210:24:222
310452130,0sleep10-21swapper/107:10:171
289392130,0sleep20-21swapper/208:15:202
288292110,0sleep20-21swapper/210:15:212
3010699106,3cyclictest24338-21ssh12:34:490
220632100,0sleep10-21swapper/110:31:351
301209995,3cyclictest283-21systemd-journal11:23:573
301119993,3cyclictest20709-1kworker/u9:210:45:011
8548280,0sleep10-21swapper/108:40:231
301209986,1cyclictest0-21swapper/309:58:543
301209983,3cyclictest283-21systemd-journal09:46:453
301159985,2cyclictest508-21dbus-daemon10:54:212
301119984,3cyclictest3758-21snmpd10:24:281
301119983,3cyclictest283-21systemd-journal08:31:141
301119983,3cyclictest283-21systemd-journal07:52:261
301119980,7cyclictest16080-21apt-get09:00:131
301069985,2cyclictest12-21ksoftirqd/007:40:010
301069984,3cyclictest283-21systemd-journal08:50:000
21686280,0sleep10-21swapper/109:50:301
21409280,0sleep20-21swapper/208:00:152
31308270,0sleep00-21swapper/011:18:030
30930270,2sleep031044-21/usr/sbin/munin07:10:170
301209975,1cyclictest11736-21in:imuxsock09:37:333
301209973,3cyclictest508-21dbus-daemon08:36:393
301209973,3cyclictest508-21dbus-daemon08:00:023
301209973,3cyclictest508-21dbus-daemon07:20:193
301209973,3cyclictest3758-21snmpd10:56:443
301209973,3cyclictest3758-21snmpd10:34:553
301209973,3cyclictest29741-11brltty11:19:213
301209973,3cyclictest18535-21sensors12:30:243
301209973,3cyclictest0-21swapper/311:33:383
301209973,1cyclictest0-21swapper/310:27:573
301209970,7cyclictest0-21swapper/311:53:233
301209970,6cyclictest27066-21grep10:35:143
301159973,3cyclictest283-21systemd-journal09:37:082
301159973,3cyclictest27340-21smart_sda11:35:222
301159973,3cyclictest27340-21smart_sda11:35:212
301159973,2cyclictest283-21systemd-journal11:55:012
301159973,1cyclictest0-21swapper/211:04:232
301159973,1cyclictest0-21swapper/210:07:272
301159972,3cyclictest283-21systemd-journal10:30:582
301159972,3cyclictest283-21systemd-journal07:22:242
301159972,3cyclictest13581-21awk08:55:002
301119974,2cyclictest8984-21sshd11:24:391
301119974,2cyclictest508-21dbus-daemon08:09:571
301119973,3cyclictest3758-21snmpd07:44:091
301119973,3cyclictest283-21systemd-journal10:16:471
301119973,3cyclictest283-21systemd-journal09:05:511
301119973,3cyclictest28039-21sed10:35:231
301119973,2cyclictest7590-21lldpd11:01:191
301119972,3cyclictest283-21systemd-journal12:37:401
301119970,7cyclictest30270-21ssh10:56:541
301119970,6cyclictest2466-21cat11:40:191
301119970,4cyclictest32679-21latency_hist12:20:001
301069974,2cyclictest508-21dbus-daemon08:52:300
301069974,2cyclictest283-21systemd-journal08:23:410
301069974,2cyclictest283-21systemd-journal08:00:470
301069973,3cyclictest3758-21snmpd11:45:540
301069973,3cyclictest3758-21snmpd11:36:590
301069973,3cyclictest3758-21snmpd11:36:590
301069973,3cyclictest3758-21snmpd07:52:320
301069973,3cyclictest283-21systemd-journal09:28:480
301069973,3cyclictest19116-21gdbus10:45:010
301069973,1cyclictest8599-21munin-run12:25:010
301069973,1cyclictest0-21swapper/012:36:480
301069972,4cyclictest2872-21date07:20:010
301069972,3cyclictest283-21systemd-journal11:50:050
301069970,5cyclictest17691-21turbostat11:10:000
30096270,0sleep20-21swapper/212:17:542
25364270,1sleep025385-21ssh10:34:140
301209966,0cyclictest0-21swapper/309:42:243
301209966,0cyclictest0-21swapper/309:15:413
301209964,2cyclictest11736-21in:imuxsock08:10:473
301209964,1cyclictest3628-21grep10:20:213
301209963,2cyclictest8067-21sh11:44:113
301209963,2cyclictest6972-21ssh09:21:063
301209963,2cyclictest3758-21snmpd10:06:113
301209963,2cyclictest32703-21apt-get12:20:003
301209963,2cyclictest3187-21sh12:00:323
301209963,2cyclictest28360-21fw_packets08:15:163
301209963,2cyclictest28341-21ssh12:36:353
301209963,2cyclictest283-21systemd-journal11:55:083
301209963,2cyclictest2810-21users12:20:233
301209963,2cyclictest14456-21hddtemp_smartct08:55:243
301209962,3cyclictest508-21dbus-daemon12:11:053
301209962,3cyclictest3758-21snmpd11:46:243
301209962,3cyclictest3758-21snmpd11:05:053
301209962,3cyclictest3758-21snmpd11:04:363
301209962,3cyclictest3758-21snmpd09:50:513
301209962,3cyclictest3758-21snmpd09:11:553
301209962,3cyclictest3758-21snmpd08:30:333
301209962,3cyclictest3758-21snmpd08:27:483
301209962,3cyclictest3758-21snmpd08:23:183
301209962,3cyclictest3758-21snmpd07:49:593
301209962,3cyclictest3758-21snmpd07:49:593
301209962,3cyclictest28398-21sed10:15:193
301209962,3cyclictest16950-21expr07:50:143
301209962,3cyclictest10868-21cat11:25:173
301209962,3cyclictest10394-21sed08:45:203
301209962,1cyclictest51850irq/136-enp4s0-12:08:283
301209962,1cyclictest0-21swapper/310:50:233
301209961,4cyclictest1093-21expr07:15:133
301209961,3cyclictest283-21systemd-journal07:14:553
301209960,6cyclictest0-21swapper/309:29:173
301209960,5cyclictest9645-21sshd12:25:153
301209960,5cyclictest28068-21sshd11:35:393
301209960,5cyclictest28068-21sshd11:35:393
301209960,2cyclictest20827-21cat10:10:233
301159966,0cyclictest0-21swapper/212:06:262
301159964,1cyclictest11738-21rs:main2
301159963,2cyclictest668-21runrttasks08:10:182
301159963,2cyclictest5933-21ssh10:41:452
301159963,2cyclictest3960-21hddtemp_smartct10:00:152
301159963,2cyclictest3758-21snmpd12:35:402
301159963,2cyclictest3758-21snmpd09:13:462
301159963,2cyclictest29780-21ssh10:36:182
301159963,2cyclictest283-21systemd-journal10:59:452
301159963,2cyclictest283-21systemd-journal07:57:272
301159963,2cyclictest22204-21ssh09:30:372
301159963,2cyclictest21104-21sh10:10:292
301159963,2cyclictest11736-21in:imuxsock08:29:092
301159963,2cyclictest11696-21rm11:45:392
301159963,2cyclictest10314-21sshd08:45:192
301159963,1cyclictest0-21swapper/211:43:252
301159962,3cyclictest8118-21cat07:30:162
301159962,3cyclictest508-21dbus-daemon07:15:012
301159962,3cyclictest3758-21snmpd11:21:532
301159962,3cyclictest3758-21snmpd10:45:052
301159962,3cyclictest3758-21snmpd09:48:252
301159962,3cyclictest3758-21snmpd09:26:022
301159962,3cyclictest3758-21snmpd09:23:102
301159962,3cyclictest3758-21snmpd08:39:422
301159962,3cyclictest3758-21snmpd08:30:032
301159962,3cyclictest3758-21snmpd07:38:082
301159962,3cyclictest3758-21snmpd07:27:262
301159962,3cyclictest283-21systemd-journal09:10:002
301159962,3cyclictest27972-21cat09:55:202
301159962,3cyclictest24166-21cat08:05:172
301159962,1cyclictest141rcu_preempt11:25:122
301159962,1cyclictest0-21swapper/212:31:352
301159962,1cyclictest0-21swapper/211:32:452
301159960,6cyclictest0-21swapper/211:50:552
301159960,5cyclictest12402-21sshd07:40:142
301159960,0cyclictest0-21swapper/211:05:272
301119966,0cyclictest0-21swapper/110:26:001
301119966,0cyclictest0-21swapper/109:15:221
301119963,2cyclictest9207-21sh10:44:291
301119963,2cyclictest7590-21lldpd11:26:131
301119963,2cyclictest3758-21snmpd07:45:111
301119963,2cyclictest3758-21snmpd07:45:111
301119963,2cyclictest26687-21cat11:35:161
301119963,2cyclictest26687-21cat11:35:161
301119963,2cyclictest22557-21ssh12:13:181
301119963,2cyclictest20873-21sshd10:50:471
301119963,2cyclictest20057-21awk11:10:291
301119963,2cyclictest19611-21ssh11:50:331
301119963,2cyclictest19221-21expr07:55:231
301119963,2cyclictest17513-21expr12:30:161
301119963,2cyclictest14434-21tail08:55:231
301119963,2cyclictest11736-21in:imuxsock09:10:281
301119963,2cyclictest11736-21in:imuxsock08:36:151
301119963,2cyclictest11119-21cut11:05:221
301119962,3cyclictest7590-21lldpd07:18:321
301119962,3cyclictest668-21runrttasks12:05:321
301119962,3cyclictest508-21dbus-daemon09:58:261
301119962,3cyclictest3758-21snmpd12:26:341
301119962,3cyclictest3758-21snmpd11:31:361
301119962,3cyclictest3758-21snmpd09:45:451
301119962,3cyclictest3758-21snmpd09:36:111
301119962,3cyclictest3758-21snmpd09:21:011
301119962,3cyclictest3758-21snmpd08:25:451
301119962,3cyclictest3758-21snmpd08:18:271
301119962,3cyclictest10729-21idleruntime-cro10:05:011
301119962,3cyclictest10056-21diskstats07:35:181
301119962,1cyclictest0-21swapper/111:17:001
301119962,1cyclictest0-21swapper/110:10:381
301119961,3cyclictest283-21systemd-journal09:30:041
301119961,3cyclictest283-21systemd-journal08:50:001
301119960,6cyclictest0-21swapper/112:00:181
301119960,5cyclictest26364-21cat08:10:171
301119960,5cyclictest13377-21sshd10:05:431
301069966,0cyclictest0-21swapper/011:01:070
301069963,2cyclictest5596-21sh12:02:280
301069963,2cyclictest508-21dbus-daemon08:35:200
301069963,2cyclictest3758-21snmpd10:18:490
301069963,2cyclictest3758-21snmpd09:16:380
301069963,2cyclictest31408-21ssh09:36:350
301069963,2cyclictest26907-21cat08:10:210
301069963,2cyclictest23781-21df08:05:140
301069963,2cyclictest20211-21ssh11:10:360
301069963,2cyclictest17892-21sh11:30:100
301069962,3cyclictest7333-21ls08:40:140
301069962,3cyclictest4558-21cat09:40:200
301069962,3cyclictest3758-21snmpd12:17:020
301069962,3cyclictest3758-21snmpd11:41:270
301069962,3cyclictest3758-21snmpd10:50:100
301069962,3cyclictest3758-21snmpd10:41:430
301069962,3cyclictest3758-21snmpd10:35:010
301069962,3cyclictest3758-21snmpd09:07:070
301069962,3cyclictest3758-21snmpd09:00:580
301069962,3cyclictest3758-21snmpd08:57:160
301069962,3cyclictest3758-21snmpd07:55:030
301069962,3cyclictest3758-21snmpd07:42:110
301069962,3cyclictest3415-21cut07:20:200
301069962,3cyclictest283-21systemd-journal07:32:250
301069962,3cyclictest26718-21apt-get10:55:200
301069962,3cyclictest25786-21cat11:55:180
301069962,3cyclictest2476-21cat08:30:140
301069962,3cyclictest21026-21cat09:30:230
301069962,3cyclictest1-21systemd09:11:420
301069962,3cyclictest0-21swapper/012:25:020
301069962,1cyclictest0-21swapper/010:11:020
301069961,3cyclictest283-21systemd-journal12:05:390
301069960,6cyclictest0-21swapper/010:07:360
301069960,6cyclictest0-21swapper/010:02:180
301069960,6cyclictest0-21swapper/009:52:270
301069960,0cyclictest0-21swapper/010:27:410
301069960,0cyclictest0-21swapper/009:55:270
301209953,1cyclictest7093-21/usr/sbin/munin08:40:203
301209952,2cyclictest8194-21latency07:30:163
301209952,2cyclictest5418-21cstates07:25:143
301209952,2cyclictest3758-21snmpd09:00:023
301209952,2cyclictest24064-21cat08:05:173
301209952,2cyclictest21511-21cat08:00:163
301209952,2cyclictest18685-21expr09:05:233
301209952,2cyclictest12936-21ntpq07:40:173
301209952,2cyclictest11798-21grep08:50:143
301209952,2cyclictest10521-21ssh10:45:083
301209951,3cyclictest3758-21snmpd07:35:053
301209950,4cyclictest29741-11brltty09:30:033
301159952,2cyclictest4923-21sh09:40:232
301159952,2cyclictest383-21ls07:15:012
301159952,2cyclictest3758-21snmpd12:20:102
301159952,2cyclictest30194-21cat08:20:212
301159952,2cyclictest17411-21cat09:00:212
301159952,2cyclictest14445-21gdbus07:45:022
301159952,2cyclictest14445-21gdbus07:45:022
301159951,3cyclictest3758-21snmpd08:55:012
301159951,3cyclictest3758-21snmpd08:40:002
301159951,3cyclictest17528-21cat12:10:192
301159951,3cyclictest10954-21/usr/sbin/munin10:25:212
301159950,4cyclictest8951-21ssh12:25:072
301159950,3cyclictest283-21systemd-journal07:50:212
301119952,2cyclictest7988-21head07:30:151
301119952,2cyclictest5592-21sh07:25:141
301119952,2cyclictest4362-21grep07:20:261
301119952,2cyclictest3758-21snmpd08:45:071
301119952,2cyclictest3758-21snmpd08:00:211
301069952,2cyclictest32673-21expr08:25:140
301069952,2cyclictest29741-11brltty09:20:020
301069952,2cyclictest28812-21ntpq08:15:190
301069951,3cyclictest5904-21irqstats07:25:180
301069951,3cyclictest2299-21expr11:20:140
301069950,1cyclictest283-21systemd-journal07:45:030
301069950,1cyclictest283-21systemd-journal07:45:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional