You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-09-30 - 19:02
/usr/bin/Xorg /usr/bin/Xorg

x86 Intel Core i5-8265UE @1600 MHz, Linux 5.10.41-rt42 (Profile)

Latency plot of system in rack #a, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Fri Sep 30, 2022 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
121782321293,18sleep10-21swapper/107:06:251
122142289263,17sleep00-21swapper/007:06:530
123242281250,19sleep20-21swapper/207:08:202
104952272244,18sleep30-21swapper/307:05:083
259152580,0sleep00-21swapper/007:35:210
150912580,0sleep00-21swapper/010:35:110
154412530,0sleep20-21swapper/212:13:232
51122520,0sleep20-21swapper/210:29:012
305732460,0sleep30-21swapper/309:25:583
177232180,1sleep20-21swapper/211:55:132
195492150,0sleep30-21swapper/311:55:393
13472150,0sleep30-21swapper/310:26:053
209972140,0sleep10-21swapper/110:58:021
290682130,0sleep30-21swapper/311:42:063
143062110,0sleep20-21swapper/210:34:462
77802100,0sleep30-21swapper/311:29:433
3126290,1sleep13132-21timerwakeupswit12:05:221
16295290,0sleep20-21swapper/209:37:032
125729994,3cyclictest283-21systemd-journal12:02:172
125729994,3cyclictest283-21systemd-journal09:13:232
125649990,8cyclictest13025-21ssh12:30:541
125609994,3cyclictest283-21systemd-journal09:41:200
125609994,3cyclictest283-21systemd-journal08:29:360
20709280,0sleep20-21swapper/207:25:182
125779983,3cyclictest283-21systemd-journal09:35:003
125729986,1cyclictest3011-21rm11:45:372
125729983,3cyclictest283-21systemd-journal09:07:322
125729983,3cyclictest283-21systemd-journal08:11:402
125729982,3cyclictest11738-21rs:main2
125609983,3cyclictest283-21systemd-journal08:44:470
125779976,1cyclictest34-21ksoftirqd/312:29:593
125779973,3cyclictest29741-11brltty07:36:383
125779973,3cyclictest19023-21snmpd07:50:253
125779972,3cyclictest283-21systemd-journal09:52:123
125779972,3cyclictest283-21systemd-journal09:52:123
125729973,3cyclictest29741-11brltty09:21:432
125729973,3cyclictest283-21systemd-journal10:35:342
125649975,1cyclictest0-21swapper/109:55:011
125649975,1cyclictest0-21swapper/109:55:011
125649974,2cyclictest283-21systemd-journal12:12:181
125649974,2cyclictest283-21systemd-journal08:23:441
125649973,3cyclictest283-21systemd-journal08:47:461
125649973,3cyclictest283-21systemd-journal07:41:371
125649973,3cyclictest283-21systemd-journal07:15:471
125649973,3cyclictest283-21systemd-journal07:13:321
125649973,3cyclictest19023-21snmpd07:21:261
125649973,3cyclictest13777-21grep09:55:191
125649973,3cyclictest0-21swapper/109:12:251
125649972,3cyclictest283-21systemd-journal09:48:011
125649970,4cyclictest1821-21awk12:25:001
125609976,1cyclictest12-21ksoftirqd/009:20:010
125609973,3cyclictest5595-21basename10:10:020
125609973,3cyclictest19060-21http08:35:000
125609973,3cyclictest19023-21snmpd09:48:110
125609973,3cyclictest19023-21snmpd07:19:260
125609971,3cyclictest19116-21gdbus07:45:010
125609970,4cyclictest8711-21perf11:50:000
125609970,4cyclictest30607-21munin-plugin-st10:25:010
28851260,0sleep00-21swapper/010:43:160
21208260,0sleep10-21swapper/112:35:531
125779966,0cyclictest0-21swapper/311:24:483
125779966,0cyclictest0-21swapper/310:57:453
125779966,0cyclictest0-21swapper/309:20:113
125779966,0cyclictest0-21swapper/308:40:223
125779965,1cyclictest34-21ksoftirqd/307:15:003
125779963,2cyclictest7292-21expr10:30:143
125779963,2cyclictest508-21dbus-daemon11:15:103
125779963,2cyclictest508-21dbus-daemon10:35:083
125779963,2cyclictest31760-21ssh09:46:033
125779963,2cyclictest27704-21gltestperf07:40:183
125779963,2cyclictest25367-21ssh10:40:343
125779963,2cyclictest24542-21grep08:45:163
125779963,2cyclictest19023-21snmpd08:58:223
125779963,2cyclictest14800-21ssh12:32:173
125779963,2cyclictest11736-21in:imuxsock10:18:273
125779963,2cyclictest11736-21in:imuxsock08:20:513
125779963,2cyclictest10229-21ssh10:51:173
125779963,2cyclictest10027-21wc12:10:153
125779962,3cyclictest9680-21ntpq11:30:173
125779962,3cyclictest6580-21cat08:05:143
125779962,3cyclictest3264-21sshd07:58:413
125779962,3cyclictest19023-21snmpd12:35:133
125779962,3cyclictest19023-21snmpd12:23:033
125779962,3cyclictest19023-21snmpd11:50:373
125779962,3cyclictest19023-21snmpd11:09:483
125779962,3cyclictest19023-21snmpd10:22:543
125779962,3cyclictest19023-21snmpd10:03:583
125779962,3cyclictest19023-21snmpd09:41:143
125779962,3cyclictest19023-21snmpd09:10:143
125779962,3cyclictest19023-21snmpd09:08:293
125779962,3cyclictest19023-21snmpd08:50:253
125779962,3cyclictest19023-21snmpd08:35:093
125779962,3cyclictest19023-21snmpd08:31:253
125779962,3cyclictest19023-21snmpd08:15:003
125779962,3cyclictest19023-21snmpd07:27:383
125779962,3cyclictest19023-21snmpd07:12:543
125779962,3cyclictest18576-21cat07:20:203
125779962,3cyclictest1606-21ssh10:06:563
125779962,3cyclictest11653-21df09:15:153
125779962,1cyclictest0-21swapper/311:11:293
125779962,1cyclictest0-21swapper/311:03:483
125779961,4cyclictest440-21cut10:45:223
125779961,3cyclictest283-21systemd-journal09:35:003
125779960,6cyclictest0-21swapper/311:45:093
125779960,5cyclictest16674-21sshd08:28:463
125779960,5cyclictest14817-21timerandwakeup09:55:273
125779960,3cyclictest22645-21ssh12:17:353
125779960,0cyclictest0-21swapper/308:00:113
125729966,0cyclictest0-21swapper/211:30:282
125729966,0cyclictest0-21swapper/211:03:592
125729966,0cyclictest0-21swapper/209:28:502
125729963,2cyclictest31583-21ssh09:45:542
125729963,2cyclictest29162-21ssh10:04:452
125729963,2cyclictest24592-21ssh09:41:542
125729963,2cyclictest23634-21cat10:20:192
125729963,2cyclictest10959-21ssh09:15:002
125729963,1cyclictest0-21swapper/211:39:202
125729962,4cyclictest7330-21apt-get10:50:142
125729962,3cyclictest508-21dbus-daemon12:25:392
125729962,3cyclictest508-21dbus-daemon07:45:002
125729962,3cyclictest283-21systemd-journal12:07:452
125729962,3cyclictest25112-21grep11:20:152
125729962,3cyclictest19023-21snmpd12:31:262
125729962,3cyclictest19023-21snmpd12:16:422
125729962,3cyclictest19023-21snmpd11:50:302
125729962,3cyclictest19023-21snmpd11:41:572
125729962,3cyclictest19023-21snmpd11:06:582
125729962,3cyclictest19023-21snmpd10:55:132
125729962,3cyclictest19023-21snmpd10:45:322
125729962,3cyclictest19023-21snmpd10:18:482
125729962,3cyclictest19023-21snmpd10:12:572
125729962,3cyclictest19023-21snmpd09:52:242
125729962,3cyclictest19023-21snmpd09:52:242
125729962,3cyclictest19023-21snmpd09:30:042
125729962,3cyclictest19023-21snmpd08:41:342
125729962,3cyclictest19023-21snmpd08:21:242
125729962,3cyclictest19023-21snmpd07:59:062
125729962,3cyclictest19023-21snmpd07:24:592
125729962,3cyclictest19023-21snmpd07:15:372
125729962,3cyclictest1-21systemd09:56:222
125729962,3cyclictest1096-21sed11:25:172
125729962,2cyclictest283-21systemd-journal12:35:402
125729962,1cyclictest0-21swapper/212:20:182
125729962,1cyclictest0-21swapper/211:17:202
125729961,3cyclictest283-21systemd-journal08:58:232
125729961,3cyclictest283-21systemd-journal08:00:502
125729960,6cyclictest0-21swapper/210:05:242
125729960,6cyclictest0-21swapper/208:05:152
125649966,0cyclictest0-21swapper/109:01:421
125649966,0cyclictest0-21swapper/108:08:481
125649963,2cyclictest508-21dbus-daemon11:40:111
125649963,2cyclictest4752-21rm10:28:451
125649963,2cyclictest283-21systemd-journal10:38:541
125649963,2cyclictest283-21systemd-journal07:33:451
125649963,2cyclictest24013-21ssh11:00:111
125649963,2cyclictest20210-21sh11:56:081
125649963,2cyclictest19023-21snmpd11:16:151
125649963,2cyclictest19023-21snmpd10:02:001
125649963,2cyclictest1484-21ssh10:06:511
125649963,2cyclictest1398-21needreboot09:05:161
125649963,2cyclictest1-21systemd07:25:241
125649963,1cyclictest0-21swapper/110:20:351
125649962,3cyclictest7220-21expr10:30:151
125649962,3cyclictest508-21dbus-daemon09:35:011
125649962,3cyclictest29741-11brltty07:53:191
125649962,3cyclictest25554-21cut07:35:171
125649962,3cyclictest19023-21snmpd11:31:091
125649962,3cyclictest19023-21snmpd11:28:331
125649962,3cyclictest19023-21snmpd10:44:081
125649962,3cyclictest19023-21snmpd10:14:431
125649962,3cyclictest19023-21snmpd08:40:251
125649962,3cyclictest19023-21snmpd08:02:061
125649962,3cyclictest19023-21snmpd07:58:151
125649962,3cyclictest19023-21snmpd07:48:531
125649962,3cyclictest18646-21head12:15:161
125649962,3cyclictest11017-21cat08:15:161
125649962,3cyclictest0-21swapper/109:24:261
125649962,1cyclictest0-21swapper/112:00:001
125649962,1cyclictest0-21swapper/111:50:021
125649962,1cyclictest0-21swapper/110:50:451
125649962,1cyclictest0-21swapper/110:47:221
125649962,1cyclictest0-21swapper/110:15:221
125649962,1cyclictest0-21swapper/109:30:061
125649962,1cyclictest0-21swapper/109:15:361
125649961,3cyclictest7598-21awk11:10:011
125649960,5cyclictest25665-21ntp_states11:20:181
125649960,5cyclictest17315-21grep11:35:141
125649960,2cyclictest20516-21ntp_states08:35:181
125649960,2cyclictest1986-21ntp_states11:45:171
125649960,0cyclictest0-21swapper/108:10:211
125609963,2cyclictest9196-21chrt10:50:290
125609963,2cyclictest508-21dbus-daemon12:10:220
125609963,2cyclictest283-21systemd-journal08:24:590
125609963,2cyclictest24736-21sh12:38:390
125609963,2cyclictest23552-21awk10:00:260
125609963,2cyclictest19023-21snmpd12:29:150
125609963,2cyclictest19023-21snmpd09:05:040
125609963,2cyclictest17902-21fschecks_count11:55:150
125609963,2cyclictest15161-21ssh11:14:300
125609963,2cyclictest14659-21idleruntime-cro10:35:000
125609963,2cyclictest1405-21ssh10:45:480
125609963,2cyclictest11736-21in:imuxsock12:34:490
125609963,2cyclictest10591-21ssh10:12:200
125609962,3cyclictest8763-21cat11:30:130
125609962,3cyclictest5367-21sshd10:29:130
125609962,3cyclictest31658-21ntp_kernel_err09:00:170
125609962,3cyclictest2599-21ntpq12:05:190
125609962,3cyclictest24273-21expr08:45:160
125609962,3cyclictest19023-21snmpd11:38:020
125609962,3cyclictest19023-21snmpd10:16:190
125609962,3cyclictest19023-21snmpd09:55:370
125609962,3cyclictest19023-21snmpd08:15:290
125609962,3cyclictest19023-21snmpd08:10:350
125609962,3cyclictest19023-21snmpd08:00:540
125609962,3cyclictest19023-21snmpd07:48:410
125609962,3cyclictest19023-21snmpd07:31:010
125609962,3cyclictest19023-21snmpd07:29:460
125609962,3cyclictest19023-21snmpd07:22:070
125609962,3cyclictest18750-21cat12:15:170
125609962,3cyclictest16670-21cat10:55:180
125609962,3cyclictest14770-21turbostat07:15:010
125609961,3cyclictest283-21systemd-journal09:25:290
125609961,2cyclictest26925-21ssh12:20:140
125609960,6cyclictest0-21swapper/009:50:380
125609960,6cyclictest0-21swapper/009:50:380
125609960,6cyclictest0-21swapper/009:31:160
125609960,6cyclictest0-21swapper/008:35:130
125609960,4cyclictest16950-21perf11:55:010
125609960,3cyclictest25815-21ssh11:00:230
125609960,1cyclictest131rcuc/008:50:130
10348260,0sleep30-21swapper/310:12:073
125779952,2cyclictest22754-21cut07:30:153
125779952,2cyclictest19023-21snmpd09:00:043
125779952,2cyclictest19023-21snmpd07:45:103
125779952,2cyclictest16634-21ssh11:35:043
125779952,2cyclictest0-21swapper/312:00:083
125779951,3cyclictest10334-21/usr/sbin/munin08:15:153
125779951,3cyclictest0-21swapper/312:05:013
125729952,2cyclictest8313-21tr11:10:142
125729952,2cyclictest31117-21df09:00:142
125729952,2cyclictest29575-21cut07:45:142
125729952,2cyclictest26923-21cat08:50:172
125729952,2cyclictest25127-21cat07:35:142
125729952,2cyclictest22575-21date07:30:012
125729952,2cyclictest19684-21tr08:35:122
125729952,2cyclictest19023-21snmpd07:10:122
125729952,2cyclictest10503-21cut08:15:132
125729951,3cyclictest31604-21sshd07:50:012
125729951,3cyclictest15531-21/usr/sbin/munin08:25:162
125729951,2cyclictest283-21systemd-journal08:30:002
125729951,1cyclictest0-21swapper/210:40:102
125649953,1cyclictest668-21runrttasks08:57:321
125649952,2cyclictest283-21systemd-journal12:25:141
125649952,2cyclictest283-21systemd-journal08:27:301
125649952,2cyclictest20629-21gdbus09:40:021
125649952,2cyclictest17259-21cat08:30:131
125649952,2cyclictest11736-21in:imuxsock09:25:041
125649951,3cyclictest8096-21/usr/sbin/munin11:10:171
125649950,3cyclictest283-21systemd-journal08:51:421
125609952,2cyclictest343-21ssh11:25:120
125609952,2cyclictest31859-21expr07:50:130
125609952,2cyclictest3037-21ssh09:10:140
125609952,2cyclictest25457-21expr11:40:140
125609952,2cyclictest19520-21rm09:20:020
125609952,2cyclictest19023-21snmpd08:55:000
125609952,2cyclictest19023-21snmpd07:55:090
125609952,2cyclictest12204-21rm09:35:060
125609951,3cyclictest6457-21/usr/sbin/munin08:05:140
125609951,3cyclictest19023-21snmpd11:20:060
125609950,4cyclictest16273-21/usr/sbin/munin11:15:130
125609950,3cyclictest596-21/usr/sbin/munin11:05:160
125609950,3cyclictest283-21systemd-journal12:00:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional