You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-09-30 - 18:37
/usr/bin/Xorg /usr/bin/Xorg

x86 Intel Xeon E3-1220 @3100 MHz, Linux 4.19.1-rt3 (Profile)

Latency plot of system in rack #2, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Fri Sep 30, 2022 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
308692540,0sleep30-21swapper/311:10:423
209802530,0sleep10-21swapper/111:56:301
226262520,0sleep00-21swapper/012:29:130
55792510,0sleep30-21swapper/309:44:263
198322510,0sleep20-21swapper/211:24:182
157472510,0sleep00-21swapper/012:03:210
1082825139,7sleep10-21swapper/107:09:261
297822500,0sleep00-21swapper/009:42:160
323072480,0sleep30-21swapper/311:19:233
109202480,0sleep00-21swapper/012:34:210
203092470,0sleep30-21swapper/312:36:283
140202470,0sleep10-21swapper/111:14:521
42682460,0sleep30-21swapper/312:00:203
179952410,2sleep31098899cyclictest11:31:393
1069223523,7sleep00-21swapper/007:07:430
1074623311,7sleep20-21swapper/207:08:262
1061123210,7sleep30-21swapper/307:06:433
152402170,0sleep30-21swapper/310:50:473
131472170,0sleep00-21swapper/010:58:280
160732150,0sleep3391rcuc/310:59:163
10978991514,0cyclictest33150irq/27-ahci[00010:45:201
298602140,0sleep00-21swapper/009:50:170
132242140,0sleep00-21swapper/011:14:380
1097899140,13cyclictest619-21systemd-logind11:35:391
251252130,0sleep2311rcuc/210:13:182
113622130,0sleep00-21swapper/010:17:520
1098299130,11cyclictest21262-21sshd09:32:082
10971991311,1cyclictest1-21systemd10:42:570
326862120,0sleep30-21swapper/308:00:153
283432120,0sleep00-21swapper/009:34:020
10988991210,1cyclictest0-21swapper/311:55:273
1098899120,11cyclictest28387-21sshd09:17:573
1098899120,11cyclictest26999-21lspci12:05:583
10982991210,1cyclictest0-21swapper/210:02:482
10978991211,0cyclictest5586-21lspci09:36:121
10978991211,0cyclictest18678-21lspci09:31:261
1098899119,1cyclictest614-21dbus-daemon09:13:083
10988991110,0cyclictest0-21swapper/311:51:583
10988991110,0cyclictest0-21swapper/309:22:483
1098899110,1cyclictest614-21dbus-daemon09:58:183
1098899110,10cyclictest12332-21grepconf.sh11:06:073
1098899110,10cyclictest0-21swapper/310:32:083
1098299119,1cyclictest0-21swapper/209:37:382
1098299110,1cyclictest28972-21bash10:54:292
1098299110,10cyclictest0-21swapper/212:28:492
1098299110,10cyclictest0-21swapper/211:51:192
1098299110,10cyclictest0-21swapper/210:43:082
1098299110,10cyclictest0-21swapper/210:31:482
1097899119,1cyclictest15738-21bash09:14:591
1097899110,1cyclictest9308-21lspci10:17:191
1097899110,10cyclictest0-21swapper/112:33:491
1097899110,10cyclictest0-21swapper/112:03:291
1097199119,1cyclictest13540-21sshd10:02:170
1097199119,1cyclictest0-21swapper/009:36:370
1097199110,10cyclictest27580-21lspci11:01:570
1097199110,10cyclictest0-21swapper/011:16:170
1097199110,10cyclictest0-21swapper/008:26:370
1098899109,0cyclictest0-21swapper/312:22:573
1098899109,0cyclictest0-21swapper/310:35:583
1098899109,0cyclictest0-21swapper/310:20:083
1098899109,0cyclictest0-21swapper/310:02:483
1098899109,0cyclictest0-21swapper/309:53:573
1098299109,0cyclictest0-21swapper/210:35:392
1098299108,1cyclictest968-21sshd12:08:492
1098299100,0cyclictest23335-21sshd11:40:592
1098299100,0cyclictest0-21swapper/211:16:292
1098299100,0cyclictest0-21swapper/211:02:092
1098299100,0cyclictest0-21swapper/210:07:082
1098299100,0cyclictest0-21swapper/209:58:282
1098299100,0cyclictest0-21swapper/209:18:272
1097899109,0cyclictest0-21swapper/111:32:091
1097899109,0cyclictest0-21swapper/111:25:091
1097899109,0cyclictest0-21swapper/111:21:381
1097899109,0cyclictest0-21swapper/109:19:481
10978991010,0cyclictest33150irq/27-ahci[00010:30:501
1097899100,9cyclictest0-21swapper/112:13:581
1097899100,0cyclictest0-21swapper/112:37:091
1097899100,0cyclictest0-21swapper/112:27:091
1097899100,0cyclictest0-21swapper/112:06:591
1097899100,0cyclictest0-21swapper/109:24:291
1097199109,0cyclictest0-21swapper/012:08:470
1097199109,0cyclictest0-21swapper/011:30:270
1097199109,0cyclictest0-21swapper/011:26:570
1097199109,0cyclictest0-21swapper/010:39:070
1097199109,0cyclictest0-21swapper/010:06:370
1097199109,0cyclictest0-21swapper/009:26:570
1097199108,1cyclictest10386-21sshd11:05:370
1097199100,9cyclictest0-21swapper/012:15:370
1097199100,0cyclictest0-21swapper/012:35:260
109889998,0cyclictest0-21swapper/312:32:583
109889998,0cyclictest0-21swapper/312:26:183
109889990,0cyclictest0-21swapper/311:48:283
109889990,0cyclictest0-21swapper/310:07:073
109889990,0cyclictest0-21swapper/307:50:273
109829998,0cyclictest0-21swapper/212:38:492
109829998,0cyclictest0-21swapper/212:32:092
109829998,0cyclictest0-21swapper/212:18:592
109829998,0cyclictest0-21swapper/211:05:492
109829998,0cyclictest0-21swapper/209:43:372
109829998,0cyclictest0-21swapper/209:23:082
109829998,0cyclictest0-21swapper/209:13:382
109789998,0cyclictest0-21swapper/112:17:191
109789998,0cyclictest0-21swapper/111:18:091
109789998,0cyclictest0-21swapper/110:52:291
109789998,0cyclictest0-21swapper/110:21:391
109789998,0cyclictest0-21swapper/109:55:381
109789998,0cyclictest0-21swapper/109:51:091
109789998,0cyclictest0-21swapper/109:45:291
109719998,0cyclictest0-21swapper/011:47:460
109719998,0cyclictest0-21swapper/010:31:370
109719997,2cyclictest2599-21kworker/0:210:51:180
109719997,2cyclictest14001-21kworker/0:011:39:140
109719997,2cyclictest10916-21kworker/0:211:23:250
109719990,0cyclictest0-21swapper/007:20:570
29397280,1sleep31-21systemd09:26:053
26047280,0sleep10-21swapper/109:25:191
109889987,0cyclictest0-21swapper/311:41:383
109889987,0cyclictest0-21swapper/311:27:383
109889987,0cyclictest0-21swapper/309:37:183
109889985,2cyclictest614-21dbus-daemon12:19:483
109889985,2cyclictest598-21avahi-daemon12:11:193
109889985,2cyclictest598-21avahi-daemon11:39:563
109889985,2cyclictest598-21avahi-daemon11:03:243
109889985,2cyclictest598-21avahi-daemon10:44:353
109889985,2cyclictest598-21avahi-daemon10:27:213
109889985,2cyclictest598-21avahi-daemon10:16:093
109889985,2cyclictest598-21avahi-daemon09:46:133
109829987,0cyclictest0-21swapper/209:54:072
109829987,0cyclictest0-21swapper/209:49:182
109829985,2cyclictest598-21avahi-daemon12:03:062
109829985,2cyclictest598-21avahi-daemon11:35:192
109829985,2cyclictest598-21avahi-daemon11:31:262
109829985,2cyclictest598-21avahi-daemon11:13:572
109829985,2cyclictest598-21avahi-daemon10:21:232
109829985,2cyclictest598-21avahi-daemon10:16:272
109829984,3cyclictest598-21avahi-daemon11:56:122
109789988,0cyclictest518-40kipmi007:32:481
109789987,0cyclictest0-21swapper/111:03:491
109789985,2cyclictest598-21avahi-daemon10:07:391
109719987,0cyclictest0-21swapper/011:51:170
109719987,0cyclictest0-21swapper/009:07:560
109719987,0cyclictest0-21swapper/007:40:160
109719987,0cyclictest0-21swapper/007:35:570
109719986,2cyclictest9950-21kworker/0:210:25:060
109719986,2cyclictest9950-21kworker/0:210:22:530
109719986,2cyclictest9512-21kworker/0:209:55:130
109719986,2cyclictest32427-21kworker/0:010:10:000
109719986,2cyclictest29140-21kworker/0:110:45:250
109719986,2cyclictest2609-21kworker/0:111:42:540
109719986,2cyclictest23932-21kworker/0:109:10:070
109719986,2cyclictest23071-21kworker/0:312:11:130
109719986,2cyclictest21947-21kworker/0:209:23:260
109719986,2cyclictest21947-21kworker/0:209:18:300
109719986,2cyclictest12618-21kworker/0:212:23:140
109719985,2cyclictest598-21avahi-daemon09:46:380
109719984,3cyclictest23071-21kworker/0:311:58:220
109889976,0cyclictest0-21swapper/308:59:283
109889975,1cyclictest598-21avahi-daemon11:20:213
109889974,2cyclictest614-21dbus-daemon10:12:043
109889973,3cyclictest614-21dbus-daemon10:45:553
109829975,1cyclictest598-21avahi-daemon11:46:452
109829975,1cyclictest598-21avahi-daemon11:25:092
109829975,1cyclictest598-21avahi-daemon10:46:072
109829974,2cyclictest598-21avahi-daemon12:20:472
109829974,2cyclictest598-21avahi-daemon10:56:462
109829974,2cyclictest598-21avahi-daemon09:25:492
109829972,2cyclictest9960-21sshd12:10:012
109829972,2cyclictest16555-21sshd10:27:082
109789976,0cyclictest0-21swapper/110:41:091
109789975,1cyclictest598-21avahi-daemon11:52:431
109789975,1cyclictest598-21avahi-daemon11:46:051
109789975,1cyclictest598-21avahi-daemon10:25:481
109789975,1cyclictest598-21avahi-daemon10:11:201
109789975,1cyclictest5590-21dump-pmu-power08:15:001
109789974,2cyclictest643-21gdbus12:22:201
109789974,2cyclictest598-21avahi-daemon11:07:101
109789974,2cyclictest598-21avahi-daemon09:40:311
109719976,0cyclictest0-21swapper/008:48:470
109889965,0cyclictest0-21swapper/308:18:273
109889964,1cyclictest614-21dbus-daemon09:31:503
109889964,1cyclictest598-21avahi-daemon08:00:013
109889960,5cyclictest0-21swapper/309:03:573
109829964,1cyclictest9672-21awk08:25:002
109829963,2cyclictest970-21snmpd09:08:132
109829963,2cyclictest970-21snmpd08:26:392
109829963,2cyclictest643-21gdbus08:50:002
109829960,5cyclictest0-21swapper/207:51:272
109789965,0cyclictest25-21ksoftirqd/107:15:011
109789964,1cyclictest643-21gdbus11:41:061
109789964,1cyclictest614-21dbus-daemon08:55:011
109789964,1cyclictest614-21dbus-daemon08:05:001
109789964,1cyclictest598-21avahi-daemon10:35:071
109789964,1cyclictest31774-21sshd10:55:091
109789964,1cyclictest25-21ksoftirqd/108:30:001
109789963,2cyclictest970-21snmpd10:00:421
109789963,2cyclictest970-21snmpd07:49:031
109719966,0cyclictest31808-21kworker/0:208:23:310
109719966,0cyclictest23674-21kworker/0:007:52:390
109719966,0cyclictest11728-21kworker/0:008:40:140
109719966,0cyclictest11157-21kworker/0:107:25:510
109719966,0cyclictest11157-21kworker/0:107:15:140
109719965,0cyclictest0-21swapper/008:58:360
109719965,0cyclictest0-21swapper/008:05:560
109719960,5cyclictest0-21swapper/008:53:470
109719960,5cyclictest0-21swapper/008:03:370
109889954,0cyclictest0-21swapper/307:14:473
109889953,1cyclictest970-21snmpd08:45:073
109889953,1cyclictest970-21snmpd08:44:133
109889953,1cyclictest970-21snmpd08:11:483
109889953,1cyclictest970-21snmpd07:42:153
109889953,1cyclictest970-21snmpd07:35:283
109889953,1cyclictest970-21snmpd07:15:413
109889953,1cyclictest616-21gdbus08:35:013
109889953,1cyclictest443-21systemd-journal07:31:213
109889953,1cyclictest4421-21sendmail08:25:043
109889953,1cyclictest26434-21mii-tool07:45:173
109889953,1cyclictest26289-21tr09:05:123
109889953,1cyclictest17872-21cpu07:25:153
109889953,1cyclictest16321-21irqstats07:20:213
109889953,1cyclictest1002-21rpcbind08:51:583
109889950,4cyclictest0-21swapper/308:08:083
109889950,2cyclictest8515-21/usr/sbin/munin08:20:173
109829954,0cyclictest0-21swapper/209:00:082
109829953,1cyclictest970-21snmpd08:35:012
109829953,1cyclictest970-21snmpd08:32:432
109829953,1cyclictest970-21snmpd08:05:232
109829953,1cyclictest970-21snmpd07:55:572
109829953,1cyclictest970-21snmpd07:41:502
109829953,1cyclictest970-21snmpd07:37:142
109829953,1cyclictest970-21snmpd07:30:592
109829953,1cyclictest970-21snmpd07:10:072
109829953,1cyclictest598-21avahi-daemon07:15:022
109829953,1cyclictest4286-21cat08:10:162
109829953,1cyclictest25960-21/usr/sbin/munin07:45:212
109829953,1cyclictest20416-21tr08:50:142
109829953,1cyclictest18281-21cat07:25:182
109829953,1cyclictest17397-21unixbench_singl08:40:232
109829953,1cyclictest1071-21lldpd07:22:512
109829953,1cyclictest0-21swapper/208:15:182
109829952,2cyclictest970-21snmpd08:00:562
109829950,0cyclictest0-21swapper/208:55:382
109789953,1cyclictest970-21snmpd08:50:311
109789953,1cyclictest970-21snmpd08:46:041
109789953,1cyclictest970-21snmpd08:40:481
109789953,1cyclictest970-21snmpd08:31:121
109789953,1cyclictest970-21snmpd08:15:081
109789953,1cyclictest970-21snmpd07:52:501
109789953,1cyclictest970-21snmpd07:35:021
109789953,1cyclictest970-21snmpd07:21:471
109789953,1cyclictest8316-21cat08:20:161
109789953,1cyclictest643-21gdbus07:25:001
109789953,1cyclictest598-21avahi-daemon09:07:571
109789953,1cyclictest598-21avahi-daemon07:44:531
109789953,1cyclictest31204-21cat07:55:211
109789953,1cyclictest25-21ksoftirqd/109:00:011
109789953,1cyclictest14462-21cat08:35:151
109789953,1cyclictest13315-21gltestperf07:15:001
109719955,0cyclictest31808-21kworker/0:208:10:110
109719955,0cyclictest23674-21kworker/0:007:56:060
109719955,0cyclictest23674-21kworker/0:007:45:110
109719955,0cyclictest11728-21kworker/0:008:36:510
109719955,0cyclictest11157-21kworker/0:107:10:470
109719953,1cyclictest970-21snmpd08:30:390
109719953,1cyclictest966-21runrttasks08:15:510
109719953,1cyclictest20319-21cat07:30:150
109719952,2cyclictest970-21snmpd09:03:020
109889942,1cyclictest598-21avahi-daemon08:30:113
109789942,1cyclictest2126-21head08:05:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional