You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-05-12 - 13:51

Intel(R) Xeon(R) CPU E31220 @ 3.10GHz, Linux 4.19.1-rt3 (Profile)

Latency plot of system in rack #2, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Wed May 12, 2021 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
233572550,0sleep20-21swapper/209:38:462
59962530,0sleep00-21swapper/011:10:110
113632530,0sleep20-21swapper/212:39:402
325212510,1sleep00-21swapper/012:04:540
252792490,0sleep00-21swapper/010:26:580
215932490,0sleep10-21swapper/110:18:101
26572470,0sleep10-21swapper/109:33:401
246842460,0sleep10-21swapper/110:50:381
130432440,1sleep233-21ksoftirqd/212:07:562
53452370,0sleep20-21swapper/211:41:572
181702308,7sleep30-21swapper/307:08:163
1629022923,3sleep10-21swapper/107:05:021
1812222816,7sleep20-21swapper/207:07:392
179572287,7sleep00-21swapper/007:05:330
8542160,1sleep341-21ksoftirqd/312:29:003
245062140,0sleep20-21swapper/211:22:432
224372140,0sleep10-21swapper/111:22:101
290372130,0sleep20-21swapper/209:32:052
49982120,0sleep30-21swapper/312:37:573
1844899120,11cyclictest0-21swapper/310:04:053
1843999121,1cyclictest576-17sedispatch12:12:422
1843199120,11cyclictest0-21swapper/109:57:521
123312120,0sleep10-21swapper/110:31:431
267902110,0sleep20-21swapper/211:47:182
1844899119,1cyclictest0-21swapper/311:21:463
18448991110,0cyclictest0-21swapper/310:34:463
18448991110,0cyclictest0-21swapper/308:25:163
1844899110,10cyclictest0-21swapper/309:52:063
1844899110,10cyclictest0-21swapper/309:35:563
1843999110,10cyclictest0-21swapper/207:25:222
18431991110,0cyclictest0-21swapper/112:10:221
18431991110,0cyclictest0-21swapper/111:31:121
18431991110,0cyclictest0-21swapper/109:42:221
1843199110,10cyclictest16747-21sshd10:25:021
1842499119,1cyclictest0-21swapper/012:37:220
1842499110,10cyclictest28160-21lspci11:31:320
189032100,0sleep20-21swapper/210:41:172
1844899109,0cyclictest0-21swapper/312:11:163
1844899109,0cyclictest0-21swapper/311:48:163
1844899109,0cyclictest0-21swapper/311:30:563
1844899109,0cyclictest0-21swapper/310:48:163
1844899109,0cyclictest0-21swapper/310:27:063
1844899109,0cyclictest0-21swapper/309:15:063
1844899100,9cyclictest0-21swapper/310:19:163
1844899100,9cyclictest0-21swapper/308:20:263
1844899100,0cyclictest0-21swapper/312:19:363
1844899100,0cyclictest0-21swapper/310:52:063
1844899100,0cyclictest0-21swapper/309:58:263
1844899100,0cyclictest0-21swapper/309:42:563
1843999100,9cyclictest0-21swapper/209:53:422
1843999100,0cyclictest0-21swapper/210:22:322
1843199109,0cyclictest0-21swapper/112:04:521
1843199109,0cyclictest0-21swapper/109:27:521
1842499109,0cyclictest0-21swapper/012:25:520
1842499109,0cyclictest0-21swapper/010:48:220
1842499108,1cyclictest614-21dbus-daemon09:26:220
1842499100,9cyclictest0-21swapper/011:07:120
1842499100,9cyclictest0-21swapper/010:35:120
1842499100,0cyclictest0-21swapper/011:21:020
1842499100,0cyclictest0-21swapper/010:22:020
1842499100,0cyclictest0-21swapper/008:10:120
184489998,0cyclictest0-21swapper/312:32:563
184489998,0cyclictest0-21swapper/311:35:363
184489998,0cyclictest0-21swapper/311:14:163
184489998,0cyclictest0-21swapper/309:28:363
184399998,0cyclictest0-21swapper/211:33:522
184399998,0cyclictest0-21swapper/211:12:222
184399998,0cyclictest0-21swapper/210:07:322
184399998,0cyclictest0-21swapper/208:50:222
184399996,2cyclictest598-21avahi-daemon10:04:412
184319998,0cyclictest13907-21lspci12:08:101
184319998,0cyclictest0-21swapper/110:01:021
184319998,0cyclictest0-21swapper/109:54:421
184319998,0cyclictest0-21swapper/109:37:421
184319998,0cyclictest0-21swapper/109:17:021
184249998,0cyclictest0-21swapper/011:45:220
184249998,0cyclictest0-21swapper/009:36:020
184249997,1cyclictest614-21dbus-daemon11:55:020
184249990,8cyclictest599-21ModemManager09:13:020
184249990,0cyclictest17482-21sshd09:21:120
184249990,0cyclictest0-21swapper/011:42:120
184489987,0cyclictest0-21swapper/312:22:263
184489987,0cyclictest0-21swapper/311:15:463
184489987,0cyclictest0-21swapper/309:31:063
184489987,0cyclictest0-21swapper/309:23:263
184489985,2cyclictest598-21avahi-daemon12:03:343
184489985,2cyclictest598-21avahi-daemon11:51:133
184489985,2cyclictest598-21avahi-daemon11:01:413
184489985,2cyclictest598-21avahi-daemon10:57:293
184489985,2cyclictest598-21avahi-daemon10:57:293
184489985,2cyclictest598-21avahi-daemon10:43:383
184489985,2cyclictest598-21avahi-daemon10:21:523
184489985,2cyclictest598-21avahi-daemon09:46:443
184489985,2cyclictest598-21avahi-daemon09:13:023
184399987,0cyclictest0-21swapper/211:51:022
184399986,1cyclictest598-21avahi-daemon09:14:492
184399985,2cyclictest598-21avahi-daemon12:28:052
184399985,2cyclictest598-21avahi-daemon12:15:032
184399985,2cyclictest598-21avahi-daemon11:55:272
184399985,2cyclictest598-21avahi-daemon10:51:442
184399985,2cyclictest598-21avahi-daemon10:32:372
184399985,2cyclictest598-21avahi-daemon10:10:302
184399985,2cyclictest598-21avahi-daemon09:46:162
184399985,2cyclictest598-21avahi-daemon09:16:412
184399980,1cyclictest0-21swapper/211:02:122
184319987,0cyclictest28946-21lspci11:00:001
184319987,0cyclictest28946-21lspci11:00:001
184319987,0cyclictest0-21swapper/108:56:321
184319987,0cyclictest0-21swapper/108:20:321
184319986,1cyclictest598-21avahi-daemon11:37:451
184319986,1cyclictest598-21avahi-daemon10:46:451
184319985,2cyclictest598-21avahi-daemon12:16:221
184319985,2cyclictest598-21avahi-daemon11:04:341
184319985,2cyclictest598-21avahi-daemon10:11:501
184319985,2cyclictest598-21avahi-daemon09:48:511
184319985,2cyclictest598-21avahi-daemon09:22:241
184319985,2cyclictest598-21avahi-daemon09:12:501
184319984,3cyclictest598-21avahi-daemon10:43:081
184249987,0cyclictest0-21swapper/012:16:220
184249987,0cyclictest0-21swapper/011:25:320
184249987,0cyclictest0-21swapper/011:15:120
184249987,0cyclictest0-21swapper/009:51:320
184249985,2cyclictest598-21avahi-daemon12:32:080
184249985,2cyclictest598-21avahi-daemon11:01:280
184249985,2cyclictest598-21avahi-daemon09:58:310
184249980,4cyclictest619-21systemd-logind07:25:000
184249980,1cyclictest19943-21sshd11:53:420
29883270,0sleep10-21swapper/111:08:041
184489976,0cyclictest0-21swapper/307:20:263
184489975,1cyclictest598-21avahi-daemon10:35:423
184489974,2cyclictest598-21avahi-daemon11:41:203
184489974,2cyclictest598-21avahi-daemon11:05:063
184489974,2cyclictest598-21avahi-daemon10:12:153
184489974,2cyclictest598-21avahi-daemon10:05:023
184489973,1cyclictest598-21avahi-daemon12:05:283
184399976,0cyclictest0-21swapper/207:35:012
184399975,1cyclictest633-21polkitd11:38:172
184399975,1cyclictest598-21avahi-daemon12:31:182
184399975,1cyclictest598-21avahi-daemon12:20:132
184399975,1cyclictest598-21avahi-daemon12:00:212
184399975,1cyclictest598-21avahi-daemon11:26:572
184399975,1cyclictest598-21avahi-daemon11:15:502
184399975,1cyclictest598-21avahi-daemon11:06:012
184399975,1cyclictest598-21avahi-daemon10:55:042
184399975,1cyclictest598-21avahi-daemon10:55:042
184399975,1cyclictest598-21avahi-daemon10:45:112
184399975,1cyclictest598-21avahi-daemon10:28:322
184399975,1cyclictest598-21avahi-daemon10:16:412
184399975,1cyclictest598-21avahi-daemon09:41:122
184399975,1cyclictest598-21avahi-daemon09:20:012
184399974,2cyclictest598-21avahi-daemon10:37:322
184399974,2cyclictest598-21avahi-daemon09:57:082
184399974,2cyclictest598-21avahi-daemon09:25:362
184319976,0cyclictest0-21swapper/112:20:121
184319975,1cyclictest599-21ModemManager12:32:371
184319975,1cyclictest598-21avahi-daemon12:35:371
184319975,1cyclictest598-21avahi-daemon12:29:251
184319975,1cyclictest598-21avahi-daemon11:55:171
184319975,1cyclictest598-21avahi-daemon11:54:471
184319975,1cyclictest598-21avahi-daemon11:46:531
184319975,1cyclictest598-21avahi-daemon11:40:081
184319975,1cyclictest598-21avahi-daemon11:25:391
184319975,1cyclictest598-21avahi-daemon11:15:571
184319975,1cyclictest598-21avahi-daemon11:10:061
184319975,1cyclictest598-21avahi-daemon10:24:361
184319974,2cyclictest614-21dbus-daemon08:15:001
184319974,2cyclictest598-21avahi-daemon10:35:061
184319974,2cyclictest598-21avahi-daemon10:09:191
184319970,0cyclictest0-21swapper/109:05:221
184249976,0cyclictest0-21swapper/010:18:020
184249976,0cyclictest0-21swapper/007:55:120
184249975,1cyclictest598-21avahi-daemon12:24:160
184249975,1cyclictest598-21avahi-daemon12:10:470
184249975,1cyclictest598-21avahi-daemon11:36:120
184249975,1cyclictest598-21avahi-daemon10:31:390
184249975,1cyclictest598-21avahi-daemon09:45:200
184249975,1cyclictest598-21avahi-daemon09:30:440
184249975,1cyclictest598-21avahi-daemon09:15:480
184249975,1cyclictest2196-21sshd12:05:140
184249974,2cyclictest614-21dbus-daemon10:58:590
184249974,2cyclictest614-21dbus-daemon10:58:590
184249974,2cyclictest598-21avahi-daemon10:40:250
184249974,2cyclictest598-21avahi-daemon10:10:520
184249974,2cyclictest598-21avahi-daemon10:06:300
184249974,2cyclictest598-21avahi-daemon10:00:310
184249974,2cyclictest598-21avahi-daemon09:40:150
3337260,0sleep30-21swapper/307:50:113
184489965,0cyclictest0-21swapper/308:05:263
184489965,0cyclictest0-21swapper/307:13:163
184489964,1cyclictest970-21snmpd08:04:543
184489964,1cyclictest633-21polkitd11:25:363
184489964,1cyclictest598-21avahi-daemon08:19:553
184489964,1cyclictest598-21avahi-daemon07:50:003
184489964,1cyclictest598-21avahi-daemon07:40:003
184489963,2cyclictest970-21snmpd09:06:503
184489963,2cyclictest970-21snmpd08:55:053
184489963,2cyclictest970-21snmpd08:40:463
184489963,2cyclictest970-21snmpd08:39:433
184489963,2cyclictest633-21polkitd11:55:253
184489960,5cyclictest0-21swapper/308:14:163
184399966,0cyclictest0-21swapper/208:25:012
184399965,0cyclictest0-21swapper/208:11:222
184399964,1cyclictest614-21dbus-daemon08:20:002
184399963,2cyclictest970-21snmpd08:23:102
184399963,2cyclictest970-21snmpd08:09:252
184399963,2cyclictest970-21snmpd07:16:472
184399963,2cyclictest970-21snmpd07:12:102
184399960,5cyclictest0-21swapper/208:04:522
184319960,5cyclictest0-21swapper/108:41:021
184319960,5cyclictest0-21swapper/107:30:221
184319960,2cyclictest19377-21/usr/sbin/munin08:30:181
184319960,0cyclictest0-21swapper/108:45:021
184249966,0cyclictest752-21kworker/0:107:50:480
184249964,1cyclictest970-21snmpd08:07:390
184249964,1cyclictest633-21polkitd10:50:010
184249964,1cyclictest17642-21grep08:25:130
184249963,2cyclictest970-21snmpd08:23:550
184249963,2cyclictest970-21snmpd07:49:420
27952250,0sleep30-21swapper/308:50:133
184489953,1cyclictest970-21snmpd09:00:263
184489953,1cyclictest970-21snmpd08:46:083
184489953,1cyclictest31821-21cat07:40:123
184489953,1cyclictest19869-21cat08:30:153
184489952,2cyclictest27393-21tr07:30:103
184399953,1cyclictest970-21snmpd09:05:082
184399953,1cyclictest970-21snmpd08:55:022
184399953,1cyclictest970-21snmpd08:46:202
184399953,1cyclictest970-21snmpd07:56:092
184399953,1cyclictest970-21snmpd07:53:152
184399953,1cyclictest970-21snmpd07:43:362
184399953,1cyclictest970-21snmpd07:31:112
184399953,1cyclictest618-21lsmd08:31:202
184399953,1cyclictest23918-21mii-tool08:40:142
184399953,1cyclictest21869-21cat08:35:202
184399953,1cyclictest1313-21df07:45:112
184399952,2cyclictest970-21snmpd07:20:472
184399950,1cyclictest1004-21dump-pmu-power09:05:002
184319953,1cyclictest970-21snmpd08:51:141
184319953,1cyclictest970-21snmpd08:35:101
184319953,1cyclictest970-21snmpd08:15:131
184319953,1cyclictest970-21snmpd08:02:211
184319953,1cyclictest970-21snmpd07:56:541
184319953,1cyclictest970-21snmpd07:45:181
184319953,1cyclictest970-21snmpd07:28:291
184319953,1cyclictest970-21snmpd07:11:141
184319953,1cyclictest29802-21mii-tool07:35:121
184319953,1cyclictest17596-21df08:25:121
184319952,2cyclictest970-21snmpd07:20:111
184319950,4cyclictest0-21swapper/108:09:221
184319950,4cyclictest0-21swapper/107:50:411
184319950,1cyclictest21193-21/usr/sbin/munin07:15:211
184249954,0cyclictest0-21swapper/008:41:310
184249953,1cyclictest970-21snmpd09:05:560
184249953,1cyclictest970-21snmpd08:45:530
184249953,1cyclictest970-21snmpd08:36:490
184249953,1cyclictest970-21snmpd08:15:310
184249953,1cyclictest970-21snmpd07:31:560
184249953,1cyclictest970-21snmpd07:11:170
184249953,1cyclictest966-21runrttasks07:40:350
184249953,1cyclictest7609-21cat08:00:130
184249953,1cyclictest29995-21cat08:55:130
184249953,1cyclictest27962-21cat08:50:130
184249953,1cyclictest21647-21cat07:15:140
184249953,1cyclictest10981-21kworker/0:208:30:200
184249953,1cyclictest1078-21ntpd07:35:160
184249952,2cyclictest970-21snmpd07:27:310
184489942,1cyclictest970-21snmpd07:25:053
184489942,1cyclictest633-21polkitd07:55:003
184489942,1cyclictest20632-21service07:15:013
184319942,1cyclictest966-21runrttasks09:00:111
184319942,1cyclictest577-13audispd07:40:001
184249943,0cyclictest23191-21kworker/0:009:00:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional