You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-01 - 22:19

x86 Intel Xeon E3-1220 @3100 MHz, Linux 4.16.15-rt7 (Profile)

Latency plot of system in rack #b, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the alll highest latencies:
System rackbslot1.osadl.org (updated Fri Jul 01, 2022 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
313512960,0sleep30-21swapper/307:50:343
202582570,0sleep30-21swapper/311:10:093
171162550,0sleep00-21swapper/009:15:170
417925442,7sleep00-21swapper/007:07:510
399625038,7sleep30-21swapper/307:06:013
350225023,8sleep10-21swapper/107:05:191
404824836,7sleep20-21swapper/207:06:362
93502470,1sleep19343-21/usr/share/muni09:05:011
19562190,2sleep0451999cyclictest07:55:320
37632170,0sleep30-21swapper/310:40:553
4519991614,1cyclictest17929-21snmpd12:10:420
251052160,0sleep00-21swapper/008:35:120
4531991513,1cyclictest17929-21snmpd12:08:302
4519991412,1cyclictest17929-21snmpd09:54:270
453899130,12cyclictest28262-31munin-html12:15:303
4531991311,1cyclictest17929-21snmpd12:37:492
4531991210,1cyclictest0-21swapper/210:25:262
453199120,11cyclictest0-21swapper/210:10:162
4524991210,1cyclictest29756-21/usr/sbin/munin12:20:101
452499120,1cyclictest18133-31munin-html10:10:301
452499120,11cyclictest5409-21timerandwakeup08:55:251
452499120,11cyclictest24713-31munin-graph11:15:351
452499120,11cyclictest23521-31munin-graph09:25:371
4519991210,1cyclictest36050irq/33-ahci[00008:00:310
453899119,1cyclictest6129-31munin-html09:50:303
453899119,1cyclictest17929-21snmpd09:39:443
453899119,1cyclictest0-21swapper/311:05:463
453899119,1cyclictest0-21swapper/310:25:333
453899110,1cyclictest0-21swapper/312:20:013
453899110,1cyclictest0-21swapper/310:01:003
453899110,10cyclictest0-21swapper/308:15:253
453199119,1cyclictest17929-21snmpd12:33:392
453199119,1cyclictest0-21swapper/210:30:082
453199119,1cyclictest0-21swapper/210:30:072
453199119,1cyclictest0-21swapper/209:59:462
453199119,1cyclictest0-21swapper/207:55:072
453199119,1cyclictest0-21swapper/207:49:472
4531991110,0cyclictest0-21swapper/208:55:112
453199110,1cyclictest0-21swapper/210:17:512
453199110,10cyclictest0-21swapper/211:11:472
453199110,10cyclictest0-21swapper/211:01:072
453199110,10cyclictest0-21swapper/210:54:022
453199110,0cyclictest0-21swapper/211:30:412
4524991110,0cyclictest17929-21snmpd10:23:241
452499110,10cyclictest0-21swapper/112:30:111
452499110,10cyclictest0-21swapper/107:40:211
452499110,10cyclictest0-21swapper/107:40:211
451999119,1cyclictest0-21swapper/008:45:240
4519991110,0cyclictest0-21swapper/008:10:120
451999110,1cyclictest0-21swapper/011:15:040
451999110,10cyclictest0-21swapper/011:00:140
451999110,10cyclictest0-21swapper/010:30:400
451999110,10cyclictest0-21swapper/010:30:400
451999110,10cyclictest0-21swapper/009:30:070
451999110,10cyclictest0-21swapper/008:23:460
453899108,1cyclictest0-21swapper/310:54:463
453199109,0cyclictest0-21swapper/208:00:082
453199108,1cyclictest33-21ksoftirqd/212:15:012
453199108,1cyclictest0-21swapper/212:00:422
453199108,1cyclictest0-21swapper/208:51:192
453199108,1cyclictest0-21swapper/208:21:172
4531991010,0cyclictest17929-21snmpd08:42:342
453199100,9cyclictest0-21swapper/208:29:212
453199100,1cyclictest0-21swapper/210:01:132
453199100,1cyclictest0-21swapper/207:44:472
453199100,1cyclictest0-21swapper/207:44:472
453199100,1cyclictest0-21swapper/207:24:462
453199100,0cyclictest0-21swapper/207:29:462
452499108,1cyclictest0-21swapper/112:37:451
452499108,1cyclictest0-21swapper/110:15:121
4524991010,0cyclictest17929-21snmpd10:48:581
451999108,1cyclictest0-21swapper/011:43:010
451999108,1cyclictest0-21swapper/010:21:180
451999108,1cyclictest0-21swapper/009:01:420
451999100,9cyclictest0-21swapper/012:30:580
451999100,9cyclictest0-21swapper/012:21:160
451999100,9cyclictest0-21swapper/010:26:000
451999100,9cyclictest0-21swapper/009:41:060
451999100,1cyclictest0-21swapper/010:06:070
451999100,1cyclictest0-21swapper/009:20:260
45389999,0cyclictest17929-21snmpd08:45:373
45389998,0cyclictest0-21swapper/311:15:163
45389997,1cyclictest1302-31munin-graph11:30:383
45389997,1cyclictest0-21swapper/309:46:093
45389997,1cyclictest0-21swapper/309:30:493
45389997,1cyclictest0-21swapper/308:55:083
45389997,1cyclictest0-21swapper/308:00:323
45319998,0cyclictest0-21swapper/211:15:402
45319998,0cyclictest0-21swapper/209:46:412
45319997,1cyclictest0-21swapper/211:51:402
45319997,1cyclictest0-21swapper/209:34:162
45319996,2cyclictest13983-31munin-html08:15:312
45319990,8cyclictest0-21swapper/211:58:372
45319990,8cyclictest0-21swapper/211:36:582
45319990,8cyclictest0-21swapper/211:28:342
45319990,8cyclictest0-21swapper/209:24:052
45249997,1cyclictest28364-31munin-graph07:45:401
45249997,1cyclictest0-21swapper/111:40:171
45249995,3cyclictest14170-21kworker/1:208:17:451
45199999,0cyclictest17929-21snmpd10:01:390
45199997,1cyclictest17929-21snmpd12:01:180
45199997,1cyclictest0-21swapper/012:35:480
45199997,1cyclictest0-21swapper/011:54:090
45199997,1cyclictest0-21swapper/011:47:120
45199997,1cyclictest0-21swapper/009:09:170
45199997,1cyclictest0-21swapper/008:55:530
45199997,1cyclictest0-21swapper/008:15:020
45199997,1cyclictest0-21swapper/008:05:210
45199997,1cyclictest0-21swapper/007:29:110
45199990,8cyclictest0-21swapper/007:49:510
45199990,1cyclictest0-21swapper/011:36:420
45199990,1cyclictest0-21swapper/009:57:050
45389987,0cyclictest0-21swapper/307:55:143
45389986,1cyclictest0-21swapper/312:26:583
45389986,1cyclictest0-21swapper/308:22:023
45389986,1cyclictest0-21swapper/307:49:543
45389980,7cyclictest0-21swapper/310:20:533
45389980,7cyclictest0-21swapper/309:00:563
45389980,7cyclictest0-21swapper/308:28:203
45389980,7cyclictest0-21swapper/307:14:423
45319986,1cyclictest33-21ksoftirqd/210:10:012
45319986,1cyclictest17929-21snmpd09:16:232
45319986,1cyclictest17929-21snmpd08:09:062
45319986,1cyclictest0-21swapper/211:08:142
45319986,1cyclictest0-21swapper/209:39:452
45319986,1cyclictest0-21swapper/209:27:192
45319986,1cyclictest0-21swapper/207:54:482
45319980,1cyclictest0-21swapper/212:23:002
45249986,1cyclictest0-21swapper/109:10:361
45249986,1cyclictest0-21swapper/107:34:421
45249986,1cyclictest0-21swapper/107:13:121
45249985,2cyclictest24021-21kworker/1:109:35:371
45249985,2cyclictest22855-21kworker/1:112:15:101
45249985,2cyclictest11065-21kworker/1:108:11:251
45249980,1cyclictest0-21swapper/107:22:251
45199986,1cyclictest0-21swapper/012:16:460
45199986,1cyclictest0-21swapper/011:05:320
45199986,1cyclictest0-21swapper/007:39:120
45199980,7cyclictest0-21swapper/010:47:270
45199980,1cyclictest0-21swapper/010:58:260
45389977,0cyclictest17601-21awk07:30:073
45389975,1cyclictest22831-21munin-plugin-st12:10:003
45389975,1cyclictest17929-21snmpd10:18:423
45389975,1cyclictest17929-21snmpd07:22:053
45389975,1cyclictest0-21swapper/312:04:023
45389975,1cyclictest0-21swapper/311:50:093
45389975,1cyclictest0-21swapper/311:41:263
45389975,1cyclictest0-21swapper/311:39:203
45389975,1cyclictest0-21swapper/311:21:543
45389975,1cyclictest0-21swapper/311:03:583
45389975,1cyclictest0-21swapper/310:47:203
45389975,1cyclictest0-21swapper/310:33:273
45389975,1cyclictest0-21swapper/310:33:273
45389975,1cyclictest0-21swapper/310:14:443
45389975,1cyclictest0-21swapper/309:16:273
45389975,1cyclictest0-21swapper/309:13:133
45389975,1cyclictest0-21swapper/308:10:153
45389970,6cyclictest0-21swapper/312:36:593
45389970,6cyclictest0-21swapper/308:41:343
45389970,6cyclictest0-21swapper/308:37:033
45389970,1cyclictest0-21swapper/309:59:343
45389970,1cyclictest0-21swapper/307:39:153
45319975,1cyclictest33-21ksoftirqd/209:10:002
45319975,1cyclictest17929-21snmpd11:49:382
45319975,1cyclictest0-21swapper/210:41:162
45319975,1cyclictest0-21swapper/210:20:462
45319975,1cyclictest0-21swapper/207:34:272
45319975,1cyclictest0-21swapper/207:16:522
45319972,1cyclictest23445-21/usr/share/muni08:35:002
45319970,6cyclictest0-21swapper/208:12:142
45249976,0cyclictest0-21swapper/111:20:051
45249975,2cyclictest3197-21kworker/1:009:50:121
45249975,2cyclictest31174-21kworker/1:011:30:541
45249975,1cyclictest303602chrt10:32:471
45249975,1cyclictest303602chrt10:32:471
45249975,1cyclictest2247-21kworker/1:208:00:151
45249975,1cyclictest20451-21kworker/1:008:35:311
45249975,1cyclictest0-21swapper/111:00:041
45249975,1cyclictest0-21swapper/110:43:071
45249975,1cyclictest0-21swapper/109:30:181
45249975,1cyclictest0-21swapper/108:30:041
45249975,0cyclictest6035-21kworker/1:009:01:171
45249974,2cyclictest6035-21kworker/1:009:15:331
45249974,2cyclictest31994-21kworker/1:108:50:051
45249974,2cyclictest26528-21kworker/1:208:40:291
45249974,2cyclictest16279-21kworker/1:212:00:021
45249974,2cyclictest10603-21kworker/1:007:25:291
45249974,2cyclictest10299-21kworker/1:011:55:411
45249973,3cyclictest9405-21kworker/1:110:00:271
45249973,3cyclictest5571-21kworker/1:008:05:331
45249970,6cyclictest0-21swapper/112:05:571
45249970,6cyclictest0-21swapper/111:38:101
45249970,6cyclictest0-21swapper/110:26:191
45249970,6cyclictest0-21swapper/108:27:581
45199977,0cyclictest17929-21snmpd07:12:530
45199975,1cyclictest17929-21snmpd08:33:310
45199975,1cyclictest0-21swapper/010:51:010
45199975,1cyclictest0-21swapper/010:15:100
45199975,1cyclictest0-21swapper/009:10:450
45199975,1cyclictest0-21swapper/007:23:510
45199975,1cyclictest0-21swapper/007:15:570
45199973,3cyclictest28237-21cat08:40:160
45199970,6cyclictest0-21swapper/010:13:430
30849270,1sleep30-21swapper/311:27:003
45389965,1cyclictest17929-21snmpd08:05:333
45389964,1cyclictest32683-21/usr/share/muni08:50:003
45389964,1cyclictest17929-21snmpd11:57:573
45389964,1cyclictest0-21swapper/309:24:403
45389963,2cyclictest752-21dbus-daemon07:26:053
45389963,2cyclictest17929-21snmpd10:08:183
45389963,2cyclictest17929-21snmpd09:25:173
45389963,2cyclictest0-21swapper/309:05:323
45319966,0cyclictest17929-21snmpd12:27:212
45319965,1cyclictest17929-21snmpd11:40:592
45319964,1cyclictest17929-21snmpd09:40:112
45319964,1cyclictest17929-21snmpd09:00:132
45319963,2cyclictest752-21dbus-daemon07:35:452
45319963,2cyclictest17929-21snmpd12:17:152
45319963,2cyclictest17929-21snmpd08:45:042
45319963,2cyclictest17929-21snmpd08:36:372
45319962,1cyclictest0-21swapper/209:10:022
45249964,2cyclictest4848-21kworker/1:311:45:361
45249964,2cyclictest17624-21kworker/1:209:24:131
45249964,2cyclictest1195-21kworker/1:010:55:541
45249964,2cyclictest1195-21kworker/1:010:50:421
45249964,2cyclictest10603-21kworker/1:007:17:411
45249964,2cyclictest10299-21kworker/1:011:53:061
45249964,1cyclictest31410-21kworker/1:007:55:111
45249964,1cyclictest29116-21/usr/share/muni07:50:001
45249964,1cyclictest24594-21polkitd11:09:541
45249964,1cyclictest16946-21kworker/1:307:35:421
45249964,1cyclictest13171-21kworker/1:211:10:321
45249963,2cyclictest17929-21snmpd09:43:451
45249963,2cyclictest14170-21kworker/1:208:20:011
45249962,3cyclictest24021-21kworker/1:109:45:071
45249960,1cyclictest0-21swapper/109:59:411
45249960,1cyclictest0-21swapper/108:46:231
45199965,1cyclictest17929-21snmpd09:45:450
45199964,1cyclictest0-21swapper/011:28:000
45199963,2cyclictest752-21dbus-daemon11:25:000
45199963,2cyclictest752-21dbus-daemon08:52:000
45199963,2cyclictest17929-21snmpd08:27:120
45199963,2cyclictest17929-21snmpd07:32:500
45199963,2cyclictest14012-21munin-update11:55:000
45199962,1cyclictest22280-31munin-html12:05:310
24309260,4sleep30-21swapper/307:40:143
24309260,4sleep30-21swapper/307:40:143
45389953,1cyclictest87950irq/34-eno2-rx-10:35:153
45389953,1cyclictest752-21dbus-daemon12:10:013
45389953,1cyclictest4863-21awk12:30:273
45389953,1cyclictest17929-21snmpd09:40:263
45389953,1cyclictest0-21swapper/307:15:093
45389952,2cyclictest8041-21/usr/share/muni11:45:023
45389952,2cyclictest20469-21/usr/share/muni08:30:023
45389952,2cyclictest10470-21sendmail_mailst10:55:013
45319953,1cyclictest4775-21cat10:45:052
45319953,1cyclictest32034-21check_http10:35:112
45319953,1cyclictest17929-21snmpd07:10:012
45319952,2cyclictest6141-31munin-graph09:50:362
45319952,2cyclictest25809-21wc11:20:042
45319951,3cyclictest0-21swapper/210:55:142
45249954,0cyclictest18689-21kworker/1:210:35:091
45249953,1cyclictest932-21cat12:25:131
45249953,1cyclictest87650irq/28-eno1-rx-12:10:291
45249953,1cyclictest29526-21grep11:25:111
45249953,1cyclictest12560-21kworker/1:010:05:041
45199953,1cyclictest31173-21cat10:35:070
45199953,1cyclictest29918-21awk07:50:090
45199953,1cyclictest27284-21/usr/share/muni09:35:000
45199953,1cyclictest23420-21cat07:40:060
45199953,1cyclictest23420-21cat07:40:060
45199953,1cyclictest19964-21cat11:10:060
45199953,1cyclictest0-21swapper/011:30:050
45199952,1cyclictest442-21cpuspeed_turbos12:25:100
45199950,3cyclictest1825-21wc10:40:050
45199950,1cyclictest23305-31munin-html09:25:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional