You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-04 - 15:49

x86 Intel Xeon E3-1220 @3100 MHz, Linux 4.19.1-rt3 (Profile)

Latency plot of system in rack #2, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Sun Dec 04, 2022 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3165021010,1sleep0590099cyclictest11:36:220
158562550,0sleep30-21swapper/311:56:353
122562540,0sleep30-21swapper/309:55:173
274462500,0sleep00-21swapper/012:39:570
18742500,0sleep30-21swapper/309:12:353
129572480,0sleep30-21swapper/310:35:213
151852420,0sleep20-21swapper/209:15:422
551523524,7sleep10-21swapper/107:06:331
544523412,7sleep20-21swapper/207:05:422
400622816,7sleep00-21swapper/007:05:120
552222413,7sleep30-21swapper/307:06:393
82442200,0sleep30-21swapper/310:58:283
135052170,0sleep00-21swapper/010:59:520
12292160,0sleep20-21swapper/209:28:272
298702150,0sleep30-21swapper/311:03:533
260572150,1sleep30-21swapper/310:46:433
91792140,0sleep20-21swapper/210:58:422
297172140,0sleep129718-21unixbench_singl10:15:241
262032140,0sleep10-21swapper/110:14:531
178572140,0sleep00-21swapper/007:35:190
5907991312,0cyclictest33150irq/27-ahci[00009:57:401
5907991311,1cyclictest3891-21lspci10:57:181
261432130,0sleep10-21swapper/109:18:371
200172130,0sleep30-21swapper/311:49:513
94882120,0sleep3391rcuc/310:10:303
590799120,11cyclictest29947-21tty11:44:121
590799120,11cyclictest0-21swapper/111:12:321
590099120,1cyclictest573-17auditd10:26:100
5920991110,0cyclictest0-21swapper/309:43:173
592099110,10cyclictest0-21swapper/312:34:573
592099110,10cyclictest0-21swapper/312:17:083
592099110,10cyclictest0-21swapper/310:15:473
592099110,10cyclictest0-21swapper/309:46:283
591199119,1cyclictest0-21swapper/210:02:422
5911991110,0cyclictest31990-21sshd12:16:422
5911991110,0cyclictest0-21swapper/209:24:122
591199110,10cyclictest0-21swapper/209:35:522
5907991111,0cyclictest33150irq/27-ahci[00012:24:441
5907991110,0cyclictest4122-21lspci11:45:321
590799110,1cyclictest18795-21lspci11:57:211
590099110,10cyclictest24630-21lspci09:42:090
590099110,10cyclictest0-21swapper/010:40:200
592099109,0cyclictest0-21swapper/310:03:173
592099109,0cyclictest0-21swapper/309:34:383
592099100,0cyclictest0-21swapper/311:41:573
592099100,0cyclictest0-21swapper/311:30:373
592099100,0cyclictest0-21swapper/310:33:283
592099100,0cyclictest0-21swapper/310:08:273
591199109,0cyclictest0-21swapper/210:05:212
591199100,9cyclictest0-21swapper/211:37:022
591199100,9cyclictest0-21swapper/208:57:122
591199100,0cyclictest0-21swapper/212:05:412
590799109,0cyclictest29086-21lspci12:08:021
590799109,0cyclictest0-21swapper/111:26:121
590799109,0cyclictest0-21swapper/110:36:021
590799109,0cyclictest0-21swapper/110:33:411
590799109,0cyclictest0-21swapper/110:20:411
590799109,0cyclictest0-21swapper/109:23:121
590099109,0cyclictest0-21swapper/012:11:190
590099109,0cyclictest0-21swapper/011:18:100
590099109,0cyclictest0-21swapper/009:48:300
590099108,1cyclictest0-21swapper/009:15:090
590099102,4cyclictest7881-21idleruntime-cro07:15:010
590099100,9cyclictest0-21swapper/011:47:190
590099100,9cyclictest0-21swapper/010:45:590
590099100,9cyclictest0-21swapper/010:23:590
590099100,0cyclictest0-21swapper/010:19:300
590099100,0cyclictest0-21swapper/009:11:200
122342100,1sleep20-21swapper/212:03:552
59209999,0cyclictest0-21swapper/311:06:373
59209998,0cyclictest0-21swapper/312:14:583
59209998,0cyclictest0-21swapper/312:03:583
59209998,0cyclictest0-21swapper/311:21:383
59209998,0cyclictest0-21swapper/310:20:283
59209998,0cyclictest0-21swapper/309:15:373
59209998,0cyclictest0-21swapper/309:01:073
59209998,0cyclictest0-21swapper/307:20:283
59209990,0cyclictest0-21swapper/307:15:573
59119998,0cyclictest0-21swapper/212:24:512
59119998,0cyclictest0-21swapper/212:14:322
59119998,0cyclictest0-21swapper/211:32:312
59119998,0cyclictest0-21swapper/211:25:422
59119998,0cyclictest0-21swapper/211:21:122
59119998,0cyclictest0-21swapper/211:07:112
59119998,0cyclictest0-21swapper/210:52:122
59119998,0cyclictest0-21swapper/210:49:322
59119998,0cyclictest0-21swapper/207:14:122
59119996,2cyclictest614-21dbus-daemon10:21:082
59119991,1cyclictest131rcu_sched10:14:192
59119990,8cyclictest22857-21kworker/2:209:44:012
59079998,0cyclictest0-21swapper/112:36:531
59079998,0cyclictest0-21swapper/112:10:321
59079998,0cyclictest0-21swapper/111:17:121
59079998,0cyclictest0-21swapper/111:07:511
59079998,0cyclictest0-21swapper/108:31:311
59079997,1cyclictest17483-21bash11:00:321
59079996,2cyclictest598-21avahi-daemon09:26:301
59079990,0cyclictest0-21swapper/111:50:521
59079990,0cyclictest0-21swapper/108:54:311
59009998,0cyclictest0-21swapper/012:27:500
59009998,0cyclictest0-21swapper/010:30:290
59009998,0cyclictest0-21swapper/010:12:300
59009990,0cyclictest0-21swapper/012:31:400
59209987,0cyclictest0-21swapper/312:36:583
59209987,0cyclictest0-21swapper/311:26:083
59209985,2cyclictest598-21avahi-daemon11:14:593
59209985,2cyclictest598-21avahi-daemon10:53:513
59209985,2cyclictest598-21avahi-daemon10:43:463
59209985,2cyclictest598-21avahi-daemon10:26:033
59119987,0cyclictest0-21swapper/212:30:412
59119987,0cyclictest0-21swapper/211:46:022
59119987,0cyclictest0-21swapper/210:26:422
59119987,0cyclictest0-21swapper/210:17:412
59119987,0cyclictest0-21swapper/209:48:522
59119985,2cyclictest598-21avahi-daemon12:26:532
59119985,2cyclictest598-21avahi-daemon11:44:352
59119985,2cyclictest598-21avahi-daemon11:16:252
59119985,2cyclictest598-21avahi-daemon09:14:442
59119981,1cyclictest131rcu_sched11:04:412
59079986,1cyclictest598-21avahi-daemon11:22:561
59079986,1cyclictest5694-21lspci09:37:301
59079986,1cyclictest1-21systemd11:33:011
59079985,2cyclictest598-21avahi-daemon12:17:531
59079985,2cyclictest598-21avahi-daemon10:51:261
59079985,2cyclictest598-21avahi-daemon09:48:551
59079985,2cyclictest598-21avahi-daemon09:34:391
59079985,2cyclictest598-21avahi-daemon09:11:331
59009987,0cyclictest27857-21ntpq08:00:200
59009987,0cyclictest0-21swapper/011:06:290
59009987,0cyclictest0-21swapper/009:34:090
59009985,2cyclictest598-21avahi-daemon12:07:430
59009985,2cyclictest598-21avahi-daemon11:33:140
59009985,2cyclictest598-21avahi-daemon11:11:370
59009985,2cyclictest598-21avahi-daemon10:50:170
59009985,2cyclictest598-21avahi-daemon10:09:120
59009985,2cyclictest598-21avahi-daemon10:03:130
59009985,2cyclictest598-21avahi-daemon09:58:350
59009985,2cyclictest598-21avahi-daemon09:50:330
59009985,2cyclictest598-21avahi-daemon09:36:580
59209975,1cyclictest598-21avahi-daemon11:52:333
59209975,1cyclictest598-21avahi-daemon11:35:123
59209975,1cyclictest598-21avahi-daemon09:50:573
59209975,1cyclictest598-21avahi-daemon09:20:093
59209974,2cyclictest616-21gdbus12:05:333
59209974,2cyclictest614-21dbus-daemon11:16:563
59209974,2cyclictest598-21avahi-daemon12:28:463
59209974,2cyclictest598-21avahi-daemon12:20:293
59209974,2cyclictest598-21avahi-daemon09:28:493
59209970,6cyclictest0-21swapper/308:20:083
59119975,1cyclictest598-21avahi-daemon11:51:202
59119975,1cyclictest598-21avahi-daemon10:37:472
59119975,1cyclictest598-21avahi-daemon09:51:142
59119975,1cyclictest33-21ksoftirqd/208:50:002
59119974,2cyclictest598-21avahi-daemon10:41:202
59119974,2cyclictest598-21avahi-daemon09:30:292
59119972,1cyclictest33-21ksoftirqd/211:56:312
59119971,1cyclictest131rcu_sched12:36:042
59119971,1cyclictest131rcu_sched10:30:372
59119970,1cyclictest33-21ksoftirqd/211:10:382
59119970,1cyclictest131rcu_sched09:58:182
59079975,1cyclictest598-21avahi-daemon12:31:481
59079975,1cyclictest598-21avahi-daemon12:27:071
59079975,1cyclictest598-21avahi-daemon12:00:421
59079975,1cyclictest598-21avahi-daemon10:48:551
59079975,1cyclictest598-21avahi-daemon10:41:171
59079975,1cyclictest598-21avahi-daemon10:25:131
59079975,1cyclictest598-21avahi-daemon10:08:281
59079975,1cyclictest598-21avahi-daemon10:02:381
59079975,1cyclictest598-21avahi-daemon09:50:571
59079975,1cyclictest598-21avahi-daemon09:43:481
59079975,1cyclictest25-21ksoftirqd/107:45:001
59079974,2cyclictest643-21gdbus11:35:061
59009975,1cyclictest598-21avahi-daemon12:15:540
59009975,1cyclictest598-21avahi-daemon12:02:290
59009975,1cyclictest598-21avahi-daemon11:53:010
59009975,1cyclictest598-21avahi-daemon11:40:430
59009975,1cyclictest598-21avahi-daemon11:26:120
59009975,1cyclictest598-21avahi-daemon10:38:070
59009975,1cyclictest0-21swapper/011:01:400
59009974,2cyclictest614-21dbus-daemon11:20:270
59009974,2cyclictest598-21avahi-daemon09:20:200
11937270,1sleep3391rcuc/309:39:113
59209965,0cyclictest0-21swapper/308:29:173
59209963,2cyclictest970-21snmpd08:10:163
59209963,2cyclictest970-21snmpd08:10:153
59209963,2cyclictest970-21snmpd07:29:113
59209960,5cyclictest0-21swapper/308:16:573
59209960,0cyclictest0-21swapper/308:36:173
59119965,0cyclictest13885-21threads07:25:212
59119965,0cyclictest0-21swapper/208:10:122
59119965,0cyclictest0-21swapper/208:10:112
59119965,0cyclictest0-21swapper/208:02:322
59119964,1cyclictest614-21dbus-daemon09:09:592
59119964,1cyclictest614-21dbus-daemon08:25:012
59119964,1cyclictest5192-21grep08:25:142
59119962,1cyclictest0-21swapper/207:15:562
59119961,1cyclictest131rcu_sched07:40:012
59119960,5cyclictest12493-21kworker/2:107:33:102
59079963,2cyclictest970-21snmpd08:05:481
59009964,1cyclictest633-21polkitd12:21:220
59009964,1cyclictest614-21dbus-daemon11:55:000
59009964,1cyclictest23821-21sshd09:25:510
59009963,2cyclictest970-21snmpd08:51:130
59009963,2cyclictest970-21snmpd07:54:570
59009960,5cyclictest0-21swapper/007:15:590
59209954,0cyclictest0-21swapper/308:30:483
59209953,1cyclictest970-21snmpd08:56:233
59209953,1cyclictest970-21snmpd08:52:493
59209953,1cyclictest970-21snmpd07:51:533
59209953,1cyclictest970-21snmpd07:46:333
59209953,1cyclictest970-21snmpd07:40:533
59209953,1cyclictest970-21snmpd07:34:203
59209953,1cyclictest970-21snmpd07:10:593
59209953,1cyclictest966-21runrttasks08:40:103
59209953,1cyclictest30122-21grep08:05:203
59209953,1cyclictest27487-21cat08:00:183
59209953,1cyclictest25280-21tail07:55:143
59209953,1cyclictest21615-21cat09:05:143
59209953,1cyclictest13427-21cat08:45:153
59209953,1cyclictest1071-21lldpd07:35:133
59119953,1cyclictest970-21snmpd08:51:282
59119953,1cyclictest970-21snmpd08:42:402
59119953,1cyclictest970-21snmpd08:38:192
59119953,1cyclictest970-21snmpd08:30:102
59119953,1cyclictest970-21snmpd07:55:352
59119953,1cyclictest970-21snmpd07:41:022
59119953,1cyclictest4421-21sendmail07:48:142
59119953,1cyclictest29528-21cat08:05:152
59119953,1cyclictest23380-21cat07:50:172
59119952,1cyclictest33-21ksoftirqd/208:15:002
59119950,0cyclictest0-21swapper/209:00:412
59079954,0cyclictest0-21swapper/108:21:021
59079954,0cyclictest0-21swapper/107:30:211
59079953,1cyclictest970-21snmpd09:08:521
59079953,1cyclictest970-21snmpd09:00:201
59079953,1cyclictest970-21snmpd08:47:351
59079953,1cyclictest970-21snmpd08:41:221
59079953,1cyclictest970-21snmpd08:37:441
59079953,1cyclictest970-21snmpd08:16:301
59079953,1cyclictest970-21snmpd08:02:161
59079953,1cyclictest970-21snmpd07:45:291
59079953,1cyclictest970-21snmpd07:35:061
59079953,1cyclictest970-21snmpd07:25:511
59079953,1cyclictest966-21runrttasks08:57:441
59079953,1cyclictest598-21avahi-daemon07:18:341
59079953,1cyclictest4421-21sendmail07:21:201
59079950,4cyclictest0-21swapper/107:58:211
59079950,4cyclictest0-21swapper/107:13:521
59009954,0cyclictest0-21swapper/008:41:490
59009953,1cyclictest970-21snmpd09:00:530
59009953,1cyclictest970-21snmpd08:32:120
59009953,1cyclictest970-21snmpd08:20:430
59009953,1cyclictest970-21snmpd07:45:500
59009953,1cyclictest970-21snmpd07:25:270
59009953,1cyclictest633-21polkitd08:20:000
59009953,1cyclictest598-21avahi-daemon07:30:520
59009953,1cyclictest5526-21cut08:25:170
59009953,1cyclictest4421-21sendmail08:57:340
59009953,1cyclictest11205-21cat07:20:160
59009952,2cyclictest970-21snmpd07:41:320
59009952,2cyclictest25970-21gunzip07:55:190
59009952,2cyclictest10553-21chrt08:38:210
59009950,4cyclictest29032-21sshd08:05:100
59009950,4cyclictest0-21swapper/009:05:490
59009950,0cyclictest0-21swapper/008:48:300
59119942,1cyclictest71350irq/25-eno1-tx-07:20:152
59079942,1cyclictest31074-21/usr/sbin/munin08:10:151
59079942,1cyclictest31074-21/usr/sbin/munin08:10:141
59079942,1cyclictest0-21swapper/108:25:121
59079942,1cyclictest0-21swapper/107:50:161
59009944,0cyclictest30817-21kworker/0:108:10:090
59009944,0cyclictest30817-21kworker/0:108:10:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional