You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-14 - 04:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Fri Jun 14, 2024 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
327022990,0sleep232701-21sshd21:19:482
187072990,2sleep3584299cyclictest23:02:233
53782930,0sleep20-21swapper/222:34:182
285612600,0sleep20-21swapper/221:10:272
112512580,1sleep311243-21lspci21:56:183
132722570,1sleep213273-21bash00:28:292
61322550,1sleep36126-21lspci21:20:173
38422550,1sleep00-21swapper/000:13:210
317142550,0sleep20-21swapper/222:36:422
250902540,0sleep30-21swapper/300:18:523
122932540,0sleep10-21swapper/121:50:271
292512530,0sleep00-21swapper/022:12:450
283212530,1sleep228311-21sshd22:03:502
283212530,1sleep228311-21sshd22:03:492
135202530,0sleep20-21swapper/222:20:122
40062520,0sleep10-21swapper/122:52:071
27432520,0sleep20-21swapper/221:37:472
247762520,1sleep124772-21lspci00:18:511
226782520,1sleep122677-21sshd00:29:281
116472510,0sleep00-21swapper/020:40:180
3802500,0sleep20-21swapper/223:48:202
3802500,0sleep20-21swapper/223:48:202
78332490,0sleep10-21swapper/123:40:011
58542490,1sleep35859-21grep21:38:043
286632480,0sleep00-21swapper/021:46:060
202702480,0sleep20-21swapper/200:14:592
106902480,0sleep10-21swapper/122:46:471
305232470,0sleep00-21swapper/021:52:100
248062470,0sleep10-21swapper/121:10:061
200432470,0sleep30-21swapper/323:26:143
228832460,0sleep2311rcuc/223:02:462
152572410,1sleep01-21systemd22:38:120
188012370,0sleep10-21swapper/121:57:001
121992340,1sleep012200-21bash21:35:360
55712308,7sleep30-21swapper/319:08:163
561722817,7sleep00-21swapper/019:08:500
54712287,7sleep10-21swapper/119:07:021
555522211,7sleep20-21swapper/219:08:032
3022200,1sleep1646-21dbus-daemon00:23:181
227002200,0sleep10-21swapper/123:02:451
92162170,0sleep00-21swapper/023:46:050
92162170,0sleep00-21swapper/023:46:040
38662170,0sleep20-21swapper/221:40:462
72392160,1sleep1231rcuc/123:34:001
274842160,0sleep00-21swapper/000:09:190
108322160,1sleep110825-21sshd22:16:591
59012150,0sleep20-21swapper/221:20:162
56152150,0sleep00-21swapper/021:40:560
46662150,0sleep10-21swapper/100:13:261
40782150,1sleep3620-13audispd23:15:433
24662150,0sleep00-21swapper/021:11:010
221272150,0sleep00-21swapper/023:44:210
105192150,0sleep20-21swapper/200:20:482
5827991413,0cyclictest0-21swapper/100:07:591
324822140,0sleep00-21swapper/022:15:560
303762140,0sleep030375-21bash23:30:100
297272140,0sleep329725-21lspci21:10:313
155492140,0sleep3391rcuc/321:18:133
13062140,0sleep0111rcuc/023:27:310
119602140,0sleep10-21swapper/100:38:571
5842991311,1cyclictest9282-21systemd-cgroups22:10:523
582799130,12cyclictest0-21swapper/122:13:391
582199130,12cyclictest0-21swapper/000:30:130
44352130,3sleep14431-21lspci22:04:371
44352130,3sleep14431-21lspci22:04:361
5842991210,1cyclictest2444-21grepconf.sh22:19:133
584299120,11cyclictest0-21swapper/322:46:133
583499120,1cyclictest700-21gdbus22:56:512
583499120,1cyclictest32374-21bash00:00:112
583499120,11cyclictest619-17sedispatch23:13:012
583499120,0cyclictest0-21swapper/223:35:212
5827991211,0cyclictest0-21swapper/121:40:481
5827991210,1cyclictest31331-21sshd23:15:201
5827991210,1cyclictest18067-21sshd23:55:501
5827991210,1cyclictest18067-21sshd23:55:501
5827991210,1cyclictest0-21swapper/123:23:101
5821991210,1cyclictest8181-21bash22:07:530
5821991210,1cyclictest648-21systemd-logind22:41:220
5821991210,1cyclictest12283-21sshd23:52:230
5821991210,1cyclictest12283-21sshd23:52:220
582199120,1cyclictest30266-21sshd22:51:330
582199120,1cyclictest17182-21sshd22:47:230
582199120,11cyclictest11301-21sshd00:38:530
584299119,1cyclictest0-21swapper/323:21:333
584299119,1cyclictest0-21swapper/321:30:233
584299119,1cyclictest0-21swapper/300:33:223
5842991110,0cyclictest16409-21sshd22:29:223
584299110,10cyclictest2358-21lspci00:23:333
584299110,10cyclictest0-21swapper/321:43:533
584299110,10cyclictest0-21swapper/300:25:233
584299110,10cyclictest0-21swapper/300:03:233
583499119,1cyclictest25950-21sshd00:33:102
5834991110,0cyclictest0-21swapper/221:57:112
583499110,1cyclictest24355-21sshd23:53:312
583499110,1cyclictest24355-21sshd23:53:302
583499110,10cyclictest0-21swapper/221:46:412
582799119,1cyclictest20566-21lspci21:36:241
5827991110,0cyclictest0-21swapper/123:06:191
5827991110,0cyclictest0-21swapper/122:36:591
582799110,10cyclictest0-21swapper/123:39:301
582799110,10cyclictest0-21swapper/121:00:381
582799110,0cyclictest0-21swapper/122:44:491
582199110,10cyclictest0-21swapper/023:24:320
582199110,10cyclictest0-21swapper/000:02:430
582199110,0cyclictest0-21swapper/021:23:430
584299109,0cyclictest0-21swapper/322:32:233
584299109,0cyclictest0-21swapper/322:05:333
584299100,9cyclictest0-21swapper/323:39:433
584299100,0cyclictest0-21swapper/323:33:033
584299100,0cyclictest0-21swapper/300:35:533
583499109,0cyclictest0-21swapper/223:40:102
583499109,0cyclictest0-21swapper/223:16:002
583499109,0cyclictest0-21swapper/222:53:502
583499109,0cyclictest0-21swapper/220:25:212
583499109,0cyclictest0-21swapper/200:16:012
582799109,0cyclictest24093-21lspci21:27:511
582799109,0cyclictest0-21swapper/123:12:201
582799109,0cyclictest0-21swapper/122:21:591
582799109,0cyclictest0-21swapper/122:09:291
582799109,0cyclictest0-21swapper/121:49:291
582799109,0cyclictest0-21swapper/121:30:491
582799109,0cyclictest0-21swapper/121:22:191
582799101,1cyclictest131rcu_sched22:28:021
582799100,0cyclictest0-21swapper/122:56:101
582799100,0cyclictest0-21swapper/122:33:591
582199109,0cyclictest0-21swapper/022:33:330
582199109,0cyclictest0-21swapper/022:27:330
582199100,0cyclictest0-21swapper/000:26:330
291252100,0sleep30-21swapper/322:42:283
58429998,0cyclictest0-21swapper/323:51:133
58429998,0cyclictest0-21swapper/323:51:133
58429998,0cyclictest0-21swapper/323:46:233
58429998,0cyclictest0-21swapper/323:46:233
58429998,0cyclictest0-21swapper/323:10:433
58429998,0cyclictest0-21swapper/322:35:223
58429997,1cyclictest12411-21sshd23:07:433
58429997,1cyclictest1-21systemd22:54:323
58349997,1cyclictest27945-21sshd22:15:312
58349997,1cyclictest0-21swapper/223:28:412
58349997,1cyclictest0-21swapper/222:46:412
58349997,1cyclictest0-21swapper/200:08:402
58279998,0cyclictest29455-21systemd-cgroups23:54:001
58279998,0cyclictest29455-21systemd-cgroups23:53:591
58279998,0cyclictest0-21swapper/123:28:001
58279998,0cyclictest0-21swapper/120:01:481
58219998,0cyclictest0-21swapper/022:24:330
58219998,0cyclictest0-21swapper/021:18:520
58219997,1cyclictest26797-21lspci21:34:020
58219996,2cyclictest6525-21kworker/0:023:36:010
58219996,2cyclictest23366-21kworker/0:321:25:130
58219990,8cyclictest25138-21sshd23:08:530
5297290,0sleep10-21swapper/100:00:361
21573290,1sleep0101ktimersoftd/021:05:160
58429987,0cyclictest0-21swapper/322:23:233
58429986,1cyclictest31455-21lspci21:28:323
58429985,2cyclictest4121-21sshd21:52:423
58429984,3cyclictest700-21gdbus23:41:433
58349987,0cyclictest0-21swapper/223:23:512
58349987,0cyclictest0-21swapper/221:33:212
58349986,1cyclictest649-21avahi-daemon22:42:472
58349986,1cyclictest4338-21lspci23:30:412
58349986,1cyclictest29519-21lspci21:25:212
58349984,2cyclictest15571-21sshd00:35:382
58349983,2cyclictest15911-21sshd23:58:392
58349983,2cyclictest15911-21sshd23:58:382
58279987,0cyclictest0-21swapper/120:55:491
58279987,0cyclictest0-21swapper/120:52:481
58279987,0cyclictest0-21swapper/119:56:391
58279987,0cyclictest0-21swapper/119:13:491
58279987,0cyclictest0-21swapper/100:34:191
58279986,1cyclictest11296-21lspci23:46:171
58279986,1cyclictest11296-21lspci23:46:171
58279983,1cyclictest25-21ksoftirqd/121:17:131
58219987,0cyclictest0-21swapper/023:11:530
58219987,0cyclictest0-21swapper/022:55:430
58219987,0cyclictest0-21swapper/019:20:210
58219986,2cyclictest24799-21kworker/0:200:24:000
58219986,2cyclictest11015-21kworker/0:122:00:310
58219986,2cyclictest11015-21kworker/0:122:00:300
58219986,1cyclictest23343-21lspci23:17:330
58219985,2cyclictest24614-21kworker/0:021:57:100
58219980,4cyclictest616-17auditd20:40:010
15808280,0sleep20-21swapper/223:05:052
58429975,1cyclictest700-21gdbus00:10:193
58429975,1cyclictest30129-21lspci21:46:143
58429975,1cyclictest2985-21lspci22:55:033
58429974,2cyclictest649-21avahi-daemon23:55:413
58429974,2cyclictest649-21avahi-daemon23:55:403
58429974,2cyclictest649-21avahi-daemon22:00:473
58429974,2cyclictest649-21avahi-daemon22:00:473
58429973,3cyclictest48-21kauditd00:06:313
58349976,0cyclictest0-21swapper/220:50:212
58349974,1cyclictest16349-21sshd21:50:502
58349974,1cyclictest15278-21sshd22:26:142
58349972,2cyclictest15118-21sshd22:05:292
58349972,2cyclictest11945-21sshd22:11:072
58279976,0cyclictest0-21swapper/120:32:491
58279976,0cyclictest0-21swapper/120:24:591
58279976,0cyclictest0-21swapper/119:32:391
58219975,2cyclictest5451-21kworker/0:223:00:130
58219975,2cyclictest31191-21kworker/0:100:16:390
58219974,2cyclictest649-21avahi-daemon23:55:100
58219974,2cyclictest649-21avahi-daemon23:55:090
58429964,1cyclictest23657-21sshd21:09:553
58429963,2cyclictest17299-21snmpd19:48:563
58429962,3cyclictest13561-21sed20:45:163
58349965,0cyclictest0-21swapper/221:00:402
58349964,1cyclictest17299-21snmpd19:46:082
58349963,2cyclictest721-21gdbus21:09:592
58349963,2cyclictest17299-21snmpd20:03:302
58349963,1cyclictest33-21ksoftirqd/220:12:342
58279965,0cyclictest0-21swapper/120:46:491
58279965,0cyclictest0-21swapper/120:10:481
58279965,0cyclictest0-21swapper/119:24:381
58279964,1cyclictest10467-21wc19:20:001
58279963,2cyclictest17299-21snmpd21:06:171
58219966,0cyclictest10379-21kworker/0:219:30:210
58219963,2cyclictest17299-21snmpd20:14:100
58219963,2cyclictest17299-21snmpd20:06:030
58219963,2cyclictest17299-21snmpd20:01:020
58219960,5cyclictest0-21swapper/020:45:320
58219960,5cyclictest0-21swapper/019:16:420
58429953,1cyclictest5324-21cat20:25:153
58429953,1cyclictest22959-21cpu19:50:123
58429953,1cyclictest17661-21ls20:55:173
58429953,1cyclictest17299-21snmpd20:52:203
58429953,1cyclictest17299-21snmpd20:40:083
58429953,1cyclictest17299-21snmpd20:38:313
58429953,1cyclictest17299-21snmpd20:33:013
58429953,1cyclictest17299-21snmpd20:21:273
58429953,1cyclictest17299-21snmpd20:15:313
58429953,1cyclictest17299-21snmpd20:12:003
58429953,1cyclictest17299-21snmpd19:40:153
58429953,1cyclictest17299-21snmpd19:17:113
58429953,1cyclictest17299-21snmpd19:11:473
58429953,1cyclictest13630-21ps19:25:203
58429953,1cyclictest1058-21sendmail19:35:173
58429953,1cyclictest1034-21in:imjournal21:00:593
58429952,2cyclictest700-21gdbus19:55:003
58429952,2cyclictest30518-21taskset20:06:043
58429952,2cyclictest17299-21snmpd19:21:053
58429950,4cyclictest0-21swapper/319:34:213
58349954,0cyclictest0-21swapper/219:15:312
58349953,1cyclictest9600-21missed_timers20:35:162
58349953,1cyclictest3612-21grep20:20:172
58349953,1cyclictest29908-21ntp_kernel_pll_20:05:232
58349953,1cyclictest17299-21snmpd20:56:382
58349953,1cyclictest17299-21snmpd20:45:172
58349953,1cyclictest17299-21snmpd20:30:342
58349953,1cyclictest17299-21snmpd19:55:542
58349953,1cyclictest17299-21snmpd19:51:182
58349953,1cyclictest17299-21snmpd19:25:262
58349953,1cyclictest17299-21snmpd19:24:342
58349953,1cyclictest17299-21snmpd19:13:412
58349953,1cyclictest11511-21irqstats20:40:162
58349953,1cyclictest1109-21ntpd19:30:152
58349950,4cyclictest740-21/usr/sbin/munin20:15:172
58349950,4cyclictest18844-21/usr/sbin/munin19:40:112
58279953,1cyclictest23406-21cat19:50:151
58279953,1cyclictest18844-21/usr/sbin/munin19:40:171
58279953,1cyclictest18165-21unixbench_singl19:35:251
58279953,1cyclictest17299-21snmpd20:39:461
58279953,1cyclictest17299-21snmpd20:26:391
58279953,1cyclictest17299-21snmpd20:18:251
58279953,1cyclictest17299-21snmpd19:47:381
58279953,1cyclictest17299-21snmpd19:26:291
58279953,1cyclictest1058-21sendmail20:40:281
58219955,0cyclictest20627-21kworker/0:119:55:190
58219954,1cyclictest16559-21kworker/0:019:41:590
58219954,0cyclictest0-21swapper/020:20:020
58219954,0cyclictest0-21swapper/019:25:320
58219953,1cyclictest7410-21cat20:30:170
58219953,1cyclictest684-21polkitd19:50:010
58219953,1cyclictest19628-21cat21:00:190
58219953,1cyclictest17299-21snmpd20:50:010
58219953,1cyclictest17299-21snmpd20:26:510
58219953,1cyclictest17299-21snmpd20:19:520
58219953,1cyclictest17299-21snmpd19:48:330
58219953,1cyclictest17299-21snmpd19:37:050
58219953,1cyclictest17299-21snmpd19:10:190
58219950,4cyclictest18415-21grep20:55:260
58429942,1cyclictest26994-21runrttasks20:00:013
58349942,1cyclictest17021-21cat19:35:122
58279942,1cyclictest29123-21cpuspeed_turbos20:05:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional