You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 05:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Sun Nov 30, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2616421030,0sleep10-21swapper/121:54:121
56772930,2sleep3592599cyclictest23:39:483
136702650,0sleep1231rcuc/121:45:541
73832610,0sleep10-21swapper/123:36:321
296102600,0sleep0111rcuc/022:35:230
316352590,0sleep10-21swapper/123:22:221
132962580,0sleep10-21swapper/121:22:031
221852570,0sleep00-21swapper/022:00:310
34002560,0sleep2311rcuc/222:08:552
135702550,0sleep10-21swapper/122:53:521
135702550,0sleep10-21swapper/122:53:521
109232540,0sleep30-21swapper/300:31:373
93632530,0sleep29362-21grep22:29:582
292962510,2sleep0591099cyclictest22:48:540
252852510,0sleep025282-21sshd23:01:400
239412510,0sleep30-21swapper/323:24:573
85582500,0sleep10-21swapper/121:18:191
547425040,6sleep10-21swapper/119:05:491
144452490,0sleep30-21swapper/322:47:203
251212460,0sleep10-21swapper/122:14:381
176092460,0sleep30-21swapper/321:15:523
69582430,1sleep2592199cyclictest22:49:552
262882360,2sleep275650irq/25-eno1-tx-23:01:462
241602350,0sleep10-21swapper/122:34:571
146992340,0sleep00-21swapper/022:30:240
55062308,7sleep30-21swapper/319:06:153
54882256,4sleep00-21swapper/019:06:000
576122210,7sleep20-21swapper/219:09:232
319802210,1sleep331979-21id21:34:183
318382200,1sleep0111rcuc/022:15:180
201332190,2sleep2592199cyclictest22:34:302
70492180,0sleep00-21swapper/022:12:400
302262180,0sleep00-21swapper/023:28:550
94682170,1sleep2321ktimersoftd/200:13:222
313702170,2sleep1591699cyclictest21:37:381
123412170,1sleep2620-13audispd23:23:442
104982170,0sleep20-21swapper/222:56:482
5921991615,0cyclictest20437-21lspci23:34:382
5921991514,0cyclictest29820-21lspci21:23:512
5921991514,0cyclictest28819-21lspci21:40:432
591699150,13cyclictest29553-21sshd22:15:071
58542150,0sleep00-21swapper/023:16:220
193282150,0sleep30-21swapper/322:30:543
130082150,0sleep30-21swapper/322:50:253
130082150,0sleep30-21swapper/322:50:253
106432150,0sleep30-21swapper/322:06:103
5921991413,0cyclictest321ktimersoftd/221:17:562
5921991413,0cyclictest25151-21lspci21:33:352
5916991412,1cyclictest16866-21sshd21:42:571
326352140,0sleep20-21swapper/221:54:532
25752140,0sleep30-21swapper/322:22:293
187252140,1sleep30-21swapper/322:37:443
158932140,0sleep20-21swapper/222:37:252
15162140,0sleep00-21swapper/000:22:500
151182140,0sleep20-21swapper/221:25:372
591699130,1cyclictest648-21systemd-logind21:29:271
5925991210,1cyclictest646-21dbus-daemon00:00:433
592599120,11cyclictest0-21swapper/319:15:013
5921991210,1cyclictest31995-21sshd22:52:262
5921991210,1cyclictest31995-21sshd22:52:262
592199120,11cyclictest30178-21sshd23:12:162
592199120,11cyclictest0-21swapper/221:56:152
591699120,1cyclictest623-21bash23:25:471
591699120,11cyclictest0-21swapper/122:55:061
239202120,0sleep00-21swapper/023:35:000
210602120,0sleep20-21swapper/223:44:432
592599119,1cyclictest12680-21sshd23:10:233
592599110,10cyclictest0-21swapper/322:55:123
592599110,10cyclictest0-21swapper/321:59:423
592599110,0cyclictest0-21swapper/322:13:333
592599110,0cyclictest0-21swapper/320:05:213
592599110,0cyclictest0-21swapper/300:37:033
592199119,1cyclictest0-21swapper/222:21:052
5921991110,0cyclictest2768-21lspci00:30:382
5921991110,0cyclictest0-21swapper/223:08:152
5921991110,0cyclictest0-21swapper/222:11:552
5921991110,0cyclictest0-21swapper/221:47:552
5921991110,0cyclictest0-21swapper/200:06:462
592199110,10cyclictest0-21swapper/223:38:062
592199110,10cyclictest0-21swapper/220:01:552
592199110,10cyclictest0-21swapper/200:38:552
592199110,0cyclictest0-21swapper/222:02:162
592199110,0cyclictest0-21swapper/221:36:462
591699110,10cyclictest29551-21sshd23:15:271
591699110,10cyclictest0-21swapper/123:07:261
591699110,0cyclictest0-21swapper/100:38:461
591099113,4cyclictest24302-21idleruntime-cro00:14:590
592599109,0cyclictest0-21swapper/323:18:233
592599109,0cyclictest0-21swapper/322:02:433
592599109,0cyclictest0-21swapper/321:08:523
592199109,0cyclictest0-21swapper/223:29:262
592199109,0cyclictest0-21swapper/200:20:252
592199108,1cyclictest33-21ksoftirqd/222:17:222
592199100,0cyclictest0-21swapper/220:20:142
591699109,0cyclictest0-21swapper/123:30:561
591699109,0cyclictest0-21swapper/100:21:261
591699109,0cyclictest0-21swapper/100:03:371
591699108,1cyclictest32154-1kworker/1:2H23:59:261
591699100,0cyclictest30213-21sshd21:30:361
591099108,1cyclictest3161-21cpu21:55:130
591099106,3cyclictest29141-21kworker/0:021:35:390
59259998,0cyclictest0-21swapper/322:16:233
59259998,0cyclictest0-21swapper/321:37:133
59259998,0cyclictest0-21swapper/319:52:223
59259998,0cyclictest0-21swapper/300:26:533
59259998,0cyclictest0-21swapper/300:22:423
59259997,1cyclictest41-21ksoftirqd/323:59:493
59259997,1cyclictest28223-21lspci23:28:433
59259990,8cyclictest0-21swapper/320:39:423
59259990,8cyclictest0-21swapper/320:31:223
59259990,8cyclictest0-21swapper/320:31:213
59259990,8cyclictest0-21swapper/319:48:123
59219997,1cyclictest33-21ksoftirqd/223:55:192
59169998,0cyclictest0-21swapper/122:29:261
59169998,0cyclictest0-21swapper/122:06:471
59169998,0cyclictest0-21swapper/121:08:061
59169998,0cyclictest0-21swapper/100:25:371
59169998,0cyclictest0-21swapper/100:17:171
59169997,1cyclictest0-21swapper/100:13:061
59109998,0cyclictest0-21swapper/023:35:220
59109996,2cyclictest8188-21kworker/0:023:20:550
59109996,2cyclictest649-21avahi-daemon23:55:300
59109996,2cyclictest21731-21kworker/0:323:14:090
59109996,2cyclictest15248-21kworker/0:300:04:530
59109990,1cyclictest0-21swapper/021:29:530
59259987,0cyclictest0-21swapper/320:21:213
59259987,0cyclictest0-21swapper/319:29:113
59259987,0cyclictest0-21swapper/319:12:123
59259987,0cyclictest0-21swapper/300:18:333
59259987,0cyclictest0-21swapper/300:14:233
59259986,1cyclictest25314-21lspci22:41:513
59259986,1cyclictest21628-21lspci21:53:433
59259985,2cyclictest649-21avahi-daemon23:52:203
59259985,2cyclictest649-21avahi-daemon21:40:513
59259984,3cyclictest649-21avahi-daemon23:06:143
59259980,7cyclictest18480-21sshd21:29:303
59259980,0cyclictest0-21swapper/320:49:123
59219987,0cyclictest8547-21lspci23:53:212
59219986,1cyclictest33-21ksoftirqd/222:43:252
59219986,1cyclictest33-21ksoftirqd/221:11:482
59219986,1cyclictest33-21ksoftirqd/200:15:212
59219986,1cyclictest33-21ksoftirqd/200:01:242
59219986,1cyclictest30931-21lspci23:45:382
59219986,1cyclictest0-21swapper/223:15:062
59169986,1cyclictest6858-21lspci22:46:321
59169986,1cyclictest26919-21lspci23:01:501
59169986,1cyclictest17173-21lspci22:00:071
59169985,2cyclictest649-21avahi-daemon22:38:181
59169984,3cyclictest4535-21sshd21:10:311
59109987,0cyclictest0-21swapper/021:22:420
59109986,2cyclictest25929-21kworker/0:100:30:420
59109986,1cyclictest4412-21grep21:45:020
59109986,1cyclictest13072-21lspci22:09:580
59109985,2cyclictest649-21avahi-daemon22:29:150
59109985,2cyclictest649-21avahi-daemon21:44:410
59109980,7cyclictest0-21swapper/000:29:420
32748280,2sleep1591699cyclictest00:09:011
30215280,1sleep030166-21sshd23:52:140
21139280,1sleep1231rcuc/123:14:411
59259976,0cyclictest0-21swapper/319:21:223
59259975,1cyclictest30007-21sshd21:23:533
59259975,1cyclictest26268-21sshd23:45:153
59259975,1cyclictest15831-21lspci21:46:083
59259975,1cyclictest11924-21lspci21:11:353
59259974,2cyclictest646-21dbus-daemon23:30:533
59259974,2cyclictest15453-21sshd23:04:053
59259970,6cyclictest21840-21sshd23:41:193
59219975,1cyclictest33-21ksoftirqd/200:27:132
59219970,6cyclictest0-21swapper/219:22:552
59169975,1cyclictest8251-21lspci23:40:021
59169975,1cyclictest31539-21sshd22:42:311
59169975,1cyclictest24554-21sshd23:45:061
59169975,1cyclictest2451-21sshd00:30:361
59169974,2cyclictest649-21avahi-daemon23:50:451
59169974,2cyclictest649-21avahi-daemon22:20:281
59169974,2cyclictest649-21avahi-daemon21:57:571
59109975,2cyclictest15212-21kworker/0:021:15:040
59109975,1cyclictest620-13audispd22:57:480
59109975,1cyclictest5559-21id23:06:210
59109975,1cyclictest4747-21sshd00:19:490
59109975,1cyclictest20595-21sshd21:53:360
59109975,1cyclictest13801-21lspci21:11:500
59109974,2cyclictest649-21avahi-daemon23:46:260
59109974,2cyclictest649-21avahi-daemon22:40:380
59109974,2cyclictest649-21avahi-daemon00:05:280
59109974,2cyclictest648-21systemd-logind22:54:340
59109974,2cyclictest648-21systemd-logind22:54:330
59109974,2cyclictest20517-21sshd21:33:060
59109970,1cyclictest619-17sedispatch00:39:320
22664270,1sleep022834-21sshd22:21:110
59259965,0cyclictest0-21swapper/320:54:113
59259965,0cyclictest0-21swapper/320:17:523
59259965,0cyclictest0-21swapper/319:59:513
59259964,1cyclictest646-21dbus-daemon00:05:063
59259963,2cyclictest648-21systemd-logind22:25:043
59219965,0cyclictest0-21swapper/220:47:552
59219965,0cyclictest0-21swapper/220:15:152
59219965,0cyclictest0-21swapper/219:53:352
59219965,0cyclictest0-21swapper/219:29:252
59219964,1cyclictest25277-21sshd21:07:142
59219960,5cyclictest0-21swapper/219:31:342
59219960,0cyclictest0-21swapper/220:58:442
59219960,0cyclictest0-21swapper/220:32:242
59219960,0cyclictest0-21swapper/220:32:242
59169964,1cyclictest18380-21kworker/1:119:38:581
59169960,5cyclictest0-21swapper/119:46:351
59169960,5cyclictest0-21swapper/119:17:051
59109963,2cyclictest684-21polkitd21:06:170
59109963,2cyclictest17299-21snmpd20:44:290
59109963,2cyclictest17299-21snmpd19:35:070
59109962,3cyclictest616-13auditd23:40:080
59259954,0cyclictest0-21swapper/320:57:233
59259953,1cyclictest5270-21cat20:25:153
59259953,1cyclictest17299-21snmpd21:01:103
59259953,1cyclictest17299-21snmpd20:10:083
59259953,1cyclictest17299-21snmpd19:40:003
59259953,1cyclictest17299-21snmpd19:35:523
59259953,1cyclictest17299-21snmpd19:31:393
59259950,1cyclictest11035-21grep20:40:143
59219953,1cyclictest682-21lsmd19:35:432
59219953,1cyclictest24954-21/usr/sbin/munin19:55:192
59219953,1cyclictest17299-21snmpd21:01:312
59219953,1cyclictest17299-21snmpd20:42:352
59219953,1cyclictest17299-21snmpd20:13:142
59219953,1cyclictest17299-21snmpd20:07:042
59219953,1cyclictest17299-21snmpd19:47:552
59219953,1cyclictest17299-21snmpd19:16:082
59219953,1cyclictest17299-21snmpd19:11:542
59219953,1cyclictest14988-21/usr/sbin/munin20:50:132
59219953,1cyclictest1109-21ntpd19:40:172
59219950,4cyclictest8888-21/usr/sbin/munin20:35:162
59219950,2cyclictest6491-21sshd20:28:302
59169954,0cyclictest0-21swapper/120:50:061
59169953,1cyclictest7310-21cat20:30:161
59169953,1cyclictest7310-21cat20:30:151
59169953,1cyclictest682-21lsmd19:51:441
59169953,1cyclictest649-21avahi-daemon20:42:181
59169953,1cyclictest17299-21snmpd21:00:161
59169953,1cyclictest17299-21snmpd20:46:061
59169953,1cyclictest17299-21snmpd20:39:211
59169953,1cyclictest17299-21snmpd20:25:211
59169953,1cyclictest17299-21snmpd20:21:341
59169953,1cyclictest17299-21snmpd20:15:081
59169953,1cyclictest17299-21snmpd20:11:581
59169953,1cyclictest17299-21snmpd20:00:021
59169953,1cyclictest17299-21snmpd19:56:341
59169953,1cyclictest17299-21snmpd19:41:041
59169953,1cyclictest17299-21snmpd19:32:301
59169953,1cyclictest17299-21snmpd19:25:571
59169953,1cyclictest17299-21snmpd19:20:501
59169953,1cyclictest1058-21sendmail19:10:161
59169953,1cyclictest1053-21lldpd20:58:371
59169952,2cyclictest17299-21snmpd20:05:111
59109955,0cyclictest0-21swapper/020:15:020
59109953,1cyclictest8184-21tr19:15:010
59109953,1cyclictest7784-21pmu-power20:30:190
59109953,1cyclictest7784-21pmu-power20:30:180
59109953,1cyclictest29522-21cat20:05:170
59109953,1cyclictest19071-21expr19:40:140
59109953,1cyclictest17299-21snmpd20:56:450
59109953,1cyclictest17299-21snmpd20:45:320
59109953,1cyclictest17299-21snmpd20:20:430
59109953,1cyclictest17299-21snmpd20:01:560
59109953,1cyclictest17299-21snmpd19:56:250
59109953,1cyclictest17299-21snmpd19:25:450
59109953,1cyclictest17299-21snmpd19:20:170
59109953,1cyclictest17299-21snmpd19:10:060
59109953,1cyclictest15284-21cat19:30:160
59109952,2cyclictest31223-21wc20:10:140
59109952,2cyclictest20875-21chrt19:45:030
59109952,2cyclictest19448-21hwlatdetect21:00:160
59109952,2cyclictest17299-21snmpd20:27:410
59259942,1cyclictest27482-21cat20:00:183
59109942,1cyclictest9278-21/usr/sbin/munin20:35:150
59109942,1cyclictest23413-21cat19:50:150
59109942,1cyclictest0-21swapper/020:50:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional