You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 06:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Sun Nov 23, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
195452980,0sleep02720699cyclictest22:37:160
315152920,2sleep12721099cyclictest00:19:191
173292840,2sleep12721099cyclictest23:09:221
298752720,0sleep30-21swapper/323:00:503
276212670,0sleep227576-21sshd00:25:362
276212670,0sleep227576-21sshd00:25:362
216232660,2sleep2321ktimersoftd/200:38:422
66242650,0sleep20-21swapper/223:56:292
302212630,0sleep10-21swapper/100:22:301
209352620,0sleep00-21swapper/023:28:540
267292610,1sleep326732-21bash23:48:483
101862600,0sleep20-21swapper/221:16:112
251532590,0sleep10-21swapper/122:31:201
222022580,0sleep20-21swapper/221:36:392
263462560,0sleep10-21swapper/123:03:481
189762550,0sleep118911-21sshd21:52:201
156792550,0sleep30-21swapper/321:16:443
131742550,0sleep00-21swapper/023:37:440
11962530,0sleep30-21swapper/321:31:223
242152520,0sleep30-21swapper/323:22:493
140452500,0sleep30-21swapper/323:05:423
123172500,0sleep312315-21lspci21:48:283
306542490,0sleep30-21swapper/322:44:483
71862480,0sleep00-21swapper/021:47:570
284632470,0sleep10-21swapper/122:28:281
228722470,2sleep02720699cyclictest23:09:560
197352470,0sleep30-21swapper/322:21:093
2677724635,7sleep20-21swapper/219:05:592
93462440,2sleep02720699cyclictest00:00:020
144012430,1sleep01095-21nfsd22:43:090
13102420,0sleep00-21swapper/022:45:050
201102360,2sleep02720699cyclictest21:14:010
269522319,7sleep00-21swapper/019:08:050
2661322411,7sleep30-21swapper/319:05:243
250622240,1sleep225065-21bash22:50:352
2681822210,7sleep10-21swapper/119:06:311
85022210,0sleep30-21swapper/321:57:423
69392190,1sleep1231rcuc/123:33:571
49892190,0sleep3401ktimersoftd/322:35:473
321872190,1sleep30-21swapper/321:21:373
238032190,1sleep00-21swapper/022:34:310
58772180,1sleep15873-21lspci00:09:571
245742180,0sleep00-21swapper/022:21:380
165642180,1sleep1241ktimersoftd/123:25:151
134792180,1sleep21095-21nfsd21:48:352
74622170,2sleep32721999cyclictest21:35:163
183342170,1sleep018338-21bash23:47:570
282542160,2sleep22721799cyclictest23:35:572
233892160,0sleep20-21swapper/222:24:482
21292160,0sleep10-21swapper/100:02:361
143532150,1sleep214349-21lspci22:17:272
6762140,0sleep20-21swapper/221:28:092
310342140,0sleep20-21swapper/223:10:382
242792140,0sleep2321ktimersoftd/223:32:262
220122140,0sleep022007-21sshd23:19:250
141782140,0sleep10-21swapper/122:14:181
27219991311,1cyclictest28577-21grep00:39:283
2721999130,1cyclictest3962-21sshd22:51:473
2721099131,11cyclictest25-21ksoftirqd/122:00:241
2721099130,1cyclictest18792-21sshd21:39:341
2721099130,12cyclictest0-21swapper/121:10:351
251352130,1sleep225137-21bash23:48:392
27219991210,1cyclictest8191-21hostname19:40:173
2721999120,1cyclictest27289-21tty22:18:463
2721999120,11cyclictest0-21swapper/321:25:263
2721799120,1cyclictest19195-21sshd22:05:112
2721799120,1cyclictest0-21swapper/222:40:512
2721799120,11cyclictest0-21swapper/222:03:522
2721799120,11cyclictest0-21swapper/219:35:012
2721799120,11cyclictest0-21swapper/200:08:322
27210991210,1cyclictest3990-21grepconf.sh00:33:241
27210991210,1cyclictest25-21ksoftirqd/122:57:411
27210991210,1cyclictest0-21swapper/123:53:441
2721099120,11cyclictest22942-21sshd22:53:441
2721099120,11cyclictest0-21swapper/121:44:041
27206991211,0cyclictest0-21swapper/021:43:020
2720699120,11cyclictest0-21swapper/023:14:120
2720699120,11cyclictest0-21swapper/021:58:020
2721999119,1cyclictest19858-21lspci23:41:373
2721999110,10cyclictest0-21swapper/322:14:563
2721999110,10cyclictest0-21swapper/321:07:463
2721999110,10cyclictest0-21swapper/300:10:273
2721999110,10cyclictest0-21swapper/300:10:273
2721999110,0cyclictest0-21swapper/323:10:363
2721999110,0cyclictest0-21swapper/321:41:263
2721999110,0cyclictest0-21swapper/300:27:173
2721999110,0cyclictest0-21swapper/300:27:173
2721999110,0cyclictest0-21swapper/300:09:483
27217991110,0cyclictest0-21swapper/222:29:122
27217991110,0cyclictest0-21swapper/219:50:012
2721799110,10cyclictest0-21swapper/223:27:512
2721799110,10cyclictest0-21swapper/221:52:012
2721799110,0cyclictest0-21swapper/222:48:012
27210991111,0cyclictest33050irq/27-ahci[00022:38:241
27210991110,0cyclictest0-21swapper/122:40:051
27210991110,0cyclictest0-21swapper/121:15:241
2721099110,10cyclictest0-21swapper/123:15:541
2721099110,10cyclictest0-21swapper/121:59:441
2720699119,1cyclictest11946-21cpuspeed_turbos19:50:120
27206991110,0cyclictest0-21swapper/022:28:420
2720699110,10cyclictest8654-21sshd21:38:320
2720699110,10cyclictest0-21swapper/000:18:120
2721999109,0cyclictest0-21swapper/322:56:563
2721999109,0cyclictest0-21swapper/321:53:463
2721799109,0cyclictest0-21swapper/221:21:512
2721799109,0cyclictest0-21swapper/221:08:412
2721799100,0cyclictest0-21swapper/221:32:012
2721099109,0cyclictest25-21ksoftirqd/123:22:181
2721099109,0cyclictest0-21swapper/121:49:541
2721099109,0cyclictest0-21swapper/120:15:241
2721099109,0cyclictest0-21swapper/119:35:141
2721099108,1cyclictest25-21ksoftirqd/122:20:191
2721099107,1cyclictest25-21ksoftirqd/123:10:571
2721099100,9cyclictest26226-21kworker/1:223:42:221
2721099100,1cyclictest25-21ksoftirqd/123:36:161
2721099100,1cyclictest25-21ksoftirqd/100:39:291
2720699100,0cyclictest0-21swapper/000:35:420
272199997,1cyclictest12204-21sshd22:04:323
272179998,0cyclictest0-21swapper/223:04:512
272179997,1cyclictest4133-21lspci22:58:212
272109998,0cyclictest523-40kipmi020:45:231
272109998,0cyclictest0-21swapper/121:05:441
272109997,1cyclictest25-21ksoftirqd/123:48:461
272109997,1cyclictest25-21ksoftirqd/122:45:521
272109997,1cyclictest25-21ksoftirqd/122:15:171
272109997,1cyclictest25-21ksoftirqd/100:25:201
272109997,1cyclictest25-21ksoftirqd/100:25:191
272109990,8cyclictest5141-21kworker/1:021:30:131
272109990,1cyclictest25-21ksoftirqd/123:56:091
272109990,1cyclictest121rcu_preempt21:25:151
272069998,0cyclictest31024-21sshd22:15:530
272069998,0cyclictest0-21swapper/023:04:220
272069998,0cyclictest0-21swapper/021:26:230
272069995,3cyclictest27143-21kworker/0:121:07:480
272069990,5cyclictest854-21munin-run21:25:000
10880290,0sleep210883-21bash22:39:382
31522280,0sleep30-21swapper/323:55:413
272199987,0cyclictest0-21swapper/322:31:363
272199987,0cyclictest0-21swapper/320:29:463
272199986,1cyclictest41-21ksoftirqd/300:15:083
272199986,1cyclictest31132-21bash22:48:013
272199986,1cyclictest17936-21sshd22:08:163
272199986,1cyclictest13163-21lspci00:20:393
272199985,2cyclictest649-21avahi-daemon23:19:033
272199985,2cyclictest646-21dbus-daemon23:39:153
272179987,0cyclictest0-21swapper/220:16:312
272179985,2cyclictest649-21avahi-daemon22:12:412
272179984,3cyclictest649-21avahi-daemon23:44:492
272179984,1cyclictest646-21dbus-daemon00:04:262
272109987,0cyclictest0-21swapper/119:46:441
272109986,1cyclictest25-21ksoftirqd/122:07:461
272109986,1cyclictest25-21ksoftirqd/121:20:191
272109986,1cyclictest25-21ksoftirqd/100:11:451
272109986,1cyclictest25-21ksoftirqd/100:11:451
272069987,0cyclictest0-21swapper/019:25:420
272069986,1cyclictest9-21ksoftirqd/023:50:110
272069986,1cyclictest9-21ksoftirqd/000:00:000
272069986,1cyclictest19826-21lspci23:41:360
272069986,1cyclictest14211-21lspci22:07:530
272069985,2cyclictest649-21avahi-daemon21:31:430
272069985,2cyclictest649-21avahi-daemon21:15:570
22530280,0sleep022525-21bash22:50:210
4550270,1sleep01011-21sshd23:30:240
272199976,0cyclictest17275-21lspci00:00:453
272199976,0cyclictest0-21swapper/321:13:163
272199976,0cyclictest0-21swapper/319:30:163
272199975,1cyclictest13945-21sshd23:50:413
272199974,2cyclictest684-21polkitd23:30:313
272199974,2cyclictest646-21dbus-daemon23:29:303
272199974,2cyclictest32307-21sshd22:25:343
272199974,1cyclictest649-21avahi-daemon00:30:263
272179976,0cyclictest0-21swapper/221:01:012
272179975,1cyclictest9029-21sshd23:50:142
272179975,1cyclictest7222-21sshd23:05:092
272179975,1cyclictest28661-21lspci21:10:572
272179975,1cyclictest24349-21lspci00:18:322
272179975,1cyclictest21808-21sshd23:16:072
272179975,1cyclictest13998-21lspci21:55:042
272179975,1cyclictest11695-21lspci00:30:402
272179974,2cyclictest700-21gdbus00:10:202
272179974,2cyclictest700-21gdbus00:10:202
272179974,2cyclictest681-21gdbus00:20:122
272179974,2cyclictest19236-21sshd23:22:192
272179973,3cyclictest700-21gdbus22:31:502
272179972,3cyclictest4269-21sshd21:41:142
272179970,6cyclictest0-21swapper/219:43:512
272069976,0cyclictest25510-21lspci00:05:080
272069976,0cyclictest0-21swapper/020:59:420
272069975,1cyclictest649-21avahi-daemon22:55:360
272069975,1cyclictest649-21avahi-daemon22:04:160
272069975,1cyclictest649-21avahi-daemon21:51:500
272069975,1cyclictest649-21avahi-daemon00:13:170
272069975,1cyclictest649-21avahi-daemon00:13:160
272069975,1cyclictest646-21dbus-daemon00:30:460
272069974,2cyclictest700-21gdbus00:25:580
272069974,2cyclictest700-21gdbus00:25:570
272069974,2cyclictest649-21avahi-daemon23:20:370
272069974,2cyclictest649-21avahi-daemon22:11:070
10558270,1sleep010701-21sshd00:23:550
272199965,0cyclictest0-21swapper/320:36:463
272199964,1cyclictest1460-21crond19:25:003
272199963,2cyclictest17299-21snmpd20:11:383
272199960,5cyclictest0-21swapper/320:34:263
272179964,1cyclictest649-21avahi-daemon19:15:002
272179963,2cyclictest17299-21snmpd20:00:402
272179963,1cyclictest0-21swapper/220:55:422
272179960,0cyclictest0-21swapper/220:42:412
272179960,0cyclictest0-21swapper/219:31:222
272109965,0cyclictest0-21swapper/119:11:441
272109964,1cyclictest681-21gdbus19:25:001
272109964,1cyclictest25-21ksoftirqd/119:30:001
272109960,5cyclictest31748-21kworker/1:120:58:421
272109960,0cyclictest0-21swapper/120:00:041
272069965,0cyclictest0-21swapper/020:00:020
272069963,2cyclictest17299-21snmpd20:51:390
272069963,2cyclictest17299-21snmpd20:42:240
272069963,2cyclictest17299-21snmpd19:11:420
272069960,5cyclictest0-21swapper/020:16:120
272199953,1cyclictest32654-21cat20:40:153
272199953,1cyclictest31262-21grep19:15:213
272199953,1cyclictest17299-21snmpd21:01:063
272199953,1cyclictest17299-21snmpd20:55:183
272199953,1cyclictest17299-21snmpd20:52:423
272199953,1cyclictest17299-21snmpd20:45:123
272199953,1cyclictest17299-21snmpd20:20:503
272199953,1cyclictest17299-21snmpd20:15:353
272199953,1cyclictest17299-21snmpd20:06:033
272199953,1cyclictest17299-21snmpd19:54:373
272199953,1cyclictest17299-21snmpd19:47:373
272199953,1cyclictest17299-21snmpd19:29:003
272199953,1cyclictest17299-21snmpd19:11:063
272199953,1cyclictest16377-21cat20:00:163
272199953,1cyclictest14380-21cat19:55:163
272199952,2cyclictest5910-21cut19:35:123
272179953,1cyclictest649-21avahi-daemon19:45:132
272179953,1cyclictest32014-21/usr/sbin/munin19:20:132
272179953,1cyclictest30656-21cat20:35:152
272179953,1cyclictest26549-21cat20:25:172
272179953,1cyclictest17299-21snmpd20:52:032
272179953,1cyclictest17299-21snmpd20:46:132
272179953,1cyclictest17299-21snmpd20:33:352
272179953,1cyclictest17299-21snmpd20:11:352
272179953,1cyclictest17299-21snmpd20:06:232
272179953,1cyclictest17299-21snmpd19:56:232
272179953,1cyclictest17299-21snmpd19:17:362
272179953,1cyclictest1704-21grep19:25:132
272109955,0cyclictest0-21swapper/120:32:141
272109954,0cyclictest0-21swapper/120:05:241
272109953,1cyclictest20472-21mii-tool20:10:151
272109953,1cyclictest17299-21snmpd21:00:331
272109953,1cyclictest17299-21snmpd20:40:361
272109953,1cyclictest17299-21snmpd20:25:531
272109953,1cyclictest17299-21snmpd20:21:591
272109953,1cyclictest17299-21snmpd19:55:501
272109953,1cyclictest17299-21snmpd19:50:341
272109953,1cyclictest17299-21snmpd19:32:141
272109953,1cyclictest17299-21snmpd19:15:541
272109952,2cyclictest8881-21wc19:40:211
272109951,1cyclictest25-21ksoftirqd/120:39:591
272109950,0cyclictest0-21swapper/120:53:541
272069953,1cyclictest28589-21cat20:30:140
272069953,1cyclictest20264-21df_inode20:10:140
272069953,1cyclictest17299-21snmpd20:45:060
272069953,1cyclictest17299-21snmpd19:58:280
272069953,1cyclictest17299-21snmpd19:47:500
272069953,1cyclictest17299-21snmpd19:35:070
272069953,1cyclictest17299-21snmpd19:20:070
272069953,1cyclictest17299-21snmpd19:15:150
272069953,1cyclictest1053-21lldpd21:00:220
272069952,2cyclictest30222-21tr20:35:140
272069952,2cyclictest18012-21taskset20:05:130
272069952,2cyclictest17299-21snmpd19:43:280
272069952,2cyclictest17299-21snmpd19:33:430
272179942,1cyclictest0-21swapper/220:20:182
272069942,1cyclictest26180-21cpuspeed_turbos20:25:150
272069942,1cyclictest240612sleep020:20:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional