You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 06:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack2slot0.osadl.org (updated Thu Dec 04, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
98122990,0sleep10-21swapper/122:09:091
124662990,1sleep3401ktimersoftd/321:27:443
209232730,0sleep09-21ksoftirqd/023:39:230
261182670,1sleep026115-21sshd21:51:290
297532620,0sleep10-21swapper/122:33:281
54412610,0sleep20-21swapper/223:53:512
226742590,0sleep00-21swapper/021:44:480
104372580,0sleep00-21swapper/023:25:330
64662570,0sleep30-21swapper/321:10:153
321982560,0sleep10-21swapper/100:06:041
74722540,0sleep20-21swapper/223:03:052
74722540,0sleep20-21swapper/223:03:052
249512540,1sleep124950-21sshd22:42:291
120962530,2sleep01036199cyclictest22:47:320
129652520,0sleep00-21swapper/022:57:140
152802510,0sleep315276-21id23:45:113
315062500,0sleep20-21swapper/222:46:142
51422490,2sleep01036199cyclictest21:10:080
167782480,0sleep10-21swapper/123:19:571
90512460,0sleep10-21swapper/123:41:201
208992440,1sleep11095-21nfsd23:48:571
110902390,2sleep31037099cyclictest23:51:073
93322370,0sleep20-21swapper/221:24:162
315002370,0sleep10-21swapper/121:42:241
160812370,0sleep30-21swapper/300:14:313
988423126,3sleep10-21swapper/119:05:251
101182309,6sleep20-21swapper/219:08:192
57142280,1sleep3391rcuc/321:46:163
101402287,7sleep30-21swapper/319:08:363
99432277,7sleep00-21swapper/019:06:040
24792210,0sleep10-21swapper/121:20:181
123002210,0sleep30-21swapper/323:44:553
129882190,0sleep00-21swapper/023:10:030
45352180,0sleep00-21swapper/023:31:220
242332170,1sleep30-21swapper/321:32:063
10365991716,0cyclictest27772-21lspci23:27:182
323392150,0sleep00-21swapper/022:24:080
292652150,0sleep00-21swapper/000:32:540
114502150,0sleep2311rcuc/223:44:502
10365991514,0cyclictest1332-21lspci22:59:192
10361991514,0cyclictest16940-21sensors21:15:190
308722140,0sleep20-21swapper/222:39:582
197512140,0sleep10-21swapper/121:50:501
181572140,0sleep10-21swapper/122:16:171
1036499140,13cyclictest0-21swapper/121:10:491
10361991412,1cyclictest14822-21lspci22:03:120
1036199140,12cyclictest19526-21sshd23:58:270
319722130,0sleep131970-21lspci21:26:271
239292130,0sleep10-21swapper/121:19:171
18432130,0sleep30-21swapper/321:20:163
156172130,0sleep00-21swapper/000:04:310
10365991312,0cyclictest4473-21lspci21:39:482
1036599130,12cyclictest646-21dbus-daemon21:25:462
1036499130,1cyclictest7893-21lspci00:13:391
1036499130,12cyclictest0-21swapper/121:05:191
1036499130,0cyclictest0-21swapper/122:53:091
10361991312,0cyclictest8548-21lspci21:36:570
10361991312,0cyclictest2080-21kworker/0:022:38:070
10361991312,0cyclictest15967-21kworker/0:122:50:150
10361991311,1cyclictest17238-21kworker/0:221:26:430
185582120,0sleep2311rcuc/223:35:532
1037099120,1cyclictest2858-21bash21:42:473
10365991210,1cyclictest5077-21lspci22:24:402
10365991210,1cyclictest0-21swapper/223:07:062
1036599120,1cyclictest19480-21sshd21:54:062
1036599120,1cyclictest0-21swapper/223:17:262
1036599120,11cyclictest27913-21lspci22:01:162
1036599120,11cyclictest23605-21sshd22:07:152
1036499120,1cyclictest27606-21sshd22:10:491
1036499120,11cyclictest0-21swapper/100:35:091
10361991211,0cyclictest2080-21kworker/0:022:27:330
1036199120,1cyclictest700-21gdbus00:24:050
1037099119,1cyclictest15219-21sshd22:19:173
10370991110,0cyclictest0-21swapper/322:11:273
1037099110,10cyclictest0-21swapper/322:55:373
1037099110,10cyclictest0-21swapper/322:25:573
1037099110,0cyclictest0-21swapper/323:02:173
1037099110,0cyclictest0-21swapper/323:02:173
1037099110,0cyclictest0-21swapper/322:34:273
1036599119,1cyclictest33-21ksoftirqd/222:53:022
10365991110,0cyclictest0-21swapper/222:10:162
1036599110,10cyclictest0-21swapper/221:15:262
1036599110,10cyclictest0-21swapper/220:45:062
1036599110,10cyclictest0-21swapper/200:16:062
1036599110,10cyclictest0-21swapper/200:06:152
1036599110,0cyclictest0-21swapper/222:18:062
1036599110,0cyclictest0-21swapper/200:35:462
1036599110,0cyclictest0-21swapper/200:25:562
1036499116,1cyclictest618-13audispd00:26:181
1036499115,1cyclictest648-21systemd-logind23:38:241
1036499114,2cyclictest684-21polkitd00:33:301
1036499114,1cyclictest684-21polkitd23:04:081
1036499114,1cyclictest684-21polkitd23:04:081
1036499114,1cyclictest11638-21sshd23:25:411
1036499110,10cyclictest0-21swapper/122:48:191
1036199119,1cyclictest9517-21lspci21:49:560
1036199119,1cyclictest21737-21bash22:19:560
10361991110,0cyclictest3599-21kworker/0:023:45:430
10361991110,0cyclictest30763-21kworker/0:022:10:230
10361991110,0cyclictest24890-21lspci00:39:580
10361991110,0cyclictest23428-21lspci00:28:550
1036199110,10cyclictest7991-21lspci21:30:250
1036199110,0cyclictest0-21swapper/000:09:270
1037099109,0cyclictest0-21swapper/323:17:273
1037099109,0cyclictest0-21swapper/321:56:273
1037099109,0cyclictest0-21swapper/321:17:073
1037099109,0cyclictest0-21swapper/300:16:073
1037099108,1cyclictest16295-21bash23:07:073
1037099100,0cyclictest0-21swapper/322:50:473
1037099100,0cyclictest0-21swapper/321:52:173
1036599109,0cyclictest0-21swapper/221:33:562
1036599109,0cyclictest0-21swapper/220:40:162
1036599109,0cyclictest0-21swapper/200:04:262
1036599108,1cyclictest18656-21sshd23:13:462
1036599100,0cyclictest0-21swapper/221:45:462
1036599100,0cyclictest0-21swapper/221:40:252
1036499105,1cyclictest9144-21sshd00:20:341
1036499104,1cyclictest700-21gdbus23:31:501
1036499104,1cyclictest700-21gdbus23:06:161
1036499104,1cyclictest684-21polkitd00:00:481
1036499104,1cyclictest4969-21sshd21:46:111
1036499104,1cyclictest32169-21sshd23:56:261
1036499104,1cyclictest25301-21sshd00:15:221
1036499104,1cyclictest24056-21sshd21:57:431
1036499104,1cyclictest20875-21sshd23:10:441
1036499104,1cyclictest15666-21sshd22:25:371
1036499104,1cyclictest10876-21sshd22:37:581
1036499103,2cyclictest17299-21snmpd20:15:171
1036499102,3cyclictest616-13auditd22:21:061
1036199109,0cyclictest0-21swapper/023:09:350
1036199109,0cyclictest0-21swapper/023:01:060
1036199109,0cyclictest0-21swapper/023:01:060
1036199109,0cyclictest0-21swapper/020:15:160
1036199109,0cyclictest0-21swapper/019:50:160
1036199109,0cyclictest0-21swapper/000:19:170
1036199109,0cyclictest0-21swapper/000:11:170
24628290,1sleep3401ktimersoftd/322:07:223
103709998,0cyclictest0-21swapper/322:41:063
103709998,0cyclictest0-21swapper/320:00:373
103709998,0cyclictest0-21swapper/300:25:573
103659998,0cyclictest3476-21lspci21:55:382
103659998,0cyclictest0-21swapper/222:34:252
103659998,0cyclictest0-21swapper/219:31:062
103659990,8cyclictest8562-21kworker/2:100:14:262
103649994,1cyclictest2854-21sshd21:33:131
103649993,1cyclictest684-21polkitd22:56:571
103649993,1cyclictest6569-21sshd22:02:221
103649993,1cyclictest646-21dbus-daemon23:20:301
103619999,0cyclictest7495-21kworker/0:323:42:050
103619998,0cyclictest7747-21lspci22:31:150
103619998,0cyclictest25180-21kworker/0:123:52:390
103619990,8cyclictest17498-21kworker/0:222:05:170
103709987,0cyclictest0-21swapper/319:25:373
103709987,0cyclictest0-21swapper/300:37:373
103709987,0cyclictest0-21swapper/300:06:173
103709986,1cyclictest3618-21lspci23:31:163
103709986,1cyclictest32002-21lspci22:49:323
103709986,1cyclictest29428-21bash00:02:373
103709986,1cyclictest12801-21lspci22:35:013
103709986,1cyclictest1249-21lspci23:37:243
103709985,2cyclictest700-21gdbus23:59:233
103709985,2cyclictest649-21avahi-daemon23:29:503
103709985,2cyclictest649-21avahi-daemon22:25:003
103709983,2cyclictest649-21avahi-daemon00:21:063
103659987,0cyclictest0-21swapper/220:55:262
103659987,0cyclictest0-21swapper/219:23:362
103659986,1cyclictest33-21ksoftirqd/223:49:252
103659986,1cyclictest33-21ksoftirqd/222:41:372
103659986,1cyclictest33-21ksoftirqd/222:25:142
103659986,1cyclictest3035-21sshd21:09:362
103659984,2cyclictest700-21gdbus23:56:282
103659983,2cyclictest8620-21sshd00:20:302
103649987,0cyclictest0-21swapper/121:35:391
103649983,1cyclictest32544-21sshd23:53:201
103619987,0cyclictest0-21swapper/021:07:460
103619986,1cyclictest30880-21sshd23:18:070
103619986,1cyclictest15674-21sshd22:44:460
103619985,2cyclictest649-21avahi-daemon23:20:420
103709976,0cyclictest0-21swapper/319:36:073
103709975,1cyclictest684-21polkitd00:31:463
103709975,1cyclictest649-21avahi-daemon23:10:423
103709974,2cyclictest646-21dbus-daemon22:01:003
103709974,2cyclictest22068-21sshd21:38:193
103709974,2cyclictest19351-21sshd23:20:123
103659976,0cyclictest0-21swapper/221:11:262
103659976,0cyclictest0-21swapper/220:31:262
103659976,0cyclictest0-21swapper/220:15:062
103659976,0cyclictest0-21swapper/220:10:352
103659975,1cyclictest33-21ksoftirqd/223:30:142
103659975,1cyclictest33-21ksoftirqd/200:30:202
103659974,2cyclictest649-21avahi-daemon23:20:182
103649976,0cyclictest0-21swapper/120:48:391
103649976,0cyclictest0-21swapper/120:31:191
103649974,1cyclictest616-13auditd20:14:391
103619976,0cyclictest6355-21lspci21:55:550
103619974,2cyclictest649-21avahi-daemon21:22:100
103709964,1cyclictest700-21gdbus20:35:003
103709964,1cyclictest17299-21snmpd20:15:443
103709962,1cyclictest29834-21sshd21:07:143
103659966,0cyclictest10309-21kworker/2:219:55:152
103659965,0cyclictest0-21swapper/221:01:362
103659965,0cyclictest0-21swapper/220:51:462
103659965,0cyclictest0-21swapper/220:20:562
103659965,0cyclictest0-21swapper/219:51:462
103659965,0cyclictest0-21swapper/219:17:062
103659960,0cyclictest0-21swapper/219:39:362
103649964,1cyclictest23354-21pluginstate21:00:011
103649964,1cyclictest17299-21snmpd20:07:141
103649963,2cyclictest17299-21snmpd20:44:301
103649963,2cyclictest17299-21snmpd19:56:221
103649960,5cyclictest0-21swapper/119:39:581
103619964,1cyclictest646-21dbus-daemon19:30:000
103619963,2cyclictest17299-21snmpd19:44:430
103619960,5cyclictest0-21swapper/020:01:450
103619960,1cyclictest121rcu_preempt19:39:590
103709953,1cyclictest9838-21cat20:25:123
103709953,1cyclictest24074-21cat21:00:133
103709953,1cyclictest22838-21grep20:55:213
103709953,1cyclictest20012-21cat20:50:153
103709953,1cyclictest17299-21snmpd20:45:093
103709953,1cyclictest17299-21snmpd20:43:003
103709953,1cyclictest17299-21snmpd20:35:583
103709953,1cyclictest17299-21snmpd20:05:073
103709953,1cyclictest17299-21snmpd19:43:043
103709953,1cyclictest17299-21snmpd19:21:233
103709953,1cyclictest17299-21snmpd19:15:033
103709953,1cyclictest17299-21snmpd19:10:303
103709953,1cyclictest1058-21sendmail20:20:073
103709952,2cyclictest17299-21snmpd19:30:273
103709950,4cyclictest30979-21sshd19:56:103
103709950,4cyclictest0-21swapper/319:48:163
103659953,1cyclictest17299-21snmpd20:36:232
103659953,1cyclictest17299-21snmpd20:25:442
103659953,1cyclictest17299-21snmpd20:00:312
103659953,1cyclictest17299-21snmpd19:47:482
103659953,1cyclictest17299-21snmpd19:42:252
103659953,1cyclictest17299-21snmpd19:26:542
103659953,1cyclictest17299-21snmpd19:10:032
103659953,1cyclictest1718-21cat20:05:162
103649953,1cyclictest7781-21cat20:20:171
103649953,1cyclictest32024-21cat20:00:151
103649953,1cyclictest23405-21/usr/sbin/munin19:40:181
103649953,1cyclictest17299-21snmpd21:01:421
103649953,1cyclictest17299-21snmpd19:50:371
103649953,1cyclictest17299-21snmpd19:45:581
103649953,1cyclictest17299-21snmpd19:32:271
103649953,1cyclictest17299-21snmpd19:27:451
103649953,1cyclictest17299-21snmpd19:20:241
103649953,1cyclictest13652-21cat19:15:151
103649953,1cyclictest1058-21sendmail20:35:131
103649953,1cyclictest0-21swapper/119:10:101
103649952,2cyclictest646-21dbus-daemon20:29:591
103649950,4cyclictest21199-21sshd20:53:381
103619953,1cyclictest9839-21cat20:25:120
103619953,1cyclictest7817-21cat20:20:170
103619953,1cyclictest4669-21yum20:10:210
103619953,1cyclictest29990-21cat19:55:150
103619953,1cyclictest26306-21ntpq19:45:160
103619953,1cyclictest2576-21unixbench_singl20:05:220
103619953,1cyclictest24354-21awk21:00:160
103619953,1cyclictest21748-21expr20:55:130
103619953,1cyclictest20932-21yum20:50:220
103619953,1cyclictest19967-21missed_timers19:30:160
103619953,1cyclictest17299-21snmpd20:48:270
103619953,1cyclictest17299-21snmpd20:44:060
103619953,1cyclictest17299-21snmpd20:30:110
103619953,1cyclictest17299-21snmpd19:24:090
103619953,1cyclictest17299-21snmpd19:16:390
103619953,1cyclictest17299-21snmpd19:13:000
103619953,1cyclictest1049-21rpcbind20:37:280
103709942,1cyclictest3338-21sort20:10:113
103709942,1cyclictest0-21swapper/319:50:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional