You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 11:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Fri May 02, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
695421030,2sleep2871899cyclictest00:03:302
230982940,0sleep023074-21sshd00:11:100
90682790,1sleep341-21ksoftirqd/300:00:273
226502580,0sleep222655-21bash00:30:472
96782570,1sleep09652-21sshd22:15:300
230692570,1sleep3391rcuc/322:16:503
197532560,0sleep3401ktimersoftd/300:20:233
314822550,1sleep00-21swapper/023:56:290
175882550,0sleep00-21swapper/023:42:460
141432550,1sleep0646-21dbus-daemon21:30:170
134182550,1sleep21095-21nfsd00:10:162
279272530,0sleep00-21swapper/022:29:400
255942530,0sleep10-21swapper/121:49:361
220532530,0sleep10-21swapper/123:03:061
220532530,0sleep10-21swapper/123:03:051
204922530,0sleep30-21swapper/321:27:483
302572520,1sleep130246-21cp23:37:461
310972510,2sleep3872199cyclictest21:22:423
237772510,0sleep10-21swapper/100:01:571
88142490,0sleep30-21swapper/323:08:013
308272490,0sleep030829-21sshd00:21:320
91962470,0sleep10-21swapper/100:22:411
293372450,0sleep00-21swapper/023:03:500
293372450,0sleep00-21swapper/023:03:490
51962440,0sleep20-21swapper/222:05:562
234872360,1sleep323485-21lspci22:23:033
860323523,7sleep30-21swapper/319:09:583
84942309,7sleep10-21swapper/119:08:391
85842276,7sleep20-21swapper/219:09:492
229662220,0sleep00-21swapper/000:30:480
835522110,7sleep00-21swapper/019:06:540
272172200,1sleep127192-21sshd23:12:511
180582200,0sleep118055-21lspci23:52:041
296172180,0sleep20-21swapper/200:05:362
262472170,0sleep20-21swapper/223:49:492
115672170,0sleep10-21swapper/122:31:061
90052160,0sleep29008-21sshd22:30:512
8711991614,1cyclictest648-21systemd-logind00:06:060
64542160,0sleep30-21swapper/323:38:363
56722160,0sleep10-21swapper/123:32:221
129492160,0sleep00-21swapper/022:03:410
101952160,1sleep3391rcuc/322:55:433
147122150,1sleep314697-21sshd23:48:413
871199141,1cyclictest0-21swapper/021:25:460
871199140,13cyclictest4565-21lspci21:20:160
85812140,0sleep38577-21lspci23:04:573
85812140,0sleep38577-21lspci23:04:563
69492140,0sleep30-21swapper/323:50:583
324382140,0sleep30-21swapper/321:41:023
306962140,0sleep10-21swapper/123:25:321
287272140,0sleep10-21swapper/100:11:441
131032140,0sleep10-21swapper/122:46:441
871899130,12cyclictest0-21swapper/223:30:042
871899130,12cyclictest0-21swapper/221:46:532
8712991312,0cyclictest9498-21lspci23:20:251
8712991312,0cyclictest20779-21lspci23:15:221
8712991312,0cyclictest13826-21lspci21:27:101
8711991311,1cyclictest620-13audispd21:52:360
8711991311,1cyclictest0-21swapper/023:24:470
8711991311,1cyclictest0-21swapper/000:01:270
36792130,0sleep00-21swapper/023:26:030
281162130,0sleep10-21swapper/123:09:551
872199120,1cyclictest7486-21sshd23:32:333
872199120,1cyclictest1-21systemd23:16:433
872199120,1cyclictest0-21swapper/322:29:523
872199120,11cyclictest0-21swapper/322:36:223
872199120,11cyclictest0-21swapper/321:31:223
871899120,1cyclictest684-21polkitd22:54:332
8712991211,0cyclictest23460-21lspci22:01:331
8712991211,0cyclictest21681-21lspci23:58:411
8712991211,0cyclictest17299-21snmpd20:50:421
8712991210,1cyclictest30180-21sshd22:08:211
8711991210,1cyclictest0-21swapper/021:17:470
871199120,11cyclictest1385-21bash23:38:060
871199120,11cyclictest1-21systemd22:06:570
872199119,1cyclictest646-21dbus-daemon00:07:433
872199119,1cyclictest0-21swapper/321:18:223
871899119,1cyclictest9844-21lspci00:16:032
871899119,1cyclictest646-21dbus-daemon21:56:442
8718991110,0cyclictest21150-21lspci23:52:212
8718991110,0cyclictest0-21swapper/222:56:042
8718991110,0cyclictest0-21swapper/222:16:042
8718991110,0cyclictest0-21swapper/221:09:032
871899110,10cyclictest0-21swapper/200:25:332
871299119,1cyclictest3060-21sshd00:32:101
8712991110,0cyclictest0-21swapper/100:16:501
871299110,0cyclictest0-21swapper/121:54:001
8711991110,0cyclictest0-21swapper/022:30:460
8711991110,0cyclictest0-21swapper/019:40:250
871199110,1cyclictest0-21swapper/023:14:060
208312110,0sleep0111rcuc/000:17:140
872199109,0cyclictest0-21swapper/322:05:033
872199109,0cyclictest0-21swapper/321:51:433
872199100,0cyclictest0-21swapper/323:57:533
871899109,0cyclictest0-21swapper/223:37:132
871899109,0cyclictest0-21swapper/220:50:242
871899108,1cyclictest29473-21lspci21:25:332
871299108,1cyclictest25-21ksoftirqd/121:35:161
871299101,1cyclictest131rcu_sched21:23:081
871299100,1cyclictest25306-21lspci00:05:151
871299100,0cyclictest0-21swapper/100:29:001
871199109,0cyclictest0-21swapper/023:31:270
871199109,0cyclictest0-21swapper/020:15:160
871199108,1cyclictest23523-21sshd23:52:360
87219998,0cyclictest0-21swapper/323:40:133
87219998,0cyclictest0-21swapper/320:20:123
87219998,0cyclictest0-21swapper/319:40:113
87219997,1cyclictest48-21kauditd22:40:533
87219995,3cyclictest649-21avahi-daemon00:25:433
87189998,0cyclictest27914-21lspci00:21:132
87189998,0cyclictest0-21swapper/223:23:232
87189997,1cyclictest33-21ksoftirqd/222:14:322
87189997,1cyclictest33-21ksoftirqd/221:30:182
87189996,2cyclictest649-21avahi-daemon23:09:592
87189990,1cyclictest131rcu_sched23:02:232
87189990,1cyclictest131rcu_sched23:02:232
87129997,1cyclictest25-21ksoftirqd/123:45:351
87129997,1cyclictest25-21ksoftirqd/122:50:561
87129997,1cyclictest25-21ksoftirqd/122:19:261
87129992,1cyclictest131rcu_sched22:58:111
87129990,1cyclictest131rcu_sched22:29:021
87129990,1cyclictest131rcu_sched22:24:551
87129990,1cyclictest131rcu_sched21:30:511
87129990,0cyclictest0-21swapper/119:23:101
87119997,1cyclictest17324-21systemd-cgroups23:15:060
87119996,2cyclictest31961-21kworker/0:021:43:030
87219987,0cyclictest0-21swapper/323:26:533
87219987,0cyclictest0-21swapper/322:04:323
87219987,0cyclictest0-21swapper/321:00:223
87219987,0cyclictest0-21swapper/300:18:033
87219986,1cyclictest6236-21lspci00:39:103
87219986,1cyclictest24918-21lspci21:58:403
87219985,2cyclictest649-21avahi-daemon22:10:243
87219984,3cyclictest649-21avahi-daemon00:13:003
87219984,3cyclictest13716-21sshd22:31:193
87189986,1cyclictest684-21polkitd22:25:212
87189986,1cyclictest33-21ksoftirqd/223:55:572
87189986,1cyclictest33-21ksoftirqd/221:50:182
87189986,1cyclictest33-21ksoftirqd/221:13:152
87189985,2cyclictest649-21avahi-daemon23:16:402
87189985,2cyclictest649-21avahi-daemon21:21:482
87189984,2cyclictest646-21dbus-daemon23:41:252
87129986,1cyclictest25-21ksoftirqd/123:40:201
87129986,1cyclictest25-21ksoftirqd/122:40:311
87129986,1cyclictest25-21ksoftirqd/121:57:061
87129986,1cyclictest25-21ksoftirqd/121:41:191
87129986,1cyclictest25-21ksoftirqd/121:16:161
87129986,1cyclictest25-21ksoftirqd/121:05:001
87129986,1cyclictest25-21ksoftirqd/100:35:031
87129982,1cyclictest17327-21sadc19:30:001
87129981,1cyclictest131rcu_sched22:35:271
87129981,1cyclictest131rcu_sched22:11:081
87129980,1cyclictest131rcu_sched21:13:271
87119987,0cyclictest0-21swapper/023:48:270
87119986,1cyclictest648-21systemd-logind22:46:510
87119986,1cyclictest14945-21lspci21:12:030
87119985,2cyclictest649-21avahi-daemon22:40:520
87119985,2cyclictest649-21avahi-daemon00:25:410
21487280,6sleep3646-21dbus-daemon22:53:473
87219976,0cyclictest0-21swapper/319:10:313
87219975,1cyclictest23810-21lspci21:12:553
87219975,1cyclictest13408-21lspci21:36:113
87219974,2cyclictest684-21polkitd23:10:303
87219974,2cyclictest649-21avahi-daemon23:20:243
87219974,2cyclictest649-21avahi-daemon22:45:213
87219974,2cyclictest20280-21sshd00:33:583
87189976,1cyclictest33-21ksoftirqd/221:40:182
87189975,1cyclictest649-21avahi-daemon22:40:382
87189975,1cyclictest33-21ksoftirqd/223:10:022
87189975,1cyclictest33-21ksoftirqd/222:35:292
87189975,1cyclictest33-21ksoftirqd/221:16:572
87189975,1cyclictest24655-21sshd23:28:042
87189974,2cyclictest649-21avahi-daemon21:35:212
87189974,1cyclictest27975-21sshd22:20:212
87189973,3cyclictest684-21polkitd22:47:272
87189972,4cyclictest616-13auditd00:35:232
87189972,2cyclictest7917-21sshd22:00:082
87119976,0cyclictest0-21swapper/022:35:170
87119975,1cyclictest684-21polkitd22:11:250
87119975,1cyclictest684-21polkitd21:48:530
87119975,1cyclictest646-21dbus-daemon22:53:200
87119975,1cyclictest646-21dbus-daemon21:57:450
87119975,1cyclictest24482-21lspci00:37:420
87119975,1cyclictest20153-21sshd22:56:410
87119974,2cyclictest649-21avahi-daemon23:07:430
87119974,2cyclictest649-21avahi-daemon22:20:460
87119974,2cyclictest649-21avahi-daemon21:38:170
87119972,4cyclictest19523-21basename20:55:000
87119971,3cyclictest3283-21perf20:15:000
19005270,1sleep319166-21sshd21:45:503
87219965,0cyclictest0-21swapper/320:30:113
87219964,1cyclictest215072sleep320:59:513
87219963,2cyclictest684-21polkitd21:09:133
87219963,2cyclictest646-21dbus-daemon20:49:593
87219962,3cyclictest31324-21taskset20:02:173
87189965,0cyclictest0-21swapper/220:38:142
87189965,0cyclictest0-21swapper/220:10:142
87189964,1cyclictest17299-21snmpd19:40:482
87189960,5cyclictest0-21swapper/220:45:432
87129964,1cyclictest646-21dbus-daemon21:08:511
87129964,1cyclictest25-21ksoftirqd/119:15:011
87119964,1cyclictest646-21dbus-daemon21:08:350
87119964,1cyclictest646-21dbus-daemon19:39:560
87119962,3cyclictest646-21dbus-daemon19:15:010
87119960,5cyclictest0-21swapper/021:02:160
87119960,5cyclictest0-21swapper/020:03:360
87219954,0cyclictest0-21swapper/320:27:023
87219953,1cyclictest17299-21snmpd20:52:093
87219953,1cyclictest17299-21snmpd20:35:113
87219953,1cyclictest17299-21snmpd20:15:103
87219953,1cyclictest17299-21snmpd20:10:493
87219953,1cyclictest17299-21snmpd19:48:433
87219953,1cyclictest17299-21snmpd19:22:153
87219953,1cyclictest17299-21snmpd19:17:413
87219953,1cyclictest16920-21grep19:25:203
87219953,1cyclictest1053-21lldpd19:50:243
87219952,2cyclictest1053-21lldpd20:40:253
87219950,4cyclictest17565-21sshd19:30:103
87219950,4cyclictest0-21swapper/320:07:013
87219950,1cyclictest0-21swapper/319:55:203
87189953,1cyclictest684-21polkitd20:25:002
87189953,1cyclictest3994-21cat20:15:172
87189953,1cyclictest17299-21snmpd21:00:212
87189953,1cyclictest17299-21snmpd20:41:432
87189953,1cyclictest17299-21snmpd20:20:372
87189953,1cyclictest17299-21snmpd20:01:012
87189953,1cyclictest17299-21snmpd19:50:242
87189953,1cyclictest17299-21snmpd19:45:162
87189953,1cyclictest17299-21snmpd19:25:112
87189953,1cyclictest17299-21snmpd19:20:482
87189953,1cyclictest17299-21snmpd19:15:472
87189953,1cyclictest17299-21snmpd19:11:532
87189953,1cyclictest1109-21ntpd20:05:192
87189953,1cyclictest1053-21lldpd19:56:112
87189953,1cyclictest10050-21cat20:30:142
87189952,2cyclictest18505-21head19:30:192
87189950,4cyclictest0-21swapper/219:36:342
87189950,1cyclictest0-21swapper/220:55:212
87129954,0cyclictest0-21swapper/120:45:001
87129954,0cyclictest0-21swapper/120:00:411
87129953,1cyclictest7562-21/usr/sbin/munin20:25:211
87129953,1cyclictest26184-21cat19:50:151
87129953,1cyclictest17299-21snmpd20:55:021
87129953,1cyclictest17299-21snmpd20:36:141
87129953,1cyclictest17299-21snmpd20:20:101
87129953,1cyclictest17299-21snmpd20:12:051
87129953,1cyclictest17299-21snmpd19:56:181
87129953,1cyclictest17299-21snmpd19:48:011
87129953,1cyclictest17299-21snmpd19:43:301
87129953,1cyclictest17299-21snmpd19:36:551
87129953,1cyclictest17299-21snmpd19:15:081
87129953,1cyclictest14034-21cut20:40:201
87129953,1cyclictest0-21swapper/120:05:161
87129950,0cyclictest0-21swapper/120:16:311
87129950,0cyclictest0-21swapper/119:34:191
87119954,0cyclictest0-21swapper/020:25:460
87119953,1cyclictest9698-21cpuspeed_turbos20:30:120
87119953,1cyclictest17299-21snmpd20:56:260
87119953,1cyclictest17299-21snmpd20:45:560
87119953,1cyclictest17299-21snmpd20:35:430
87119953,1cyclictest17299-21snmpd20:20:040
87119953,1cyclictest17299-21snmpd20:07:210
87119953,1cyclictest17299-21snmpd19:55:330
87119953,1cyclictest17299-21snmpd19:47:010
87119953,1cyclictest17299-21snmpd19:34:330
87119953,1cyclictest17299-21snmpd19:27:210
87119953,1cyclictest17299-21snmpd19:22:390
87119953,1cyclictest17299-21snmpd19:18:590
87119953,1cyclictest14601-21grep20:40:240
87119953,1cyclictest1053-21lldpd19:50:330
87219942,1cyclictest19724-21cpuspeed_turbos19:35:113
87129942,1cyclictest17299-21snmpd20:30:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional