You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 04:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack2slot0.osadl.org (updated Thu Mar 26, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3046721080,0sleep030466-21bash22:59:460
115912810,0sleep00-21swapper/022:00:420
246892580,1sleep324602-21sshd22:15:273
172122580,0sleep20-21swapper/200:17:542
17132560,0sleep10-21swapper/123:57:281
191312550,0sleep20-21swapper/223:31:332
140812550,0sleep30-21swapper/320:10:123
155132540,0sleep00-21swapper/000:09:350
131282540,0sleep10-21swapper/122:50:051
290102530,1sleep129011-21bash23:32:241
254192530,0sleep00-21swapper/022:31:580
34902520,0sleep00-21swapper/021:49:120
293832520,0sleep30-21swapper/321:48:403
201562520,1sleep30-21swapper/319:05:173
209592510,1sleep020951-21bash23:42:400
187732510,1sleep01-21systemd23:20:330
81382500,1sleep21-21systemd00:33:332
246572500,0sleep30-21swapper/323:01:573
20372500,1sleep12034-21sshd23:35:321
186782500,0sleep00-21swapper/021:26:540
236152490,0sleep30-21swapper/322:01:463
217172490,0sleep221721-21bash21:42:332
2071724937,7sleep00-21swapper/019:08:240
256462470,1sleep325644-21lspci23:18:283
2072123928,6sleep20-21swapper/219:08:262
267302360,2sleep32097299cyclictest00:26:533
230672350,0sleep30-21swapper/323:48:193
37802340,0sleep0111rcuc/021:43:480
204992299,7sleep10-21swapper/119:05:361
127152220,0sleep00-21swapper/023:28:180
265782200,0sleep10-21swapper/120:40:131
41832180,0sleep00-21swapper/000:25:010
28122180,0sleep20-21swapper/222:51:562
236682180,0sleep30-21swapper/300:37:343
226482170,1sleep1674-21dbus-daemon23:48:171
2096899170,1cyclictest1-21systemd21:16:002
2097299162,1cyclictest674-21dbus-daemon21:28:283
170222160,0sleep30-21swapper/322:58:373
303722150,0sleep330370-21sshd00:05:193
2096399150,14cyclictest0-21swapper/122:23:051
113192150,1sleep2311rcuc/221:47:062
78662140,1sleep3391rcuc/323:33:213
319602140,1sleep131958-21lspci21:59:471
303022140,0sleep10-21swapper/122:18:461
20972991412,1cyclictest674-21dbus-daemon23:53:083
9972130,0sleep30-21swapper/321:38:063
37592130,0sleep13749-21sshd21:17:251
34192130,0sleep10-21swapper/119:45:011
269952130,0sleep1241ktimersoftd/121:43:001
20972991311,1cyclictest0-21swapper/323:59:483
20968991311,1cyclictest32406-21systemd-cgroups22:02:312
2096899130,1cyclictest15137-21sshd23:36:412
20962991311,1cyclictest26101-21lspci23:54:040
157012130,0sleep10-21swapper/121:33:551
15642130,0sleep30-21swapper/321:51:443
50832120,0sleep10-21swapper/122:08:241
2097299120,11cyclictest0-21swapper/322:54:093
2097299120,11cyclictest0-21swapper/322:37:483
20968991210,1cyclictest674-21dbus-daemon22:14:102
2096899120,1cyclictest1-21systemd22:59:512
2096899120,11cyclictest0-21swapper/223:14:412
2096399120,11cyclictest27971-21sshd22:56:451
2096399120,0cyclictest0-21swapper/121:05:151
2096299120,11cyclictest31455-21sshd23:46:160
220112110,0sleep2311rcuc/222:07:052
20972991110,0cyclictest6317-21lspci22:27:393
20972991110,0cyclictest0-21swapper/300:23:283
20972991110,0cyclictest0-21swapper/300:14:183
2097299110,10cyclictest0-21swapper/322:06:283
2096899119,1cyclictest393-21sshd22:16:102
2096899119,1cyclictest30834-21lspci21:59:402
2096899119,1cyclictest0-21swapper/223:26:412
20968991110,0cyclictest0-21swapper/223:54:012
20968991110,0cyclictest0-21swapper/200:24:422
2096899110,10cyclictest0-21swapper/200:03:012
2096399119,1cyclictest0-21swapper/123:27:351
2096399119,1cyclictest0-21swapper/100:12:551
20963991110,0cyclictest0-21swapper/121:11:061
2096399110,10cyclictest22772-21sshd21:48:051
2096399110,10cyclictest0-21swapper/123:19:351
2096399110,10cyclictest0-21swapper/121:53:051
2096299119,1cyclictest24978-21sshd23:15:350
2096299119,1cyclictest22989-21sshd22:29:050
2096299119,1cyclictest0-21swapper/021:52:260
2096299111,1cyclictest131rcu_sched22:37:270
20962991110,0cyclictest0-21swapper/023:38:450
20962991110,0cyclictest0-21swapper/022:09:350
2096299110,10cyclictest0-21swapper/022:13:350
2097299109,0cyclictest0-21swapper/322:49:183
2097299109,0cyclictest0-21swapper/321:17:083
2097299100,0cyclictest0-21swapper/323:42:593
2097299100,0cyclictest0-21swapper/321:43:383
2096899109,0cyclictest0-21swapper/223:20:412
2096899109,0cyclictest0-21swapper/223:08:412
2096899109,0cyclictest0-21swapper/221:52:102
2096899109,0cyclictest0-21swapper/200:38:412
2096899100,0cyclictest0-21swapper/223:16:422
2096399109,0cyclictest0-21swapper/123:03:351
2096399109,0cyclictest0-21swapper/122:45:251
2096399109,0cyclictest0-21swapper/122:40:061
2096399109,0cyclictest0-21swapper/121:20:051
2096399109,0cyclictest0-21swapper/100:39:551
2096399109,0cyclictest0-21swapper/100:05:051
2096399108,1cyclictest17839-21sshd00:31:351
2096399108,1cyclictest0-21swapper/122:02:161
2096399100,9cyclictest0-21swapper/120:07:261
2096399100,0cyclictest0-21swapper/120:54:551
2096299109,0cyclictest32550irq/27-ahci[00023:07:170
2096299109,0cyclictest32550irq/27-ahci[00021:34:320
2096299109,0cyclictest17139-21lspci22:42:120
2096299109,0cyclictest0-21swapper/023:57:350
2096299108,1cyclictest9-21ksoftirqd/000:32:560
2096299108,1cyclictest9-21ksoftirqd/000:14:030
2096299108,1cyclictest699-21gdbus21:23:450
2096299107,2cyclictest9-21ksoftirqd/022:15:260
2096299100,2cyclictest131rcu_sched22:52:380
2096299100,1cyclictest24885-21systemd-cgroups23:04:450
2096299100,0cyclictest0-21swapper/000:15:350
5815290,2sleep3401ktimersoftd/323:25:003
20982290,1sleep11-21systemd21:27:101
209729998,0cyclictest0-21swapper/322:13:183
209729997,1cyclictest19922-21sshd23:09:483
209689998,0cyclictest0-21swapper/222:33:202
209689997,1cyclictest16499-21sshd00:09:412
209689997,1cyclictest1568-21sshd21:21:002
209639998,0cyclictest0-21swapper/122:31:251
209639998,0cyclictest0-21swapper/120:00:251
209639998,0cyclictest0-21swapper/119:47:251
209639998,0cyclictest0-21swapper/119:20:151
209639998,0cyclictest0-21swapper/100:18:451
209629997,1cyclictest9-21ksoftirqd/021:39:370
209629997,1cyclictest9-21ksoftirqd/000:36:510
209729987,0cyclictest0-21swapper/300:33:193
209729986,1cyclictest28467-21lspci00:02:273
209729986,1cyclictest25005-21lspci00:15:473
209729985,2cyclictest699-21gdbus22:41:203
209729985,2cyclictest660-21avahi-daemon23:39:513
209729985,2cyclictest660-21avahi-daemon23:20:413
209729985,2cyclictest660-21avahi-daemon23:10:013
209729985,2cyclictest660-21avahi-daemon22:34:103
209729984,3cyclictest660-21avahi-daemon21:11:063
209729984,3cyclictest16934-21sshd21:58:303
209689987,0cyclictest0-21swapper/222:28:312
209689987,0cyclictest0-21swapper/221:32:502
209689986,1cyclictest33-21ksoftirqd/223:58:252
209689986,1cyclictest33-21ksoftirqd/223:40:032
209689986,1cyclictest33-21ksoftirqd/200:13:262
209689985,2cyclictest660-21avahi-daemon23:45:322
209689985,2cyclictest660-21avahi-daemon22:45:372
209689985,2cyclictest660-21avahi-daemon21:35:552
209689985,2cyclictest660-21avahi-daemon00:25:482
209639987,0cyclictest0-21swapper/123:21:351
209639987,0cyclictest0-21swapper/122:28:151
209639987,0cyclictest0-21swapper/120:49:261
209639986,1cyclictest9734-21kworker/1:023:41:091
209639986,1cyclictest25-21ksoftirqd/122:35:321
209639986,1cyclictest16100-21lspci00:25:571
209639985,2cyclictest660-21avahi-daemon23:06:101
209639984,3cyclictest674-21dbus-daemon21:37:121
209639984,3cyclictest660-21avahi-daemon23:11:191
209639983,2cyclictest649-21polkitd00:00:211
209639980,7cyclictest10561-21sshd00:20:081
209629986,1cyclictest9-21ksoftirqd/023:30:200
209629986,1cyclictest9-21ksoftirqd/022:20:480
209629986,1cyclictest9-21ksoftirqd/021:18:450
209629986,1cyclictest9-21ksoftirqd/000:23:570
209629986,1cyclictest19567-21lspci22:45:110
209629985,1cyclictest9-21ksoftirqd/021:14:290
209629980,7cyclictest28702-21kworker/0:223:11:250
209629980,1cyclictest131rcu_sched00:00:040
209729975,1cyclictest660-21avahi-daemon21:32:193
209729973,3cyclictest674-21dbus-daemon21:20:503
209729972,4cyclictest14359-21lspci22:20:093
209689976,0cyclictest0-21swapper/221:01:002
209689975,1cyclictest660-21avahi-daemon22:35:322
209689975,1cyclictest660-21avahi-daemon22:22:492
209689975,1cyclictest660-21avahi-daemon21:26:272
209689974,2cyclictest660-21avahi-daemon23:01:042
209689974,2cyclictest660-21avahi-daemon22:40:042
209689974,2cyclictest660-21avahi-daemon19:44:542
209689974,2cyclictest649-21polkitd21:13:332
209639975,1cyclictest660-21avahi-daemon23:50:311
209639974,2cyclictest674-21dbus-daemon22:10:001
209629975,1cyclictest660-21avahi-daemon20:15:000
209629970,1cyclictest131rcu_sched21:56:120
209729964,1cyclictest699-21gdbus19:39:593
209729964,1cyclictest674-21dbus-daemon20:25:003
209729963,2cyclictest1002-21snmpd20:27:253
209729963,2cyclictest1002-21snmpd20:07:013
209729960,5cyclictest0-21swapper/319:41:483
209729960,0cyclictest0-21swapper/321:03:083
209689965,0cyclictest0-21swapper/219:55:302
209689964,1cyclictest1002-21snmpd19:47:092
209689963,2cyclictest1002-21snmpd20:59:542
209689963,2cyclictest1002-21snmpd19:33:332
209689960,5cyclictest0-21swapper/220:42:402
209689960,5cyclictest0-21swapper/219:38:302
209639965,0cyclictest0-21swapper/121:00:251
209639965,0cyclictest0-21swapper/120:37:351
209639965,0cyclictest0-21swapper/120:10:551
209639964,1cyclictest699-21gdbus20:35:011
209639963,2cyclictest1002-21snmpd19:38:511
209639960,5cyclictest0-21swapper/119:57:151
209639960,5cyclictest0-21swapper/119:18:561
209629965,0cyclictest0-21swapper/020:45:160
209629964,1cyclictest31282-21kworker/0:119:12:270
209629964,1cyclictest15608-21perf20:15:000
209629963,2cyclictest674-21dbus-daemon20:40:000
209629963,2cyclictest1002-21snmpd19:57:460
209729953,1cyclictest26475-21cat20:40:123
209729953,1cyclictest1705-21sendmail20:00:103
209729953,1cyclictest1088-21ntpd19:50:153
209729953,1cyclictest1002-21snmpd21:05:593
209729953,1cyclictest1002-21snmpd20:59:573
209729953,1cyclictest1002-21snmpd20:50:173
209729953,1cyclictest1002-21snmpd20:30:043
209729953,1cyclictest1002-21snmpd20:16:383
209729953,1cyclictest1002-21snmpd19:31:003
209729953,1cyclictest1002-21snmpd19:12:203
209729952,2cyclictest1002-21snmpd19:25:153
209729952,2cyclictest1002-21snmpd19:23:563
209729950,4cyclictest28321-21df_inode20:45:103
209729950,2cyclictest3864-21df19:45:103
209729950,0cyclictest0-21swapper/320:35:583
209689953,1cyclictest1082-21lldpd21:05:082
209689953,1cyclictest1082-21lldpd20:25:072
209689953,1cyclictest1002-21snmpd20:50:472
209689953,1cyclictest1002-21snmpd20:36:102
209689953,1cyclictest1002-21snmpd20:33:082
209689953,1cyclictest1002-21snmpd20:13:432
209689953,1cyclictest1002-21snmpd20:06:292
209689953,1cyclictest1002-21snmpd20:02:572
209689953,1cyclictest1002-21snmpd19:27:062
209689953,1cyclictest1002-21snmpd19:20:292
209689953,1cyclictest1002-21snmpd19:16:022
209689953,1cyclictest1002-21snmpd19:11:592
209689952,2cyclictest28544-21cat20:45:112
209689952,2cyclictest1002-21snmpd20:15:042
209689950,4cyclictest5918-21sshd19:50:112
209639954,0cyclictest0-21swapper/120:58:351
209639953,1cyclictest21600-21cat19:10:131
209639953,1cyclictest15289-21kworker/1:120:15:171
209639953,1cyclictest1080-21rs:main1
209639953,1cyclictest1002-21snmpd20:23:041
209639953,1cyclictest1002-21snmpd19:53:511
209639952,2cyclictest28525-21cut19:25:141
209639952,2cyclictest1002-21snmpd20:25:161
209629954,0cyclictest0-21swapper/020:07:050
209629953,1cyclictest7442-21crond19:55:000
209629953,1cyclictest660-21avahi-daemon20:00:000
209629953,1cyclictest4429-21latency21:05:130
209629953,1cyclictest30099-21/usr/sbin/munin20:50:200
209629953,1cyclictest1899-21tr21:00:100
209629953,1cyclictest1002-21snmpd20:55:350
209629953,1cyclictest1002-21snmpd20:41:250
209629953,1cyclictest1002-21snmpd20:27:400
209629953,1cyclictest1002-21snmpd19:37:540
209629952,2cyclictest26487-21nfsd19:20:160
209629952,2cyclictest23390-21chrt20:30:390
209629952,2cyclictest1002-21snmpd19:46:180
209629951,3cyclictest620-13auditd20:20:240
209629950,4cyclictest3366-21crond19:44:590
209629950,4cyclictest31638-21crond19:34:590
209629950,1cyclictest29613-21perf19:30:000
209729942,1cyclictest8879-21cat19:55:193
209729942,1cyclictest23221-21sensors19:15:013
209689942,1cyclictest18361-21cat20:20:132
209629942,1cyclictest24749-21gunzip19:15:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional