You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 12:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Sat Jul 12, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1959721060,0sleep20-21swapper/200:09:482
1442121050,2sleep3368299cyclictest23:22:583
2093821030,2sleep3368299cyclictest22:04:363
238742790,1sleep1646-21dbus-daemon22:25:571
12382540,0sleep30-21swapper/323:58:313
290332530,0sleep30-21swapper/323:54:593
43972520,0sleep20-21swapper/222:21:052
220902520,1sleep0700-21gdbus23:51:110
109722520,0sleep20-21swapper/220:45:132
22842510,0sleep30-21swapper/322:36:043
186302510,0sleep00-21swapper/021:21:510
45542490,0sleep00-21swapper/000:35:290
168482490,0sleep10-21swapper/123:53:491
267192480,0sleep20-21swapper/221:55:582
79652450,0sleep00-21swapper/023:07:090
280752450,1sleep0101ktimersoftd/021:25:440
73592410,0sleep2311rcuc/221:48:092
67832360,0sleep10-21swapper/122:36:301
113472350,0sleep10-21swapper/122:12:431
319723423,6sleep20-21swapper/219:05:402
324622912,12sleep00-21swapper/019:06:180
3676992120,0cyclictest28326-21lspci22:14:202
33342219,7sleep30-21swapper/319:07:213
31722208,7sleep10-21swapper/119:05:231
250342190,1sleep3646-21dbus-daemon23:11:493
239962180,2sleep0366199cyclictest21:19:230
159332180,1sleep315917-21sshd23:26:113
3676991716,0cyclictest523-40kipmi023:34:522
285392170,1sleep328509-21sshd21:50:103
202512170,0sleep00-21swapper/000:13:020
159052170,0sleep20-21swapper/222:58:422
3676991615,0cyclictest1195-21lspci00:21:032
3676991514,0cyclictest32316-21lspci21:32:162
368299140,1cyclictest2470-21grep22:54:253
3667991413,0cyclictest9933-21kworker/1:019:30:311
316392140,0sleep00-21swapper/000:01:200
237642140,1sleep223767-21bash23:42:122
201772140,0sleep120175-21lspci23:48:001
194352140,0sleep30-21swapper/323:08:163
193622140,0sleep20-21swapper/222:40:402
18912140,0sleep10-21swapper/100:07:581
117072140,0sleep20-21swapper/221:24:182
3682991311,1cyclictest3635-21bash23:37:153
3676991312,0cyclictest2106-21lspci23:58:362
3676991311,1cyclictest33-21ksoftirqd/200:19:292
367699130,12cyclictest6104-21lspci23:28:212
366799130,12cyclictest5117-21sshd21:23:401
366199130,1cyclictest32197-21sshd21:50:240
327332130,0sleep30-21swapper/322:05:363
238412130,0sleep10-21swapper/121:31:261
81512120,0sleep1231rcuc/123:16:161
3682991210,1cyclictest31115-21sshd00:14:163
368299120,1cyclictest0-21swapper/321:56:053
367699121,1cyclictest131rcu_sched22:50:122
3676991211,0cyclictest5700-21lspci22:33:262
3676991211,0cyclictest2754-21lspci23:15:442
3676991210,1cyclictest9768-21sshd23:37:512
367699120,1cyclictest10410-21lspci23:53:112
3667991210,1cyclictest0-21swapper/123:02:311
366799120,11cyclictest25180-21sshd00:03:511
366799120,10cyclictest21182-21sshd23:20:311
3661991210,1cyclictest0-21swapper/022:50:140
366199120,1cyclictest17049-21sshd23:29:240
366199120,11cyclictest0-21swapper/021:41:040
287592120,0sleep20-21swapper/200:30:542
227732120,2sleep3368299cyclictest21:49:383
368299119,1cyclictest4434-21lspci22:57:343
3682991110,0cyclictest7355-21sshd23:46:463
3682991110,0cyclictest0-21swapper/323:03:253
368299110,10cyclictest0-21swapper/322:44:553
368299110,10cyclictest0-21swapper/322:16:253
368299110,0cyclictest0-21swapper/322:48:053
367699113,1cyclictest33-21ksoftirqd/221:26:572
367699111,1cyclictest131rcu_sched21:52:222
3676991110,0cyclictest30430-21lspci21:13:592
3676991110,0cyclictest23782-21lspci23:45:142
367699110,10cyclictest0-21swapper/221:42:402
366799119,1cyclictest22905-21lspci23:26:511
366799110,10cyclictest0-21swapper/122:15:311
366799110,10cyclictest0-21swapper/121:59:511
366799110,10cyclictest0-21swapper/100:19:111
366799110,0cyclictest0-21swapper/122:50:211
3661991110,0cyclictest0-21swapper/023:20:240
3661991110,0cyclictest0-21swapper/023:17:140
3661991110,0cyclictest0-21swapper/000:24:240
3661991110,0cyclictest0-21swapper/000:15:240
366199110,1cyclictest14327-21bash22:19:040
366199110,10cyclictest0-21swapper/000:06:240
366199110,0cyclictest0-21swapper/021:45:440
299102110,2sleep2367699cyclictest22:47:492
368299109,0cyclictest0-21swapper/323:40:253
368299109,0cyclictest0-21swapper/323:34:053
368299109,0cyclictest0-21swapper/321:42:053
368299109,0cyclictest0-21swapper/300:26:263
368299109,0cyclictest0-21swapper/300:02:063
368299108,1cyclictest646-21dbus-daemon00:38:363
368299100,0cyclictest0-21swapper/321:26:053
367699109,0cyclictest27342-21lspci22:17:142
367699109,0cyclictest0-21swapper/219:25:002
367699109,0cyclictest0-21swapper/200:36:012
367699108,1cyclictest618-13audispd00:27:012
367699108,1cyclictest33-21ksoftirqd/223:22:252
367699108,1cyclictest33-21ksoftirqd/223:10:502
367699108,1cyclictest33-21ksoftirqd/223:05:092
367699107,1cyclictest33-21ksoftirqd/200:02:572
367699101,1cyclictest131rcu_sched21:36:442
367699101,1cyclictest131rcu_sched21:16:122
367699100,1cyclictest646-21dbus-daemon22:29:362
367699100,0cyclictest0-21swapper/223:00:512
366799109,0cyclictest0-21swapper/121:41:111
366799109,0cyclictest0-21swapper/100:31:211
366799108,1cyclictest14702-21sshd22:04:011
3667991010,0cyclictest7849-21kworker/1:119:23:351
3667991010,0cyclictest28284-21kworker/1:020:10:231
366799100,0cyclictest0-21swapper/123:08:211
366799100,0cyclictest0-21swapper/122:31:211
366199109,0cyclictest0-21swapper/022:47:030
366199109,0cyclictest0-21swapper/022:25:240
366199109,0cyclictest0-21swapper/000:27:330
3661991010,0cyclictest0-21swapper/023:14:040
366199100,0cyclictest0-21swapper/022:40:440
366199100,0cyclictest0-21swapper/022:22:130
366199100,0cyclictest0-21swapper/022:03:540
36829998,1cyclictest6275-21lspci22:27:223
36829998,0cyclictest0-21swapper/323:15:353
36829998,0cyclictest0-21swapper/322:20:053
36829997,1cyclictest648-21systemd-logind00:17:263
36829997,1cyclictest29248-21sshd00:20:363
36829996,2cyclictest700-21gdbus21:20:513
36829995,3cyclictest8721-21sshd21:11:433
36769998,0cyclictest0-21swapper/200:14:502
36769997,1cyclictest33-21ksoftirqd/222:36:362
36769997,1cyclictest33-21ksoftirqd/222:04:512
36769991,1cyclictest33-21ksoftirqd/222:05:192
36679999,0cyclictest4241-21kworker/1:120:31:011
36679998,0cyclictest0-21swapper/122:56:411
36679998,0cyclictest0-21swapper/121:25:101
36679998,0cyclictest0-21swapper/100:22:211
36619998,0cyclictest0-21swapper/023:35:430
36619998,0cyclictest0-21swapper/021:55:330
36619998,0cyclictest0-21swapper/021:05:240
36619997,1cyclictest684-21polkitd21:13:160
36619997,1cyclictest30296-21lspci22:11:260
36619991,4cyclictest646-21dbus-daemon21:40:000
36829987,0cyclictest0-21swapper/319:14:253
36829985,2cyclictest19788-21sshd00:09:493
36679988,0cyclictest9933-21kworker/1:019:50:591
36679988,0cyclictest9933-21kworker/1:019:47:411
36679988,0cyclictest7849-21kworker/1:119:18:131
36679988,0cyclictest2176-21kworker/1:020:24:151
36679988,0cyclictest12581-21kworker/1:320:50:051
36679987,0cyclictest0-21swapper/100:10:111
36679986,1cyclictest7772-21lspci00:25:091
36679986,1cyclictest32701-21lspci23:36:561
36679986,1cyclictest25-21ksoftirqd/122:42:541
36679986,1cyclictest25-21ksoftirqd/100:39:191
36679986,1cyclictest12781-21sshd22:06:481
36679985,2cyclictest649-21avahi-daemon23:40:161
36679985,2cyclictest649-21avahi-daemon21:51:541
36679985,2cyclictest649-21avahi-daemon21:46:431
36619986,1cyclictest646-21dbus-daemon23:02:240
36619986,1cyclictest546-21lspci23:33:570
36619986,1cyclictest27448-21lspci22:32:250
36619986,1cyclictest21018-21lspci23:48:050
36619985,2cyclictest700-21gdbus21:30:410
36619985,2cyclictest649-21avahi-daemon23:40:200
36619985,2cyclictest649-21avahi-daemon22:39:110
36619985,2cyclictest649-21avahi-daemon22:07:430
36619980,4cyclictest6468-21systemd-cgroups20:35:000
9753271,4sleep19784-21getsmi20:40:211
36829975,1cyclictest7075-21lspci21:35:553
36829975,1cyclictest649-21avahi-daemon00:30:323
36829975,1cyclictest19172-21sshd21:15:513
36829974,2cyclictest649-21avahi-daemon22:30:183
36829974,2cyclictest649-21avahi-daemon21:30:053
36829973,3cyclictest646-21dbus-daemon22:10:123
36769976,0cyclictest0-21swapper/219:48:302
36769975,1cyclictest33-21ksoftirqd/219:30:002
36769974,2cyclictest33-21ksoftirqd/219:20:002
36769972,2cyclictest700-21gdbus21:08:512
36769970,6cyclictest0-21swapper/219:50:102
36769970,6cyclictest0-21swapper/219:35:092
36679977,0cyclictest26203-21kworker/1:120:03:171
36679976,0cyclictest0-21swapper/123:30:011
36679975,1cyclictest684-21polkitd21:08:121
36679975,1cyclictest649-21avahi-daemon21:10:161
36679975,1cyclictest25546-21lspci23:57:441
36679975,1cyclictest1281-21lspci22:45:071
36679975,1cyclictest1011-21sshd21:36:101
36679974,2cyclictest649-21avahi-daemon21:15:031
36679974,2cyclictest11779-21sshd23:10:311
36619977,0cyclictest18249-21kworker/0:019:25:140
36619976,0cyclictest0-21swapper/022:56:340
36619976,0cyclictest0-21swapper/020:56:240
36619975,2cyclictest29647-21kworker/0:223:56:380
36619974,2cyclictest28659-21kworker/0:100:30:270
36619972,4cyclictest5646-21munin-run19:15:000
36619970,6cyclictest0-21swapper/019:55:340
36619970,0cyclictest0-21swapper/020:05:340
2793270,5sleep11-21systemd22:20:571
36829964,1cyclictest646-21dbus-daemon21:07:303
36829960,5cyclictest0-21swapper/320:50:353
36769965,0cyclictest0-21swapper/220:29:492
36769965,0cyclictest0-21swapper/220:10:402
36769965,0cyclictest0-21swapper/220:00:392
36769964,1cyclictest33-21ksoftirqd/219:35:002
36769964,1cyclictest17299-21snmpd20:19:212
36769960,5cyclictest0-21swapper/220:50:092
36679960,5cyclictest0-21swapper/120:28:401
36679960,5cyclictest0-21swapper/120:07:401
36619966,0cyclictest18249-21kworker/0:019:18:230
36619966,0cyclictest16509-21kworker/0:221:00:550
36619965,0cyclictest0-21swapper/019:45:040
36619964,1cyclictest9096-21cut20:40:140
36619964,1cyclictest649-21avahi-daemon20:30:000
36619963,2cyclictest17299-21snmpd19:20:280
36619960,5cyclictest0-21swapper/020:22:540
36829954,0cyclictest0-21swapper/320:15:553
36829953,1cyclictest9067-21sed20:40:153
36829953,1cyclictest648-21systemd-logind20:35:003
36829953,1cyclictest2996-21hwlatdetect20:25:133
36829953,1cyclictest17355-21cat21:00:163
36829953,1cyclictest17299-21snmpd20:56:043
36829953,1cyclictest17299-21snmpd20:47:363
36829953,1cyclictest17299-21snmpd20:10:203
36829953,1cyclictest17299-21snmpd20:00:263
36829953,1cyclictest17299-21snmpd19:51:023
36829953,1cyclictest17299-21snmpd19:39:053
36829953,1cyclictest17299-21snmpd19:32:053
36829953,1cyclictest17299-21snmpd19:25:203
36829953,1cyclictest17299-21snmpd19:23:023
36829953,1cyclictest17070-21cat19:40:183
36829952,2cyclictest646-21dbus-daemon19:55:003
36829952,2cyclictest17299-21snmpd20:31:183
36829952,2cyclictest1447-21awk20:20:193
36829950,1cyclictest28139-21unixbench_multi20:05:223
36829950,0cyclictest0-21swapper/319:45:553
36769954,0cyclictest0-21swapper/220:23:302
36769954,0cyclictest0-21swapper/219:43:002
36769953,1cyclictest4646-21/usr/sbin/munin20:30:152
36769953,1cyclictest23069-21grep19:55:162
36769953,1cyclictest17299-21snmpd20:40:572
36769953,1cyclictest17299-21snmpd20:09:062
36769953,1cyclictest17299-21snmpd19:10:152
36769953,1cyclictest17127-21df21:00:142
36769950,1cyclictest0-21swapper/220:35:172
36679955,0cyclictest9933-21kworker/1:019:57:551
36679953,1cyclictest684-21polkitd20:15:001
36679953,1cyclictest649-21avahi-daemon20:36:421
36679953,1cyclictest17299-21snmpd21:02:371
36679953,1cyclictest17299-21snmpd20:55:311
36679953,1cyclictest17299-21snmpd19:40:321
36679953,1cyclictest17299-21snmpd19:38:381
36679953,1cyclictest1109-21ntpd19:10:151
36679953,1cyclictest10995-21cat19:25:151
36679952,2cyclictest12547-21crond20:50:001
36619955,0cyclictest4066-21kworker/0:220:35:010
36619955,0cyclictest28241-21kworker/0:220:10:310
36619955,0cyclictest24758-21kworker/0:120:00:530
36619955,0cyclictest18249-21kworker/0:019:40:190
36619955,0cyclictest18249-21kworker/0:019:35:330
36619953,1cyclictest17299-21snmpd19:30:050
36619953,1cyclictest11245-21cat20:45:150
36619953,1cyclictest1058-21sendmail20:50:060
36619952,2cyclictest32023-21wc20:15:190
36619952,2cyclictest21803-21wc19:50:190
36829942,1cyclictest5738-21munin-node19:15:003
36769942,1cyclictest15019-21expr20:55:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional