You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-06 - 00:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Sat Jul 05, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
111882940,0sleep20-21swapper/211:36:102
222092930,0sleep20-21swapper/211:34:222
124972900,0sleep012495-21sshd09:43:440
113372660,1sleep2311rcuc/210:10:032
113372660,1sleep2311rcuc/210:10:022
12592550,0sleep20-21swapper/210:02:222
267892540,0sleep00-21swapper/012:03:080
109982540,0sleep00-21swapper/010:00:070
87572530,0sleep11-21systemd12:04:251
176782520,2sleep22738799cyclictest09:57:332
128622510,0sleep00-21swapper/010:06:430
101482510,0sleep00-21swapper/012:38:400
76502500,0sleep37652-21bash12:27:023
34342500,0sleep30-21swapper/311:29:533
220132500,0sleep00-21swapper/011:31:270
74932490,1sleep37490-21lspci11:07:273
142372490,0sleep00-21swapper/012:19:060
324352470,2sleep22738799cyclictest11:18:122
2693123617,7sleep00-21swapper/007:06:050
2607923519,10sleep10-21swapper/107:05:181
25672350,0sleep20-21swapper/212:32:172
2688323429,3sleep20-21swapper/207:05:272
117672340,2sleep32739399cyclictest12:01:463
277022220,1sleep327701-21sshd12:14:363
269392219,7sleep30-21swapper/307:06:123
98102200,0sleep20-21swapper/210:33:262
155202180,0sleep215517-21sshd09:53:592
122272180,0sleep30-21swapper/312:38:513
36302170,0sleep23619-21sshd12:20:562
82762160,0sleep10-21swapper/110:58:201
296832160,0sleep10-21swapper/109:11:261
27387991615,0cyclictest12148-21lspci09:07:372
159702160,2sleep32739399cyclictest11:30:543
73812150,0sleep30-21swapper/310:33:113
45612150,0sleep20-21swapper/210:45:432
30112150,0sleep00-21swapper/011:52:300
2738799156,1cyclictest33-21ksoftirqd/210:58:252
183132150,1sleep318315-21bash10:04:063
121242150,0sleep30-21swapper/312:30:183
68872140,0sleep00-21swapper/011:41:280
36312140,0sleep30-21swapper/310:48:453
35602140,0sleep30-21swapper/309:32:353
298582140,0sleep10-21swapper/109:48:511
293742140,0sleep00-21swapper/012:14:450
2738799145,1cyclictest33-21ksoftirqd/211:58:162
27387991413,0cyclictest17299-21snmpd09:43:412
2738799140,1cyclictest32727-21sshd09:22:152
273402140,0sleep20-21swapper/212:25:532
226742140,0sleep10-21swapper/112:36:531
160282140,0sleep10-21swapper/111:56:281
137352140,0sleep30-21swapper/311:22:133
50822130,1sleep3391rcuc/311:38:313
315932130,0sleep30-21swapper/311:03:383
2739399130,12cyclictest27940-21bash11:49:043
27387991311,1cyclictest11573-21bash10:40:162
2738799130,12cyclictest32022-21bash09:49:052
2738799130,12cyclictest0-21swapper/211:40:262
235892130,0sleep1231rcuc/111:51:271
230472130,0sleep20-21swapper/211:05:502
211192130,1sleep3646-21dbus-daemon12:16:473
27393991211,0cyclictest0-21swapper/312:24:543
27393991210,1cyclictest646-21dbus-daemon09:38:123
2739399120,11cyclictest684-21polkitd12:05:243
2738799123,1cyclictest33-21ksoftirqd/211:54:362
27387991210,1cyclictest0-21swapper/210:22:252
27387991210,0cyclictest30669-21sshd09:18:452
2738799120,11cyclictest25336-21lspci09:28:142
2738799120,11cyclictest0-21swapper/210:26:052
27383991210,1cyclictest0-21swapper/109:54:311
2738399120,1cyclictest692-21NetworkManager10:54:211
2738399120,11cyclictest0-21swapper/111:44:211
27376991210,1cyclictest32303-21lspci10:28:510
27376991210,1cyclictest19601-21lspci12:08:110
27376991210,1cyclictest1-21systemd10:34:120
2739399111,1cyclictest131rcu_sched10:15:453
2739399110,10cyclictest0-21swapper/310:10:133
2739399110,10cyclictest0-21swapper/310:10:133
2739399110,10cyclictest0-21swapper/309:59:133
2738799112,1cyclictest131rcu_sched09:35:362
2738799111,3cyclictest33-21ksoftirqd/212:00:452
2738799111,2cyclictest33-21ksoftirqd/210:52:332
2738799111,1cyclictest33-21ksoftirqd/211:00:592
2738799111,1cyclictest33-21ksoftirqd/209:12:312
2738799111,1cyclictest131rcu_sched11:12:332
2738799110,3cyclictest33-21ksoftirqd/211:47:532
2738799110,1cyclictest33-21ksoftirqd/211:20:572
2738799110,10cyclictest0-21swapper/208:55:252
27383991110,0cyclictest0-21swapper/109:41:121
2738399110,10cyclictest0-21swapper/110:07:321
2739399109,0cyclictest27111-21lspci10:44:543
2739399109,0cyclictest0-21swapper/310:53:543
2739399109,0cyclictest0-21swapper/310:36:233
2739399100,9cyclictest21520-21sshd11:59:523
2738799109,0cyclictest16243-21lspci10:37:232
2738799109,0cyclictest0-21swapper/210:15:052
2738799108,1cyclictest33-21ksoftirqd/210:09:442
2738799102,1cyclictest33-21ksoftirqd/212:16:152
2738799102,1cyclictest121rcu_preempt12:10:592
2738799101,1cyclictest33-21ksoftirqd/212:38:422
2738799101,1cyclictest131rcu_sched11:26:542
2738799100,1cyclictest33-21ksoftirqd/212:05:442
2738799100,1cyclictest33-21ksoftirqd/209:33:252
2738799100,0cyclictest0-21swapper/207:40:252
2738399109,0cyclictest0-21swapper/111:01:421
2738399109,0cyclictest0-21swapper/110:42:421
2738399109,0cyclictest0-21swapper/110:29:311
2738399109,0cyclictest0-21swapper/110:00:421
2738399108,1cyclictest670-21packagekitd11:09:021
2738399100,0cyclictest0-21swapper/110:18:021
2738399100,0cyclictest0-21swapper/109:05:321
2737699100,9cyclictest8957-21sshd11:47:220
2737699100,0cyclictest20926-21sshd09:47:520
2737699100,0cyclictest0-21swapper/009:10:520
273939998,0cyclictest0-21swapper/311:12:143
273939998,0cyclictest0-21swapper/310:24:533
273939998,0cyclictest0-21swapper/308:31:433
273879998,0cyclictest0-21swapper/207:35:552
273879997,1cyclictest33-21ksoftirqd/207:30:002
273839998,0cyclictest0-21swapper/111:26:421
273839998,0cyclictest0-21swapper/109:25:011
273839998,0cyclictest0-21swapper/108:03:211
273769996,1cyclictest649-21avahi-daemon10:21:100
19364290,1sleep1241ktimersoftd/110:34:251
9626280,1sleep1231rcuc/111:21:511
273939987,0cyclictest0-21swapper/308:35:233
273939986,1cyclictest41-21ksoftirqd/310:27:593
273939986,1cyclictest2963-21lspci11:15:323
273939985,2cyclictest649-21avahi-daemon10:06:353
273939985,2cyclictest649-21avahi-daemon09:52:323
273939985,2cyclictest646-21dbus-daemon10:57:543
273839987,0cyclictest0-21swapper/111:35:321
273839987,0cyclictest0-21swapper/110:48:321
273839987,0cyclictest0-21swapper/108:10:021
273839987,0cyclictest0-21swapper/107:51:211
273839986,1cyclictest5707-21lspci11:13:011
273839986,1cyclictest21564-21lspci12:19:451
273839986,1cyclictest12477-21sshd12:13:151
273839985,2cyclictest649-21avahi-daemon11:49:151
273839985,2cyclictest646-21dbus-daemon10:24:521
273769987,0cyclictest0-21swapper/009:58:220
273769986,2cyclictest23411-21kworker/0:212:23:410
273769986,1cyclictest9-21ksoftirqd/010:52:350
273769986,1cyclictest9-21ksoftirqd/009:15:100
273769986,1cyclictest8421-21lspci09:36:380
273769986,1cyclictest6502-21lspci10:12:590
273769986,1cyclictest6502-21lspci10:12:590
273769986,1cyclictest1082-21lspci10:57:390
273769985,2cyclictest700-21gdbus11:16:460
273769985,2cyclictest649-21avahi-daemon12:31:580
273769985,2cyclictest649-21avahi-daemon11:55:010
273769985,2cyclictest649-21avahi-daemon11:36:390
273769980,4cyclictest24038-21perf08:20:000
273769980,4cyclictest24038-21perf08:19:590
24320280,1sleep10-21swapper/110:11:271
24320280,1sleep10-21swapper/110:11:261
18846280,1sleep1646-21dbus-daemon09:20:481
273939975,1cyclictest649-21avahi-daemon09:48:183
273939975,1cyclictest649-21avahi-daemon09:15:063
273939975,1cyclictest646-21dbus-daemon11:40:093
273939975,1cyclictest41-21ksoftirqd/311:50:133
273939975,1cyclictest23864-21lspci09:41:253
273939975,1cyclictest13087-21lspci09:20:153
273939975,1cyclictest12699-21lspci09:13:143
273939973,3cyclictest692-21NetworkManager09:27:573
273879975,1cyclictest33-21ksoftirqd/208:20:002
273879975,1cyclictest33-21ksoftirqd/208:20:002
273839975,1cyclictest6217-21lspci09:56:201
273839975,1cyclictest25-21ksoftirqd/109:30:201
273839975,1cyclictest25-21ksoftirqd/108:00:001
273839975,1cyclictest24575-21lspci12:05:421
273839975,1cyclictest17237-21sshd12:33:361
273839975,1cyclictest11004-21lspci09:36:531
273839974,2cyclictest649-21avahi-daemon12:21:271
273839974,2cyclictest649-21avahi-daemon09:15:331
273839974,2cyclictest646-21dbus-daemon10:35:211
273839974,2cyclictest22117-21sshd11:31:281
273839970,6cyclictest0-21swapper/108:31:521
273839970,3cyclictest666-21sshd11:15:211
273769976,0cyclictest1881-21lspci10:45:270
273769975,1cyclictest9-21ksoftirqd/011:10:230
273769975,1cyclictest9-21ksoftirqd/010:40:160
273769975,1cyclictest21368-21sshd09:31:030
273769975,1cyclictest17009-21sshd12:25:020
273769975,1cyclictest14326-21sshd10:37:110
273769975,1cyclictest13090-21lspci09:20:150
273769974,2cyclictest649-21avahi-daemon11:00:150
273769974,2cyclictest649-21avahi-daemon10:15:070
273769974,2cyclictest649-21avahi-daemon09:50:260
273769974,2cyclictest26636-21sshd11:23:230
273769973,3cyclictest684-21polkitd11:26:130
273769970,6cyclictest5645-21sshd09:26:080
273769970,1cyclictest131rcu_sched11:05:380
22103270,1sleep122101-21lspci12:28:201
273939964,1cyclictest646-21dbus-daemon09:07:343
273939963,2cyclictest17299-21snmpd07:56:523
273939960,5cyclictest0-21swapper/308:00:033
273879965,0cyclictest0-21swapper/208:05:152
273879964,1cyclictest648-21systemd-logind07:49:592
273879964,1cyclictest33-21ksoftirqd/208:40:012
273879964,1cyclictest33-21ksoftirqd/207:15:002
273879963,2cyclictest17299-21snmpd08:12:562
273879963,2cyclictest17299-21snmpd07:22:442
273879960,5cyclictest0-21swapper/208:29:452
273839964,1cyclictest646-21dbus-daemon08:45:011
273839964,1cyclictest646-21dbus-daemon07:15:001
273839960,5cyclictest0-21swapper/108:50:121
273839960,5cyclictest0-21swapper/108:24:021
273769964,1cyclictest28805-21mii-tool08:30:150
273769963,2cyclictest700-21gdbus09:09:140
273769963,2cyclictest17299-21snmpd08:52:540
273769960,5cyclictest0-21swapper/009:00:310
273769960,5cyclictest0-21swapper/008:24:220
273769960,3cyclictest5700-21perf07:35:000
273939954,0cyclictest0-21swapper/308:06:433
273939953,1cyclictest409-21cat08:40:183
273939953,1cyclictest22702-21cat08:15:153
273939953,1cyclictest22702-21cat08:15:153
273939953,1cyclictest17299-21snmpd08:55:453
273939953,1cyclictest17299-21snmpd08:27:233
273939953,1cyclictest17299-21snmpd07:36:333
273939953,1cyclictest17299-21snmpd07:32:213
273939953,1cyclictest17299-21snmpd07:27:273
273939953,1cyclictest17299-21snmpd07:23:593
273939953,1cyclictest17299-21snmpd07:16:453
273939953,1cyclictest17299-21snmpd07:10:453
273939953,1cyclictest12483-21cat07:50:163
273939953,1cyclictest1058-21sendmail09:04:423
273939953,1cyclictest10444-21cat07:45:143
273939952,2cyclictest17299-21snmpd08:52:213
273939950,0cyclictest0-21swapper/308:45:323
273939950,0cyclictest0-21swapper/307:40:533
273879953,1cyclictest33-21ksoftirqd/207:15:002
273879953,1cyclictest17299-21snmpd08:50:032
273879953,1cyclictest17299-21snmpd08:48:082
273879953,1cyclictest17299-21snmpd08:40:572
273879953,1cyclictest17299-21snmpd08:20:462
273879953,1cyclictest17299-21snmpd08:00:012
273879953,1cyclictest1058-21sendmail07:55:162
273879953,1cyclictest0-21swapper/207:50:202
273879951,1cyclictest121rcu_preempt09:00:122
273839955,0cyclictest615-21kworker/1:207:39:511
273839955,0cyclictest615-21kworker/1:207:32:041
273839955,0cyclictest3872-21kworker/1:108:55:561
273839955,0cyclictest17894-21kworker/1:008:05:101
273839954,0cyclictest0-21swapper/108:15:421
273839954,0cyclictest0-21swapper/108:15:421
273839953,1cyclictest28836-21grep07:10:221
273839953,1cyclictest26293-21grep08:25:131
273839953,1cyclictest17299-21snmpd09:00:501
273839953,1cyclictest17299-21snmpd08:36:501
273839953,1cyclictest17299-21snmpd07:45:251
273839953,1cyclictest17299-21snmpd07:25:061
273839953,1cyclictest1593-21kworker/1:008:46:221
273839953,1cyclictest1109-21ntpd07:40:181
273769953,1cyclictest6989-21sensors_volt07:35:240
273769953,1cyclictest552-21grep08:40:190
273769953,1cyclictest27894-21grep07:10:140
273769953,1cyclictest17299-21snmpd08:56:510
273769953,1cyclictest17299-21snmpd08:46:090
273769953,1cyclictest17299-21snmpd08:25:110
273769953,1cyclictest17299-21snmpd08:05:310
273769953,1cyclictest17299-21snmpd07:53:190
273769953,1cyclictest17299-21snmpd07:45:310
273769953,1cyclictest17299-21snmpd07:27:240
273769953,1cyclictest17299-21snmpd07:21:480
273769953,1cyclictest17299-21snmpd07:15:150
273769953,1cyclictest14749-21needreboot07:55:170
273769953,1cyclictest1-21systemd08:15:000
273769952,2cyclictest17299-21snmpd07:42:190
273769950,4cyclictest0-21swapper/008:03:010
273939942,1cyclictest24303-21awk08:20:133
273939942,1cyclictest20571-21smartctl08:10:133
273879942,1cyclictest4173-21/usr/sbin/munin07:30:142
273879942,1cyclictest17299-21snmpd08:30:052
273839942,1cyclictest32301-21expr07:20:151
273769942,1cyclictest30415-21grep08:35:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional