You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 19:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot0.osadl.org (updated Thu Dec 04, 2025 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9745212193,23sleep130-21swapper/1319:09:085
9923211891,23sleep30-21swapper/319:11:399
235521120,1sleep102353-21sshd22:57:592
98221090,5sleep91046499cyclictest23:09:1215
9732210890,11sleep10-21swapper/119:08:561
762021050,1sleep60-21swapper/623:09:5712
9918210480,20sleep150-21swapper/1519:11:357
9928210172,24sleep80-21swapper/819:11:4414
9731210076,19sleep00-21swapper/019:08:550
966429986,8sleep90-21swapper/919:08:1615
40962990,1sleep20-21swapper/222:06:308
39932960,6sleep151047399cyclictest23:02:057
281162950,2sleep028117-21sshd00:01:290
281162950,2sleep028117-21sshd00:01:290
254922930,1sleep40-21swapper/400:12:4710
107472930,0sleep130-21swapper/1322:33:105
51642920,1sleep110-21swapper/1122:28:513
111462920,1sleep50-21swapper/522:58:5811
310172910,2sleep831016-21sshd23:08:5514
263152910,1sleep70-21swapper/722:09:0013
82392900,1sleep150-21swapper/1522:36:417
326032900,0sleep140-21swapper/1423:32:016
123052900,6sleep51045899cyclictest21:26:1011
123052900,6sleep51045899cyclictest21:26:1011
993128981,4sleep110-21swapper/1119:11:473
985628976,9sleep120-21swapper/1219:10:444
291932890,2sleep71068-21dbus-daemon23:16:0813
63402880,1sleep00-21swapper/021:22:040
63402880,1sleep00-21swapper/021:22:040
189222880,1sleep00-21swapper/022:15:340
120572880,1sleep110-21swapper/1121:48:283
978428772,11sleep140-21swapper/1419:09:426
65162870,1sleep21068-21dbus-daemon21:55:328
319672870,0sleep90-21swapper/923:31:5615
308852870,0sleep120-21swapper/1222:28:044
281162870,2sleep1496350irq/41-eth0-TxR00:12:576
986628676,6sleep50-21swapper/519:10:5311
85032860,0sleep140-21swapper/1423:17:356
32612860,0sleep20-21swapper/223:58:188
32612860,0sleep20-21swapper/223:58:188
300312860,6sleep141047299cyclictest21:24:276
300312860,6sleep141047299cyclictest21:24:276
11842860,0sleep10-21swapper/123:28:041
658028572,9sleep40-21swapper/419:07:3910
992728472,7sleep70-21swapper/719:11:4313
978928375,4sleep20-21swapper/219:09:468
976328375,4sleep100-21swapper/1019:09:212
973728372,7sleep60-21swapper/619:09:0112
76532830,2sleep91348-21nfsd00:38:1615
179012830,1sleep70-21swapper/720:37:4813
323762800,0sleep60-21swapper/622:09:4712
279162800,0sleep40-21swapper/422:09:1310
132142790,1sleep71046299cyclictest21:44:3913
53782640,1sleep15379-21systemd-cgroups22:13:581
184172630,0sleep90-21swapper/922:18:5515
56812620,1sleep20-21swapper/221:59:018
224732580,0sleep110-21swapper/1122:45:423
318392570,1sleep2321ktimersoftd/222:42:538
187582570,0sleep40-21swapper/421:19:4410
187582570,0sleep40-21swapper/421:19:4410
277712500,1sleep130-21swapper/1300:12:565
1139099460,12rtkit-daemon0-21swapper/1223:32:454
264932430,6sleep91046499cyclictest21:27:5015
264932430,6sleep91046499cyclictest21:27:5015
214622430,1sleep110-21swapper/1123:15:073
1139099430,0rtkit-daemon0-21swapper/1519:53:387
230312410,6sleep11045299cyclictest21:49:541
1139099400,1rtkit-daemon11389-21rtkit-daemon22:28:397
1139099400,15rtkit-daemon0-21swapper/1521:53:367
170652380,2sleep110-21swapper/1121:41:313
1139099380,22rtkit-daemon0-21swapper/1223:46:374
1045499381,2cyclictest0-21swapper/222:37:478
232742370,33sleep41-21systemd23:08:0410
1139099370,0rtkit-daemon0-21swapper/1521:13:267
1139099370,0rtkit-daemon0-21swapper/1521:13:267
82942360,1sleep90-21swapper/921:25:4215
82942360,1sleep90-21swapper/921:25:4215
1139099360,2rtkit-daemon26617-21systemd21:31:527
1139099360,2rtkit-daemon26617-21systemd21:31:527
1139099360,0rtkit-daemon0-21swapper/722:13:0713
1139099360,0rtkit-daemon0-21swapper/1523:09:347
1139099360,0rtkit-daemon0-21swapper/1521:25:237
1139099360,0rtkit-daemon0-21swapper/1521:25:237
304572350,2sleep100-21swapper/1023:35:102
10452993513,4cyclictest5947-21systemd00:23:091
307022340,3sleep330654-21sshd21:24:329
307022340,3sleep330654-21sshd21:24:329
114532340,7sleep449-21ksoftirqd/422:55:2910
1139099340,26rtkit-daemon1-21systemd00:09:5710
1139099340,11rtkit-daemon0-21swapper/720:53:5413
1139099330,1rtkit-daemon0-21swapper/400:22:5610
1139099330,0rtkit-daemon0-21swapper/1522:02:397
79662320,28sleep11068-21dbus-daemon00:34:411
246562320,2sleep30-21swapper/323:19:169
191502320,2sleep30-21swapper/323:37:449
158842320,28sleep100-21swapper/1000:24:242
134582320,1sleep120-21swapper/1221:59:594
1139099320,1rtkit-daemon0-21swapper/723:02:1113
218612310,2sleep40-21swapper/421:53:2710
114422310,27sleep40-21swapper/421:37:2410
47632300,26sleep84875-21systemd22:06:3714
308562300,26sleep101234-21polkitd22:09:362
252102300,1sleep100-21swapper/1000:29:122
165252300,1sleep3401ktimersoftd/323:29:589
159322300,1sleep30-21swapper/300:03:409
159322300,1sleep30-21swapper/300:03:409
159062300,0sleep130-21swapper/1300:39:255
121632301,2sleep141068-21dbus-daemon23:17:526
106322300,2sleep140-21swapper/1422:55:246
1045499302,25cyclictest8370-21run-parts22:58:388
82592290,26sleep60-21swapper/623:28:5812
72942290,25sleep127391-21systemd22:25:244
269982290,1sleep140-21swapper/1400:18:036
215382290,0sleep30-21swapper/321:31:139
215382290,0sleep30-21swapper/321:31:139
196082290,4sleep0121rcuc/023:41:410
18912290,1sleep80-21swapper/823:43:1014
151102290,25sleep70-21swapper/700:39:2013
1139099290,1rtkit-daemon0-21swapper/1520:28:137
1139099290,0rtkit-daemon0-21swapper/722:42:5913
1139099290,0rtkit-daemon0-21swapper/722:29:4913
1045499295,13cyclictest33-21ksoftirqd/223:13:138
92872280,1sleep110-21swapper/1122:07:123
268802280,1sleep20-21swapper/200:22:068
251742280,4sleep81046399cyclictest23:23:0614
251742280,4sleep81046399cyclictest23:23:0614
194972280,0sleep70-21swapper/722:00:4213
185572280,1sleep10-21swapper/122:00:371
167632280,24sleep120-21swapper/1221:16:084
167632280,24sleep120-21swapper/1221:16:084
165092280,6sleep21045499cyclictest23:26:128
165092280,6sleep21045499cyclictest23:26:128
1139099280,0rtkit-daemon0-21swapper/1521:52:177
1046499287,11cyclictest23771-21systemd-cgroups22:04:4915
3692270,23sleep150-21swapper/1522:17:107
36922270,1sleep133696-21uname00:09:435
33102270,1sleep111041rcuc/1122:51:033
323112270,1sleep140-21swapper/1423:57:586
323112270,1sleep140-21swapper/1423:57:586
302362270,0sleep50-21swapper/521:32:1911
302362270,0sleep50-21swapper/521:32:1911
255112271,3sleep1425617-21sshd22:19:496
189112270,24sleep110-21swapper/1123:03:383
187082270,2sleep90-21swapper/923:41:3415
14892271,22sleep100-21swapper/1021:28:402
14892271,22sleep100-21swapper/1021:28:402
141142270,22sleep30-21swapper/300:10:549
1139099270,0rtkit-daemon0-21swapper/1520:33:417
10467992710,7cyclictest131rcu_preempt00:38:183
1045499272,22cyclictest1234-21polkitd21:19:388
1045499272,22cyclictest1234-21polkitd21:19:388
87512260,1sleep60-21swapper/619:47:4712
67722260,22sleep120-21swapper/1222:14:104
326122260,2sleep30-21swapper/321:54:459
260672260,1sleep10-21swapper/122:57:191
256872260,2sleep110-21swapper/1123:19:253
177952260,22sleep00-21swapper/023:11:130
16892260,2sleep20-21swapper/200:33:538
122932260,9sleep990-21ksoftirqd/921:40:5715
1139099260,0rtkit-daemon0-21swapper/723:07:4713
1139099260,0rtkit-daemon0-21swapper/720:52:3513
105472260,0sleep40-21swapper/422:22:0310
10467992612,7cyclictest106-21ksoftirqd/1122:38:043
1046499267,11cyclictest1068-21dbus-daemon21:51:5115
1046499266,15cyclictest90-21ksoftirqd/922:51:4915
10464992623,2cyclictest881rcuc/923:32:5115
1046499261,19cyclictest23676-21systemd-cgroups22:56:5915
10462992620,4cyclictest29603-21systemd23:23:3913
10462992620,4cyclictest29603-21systemd23:23:3913
1045499267,10cyclictest0-21swapper/223:28:328
1045499265,12cyclictest0-21swapper/222:49:178
1045499263,20cyclictest13609-21sshd00:07:298
1045499263,20cyclictest13609-21sshd00:07:298
1045499262,18cyclictest74131sshd22:54:598
10454992612,11cyclictest18432-21gdbus00:25:558
1045499260,23cyclictest14707-21kworker/2:021:23:418
1045499260,23cyclictest14707-21kworker/2:021:23:418
95222250,0sleep80-21swapper/822:51:4814
56042250,2sleep12114-21ksoftirqd/1221:43:404
310372250,1sleep531036-21systemd-cgroups00:29:5511
29972250,22sleep70-21swapper/722:02:3513
187982250,1sleep80-21swapper/822:56:2214
18782250,21sleep11-21systemd22:24:411
164142250,21sleep80-21swapper/823:03:1914
1139099250,3rtkit-daemon11389-21rtkit-daemon00:05:144
1139099250,3rtkit-daemon11389-21rtkit-daemon00:05:144
1139099250,0rtkit-daemon0-21swapper/721:33:2913
10467992512,7cyclictest131rcu_preempt23:23:173
10467992512,7cyclictest131rcu_preempt23:23:173
10467992512,7cyclictest106-21ksoftirqd/1123:59:413
10467992512,7cyclictest106-21ksoftirqd/1123:59:413
1046499257,9cyclictest0-21swapper/900:13:1415
1046499257,12cyclictest1068-21dbus-daemon00:03:5515
1046499257,12cyclictest1068-21dbus-daemon00:03:5515
1046499257,10cyclictest90-21ksoftirqd/921:14:0815
1046499257,10cyclictest90-21ksoftirqd/921:14:0815
1046499255,12cyclictest90-21ksoftirqd/922:26:2115
10464992522,2cyclictest881rcuc/922:01:0515
1046299250,3cyclictest1068-21dbus-daemon23:22:3113
1045499258,12cyclictest28730-21sshd22:24:008
1045499256,17cyclictest321ktimersoftd/200:40:248
1045499256,10cyclictest0-21swapper/222:13:348
1045499255,7cyclictest0-21swapper/223:38:418
10454992516,5cyclictest1502750sshd22:33:408
10454992514,8cyclictest1068-21dbus-daemon21:35:098
63202240,1sleep120-21swapper/1221:40:114
309142240,1sleep00-21swapper/022:46:520
262582240,3sleep65467-21gdbus21:13:3812
262582240,3sleep65467-21gdbus21:13:3812
262262240,20sleep120-21swapper/1200:32:594
261372240,20sleep80-21swapper/822:01:3214
168372240,21sleep50-21swapper/500:11:1211
162912240,2sleep70-21swapper/723:03:1813
153302240,2sleep40-21swapper/421:30:2710
153302240,2sleep40-21swapper/421:30:2710
137602240,1sleep4471rcuc/423:17:5710
1139099240,0rtkit-daemon0-21swapper/720:42:4013
1139099240,0rtkit-daemon0-21swapper/1521:38:597
10832240,2sleep61084-21uname22:57:5512
108082240,22sleep00-21swapper/019:12:400
1046999241,21cyclictest0-21swapper/1321:47:435
10468992413,5cyclictest0-21swapper/1223:12:344
1046799245,17cyclictest0-21swapper/1100:25:443
10467992410,6cyclictest106-21ksoftirqd/1122:10:373
10467992410,6cyclictest106-21ksoftirqd/1121:55:393
1046499246,16cyclictest6047-21kworker/9:522:58:2915
1046499246,12cyclictest90-21ksoftirqd/900:27:4315
1046499246,11cyclictest90-21ksoftirqd/923:24:1215
1046499246,11cyclictest90-21ksoftirqd/923:24:1215
1046499246,11cyclictest90-21ksoftirqd/922:30:0415
1046499246,10cyclictest1073-21systemd-logind00:17:5015
1046499245,13cyclictest90-21ksoftirqd/921:18:3915
1046499245,13cyclictest90-21ksoftirqd/921:18:3915
1046499245,13cyclictest90-21ksoftirqd/900:10:0515
1046499243,9cyclictest90-21ksoftirqd/923:43:0215
10464992421,2cyclictest881rcuc/923:15:0115
10464992421,2cyclictest881rcuc/922:15:5815
1045599248,7cyclictest141rcu_sched21:36:549
10455992414,5cyclictest41-21ksoftirqd/323:45:429
10455992413,5cyclictest41-21ksoftirqd/323:02:309
10455992411,7cyclictest131rcu_preempt22:52:029
10455992411,5cyclictest131rcu_preempt22:17:239
1045499249,13cyclictest525-21systemd-journal23:08:458
1045499248,14cyclictest1042-17auditd22:29:598
1045499247,15cyclictest0-21swapper/221:12:498
1045499247,15cyclictest0-21swapper/221:12:498
1045499246,10cyclictest33-21ksoftirqd/223:34:568
1045499244,18cyclictest1068-21dbus-daemon23:56:388
1045499244,18cyclictest1068-21dbus-daemon23:56:388
1045499243,10cyclictest0-21swapper/222:07:398
1045499242,19cyclictest27295-21cp21:42:388
42262230,1sleep00-21swapper/021:36:320
39182230,1sleep130-21swapper/1320:18:245
301382230,1sleep80-21swapper/823:35:0914
3012230,1sleep120-21swapper/1220:54:124
26562230,5sleep81046399cyclictest20:57:5214
26562230,5sleep81046399cyclictest20:57:5214
243692230,19sleep140-21swapper/1422:12:366
231982230,1sleep150-21swapper/1523:45:587
22622230,1sleep140-21swapper/1400:22:516
207292230,2sleep620725-21systemd00:08:0012
192872231,2sleep719658-21sshd22:22:5513
189942230,1sleep50-21swapper/521:45:2611
171642230,1sleep13122-21ksoftirqd/1323:41:225
135632230,2sleep11-21systemd00:03:221
135632230,2sleep11-21systemd00:03:221
119762230,1sleep70-21swapper/700:31:3313
1047299233,18cyclictest1020-21ystemctl21:17:506
1047299233,18cyclictest1020-21ystemctl21:17:506
1046999231,20cyclictest1068-21dbus-daemon23:23:005
1046999231,20cyclictest1068-21dbus-daemon23:23:005
1046799238,8cyclictest106-21ksoftirqd/1121:36:033
1046799237,7cyclictest25872-21kworker/11:421:30:223
1046799237,7cyclictest25872-21kworker/11:421:30:223
10467992311,7cyclictest106-21ksoftirqd/1122:27:093
10467992310,5cyclictest131rcu_preempt21:44:013
1046499238,9cyclictest0-21swapper/923:05:1215
1046499237,8cyclictest18764-21sshd00:00:1515
1046499237,8cyclictest18764-21sshd00:00:1515
1046499237,7cyclictest22361-21systemd-cgroups23:52:5715
1046499237,7cyclictest22361-21systemd-cgroups23:52:5715
1046499237,10cyclictest90-21ksoftirqd/922:33:1315
1046499236,9cyclictest0-21swapper/900:35:3515
1046499235,10cyclictest422-21sshd23:50:3815
1046499235,10cyclictest422-21sshd23:50:3815
1046499234,12cyclictest90-21ksoftirqd/900:24:4115
1046499233,10cyclictest0-21swapper/921:32:4215
10462992318,3cyclictest1068-21dbus-daemon21:12:5213
10462992318,3cyclictest1068-21dbus-daemon21:12:5213
1046199234,3cyclictest1974-21tr00:37:5012
10456992317,4cyclictest28966-2110-uname22:01:5210
1045599239,7cyclictest141rcu_sched00:14:359
1045599239,6cyclictest131rcu_preempt22:21:599
1045599238,7cyclictest41-21ksoftirqd/323:51:339
1045599238,7cyclictest41-21ksoftirqd/323:51:339
1045599237,8cyclictest41-21ksoftirqd/300:34:559
1045599237,6cyclictest141rcu_sched22:45:439
1045599235,8cyclictest41-21ksoftirqd/323:58:089
1045599235,8cyclictest41-21ksoftirqd/323:58:089
1045599234,17cyclictest0-21swapper/300:25:449
10455992313,6cyclictest41-21ksoftirqd/322:53:309
10455992312,3cyclictest41-21ksoftirqd/322:23:539
10455992310,5cyclictest41-21ksoftirqd/321:43:339
1045499237,9cyclictest5464-21packagekitd00:14:428
1045499237,9cyclictest0-21swapper/221:51:028
1045499237,10cyclictest33-21ksoftirqd/223:43:078
1045499236,11cyclictest13111-21sshd23:02:578
1045499234,17cyclictest0-21swapper/200:11:028
10454992314,7cyclictest321ktimersoftd/222:19:018
1045499231,20cyclictest0-21swapper/200:27:468
1045499231,19cyclictest16131-21rm21:37:488
1045499230,20cyclictest16177-21sshd21:30:328
1045499230,20cyclictest16177-21sshd21:30:328
40492220,20sleep60-21swapper/620:19:5312
280572220,2sleep50-21swapper/522:09:1511
263912220,1sleep50-21swapper/519:28:4811
241202220,20sleep00-21swapper/020:05:530
213582220,18sleep01068-21dbus-daemon00:04:260
213582220,18sleep01068-21dbus-daemon00:04:260
192202220,1sleep6651ktimersoftd/622:26:5412
170402220,19sleep5525-21systemd-journal00:20:5011
1139099220,0rtkit-daemon0-21swapper/423:41:4310
1047299221,2cyclictest0-21swapper/1420:22:496
10468992218,2cyclictest0-21swapper/1221:53:444
10468992217,3cyclictest18825-21uname00:32:254
1046799229,7cyclictest131rcu_preempt21:18:233
1046799229,7cyclictest131rcu_preempt21:18:233
1046799229,7cyclictest106-21ksoftirqd/1123:52:203
1046799229,7cyclictest106-21ksoftirqd/1123:52:203
10467992212,5cyclictest131rcu_preempt23:53:513
10467992212,5cyclictest131rcu_preempt23:53:513
10467992211,6cyclictest131rcu_preempt00:07:293
10467992211,6cyclictest131rcu_preempt00:07:293
1046499227,9cyclictest90-21ksoftirqd/922:37:4015
1046499226,8cyclictest90-21ksoftirqd/921:43:3415
1046499224,10cyclictest0-21swapper/922:42:5115
1046499223,9cyclictest90-21ksoftirqd/921:53:1815
10464992217,3cyclictest96050irq/38-eth0-TxR20:27:5015
1046499221,12cyclictest0-21swapper/922:11:4015
10462992214,6cyclictest14706-21uname00:20:3213
1046199221,18cyclictest4633-21systemd23:20:5012
1045699220,20cyclictest0-21swapper/421:42:5810
1045599229,9cyclictest131rcu_preempt23:55:279
1045599229,9cyclictest131rcu_preempt23:55:279
1045599228,6cyclictest141rcu_sched22:38:239
1045599228,4cyclictest41-21ksoftirqd/322:30:429
10455992212,6cyclictest41-21ksoftirqd/323:35:179
10455992210,6cyclictest131rcu_preempt21:19:549
10455992210,6cyclictest131rcu_preempt21:19:549
10455992210,6cyclictest131rcu_preempt00:42:299
1045499225,10cyclictest33-21ksoftirqd/223:50:328
1045499225,10cyclictest33-21ksoftirqd/223:50:328
1045499224,8cyclictest0-21swapper/223:18:278
313432210,18sleep40-21swapper/423:31:5210
279572210,17sleep328073-21systemd23:04:519
26032210,1sleep30-21swapper/319:42:249
251222210,1sleep140-21swapper/1421:31:416
251222210,1sleep140-21swapper/1421:31:416
250882210,2sleep131-21systemd22:23:335
249732210,1sleep6651ktimersoftd/621:57:4512
227622210,2sleep422763-21sh23:34:1610
210952210,5sleep51045899cyclictest20:42:3511
193042210,2sleep1519303-21sshd00:04:087
193042210,2sleep1519303-21sshd00:04:087
163192210,2sleep130-21swapper/1322:48:425
118352210,1sleep110-21swapper/1121:15:353
118352210,1sleep110-21swapper/1121:15:353
1139099210,2rtkit-daemon11389-21rtkit-daemon00:11:434
1139099210,1rtkit-daemon0-21swapper/1521:29:0413
1139099210,1rtkit-daemon0-21swapper/1521:29:0413
1047399214,15cyclictest0-21swapper/1523:20:497
10473992116,3cyclictest477-21jbd2/md124p1-800:27:247
1047399210,18cyclictest0-21swapper/1500:18:097
1047299211,4cyclictest1068-21dbus-daemon23:25:386
1047299211,4cyclictest1068-21dbus-daemon23:25:386
10472992114,4cyclictest20860-21run-parts23:45:406
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional