You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 06:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot0.osadl.org (updated Sun Nov 16, 2025 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44821570,28sleep150-21swapper/1519:07:357
1661921400,2sleep21-21systemd23:55:238
33892124104,14sleep120-21swapper/1219:12:054
33842124104,13sleep70-21swapper/719:12:0013
32762115107,4sleep50-21swapper/519:11:1011
860211187,17sleep00-21swapper/019:07:370
2878421100,2sleep00-21swapper/022:47:410
2878421100,2sleep00-21swapper/022:47:410
3362210374,24sleep30-21swapper/319:11:409
949221010,6sleep12404599cyclictest21:15:524
3162421010,0sleep20-21swapper/221:21:358
261692990,1sleep40-21swapper/423:20:2310
301862970,1sleep30-21swapper/323:09:409
81512950,1sleep140-21swapper/1421:26:046
34292950,1sleep80-21swapper/823:03:0414
147272940,4sleep3403299cyclictest23:55:089
8982930,0sleep80-21swapper/823:35:2514
56722930,6sleep14404899cyclictest22:05:236
244652930,0sleep9881rcuc/921:13:5715
303412910,1sleep100-21swapper/1022:18:262
317129066,20sleep140-21swapper/1419:09:436
340228972,4sleep40-21swapper/419:12:1310
4042880,1sleep00-21swapper/021:14:520
338328877,7sleep60-21swapper/619:11:5912
60192870,1sleep110-21swapper/1123:21:503
3227928772,11sleep110-21swapper/1119:07:323
318122870,2sleep3403299cyclictest22:44:319
318122870,2sleep3403299cyclictest22:44:319
304328776,7sleep10-21swapper/119:08:101
222632870,1sleep100-21swapper/1000:23:202
338528568,12sleep80-21swapper/819:12:0114
271972840,1sleep50-21swapper/522:40:1711
271972840,1sleep50-21swapper/522:40:1711
67672830,1sleep126770-21systemd-cgroups21:18:494
328228375,4sleep100-21swapper/1019:11:152
324428375,4sleep130-21swapper/1319:10:465
306828375,4sleep90-21swapper/919:08:3415
304428372,6sleep20-21swapper/219:08:118
13922830,5sleep6403599cyclictest21:14:5812
255562810,1sleep140-21swapper/1400:03:206
69152790,0sleep140-21swapper/1422:27:036
278122790,0sleep150-21swapper/1500:07:227
324782740,5sleep5403499cyclictest21:02:3911
26542740,0sleep80-21swapper/821:54:0314
121742720,1sleep121121rcuc/1223:47:324
225112680,6sleep11404499cyclictest19:32:393
241362620,0sleep70-21swapper/700:27:1813
217932620,0sleep10-21swapper/100:19:581
229702590,2sleep01068-21dbus-daemon00:06:510
243432550,1sleep00-21swapper/020:52:410
1139099540,0rtkit-daemon0-21swapper/1521:07:377
1139099510,2rtkit-daemon11389-21rtkit-daemon22:20:464
152362470,1sleep140-21swapper/1421:34:066
1139099470,24rtkit-daemon29685-21systemd-cgroups22:25:564
404899461,2cyclictest0-21swapper/1421:37:316
1139099460,1rtkit-daemon0-21swapper/719:32:447
403599455,38cyclictest15065-21sshd23:47:4112
4035994513,25cyclictest1255-21kill22:41:0612
4035994513,25cyclictest1255-21kill22:41:0612
4035994512,27cyclictest0-21swapper/623:38:2112
403399451,41cyclictest28948-21sshd00:35:1810
403599449,33cyclictest0-21swapper/621:34:5412
403599448,34cyclictest0-21swapper/622:27:4212
4035994416,26cyclictest0-21swapper/622:53:3712
4035994416,26cyclictest0-21swapper/622:53:3712
4035994413,22cyclictest0-21swapper/621:31:2712
4035994411,28cyclictest162021sd-pam23:26:1712
4048994315,4cyclictest11341-21sshd23:07:386
403599438,33cyclictest0-21swapper/621:41:5612
403599436,29cyclictest0-21swapper/621:55:2412
4035994315,26cyclictest0-21swapper/623:08:5612
4035994310,30cyclictest0-21swapper/621:21:5412
4033994314,3cyclictest0-21swapper/422:23:3210
403399430,2cyclictest0-21swapper/423:32:2310
404899420,2cyclictest0-21swapper/1423:52:326
403599429,31cyclictest1-21systemd22:11:4512
403599428,26cyclictest0-21swapper/623:56:0312
403599424,31cyclictest22001-21sshd00:34:2912
4035994213,14cyclictest11623-21env22:20:0712
4035994211,22cyclictest0-21swapper/623:13:4612
403599419,30cyclictest0-21swapper/622:59:3312
403599419,30cyclictest0-21swapper/621:58:1712
4035994115,23cyclictest14888-21cp00:26:1412
4035994113,26cyclictest12907-21run-parts00:40:3712
4035994113,22cyclictest0-21swapper/622:47:1712
4035994113,22cyclictest0-21swapper/622:47:1712
4035994111,27cyclictest26941-21systemctl22:36:2412
4035994111,27cyclictest26941-21systemctl22:36:2412
4033994114,4cyclictest25014-21sh23:48:4410
403399410,17cyclictest0-21swapper/423:16:0410
403399410,16cyclictest0-21swapper/400:13:3610
203502410,5sleep0402799cyclictest22:13:430
403699403,30cyclictest0-21swapper/723:47:2113
4035994013,25cyclictest6548-21sshd23:43:1012
4035994013,20cyclictest0-21swapper/623:34:3612
4035994012,26cyclictest28368-21sshd00:20:4312
403399400,1cyclictest0-21swapper/421:22:5310
403699395,26cyclictest5590-21grep23:57:4113
403699392,30cyclictest0-21swapper/721:13:1313
403599397,26cyclictest0-21swapper/600:07:5112
403599395,25cyclictest0-21swapper/621:49:5212
4035993912,19cyclictest0-21swapper/623:58:3712
4035993911,26cyclictest0-21swapper/623:03:4812
4035993911,21cyclictest1-21systemd22:14:0012
403399390,18cyclictest30535-21sshd21:21:2910
403399390,17cyclictest0-21swapper/400:07:3310
403599385,31cyclictest0-21swapper/623:29:4212
4035993825,10cyclictest32168-21tune2fs21:02:3512
4035993814,22cyclictest0-21swapper/621:42:3812
4035993814,22cyclictest0-21swapper/600:27:2912
4035993813,23cyclictest1297-21sshd21:24:0112
4035993812,19cyclictest13171-21systemd-cgroups22:02:3412
4035993811,24cyclictest26685-21sshd22:47:3312
4035993811,24cyclictest26685-21sshd22:47:3312
4035993810,25cyclictest11818-21sshd22:23:5212
4033993812,4cyclictest613-21sh22:41:0110
4033993812,4cyclictest613-21sh22:41:0110
403399380,3cyclictest18855-21systemd-cgroups22:31:5610
403699379,21cyclictest8734-21cpuspeed_turbos21:22:3113
403699377,22cyclictest0-21swapper/722:33:4413
403699377,22cyclictest0-21swapper/722:33:4413
4035993716,19cyclictest1349-21nfsd00:02:3912
4035993716,15cyclictest1078-21ptp4l20:03:1512
4035993716,15cyclictest1078-21ptp4l20:03:1512
4035993713,22cyclictest0-21swapper/619:32:4912
4035993712,23cyclictest0-21swapper/620:33:0612
4035993711,24cyclictest3595-21rm23:17:4012
403399370,16cyclictest0-21swapper/423:27:5510
1139099370,4rtkit-daemon0-21swapper/422:04:2310
1139099370,24rtkit-daemon0-21swapper/1521:45:137
4048993614,3cyclictest25863-21run-parts23:34:276
403699366,13cyclictest0-21swapper/700:17:3213
403699364,29cyclictest525-21systemd-journal22:28:3513
403699364,24cyclictest5251systemd-journal00:37:5713
403699363,30cyclictest32385-21systemd22:11:4513
403699362,31cyclictest2754-21sh22:59:3313
403699361,27cyclictest15373-21systemd-cgroups22:53:0913
403699361,27cyclictest15373-21systemd-cgroups22:53:0913
4035993619,16cyclictest0-21swapper/619:22:3812
4035993619,15cyclictest26501-21updatedb.mlocat00:12:2212
4035993618,16cyclictest0-21swapper/619:57:4412
4035993617,18cyclictest0-21swapper/619:47:3012
4035993617,17cyclictest0-21swapper/620:42:4512
4035993616,18cyclictest0-21swapper/620:40:2812
4035993615,19cyclictest0-21swapper/620:52:4512
4035993614,20cyclictest12286-21cat19:22:1912
4035993612,23cyclictest0-21swapper/620:12:2112
4035993612,23cyclictest0-21swapper/620:12:2112
4035993612,21cyclictest0-21swapper/621:07:3512
4033993612,4cyclictest31742-21systemd23:57:1510
403399360,15cyclictest0-21swapper/423:11:1810
248042360,0sleep20-21swapper/223:23:338
403699354,29cyclictest0-21swapper/721:34:1113
4036993518,15cyclictest0-21swapper/721:44:2713
4035993518,15cyclictest0-21swapper/620:47:4012
4035993516,18cyclictest0-21swapper/619:42:3812
4035993516,17cyclictest0-21swapper/620:22:2012
4035993516,17cyclictest0-21swapper/620:22:2012
4035993515,15cyclictest0-21swapper/619:37:3712
4035993514,20cyclictest0-21swapper/620:07:3512
4035993514,20cyclictest0-21swapper/620:07:3512
4035993514,19cyclictest0-21swapper/619:52:1912
4035993512,21cyclictest0-21swapper/620:27:4412
4035993512,18cyclictest281961nfsd420:17:4312
4035993512,18cyclictest281961nfsd420:17:4312
4035993512,17cyclictest0-21swapper/619:32:1912
403699346,26cyclictest0-21swapper/722:52:1413
403699346,26cyclictest0-21swapper/722:52:1413
403699345,26cyclictest22187-21sshd00:30:4513
403699343,28cyclictest1-21systemd23:07:3713
403699341,25cyclictest0-21swapper/723:52:2613
4035993415,17cyclictest0-21swapper/619:12:4412
4035993411,21cyclictest0-21swapper/620:57:4912
403399340,1cyclictest0-21swapper/423:58:4610
403699336,21cyclictest0-21swapper/700:14:5813
403699333,23cyclictest0-21swapper/721:56:2313
403699333,21cyclictest0-21swapper/721:27:4113
403699332,29cyclictest0-21swapper/719:27:5413
4036993316,14cyclictest1-21systemd21:37:2713
403699331,29cyclictest19238-21sshd23:22:5713
4033993314,2cyclictest0-21swapper/422:10:2010
4033993311,5cyclictest27751-21sh22:47:3610
4033993311,5cyclictest27751-21sh22:47:3610
4033993311,3cyclictest9794-2110-uname21:15:5510
403399330,15cyclictest0-21swapper/421:54:5510
319302330,1sleep100-21swapper/1000:27:532
315922330,0sleep130-21swapper/1323:09:505
1139099330,0rtkit-daemon0-21swapper/1520:53:457
58252320,0sleep5571ktimersoftd/522:56:0311
58252320,0sleep5571ktimersoftd/522:56:0311
403699327,22cyclictest25413-21cp23:12:4013
403699325,25cyclictest15237-21systemd22:16:5313
403699324,25cyclictest26861-21sshd22:22:0413
403699324,25cyclictest25886-21cp23:34:2813
403699324,21cyclictest0-21swapper/700:33:5813
403699323,21cyclictest0-21swapper/723:30:3013
4036993224,2cyclictest0-21swapper/721:58:3813
403699322,23cyclictest7344-21systemd-cgroups23:43:1613
403699322,23cyclictest0-21swapper/723:41:4213
4036993214,15cyclictest0-21swapper/723:06:2013
4036993212,14cyclictest0-21swapper/700:12:0513
403399320,1cyclictest0-21swapper/400:38:1710
31792320,27sleep120-21swapper/1200:17:464
314352320,2sleep20-21swapper/222:00:558
1139099320,1rtkit-daemon0-21swapper/1223:55:114
46182310,1sleep100-21swapper/1019:12:362
403699318,17cyclictest12973-21sshd21:48:0213
403699317,22cyclictest15936-21sh21:19:4913
403699311,27cyclictest26268-21systemd-cgroups22:03:5313
403699311,22cyclictest0-21swapper/722:44:0713
403699311,22cyclictest0-21swapper/722:44:0713
4033993113,3cyclictest8743-21run-parts23:00:1910
4033993113,3cyclictest31472-21uname22:55:0910
4033993113,3cyclictest31472-21uname22:55:0910
204212310,1sleep50-21swapper/521:27:3311
1139099310,1rtkit-daemon0-21swapper/1521:35:477
45272300,1sleep20-21swapper/223:10:278
403699307,20cyclictest922-21env22:22:3913
403699304,23cyclictest3661-21/usr/sbin/munin22:37:4313
403699304,23cyclictest3661-21/usr/sbin/munin22:37:4313
58092290,25sleep135911-21cron23:32:195
403699299,17cyclictest1350-21nfsd19:37:4313
403699298,18cyclictest1-21systemd23:19:3213
403699293,23cyclictest14156-21pnmscale00:02:2113
403499290,27cyclictest0-21swapper/521:07:3211
4033992913,2cyclictest0-21swapper/400:23:4010
4033992910,4cyclictest22119-2110-uname00:06:4610
288292290,25sleep100-21swapper/1022:54:492
288292290,25sleep100-21swapper/1022:54:492
284872290,2sleep10-21swapper/122:32:441
284872290,2sleep10-21swapper/122:32:441
271362290,1sleep1241ktimersoftd/122:51:101
271362290,1sleep1241ktimersoftd/122:51:101
184452290,25sleep30-21swapper/323:51:569
160962290,25sleep20-21swapper/223:58:538
118072290,1sleep80-21swapper/822:16:3214
1139099290,0rtkit-daemon0-21swapper/1521:16:257
95772280,1sleep3401ktimersoftd/322:42:079
95772280,1sleep3401ktimersoftd/322:42:079
77462280,3sleep127893-21sh23:00:124
48982280,24sleep110-21swapper/1121:50:553
404899283,3cyclictest1-21systemd21:52:576
403699289,16cyclictest0-21swapper/720:07:3413
403699289,16cyclictest0-21swapper/720:07:3413
4033992811,4cyclictest4310-21run-parts23:46:4310
39792280,1sleep90-21swapper/923:28:1415
160542280,2sleep813183-21cups-browsed21:41:1414
134062280,2sleep913392-21sshd23:44:0015
129512280,25sleep110-21swapper/1100:26:023
128822280,1sleep00-21swapper/022:46:050
128822280,1sleep00-21swapper/022:46:050
1139099280,2rtkit-daemon1078-21ptp4l20:24:417
1139099280,2rtkit-daemon1078-21ptp4l20:24:417
1139099280,20rtkit-daemon2748-21ngircd20:39:357
110902280,24sleep110-21swapper/1122:20:043
403699277,18cyclictest0-21swapper/720:44:4013
403699277,18cyclictest0-21swapper/719:57:5813
403699277,17cyclictest23573-21grep19:32:4913
403699277,17cyclictest0-21swapper/719:42:3913
403699276,18cyclictest5082-21sensors_fan21:07:4513
4036992715,9cyclictest32503-21sed21:02:3913
326712270,23sleep130-21swapper/1322:11:485
263712270,1sleep80-21swapper/822:36:2014
263712270,1sleep80-21swapper/822:36:2014
244562270,1sleep30-21swapper/323:05:409
8132260,24sleep100-21swapper/1020:22:552
8132260,24sleep100-21swapper/1020:22:552
5582260,1sleep20-21swapper/200:04:138
404899264,3cyclictest1708-21sshd21:47:066
403699269,15cyclictest0-21swapper/720:12:3813
403699269,15cyclictest0-21swapper/720:12:3813
403699269,15cyclictest0-21swapper/719:12:2313
403699268,16cyclictest0-21swapper/720:22:3113
403699268,16cyclictest0-21swapper/720:22:3113
403699267,17cyclictest0-21swapper/719:52:3713
403699266,18cyclictest0-21swapper/720:52:2113
403699266,18cyclictest0-21swapper/720:47:4413
403699266,18cyclictest0-21swapper/720:33:0613
403699266,18cyclictest0-21swapper/719:47:5113
403699266,18cyclictest0-21swapper/719:17:5113
403699266,17cyclictest1351-21nfsd20:02:2913
403699266,17cyclictest1351-21nfsd20:02:2913
403699265,19cyclictest0-21swapper/720:28:2513
403699265,19cyclictest0-21swapper/720:17:5913
403699265,19cyclictest0-21swapper/720:17:5913
403699265,18cyclictest12234-21cut20:37:4313
306852260,22sleep30-21swapper/322:29:349
26222260,1sleep50-21swapper/522:59:3211
241912260,1sleep10-21swapper/121:20:471
228432260,1sleep150-21swapper/1521:23:587
226322260,1sleep90-21swapper/922:35:4815
226322260,1sleep90-21swapper/922:35:4815
189782260,22sleep20-21swapper/222:57:388
152232260,1sleep50-21swapper/521:23:0011
139432260,1sleep00-21swapper/022:31:230
130752260,23sleep110-21swapper/1122:42:323
130752260,23sleep110-21swapper/1122:42:323
1139099260,0rtkit-daemon0-21swapper/1223:23:384
58202250,2sleep10-21swapper/123:54:031
404899250,7cyclictest0-21swapper/1400:02:146
403699256,17cyclictest0-21swapper/719:24:4113
403699255,18cyclictest26599-21egrep20:57:3613
264902250,1sleep100-21swapper/1023:56:362
226342250,1sleep90-21swapper/922:28:3515
135002250,21sleep30-21swapper/321:48:069
118912250,1sleep90-21swapper/923:18:3615
110282250,1sleep20-21swapper/221:33:398
49382240,1sleep120-21swapper/1223:43:004
404599240,17cyclictest0-21swapper/1223:22:194
403999240,2cyclictest0-21swapper/923:23:4415
403399240,1cyclictest0-21swapper/423:06:3210
37832240,20sleep80-21swapper/800:04:3614
326402240,1sleep5561rcuc/523:09:5811
284282240,22sleep30-21swapper/319:42:099
258692240,1sleep150-21swapper/1523:38:137
254242240,2sleep130-21swapper/1300:03:205
174412240,20sleep130-21swapper/1322:57:335
159232240,3sleep111068-21dbus-daemon21:30:513
149772240,2sleep140-21swapper/1400:15:246
141772240,2sleep110-21swapper/1121:16:243
137012240,1sleep121121rcuc/1200:22:344
1139099240,6rtkit-daemon2420-21cut00:12:484
1139099240,1rtkit-daemon0-21swapper/721:29:077
1139099240,0rtkit-daemon0-21swapper/1520:21:447
1139099240,0rtkit-daemon0-21swapper/1520:21:447
51372230,2sleep130-21swapper/1322:33:435
51372230,2sleep130-21swapper/1322:33:435
50562230,1sleep130-21swapper/1300:21:485
402799231,20cyclictest1-21systemd21:19:420
320052230,19sleep00-21swapper/023:09:540
29912230,0sleep100-21swapper/1023:24:452
287642230,2sleep1241ktimersoftd/121:46:271
227872230,20sleep100-21swapper/1023:37:532
222822230,0sleep150-21swapper/1523:26:597
215992230,1sleep40-21swapper/420:49:3310
214162230,1sleep50-21swapper/521:13:3811
190932231,3sleep1119235-21uname23:05:003
167892230,1sleep10-21swapper/122:53:201
167892230,1sleep10-21swapper/122:53:201
145592230,0sleep80-21swapper/822:02:3714
135222230,1sleep10-21swapper/100:29:371
132532230,2sleep1513394-21sshd00:29:357
113942230,1sleep30-21swapper/321:55:039
1139099230,1rtkit-daemon7340-21munin-node20:12:187
1139099230,1rtkit-daemon7340-21munin-node20:12:187
1139099230,1rtkit-daemon0-21swapper/422:13:164
83772220,1sleep5571ktimersoftd/500:40:0611
60512221,17sleep115467-21gdbus23:39:463
49732220,18sleep5525-21systemd-journal22:15:4111
405099229,8cyclictest141rcu_sched22:37:277
405099229,8cyclictest141rcu_sched22:37:277
4050992216,4cyclictest4297-21run-parts22:26:467
404599221,11cyclictest10947-21sshd22:42:184
404599221,11cyclictest10947-21sshd22:42:184
404599220,19cyclictest19696-21kworker/12:322:55:004
404599220,19cyclictest19696-21kworker/12:322:55:004
4044992217,3cyclictest1068-21dbus-daemon22:56:473
4044992217,3cyclictest1068-21dbus-daemon22:56:473
403999220,20cyclictest1238-21gdbus23:47:2115
4034992217,3cyclictest24991-21sshd21:20:5211
4034992216,4cyclictest25505-21sh21:56:4611
263372220,2sleep50-21swapper/522:25:3511
215022220,1sleep20-21swapper/200:41:398
179802220,1sleep10-21swapper/100:09:501
152072220,1sleep31068-21dbus-daemon00:37:249
1139099220,3rtkit-daemon8827-21systemctl22:19:4610
61442211,2sleep25464-21packagekitd23:50:198
4050992113,3cyclictest16989-21sshd00:22:457
4048992114,4cyclictest7548-21sshd21:51:136
404899211,18cyclictest0-21swapper/1422:30:556
404899210,19cyclictest0-21swapper/1422:57:196
404899210,19cyclictest0-21swapper/1422:57:196
404699212,17cyclictest15905-21systemctl22:27:515
4046992114,4cyclictest9120-21sshd22:37:535
4046992114,4cyclictest9120-21sshd22:37:535
4045992117,2cyclictest0-21swapper/1222:02:354
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional