You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 09:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot0.osadl.org (updated Wed Nov 26, 2025 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
566721490,6sleep141849199cyclictest22:34:536
2304921420,7sleep21847599cyclictest21:26:298
177022133116,13sleep90-21swapper/919:09:1115
177882124105,15sleep00-21swapper/019:10:060
448321170,26sleep31847699cyclictest23:31:249
277421080,1sleep30-21swapper/300:05:079
17745210790,12sleep120-21swapper/1219:09:304
17641210682,19sleep40-21swapper/419:08:1710
11390991010,94rtkit-daemon0-21swapper/1319:08:415
46152990,1sleep110-21swapper/1123:05:043
46152990,1sleep110-21swapper/1123:05:043
311312980,1sleep20-21swapper/221:31:188
123412980,1sleep90-21swapper/922:47:0715
1775829674,17sleep70-21swapper/719:09:4113
147582940,1sleep50-21swapper/500:24:0811
316922930,1sleep40-21swapper/422:19:1310
199882930,1sleep120-21swapper/1221:55:324
322412920,6sleep131848999cyclictest00:04:445
214912920,1sleep20-21swapper/200:40:088
123952920,1sleep20-21swapper/222:02:038
136712910,1sleep120-21swapper/1223:36:064
29652900,1sleep110-21swapper/1122:00:523
117282900,1sleep60-21swapper/621:43:0812
310892890,1sleep30-21swapper/322:11:589
1795628981,4sleep30-21swapper/319:11:459
1789628981,4sleep110-21swapper/1119:11:373
1787028972,4sleep50-21swapper/519:11:1511
1767328981,4sleep10-21swapper/119:08:461
161592890,1sleep110-21swapper/1122:13:433
270992880,0sleep140-21swapper/1423:30:156
1767828776,7sleep60-21swapper/619:08:5112
1798828672,4sleep140-21swapper/1419:12:126
191452850,1sleep30-21swapper/321:07:479
13032840,1sleep80-21swapper/823:42:2714
1783528272,6sleep100-21swapper/1019:10:482
1781628274,4sleep80-21swapper/819:10:3014
1778628272,6sleep150-21swapper/1519:10:057
183972810,0sleep30-21swapper/321:33:119
255532800,0sleep00-21swapper/000:07:440
1772128072,4sleep20-21swapper/219:09:208
144772800,1sleep151849299cyclictest22:58:117
144772800,1sleep151849299cyclictest22:58:117
61002790,0sleep60-21swapper/600:27:0612
24052750,0sleep110-21swapper/1121:49:543
152022720,0sleep80-21swapper/823:13:3414
152022720,0sleep80-21swapper/823:13:3414
241862710,7sleep91848599cyclictest22:33:1215
310862620,6sleep01847099cyclictest22:19:090
70862600,4sleep21847599cyclictest22:46:278
1849199550,2cyclictest0-21swapper/1423:07:456
1849199550,2cyclictest0-21swapper/1423:07:456
181742550,0sleep120-21swapper/1200:32:164
1849199510,49cyclictest0-21swapper/1422:03:336
1849199510,48cyclictest0-21swapper/1423:23:096
1847699510,42cyclictest12432-21sshd23:58:139
1847499511,39cyclictest6974-21df_abs22:12:441
1847499511,39cyclictest445-21sshd22:49:181
1847499510,39cyclictest15354-21systemd-cgroups23:13:351
1847499510,39cyclictest15354-21systemd-cgroups23:13:351
166362510,21sleep31847699cyclictest21:55:079
1849199500,46cyclictest12789-21ystemctl23:43:326
1849199500,43cyclictest6618-21kworker/u34:223:57:426
1847499500,41cyclictest3196-21taskset21:53:291
1139099500,1rtkit-daemon0-21swapper/521:17:0411
1847499490,41cyclictest0-21swapper/122:47:171
1847499490,40cyclictest0-21swapper/121:44:091
1847499490,40cyclictest0-21swapper/121:24:551
1847499490,39cyclictest0-21swapper/123:36:281
1847499490,37cyclictest1068-21dbus-daemon23:17:291
1847499490,37cyclictest1068-21dbus-daemon23:17:291
1849199482,41cyclictest1-21systemd22:48:096
1849199481,40cyclictest7767-21run-parts21:28:206
1849199481,39cyclictest1068-21dbus-daemon21:57:566
1849199480,39cyclictest0-21swapper/1421:23:326
1849199480,2cyclictest0-21swapper/1400:33:016
1849199480,2cyclictest0-21swapper/1400:31:466
1847499481,45cyclictest1233-21gdbus00:26:221
1847499481,36cyclictest525-21systemd-journal00:16:121
1847499480,46cyclictest0-21swapper/123:38:481
1847499480,46cyclictest0-21swapper/100:37:131
1847499480,42cyclictest0-21swapper/121:29:431
1847499480,42cyclictest0-21swapper/100:38:571
1847499480,41cyclictest10606-21systemd-cgroups00:31:201
1847499480,41cyclictest0-21swapper/123:57:491
1847499480,40cyclictest0-21swapper/122:17:501
1847499480,38cyclictest1-21systemd00:22:131
35022470,2sleep150-21swapper/1521:57:287
1849199470,37cyclictest1069-21NetworkManager21:48:526
1849199470,34cyclictest303261kill00:04:296
1849199470,2cyclictest0-21swapper/1423:51:266
1849199470,2cyclictest0-21swapper/1423:13:056
1849199470,2cyclictest0-21swapper/1423:13:056
1849199470,1cyclictest0-21swapper/1422:46:336
1849199470,1cyclictest0-21swapper/1422:24:096
1849199470,1cyclictest0-21swapper/1421:33:096
1849199470,1cyclictest0-21swapper/1421:13:026
1847499471,39cyclictest17328-21systemd21:18:391
1847499470,45cyclictest0-21swapper/122:58:241
1847499470,45cyclictest0-21swapper/122:58:241
1847499470,45cyclictest0-21swapper/122:02:161
1847499470,45cyclictest0-21swapper/121:15:461
1847499470,41cyclictest0-21swapper/123:43:201
1847499470,40cyclictest5251systemd-journal23:08:231
1847499470,40cyclictest5251systemd-journal23:08:231
1847499470,39cyclictest24211-21systemd22:03:091
1847499470,37cyclictest0-21swapper/123:03:491
1847499470,37cyclictest0-21swapper/123:03:491
1847499470,35cyclictest0-21swapper/122:23:311
1847499470,35cyclictest0-21swapper/121:40:491
1849199463,41cyclictest13619-2110-uname22:28:276
1849199463,40cyclictest0-21swapper/1421:53:086
1849199462,41cyclictest5467-21gdbus22:12:556
18491994611,27cyclictest1-21systemd22:56:046
1849199460,43cyclictest1068-21dbus-daemon21:45:066
1849199460,2cyclictest11588-21sshd22:20:416
1849199460,2cyclictest0-21swapper/1423:36:186
1849199460,2cyclictest0-21swapper/1423:18:076
1849199460,2cyclictest0-21swapper/1423:18:076
1849199460,1cyclictest0-21swapper/1423:38:486
1847499460,43cyclictest1-21systemd22:53:051
1847499460,43cyclictest0-21swapper/123:28:511
1847499460,43cyclictest0-21swapper/123:23:091
1847499460,40cyclictest0-21swapper/122:35:471
1847499460,39cyclictest0-21swapper/122:37:361
1847499460,37cyclictest0-21swapper/122:07:411
1847499460,36cyclictest0-21swapper/121:47:351
1849199450,2cyclictest0-21swapper/1422:08:316
1849199450,2cyclictest0-21swapper/1421:17:536
1849199450,2cyclictest0-21swapper/1420:48:296
1849199450,2cyclictest0-21swapper/1400:40:266
1849199450,2cyclictest0-21swapper/1400:19:186
1849199450,2cyclictest0-21swapper/1400:11:456
1849199450,1cyclictest0-21swapper/1422:39:496
1849199450,1cyclictest0-21swapper/1400:23:186
1847699456,3cyclictest4035-21gdbus23:42:039
1847499450,43cyclictest0-21swapper/100:02:351
1847499450,38cyclictest0-21swapper/123:53:581
1847499450,37cyclictest0-21swapper/121:33:041
1847499450,36cyclictest0-21swapper/123:49:491
1849199442,40cyclictest832-21jbd2/md125-820:32:406
1849199442,40cyclictest832-21jbd2/md125-820:32:406
1849199441,40cyclictest4500-21ystemctl21:38:486
1849199440,2cyclictest0-21swapper/1423:53:306
1849199440,2cyclictest0-21swapper/1423:03:086
1849199440,2cyclictest0-21swapper/1423:03:086
1849199440,2cyclictest0-21swapper/1420:37:456
1849199440,2cyclictest0-21swapper/1420:37:456
1849199440,2cyclictest0-21swapper/1400:13:216
1849199440,1cyclictest0-21swapper/1420:07:416
1849199440,1cyclictest0-21swapper/1419:56:336
1847799440,3cyclictest1-21systemd21:19:1710
1847699441,40cyclictest0-21swapper/300:36:309
18476994410,31cyclictest0-21swapper/322:32:379
1847699440,4cyclictest18400-21sshd23:06:459
1847699440,4cyclictest18400-21sshd23:06:459
1847499440,42cyclictest0-21swapper/122:29:171
1847499440,42cyclictest0-21swapper/100:11:461
1847499440,41cyclictest0-21swapper/120:12:431
1849199430,2cyclictest0-21swapper/1422:59:296
1849199430,2cyclictest0-21swapper/1422:59:296
1849199430,2cyclictest0-21swapper/1420:12:496
1849199430,2cyclictest0-21swapper/1419:48:336
1849199430,2cyclictest0-21swapper/1419:19:216
1848599431,39cyclictest6827-21cp00:34:3315
1848599431,39cyclictest1-21systemd21:28:4515
1847699430,40cyclictest0-21swapper/323:46:589
1847499430,40cyclictest0-21swapper/119:32:391
1849199420,2cyclictest0-21swapper/1421:02:546
1849199420,2cyclictest0-21swapper/1420:54:256
1849199420,2cyclictest0-21swapper/1420:46:536
1849199420,2cyclictest0-21swapper/1420:46:536
1849199420,2cyclictest0-21swapper/1420:27:536
1849199420,2cyclictest0-21swapper/1420:27:536
1849199420,2cyclictest0-21swapper/1419:57:566
1849199420,2cyclictest0-21swapper/1419:44:096
1849199420,26cyclictest96350irq/41-eth0-TxR21:07:466
1849199420,1cyclictest0-21swapper/1419:32:396
1848599428,3cyclictest1-21systemd22:16:1715
18485994214,26cyclictest27817-21sshd22:26:3115
18485994211,28cyclictest10468-21kill22:28:0315
1847699429,2cyclictest0-21swapper/321:25:429
1847699425,7cyclictest1245-21gdbus23:49:409
1847699420,40cyclictest0-21swapper/322:45:429
1849199410,38cyclictest0-21swapper/1420:17:416
1849199410,2cyclictest96350irq/41-eth0-TxR19:30:216
1849199410,2cyclictest0-21swapper/1420:57:416
1849199410,2cyclictest0-21swapper/1419:38:076
1849199410,2cyclictest0-21swapper/1419:22:526
1849199410,2cyclictest0-21swapper/1419:12:446
1848599418,3cyclictest21517-21sshd22:55:2415
1848599418,3cyclictest14209-2110-uname21:14:5815
18485994111,28cyclictest12074-21sshd21:43:1115
18485994111,27cyclictest1068-21dbus-daemon22:57:4815
18485994111,27cyclictest1068-21dbus-daemon22:57:4815
1848599410,10cyclictest5730-21sshd21:38:5715
1847699419,29cyclictest6254-21sh21:17:399
1847699413,7cyclictest0-21swapper/323:23:449
18476994112,27cyclictest0-21swapper/322:31:589
1847499410,39cyclictest0-21swapper/120:32:441
1847499410,39cyclictest0-21swapper/120:32:441
1847499410,39cyclictest0-21swapper/119:42:381
1849199400,2cyclictest0-21swapper/1420:22:406
1849199400,2cyclictest0-21swapper/1420:22:406
1849199400,2cyclictest0-21swapper/1420:02:526
1848599409,3cyclictest3020-21sshd23:08:3015
1848599409,3cyclictest3020-21sshd23:08:3015
1848599408,4cyclictest28542-21systemd00:00:2415
1848599408,3cyclictest1351-21nfsd21:59:3115
1848599408,3cyclictest1008-21sshd00:13:5715
1848599407,4cyclictest4410-2110-uname22:19:4915
1848599406,6cyclictest0-21swapper/922:38:4915
1848599404,6cyclictest9402-21gdbus23:27:2615
1848599402,10cyclictest1073-21systemd-logind23:42:3715
18485994010,4cyclictest18121-21sh00:02:5715
1847699409,28cyclictest22642-2110-uname21:15:559
1847699407,3cyclictest1-21systemd23:21:419
1847699407,3cyclictest1-21systemd23:21:419
1847699406,4cyclictest1233-21gdbus23:12:329
1847699406,4cyclictest1233-21gdbus23:12:329
1847699406,3cyclictest5467-21gdbus00:17:229
1847699406,3cyclictest27484-21sshd00:29:199
1847699405,2cyclictest0-21swapper/323:34:119
18476994014,24cyclictest20351-21sh21:52:079
1847499400,38cyclictest0-21swapper/121:00:321
1847499400,38cyclictest0-21swapper/120:19:491
1847499400,38cyclictest0-21swapper/119:47:451
1847499400,38cyclictest0-21swapper/119:37:411
1847499400,38cyclictest0-21swapper/119:27:411
1847499400,38cyclictest0-21swapper/119:17:501
1847499400,38cyclictest0-21swapper/119:14:021
18486993916,20cyclictest0-21swapper/1021:17:402
1848599399,4cyclictest706-21systemd00:26:2615
1848599398,3cyclictest1-21systemd22:09:0215
1848599397,3cyclictest20938-2110-uname21:33:3115
1848599396,4cyclictest20738-21sshd23:22:0515
1848599396,4cyclictest20738-21sshd23:22:0515
1848599396,4cyclictest1233-21gdbus23:35:0615
1848599396,3cyclictest1068-21dbus-daemon22:07:2515
1848599396,30cyclictest477-21jbd2/md124p1-823:38:5915
18485993912,24cyclictest5133-21systemd00:42:1215
1848599390,10cyclictest10339-21systemd21:17:5215
1847699399,4cyclictest28619-21sshd21:37:559
1847699398,7cyclictest9179-2110-uname22:12:539
1847699396,3cyclictest1234-21polkitd22:27:239
1847699396,3cyclictest1068-21dbus-daemon22:39:559
1847699396,3cyclictest1068-21dbus-daemon00:21:249
1847699394,6cyclictest1068-21dbus-daemon00:25:419
1847699390,36cyclictest1068-21dbus-daemon23:09:349
1847699390,36cyclictest1068-21dbus-daemon23:09:349
1847699390,13cyclictest0-21swapper/322:02:369
1847499392,35cyclictest0-21swapper/120:52:581
1847499390,37cyclictest0-21swapper/121:09:141
1847499390,37cyclictest0-21swapper/120:48:301
1847499390,37cyclictest0-21swapper/120:42:401
1847499390,37cyclictest0-21swapper/120:42:401
1847499390,37cyclictest0-21swapper/120:37:291
1847499390,37cyclictest0-21swapper/120:37:291
1847499390,37cyclictest0-21swapper/120:27:341
1847499390,37cyclictest0-21swapper/120:27:341
1847499390,37cyclictest0-21swapper/120:08:091
1847499390,37cyclictest0-21swapper/119:22:591
1847499390,35cyclictest28048-21cpu20:02:401
1847499390,34cyclictest0-21swapper/120:22:401
1847499390,34cyclictest0-21swapper/120:22:401
1847499390,33cyclictest0-21swapper/119:52:441
1848599387,4cyclictest27331-21uname23:30:1715
1848599386,4cyclictest9402-21gdbus00:28:0215
1848599386,3cyclictest1245-21gdbus23:48:5115
1848599380,10cyclictest22831-21sshd23:03:1015
1848599380,10cyclictest22831-21sshd23:03:1015
1847699388,4cyclictest27810-21sshd22:18:459
1847699386,3cyclictest96150irq/39-eth0-TxR23:55:179
1847699385,4cyclictest5467-21gdbus22:59:549
1847699385,4cyclictest5467-21gdbus22:59:549
1847699384,4cyclictest4294-2110-uname22:53:179
1847699383,4cyclictest3625-21kill21:27:519
1847499380,36cyclictest0-21swapper/121:02:581
1847499380,36cyclictest0-21swapper/119:57:471
1139099380,4rtkit-daemon0-21swapper/523:06:1511
1139099380,4rtkit-daemon0-21swapper/523:06:1511
1139099380,10rtkit-daemon0-21swapper/521:44:5711
1848699370,18cyclictest0-21swapper/1022:32:392
1848599379,2cyclictest0-21swapper/900:19:5915
1848599378,3cyclictest20592-21systemd21:52:0915
1848599378,3cyclictest17795-21run-parts21:25:5015
1848599376,4cyclictest5467-21gdbus23:15:2215
1848599376,4cyclictest5467-21gdbus23:15:2215
1848599371,6cyclictest0-21swapper/920:22:3915
1848599371,6cyclictest0-21swapper/920:22:3915
18485993711,24cyclictest1455-21sshd21:57:1415
1847699377,3cyclictest1-21systemd00:39:559
1847699374,4cyclictest7118-21sshd21:42:439
1847699371,7cyclictest1-21systemd00:07:409
152502370,1sleep80-21swapper/822:02:2614
1848599367,3cyclictest1245-21gdbus22:49:4715
1848599361,32cyclictest1282-21snmpd23:55:2115
1847699365,3cyclictest19318-2110-uname21:58:589
1847699364,3cyclictest1073-21systemd-logind22:50:109
176222360,2sleep15138-21ksoftirqd/1523:58:537
121222360,1sleep100-21swapper/1000:27:422
231592350,0sleep50-21swapper/521:33:4511
1848599355,4cyclictest1233-21gdbus00:07:5215
1848599350,7cyclictest0-21swapper/920:07:2315
1847699358,3cyclictest0-21swapper/320:57:489
165232340,2sleep7721rcuc/722:47:3713
1139099340,1rtkit-daemon0-21swapper/500:20:2211
296322330,7sleep51847999cyclictest22:41:2611
286372330,1sleep60-21swapper/623:26:5512
234882330,1sleep100-21swapper/1020:33:572
234882330,1sleep100-21swapper/1020:33:572
1848599337,3cyclictest19974-21fschecks_time19:12:4415
1847699335,3cyclictest16696-21cpuspeed_turbos20:27:419
1847699335,3cyclictest16696-21cpuspeed_turbos20:27:419
1847699334,3cyclictest32119-21cpu20:07:389
1139099330,0rtkit-daemon0-21swapper/519:12:4511
297782320,1sleep5571ktimersoftd/500:08:0511
1139099320,0rtkit-daemon0-21swapper/519:17:5211
216642310,2sleep110-21swapper/1123:37:113
1847799310,3cyclictest1238-21gdbus21:30:2310
1847699316,2cyclictest1350-21nfsd20:12:569
1847699311,4cyclictest0-21swapper/319:52:399
122362310,2sleep130-21swapper/1322:09:455
1139099310,18rtkit-daemon0-21swapper/521:24:4911
91112300,26sleep50-21swapper/500:05:5811
68222300,1sleep110-21swapper/1100:15:253
205002300,1sleep00-21swapper/023:07:010
205002300,1sleep00-21swapper/023:07:010
1848599304,3cyclictest0-21swapper/919:57:2815
1848199305,6cyclictest0-21swapper/723:22:3613
1848199304,10cyclictest0-21swapper/700:21:4813
18481993025,3cyclictest721rcuc/721:37:3113
1847699306,3cyclictest8076-21tune2fs19:37:449
1847099303,20cyclictest10-21ksoftirqd/022:59:370
1847099303,20cyclictest10-21ksoftirqd/022:59:370
79552290,2sleep77944-21sshd21:21:1313
321792290,1sleep50-21swapper/523:38:0811
227172290,7sleep21847599cyclictest23:07:198
227172290,7sleep21847599cyclictest23:07:198
1848599296,3cyclictest25439-21entropy20:37:4415
1848599296,3cyclictest25439-21entropy20:37:4415
18481992912,15cyclictest525-21systemd-journal23:13:2213
18481992912,15cyclictest525-21systemd-journal23:13:2213
1847699291,6cyclictest2416-21grep20:47:499
1847699290,3cyclictest83250jbd2/md125-820:37:539
1847699290,3cyclictest83250jbd2/md125-820:37:539
1847099293,19cyclictest0-21swapper/021:40:150
172532290,0sleep00-21swapper/021:36:530
211672280,1sleep100-21swapper/1000:17:332
1847699285,3cyclictest14834-21timerandwakeup20:22:569
1847699285,3cyclictest14834-21timerandwakeup20:22:569
1847699285,3cyclictest1361-21runrttasks20:55:139
1847699280,2cyclictest0-21swapper/319:22:489
1847599287,11cyclictest33-21ksoftirqd/223:42:108
154882280,1sleep70-21swapper/722:58:1913
154882280,1sleep70-21swapper/722:58:1913
1139099280,0rtkit-daemon0-21swapper/523:35:0511
45122270,1sleep120-21swapper/1221:24:154
40332270,0sleep70-21swapper/722:57:1413
314212270,20sleep130-21swapper/1321:41:555
275302270,1sleep150-21swapper/1522:15:087
236702270,2sleep60-21swapper/622:40:3912
1848599270,9cyclictest1282-21snmpd19:38:0915
1848199277,11cyclictest74-21ksoftirqd/723:47:3913
1848199277,11cyclictest74-21ksoftirqd/723:17:2813
1848199277,11cyclictest74-21ksoftirqd/723:17:2813
1848199277,10cyclictest74-21ksoftirqd/723:43:2713
1848199277,10cyclictest74-21ksoftirqd/700:41:3713
1847699276,3cyclictest13615-21switchtime19:42:569
1847599276,15cyclictest33-21ksoftirqd/200:23:298
1847599270,5cyclictest0-21swapper/222:52:188
1847099277,10cyclictest0-21swapper/000:29:160
1139099270,14rtkit-daemon1282-21snmpd20:58:2511
83022260,1sleep120-21swapper/1200:19:434
63292260,2sleep110-21swapper/1121:42:413
57752260,1sleep120-21swapper/1221:38:574
31172260,2sleep120-21swapper/1222:00:544
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional