You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 19:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon May 25, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
195562920,2sleep52903299cyclictest11:59:405
201262810,0sleep60-21swapper/611:57:576
2874827872,2sleep20-21swapper/207:07:152
151522710,0sleep30-21swapper/311:07:563
162762700,1sleep125-21ksoftirqd/110:56:571
266312630,1sleep30-21swapper/307:03:553
50992510,1sleep15098-21grep10:36:061
281452510,0sleep50-21swapper/511:03:095
23942500,0sleep00-21swapper/009:40:390
291192490,0sleep50-21swapper/510:55:495
188822490,0sleep40-21swapper/409:21:214
167732480,1sleep52903299cyclictest09:56:145
113472480,1sleep311346-21grepconf.sh10:30:563
112272480,0sleep70-21swapper/709:41:107
277892470,1sleep427784-21sshd10:46:354
260622470,0sleep10-21swapper/110:52:001
65162460,0sleep20-21swapper/209:46:262
32142450,0sleep30-21swapper/309:16:473
178122450,0sleep117810-21sshd09:23:101
86762440,0sleep10-21swapper/111:27:481
51342440,0sleep20-21swapper/211:36:462
47112440,0sleep20-21swapper/211:14:362
2855224423,8sleep70-21swapper/707:04:327
64152430,0sleep00-21swapper/011:14:420
54402430,2sleep32902299cyclictest12:22:533
302042420,0sleep30-21swapper/309:55:083
2869324230,8sleep50-21swapper/507:06:305
226932420,0sleep50-21swapper/510:51:485
212022420,0sleep40-21swapper/411:00:524
192552420,0sleep00-21swapper/010:07:300
123542420,0sleep30-21swapper/309:52:193
326142410,1sleep2758-21runrttasks12:24:202
299582410,0sleep10-21swapper/112:00:161
102372410,0sleep70-21swapper/711:40:447
79252400,0sleep70-21swapper/710:43:417
38002400,0sleep30-21swapper/310:23:113
2860724027,9sleep40-21swapper/407:05:174
206192400,0sleep00-21swapper/009:12:120
156862400,2sleep42902699cyclictest12:17:574
28922390,0sleep20-21swapper/212:22:442
2884923927,9sleep10-21swapper/107:08:351
2856923927,8sleep60-21swapper/607:04:476
2639423926,9sleep00-21swapper/007:03:530
186322390,0sleep50-21swapper/509:24:585
117292390,0sleep60-21swapper/612:30:336
49932380,2sleep42902699cyclictest11:27:354
63092370,0sleep70-21swapper/710:14:027
46672360,0sleep60-21swapper/609:11:056
2902699257,2cyclictest49-21ksoftirqd/411:46:324
29026992410,1cyclictest49-21ksoftirqd/411:54:204
300422220,0sleep60-21swapper/609:27:316
2902699229,3cyclictest49-21ksoftirqd/410:42:354
2902699228,1cyclictest49-21ksoftirqd/409:35:154
2902699219,3cyclictest49-21ksoftirqd/411:29:144
2902699218,2cyclictest49-21ksoftirqd/411:04:154
2902699211,1cyclictest121rcu_preempt12:05:594
63312200,7sleep449-21ksoftirqd/410:50:514
29032992016,3cyclictest57-21ksoftirqd/512:34:405
29032992016,1cyclictest57-21ksoftirqd/511:35:515
2902699208,4cyclictest49-21ksoftirqd/409:12:144
2902699206,2cyclictest49-21ksoftirqd/411:20:444
2902699206,1cyclictest49-21ksoftirqd/410:55:084
2902699204,3cyclictest49-21ksoftirqd/409:51:534
2902699204,1cyclictest49-21ksoftirqd/410:29:024
29026992016,1cyclictest49-21ksoftirqd/411:17:504
29026992016,1cyclictest49-21ksoftirqd/409:14:104
29032991917,1cyclictest57-21ksoftirqd/511:18:365
2902699199,1cyclictest49-21ksoftirqd/410:14:004
2902699197,2cyclictest49-21ksoftirqd/410:00:304
2902699197,1cyclictest49-21ksoftirqd/412:37:384
2902699193,1cyclictest49-21ksoftirqd/412:02:074
29026991917,1cyclictest49-21ksoftirqd/411:12:174
2902699190,1cyclictest22892-21systemd-cgroups09:47:234
29032991816,1cyclictest57-21ksoftirqd/510:41:305
29032991815,3cyclictest551rcuc/509:32:525
29032991814,3cyclictest57-21ksoftirqd/510:28:595
29032991814,3cyclictest57-21ksoftirqd/509:18:455
2902699188,2cyclictest49-21ksoftirqd/412:22:024
2902699187,4cyclictest49-21ksoftirqd/412:28:564
2902699187,1cyclictest49-21ksoftirqd/409:24:424
2902699186,3cyclictest49-21ksoftirqd/410:08:534
2902699186,1cyclictest49-21ksoftirqd/410:23:064
2902699185,3cyclictest49-21ksoftirqd/410:33:564
2902699185,2cyclictest49-21ksoftirqd/412:28:444
2902699185,1cyclictest49-21ksoftirqd/409:29:504
2902699183,1cyclictest49-21ksoftirqd/411:34:334
2902699182,3cyclictest49-21ksoftirqd/409:39:054
29026991815,1cyclictest49-21ksoftirqd/412:12:554
264382180,1sleep130045-21kworker/u16:009:58:421
290992170,2sleep02900899cyclictest11:03:120
29032991716,1cyclictest57-21ksoftirqd/509:15:175
29032991715,1cyclictest57-21ksoftirqd/512:29:425
29032991715,1cyclictest57-21ksoftirqd/511:58:345
29032991715,1cyclictest57-21ksoftirqd/511:42:295
29032991715,1cyclictest57-21ksoftirqd/511:23:095
29032991715,1cyclictest57-21ksoftirqd/510:23:575
29032991715,1cyclictest57-21ksoftirqd/510:07:315
29032991713,3cyclictest57-21ksoftirqd/510:48:385
2902699176,3cyclictest49-21ksoftirqd/410:04:004
2902699176,1cyclictest49-21ksoftirqd/410:24:274
2902699174,1cyclictest49-21ksoftirqd/411:50:294
29026991716,1cyclictest49-21ksoftirqd/411:38:574
29026991713,3cyclictest49-21ksoftirqd/409:56:014
93232160,1sleep29235-21systemd11:59:052
36562160,1sleep13645-21bash09:38:561
290712160,0sleep10-21swapper/111:04:581
29032991615,1cyclictest57-21ksoftirqd/512:04:465
29032991614,1cyclictest57-21ksoftirqd/512:25:065
29032991614,1cyclictest57-21ksoftirqd/512:20:155
29032991614,1cyclictest57-21ksoftirqd/512:18:045
29032991614,1cyclictest57-21ksoftirqd/511:25:185
29032991614,1cyclictest57-21ksoftirqd/510:13:195
29032991614,1cyclictest57-21ksoftirqd/509:10:085
29032991612,3cyclictest57-21ksoftirqd/511:09:445
29032991612,3cyclictest57-21ksoftirqd/509:51:175
29032991611,4cyclictest57-21ksoftirqd/510:35:315
25252160,0sleep1231rcuc/111:56:561
65102150,0sleep20-21swapper/210:45:202
2904199157,4cyclictest73-21ksoftirqd/709:16:137
29032991514,1cyclictest57-21ksoftirqd/511:48:465
29032991513,2cyclictest57-21ksoftirqd/512:10:345
29032991513,2cyclictest57-21ksoftirqd/511:29:275
29032991513,1cyclictest57-21ksoftirqd/511:43:595
29032991513,1cyclictest57-21ksoftirqd/511:04:275
29032991513,1cyclictest57-21ksoftirqd/510:18:495
29032991513,1cyclictest57-21ksoftirqd/509:44:055
29032991513,1cyclictest57-21ksoftirqd/509:35:365
29032991511,3cyclictest57-21ksoftirqd/510:01:055
29032991511,1cyclictest57-21ksoftirqd/510:14:425
29032991511,1cyclictest57-21ksoftirqd/509:40:425
2901099150,15cyclictest1439-21kworker/1:411:38:201
29008991514,1cyclictest9-21ksoftirqd/009:44:210
29008991513,1cyclictest9-21ksoftirqd/012:13:590
29008991513,1cyclictest9-21ksoftirqd/010:12:250
266412150,1sleep31-21systemd11:34:153
173742150,0sleep0111rcuc/011:04:170
29026991413,1cyclictest5574-21kworker/4:007:39:104
2901099141,3cyclictest26411-21sshd11:21:251
2900899143,4cyclictest15615-21systemd-cgroups11:39:080
29008991413,1cyclictest9-21ksoftirqd/011:21:210
29008991412,1cyclictest9-21ksoftirqd/012:26:030
2900899140,2cyclictest13734-21bash10:34:430
2900899140,13cyclictest5349-21kworker/0:411:38:280
274932140,0sleep30-21swapper/310:46:343
196532140,1sleep719634-21bash11:17:217
16122140,0sleep60-21swapper/610:56:066
124022140,2sleep22901599cyclictest09:50:262
119812140,1sleep111963-21sshd12:08:331
2904199133,7cyclictest23218-21systemd-cgroups10:18:467
2903799132,5cyclictest26567-21bash12:36:576
29037991311,1cyclictest65-21ksoftirqd/609:57:596
29026991312,1cyclictest5574-21kworker/4:007:28:364
29026991312,1cyclictest5574-21kworker/4:007:14:344
29026991312,1cyclictest5574-21kworker/4:007:14:344
29026991312,1cyclictest4004-21kworker/4:108:37:564
29026991312,1cyclictest4004-21kworker/4:108:33:044
29022991311,1cyclictest41-21ksoftirqd/310:14:003
29022991310,1cyclictest8121-21sshd11:55:213
29015991312,1cyclictest33-21ksoftirqd/209:31:012
29015991311,1cyclictest33-21ksoftirqd/212:38:352
2901099132,5cyclictest857-21polkitd09:38:431
29010991311,1cyclictest25-21ksoftirqd/112:32:451
2901099130,12cyclictest12778-21systemd12:38:021
2900899139,3cyclictest9-21ksoftirqd/010:17:040
29008991312,1cyclictest9-21ksoftirqd/012:32:170
29008991312,1cyclictest9-21ksoftirqd/009:52:370
29008991311,1cyclictest9-21ksoftirqd/012:11:580
29008991311,1cyclictest9-21ksoftirqd/010:44:180
29008991310,1cyclictest9-21ksoftirqd/010:26:100
204332130,0sleep31-21systemd11:30:153
312012120,0sleep00-21swapper/011:43:490
2904199124,4cyclictest721-21dbus-daemon09:34:147
29041991210,1cyclictest73-21ksoftirqd/710:59:337
29041991210,1cyclictest73-21ksoftirqd/709:59:047
2904199120,2cyclictest7331-21cat08:23:457
2904199120,11cyclictest18737-21sshd09:45:157
2903799129,2cyclictest12957-21systemd11:02:166
2903799122,4cyclictest721-21dbus-daemon09:44:456
2903799122,4cyclictest6982-21sshd10:23:226
2903799122,4cyclictest25478-21sshd12:00:016
2903799122,4cyclictest0-21swapper/611:37:286
2903799122,4cyclictest0-21swapper/610:13:156
29037991211,1cyclictest65-21ksoftirqd/609:39:036
29037991210,1cyclictest65-21ksoftirqd/610:35:496
29037991210,1cyclictest1-21systemd10:06:286
2903799121,5cyclictest13836-21systemd12:06:476
2903799120,12cyclictest18109-21kworker/6:211:21:056
2903799120,11cyclictest3508-21kworker/6:309:33:226
2903799120,11cyclictest18533-21kworker/6:210:50:496
29026991211,1cyclictest5574-21kworker/4:008:10:024
29026991211,1cyclictest5574-21kworker/4:007:47:304
2902299122,4cyclictest24343-21sshd11:10:143
29022991211,1cyclictest41-21ksoftirqd/309:41:383
2901599124,5cyclictest7273-21sshd10:25:092
2901599122,3cyclictest857-21polkitd10:59:052
2901599122,1cyclictest5128-21sshd09:40:482
2901599120,11cyclictest4337-21sshd09:27:552
2901599120,11cyclictest30369-21bash10:52:152
2901599120,11cyclictest23164-21kworker/2:509:59:172
2901099122,4cyclictest721-21dbus-daemon10:05:021
2901099122,4cyclictest0-21swapper/111:28:551
29010991210,1cyclictest25-21ksoftirqd/111:49:031
29010991210,1cyclictest25-21ksoftirqd/111:09:331
2901099120,11cyclictest721-21dbus-daemon12:16:171
2901099120,11cyclictest23675-21kworker/1:010:46:341
2900899129,2cyclictest12866-21grepconf.sh12:34:150
29008991211,1cyclictest9-21ksoftirqd/010:29:060
29008991210,1cyclictest9-21ksoftirqd/012:21:550
29008991210,1cyclictest9-21ksoftirqd/010:53:320
29008991210,1cyclictest9-21ksoftirqd/009:33:400
29008991210,1cyclictest9-21ksoftirqd/009:18:570
2900899120,2cyclictest721-21dbus-daemon11:09:170
2900899120,1cyclictest131rcu_sched09:35:370
42942110,0sleep70-21swapper/711:09:047
41232110,0sleep3758-21runrttasks12:04:193
2904199119,1cyclictest73-21ksoftirqd/711:23:537
2904199119,1cyclictest73-21ksoftirqd/709:52:247
2904199117,1cyclictest73-21ksoftirqd/709:26:177
2904199110,10cyclictest9447-21kworker/u16:212:24:167
2904199110,10cyclictest8546-21sshd12:19:177
2903799116,4cyclictest85150irq/25-em1-rx-009:18:566
29037991110,1cyclictest65-21ksoftirqd/611:44:296
2903799111,4cyclictest23866-21grepconf.sh10:48:146
2903799110,5cyclictest16287-21systemd12:17:596
2903799110,11cyclictest23337-21kworker/6:412:09:566
2903799110,11cyclictest18533-21kworker/6:210:32:116
2903799110,10cyclictest0-21swapper/611:51:566
2903799110,1cyclictest0-21swapper/611:30:486
2902699119,1cyclictest49-21ksoftirqd/408:39:004
29026991110,1cyclictest49-21ksoftirqd/408:18:454
29026991110,1cyclictest4004-21kworker/4:109:07:244
2902299119,1cyclictest41-21ksoftirqd/310:41:423
2902299119,1cyclictest41-21ksoftirqd/310:09:403
2902299118,3cyclictest41-21ksoftirqd/309:09:123
2902299118,1cyclictest41-21ksoftirqd/311:44:073
2902299113,4cyclictest18491-21sd-pam09:24:583
2902299112,4cyclictest721-21dbus-daemon12:35:523
2902299112,4cyclictest6718-21sshd11:22:093
2902299112,4cyclictest3176-21sshd11:14:303
2902299112,4cyclictest31356-21grep09:36:493
2902299112,4cyclictest19827-21sshd12:31:013
2902299112,4cyclictest0-21swapper/311:50:503
29022991110,1cyclictest41-21ksoftirqd/312:27:183
2902299111,4cyclictest30530-21systemd-cgroups12:13:163
2902299110,1cyclictest2282-21systemd-cgroups10:04:363
2901599119,1cyclictest33-21ksoftirqd/209:53:522
2901599119,1cyclictest24112-21sshd10:15:032
2901599112,4cyclictest10059-21systemd11:48:102
2901599112,4cyclictest0-21swapper/210:29:592
29015991110,1cyclictest33-21ksoftirqd/210:04:022
2901599111,4cyclictest857-21polkitd11:29:332
2901599111,4cyclictest1199-21sshd10:54:112
2901599111,4cyclictest10026-21systemd-cgroups10:10:362
2901599110,11cyclictest7292-21kworker/2:112:18:272
2901599110,11cyclictest26962-21kworker/2:512:29:512
2901599110,11cyclictest23249-21kworker/2:112:09:252
2901599110,10cyclictest32047-21sshd10:33:582
2901599110,1cyclictest15919-21bash09:09:372
2901599110,1cyclictest0-21swapper/209:21:462
2901099119,1cyclictest25-21ksoftirqd/110:20:111
2901099115,2cyclictest857-21polkitd10:16:561
2901099113,7cyclictest6527-21grep12:22:561
2901099113,2cyclictest709-21systemd-logind09:11:531
2901099112,4cyclictest22568-21sshd12:25:381
2901099112,4cyclictest0-21swapper/111:46:011
2901099111,4cyclictest20917-21grepconf.sh11:13:461
2901099111,4cyclictest0-21swapper/111:39:401
2901099111,4cyclictest0-21swapper/110:32:481
2901099110,5cyclictest736-21gdbus09:47:231
2901099110,5cyclictest16348-21grepconf.sh09:30:221
2901099110,4cyclictest0-21swapper/110:00:031
2901099110,11cyclictest32364-21kworker/1:210:24:431
2901099110,11cyclictest23146-21kworker/1:009:15:061
2901099110,1cyclictest0-21swapper/110:59:021
2900899119,1cyclictest9-21ksoftirqd/012:04:340
2900899119,1cyclictest9-21ksoftirqd/010:54:110
2900899119,1cyclictest9-21ksoftirqd/009:58:570
2900899119,1cyclictest5006-21sshd09:53:460
2900899116,1cyclictest9-21ksoftirqd/012:02:220
2900899113,4cyclictest15721-21/usr/sbin/munin08:38:440
29008991110,1cyclictest9-21ksoftirqd/011:29:000
29008991110,1cyclictest9-21ksoftirqd/009:28:310
2900899110,11cyclictest0-21swapper/009:13:500
274052110,1sleep22901599cyclictest11:39:512
236592110,1sleep623658-21sshd11:41:316
16772110,0sleep00-21swapper/010:41:260
39792100,0sleep4471rcuc/407:19:014
2904199109,1cyclictest73-21ksoftirqd/712:00:277
2904199109,1cyclictest73-21ksoftirqd/711:07:417
2904199109,1cyclictest0-21swapper/710:30:497
2904199108,1cyclictest73-21ksoftirqd/712:30:207
2904199108,1cyclictest73-21ksoftirqd/712:10:587
2904199108,1cyclictest73-21ksoftirqd/711:29:277
2904199108,1cyclictest73-21ksoftirqd/711:19:287
2904199108,1cyclictest73-21ksoftirqd/710:56:277
2904199108,1cyclictest73-21ksoftirqd/710:43:557
2904199107,2cyclictest5575-21sshd09:53:487
2904199105,1cyclictest73-21ksoftirqd/709:28:547
2904199101,5cyclictest721-21dbus-daemon12:03:597
2904199100,9cyclictest20217-21kworker/7:511:51:037
2904199100,9cyclictest20217-21kworker/7:511:38:087
2904199100,1cyclictest0-21swapper/710:11:547
2904199100,0cyclictest0-21swapper/710:07:397
2903799109,1cyclictest0-21swapper/612:25:216
2903799103,1cyclictest1595-21sshd10:13:516
2903799101,4cyclictest20234-21sshd11:15:306
2903799101,4cyclictest0-21swapper/611:27:186
2903799100,4cyclictest29038-21sshd09:53:186
2903799100,4cyclictest22130-21sshd10:38:576
2903799100,4cyclictest12243-21sshd11:13:176
2903799100,10cyclictest730-21NetworkManager11:06:326
2903799100,10cyclictest15275-21sshd12:19:416
2903299102,0cyclictest0-21swapper/508:13:455
2902699109,1cyclictest5574-21kworker/4:008:05:104
2902699109,1cyclictest5574-21kworker/4:007:56:204
2902699109,1cyclictest5574-21kworker/4:007:37:064
2902699109,1cyclictest5574-21kworker/4:007:28:464
2902699109,1cyclictest49-21ksoftirqd/408:44:044
2902699109,1cyclictest4004-21kworker/4:108:58:544
2902699109,1cyclictest4004-21kworker/4:108:51:484
2902699108,1cyclictest49-21ksoftirqd/408:53:584
2902299109,1cyclictest21676-21sshd12:14:303
2902299108,1cyclictest6333-21sd-pam10:25:053
2902299108,1cyclictest41-21ksoftirqd/310:35:013
2902299108,1cyclictest41-21ksoftirqd/309:30:263
2902299103,6cyclictest18024-21systemd-cgroups11:02:343
2902299103,4cyclictest15018-21sshd10:53:143
2902299101,4cyclictest23587-21sshd10:00:183
2902299101,4cyclictest15688-21sshd11:24:263
2902299101,1cyclictest31389-21systemd-cgroups10:57:503
2902299100,4cyclictest32739-21sshd09:46:043
2902299100,10cyclictest1844-21nfsd11:59:063
2901599109,1cyclictest0-21swapper/211:19:322
2901599107,1cyclictest33-21ksoftirqd/211:52:502
2901599104,6cyclictest13550irq/24-ahci[00011:54:492
2901599100,4cyclictest709-21systemd-logind11:11:482
2901599100,10cyclictest28212-21kworker/2:009:37:022
2901599100,10cyclictest26796-21kworker/2:211:25:372
2901099109,1cyclictest0-21swapper/108:19:011
2901099108,1cyclictest25-21ksoftirqd/109:24:051
2901099103,6cyclictest0-21swapper/109:49:281
2901099101,0cyclictest0-21swapper/110:40:071
2901099100,9cyclictest6366-21kworker/1:512:10:061
2901099100,4cyclictest0-21swapper/110:08:541
2900899108,1cyclictest9258-21sshd11:55:250
2900899107,2cyclictest9-21ksoftirqd/011:23:560
2900899104,3cyclictest0-21swapper/010:20:390
2900899102,3cyclictest0-21swapper/011:50:440
239052100,0sleep60-21swapper/609:34:286
290419997,1cyclictest73-21ksoftirqd/712:34:147
290419997,1cyclictest73-21ksoftirqd/711:54:177
290419997,1cyclictest73-21ksoftirqd/711:46:327
290419996,1cyclictest73-21ksoftirqd/712:16:497
290419994,4cyclictest11167-21grep10:34:347
290419994,4cyclictest1-21systemd10:25:277
290419993,3cyclictest20056-21grep09:19:317
290419992,1cyclictest22106-21sshd09:10:037
290419990,0cyclictest0-21swapper/710:52:347
290379999,0cyclictest0-21swapper/608:53:476
290379995,2cyclictest857-21polkitd10:00:556
290379994,2cyclictest29355-21systemd-cgroups10:26:276
290379992,6cyclictest8454-21grepconf.sh09:15:126
290329997,0cyclictest0-21swapper/507:35:375
290269998,1cyclictest5574-21kworker/4:008:03:364
290269998,1cyclictest5574-21kworker/4:007:50:584
290269998,1cyclictest5574-21kworker/4:007:13:204
290269998,1cyclictest5574-21kworker/4:007:13:204
290269998,1cyclictest49-21ksoftirqd/408:23:574
290269998,1cyclictest4004-21kworker/4:108:18:524
290229993,1cyclictest0-21swapper/311:41:273
290229990,5cyclictest19749-21bash09:19:303
290159999,0cyclictest0-21swapper/209:16:052
290159992,6cyclictest1-21systemd10:18:572
290159992,1cyclictest0-21swapper/211:05:032
290159990,4cyclictest0-21swapper/210:39:142
290159990,0cyclictest0-21swapper/208:28:572
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional