You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 23:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sat Mar 28, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22503991420,141cyclictest28503-21kworker/0:409:24:290
2251799133118,1cyclictest73-21ksoftirqd/709:24:307
2250499107105,1cyclictest1116-21nfsd09:24:291
1574021060,0sleep00-21swapper/009:34:120
2251599840,83cyclictest930-21kworker/u16:409:24:305
287802810,1sleep6686-21dbus-daemon12:35:116
232412800,0sleep00-21swapper/009:31:000
22516996933,36cyclictest0-21swapper/609:24:306
311012550,0sleep40-21swapper/410:56:424
252062520,0sleep20-21swapper/209:43:592
281232510,1sleep628122-21grep09:38:356
140172510,0sleep30-21swapper/310:42:393
37442500,1sleep61-21systemd10:32:496
2220325023,9sleep10-21swapper/107:03:521
2217325026,8sleep20-21swapper/207:03:292
42012490,2sleep0101ktimersoftd/011:11:520
167682490,2sleep72251799cyclictest11:59:087
122142490,0sleep20-21swapper/209:07:312
98942470,0sleep10-21swapper/112:11:431
22513994747,0cyclictest1970-21kworker/3:609:24:303
311562460,0sleep331155-21sshd09:48:013
253222460,0sleep40-21swapper/412:18:114
95622450,2sleep12250499cyclictest11:47:331
203462450,0sleep3391rcuc/309:38:083
154802450,0sleep30-21swapper/310:37:113
114682450,0sleep30-21swapper/311:01:133
42292440,1sleep54231-21bash11:52:495
36212440,0sleep6631rcuc/610:47:396
88102430,0sleep30-21swapper/311:32:373
15092430,1sleep665-21ksoftirqd/611:28:316
118562420,0sleep00-21swapper/011:34:420
265492410,0sleep40-21swapper/409:51:304
2237424129,8sleep00-21swapper/007:06:150
2207124129,9sleep30-21swapper/307:02:023
193312410,0sleep10-21swapper/111:46:201
155102410,0sleep40-21swapper/409:47:064
267172400,0sleep20-21swapper/212:25:462
2216624027,9sleep40-21swapper/407:03:234
211582400,0sleep70-21swapper/711:40:507
297432390,0sleep10-21swapper/111:24:341
2212423926,9sleep70-21swapper/707:02:467
2205523927,8sleep50-21swapper/507:01:485
170382390,1sleep665-21ksoftirqd/611:57:156
1991723826,9sleep60-21swapper/607:01:336
177592380,0sleep60-21swapper/609:13:526
177592380,0sleep60-21swapper/609:13:526
22509993737,0cyclictest13550irq/24-ahci[00009:24:302
269882360,0sleep70-21swapper/712:09:017
325692210,0sleep40-21swapper/409:59:154
22517992114,4cyclictest73-21ksoftirqd/711:10:137
22517992114,4cyclictest73-21ksoftirqd/711:10:137
22514992118,2cyclictest7429-21sshd09:24:294
253932200,0sleep20-21swapper/209:34:462
22503991917,2cyclictest9-21ksoftirqd/010:03:310
22503991917,1cyclictest9-21ksoftirqd/010:17:560
22503991917,1cyclictest9-21ksoftirqd/009:55:510
236032180,0sleep5561ktimersoftd/509:53:085
22517991817,1cyclictest73-21ksoftirqd/710:56:047
22509991816,1cyclictest33-21ksoftirqd/209:58:202
22503991816,1cyclictest9-21ksoftirqd/011:10:520
22503991816,1cyclictest9-21ksoftirqd/011:10:520
22503991816,1cyclictest9-21ksoftirqd/009:19:140
22503991815,1cyclictest9-21ksoftirqd/009:46:310
22503991814,3cyclictest9-21ksoftirqd/009:58:330
2250399181,2cyclictest9-21ksoftirqd/010:07:540
2250399180,17cyclictest1628-21kworker/0:112:06:070
284092170,1sleep328405-21sshd12:22:033
237192170,0sleep00-21swapper/009:40:130
22517991715,1cyclictest73-21ksoftirqd/712:15:217
22517991715,1cyclictest73-21ksoftirqd/709:56:107
22517991715,1cyclictest73-21ksoftirqd/709:42:147
22517991713,1cyclictest73-21ksoftirqd/709:47:257
2251799170,16cyclictest691-21systemd-logind12:27:147
22504991715,1cyclictest25-21ksoftirqd/112:06:251
22504991715,1cyclictest25-21ksoftirqd/111:02:581
2250399179,5cyclictest9-21ksoftirqd/011:57:340
22503991716,1cyclictest9-21ksoftirqd/012:27:190
22503991715,1cyclictest9-21ksoftirqd/012:09:280
22503991715,1cyclictest9-21ksoftirqd/010:46:480
22503991714,3cyclictest9-21ksoftirqd/011:18:430
22503991714,2cyclictest9-21ksoftirqd/011:02:430
22503991714,2cyclictest1-21systemd10:42:010
22503991713,1cyclictest9-21ksoftirqd/010:37:310
30352160,0sleep30-21swapper/309:42:403
22517991615,1cyclictest73-21ksoftirqd/711:20:587
22517991615,1cyclictest73-21ksoftirqd/710:33:457
22517991615,1cyclictest73-21ksoftirqd/710:29:337
22517991615,1cyclictest73-21ksoftirqd/710:24:537
22517991614,1cyclictest73-21ksoftirqd/712:25:587
22517991614,1cyclictest73-21ksoftirqd/711:28:187
22517991614,1cyclictest73-21ksoftirqd/711:12:527
22517991614,1cyclictest73-21ksoftirqd/710:46:307
22517991614,1cyclictest73-21ksoftirqd/710:41:387
22517991614,1cyclictest73-21ksoftirqd/709:27:207
22517991614,1cyclictest73-21ksoftirqd/709:17:477
22517991614,1cyclictest73-21ksoftirqd/709:06:467
22517991612,4cyclictest73-21ksoftirqd/711:04:217
22517991612,2cyclictest73-21ksoftirqd/711:35:137
22504991613,3cyclictest25-21ksoftirqd/110:02:441
22503991615,1cyclictest9-21ksoftirqd/009:46:250
22503991615,0cyclictest23900-21kworker/u16:009:14:280
22503991615,0cyclictest23900-21kworker/u16:009:14:280
22503991614,1cyclictest9-21ksoftirqd/012:21:530
22503991614,1cyclictest9-21ksoftirqd/012:18:170
22503991614,1cyclictest9-21ksoftirqd/011:56:200
22503991614,1cyclictest9-21ksoftirqd/010:51:320
22503991614,1cyclictest9-21ksoftirqd/010:21:450
22503991614,1cyclictest9-21ksoftirqd/010:11:460
22503991614,1cyclictest9-21ksoftirqd/010:11:460
22503991614,1cyclictest9-21ksoftirqd/009:09:080
22503991614,1cyclictest19342-21nscd11:41:210
22503991613,1cyclictest9-21ksoftirqd/011:26:420
112582160,1sleep511244-21sshd09:46:515
58492150,0sleep30-21swapper/310:03:153
22517991514,1cyclictest73-21ksoftirqd/711:24:487
22517991513,1cyclictest73-21ksoftirqd/712:21:127
22517991513,1cyclictest73-21ksoftirqd/711:52:087
22517991513,1cyclictest73-21ksoftirqd/710:17:587
22517991513,1cyclictest73-21ksoftirqd/710:09:187
22517991513,1cyclictest73-21ksoftirqd/709:57:197
22517991513,1cyclictest73-21ksoftirqd/709:38:127
22517991511,3cyclictest73-21ksoftirqd/711:44:567
2251799150,14cyclictest10140-21kworker/7:510:11:387
2251799150,14cyclictest10140-21kworker/7:510:11:387
22514991513,1cyclictest49-21ksoftirqd/410:52:444
22513991513,1cyclictest41-21ksoftirqd/312:01:363
22509991514,1cyclictest33-21ksoftirqd/211:55:152
22509991514,1cyclictest33-21ksoftirqd/210:33:182
22503991514,1cyclictest9-21ksoftirqd/012:12:300
22503991514,1cyclictest9-21ksoftirqd/010:32:520
22503991513,1cyclictest9-21ksoftirqd/011:46:500
22503991513,1cyclictest9-21ksoftirqd/011:41:450
22503991513,1cyclictest9-21ksoftirqd/011:23:290
22503991513,1cyclictest9-21ksoftirqd/010:58:040
22503991513,1cyclictest9-21ksoftirqd/010:26:310
201672150,2sleep12250499cyclictest11:12:491
75532140,0sleep67554-21sshd11:51:146
320732140,0sleep10-21swapper/110:26:591
22517991413,1cyclictest73-21ksoftirqd/709:14:107
22517991413,1cyclictest73-21ksoftirqd/709:14:107
22517991412,1cyclictest73-21ksoftirqd/712:33:317
22517991412,1cyclictest73-21ksoftirqd/712:02:427
22517991412,1cyclictest73-21ksoftirqd/711:47:277
22517991412,1cyclictest73-21ksoftirqd/711:00:287
22517991412,1cyclictest73-21ksoftirqd/710:37:207
22517991412,1cyclictest73-21ksoftirqd/710:01:497
22517991412,1cyclictest73-21ksoftirqd/709:31:367
2251599140,3cyclictest8836-21grep11:47:305
22514991412,1cyclictest49-21ksoftirqd/412:25:044
22514991412,1cyclictest49-21ksoftirqd/410:44:154
22509991413,1cyclictest33-21ksoftirqd/210:12:552
22509991413,1cyclictest33-21ksoftirqd/210:12:552
22509991412,1cyclictest33-21ksoftirqd/210:40:362
22509991411,2cyclictest33-21ksoftirqd/211:57:182
22504991413,1cyclictest25-21ksoftirqd/111:16:431
22504991413,1cyclictest25-21ksoftirqd/110:38:271
22504991412,1cyclictest25-21ksoftirqd/111:38:211
22504991412,1cyclictest25-21ksoftirqd/111:33:451
22504991412,1cyclictest25-21ksoftirqd/109:43:251
22503991412,2cyclictest7882-21kworker/0:207:21:480
22503991412,1cyclictest9-21ksoftirqd/012:32:280
326932130,0sleep60-21swapper/610:01:096
3044621311,1sleep341-21ksoftirqd/309:16:303
272552130,0sleep50-21swapper/510:17:265
2251699133,4cyclictest0-21swapper/609:51:186
22516991311,1cyclictest686-21dbus-daemon11:34:556
22516991310,2cyclictest22914-21bash12:12:276
2251599132,5cyclictest686-21dbus-daemon10:47:265
22515991311,1cyclictest20103-21grepconf.sh10:02:115
2251599131,5cyclictest7045-21sshd10:42:155
2251599130,12cyclictest25604-21ystemctl10:30:265
22514991311,1cyclictest1-21systemd10:26:264
2251399139,1cyclictest41-21ksoftirqd/311:13:263
2251399130,13cyclictest0-21swapper/312:18:093
2251399130,12cyclictest28042-21systemd11:26:243
2250999139,3cyclictest33-21ksoftirqd/212:32:202
22509991312,1cyclictest33-21ksoftirqd/210:59:002
22509991312,1cyclictest33-21ksoftirqd/210:18:282
22509991311,2cyclictest33-21ksoftirqd/210:43:272
2250999130,1cyclictest0-21swapper/210:22:012
2250499139,1cyclictest25-21ksoftirqd/112:28:101
2250499139,1cyclictest25-21ksoftirqd/111:55:191
2250499138,3cyclictest25-21ksoftirqd/111:10:141
2250499138,3cyclictest25-21ksoftirqd/111:10:141
22504991312,1cyclictest25-21ksoftirqd/111:28:121
22504991312,1cyclictest25-21ksoftirqd/110:49:011
22504991312,1cyclictest25-21ksoftirqd/110:22:511
22504991312,1cyclictest25-21ksoftirqd/110:00:261
22504991312,1cyclictest25-21ksoftirqd/109:39:361
22504991310,2cyclictest25-21ksoftirqd/109:50:201
22503991311,2cyclictest8929-21kworker/0:009:05:420
22503991310,2cyclictest7882-21kworker/0:208:31:260
68372120,0sleep50-21swapper/509:11:275
68372120,0sleep50-21swapper/509:11:275
314572120,1sleep531458-21df_abs10:06:375
313992120,0sleep30-21swapper/309:29:353
2251699122,4cyclictest885-21polkitd11:36:536
2251699122,4cyclictest2761-21sshd10:04:586
2251699122,4cyclictest24815-21sshd11:26:126
22516991210,1cyclictest65-21ksoftirqd/612:04:576
22516991210,1cyclictest65-21ksoftirqd/610:52:276
22516991210,1cyclictest65-21ksoftirqd/610:39:266
22516991210,1cyclictest10263-21kworker/6:310:14:546
22516991210,1cyclictest10263-21kworker/6:310:14:546
2251699121,10cyclictest686-21dbus-daemon12:23:486
2251699120,11cyclictest11786-21kworker/6:410:08:046
2251599124,7cyclictest686-21dbus-daemon11:37:585
2251599123,5cyclictest885-21polkitd09:11:235
2251599122,4cyclictest696-21nscd11:21:265
2251599122,4cyclictest3697-21sshd09:33:305
2251599122,4cyclictest2518-21systemd-cgroups12:03:545
2251599122,4cyclictest23588-21sshd09:41:595
2251599122,4cyclictest15669-21sshd12:12:025
2251599122,4cyclictest0-21swapper/512:27:245
2251599122,4cyclictest0-21swapper/509:56:535
2251599122,4cyclictest0-21swapper/509:30:565
22515991210,1cyclictest57-21ksoftirqd/510:15:575
22515991210,1cyclictest57-21ksoftirqd/510:15:575
2251599121,4cyclictest0-21swapper/511:05:245
2251599120,11cyclictest31917-21kworker/5:310:22:485
2251599120,11cyclictest18628-21kworker/5:111:44:455
2251599120,11cyclictest12578-21kworker/5:310:58:235
2251499128,1cyclictest29541-21kworker/4:409:34:524
22514991210,1cyclictest686-21dbus-daemon11:40:544
2251499120,11cyclictest27094-21systemd11:30:024
2251499120,1cyclictest0-21swapper/410:10:234
2251399120,11cyclictest775-21gdbus09:15:043
2251399120,11cyclictest775-21gdbus09:15:043
2251399120,11cyclictest17061-21sshd12:12:073
2250999129,1cyclictest33-21ksoftirqd/211:05:252
2250999124,4cyclictest696-21nscd10:46:572
2250999123,6cyclictest686-21dbus-daemon10:03:362
2250999122,6cyclictest686-21dbus-daemon11:14:462
22509991211,1cyclictest33-21ksoftirqd/212:06:442
22509991211,1cyclictest33-21ksoftirqd/212:01:452
22509991211,1cyclictest33-21ksoftirqd/211:46:362
22509991211,1cyclictest33-21ksoftirqd/210:27:212
22509991211,1cyclictest33-21ksoftirqd/209:47:522
22509991210,1cyclictest33-21ksoftirqd/211:17:142
2250499129,2cyclictest25-21ksoftirqd/112:22:191
2250499128,3cyclictest25-21ksoftirqd/110:51:271
22504991211,1cyclictest25-21ksoftirqd/110:13:251
22504991211,1cyclictest25-21ksoftirqd/110:13:251
22504991211,1cyclictest25-21ksoftirqd/110:08:021
22504991211,1cyclictest25-21ksoftirqd/109:55:261
22504991211,1cyclictest25-21ksoftirqd/109:18:441
22504991210,1cyclictest25-21ksoftirqd/109:31:191
2250399129,1cyclictest7882-21kworker/0:207:53:420
2250399129,1cyclictest7882-21kworker/0:207:46:260
22503991211,1cyclictest7882-21kworker/0:208:04:500
135542120,0sleep60-21swapper/611:53:226
123632120,0sleep60-21swapper/611:44:016
40212110,0sleep40-21swapper/410:21:424
274532110,1sleep327454-21kworker/u16:309:06:283
237132110,0sleep10-21swapper/112:06:551
232642118,1sleep449-21ksoftirqd/409:27:134
2251699119,1cyclictest65-21ksoftirqd/609:52:486
2251699114,6cyclictest14185-21awk09:26:426
2251699114,1cyclictest24466-21systemd-cgroups10:17:166
2251699112,4cyclictest27306-21systemd-cgroups09:32:596
2251699112,4cyclictest0-21swapper/612:26:266
22516991110,1cyclictest65-21ksoftirqd/611:17:306
2251699111,4cyclictest0-21swapper/611:12:036
2251699110,4cyclictest492-21systemd-journal10:22:126
2251699110,11cyclictest32478-21kworker/6:110:28:036
2251699110,11cyclictest29251-21kworker/6:109:08:186
2251699110,11cyclictest20712-21kworker/6:012:07:136
2251699110,11cyclictest17354-21kworker/6:009:17:356
2251699110,11cyclictest12768-21kworker/6:110:56:336
2251699110,10cyclictest1-21systemd10:42:456
2251599119,1cyclictest0-21swapper/511:16:095
2251599114,4cyclictest14723-21sshd12:08:185
2251599113,1cyclictest330-21sshd12:22:185
2251599111,4cyclictest9598-21kill12:17:165
2251599111,4cyclictest25223-21grepconf.sh09:17:585
2251599111,4cyclictest10866-21nfsd411:06:425
2251599111,4cyclictest10866-21nfsd411:06:425
2251599110,5cyclictest18164-21systemd10:54:075
2251599110,11cyclictest5097-21kworker/5:010:36:545
2251499119,1cyclictest691-21systemd-logind10:46:424
2251499119,1cyclictest49-21ksoftirqd/411:15:184
2251499119,1cyclictest0-21swapper/411:50:504
2251499113,4cyclictest6031-21sshd12:13:224
2251499112,4cyclictest481ktimersoftd/410:38:514
2251499112,4cyclictest30896-21sshd11:20:574
2251499112,4cyclictest28967-21sshd11:54:174
2251499111,4cyclictest7840-21sshd12:02:184
2251499111,4cyclictest5460-21systemd-cgroups10:32:554
2251499111,4cyclictest25429-21sshd10:02:304
2251499111,4cyclictest19453-21systemd-cgroups09:45:344
2251499110,10cyclictest686-21dbus-daemon11:31:514
2251499110,1cyclictest0-21swapper/408:51:254
2251399119,1cyclictest41-21ksoftirqd/311:49:173
22513991110,1cyclictest41-21ksoftirqd/311:10:383
22513991110,1cyclictest41-21ksoftirqd/311:10:383
2251399111,4cyclictest31251-21sshd09:33:133
2251399110,7cyclictest885-21polkitd09:56:563
2251399110,11cyclictest0-21swapper/310:10:233
2250999119,1cyclictest33-21ksoftirqd/212:17:062
2250999119,1cyclictest33-21ksoftirqd/211:37:302
2250999119,1cyclictest33-21ksoftirqd/211:33:292
2250999114,3cyclictest16122-21systemd-cgroups12:15:522
2250999112,5cyclictest0-21swapper/211:45:332
2250999112,5cyclictest0-21swapper/210:07:012
2250999112,4cyclictest686-21dbus-daemon11:08:262
2250999112,4cyclictest686-21dbus-daemon11:08:262
22509991110,1cyclictest33-21ksoftirqd/211:30:372
2250999110,11cyclictest13770-21kworker/2:009:27:122
2250499119,1cyclictest25-21ksoftirqd/110:59:051
2250499118,1cyclictest25-21ksoftirqd/110:44:301
22504991110,1cyclictest25-21ksoftirqd/112:18:091
22504991110,1cyclictest25-21ksoftirqd/111:58:371
22504991110,1cyclictest25-21ksoftirqd/110:18:341
22504991110,1cyclictest25-21ksoftirqd/109:35:231
22504991110,1cyclictest25-21ksoftirqd/109:14:591
22504991110,1cyclictest25-21ksoftirqd/109:14:591
2250499110,1cyclictest21040-21systemd-cgroups10:31:561
2250399119,1cyclictest7882-21kworker/0:208:23:420
2250399119,1cyclictest7882-21kworker/0:208:23:420
2250399116,2cyclictest7882-21kworker/0:207:37:480
2251699108,1cyclictest65-21ksoftirqd/609:41:376
2251699103,6cyclictest9589-21sshd12:19:106
2251699103,6cyclictest0-21swapper/611:08:416
2251699103,6cyclictest0-21swapper/611:08:416
2251699100,4cyclictest1-21systemd11:03:336
2251599108,1cyclictest57-21ksoftirqd/511:57:215
2251599108,1cyclictest57-21ksoftirqd/510:35:585
2251599103,6cyclictest502-21sshd12:31:405
2251599102,2cyclictest27846-21bash11:24:275
2251599100,9cyclictest22265-21sshd11:27:505
2251599100,10cyclictest18628-21kworker/5:111:34:105
2251499108,1cyclictest49-21ksoftirqd/412:07:324
2251499105,3cyclictest12103-21bash09:09:474
2251499103,6cyclictest23608-21sshd11:42:464
2251499102,3cyclictest7733-21sshd09:16:574
2251499101,4cyclictest0-21swapper/409:38:484
2251499100,9cyclictest31999-21sshd10:14:024
2251499100,9cyclictest31999-21sshd10:14:024
2251499100,6cyclictest22670-21bash12:27:184
2251499100,4cyclictest8341-21sshd11:25:134
2251499100,4cyclictest460-21grep09:12:524
2251499100,4cyclictest460-21grep09:12:524
2251499100,10cyclictest0-21swapper/411:03:234
2251499100,1cyclictest0-21swapper/412:35:054
2251499100,1cyclictest0-21swapper/410:17:404
2251399109,1cyclictest0-21swapper/310:12:133
2251399109,1cyclictest0-21swapper/310:12:133
2251399108,1cyclictest41-21ksoftirqd/310:55:533
2251399108,1cyclictest41-21ksoftirqd/310:35:063
2251399108,1cyclictest41-21ksoftirqd/310:19:583
2251399108,1cyclictest41-21ksoftirqd/309:52:173
2251399107,3cyclictest41-21ksoftirqd/311:26:513
2251399106,3cyclictest41-21ksoftirqd/311:16:473
2251399101,4cyclictest27711-21sshd11:02:023
2251399100,4cyclictest6533-21sshd10:27:243
2251399100,4cyclictest26936-21sshd12:27:333
2251399100,10cyclictest0-21swapper/312:32:183
2250999109,1cyclictest33-21ksoftirqd/211:21:502
2250999108,1cyclictest33-21ksoftirqd/212:26:412
2250999108,1cyclictest33-21ksoftirqd/209:53:022
2250999107,1cyclictest13550irq/24-ahci[00009:39:562
2250999102,5cyclictest0-21swapper/209:16:432
2250999102,5cyclictest0-21swapper/209:14:432
2250999102,5cyclictest0-21swapper/209:14:432
2250499103,4cyclictest691-21systemd-logind09:06:431
2250499100,0cyclictest0-21swapper/112:33:481
2250399109,0cyclictest8929-21kworker/0:009:00:440
2250399108,2cyclictest7882-21kworker/0:207:14:340
2250399108,2cyclictest7882-21kworker/0:207:09:300
2250399108,0cyclictest7882-21kworker/0:207:31:540
225179999,0cyclictest0-21swapper/708:21:427
225179999,0cyclictest0-21swapper/708:21:427
225179990,9cyclictest0-21swapper/707:21:387
225159995,3cyclictest16156-21sshd09:39:475
225149999,0cyclictest0-21swapper/411:56:504
225149999,0cyclictest0-21swapper/411:08:544
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional