You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 15:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Tue May 05, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11689915050,100cyclictest0-21swapper/509:33:425
115299101100,1cyclictest1841-21nfsd09:33:411
1162999877,21cyclictest49-21ksoftirqd/411:04:194
1162999351,14cyclictest49-21ksoftirqd/410:11:334
1162999351,14cyclictest49-21ksoftirqd/410:11:334
1156998482,1cyclictest1843-21nfsd10:11:333
1156998482,1cyclictest1843-21nfsd10:11:333
117999700,69cyclictest5904-21kworker/7:311:04:207
149852550,0sleep10-21swapper/111:56:521
115299550,54cyclictest26558-21kworker/1:311:04:191
1162995431,1cyclictest49-21ksoftirqd/409:33:414
95732510,0sleep60-21swapper/611:19:096
1153995151,0cyclictest13550irq/24-ahci[00009:33:422
245602500,0sleep00-21swapper/012:28:550
66322490,1sleep56618-21sshd10:10:445
66322490,1sleep56618-21sshd10:10:445
299622490,1sleep729965-21grep10:02:137
247042490,1sleep5116899cyclictest10:15:325
159172490,0sleep10-21swapper/110:05:111
159172490,0sleep10-21swapper/110:05:111
208222480,0sleep020821-21grepconf.sh10:42:350
1175994746,1cyclictest0-21swapper/609:33:426
1175994745,1cyclictest19911-21sshd10:11:336
1175994745,1cyclictest19911-21sshd10:11:336
47552460,0sleep40-21swapper/410:41:344
46762460,0sleep20-21swapper/209:18:032
38382460,0sleep10-21swapper/110:18:091
88222450,1sleep48820-21sshd09:27:584
72392450,0sleep20-21swapper/210:30:112
262892450,2sleep3115699cyclictest10:54:313
252352450,0sleep60-21swapper/609:46:266
144112450,1sleep014414-21bash10:51:480
115462450,0sleep70-21swapper/709:35:467
3212924323,15sleep10-21swapper/107:04:461
281312430,1sleep2115399cyclictest09:56:152
117599436,37cyclictest0-21swapper/611:04:206
78324230,8sleep50-21swapper/507:06:355
67624230,9sleep70-21swapper/707:05:247
317902420,0sleep60-21swapper/611:30:306
305022420,0sleep70-21swapper/709:23:287
241902420,0sleep50-21swapper/512:19:155
234302420,0sleep10-21swapper/109:50:131
195082420,0sleep00-21swapper/009:36:190
72524128,9sleep30-21swapper/307:05:523
69002410,0sleep60-21swapper/608:14:416
6592410,0sleep40-21swapper/410:21:564
214932410,0sleep20-21swapper/209:40:292
30672400,2sleep3115699cyclictest10:19:553
3056624026,9sleep00-21swapper/007:04:290
1151994040,0cyclictest13798-21kworker/0:211:04:190
91632390,0sleep70-21swapper/710:08:547
91632390,0sleep70-21swapper/710:08:547
90623926,9sleep40-21swapper/407:08:024
72423926,9sleep20-21swapper/207:05:512
42242390,0sleep30-21swapper/311:50:133
38962390,0sleep00-21swapper/012:39:120
311382390,0sleep3391rcuc/311:16:253
218812390,0sleep30-21swapper/312:11:043
1151993939,0cyclictest6468-21kworker/0:510:11:330
1151993939,0cyclictest6468-21kworker/0:510:11:330
105272390,0sleep60-21swapper/612:18:206
313952380,2sleep6117599cyclictest10:08:136
313952380,2sleep6117599cyclictest10:08:136
3094923826,8sleep60-21swapper/607:04:356
197142380,0sleep30-21swapper/309:40:223
208372370,0sleep20-21swapper/211:37:312
1153993737,0cyclictest13550irq/24-ahci[00011:04:202
1151993737,0cyclictest5530-21kworker/0:209:33:420
1153993636,0cyclictest13550irq/24-ahci[00010:11:332
1153993636,0cyclictest13550irq/24-ahci[00010:11:332
1156993514,20cyclictest0-21swapper/309:33:423
1179993415,18cyclictest0-21swapper/709:33:427
116899319,0cyclictest0-21swapper/511:04:205
1156993028,1cyclictest1-21systemd11:04:193
190242280,0sleep40-21swapper/410:05:224
190242280,0sleep40-21swapper/410:05:224
117999270,7cyclictest19921-21systemd10:11:337
117999270,7cyclictest19921-21systemd10:11:337
1153992610,3cyclictest33-21ksoftirqd/212:15:062
1152992624,1cyclictest1-21systemd10:11:341
1152992624,1cyclictest1-21systemd10:11:341
117599242,3cyclictest0-21swapper/609:13:576
117599242,3cyclictest0-21swapper/609:13:576
117599240,6cyclictest0-21swapper/612:26:506
117599235,4cyclictest30840-21sshd12:33:066
117599233,7cyclictest0-21swapper/610:42:266
117599220,3cyclictest0-21swapper/609:54:446
1153992212,2cyclictest33-21ksoftirqd/211:26:232
1153992212,1cyclictest33-21ksoftirqd/211:44:552
1153992210,3cyclictest33-21ksoftirqd/210:41:552
1153992210,1cyclictest33-21ksoftirqd/210:09:202
1153992210,1cyclictest33-21ksoftirqd/210:09:202
326522210,0sleep00-21swapper/011:26:240
285492210,0sleep20-21swapper/211:30:182
117599215,4cyclictest25013-21id09:17:176
117599214,3cyclictest25894-21sshd11:10:016
117599214,3cyclictest25439-21bash09:24:586
117599213,5cyclictest0-21swapper/611:57:016
117599213,3cyclictest85150irq/25-em1-rx-009:38:216
117599212,5cyclictest0-21swapper/609:41:156
117599212,4cyclictest0-21swapper/610:30:516
117599212,3cyclictest0-21swapper/610:57:106
117599211,4cyclictest0-21swapper/611:06:536
117599211,3cyclictest0-21swapper/611:59:506
117599210,6cyclictest6602-21sshd11:50:226
117599210,2cyclictest0-21swapper/609:19:466
116299213,1cyclictest49-21ksoftirqd/409:41:524
115399216,3cyclictest33-21ksoftirqd/210:34:462
1153992111,3cyclictest33-21ksoftirqd/211:08:192
117599204,6cyclictest22603-21bash12:21:076
117599204,6cyclictest18515-21sshd11:35:226
117599204,4cyclictest7527-21systemd-cgroups12:08:226
117599202,3cyclictest0-21swapper/611:22:036
117599201,6cyclictest0-21swapper/610:19:596
117599200,6cyclictest16941-21bash10:15:036
117599200,6cyclictest14532-21sshd11:45:016
117599200,6cyclictest14288-21sshd10:49:486
117599200,3cyclictest8172-21bash12:35:336
117599200,17cyclictest9375-21kill10:36:006
116299208,1cyclictest464-21systemd-journal09:13:064
116299208,1cyclictest464-21systemd-journal09:13:064
116299206,2cyclictest49-21ksoftirqd/411:25:144
115399208,2cyclictest33-21ksoftirqd/212:06:082
115399207,1cyclictest33-21ksoftirqd/212:20:562
1153992013,4cyclictest33-21ksoftirqd/209:23:172
1153992012,5cyclictest33-21ksoftirqd/210:01:512
1153992010,4cyclictest33-21ksoftirqd/212:28:452
1153992010,4cyclictest33-21ksoftirqd/209:49:082
1153992010,3cyclictest33-21ksoftirqd/212:10:022
115399200,1cyclictest27789-21systemd-cgroups11:18:122
60312190,0sleep70-21swapper/710:24:157
117599192,3cyclictest25399-21sshd11:25:526
117599192,2cyclictest0-21swapper/612:09:316
117599190,6cyclictest0-21swapper/611:41:416
117599190,6cyclictest0-21swapper/610:49:136
117599190,5cyclictest10339-21systemd-cgroups10:24:326
117599190,4cyclictest0-21swapper/610:02:296
116299196,1cyclictest49-21ksoftirqd/412:34:444
116299193,3cyclictest49-21ksoftirqd/410:54:134
1162991917,1cyclictest49-21ksoftirqd/410:35:334
1162991910,2cyclictest49-21ksoftirqd/412:34:114
115399199,1cyclictest33-21ksoftirqd/211:57:582
115399198,1cyclictest33-21ksoftirqd/211:43:152
115399197,3cyclictest33-21ksoftirqd/210:45:032
1153991916,3cyclictest33-21ksoftirqd/209:54:072
1153991915,1cyclictest33-21ksoftirqd/212:00:072
1153991910,2cyclictest33-21ksoftirqd/210:55:432
24212180,0sleep10-21swapper/109:58:381
117599183,6cyclictest0-21swapper/609:51:046
116299187,2cyclictest49-21ksoftirqd/411:36:314
116299186,1cyclictest49-21ksoftirqd/411:49:474
116299185,3cyclictest49-21ksoftirqd/410:48:104
116299184,1cyclictest49-21ksoftirqd/409:45:454
1162991816,1cyclictest49-21ksoftirqd/412:28:504
1162991816,1cyclictest464-21systemd-journal09:14:484
1162991815,1cyclictest49-21ksoftirqd/411:12:144
1162991814,3cyclictest49-21ksoftirqd/410:00:054
115399188,1cyclictest33-21ksoftirqd/210:16:252
115399185,1cyclictest33-21ksoftirqd/209:36:252
115399184,1cyclictest33-21ksoftirqd/210:53:222
1153991815,1cyclictest33-21ksoftirqd/212:35:332
1153991811,3cyclictest33-21ksoftirqd/211:09:592
115399181,3cyclictest2966-21grepconf.sh11:52:102
115399181,2cyclictest33-21ksoftirqd/209:14:112
115399181,2cyclictest33-21ksoftirqd/209:14:112
115399180,3cyclictest33-21ksoftirqd/211:20:262
115399180,3cyclictest14564-21sshd10:20:412
115399180,2cyclictest121rcu_preempt12:31:332
115199187,1cyclictest9-21ksoftirqd/011:54:590
1151991816,1cyclictest9-21ksoftirqd/010:56:140
1151991814,1cyclictest709-21systemd-logind10:46:370
302522170,0sleep10-21swapper/112:21:351
168982170,0sleep10-21swapper/110:01:271
116299176,1cyclictest49-21ksoftirqd/410:15:374
116299172,3cyclictest49-21ksoftirqd/409:53:224
1162991715,1cyclictest49-21ksoftirqd/412:10:334
1162991715,1cyclictest49-21ksoftirqd/412:00:324
1162991715,1cyclictest49-21ksoftirqd/411:29:354
1162991715,1cyclictest49-21ksoftirqd/410:26:024
1162991715,1cyclictest464-21systemd-journal09:34:584
116299171,2cyclictest49-21ksoftirqd/410:33:194
116299171,1cyclictest49-21ksoftirqd/411:06:444
116299171,1cyclictest131rcu_sched11:56:104
116299171,1cyclictest131rcu_sched11:22:354
116299170,3cyclictest49-21ksoftirqd/410:58:004
116299170,1cyclictest49-21ksoftirqd/411:16:134
115399177,3cyclictest33-21ksoftirqd/209:26:072
1153991716,1cyclictest33-21ksoftirqd/210:24:312
1151991715,1cyclictest9-21ksoftirqd/010:17:430
1151991715,1cyclictest9-21ksoftirqd/010:07:330
1151991715,1cyclictest9-21ksoftirqd/010:07:330
1151991715,1cyclictest464-21systemd-journal11:11:410
1151991713,1cyclictest9-21ksoftirqd/009:46:000
115199171,1cyclictest9-21ksoftirqd/010:37:470
115199170,2cyclictest25027-21sd-pam10:01:560
67202160,0sleep10-21swapper/111:54:201
117999160,15cyclictest27282-21kworker/7:310:31:347
116299164,3cyclictest49-21ksoftirqd/412:16:444
1162991615,1cyclictest49-21ksoftirqd/412:08:284
1162991614,1cyclictest8334-21sshd12:24:164
116299160,1cyclictest131rcu_sched11:42:514
116299160,1cyclictest131rcu_sched09:20:544
115199164,1cyclictest9-21ksoftirqd/009:49:300
1151991615,1cyclictest9-21ksoftirqd/009:54:440
1151991614,2cyclictest15183-21kworker/0:608:34:410
1151991614,1cyclictest9-21ksoftirqd/012:20:130
1151991614,1cyclictest9-21ksoftirqd/012:09:380
1151991614,1cyclictest9-21ksoftirqd/009:26:000
1151991614,1cyclictest9-21ksoftirqd/009:18:400
1151991612,3cyclictest9-21ksoftirqd/009:10:120
1151991612,3cyclictest9-21ksoftirqd/009:10:120
1151991611,3cyclictest9-21ksoftirqd/011:41:450
115199160,2cyclictest3243-21grepconf.sh10:31:520
115199160,1cyclictest0-21swapper/012:04:010
140082150,0sleep1231rcuc/109:47:411
1179991510,3cyclictest73-21ksoftirqd/710:47:597
1168991513,1cyclictest57-21ksoftirqd/512:08:245
1162991513,1cyclictest49-21ksoftirqd/411:44:444
1162991513,1cyclictest49-21ksoftirqd/409:54:434
1151991513,1cyclictest9-21ksoftirqd/012:17:380
1151991513,1cyclictest9-21ksoftirqd/012:05:150
1151991513,1cyclictest9-21ksoftirqd/011:52:400
1151991513,1cyclictest9-21ksoftirqd/011:49:280
1151991513,1cyclictest9-21ksoftirqd/011:31:080
1151991513,1cyclictest9-21ksoftirqd/011:16:380
1151991511,2cyclictest32710-21systemd12:33:120
115199151,1cyclictest9-21ksoftirqd/009:20:160
115199150,14cyclictest20678-21kworker/0:411:21:050
203072140,0sleep10-21swapper/111:45:231
117999148,3cyclictest73-21ksoftirqd/709:43:497
1179991412,1cyclictest73-21ksoftirqd/709:25:007
1179991410,4cyclictest73-21ksoftirqd/711:47:127
1179991410,3cyclictest73-21ksoftirqd/712:15:347
117599143,4cyclictest3401-21latency_hist08:09:296
116899140,8cyclictest22570-21sshd09:22:595
116899140,1cyclictest0-21swapper/509:52:085
1162991414,0cyclictest19961-21kworker/4:109:09:214
115699140,13cyclictest10420-21kworker/3:011:49:233
115399145,3cyclictest33-21ksoftirqd/207:44:282
1151991412,1cyclictest9-21ksoftirqd/009:40:180
1151991410,2cyclictest9-21ksoftirqd/011:08:140
1151991410,1cyclictest9-21ksoftirqd/011:34:310
259032130,0sleep70-21swapper/712:01:237
1179991312,1cyclictest73-21ksoftirqd/711:56:597
1179991312,1cyclictest73-21ksoftirqd/711:16:537
1179991311,1cyclictest73-21ksoftirqd/711:51:007
1179991311,1cyclictest73-21ksoftirqd/710:54:477
1179991311,1cyclictest73-21ksoftirqd/710:51:377
1179991311,1cyclictest73-21ksoftirqd/709:53:517
117999130,12cyclictest17987-21kworker/7:209:09:397
117999130,12cyclictest17987-21kworker/7:209:09:397
117599133,2cyclictest2702-21netstat07:09:466
117599132,3cyclictest0-21swapper/608:49:396
117599131,5cyclictest0-21swapper/607:54:426
117599131,4cyclictest0-21swapper/608:44:286
117599130,5cyclictest0-21swapper/609:09:286
117599130,3cyclictest5973-21latency_hist08:14:286
116899138,4cyclictest32560-21systemd10:54:475
116899137,6cyclictest57-21ksoftirqd/509:36:435
116899132,5cyclictest19155-21df_inode09:24:425
1168991311,1cyclictest57-21ksoftirqd/510:01:565
116899131,4cyclictest1-21systemd11:37:285
1162991312,1cyclictest13351-21kworker/4:207:11:494
1156991311,1cyclictest41-21ksoftirqd/310:05:283
1156991311,1cyclictest41-21ksoftirqd/310:05:283
1156991311,1cyclictest41-21ksoftirqd/309:26:413
1156991310,2cyclictest41-21ksoftirqd/309:17:173
115399136,1cyclictest33-21ksoftirqd/208:34:392
1152991312,1cyclictest25-21ksoftirqd/109:37:491
1152991311,1cyclictest25-21ksoftirqd/110:29:441
115199136,1cyclictest9-21ksoftirqd/010:19:420
1151991312,1cyclictest9-21ksoftirqd/010:26:210
66442120,0sleep70-21swapper/709:47:157
225372120,1sleep122535-21grep12:36:251
1179991210,2cyclictest73-21ksoftirqd/711:20:267
1179991210,1cyclictest73-21ksoftirqd/712:04:597
1179991210,1cyclictest73-21ksoftirqd/710:36:257
117999121,10cyclictest28926-21kworker/7:411:24:367
117999120,11cyclictest29420-21kworker/u16:312:34:387
117599123,4cyclictest32319-21cstates08:59:406
117599123,4cyclictest31214-21sed07:59:446
117599122,5cyclictest9906-21latency_hist07:24:296
117599122,10cyclictest0-21swapper/608:54:446
117599121,5cyclictest0-21swapper/607:49:486
117599121,4cyclictest0-21swapper/608:24:416
117599121,3cyclictest0-21swapper/608:34:436
117599121,3cyclictest0-21swapper/608:29:436
117599120,5cyclictest0-21swapper/607:14:476
117599120,3cyclictest22245-21sed07:44:426
116899122,4cyclictest9762-21bash11:19:095
116899122,4cyclictest5644-21sshd11:44:305
116899122,4cyclictest20861-21systemd-cgroups11:39:285
116899122,4cyclictest2029-21bash09:13:595
116899122,4cyclictest2029-21bash09:13:595
116899122,4cyclictest19146-21sshd10:52:075
116899122,4cyclictest13994-21sshd12:30:045
1168991210,1cyclictest663-21in:imjournal09:49:095
116899120,11cyclictest7446-21kworker/5:512:26:185
116899120,11cyclictest32039-21systemd09:41:075
116899120,11cyclictest22578-21kworker/5:110:35:065
116899120,11cyclictest1-21systemd11:29:445
1162991211,1cyclictest13351-21kworker/4:207:34:114
1162991211,1cyclictest13351-21kworker/4:207:29:194
1162991211,1cyclictest13351-21kworker/4:207:22:134
1156991210,1cyclictest41-21ksoftirqd/311:19:363
1156991210,1cyclictest41-21ksoftirqd/309:58:243
115699120,11cyclictest15390-21bash12:30:103
115299129,2cyclictest10886-21grep11:17:111
115299127,1cyclictest25-21ksoftirqd/110:42:051
1152991211,1cyclictest25-21ksoftirqd/112:28:221
115299120,11cyclictest8000-21sshd12:31:451
115299120,11cyclictest1-21systemd09:10:451
115299120,11cyclictest1-21systemd09:10:451
83892110,1sleep7711rcuc/712:12:127
60602110,0sleep50-21swapper/510:45:285
268922110,1sleep125-21ksoftirqd/110:46:441
233282110,0sleep10-21swapper/109:15:051
117999119,1cyclictest73-21ksoftirqd/712:20:507
117999119,1cyclictest73-21ksoftirqd/711:36:077
117999119,1cyclictest73-21ksoftirqd/710:40:147
117999119,1cyclictest73-21ksoftirqd/710:24:477
117999117,3cyclictest73-21ksoftirqd/711:05:467
1179991110,1cyclictest73-21ksoftirqd/712:25:507
1179991110,1cyclictest73-21ksoftirqd/710:16:377
117999110,5cyclictest736-21gdbus12:31:127
117999110,10cyclictest0-21swapper/711:12:057
117599112,5cyclictest0-21swapper/607:29:446
117599112,2cyclictest0-21swapper/608:20:176
117599111,3cyclictest0-21swapper/607:34:396
117599111,3cyclictest0-21swapper/607:25:496
116899119,2cyclictest57-21ksoftirqd/509:16:025
116899119,1cyclictest57-21ksoftirqd/512:38:005
116899119,1cyclictest57-21ksoftirqd/510:24:425
116899114,4cyclictest721-21dbus-daemon12:00:405
116899113,7cyclictest28638-21sshd11:53:435
116899112,4cyclictest9903-21bash11:54:305
116899112,4cyclictest9692-21sshd12:22:185
116899111,4cyclictest16194-21sshd12:10:435
116899111,4cyclictest0-21swapper/510:33:135
116899110,5cyclictest695-21grepconf.sh11:04:495
116899110,10cyclictest9829-21kworker/5:510:04:495
116899110,10cyclictest9829-21kworker/5:510:04:495
1162991110,1cyclictest13351-21kworker/4:207:51:414
115699119,1cyclictest41-21ksoftirqd/312:09:213
115699119,1cyclictest41-21ksoftirqd/311:42:553
115699119,1cyclictest41-21ksoftirqd/310:42:533
115699119,1cyclictest41-21ksoftirqd/310:28:293
115699118,2cyclictest41-21ksoftirqd/312:34:373
115699112,4cyclictest22763-21grepconf.sh11:08:043
1156991110,1cyclictest41-21ksoftirqd/310:01:193
115399110,2cyclictest121rcu_preempt08:49:502
115299119,1cyclictest25-21ksoftirqd/112:04:041
115299119,1cyclictest25-21ksoftirqd/110:58:501
115299115,3cyclictest19500-21grep12:09:071
115299114,4cyclictest0-21swapper/109:24:481
1152991110,1cyclictest25-21ksoftirqd/111:37:391
1152991110,1cyclictest25-21ksoftirqd/110:49:561
117999109,1cyclictest73-21ksoftirqd/711:32:217
117999108,1cyclictest73-21ksoftirqd/711:44:157
117999108,1cyclictest73-21ksoftirqd/709:54:297
117999108,1cyclictest73-21ksoftirqd/709:14:447
117599101,4cyclictest0-21swapper/608:44:486
117599101,2cyclictest0-21swapper/607:39:296
116899109,1cyclictest0-21swapper/510:42:455
116899108,1cyclictest0-21swapper/511:25:105
116899103,6cyclictest17539-21sshd11:11:335
116899102,2cyclictest709-21systemd-logind09:56:285
116899100,10cyclictest25642-21httpd11:22:295
116299109,1cyclictest49-21ksoftirqd/408:14:414
116299109,1cyclictest19961-21kworker/4:108:49:034
116299109,1cyclictest13351-21kworker/4:208:00:014
116299109,1cyclictest13351-21kworker/4:207:56:334
116299109,1cyclictest13351-21kworker/4:207:44:554
116299109,1cyclictest13351-21kworker/4:207:42:514
115699109,1cyclictest41-21ksoftirqd/312:17:433
115699109,1cyclictest41-21ksoftirqd/309:48:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional