You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 20:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Mar 13, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11390997720,0cyclictest0-21swapper/609:54:546
316552760,1sleep331592-21sshd11:03:043
324282730,0sleep233-21ksoftirqd/210:35:242
11356997360,12cyclictest691-21systemd-logind09:54:540
14742690,0sleep10-21swapper/112:19:031
1136999620,62cyclictest31085-21kworker/3:409:54:543
194542540,0sleep70-21swapper/710:45:467
10372520,0sleep40-21swapper/411:32:444
274392490,1sleep527440-21grep11:30:375
233632490,0sleep6631rcuc/610:55:146
233632490,0sleep6631rcuc/610:55:146
138422480,0sleep113840-21systemd-cgroups09:22:101
80352470,0sleep48032-21systemd-cgroups09:34:474
61152460,0sleep50-21swapper/509:10:375
303672460,1sleep530364-21systemd10:03:475
287742460,0sleep30-21swapper/309:34:063
266472460,0sleep20-21swapper/209:56:152
25832460,0sleep00-21swapper/010:15:110
246592460,0sleep60-21swapper/611:58:106
267642450,0sleep526763-21sshd09:13:415
181162450,0sleep20-21swapper/212:18:082
86212440,0sleep10-21swapper/109:42:131
5712440,0sleep50-21swapper/512:26:285
299252440,0sleep20-21swapper/211:08:322
263362440,0sleep30-21swapper/311:23:063
103262440,1sleep1492-21systemd-journal09:47:491
275492430,0sleep00-21swapper/010:22:080
132342430,0sleep70-21swapper/711:33:287
98442420,0sleep00-21swapper/011:03:410
22222420,0sleep30-21swapper/311:01:283
118282420,0sleep10-21swapper/111:40:501
118282420,0sleep10-21swapper/111:40:501
71922410,0sleep0111rcuc/012:23:020
64502410,0sleep40-21swapper/409:40:154
273762410,0sleep327357-21sshd10:12:503
1115824128,9sleep50-21swapper/507:06:105
1102724128,9sleep40-21swapper/407:04:254
147022400,1sleep614694-21bash11:18:456
143822400,0sleep00-21swapper/011:13:100
11378994040,0cyclictest24477-21kworker/4:409:54:544
1100824029,8sleep70-21swapper/707:04:127
1095024036,1sleep30-21swapper/307:03:203
874623926,9sleep00-21swapper/007:02:050
39522390,0sleep40-21swapper/412:30:194
235192390,0sleep7711rcuc/710:05:177
139792390,0sleep40-21swapper/412:01:204
1103823926,9sleep60-21swapper/607:04:356
1094923927,8sleep20-21swapper/207:03:192
1092623928,8sleep10-21swapper/107:03:021
90162380,0sleep41137899cyclictest11:11:064
273572380,2sleep21136699cyclictest10:53:342
273572380,2sleep21136699cyclictest10:53:342
142922380,0sleep40-21swapper/411:00:174
316882370,1sleep531689-21grepconf.sh09:34:165
289912360,0sleep60-21swapper/611:25:106
98322350,0sleep79802-21sshd12:28:467
111842280,0sleep70-21swapper/711:22:147
1137899256,3cyclictest49-21ksoftirqd/410:29:524
235242240,0sleep3784-21runrttasks12:16:413
1138799222,12cyclictest29549-21sshd11:32:315
1137899224,3cyclictest49-21ksoftirqd/412:03:144
11378992216,4cyclictest49-21ksoftirqd/411:12:274
11360992218,3cyclictest25-21ksoftirqd/110:10:261
11387992116,4cyclictest3412-21bash09:54:545
1137899219,2cyclictest49-21ksoftirqd/409:30:534
1137899218,2cyclictest49-21ksoftirqd/410:07:404
1137899217,1cyclictest49-21ksoftirqd/411:37:514
1137899217,1cyclictest49-21ksoftirqd/411:37:514
1137899215,2cyclictest49-21ksoftirqd/411:47:264
11378992117,3cyclictest49-21ksoftirqd/411:17:364
11356992117,4cyclictest26493-21kworker/u16:010:17:490
1137899209,1cyclictest131rcu_sched10:56:114
1137899209,1cyclictest131rcu_sched10:56:114
1137899207,2cyclictest131rcu_sched09:49:524
1137899206,3cyclictest49-21ksoftirqd/412:07:204
1137899206,3cyclictest49-21ksoftirqd/411:46:244
1137899205,3cyclictest49-21ksoftirqd/411:26:564
11378992016,1cyclictest49-21ksoftirqd/410:50:144
11396991917,1cyclictest19213-21kworker/u16:109:54:547
1138799198,1cyclictest686-21dbus-daemon11:58:135
11387991914,0cyclictest0-21swapper/510:25:395
1137899196,3cyclictest49-21ksoftirqd/409:58:184
1137899196,3cyclictest49-21ksoftirqd/409:58:184
1137899195,3cyclictest49-21ksoftirqd/412:32:194
1137899195,3cyclictest49-21ksoftirqd/412:32:194
1137899195,3cyclictest49-21ksoftirqd/410:04:404
1137899195,2cyclictest49-21ksoftirqd/410:38:284
1137899195,2cyclictest49-21ksoftirqd/410:34:104
11378991917,1cyclictest49-21ksoftirqd/411:56:134
11378991916,1cyclictest49-21ksoftirqd/411:29:264
11378991915,1cyclictest49-21ksoftirqd/410:17:144
11378991912,4cyclictest49-21ksoftirqd/409:46:454
1137899191,1cyclictest1152-21sshd09:08:034
1137899190,3cyclictest131rcu_sched10:43:594
11360991918,1cyclictest25-21ksoftirqd/109:27:011
11360991913,3cyclictest25-21ksoftirqd/111:03:141
1135699198,5cyclictest0-21swapper/012:11:570
1135699198,5cyclictest0-21swapper/011:58:050
1135699198,5cyclictest0-21swapper/011:53:290
1135699198,5cyclictest0-21swapper/011:07:330
1135699198,5cyclictest0-21swapper/010:57:430
1135699198,0cyclictest0-21swapper/012:36:370
1135699198,0cyclictest0-21swapper/012:36:370
1135699198,0cyclictest0-21swapper/011:40:390
1135699198,0cyclictest0-21swapper/011:40:390
1135699198,0cyclictest0-21swapper/011:17:590
1135699198,0cyclictest0-21swapper/010:52:310
1135699198,0cyclictest0-21swapper/010:52:310
1135699198,0cyclictest0-21swapper/010:43:070
63712180,0sleep6631rcuc/611:40:316
63712180,0sleep6631rcuc/611:40:316
15402180,0sleep30-21swapper/311:12:253
1137899188,3cyclictest49-21ksoftirqd/410:13:354
1137899187,3cyclictest49-21ksoftirqd/412:19:084
1137899185,1cyclictest49-21ksoftirqd/412:25:214
1137899184,1cyclictest49-21ksoftirqd/412:13:224
11378991816,1cyclictest49-21ksoftirqd/410:25:024
11378991815,1cyclictest49-21ksoftirqd/409:20:144
1137899180,2cyclictest131rcu_sched09:22:014
1137899180,1cyclictest49-21ksoftirqd/409:12:144
11360991816,2cyclictest25-21ksoftirqd/110:23:411
11360991816,1cyclictest25-21ksoftirqd/112:30:011
11360991816,1cyclictest25-21ksoftirqd/111:45:461
11360991816,1cyclictest25-21ksoftirqd/111:17:081
11360991816,1cyclictest25-21ksoftirqd/109:13:291
11360991815,3cyclictest25-21ksoftirqd/110:33:421
11360991814,3cyclictest25-21ksoftirqd/111:56:281
11360991814,3cyclictest25-21ksoftirqd/109:18:501
1135699187,5cyclictest0-21swapper/012:03:530
1135699187,5cyclictest0-21swapper/011:51:390
1135699187,5cyclictest0-21swapper/011:29:310
1135699181,5cyclictest0-21swapper/010:05:150
1135699180,6cyclictest0-21swapper/009:58:070
1135699180,6cyclictest0-21swapper/009:58:070
1135699180,12cyclictest0-21swapper/010:47:210
7422170,1sleep3741-21sshd12:06:073
172662170,1sleep217246-21bash09:37:092
11396991715,1cyclictest73-21ksoftirqd/710:31:167
11396991715,1cyclictest73-21ksoftirqd/709:16:567
11396991711,3cyclictest73-21ksoftirqd/710:33:577
11387991715,1cyclictest57-21ksoftirqd/511:26:125
11387991712,1cyclictest11810-21systemd11:14:555
11378991714,2cyclictest49-21ksoftirqd/411:03:354
11360991716,1cyclictest25-21ksoftirqd/110:29:031
11360991715,2cyclictest25-21ksoftirqd/111:57:101
11360991715,1cyclictest25-21ksoftirqd/112:26:021
11360991715,1cyclictest25-21ksoftirqd/111:50:061
11360991715,1cyclictest25-21ksoftirqd/111:29:101
11360991715,1cyclictest25-21ksoftirqd/111:07:201
11360991715,1cyclictest25-21ksoftirqd/110:17:321
11360991714,1cyclictest25-21ksoftirqd/111:12:341
1135699176,9cyclictest0-21swapper/011:45:090
1135699176,0cyclictest0-21swapper/012:09:050
1135699170,5cyclictest0-21swapper/011:33:490
1135699170,11cyclictest0-21swapper/011:24:310
113072170,0sleep00-21swapper/009:51:410
210502160,1sleep521027-21sshd09:46:415
208482160,0sleep20-21swapper/210:43:572
11396991614,1cyclictest73-21ksoftirqd/712:07:057
11396991614,1cyclictest73-21ksoftirqd/712:02:497
11396991614,1cyclictest73-21ksoftirqd/712:01:277
11396991614,1cyclictest73-21ksoftirqd/711:09:137
11396991614,1cyclictest73-21ksoftirqd/709:32:337
11396991614,1cyclictest73-21ksoftirqd/709:28:547
11396991611,1cyclictest73-21ksoftirqd/710:10:507
11396991611,1cyclictest73-21ksoftirqd/709:20:077
1139699160,16cyclictest16691-21kworker/7:410:17:327
1138799165,5cyclictest0-21swapper/511:40:575
1138799165,5cyclictest0-21swapper/511:40:575
1138799164,5cyclictest0-21swapper/512:20:495
11387991612,0cyclictest0-21swapper/511:02:435
1138799160,4cyclictest0-21swapper/512:35:095
1138799160,4cyclictest0-21swapper/512:35:095
11360991615,1cyclictest25-21ksoftirqd/112:08:571
11360991614,2cyclictest25-21ksoftirqd/110:47:441
11360991614,1cyclictest25-21ksoftirqd/112:32:101
11360991614,1cyclictest25-21ksoftirqd/112:32:101
11360991614,1cyclictest25-21ksoftirqd/112:02:061
11360991614,1cyclictest25-21ksoftirqd/111:25:541
11360991614,1cyclictest25-21ksoftirqd/110:58:411
11360991614,1cyclictest25-21ksoftirqd/110:44:291
11360991614,1cyclictest25-21ksoftirqd/109:41:491
11360991614,1cyclictest25-21ksoftirqd/109:33:271
11360991614,1cyclictest25-21ksoftirqd/109:08:191
1136099161,3cyclictest25-21ksoftirqd/109:52:041
1136099161,1cyclictest121rcu_preempt10:14:191
1136099160,1cyclictest30735-21perl10:37:081
1135699165,5cyclictest0-21swapper/010:07:330
1135699165,0cyclictest0-21swapper/012:20:310
74852150,1sleep37435-21sshd09:14:273
311562150,0sleep60-21swapper/609:15:506
1139699157,3cyclictest73-21ksoftirqd/711:50:467
11396991514,1cyclictest73-21ksoftirqd/712:23:147
11396991514,1cyclictest73-21ksoftirqd/710:14:357
11396991513,1cyclictest73-21ksoftirqd/711:21:507
11396991513,1cyclictest73-21ksoftirqd/711:15:547
11396991513,1cyclictest73-21ksoftirqd/710:23:087
11396991513,1cyclictest73-21ksoftirqd/709:57:307
11396991513,1cyclictest73-21ksoftirqd/709:57:307
11396991513,1cyclictest73-21ksoftirqd/709:47:457
11396991513,1cyclictest73-21ksoftirqd/709:46:187
11396991511,1cyclictest73-21ksoftirqd/712:32:147
11396991511,1cyclictest73-21ksoftirqd/712:32:147
1139099157,6cyclictest8041-21bash11:51:456
1139099150,15cyclictest6784-21kworker/6:410:30:396
1138799155,6cyclictest31078-21cp12:30:015
11387991512,1cyclictest30521-21sshd10:42:375
1138799150,9cyclictest0-21swapper/511:42:355
1138799150,9cyclictest0-21swapper/510:38:475
1138799150,9cyclictest0-21swapper/510:15:255
11366991513,1cyclictest33-21ksoftirqd/209:09:212
1136099153,1cyclictest25-21ksoftirqd/110:02:521
11360991514,1cyclictest25-21ksoftirqd/109:57:081
11360991514,1cyclictest25-21ksoftirqd/109:57:081
11360991513,1cyclictest25-21ksoftirqd/112:13:451
11360991513,1cyclictest25-21ksoftirqd/110:52:121
11360991513,1cyclictest25-21ksoftirqd/110:52:121
11360991513,1cyclictest25-21ksoftirqd/109:06:571
11360991512,1cyclictest25-21ksoftirqd/111:35:521
1135699154,5cyclictest0-21swapper/010:35:210
1135699150,9cyclictest0-21swapper/012:30:410
1135699150,9cyclictest0-21swapper/010:36:570
89852140,1sleep38982-21bash10:30:203
156372140,0sleep60-21swapper/607:12:116
11396991413,1cyclictest73-21ksoftirqd/712:18:017
11396991413,1cyclictest73-21ksoftirqd/711:06:197
11396991412,1cyclictest73-21ksoftirqd/711:39:547
11396991412,1cyclictest73-21ksoftirqd/711:39:547
11396991412,1cyclictest73-21ksoftirqd/710:54:237
11396991412,1cyclictest73-21ksoftirqd/710:54:237
11396991412,1cyclictest73-21ksoftirqd/709:40:497
11396991412,1cyclictest73-21ksoftirqd/709:26:407
11396991412,1cyclictest31822-21bash11:56:487
11396991411,1cyclictest73-21ksoftirqd/710:59:547
11396991410,3cyclictest73-21ksoftirqd/710:48:527
1138799148,5cyclictest25785-21systemd10:10:595
1138799148,5cyclictest0-21swapper/511:08:315
1138799148,5cyclictest0-21swapper/510:21:015
1138799148,1cyclictest0-21swapper/510:55:215
1138799148,1cyclictest0-21swapper/510:55:215
1138799148,0cyclictest0-21swapper/512:16:155
1138799145,9cyclictest7521-21sshd11:53:295
1138799143,0cyclictest0-21swapper/510:29:135
1138799142,6cyclictest0-21swapper/511:17:155
11387991412,1cyclictest57-21ksoftirqd/511:01:365
1138799140,8cyclictest0-21swapper/512:06:595
11378991412,1cyclictest49-21ksoftirqd/408:46:564
11369991412,1cyclictest41-21ksoftirqd/312:19:343
11366991411,2cyclictest33-21ksoftirqd/209:48:382
197022130,0sleep0101ktimersoftd/010:27:130
124172130,0sleep2321ktimersoftd/211:31:382
11396991312,1cyclictest73-21ksoftirqd/712:13:407
11396991312,1cyclictest73-21ksoftirqd/711:27:327
11396991311,1cyclictest73-21ksoftirqd/711:44:317
11396991311,1cyclictest73-21ksoftirqd/710:37:087
11396991311,1cyclictest73-21ksoftirqd/709:09:407
11390991311,1cyclictest0-21swapper/611:12:566
1138799138,5cyclictest0-21swapper/510:51:255
1138799138,5cyclictest0-21swapper/510:33:195
1138799137,5cyclictest0-21swapper/511:48:055
1138799132,0cyclictest0-21swapper/512:06:015
1138799132,0cyclictest0-21swapper/509:57:175
1138799132,0cyclictest0-21swapper/509:57:175
11378991312,1cyclictest49-21ksoftirqd/409:06:574
1136699138,3cyclictest33-21ksoftirqd/211:48:032
1136699133,3cyclictest30515-21sshd12:24:252
11366991311,1cyclictest33-21ksoftirqd/210:50:342
11366991311,0cyclictest13550irq/24-ahci[00010:13:082
11356991311,1cyclictest9-21ksoftirqd/009:11:160
321092120,0sleep6641ktimersoftd/610:40:566
287722120,0sleep3391rcuc/310:07:213
266422120,0sleep30-21swapper/312:22:173
23052120,0sleep341-21ksoftirqd/310:20:433
1139099129,2cyclictest6614-21grepconf.sh11:31:186
1139099122,4cyclictest4194-21id10:06:036
1139099122,4cyclictest25004-21sshd10:09:046
1139099122,4cyclictest21276-21sd-pam10:01:306
1139099122,4cyclictest21276-21sd-pam10:01:306
1139099122,4cyclictest0-21swapper/612:26:566
1139099122,4cyclictest0-21swapper/611:10:586
1139099122,4cyclictest0-21swapper/610:14:316
11390991211,1cyclictest65-21ksoftirqd/612:13:236
11390991210,1cyclictest65-21ksoftirqd/609:41:416
11390991210,1cyclictest1-21systemd10:58:336
1139099121,5cyclictest4921-21sd-pam11:05:186
1139099120,11cyclictest28004-21kworker/6:412:03:046
1139099120,11cyclictest19196-21kworker/6:309:48:256
1139099120,1cyclictest0-21swapper/611:52:546
11387991210,1cyclictest686-21dbus-daemon09:20:005
11378991211,1cyclictest49-21ksoftirqd/408:31:564
11378991211,1cyclictest49-21ksoftirqd/408:31:564
11378991211,1cyclictest49-21ksoftirqd/408:10:194
11378991210,1cyclictest49-21ksoftirqd/407:11:564
1136999129,3cyclictest41-21ksoftirqd/311:17:523
1136999129,3cyclictest41-21ksoftirqd/310:00:373
1136999129,3cyclictest41-21ksoftirqd/310:00:373
1136999122,4cyclictest3197-21grepconf.sh09:49:183
11369991210,1cyclictest775-21gdbus12:26:573
11369991210,1cyclictest41-21ksoftirqd/311:30:543
1136999120,12cyclictest2833-21kworker/3:511:32:313
1136999120,11cyclictest31085-21kworker/3:409:45:023
11366991211,1cyclictest33-21ksoftirqd/210:29:492
11366991210,2cyclictest33-21ksoftirqd/210:19:432
11366991210,1cyclictest33-21ksoftirqd/212:03:212
11366991210,1cyclictest33-21ksoftirqd/211:03:432
1135699122,4cyclictest25716-21sshd09:37:350
1135699122,4cyclictest0-21swapper/009:26:320
1135699121,5cyclictest8062-21systemd09:21:540
1139099119,1cyclictest65-21ksoftirqd/610:48:536
1139099114,1cyclictest887-21gdbus10:43:136
1139099113,7cyclictest15520-21grepconf.sh10:25:096
1139099113,1cyclictest3890-21kworker/6:409:22:566
1139099112,8cyclictest24266-21sshd09:17:136
1139099112,4cyclictest18997-21sshd12:29:186
1139099112,4cyclictest0-21swapper/610:35:186
11390991110,1cyclictest65-21ksoftirqd/612:20:116
1139099111,4cyclictest686-21dbus-daemon09:32:576
1139099111,4cyclictest32371-21grepconf.sh11:32:416
1139099111,4cyclictest1640-21sshd11:42:076
1139099111,4cyclictest0-21swapper/609:08:136
1139099110,10cyclictest22644-21kworker/6:209:27:036
1139099110,10cyclictest14275-21sshd10:19:316
1138799115,2cyclictest0-21swapper/507:21:015
1137899119,1cyclictest49-21ksoftirqd/408:16:564
1137899119,1cyclictest49-21ksoftirqd/407:27:124
1136999119,1cyclictest0-21swapper/310:04:533
1136999114,4cyclictest14099-21bash12:32:403
1136999114,4cyclictest14099-21bash12:32:403
1136999112,4cyclictest20919-21sshd09:07:133
1136999110,10cyclictest17120-21systemd-cgroups09:26:063
1136699119,1cyclictest33-21ksoftirqd/211:37:022
1136699119,1cyclictest33-21ksoftirqd/211:37:022
1136699119,1cyclictest33-21ksoftirqd/209:19:282
1136699119,1cyclictest15297-21sshd11:13:132
1136699119,1cyclictest1-21systemd09:16:152
1136699118,2cyclictest6922-21cp12:08:152
1136699118,2cyclictest21445-21sshd09:57:422
1136699118,2cyclictest21445-21sshd09:57:422
1136699116,5cyclictest0-21swapper/208:24:442
1136699116,4cyclictest33-21ksoftirqd/211:42:402
11366991110,1cyclictest33-21ksoftirqd/210:11:342
11366991110,0cyclictest17237-1kworker/2:1H12:32:102
11366991110,0cyclictest17237-1kworker/2:1H12:32:102
1136699110,1cyclictest0-21swapper/211:35:182
1135699114,4cyclictest0-21swapper/008:51:570
203442100,0sleep30-21swapper/309:29:573
1139099100,4cyclictest5678-21sshd09:42:056
1139099100,4cyclictest0-21swapper/612:33:136
1139099100,4cyclictest0-21swapper/612:33:136
1139099100,10cyclictest26470-21kworker/6:012:07:196
1138799104,2cyclictest723-21in:imjournal09:50:255
1138799104,2cyclictest0-21swapper/508:44:035
1138799103,4cyclictest691-21systemd-logind09:25:165
1138799101,6cyclictest21780-21sshd09:39:155
1137899109,1cyclictest49-21ksoftirqd/408:37:174
1137899109,1cyclictest49-21ksoftirqd/408:22:184
1137899109,1cyclictest49-21ksoftirqd/408:02:134
1136999108,1cyclictest41-21ksoftirqd/311:53:063
1136999108,1cyclictest41-21ksoftirqd/311:37:543
1136999108,1cyclictest41-21ksoftirqd/311:37:543
1136999108,1cyclictest41-21ksoftirqd/310:52:363
1136999108,1cyclictest41-21ksoftirqd/310:52:363
1136999108,1cyclictest41-21ksoftirqd/310:44:043
1136999106,1cyclictest41-21ksoftirqd/310:37:133
1136999103,4cyclictest18034-21grep10:23:243
1136999101,4cyclictest0-21swapper/309:38:073
1136999100,6cyclictest24791-21sshd11:48:563
1136999100,4cyclictest9195-21bash11:07:183
1136999100,4cyclictest20916-21sshd10:36:373
1136999100,4cyclictest16514-21sshd12:07:013
1136699109,1cyclictest33-21ksoftirqd/210:39:142
1136699109,1cyclictest0-21swapper/209:23:202
1136699108,2cyclictest33-21ksoftirqd/212:01:542
1136699108,1cyclictest33-21ksoftirqd/212:16:132
1136699108,1cyclictest33-21ksoftirqd/211:21:132
1136699108,1cyclictest33-21ksoftirqd/210:25:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional