You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 13:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu May 28, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34779917019,98cyclictest14872-21sshd23:13:185
279372900,2sleep5347799cyclictest23:17:465
48672770,1sleep34866-21systemd21:47:493
3461997673,2cyclictest1844-21nfsd23:13:183
348399585,52cyclictest14816-21bash23:13:186
115452570,1sleep665-21ksoftirqd/623:42:386
303882550,0sleep40-21swapper/421:39:574
295425442,8sleep30-21swapper/319:04:543
323992530,0sleep00-21swapper/000:04:020
195312520,0sleep219527-21sshd22:53:162
195312520,0sleep219527-21sshd22:53:162
15982510,1sleep233-21ksoftirqd/221:42:042
289025026,8sleep70-21swapper/719:04:027
316282490,0sleep70-21swapper/722:48:247
311124925,9sleep60-21swapper/619:07:066
183692490,0sleep70-21swapper/700:03:217
3449994848,0cyclictest13550irq/24-ahci[00023:13:182
316224826,8sleep10-21swapper/119:07:491
282782470,0sleep30-21swapper/323:28:493
262402460,0sleep30-21swapper/323:36:023
262402460,0sleep30-21swapper/323:36:023
233082450,0sleep20-21swapper/221:47:002
172332450,1sleep717224-21sshd23:28:137
149612450,0sleep70-21swapper/723:00:187
231042440,0sleep20-21swapper/222:29:212
69572430,1sleep46920-21sshd23:29:224
52582430,0sleep00-21swapper/021:53:230
146672430,0sleep014647-21sshd22:12:210
68052420,0sleep00-21swapper/023:36:470
68052420,0sleep00-21swapper/023:36:470
225412420,0sleep30-21swapper/322:22:013
22072420,0sleep70-21swapper/700:28:207
110512420,0sleep210597-21sshd23:57:232
312524129,8sleep00-21swapper/019:07:160
262652410,0sleep30-21swapper/322:36:593
223432410,0sleep50-21swapper/521:35:505
201122410,0sleep10-21swapper/123:00:361
190602410,1sleep233-21ksoftirqd/223:35:372
190602410,1sleep233-21ksoftirqd/223:35:372
187232410,0sleep40-21swapper/422:19:544
182632410,0sleep70-21swapper/700:38:297
14102410,1sleep3758-21runrttasks23:05:023
105082410,0sleep20-21swapper/222:02:542
319402400,0sleep00-21swapper/021:47:300
312092400,0sleep40-21swapper/423:08:404
321182390,0sleep50-21swapper/522:13:225
305323926,9sleep40-21swapper/419:06:164
292523928,8sleep20-21swapper/219:04:292
291923927,9sleep50-21swapper/519:04:245
72352380,0sleep00-21swapper/000:02:420
322982380,0sleep50-21swapper/521:32:465
293732380,0sleep6631rcuc/623:36:136
293732380,0sleep6631rcuc/623:36:136
154642380,0sleep20-21swapper/221:31:472
146292380,0sleep50-21swapper/521:11:155
117092380,0sleep30-21swapper/321:18:423
69902370,0sleep1241ktimersoftd/122:37:451
9992360,0sleep40-21swapper/423:45:404
3433993635,1cyclictest9-21ksoftirqd/023:13:190
3441993535,0cyclictest20398-21kworker/1:323:13:181
314512340,0sleep20-21swapper/223:41:542
156262330,0sleep1344199cyclictest21:17:041
3441992412,1cyclictest131rcu_sched21:12:431
3441992311,1cyclictest25-21ksoftirqd/121:33:231
344199229,4cyclictest25-21ksoftirqd/122:51:321
344199229,4cyclictest25-21ksoftirqd/122:51:321
86512210,1sleep5561ktimersoftd/500:02:475
344199218,3cyclictest25-21ksoftirqd/122:16:501
348499203,1cyclictest73-21ksoftirqd/721:44:587
344199208,3cyclictest25-21ksoftirqd/122:07:251
344199203,2cyclictest25-21ksoftirqd/121:19:431
320312200,1sleep332030-21grepconf.sh22:33:393
3484991915,1cyclictest73-21ksoftirqd/721:35:387
348499190,1cyclictest121rcu_preempt22:16:057
347799198,0cyclictest0-21swapper/520:13:105
347799197,11cyclictest0-21swapper/522:50:125
347799197,11cyclictest0-21swapper/522:50:125
3469991917,1cyclictest49-21ksoftirqd/400:34:224
344199196,1cyclictest25-21ksoftirqd/100:18:351
344199194,2cyclictest131rcu_sched22:29:251
344199194,1cyclictest25-21ksoftirqd/121:54:431
344199193,3cyclictest25-21ksoftirqd/121:48:271
3441991916,1cyclictest25-21ksoftirqd/123:20:101
3441991915,1cyclictest25-21ksoftirqd/122:26:151
3441991914,3cyclictest25-21ksoftirqd/121:41:141
3433991916,1cyclictest9-21ksoftirqd/021:30:020
117992190,0sleep20-21swapper/200:04:442
348499183,2cyclictest73-21ksoftirqd/721:56:347
3484991817,1cyclictest73-21ksoftirqd/721:14:487
348499181,2cyclictest73-21ksoftirqd/700:13:347
347799187,11cyclictest0-21swapper/521:49:245
347799187,0cyclictest0-21swapper/520:23:505
3477991815,1cyclictest57-21ksoftirqd/523:46:315
3477991813,5cyclictest0-21swapper/519:22:065
346999188,2cyclictest49-21ksoftirqd/423:36:364
346999188,2cyclictest49-21ksoftirqd/423:36:364
3469991814,3cyclictest49-21ksoftirqd/421:33:044
346999181,1cyclictest121rcu_preempt23:15:354
344199188,1cyclictest25-21ksoftirqd/121:51:311
344199185,1cyclictest25-21ksoftirqd/122:02:521
3441991817,1cyclictest25-21ksoftirqd/123:46:021
3441991816,1cyclictest25-21ksoftirqd/123:14:031
3441991816,1cyclictest25-21ksoftirqd/100:23:001
3441991815,1cyclictest25-21ksoftirqd/121:36:301
3441991813,1cyclictest131rcu_sched23:42:361
3433991814,2cyclictest9-21ksoftirqd/023:25:490
3433991811,7cyclictest9-21ksoftirqd/022:46:360
3484991716,1cyclictest73-21ksoftirqd/722:04:227
3484991715,1cyclictest73-21ksoftirqd/722:37:177
3484991715,1cyclictest73-21ksoftirqd/722:12:187
3484991715,1cyclictest73-21ksoftirqd/722:03:227
3484991712,1cyclictest73-21ksoftirqd/723:15:137
3484991710,4cyclictest73-21ksoftirqd/723:29:107
348499171,2cyclictest131rcu_sched00:06:197
347799176,0cyclictest0-21swapper/520:05:525
347799175,6cyclictest0-21swapper/519:43:265
3477991715,1cyclictest28607-21sshd23:49:035
347799170,5cyclictest0-21swapper/520:37:085
3469991715,1cyclictest49-21ksoftirqd/422:30:454
3469991715,1cyclictest49-21ksoftirqd/422:08:284
3469991715,1cyclictest49-21ksoftirqd/422:01:514
3469991715,1cyclictest49-21ksoftirqd/400:22:074
3469991714,1cyclictest49-21ksoftirqd/422:35:134
3469991714,1cyclictest49-21ksoftirqd/400:13:224
3469991713,2cyclictest49-21ksoftirqd/422:45:284
346999170,3cyclictest28433-21cp21:26:594
346999170,3cyclictest131rcu_sched00:00:154
3461991713,1cyclictest464-21systemd-journal23:15:163
344199174,1cyclictest25-21ksoftirqd/123:53:581
344199172,2cyclictest25-21ksoftirqd/123:26:511
3441991715,1cyclictest25-21ksoftirqd/123:32:231
3441991715,1cyclictest25-21ksoftirqd/123:07:501
3441991715,1cyclictest25-21ksoftirqd/122:42:051
3441991715,1cyclictest25-21ksoftirqd/122:23:151
3441991715,1cyclictest25-21ksoftirqd/121:28:261
3441991715,1cyclictest25-21ksoftirqd/100:35:011
3441991715,1cyclictest25-21ksoftirqd/100:06:531
3441991715,1cyclictest25-21ksoftirqd/100:00:131
3441991714,1cyclictest25-21ksoftirqd/100:24:201
3441991712,3cyclictest25-21ksoftirqd/123:34:521
3441991712,3cyclictest25-21ksoftirqd/123:34:521
3441991712,1cyclictest25-21ksoftirqd/100:10:441
343399177,3cyclictest9-21ksoftirqd/022:57:440
3433991714,2cyclictest9-21ksoftirqd/023:42:360
3433991712,2cyclictest9-21ksoftirqd/000:37:380
3433991711,6cyclictest9-21ksoftirqd/022:28:560
343399170,2cyclictest0-21swapper/022:51:330
343399170,2cyclictest0-21swapper/022:51:330
235192170,0sleep20-21swapper/223:24:482
128222170,1sleep773-21ksoftirqd/721:29:437
3484991615,1cyclictest73-21ksoftirqd/723:48:557
3484991615,1cyclictest73-21ksoftirqd/722:28:547
3484991615,1cyclictest73-21ksoftirqd/721:25:437
3484991615,1cyclictest73-21ksoftirqd/721:10:167
3484991614,1cyclictest73-21ksoftirqd/723:18:487
3484991614,1cyclictest73-21ksoftirqd/723:03:587
3484991614,1cyclictest73-21ksoftirqd/722:50:097
3484991614,1cyclictest73-21ksoftirqd/722:50:097
3484991614,1cyclictest73-21ksoftirqd/722:26:587
3484991614,1cyclictest73-21ksoftirqd/721:42:457
3484991614,1cyclictest73-21ksoftirqd/721:19:427
3484991614,1cyclictest464-21systemd-journal23:45:517
3484991613,2cyclictest73-21ksoftirqd/723:33:507
3484991613,2cyclictest73-21ksoftirqd/723:33:507
3484991613,2cyclictest73-21ksoftirqd/700:14:257
348499160,15cyclictest6607-21kworker/7:323:55:377
347799168,3cyclictest2880-21sshd22:30:045
347799165,0cyclictest0-21swapper/519:44:165
347799165,0cyclictest0-21swapper/519:35:485
346999165,10cyclictest49-21ksoftirqd/400:13:424
3469991615,1cyclictest49-21ksoftirqd/422:28:384
3469991615,1cyclictest49-21ksoftirqd/422:09:514
3469991614,1cyclictest49-21ksoftirqd/423:54:374
3469991614,1cyclictest49-21ksoftirqd/421:17:264
3469991612,2cyclictest49-21ksoftirqd/421:55:544
3469991612,2cyclictest49-21ksoftirqd/400:27:144
3469991612,1cyclictest49-21ksoftirqd/421:38:314
346999160,3cyclictest0-21swapper/422:16:474
346999160,2cyclictest121rcu_preempt23:05:464
346999160,15cyclictest20871-21kworker/4:323:03:314
346999160,15cyclictest20871-21kworker/4:322:54:374
346999160,1cyclictest131rcu_sched23:26:084
3441991614,1cyclictest25-21ksoftirqd/122:53:421
3441991614,1cyclictest25-21ksoftirqd/122:48:021
3441991610,3cyclictest25-21ksoftirqd/100:32:111
344199160,16cyclictest12264-21kworker/1:223:48:521
343399166,1cyclictest9-21ksoftirqd/022:59:110
343399164,2cyclictest9-21ksoftirqd/022:42:090
343399163,2cyclictest9-21ksoftirqd/022:34:580
343399163,2cyclictest9-21ksoftirqd/021:27:200
3433991615,1cyclictest9-21ksoftirqd/023:53:550
3433991614,1cyclictest9-21ksoftirqd/023:16:130
3433991614,1cyclictest9-21ksoftirqd/022:23:500
3433991614,1cyclictest9-21ksoftirqd/000:31:300
3433991614,1cyclictest9-21ksoftirqd/000:14:590
3433991612,1cyclictest9-21ksoftirqd/021:15:430
343399160,1cyclictest121rcu_preempt22:16:470
298182160,0sleep40-21swapper/400:07:424
285752160,0sleep70-21swapper/723:39:507
3484991513,1cyclictest73-21ksoftirqd/722:57:247
3484991513,1cyclictest73-21ksoftirqd/722:40:047
3484991513,1cyclictest73-21ksoftirqd/721:48:567
3484991513,1cyclictest73-21ksoftirqd/700:21:497
3484991510,3cyclictest73-21ksoftirqd/723:13:267
348499150,1cyclictest131rcu_sched22:19:527
348499150,1cyclictest131rcu_sched00:28:567
3483991513,1cyclictest65-21ksoftirqd/621:15:536
348399150,15cyclictest0-21swapper/622:44:496
347799158,1cyclictest22705-21kworker/u16:322:23:485
347799154,5cyclictest0-21swapper/521:07:285
347799153,5cyclictest0-21swapper/520:21:485
3477991513,1cyclictest57-21ksoftirqd/521:57:185
347799150,9cyclictest0-21swapper/520:55:185
347799150,9cyclictest0-21swapper/520:38:465
347799150,9cyclictest0-21swapper/519:50:065
347799150,3cyclictest0-21swapper/519:17:565
3469991514,1cyclictest49-21ksoftirqd/421:09:394
3469991513,1cyclictest49-21ksoftirqd/423:48:524
3469991513,1cyclictest49-21ksoftirqd/423:21:094
3469991513,1cyclictest49-21ksoftirqd/422:50:204
3469991513,1cyclictest49-21ksoftirqd/422:50:204
3469991513,1cyclictest49-21ksoftirqd/421:21:224
346999151,2cyclictest121rcu_preempt22:40:094
346999150,4cyclictest0-21swapper/400:29:404
346999150,1cyclictest121rcu_preempt23:39:054
3449991512,2cyclictest33-21ksoftirqd/223:30:282
3441991514,1cyclictest25-21ksoftirqd/122:08:451
343399156,3cyclictest9-21ksoftirqd/021:38:520
343399152,3cyclictest9-21ksoftirqd/022:02:460
3433991513,1cyclictest9-21ksoftirqd/023:33:270
3433991513,1cyclictest9-21ksoftirqd/022:03:510
3433991513,1cyclictest9-21ksoftirqd/021:35:480
3433991513,1cyclictest9-21ksoftirqd/021:21:280
3433991513,1cyclictest9-21ksoftirqd/021:08:390
3433991513,1cyclictest9-21ksoftirqd/000:28:100
3433991512,3cyclictest9-21ksoftirqd/023:45:380
3433991511,4cyclictest9-21ksoftirqd/023:05:440
3433991510,2cyclictest9-21ksoftirqd/021:54:350
343399150,1cyclictest131rcu_sched00:11:380
217462150,0sleep50-21swapper/523:33:565
217462150,0sleep50-21swapper/523:33:565
111432150,0sleep60-21swapper/622:25:016
3552140,1sleep6356-21systemd-cgroups21:42:006
348399143,5cyclictest1-21systemd21:08:406
347799148,6cyclictest0-21swapper/520:15:365
347799148,6cyclictest0-21swapper/520:15:365
347799144,5cyclictest19678-21sshd22:40:165
347799143,5cyclictest0-21swapper/520:31:345
347799140,9cyclictest0-21swapper/519:33:205
347799140,8cyclictest0-21swapper/519:25:325
347799140,13cyclictest24936-21kworker/5:022:45:135
347799140,1cyclictest0-21swapper/523:04:295
3469991412,1cyclictest49-21ksoftirqd/421:49:044
346999141,3cyclictest131rcu_sched21:46:004
3461991412,1cyclictest41-21ksoftirqd/323:58:023
3461991412,1cyclictest41-21ksoftirqd/321:36:083
3449991413,1cyclictest33-21ksoftirqd/222:20:262
3449991412,1cyclictest33-21ksoftirqd/223:06:112
3433991412,1cyclictest9-21ksoftirqd/023:20:240
3433991412,1cyclictest9-21ksoftirqd/022:21:410
3433991412,1cyclictest9-21ksoftirqd/021:10:060
3433991411,1cyclictest9-21ksoftirqd/000:19:350
343399140,1cyclictest131rcu_sched23:50:560
18972140,0sleep50-21swapper/520:58:505
18972140,0sleep50-21swapper/520:58:505
78442130,0sleep20-21swapper/200:19:182
3484991312,1cyclictest73-21ksoftirqd/719:53:547
3484991311,1cyclictest73-21ksoftirqd/721:08:397
348399130,12cyclictest18578-21kworker/6:323:28:456
347799138,5cyclictest0-21swapper/522:20:205
347799138,5cyclictest0-21swapper/521:58:465
347799138,5cyclictest0-21swapper/521:21:365
347799138,5cyclictest0-21swapper/520:51:505
347799138,5cyclictest0-21swapper/519:57:345
347799138,4cyclictest57-21ksoftirqd/523:31:515
347799138,1cyclictest25137-21systemd-cgroups22:14:445
347799138,0cyclictest0-21swapper/521:46:285
347799138,0cyclictest0-21swapper/521:41:325
347799138,0cyclictest0-21swapper/520:46:125
347799137,6cyclictest0-21swapper/521:24:205
347799137,5cyclictest0-21swapper/522:07:325
347799133,5cyclictest19960-21kworker/u16:422:36:525
3477991312,1cyclictest57-21ksoftirqd/500:29:445
3477991311,1cyclictest28734-21sshd23:01:065
3477991311,1cyclictest26989-21sshd00:24:055
3461991311,1cyclictest41-21ksoftirqd/300:36:443
3441991311,1cyclictest25-21ksoftirqd/120:48:381
218492130,0sleep30-21swapper/300:23:513
63432120,0sleep50-21swapper/500:10:005
348399127,4cyclictest464-21systemd-journal22:19:586
348399122,4cyclictest709-21systemd-logind21:36:446
348399122,4cyclictest3916-21sshd22:56:006
348399122,4cyclictest2531-21systemd-cgroups21:54:596
348399122,4cyclictest2364-21sshd22:37:296
348399122,4cyclictest12589-21systemd-cgroups23:44:276
348399122,4cyclictest1-21systemd22:06:126
348399122,4cyclictest0-21swapper/623:04:296
3483991210,2cyclictest8593-21bash21:23:576
3483991210,1cyclictest65-21ksoftirqd/600:33:546
348399121,5cyclictest12734-21kill22:15:546
348399121,5cyclictest12569-21bash23:22:236
348399120,12cyclictest20087-21kworker/6:100:26:116
348399120,1cyclictest0-21swapper/600:18:576
347799127,5cyclictest0-21swapper/520:02:205
347799127,1cyclictest0-21swapper/522:56:005
3477991210,1cyclictest57-21ksoftirqd/523:27:385
3477991210,1cyclictest57-21ksoftirqd/500:03:425
347799120,7cyclictest0-21swapper/521:15:085
347799120,6cyclictest0-21swapper/519:09:045
346199124,5cyclictest32096-21grepconf.sh21:12:273
3461991210,1cyclictest18336-21sshd21:26:243
344999122,4cyclictest709-21systemd-logind23:13:482
344999122,4cyclictest2947-21sshd23:19:572
3449991210,1cyclictest33-21ksoftirqd/222:27:012
3449991210,1cyclictest33-21ksoftirqd/200:26:392
344999121,4cyclictest18715-21systemd-cgroups22:58:442
344999120,11cyclictest859-21gdbus22:12:142
3441991210,1cyclictest25-21ksoftirqd/120:43:381
321742120,1sleep31-21systemd23:01:183
100012120,0sleep20-21swapper/221:55:252
348499119,1cyclictest73-21ksoftirqd/720:13:397
348499118,3cyclictest73-21ksoftirqd/720:13:587
348499118,3cyclictest73-21ksoftirqd/720:13:587
348399119,1cyclictest65-21ksoftirqd/600:14:526
348399113,7cyclictest730-21NetworkManager21:20:206
348399113,7cyclictest10038-21bash23:14:476
348399112,3cyclictest0-21swapper/622:01:246
3483991110,1cyclictest65-21ksoftirqd/623:24:446
3483991110,1cyclictest0-21swapper/600:12:006
348399111,4cyclictest29245-21systemd-cgroups21:43:406
348399111,4cyclictest26796-21sshd22:31:286
348399110,5cyclictest26139-21bash23:54:286
348399110,5cyclictest24374-21sshd22:09:096
348399110,11cyclictest24283-21kworker/6:000:04:046
348399110,11cyclictest17361-21kworker/6:021:31:396
348399110,11cyclictest0-21swapper/622:39:096
348399110,10cyclictest20393-21kworker/6:600:31:346
347799119,1cyclictest57-21ksoftirqd/523:55:255
347799119,1cyclictest57-21ksoftirqd/523:19:445
347799119,1cyclictest57-21ksoftirqd/500:17:375
347799115,3cyclictest17361-21bash00:21:455
347799110,3cyclictest721-21dbus-daemon23:38:565
34762110,0sleep30-21swapper/321:55:023
346199119,1cyclictest721-21dbus-daemon23:39:463
346199119,1cyclictest41-21ksoftirqd/323:20:523
346199119,1cyclictest41-21ksoftirqd/321:59:543
346199119,1cyclictest41-21ksoftirqd/321:53:393
346199119,1cyclictest41-21ksoftirqd/300:11:353
346199118,1cyclictest41-21ksoftirqd/323:44:133
346199113,5cyclictest9305-21sshd22:48:553
346199113,5cyclictest9305-21sshd22:48:553
346199113,4cyclictest22183-21systemd22:23:503
346199113,4cyclictest1289-21kworker/u16:100:02:213
346199112,5cyclictest857-21polkitd00:19:203
346199110,2cyclictest17378-21systemctl00:14:183
3449991110,1cyclictest33-21ksoftirqd/221:23:052
3449991110,1cyclictest0-21swapper/223:47:032
344999111,4cyclictest18665-21sshd22:16:152
344999110,11cyclictest8007-21kworker/2:222:04:062
344999110,11cyclictest31047-21kworker/2:100:03:092
344999110,11cyclictest26310-21kworker/2:321:52:152
344999110,10cyclictest14013-21kworker/2:200:29:032
343399117,4cyclictest9-21ksoftirqd/020:06:520
343399115,1cyclictest9-21ksoftirqd/020:18:560
3433991110,1cyclictest9-21ksoftirqd/020:43:540
343399110,5cyclictest0-21swapper/019:19:420
186872110,0sleep20-21swapper/222:47:392
348499109,1cyclictest73-21ksoftirqd/720:23:497
348399103,6cyclictest2680-21kworker/6:322:59:156
348399102,2cyclictest17024-21kill22:49:196
348399102,2cyclictest17024-21kill22:49:196
348399100,4cyclictest20823-21sshd21:48:446
348399100,4cyclictest0-21swapper/623:59:196
347799100,4cyclictest721-21dbus-daemon00:36:035
346199108,1cyclictest41-21ksoftirqd/321:28:563
346199108,1cyclictest41-21ksoftirqd/300:04:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional