You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 03:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Tue Jun 02, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3162499123121,1cyclictest1844-21nfsd22:39:351
316459911436,53cyclictest721-21dbus-daemon22:39:364
292842920,0sleep529285-21sshd00:04:295
31664998452,0cyclictest0-21swapper/622:39:366
208702560,0sleep420845-21sshd21:17:284
188922540,0sleep10-21swapper/100:13:141
175982510,0sleep30-21swapper/323:39:443
3127425027,8sleep20-21swapper/219:06:192
3109825024,9sleep40-21swapper/419:03:574
48512490,0sleep20-21swapper/221:33:122
3141424926,8sleep70-21swapper/719:08:167
187882490,0sleep20-21swapper/200:05:462
14162490,1sleep71410-21sshd00:30:427
109802490,0sleep40-21swapper/422:34:334
44902480,0sleep30-21swapper/323:29:433
3123924824,20sleep00-21swapper/019:05:530
171862480,0sleep10-21swapper/121:13:331
232412470,0sleep723244-21kworker/u16:122:44:297
153682470,0sleep40-21swapper/423:48:504
113932460,0sleep50-21swapper/523:39:225
87642450,0sleep38763-21sshd22:49:143
35432440,0sleep30-21swapper/322:26:473
31630994439,4cyclictest13550irq/24-ahci[00022:39:362
22302440,0sleep30-21swapper/322:08:133
319512420,0sleep40-21swapper/400:10:124
233762420,0sleep20-21swapper/222:37:122
31616994140,1cyclictest17957-21kworker/0:222:39:360
274662410,0sleep427464-21sshd22:02:134
188582410,0sleep40-21swapper/423:13:504
129812410,2sleep63166499cyclictest22:38:286
3133524022,4sleep50-21swapper/519:07:105
3127524027,9sleep30-21swapper/319:06:203
3109324027,9sleep10-21swapper/119:03:541
271172400,2sleep03161699cyclictest00:15:290
235412400,0sleep20-21swapper/221:23:112
204942400,0sleep60-21swapper/600:03:586
139242400,0sleep10-21swapper/123:28:281
252002390,2sleep13162499cyclictest23:19:471
193062390,0sleep40-21swapper/400:24:144
61912380,2sleep23163099cyclictest23:15:002
3115423827,8sleep60-21swapper/619:04:476
103662370,0sleep10-21swapper/100:34:521
313962360,1sleep531399-21grepconf.sh23:18:235
3165299350,28cyclictest0-21swapper/522:39:365
203252320,0sleep50-21swapper/522:44:195
303032280,0sleep1231rcuc/121:23:341
3161699247,2cyclictest9-21ksoftirqd/023:44:520
31652992313,6cyclictest57-21ksoftirqd/521:30:225
3165299229,2cyclictest57-21ksoftirqd/523:23:465
3165299229,1cyclictest57-21ksoftirqd/521:46:225
3165299228,3cyclictest57-21ksoftirqd/523:30:305
3163799224,7cyclictest1-21systemd00:26:193
3163799224,5cyclictest993-21grep21:49:353
3161699220,5cyclictest20356-21sshd00:09:310
3165299217,3cyclictest57-21ksoftirqd/521:12:445
3165299213,4cyclictest57-21ksoftirqd/523:20:295
31652992120,1cyclictest57-21ksoftirqd/500:31:395
31652992116,3cyclictest464-21systemd-journal21:20:425
3163799214,5cyclictest721-21dbus-daemon22:46:313
3163799213,7cyclictest31073-21sshd21:36:323
3163799213,4cyclictest22760-21bash22:55:373
31637992120,1cyclictest1-21systemd22:39:363
3161699217,3cyclictest9-21ksoftirqd/022:53:090
4422200,0sleep40-21swapper/423:44:174
3167299200,20cyclictest26853-21kworker/7:522:39:367
3167299200,2cyclictest19925-21sshd00:28:067
3167299200,1cyclictest0-21swapper/723:29:217
3165299208,3cyclictest57-21ksoftirqd/523:54:105
3165299207,1cyclictest57-21ksoftirqd/521:56:485
3163799205,5cyclictest32020-21grepconf.sh23:49:493
3163799204,6cyclictest30339-21bash21:40:103
3163799204,6cyclictest24230-21sd-pam22:29:463
3163799204,6cyclictest24230-21sd-pam22:29:463
3163799204,6cyclictest1-21systemd22:11:263
3163799204,5cyclictest8509-21grepconf.sh21:14:493
3163799204,5cyclictest26867-21grepconf.sh22:22:353
3163799204,5cyclictest19614-21grep21:28:303
3163799204,5cyclictest18528-21sshd21:59:493
3163799203,6cyclictest28941-21grepconf.sh00:28:363
3163799203,6cyclictest15970-21sshd23:58:163
3163799203,5cyclictest19436-21grep23:38:043
3163799203,4cyclictest1-21systemd23:25:383
3163799203,3cyclictest4883-21sshd22:15:443
3163799200,4cyclictest10030-21cstates22:58:383
3161699208,2cyclictest9-21ksoftirqd/022:21:130
31616992016,2cyclictest9-21ksoftirqd/022:00:200
3161699201,3cyclictest3288-21bash21:47:570
3161699200,6cyclictest13641-21sshd22:34:420
3167299190,2cyclictest16515-21systemd22:18:197
3167299190,2cyclictest1-21systemd00:04:147
3167299190,1cyclictest0-21swapper/722:48:497
3165299199,1cyclictest57-21ksoftirqd/521:38:325
3165299197,2cyclictest57-21ksoftirqd/523:03:405
3165299196,1cyclictest57-21ksoftirqd/522:04:225
3165299195,2cyclictest57-21ksoftirqd/500:23:505
3165299194,3cyclictest57-21ksoftirqd/523:12:505
3165299194,2cyclictest57-21ksoftirqd/500:17:025
3165299194,1cyclictest57-21ksoftirqd/523:48:465
31652991916,3cyclictest57-21ksoftirqd/522:29:085
31652991916,3cyclictest57-21ksoftirqd/522:29:085
31652991915,3cyclictest57-21ksoftirqd/522:49:535
31652991915,3cyclictest57-21ksoftirqd/500:22:235
3163799194,6cyclictest17826-21id00:22:233
3163799194,5cyclictest9201-21sshd21:10:593
3163799194,5cyclictest28603-21grepconf.sh21:45:383
3163799194,5cyclictest28058-21sd-pam21:19:393
3163799194,5cyclictest1-21systemd23:59:413
3163799193,7cyclictest25543-21sshd23:05:003
3163799193,7cyclictest24042-21bash23:16:033
3163799193,7cyclictest1-21systemd00:17:463
3163799193,6cyclictest21671-21grep23:19:353
3163799193,6cyclictest13244-21sshd23:09:503
3163799193,6cyclictest1-21systemd00:04:543
3163799193,3cyclictest23505-21grepconf.sh22:35:183
3161699198,2cyclictest9-21ksoftirqd/000:22:270
31616991914,3cyclictest9-21ksoftirqd/023:15:350
3161699191,2cyclictest9-21ksoftirqd/023:56:320
3167299183,7cyclictest17938-21grepconf.sh00:35:197
31672991816,1cyclictest30259-21sshd00:15:407
3167299180,2cyclictest30766-21id23:57:147
3167299180,2cyclictest21837-21ystemctl22:11:097
3167299180,2cyclictest20284-21sshd23:41:487
3167299180,2cyclictest13052-21systemd23:28:277
3165299189,1cyclictest57-21ksoftirqd/522:12:425
3165299186,2cyclictest57-21ksoftirqd/521:51:245
3165299183,1cyclictest57-21ksoftirqd/500:37:095
31652991815,3cyclictest57-21ksoftirqd/522:38:115
31652991815,1cyclictest57-21ksoftirqd/522:25:475
31652991815,1cyclictest57-21ksoftirqd/521:34:035
3165299181,1cyclictest16911-21systemd22:22:005
3165299180,3cyclictest12949-21systemd-cgroups22:56:565
3165299180,17cyclictest26706-21kworker/5:422:03:025
3163799184,5cyclictest10116-21systemd21:55:393
3163799183,6cyclictest999-21sshd00:08:303
3163799183,6cyclictest721-21dbus-daemon23:44:163
3163799183,5cyclictest25599-21id00:33:513
3163799183,5cyclictest19994-21bash21:26:393
3163099180,12cyclictest5867-21sshd23:20:342
3161699187,2cyclictest9-21ksoftirqd/023:32:080
3161699187,2cyclictest9-21ksoftirqd/021:52:320
3161699187,2cyclictest9-21ksoftirqd/021:38:480
3161699187,1cyclictest9-21ksoftirqd/023:36:350
3161699185,1cyclictest9-21ksoftirqd/023:50:290
3161699184,1cyclictest9-21ksoftirqd/022:45:200
3161699183,2cyclictest1-21systemd22:31:150
3161699183,2cyclictest1-21systemd22:31:150
31616991814,1cyclictest9-21ksoftirqd/021:54:130
31616991814,1cyclictest9-21ksoftirqd/021:33:470
31616991813,3cyclictest9-21ksoftirqd/022:05:490
3161699180,1cyclictest0-21swapper/022:25:280
262752180,0sleep2311rcuc/221:13:582
199042180,0sleep60-21swapper/623:19:286
56912170,0sleep10-21swapper/123:07:381
3167299173,5cyclictest6430-21grep21:46:147
3167299173,5cyclictest27229-21grep23:16:157
3167299170,2cyclictest32624-21sshd22:28:287
3167299170,2cyclictest32624-21sshd22:28:287
3167299170,2cyclictest2661-21sd-pam23:03:437
3167299170,2cyclictest16547-21sshd21:24:337
3167299170,2cyclictest13816-21systemd21:39:127
3167299170,2cyclictest12236-21sshd23:02:277
3167299170,1cyclictest30914-21sshd21:19:497
3167299170,1cyclictest12365-21bash22:23:367
3167299170,1cyclictest0-21swapper/721:14:527
3165299176,1cyclictest57-21ksoftirqd/521:15:115
3165299174,3cyclictest57-21ksoftirqd/523:01:095
31652991715,1cyclictest57-21ksoftirqd/523:43:435
31652991713,3cyclictest57-21ksoftirqd/522:14:595
31652991710,5cyclictest57-21ksoftirqd/523:59:375
3165299170,17cyclictest0-21swapper/519:25:495
3165299170,1cyclictest131rcu_sched00:10:465
3163099170,10cyclictest22293-21systemd-cgroups23:34:262
3161699178,3cyclictest9-21ksoftirqd/000:08:210
3161699171,3cyclictest9-21ksoftirqd/000:27:460
3161699171,1cyclictest9-21ksoftirqd/021:29:520
3161699170,7cyclictest26483-21grep22:16:590
3161699170,6cyclictest20361-21grep23:01:030
3161699170,1cyclictest0-21swapper/000:00:270
3167299160,3cyclictest1040-21grepconf.sh21:31:067
3167299160,2cyclictest859-21gdbus23:09:057
3167299160,2cyclictest22175-21systemd00:22:387
3167299160,15cyclictest17670-21systemd21:54:127
3167299160,1cyclictest9483-21systemd-cgroups21:13:077
3167299160,1cyclictest721-21dbus-daemon21:52:177
3167299160,1cyclictest0-21swapper/722:35:217
31664991615,1cyclictest65-21ksoftirqd/621:18:036
3165299164,2cyclictest57-21ksoftirqd/521:24:365
31652991614,1cyclictest464-21systemd-journal23:36:185
3163799163,5cyclictest8724-21ntp_states20:18:463
3163799163,5cyclictest28720-21ntp_states20:53:493
3163799163,5cyclictest2113-21perl20:08:403
3163799163,5cyclictest2080-21ntp_states21:03:473
3163799163,5cyclictest2080-21ntp_states21:03:473
3163799162,6cyclictest20777-21nfsd419:43:463
3161699167,3cyclictest9-21ksoftirqd/021:16:510
3161699166,3cyclictest9-21ksoftirqd/023:41:380
3161699166,3cyclictest9-21ksoftirqd/023:03:560
3161699166,2cyclictest9-21ksoftirqd/022:55:010
3161699166,2cyclictest9-21ksoftirqd/022:09:140
3161699165,2cyclictest9-21ksoftirqd/021:19:230
3161699162,1cyclictest101ktimersoftd/021:25:560
31616991614,1cyclictest9-21ksoftirqd/023:20:560
31616991612,2cyclictest9-21ksoftirqd/023:09:520
31616991612,2cyclictest9-21ksoftirqd/021:09:470
31616991612,1cyclictest9-21ksoftirqd/000:28:440
3167299153,8cyclictest22972-21bash23:21:347
3167299150,2cyclictest721-21dbus-daemon23:50:337
3167299150,1cyclictest0-21swapper/723:36:097
3167299150,1cyclictest0-21swapper/722:04:377
3167299150,1cyclictest0-21swapper/722:01:097
3165299151,0cyclictest0-21swapper/520:01:435
3165299150,15cyclictest0-21swapper/519:42:495
3163799153,5cyclictest28585-21diskstats19:58:403
3163799153,4cyclictest6702-21ntp_states19:18:453
3163799153,4cyclictest26297-21cat19:53:433
3163799153,4cyclictest17031-21/usr/sbin/munin20:33:453
3163799152,5cyclictest8162-21cpuspeed_turbos19:23:383
3163799152,5cyclictest5558-21nfsd420:13:453
3163799152,5cyclictest31021-21iostat_ios20:58:433
3163799152,5cyclictest22451-21iostat20:43:443
3163799152,5cyclictest12988-21grep20:28:393
31624991512,2cyclictest31345-21sshd21:40:141
31624991510,1cyclictest25-21ksoftirqd/123:54:011
31616991511,2cyclictest9-21ksoftirqd/000:33:440
3161699151,1cyclictest0-21swapper/023:25:410
115162150,0sleep21-21systemd00:31:172
3167299140,1cyclictest16712-21sshd22:57:107
3165299142,1cyclictest57-21ksoftirqd/520:36:235
31652991412,1cyclictest57-21ksoftirqd/520:03:445
3163799142,4cyclictest31018-21cpu20:03:383
44442130,0sleep60-21swapper/623:48:206
3167299139,4cyclictest0-21swapper/721:36:527
31672991312,1cyclictest73-21ksoftirqd/700:02:397
3167299130,3cyclictest11142-21grepconf.sh00:12:467
3166499133,4cyclictest5111-21sshd23:07:366
3166499132,5cyclictest663-21in:imjournal22:13:026
3166499132,5cyclictest25464-21bash23:40:126
3166499132,10cyclictest12007-21sshd22:56:536
31652991312,1cyclictest57-21ksoftirqd/521:08:285
31652991312,1cyclictest57-21ksoftirqd/521:08:285
3165299130,13cyclictest0-21swapper/519:36:035
3165299130,0cyclictest0-21swapper/520:32:555
31645991311,1cyclictest49-21ksoftirqd/422:57:594
31645991311,1cyclictest49-21ksoftirqd/422:46:534
31645991311,1cyclictest49-21ksoftirqd/400:31:054
3164599130,13cyclictest27889-21kworker/4:222:21:014
3164599130,12cyclictest0-21swapper/422:28:434
3164599130,12cyclictest0-21swapper/422:28:434
3163799132,4cyclictest752-21snmpd19:38:403
3163799132,4cyclictest23083-21perl19:48:423
3163799132,4cyclictest20333-21smartctl20:38:503
3163799130,5cyclictest11575-21ntp_states20:23:433
31630991311,1cyclictest33-21ksoftirqd/221:54:412
31630991311,1cyclictest33-21ksoftirqd/221:41:322
31624991311,1cyclictest25-21ksoftirqd/122:25:111
3162499130,12cyclictest18332-21id22:48:021
308402130,1sleep230841-21bash23:55:212
250742130,0sleep60-21swapper/600:37:376
22342130,0sleep62229-21sshd00:21:286
115582130,0sleep211557-21grepconf.sh00:23:482
41652120,0sleep20-21swapper/219:13:472
3167299120,2cyclictest7864-21grepconf.sh22:19:347
3167299120,11cyclictest25726-21sshd23:45:477
3166499122,4cyclictest721-21dbus-daemon23:56:336
3166499122,4cyclictest5911-21sshd22:45:236
3166499122,4cyclictest31580-21sshd22:24:376
3166499122,4cyclictest31240-21sshd22:50:346
3166499122,4cyclictest19711-21sshd23:38:056
3166499122,4cyclictest0-21swapper/621:55:326
3166499121,5cyclictest25284-21systemd00:00:356
3166499121,5cyclictest22557-21cp00:17:076
3166499120,11cyclictest22124-21grep22:59:146
3166499120,11cyclictest21027-21bash22:31:296
3166499120,11cyclictest21027-21bash22:31:296
3166499120,11cyclictest0-21swapper/621:20:146
3165299123,9cyclictest57-21ksoftirqd/520:54:035
3165299120,12cyclictest0-21swapper/519:47:515
3165299120,0cyclictest0-21swapper/521:00:395
3164599129,2cyclictest721-21dbus-daemon23:08:424
3164599124,4cyclictest18892-21grep23:04:364
3164599123,6cyclictest736-21gdbus21:44:114
3164599123,6cyclictest27522-21bash23:27:234
31645991211,1cyclictest49-21ksoftirqd/400:18:564
31645991210,1cyclictest49-21ksoftirqd/422:25:414
31645991210,1cyclictest49-21ksoftirqd/421:51:494
3164599120,12cyclictest16411-21kworker/4:100:36:154
3163799120,4cyclictest11448-21diskstats19:28:403
3163099124,4cyclictest16380-21grepconf.sh21:26:262
3163099122,4cyclictest721-21dbus-daemon22:59:412
3163099122,4cyclictest4282-21sshd22:30:302
3163099122,4cyclictest4282-21sshd22:30:302
3163099122,4cyclictest31184-21sshd00:15:432
3163099121,5cyclictest13499-21bash22:51:252
3162499128,4cyclictest25-21ksoftirqd/100:26:291
3162499128,3cyclictest25-21ksoftirqd/123:39:591
3162499128,3cyclictest25-21ksoftirqd/123:01:421
3162499128,1cyclictest25-21ksoftirqd/123:33:471
31624991211,1cyclictest25-21ksoftirqd/123:49:071
31624991211,1cyclictest25-21ksoftirqd/122:35:231
31624991210,1cyclictest25-21ksoftirqd/122:04:071
31624991210,1cyclictest25-21ksoftirqd/121:58:421
31624991210,1cyclictest25-21ksoftirqd/121:55:161
31624991210,1cyclictest25-21ksoftirqd/100:19:391
3162499120,11cyclictest27056-21ystemctl21:09:581
3162499120,11cyclictest1-21systemd23:26:391
16232120,0sleep10-21swapper/100:17:461
151442120,0sleep70-21swapper/719:33:467
3167299113,7cyclictest752-21snmpd20:30:007
3167299113,7cyclictest10987-21cat20:23:407
3166499119,1cyclictest721-21dbus-daemon21:34:066
3166499116,4cyclictest7467-21grep21:24:006
3166499113,7cyclictest7641-21bash00:31:046
3166499112,4cyclictest5886-21sshd21:12:556
3166499112,4cyclictest4290-21grepconf.sh00:23:286
3166499112,4cyclictest27683-21grepconf.sh23:16:166
3166499112,4cyclictest20007-21bash21:30:196
31664991110,1cyclictest65-21ksoftirqd/600:09:036
3166499111,4cyclictest6803-21sshd23:29:516
3166499111,4cyclictest3538-21sshd23:11:116
3166499110,10cyclictest0-21swapper/621:48:466
3165299119,1cyclictest57-21ksoftirqd/519:53:285
3165299115,6cyclictest57-21ksoftirqd/519:18:335
3165299110,11cyclictest0-21swapper/520:50:155
3165299110,11cyclictest0-21swapper/520:40:015
3165299110,11cyclictest0-21swapper/520:24:255
3165299110,11cyclictest0-21swapper/520:22:515
3165299110,1cyclictest0-21swapper/520:14:015
3165299110,0cyclictest0-21swapper/519:16:395
3164599119,2cyclictest10264-21sshd21:18:414
3164599119,1cyclictest49-21ksoftirqd/423:54:324
3164599119,1cyclictest49-21ksoftirqd/422:52:144
3164599119,1cyclictest49-21ksoftirqd/422:08:174
3164599119,1cyclictest49-21ksoftirqd/421:39:114
3164599117,3cyclictest49-21ksoftirqd/422:08:544
31645991110,1cyclictest49-21ksoftirqd/421:55:084
31645991110,1cyclictest49-21ksoftirqd/421:28:474
31645991110,1cyclictest49-21ksoftirqd/400:14:294
3163799112,2cyclictest3848-21ntp_states19:13:443
3163799110,5cyclictest14905-21memory19:33:453
3163099113,5cyclictest857-21polkitd23:39:252
3163099110,11cyclictest9571-21kworker/2:300:23:032
3163099110,11cyclictest25164-21kworker/2:021:59:312
3163099110,11cyclictest24561-21kworker/2:223:29:492
3163099110,11cyclictest2314-21kworker/2:023:50:542
3163099110,11cyclictest14314-21kworker/2:423:45:082
3163099110,11cyclictest0-21swapper/223:05:542
3163099110,10cyclictest721-21dbus-daemon00:12:162
3162499119,1cyclictest25-21ksoftirqd/123:43:481
3162499119,1cyclictest25-21ksoftirqd/123:14:221
3162499119,1cyclictest25-21ksoftirqd/122:22:261
3162499119,1cyclictest25-21ksoftirqd/122:16:501
3162499119,1cyclictest25-21ksoftirqd/121:30:041
3162499117,1cyclictest25-21ksoftirqd/122:54:581
31624991110,1cyclictest25-21ksoftirqd/122:49:031
31624991110,1cyclictest25-21ksoftirqd/121:33:521
3162499110,11cyclictest19721-21kworker/1:400:04:051
3162499110,10cyclictest27113-21sshd21:51:071
3161699115,2cyclictest9-21ksoftirqd/020:33:270
137662118,1sleep449-21ksoftirqd/422:16:164
3167299103,6cyclictest752-21snmpd19:21:077
3167299102,7cyclictest7342-21tr20:18:397
3167299102,7cyclictest25841-21ntpq20:48:447
3167299102,7cyclictest17970-21expr19:38:457
3167299100,1cyclictest0-21swapper/719:28:387
3167299100,1cyclictest0-21swapper/719:23:477
3166499109,1cyclictest0-21swapper/620:08:496
3166499108,1cyclictest65-21ksoftirqd/623:50:586
3166499108,1cyclictest65-21ksoftirqd/622:16:496
3166499108,1cyclictest65-21ksoftirqd/619:53:286
3166499103,6cyclictest2354-21grep21:58:526
3166499102,4cyclictest30013-21systemd23:27:326
3166499100,4cyclictest20301-21sshd22:18:316
3166499100,4cyclictest0-21swapper/621:41:366
3166499100,1cyclictest85150irq/25-em1-rx-021:45:186
3165299100,10cyclictest0-21swapper/520:10:435
3165299100,10cyclictest0-21swapper/519:57:015
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional