You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 08:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Mar 20, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
147032930,1sleep71116-21nfsd23:23:137
146652920,0sleep514664-21systemd-cgroups23:13:585
262172830,2sleep43163799cyclictest23:20:144
160672670,0sleep20-21swapper/200:07:452
254142610,0sleep10-21swapper/122:20:521
38292560,1sleep125-21ksoftirqd/122:36:221
93352520,0sleep10-21swapper/122:42:061
93352520,0sleep10-21swapper/122:42:061
3143625228,8sleep00-21swapper/019:06:400
74552500,0sleep00-21swapper/000:18:240
3135924925,9sleep10-21swapper/119:05:371
53462470,0sleep10-21swapper/123:33:481
177352470,0sleep10-21swapper/122:22:121
100132470,0sleep50-21swapper/500:07:245
188522460,0sleep10-21swapper/122:40:541
125832460,1sleep233-21ksoftirqd/223:17:312
109382460,0sleep7711rcuc/722:42:127
109382460,0sleep7711rcuc/722:42:127
87252440,0sleep40-21swapper/422:31:044
66402440,0sleep40-21swapper/422:08:374
142112440,0sleep70-21swapper/721:11:387
81292430,1sleep2321ktimersoftd/223:48:472
43382410,1sleep24340-21sshd22:51:122
3140824128,9sleep50-21swapper/519:06:215
3131324128,9sleep40-21swapper/419:05:004
3128924128,9sleep70-21swapper/719:04:397
226082410,1sleep322607-21sshd21:45:303
202072410,0sleep10-21swapper/123:14:181
70962400,0sleep70-21swapper/721:51:597
60912400,0sleep30-21swapper/322:30:553
3142724029,8sleep20-21swapper/219:06:342
3132424029,8sleep60-21swapper/619:05:106
285302400,0sleep00-21swapper/021:45:510
266932400,0sleep426697-21sshd22:56:114
220612400,1sleep125-21ksoftirqd/123:40:211
205092400,0sleep70-21swapper/722:48:217
202442400,1sleep320192-21sshd00:11:473
165012400,0sleep60-21swapper/622:09:126
137362400,0sleep10-21swapper/123:51:021
8922390,0sleep00-21swapper/021:53:280
3110323928,8sleep30-21swapper/319:02:113
291132390,1sleep0686-21dbus-daemon00:28:580
291132390,1sleep0686-21dbus-daemon00:28:580
284952390,1sleep125-21ksoftirqd/122:11:471
22572380,0sleep00-21swapper/000:21:530
282892370,0sleep30-21swapper/300:06:423
300802360,0sleep10-21swapper/122:58:081
280522350,0sleep70-21swapper/723:33:147
3162199263,9cyclictest786-21snmpd21:16:172
31613992313,1cyclictest121rcu_preempt21:57:361
3162199220,8cyclictest3169-21bash23:59:402
3162199220,7cyclictest30483-21sshd22:56:242
3162199220,6cyclictest25246-21bash21:53:002
3162199220,6cyclictest18258-21systemd-cgroups22:35:182
3162199220,5cyclictest9937-21sshd22:19:572
3161399223,3cyclictest25-21ksoftirqd/123:25:241
3162199210,7cyclictest5114-21grep22:12:122
3162199210,7cyclictest29999-21grep22:09:592
3162199210,7cyclictest11352-21rm21:26:212
3162199210,5cyclictest6068-21sshd23:39:252
3161399219,1cyclictest25-21ksoftirqd/121:23:461
3161399217,1cyclictest25-21ksoftirqd/121:11:451
3161399215,2cyclictest25-21ksoftirqd/123:58:421
31613992117,1cyclictest25-21ksoftirqd/123:52:191
3162199200,9cyclictest29114-21cp21:49:332
3162199200,9cyclictest13542-21systemd22:29:272
3162199200,7cyclictest32404-21grep23:09:242
3162199200,7cyclictest21472-21bash21:26:542
3162199200,6cyclictest12073-21sshd00:29:522
3162199200,6cyclictest12073-21sshd00:29:522
3162199200,5cyclictest0-21swapper/200:26:382
3162199200,10cyclictest19748-21systemd23:25:242
3161399207,1cyclictest25-21ksoftirqd/121:51:051
3161399206,2cyclictest25-21ksoftirqd/121:10:371
3161399205,2cyclictest25-21ksoftirqd/100:30:401
3161399205,2cyclictest25-21ksoftirqd/100:30:401
3161399202,1cyclictest25-21ksoftirqd/123:11:041
31613992015,3cyclictest25-21ksoftirqd/100:22:161
31613992014,3cyclictest25-21ksoftirqd/121:17:041
3164599192,2cyclictest686-21dbus-daemon22:48:145
3164599190,3cyclictest10831-21bash21:44:485
3164599190,2cyclictest8239-21sd-pam23:54:245
3162199192,6cyclictest887-21gdbus22:26:212
3162199191,9cyclictest6468-21sshd21:57:272
3162199191,8cyclictest696-21nscd22:41:312
3162199190,9cyclictest19340-21grep21:07:402
3162199190,7cyclictest18463-21sshd21:32:132
3162199190,7cyclictest1192-21grepconf.sh00:14:212
3162199190,6cyclictest14423-21sshd00:05:532
3162199190,5cyclictest8655-21sshd23:02:272
3162199190,10cyclictest24853-21grepconf.sh23:12:382
3161399197,4cyclictest25-21ksoftirqd/100:09:401
3161399196,1cyclictest25-21ksoftirqd/100:03:541
3161399195,3cyclictest25-21ksoftirqd/123:43:091
3161399195,2cyclictest25-21ksoftirqd/121:31:001
3161399193,1cyclictest25-21ksoftirqd/121:36:551
31613991916,3cyclictest25-21ksoftirqd/121:51:541
31613991910,1cyclictest25-21ksoftirqd/122:04:561
240782190,0sleep40-21swapper/421:10:154
56372180,0sleep20-21swapper/221:38:562
3162199180,9cyclictest797-21sshd22:03:152
3162199180,9cyclictest2339-21cp23:31:502
3162199180,9cyclictest19648-21sshd23:27:112
3162199180,8cyclictest1-21systemd22:57:342
3162199180,7cyclictest27024-21systemd-cgroups23:51:482
3162199180,5cyclictest17326-21id00:33:512
3162199180,5cyclictest0-21swapper/222:42:462
3162199180,5cyclictest0-21swapper/222:42:462
3161399188,2cyclictest25-21ksoftirqd/121:43:071
3161399186,2cyclictest25-21ksoftirqd/122:56:031
3161399184,1cyclictest25-21ksoftirqd/123:27:591
3161399184,1cyclictest25-21ksoftirqd/100:17:041
3161399182,3cyclictest25-21ksoftirqd/100:16:131
31613991816,1cyclictest25-21ksoftirqd/123:18:391
31613991816,1cyclictest25-21ksoftirqd/122:31:251
31613991815,1cyclictest25-21ksoftirqd/121:34:521
31613991814,1cyclictest25-21ksoftirqd/122:10:271
3161399180,1cyclictest131rcu_sched22:46:581
3163799178,5cyclictest49-21ksoftirqd/400:06:464
31629991716,1cyclictest41-21ksoftirqd/300:35:013
31629991715,1cyclictest41-21ksoftirqd/323:42:583
31629991715,1cyclictest41-21ksoftirqd/322:34:253
31629991715,1cyclictest41-21ksoftirqd/322:07:023
3162199170,6cyclictest22349-21sshd23:42:082
3162199170,10cyclictest26229-21bash21:41:582
31613991716,1cyclictest2699-21kworker/1:219:12:481
31613991715,1cyclictest25-21ksoftirqd/123:02:381
31606991715,1cyclictest9-21ksoftirqd/021:30:360
30312170,0sleep0492-21systemd-journal21:10:590
144172170,0sleep40-21swapper/423:28:474
3165999160,16cyclictest0-21swapper/723:50:447
3164599160,10cyclictest0-21swapper/500:27:115
3164599160,10cyclictest0-21swapper/500:27:115
31637991614,1cyclictest49-21ksoftirqd/400:05:364
3163799160,2cyclictest131rcu_sched21:22:134
31629991615,1cyclictest41-21ksoftirqd/321:11:283
31629991614,1cyclictest41-21ksoftirqd/323:54:593
31629991614,1cyclictest41-21ksoftirqd/323:16:033
31629991614,1cyclictest41-21ksoftirqd/322:47:013
31629991614,1cyclictest41-21ksoftirqd/322:39:313
31629991614,1cyclictest41-21ksoftirqd/322:23:193
31629991614,1cyclictest41-21ksoftirqd/322:16:303
31629991614,1cyclictest41-21ksoftirqd/321:33:173
31629991614,1cyclictest41-21ksoftirqd/300:23:303
31629991613,2cyclictest41-21ksoftirqd/323:49:403
31629991612,1cyclictest41-21ksoftirqd/321:30:463
3162199160,7cyclictest6399-21systemd00:20:152
3162199160,7cyclictest18300-21grep21:17:172
31613991615,1cyclictest7576-21kworker/1:021:05:281
31613991614,1cyclictest25-21ksoftirqd/100:32:021
275832160,0sleep60-21swapper/623:55:326
26832160,1sleep72681-21bash00:31:137
26832160,1sleep72681-21bash00:31:137
245152160,1sleep665-21ksoftirqd/622:20:496
140042160,1sleep614002-21bash22:46:126
140042160,1sleep614002-21bash22:46:126
36952150,1sleep557-21ksoftirqd/522:12:075
3164599150,15cyclictest0-21swapper/522:39:555
3163799159,3cyclictest49-21ksoftirqd/422:25:014
31637991513,1cyclictest49-21ksoftirqd/422:19:564
31637991511,1cyclictest49-21ksoftirqd/423:09:564
31629991514,1cyclictest41-21ksoftirqd/323:19:513
31629991514,1cyclictest41-21ksoftirqd/321:49:563
31629991513,1cyclictest41-21ksoftirqd/323:37:033
31629991513,1cyclictest41-21ksoftirqd/323:26:443
31629991513,1cyclictest41-21ksoftirqd/323:07:033
31629991513,1cyclictest41-21ksoftirqd/322:41:493
31629991513,1cyclictest41-21ksoftirqd/322:41:493
31629991513,1cyclictest41-21ksoftirqd/322:16:593
31629991513,1cyclictest41-21ksoftirqd/322:02:423
31629991513,1cyclictest41-21ksoftirqd/321:19:333
31629991513,1cyclictest41-21ksoftirqd/321:14:133
31629991511,3cyclictest41-21ksoftirqd/323:56:513
31629991511,3cyclictest41-21ksoftirqd/321:22:333
3162999151,1cyclictest131rcu_sched21:52:533
3162999150,2cyclictest131rcu_sched00:17:063
31613991514,1cyclictest7576-21kworker/1:020:20:041
110562150,2sleep43163799cyclictest22:46:024
110562150,2sleep43163799cyclictest22:46:024
325092140,1sleep665-21ksoftirqd/600:17:586
3165199144,4cyclictest686-21dbus-daemon23:45:286
31651991412,1cyclictest65-21ksoftirqd/623:36:216
31651991412,1cyclictest65-21ksoftirqd/623:19:336
3165199140,13cyclictest4680-21kworker/6:223:01:536
3164599146,7cyclictest23809-21bash21:27:005
3164599144,9cyclictest9593-21grep22:23:385
3164599144,9cyclictest32349-21sshd23:18:415
3164599142,11cyclictest25710-21sshd21:58:355
3164599140,3cyclictest10675-21sshd22:10:455
31637991413,1cyclictest49-21ksoftirqd/423:45:034
31637991413,1cyclictest49-21ksoftirqd/422:59:544
31637991412,1cyclictest49-21ksoftirqd/423:01:554
31637991412,1cyclictest49-21ksoftirqd/422:36:084
31637991412,1cyclictest49-21ksoftirqd/421:56:494
31637991412,1cyclictest49-21ksoftirqd/400:18:274
31637991411,2cyclictest3989-21kworker/u16:323:52:184
3163799140,13cyclictest14290-21kworker/4:300:25:474
3162999149,3cyclictest41-21ksoftirqd/323:32:163
31629991413,1cyclictest41-21ksoftirqd/322:00:093
31629991413,1cyclictest41-21ksoftirqd/300:29:063
31629991413,1cyclictest41-21ksoftirqd/300:29:063
31629991413,1cyclictest41-21ksoftirqd/300:06:573
31629991412,1cyclictest41-21ksoftirqd/323:24:093
31629991412,1cyclictest41-21ksoftirqd/322:57:553
31629991412,1cyclictest16062-21bash21:37:393
3162999140,13cyclictest15071-21kworker/3:322:51:573
31606991413,1cyclictest9-21ksoftirqd/021:33:380
31606991413,1cyclictest9-21ksoftirqd/000:05:500
31606991412,2cyclictest4211-21kworker/u16:423:22:220
31606991412,2cyclictest10457-21kworker/0:421:39:510
31606991412,1cyclictest4211-21kworker/u16:423:20:040
31606991411,3cyclictest9-21ksoftirqd/022:41:070
270562140,0sleep70-21swapper/721:27:087
222182140,0sleep00-21swapper/022:35:330
105222140,0sleep50-21swapper/521:41:075
3165999132,5cyclictest885-21polkitd23:14:117
3165199133,4cyclictest7602-21sshd21:35:236
3165199132,5cyclictest8744-21sshd23:28:276
3164599138,4cyclictest22643-21sshd21:12:015
3164599134,8cyclictest31110-21grep21:53:205
3164599134,8cyclictest2869-21grepconf.sh22:52:535
3164599134,8cyclictest21025-21grep21:47:105
3164599134,8cyclictest20452-21grepconf.sh23:43:555
3164599134,8cyclictest16714-21sshd22:01:505
3164599134,8cyclictest16688-21sshd22:33:195
3164599134,8cyclictest13368-21systemd22:20:105
3164599134,2cyclictest7300-21bash00:23:595
3164599134,2cyclictest7188-21kill21:24:125
3164599134,2cyclictest28726-21grepconf.sh21:10:355
3164599134,2cyclictest26436-21sshd23:59:085
3164599134,2cyclictest25418-21sshd00:12:005
3164599133,4cyclictest28864-21sshd23:48:065
3164599133,3cyclictest24682-21bash00:04:365
3164599133,2cyclictest16043-21sshd23:28:525
3164599132,4cyclictest686-21dbus-daemon22:59:075
3164599132,4cyclictest686-21dbus-daemon22:43:415
3164599132,4cyclictest686-21dbus-daemon22:43:415
3164599132,10cyclictest887-21gdbus23:11:335
3164599132,10cyclictest691-21systemd-logind23:39:075
3164599132,1cyclictest0-21swapper/521:16:575
3163799139,3cyclictest49-21ksoftirqd/422:14:214
3163799138,5cyclictest49-21ksoftirqd/400:32:494
3163799138,1cyclictest49-21ksoftirqd/421:51:524
31637991312,1cyclictest49-21ksoftirqd/423:32:494
31637991312,1cyclictest49-21ksoftirqd/421:31:294
31637991311,1cyclictest49-21ksoftirqd/423:13:134
31637991311,1cyclictest49-21ksoftirqd/421:47:014
31637991311,1cyclictest49-21ksoftirqd/421:46:144
31637991311,1cyclictest49-21ksoftirqd/421:37:024
31637991311,1cyclictest49-21ksoftirqd/421:31:574
31637991311,1cyclictest49-21ksoftirqd/421:19:254
31637991311,1cyclictest49-21ksoftirqd/400:30:024
31637991311,1cyclictest49-21ksoftirqd/400:30:024
31629991311,1cyclictest391rcuc/323:04:013
31613991312,1cyclictest7576-21kworker/1:020:06:221
31606991312,1cyclictest9-21ksoftirqd/022:49:020
31606991311,2cyclictest1-21systemd23:05:560
31606991311,1cyclictest9-21ksoftirqd/023:34:010
31606991311,1cyclictest9-21ksoftirqd/023:14:470
31606991311,1cyclictest9-21ksoftirqd/000:35:440
31606991310,2cyclictest19960-21kworker/0:622:13:100
31606991310,1cyclictest16907-21kworker/0:223:58:360
153652130,1sleep615357-21bash00:33:446
3165999124,5cyclictest30384-21sshd22:32:127
3165999122,4cyclictest26704-21systemd-cgroups22:02:197
3165999122,4cyclictest0-21swapper/721:12:407
31659991210,1cyclictest797-21sshd22:30:437
31659991210,1cyclictest7150-21sshd23:09:497
31659991210,1cyclictest691-21systemd-logind23:05:497
3165999120,4cyclictest0-21swapper/700:07:027
3165999120,2cyclictest2784-21grep22:17:387
3165199125,6cyclictest87950irq/25-em1-rx-000:11:426
3165199124,7cyclictest6284-21sshd22:12:166
3165199122,4cyclictest723-21in:imjournal21:25:416
3165199122,4cyclictest718-21avahi-daemon21:29:376
3165199122,4cyclictest686-21dbus-daemon00:02:176
3165199122,4cyclictest492-21systemd-journal00:14:486
3165199122,4cyclictest0-21swapper/621:57:506
31651991211,1cyclictest65-21ksoftirqd/622:28:516
31651991210,1cyclictest65-21ksoftirqd/623:13:276
31651991210,1cyclictest65-21ksoftirqd/622:51:426
31651991210,1cyclictest65-21ksoftirqd/600:22:496
3165199120,2cyclictest8825-21bash00:27:466
3165199120,2cyclictest8825-21bash00:27:466
3165199120,11cyclictest30443-21systemd00:01:176
3164599124,7cyclictest320-21grep23:31:435
3164599124,7cyclictest16000-21kill00:31:565
3164599124,1cyclictest887-21gdbus23:02:065
3164599124,1cyclictest21653-21grepconf.sh23:21:505
3164599123,3cyclictest10890-21bash21:31:535
3164599122,2cyclictest686-21dbus-daemon00:16:565
3164599120,3cyclictest0-21swapper/522:26:465
3163799127,4cyclictest49-21ksoftirqd/422:50:184
31637991210,2cyclictest49-21ksoftirqd/423:37:494
31637991210,1cyclictest49-21ksoftirqd/423:48:504
31637991210,1cyclictest49-21ksoftirqd/423:22:294
31637991210,1cyclictest49-21ksoftirqd/422:03:224
31637991210,1cyclictest49-21ksoftirqd/421:12:334
31637991210,1cyclictest49-21ksoftirqd/400:14:594
3162199120,5cyclictest0-21swapper/219:59:282
3162199120,12cyclictest0-21swapper/221:04:222
31613991212,0cyclictest7576-21kworker/1:020:37:241
31613991210,1cyclictest25-21ksoftirqd/120:26:421
3160699129,3cyclictest1897-21kworker/0:423:31:000
31606991210,1cyclictest9-21ksoftirqd/023:38:470
31606991210,1cyclictest9-21ksoftirqd/022:53:320
31606991210,1cyclictest9-21ksoftirqd/022:27:590
31606991210,1cyclictest9-21ksoftirqd/021:13:240
3160699120,11cyclictest25489-21bash23:46:080
3160699120,11cyclictest0-21swapper/022:41:490
3160699120,11cyclictest0-21swapper/022:41:490
311862120,0sleep00-21swapper/022:08:090
299302120,0sleep70-21swapper/721:47:427
116582120,2sleep03160699cyclictest23:56:300
3165999119,1cyclictest14835-21ystemctl22:22:037
3165999119,1cyclictest0-21swapper/722:09:457
3165999118,2cyclictest6518-21sshd00:35:087
3165999115,4cyclictest3491-21grepconf.sh21:22:057
3165999113,7cyclictest718-21avahi-daemon22:12:427
3165999113,7cyclictest691-21systemd-logind22:53:247
31659991110,1cyclictest73-21ksoftirqd/700:17:387
3165999111,4cyclictest723-21in:imjournal22:36:467
3165999111,4cyclictest686-21dbus-daemon00:01:417
3165999111,4cyclictest22844-21sshd00:13:437
3165999111,4cyclictest20293-21sshd23:38:217
3165999111,4cyclictest0-21swapper/721:37:317
3165999110,5cyclictest691-21systemd-logind00:02:207
3165999110,5cyclictest31417-21sshd23:16:517
3165999110,5cyclictest13079-21sd-pam00:24:207
3165999110,11cyclictest5381-21kworker/7:122:58:227
3165999110,1cyclictest908-21sshd23:42:467
3165199119,1cyclictest65-21ksoftirqd/622:02:206
3165199119,1cyclictest65-21ksoftirqd/621:19:256
3165199111,4cyclictest9067-21sshd21:52:036
3165199111,4cyclictest17367-21sshd22:26:006
3165199110,5cyclictest7126-21kworker/6:221:45:116
3165199110,11cyclictest4406-21kworker/6:421:13:456
3165199110,11cyclictest3590-21kworker/6:023:08:216
3165199110,11cyclictest28731-21kworker/6:323:22:216
3165199110,11cyclictest11898-21kworker/6:423:37:106
3165199110,11cyclictest0-21swapper/623:50:056
3165199110,10cyclictest8289-21sshd22:36:376
3165199110,10cyclictest7001-21dnf21:06:556
3165199110,10cyclictest3498-21kworker/6:321:37:346
3163799119,1cyclictest49-21ksoftirqd/423:57:044
3162199118,3cyclictest0-21swapper/220:21:592
3162199113,6cyclictest786-21snmpd20:16:552
3161399119,2cyclictest25-21ksoftirqd/120:56:431
3160699119,1cyclictest9-21ksoftirqd/023:49:100
3160699119,1cyclictest9-21ksoftirqd/022:23:000
3160699119,1cyclictest9-21ksoftirqd/022:18:350
3160699119,1cyclictest9-21ksoftirqd/021:48:230
3160699119,1cyclictest9-21ksoftirqd/000:09:050
3160699118,1cyclictest9-21ksoftirqd/022:01:320
3160699117,2cyclictest9-21ksoftirqd/021:24:300
3160699113,4cyclictest712-21nscd19:31:430
31606991110,1cyclictest9-21ksoftirqd/022:05:280
31606991110,1cyclictest9-21ksoftirqd/000:15:190
31606991110,1cyclictest10358-21cstates20:21:550
3160699110,11cyclictest23988-21kworker/0:522:59:010
3165999108,1cyclictest73-21ksoftirqd/721:33:097
3165999107,3cyclictest73-21ksoftirqd/723:28:107
3165999102,4cyclictest686-21dbus-daemon23:52:077
3165999100,4cyclictest885-21polkitd21:43:047
3165999100,4cyclictest0-21swapper/721:59:147
3165999100,4cyclictest0-21swapper/721:16:587
3165199104,3cyclictest691-21systemd-logind22:56:466
3165199100,4cyclictest16472-21sshd22:55:346
3164599107,3cyclictest0-21swapper/520:26:565
3164599104,1cyclictest0-21swapper/520:16:585
3164599103,7cyclictest0-21swapper/520:57:495
3164599103,2cyclictest786-21snmpd20:25:375
3164599103,2cyclictest17327-21open_files20:32:005
3164599102,2cyclictest18239-21cut19:37:005
3164599102,1cyclictest786-21snmpd20:00:065
3164599100,4cyclictest0-21swapper/519:12:035
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional