You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 15:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Apr 01, 2026 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
56119912110,11cyclictest0-21swapper/109:08:111
5641998280,1cyclictest686-21dbus-daemon09:08:117
24872800,1sleep02452-21bash11:36:500
5634997637,39cyclictest0-21swapper/609:08:116
157912760,0sleep30-21swapper/311:06:093
5619996646,0cyclictest0-21swapper/309:08:113
538426055,2sleep10-21swapper/107:05:281
322602580,0sleep30-21swapper/311:59:033
110822560,0sleep70-21swapper/711:24:237
37492520,1sleep09-21ksoftirqd/009:17:380
231042490,0sleep60-21swapper/611:15:496
163812490,0sleep50-21swapper/511:06:115
160022490,2sleep5562899cyclictest12:29:495
517724837,8sleep30-21swapper/307:02:413
4102470,0sleep30-21swapper/312:14:013
140952470,1sleep614072-21sshd11:00:276
97242460,0sleep10-21swapper/110:54:381
87722460,1sleep665-21ksoftirqd/611:50:176
47712460,0sleep50-21swapper/512:10:345
196762460,0sleep30-21swapper/310:43:593
66872450,1sleep76683-21sshd11:03:417
5614994544,1cyclictest13550irq/24-ahci[00009:08:112
541724533,9sleep70-21swapper/707:05:587
100562450,1sleep210054-21bash11:16:492
246472440,6sleep7564199cyclictest11:12:067
117372440,1sleep011731-21systemd11:56:040
96592430,0sleep20-21swapper/209:32:462
53542430,0sleep20-21swapper/210:30:122
259432430,1sleep665-21ksoftirqd/609:18:566
96072420,0sleep1241ktimersoftd/111:50:201
560599420,42cyclictest10507-21kworker/0:309:08:110
535224229,9sleep00-21swapper/007:05:020
276042420,0sleep50-21swapper/510:23:585
241422420,0sleep10-21swapper/109:44:461
241422420,0sleep10-21swapper/109:44:461
219912420,0sleep20-21swapper/211:54:462
180632420,0sleep40-21swapper/409:44:254
180632420,0sleep40-21swapper/409:44:254
525624128,9sleep60-21swapper/607:03:486
42102410,0sleep70-21swapper/709:47:167
221082410,0sleep60-21swapper/610:06:536
122882410,0sleep10-21swapper/110:43:331
511124029,8sleep40-21swapper/407:01:464
41492400,0sleep70-21swapper/712:19:497
303992400,2sleep2561499cyclictest11:31:072
297124029,8sleep20-21swapper/207:01:202
247962400,0sleep624795-21systemd-cgroups11:56:426
214312400,0sleep2311rcuc/212:02:062
40612390,0sleep30-21swapper/310:17:003
297423927,9sleep50-21swapper/507:01:235
293052390,0sleep70-21swapper/712:21:187
293052390,0sleep70-21swapper/712:21:187
207832390,0sleep60-21swapper/610:17:596
149072390,0sleep714899-21sshd11:46:507
46412380,0sleep50-21swapper/511:14:445
304902380,0sleep70-21swapper/712:36:157
240802380,0sleep70-21swapper/710:46:117
237162380,0sleep30-21swapper/311:17:383
150942380,1sleep215063-21systemd10:17:392
193672370,0sleep70-21swapper/712:28:067
139252370,0sleep10-21swapper/111:04:071
54232350,2sleep5562899cyclictest09:34:255
5628993434,0cyclictest11471-21kworker/5:409:08:115
138322330,0sleep70-21swapper/709:53:257
85462320,0sleep4481ktimersoftd/411:35:254
562199260,19cyclictest0-21swapper/409:08:114
561499259,1cyclictest33-21ksoftirqd/210:48:582
561499225,1cyclictest33-21ksoftirqd/209:40:502
5614992219,3cyclictest33-21ksoftirqd/211:14:272
5614992215,4cyclictest33-21ksoftirqd/210:04:042
561499210,20cyclictest8454-21kworker/2:410:11:402
262332210,1sleep6641ktimersoftd/612:34:066
564199200,3cyclictest21668-21bash10:23:377
5619992018,2cyclictest41-21ksoftirqd/310:01:443
5619992017,1cyclictest41-21ksoftirqd/310:48:543
561499206,2cyclictest131rcu_sched09:41:572
561499206,2cyclictest131rcu_sched09:41:572
561499203,2cyclictest33-21ksoftirqd/212:08:162
5614992014,4cyclictest33-21ksoftirqd/209:12:032
561499197,3cyclictest33-21ksoftirqd/212:36:172
561499193,4cyclictest33-21ksoftirqd/211:50:262
561499192,1cyclictest33-21ksoftirqd/212:21:372
561499192,1cyclictest33-21ksoftirqd/212:21:372
5614991916,2cyclictest33-21ksoftirqd/211:42:312
5614991915,3cyclictest33-21ksoftirqd/210:21:572
5614991915,1cyclictest33-21ksoftirqd/210:58:102
5614991912,4cyclictest33-21ksoftirqd/211:56:512
561499191,4cyclictest121rcu_preempt10:39:142
5628991816,1cyclictest57-21ksoftirqd/511:00:465
5619991816,1cyclictest41-21ksoftirqd/309:54:013
5619991812,2cyclictest41-21ksoftirqd/310:26:213
5619991812,1cyclictest41-21ksoftirqd/312:26:583
561499186,1cyclictest33-21ksoftirqd/211:40:422
5614991817,1cyclictest33-21ksoftirqd/210:08:502
5614991817,1cyclictest33-21ksoftirqd/209:26:382
5614991816,1cyclictest6536-21sshd11:09:162
5614991814,4cyclictest33-21ksoftirqd/210:01:142
5614991813,4cyclictest33-21ksoftirqd/209:52:032
86592170,0sleep50-21swapper/509:30:565
75892170,0sleep70-21swapper/711:00:047
5641991710,6cyclictest16523-21grep11:54:267
564199170,7cyclictest31445-21grepconf.sh09:28:297
5628991715,1cyclictest57-21ksoftirqd/511:21:405
5628991715,1cyclictest57-21ksoftirqd/509:36:385
5621991715,1cyclictest49-21ksoftirqd/412:28:154
5619991715,1cyclictest41-21ksoftirqd/311:45:553
5619991715,1cyclictest41-21ksoftirqd/311:00:173
5619991715,1cyclictest41-21ksoftirqd/310:07:453
5619991714,2cyclictest41-21ksoftirqd/310:12:273
5619991711,5cyclictest41-21ksoftirqd/309:38:263
5614991715,1cyclictest33-21ksoftirqd/212:12:492
5614991715,1cyclictest33-21ksoftirqd/211:25:522
5614991715,1cyclictest33-21ksoftirqd/209:20:222
5614991714,2cyclictest33-21ksoftirqd/209:51:042
5614991713,4cyclictest33-21ksoftirqd/212:26:212
5614991713,1cyclictest33-21ksoftirqd/212:20:402
561499171,2cyclictest131rcu_sched10:33:152
5611991711,5cyclictest3602-21systemd10:20:461
93452160,0sleep30-21swapper/309:25:263
564199160,14cyclictest0-21swapper/711:38:497
564199160,11cyclictest0-21swapper/711:27:387
5619991615,1cyclictest41-21ksoftirqd/312:06:303
5619991615,1cyclictest41-21ksoftirqd/311:26:133
5619991614,1cyclictest41-21ksoftirqd/311:12:473
5619991614,1cyclictest41-21ksoftirqd/310:51:283
5619991614,1cyclictest41-21ksoftirqd/310:21:333
5619991614,1cyclictest41-21ksoftirqd/309:17:013
5614991614,1cyclictest33-21ksoftirqd/210:51:292
5614991614,1cyclictest33-21ksoftirqd/209:21:472
5614991613,1cyclictest33-21ksoftirqd/211:01:242
5614991612,4cyclictest33-21ksoftirqd/211:31:582
560599160,1cyclictest16213-21systemd-cgroups10:10:210
307572160,0sleep70-21swapper/710:35:227
240222160,0sleep00-21swapper/012:35:520
86822150,0sleep10-21swapper/109:36:291
564199150,2cyclictest797-21sshd11:58:257
5628991514,1cyclictest57-21ksoftirqd/511:41:375
5628991513,1cyclictest57-21ksoftirqd/512:13:585
5628991513,1cyclictest57-21ksoftirqd/511:29:505
5628991513,1cyclictest57-21ksoftirqd/509:19:325
5621991513,1cyclictest49-21ksoftirqd/409:48:494
5619991513,1cyclictest41-21ksoftirqd/312:34:423
5619991513,1cyclictest41-21ksoftirqd/311:50:543
5619991513,1cyclictest41-21ksoftirqd/311:39:253
5619991513,1cyclictest41-21ksoftirqd/311:30:183
5619991513,1cyclictest41-21ksoftirqd/311:08:003
5619991513,1cyclictest41-21ksoftirqd/310:37:343
5619991513,1cyclictest41-21ksoftirqd/309:48:233
5619991513,1cyclictest41-21ksoftirqd/309:41:283
5619991513,1cyclictest41-21ksoftirqd/309:41:283
5619991513,1cyclictest41-21ksoftirqd/309:35:503
5614991513,1cyclictest33-21ksoftirqd/210:41:192
5611991513,1cyclictest25-21ksoftirqd/109:51:341
560599150,1cyclictest19023-21sshd12:01:580
279002150,0sleep70-21swapper/711:08:377
5641991410,3cyclictest0-21swapper/709:34:167
563499149,5cyclictest65-21ksoftirqd/610:37:266
562899149,4cyclictest4159-21iostat_ios11:16:335
562899149,3cyclictest57-21ksoftirqd/510:40:165
5628991413,1cyclictest57-21ksoftirqd/512:05:375
5628991413,1cyclictest57-21ksoftirqd/510:04:255
5628991412,2cyclictest57-21ksoftirqd/510:06:255
5628991412,2cyclictest1-21systemd10:43:415
5628991412,1cyclictest57-21ksoftirqd/512:25:155
5628991412,1cyclictest57-21ksoftirqd/512:25:155
5628991412,1cyclictest57-21ksoftirqd/511:59:045
5628991412,1cyclictest57-21ksoftirqd/511:53:325
5628991412,1cyclictest57-21ksoftirqd/511:39:205
5628991412,1cyclictest57-21ksoftirqd/510:17:545
5628991412,1cyclictest57-21ksoftirqd/509:51:185
5628991411,2cyclictest759-21rs:main5
561999149,4cyclictest41-21ksoftirqd/310:33:333
5619991413,1cyclictest41-21ksoftirqd/312:20:043
5619991413,1cyclictest41-21ksoftirqd/311:52:223
5619991412,1cyclictest41-21ksoftirqd/312:21:353
5619991412,1cyclictest41-21ksoftirqd/312:21:353
5619991412,1cyclictest41-21ksoftirqd/312:05:113
5619991412,1cyclictest41-21ksoftirqd/311:31:313
5619991412,1cyclictest41-21ksoftirqd/309:28:223
5619991410,3cyclictest41-21ksoftirqd/309:56:263
561999140,13cyclictest9867-21kworker/3:209:14:543
5611991413,1cyclictest25-21ksoftirqd/111:41:081
561199140,13cyclictest2889-21kworker/1:111:25:431
5605991412,1cyclictest9-21ksoftirqd/011:47:520
43542140,1sleep64352-21sshd10:48:426
316172140,1sleep631600-21bash12:19:326
257562140,0sleep50-21swapper/509:42:585
257562140,0sleep50-21swapper/509:42:585
125332140,0sleep60-21swapper/609:25:376
103172140,0sleep50-21swapper/511:31:425
82252130,0sleep40-21swapper/410:19:094
564199134,8cyclictest7546-21sshd10:46:597
564199134,8cyclictest29096-21grepconf.sh11:17:577
564199130,2cyclictest1-21systemd10:36:337
563499133,4cyclictest686-21dbus-daemon12:10:106
563499133,4cyclictest31308-21sshd10:26:056
563499132,5cyclictest775-21gdbus10:13:386
563499132,5cyclictest23043-21bash09:53:576
563499132,4cyclictest7077-21sshd09:32:376
563499130,13cyclictest0-21swapper/610:29:416
5628991312,1cyclictest57-21ksoftirqd/512:34:415
5628991312,1cyclictest57-21ksoftirqd/512:19:405
5628991312,1cyclictest57-21ksoftirqd/510:51:425
5628991311,1cyclictest57-21ksoftirqd/511:46:275
5628991311,1cyclictest57-21ksoftirqd/510:51:125
5628991311,1cyclictest57-21ksoftirqd/510:33:105
5628991311,1cyclictest57-21ksoftirqd/509:21:195
562899131,11cyclictest3861-21kworker/u16:009:58:345
5621991311,1cyclictest686-21dbus-daemon09:59:094
5614991311,2cyclictest33-21ksoftirqd/207:56:172
5614991311,2cyclictest33-21ksoftirqd/207:56:172
561199132,5cyclictest5568-21cp11:07:191
5611991312,1cyclictest25-21ksoftirqd/110:40:111
561199130,12cyclictest691-21systemd-logind12:33:021
560599132,5cyclictest885-21polkitd12:11:130
5605991312,1cyclictest9-21ksoftirqd/011:30:580
5605991311,1cyclictest9-21ksoftirqd/010:14:520
48242130,0sleep10-21swapper/109:32:281
197642130,0sleep40-21swapper/409:53:464
57892120,0sleep40-21swapper/411:03:384
564199127,4cyclictest686-21dbus-daemon10:04:527
564199124,7cyclictest8834-21id09:12:217
564199124,7cyclictest21455-21grepconf.sh09:24:147
564199124,7cyclictest1116-21nfsd10:07:307
564199123,8cyclictest786-21snmpd09:36:187
564199123,8cyclictest23906-21grep10:18:107
564199123,3cyclictest686-21dbus-daemon10:12:137
564199122,4cyclictest11155-21sshd12:12:447
564199122,2cyclictest691-21systemd-logind09:42:397
564199122,2cyclictest691-21systemd-logind09:42:397
564199120,2cyclictest9482-21sshd09:56:497
564199120,2cyclictest8415-21bash11:31:377
564199120,2cyclictest21976-21grepconf.sh12:02:097
564199120,2cyclictest19689-21sshd12:07:377
564199120,2cyclictest11580-21bash11:42:577
564199120,2cyclictest1-21systemd10:26:497
564199120,2cyclictest1-21systemd09:19:217
563499122,4cyclictest0-21swapper/611:51:186
563499122,4cyclictest0-21swapper/611:03:496
5634991210,1cyclictest65-21ksoftirqd/612:28:426
5634991210,1cyclictest65-21ksoftirqd/611:09:406
563499120,6cyclictest19569-21systemd-cgroups09:27:476
563499120,11cyclictest2854-21kworker/6:011:26:126
563499120,11cyclictest15129-21sshd12:01:446
5628991211,1cyclictest57-21ksoftirqd/510:26:295
5628991210,1cyclictest57-21ksoftirqd/507:36:175
562199122,4cyclictest25055-21systemd-cgroups11:43:444
562199122,4cyclictest0-21swapper/410:41:244
5621991210,1cyclictest49-21ksoftirqd/411:47:004
5621991210,1cyclictest49-21ksoftirqd/409:26:344
562199121,5cyclictest0-21swapper/409:34:374
562199120,11cyclictest0-21swapper/411:28:274
562199120,11cyclictest0-21swapper/410:13:254
561199122,4cyclictest1622-21grep09:13:501
561199122,4cyclictest12974-21bash12:12:501
561199122,4cyclictest0-21swapper/111:58:521
561199122,4cyclictest0-21swapper/111:45:431
5611991210,1cyclictest25-21ksoftirqd/110:24:571
561199121,5cyclictest809-21grepconf.sh09:56:251
561199120,11cyclictest28417-21kworker/1:010:05:151
561199120,10cyclictest0-21swapper/112:23:211
561199120,10cyclictest0-21swapper/112:23:211
560599122,4cyclictest20148-21systemd-cgroups10:03:000
5605991210,1cyclictest9-21ksoftirqd/011:16:460
560599120,12cyclictest31582-21kworker/0:310:35:030
560599120,11cyclictest4408-21kworker/0:012:12:090
560599120,11cyclictest11330-21sshd09:44:010
560599120,11cyclictest11330-21sshd09:44:010
298182120,1sleep429819-21grepconf.sh11:21:404
282582120,0sleep028248-21sshd09:37:320
216172120,0sleep00-21swapper/012:17:020
193972120,0sleep10-21swapper/109:46:221
564199114,6cyclictest11013-21sshd10:52:457
563499119,1cyclictest10531-21grep07:11:386
563499119,1cyclictest0-21swapper/611:41:406
563499113,4cyclictest19788-21sshd09:38:576
563499112,3cyclictest0-21swapper/610:54:206
563499111,4cyclictest20216-21grepconf.sh11:39:476
563499111,4cyclictest20058-21sshd11:21:136
563499111,4cyclictest14159-21sshd12:14:496
563499111,4cyclictest0-21swapper/611:29:086
563499111,4cyclictest0-21swapper/610:31:326
563499110,4cyclictest17525-21sshd11:32:086
563499110,11cyclictest30600-21kworker/6:409:58:436
563499110,10cyclictest0-21swapper/610:03:556
563499110,1cyclictest0-21swapper/609:43:546
563499110,1cyclictest0-21swapper/609:43:546
562899119,1cyclictest57-21ksoftirqd/511:09:465
562899119,1cyclictest57-21ksoftirqd/510:15:515
562899117,4cyclictest57-21ksoftirqd/509:46:215
562199119,1cyclictest49-21ksoftirqd/411:40:394
562199119,1cyclictest49-21ksoftirqd/410:10:514
562199119,1cyclictest49-21ksoftirqd/408:36:174
562199119,1cyclictest20683-21systemd-cgroups12:09:364
562199118,2cyclictest16608-21sshd10:23:194
562199113,7cyclictest30911-21bash11:14:234
562199112,4cyclictest27901-21sshd10:57:284
562199112,4cyclictest0-21swapper/410:52:394
562199112,4cyclictest0-21swapper/409:12:014
562199112,3cyclictest0-21swapper/412:18:524
562199111,4cyclictest27974-21bash11:08:384
562199111,4cyclictest25165-21sshd10:27:334
562199111,4cyclictest24760-21sshd12:22:504
562199111,4cyclictest24760-21sshd12:22:504
561199112,4cyclictest7446-21sshd10:48:531
561199111,4cyclictest31604-21sshd09:28:301
561199111,4cyclictest0-21swapper/111:19:571
561199111,4cyclictest0-21swapper/109:17:371
561199110,5cyclictest31203-21sshd12:08:181
561199110,5cyclictest14668-21systemd10:08:221
561199110,5cyclictest12000-21bash10:11:521
561199110,11cyclictest12269-21kworker/1:412:17:031
561199110,10cyclictest17565-21cpuspeed_turbos07:26:291
560599119,1cyclictest9-21ksoftirqd/009:27:440
560599119,1cyclictest30318-21pmu-power10:16:390
560599119,1cyclictest17187-21sshd11:13:340
560599114,6cyclictest686-21dbus-daemon10:25:310
560599113,2cyclictest31148-21bash11:34:510
560599111,4cyclictest1-21systemd09:46:340
560599110,5cyclictest19006-21bash09:57:220
560599110,11cyclictest9891-21kworker/0:412:27:250
560599110,11cyclictest22589-21kworker/0:410:48:340
560599110,11cyclictest0-21swapper/009:14:230
560599110,10cyclictest22589-21kworker/0:410:45:080
189642110,0sleep40-21swapper/410:40:154
151952110,0sleep415173-21sshd10:02:434
564199108,2cyclictest0-21swapper/707:56:327
564199104,5cyclictest27510-21latency_hist08:41:177
564199103,1cyclictest784-21runrttasks08:10:277
564199102,2cyclictest786-21snmpd08:22:097
564199102,1cyclictest786-21snmpd07:43:357
564199101,2cyclictest7469-21crond08:06:177
563499103,6cyclictest26591-21sshd09:13:246
563499103,1cyclictest23371-21systemd09:46:336
563499100,4cyclictest24106-21sshd10:42:196
563499100,4cyclictest0-21swapper/612:21:236
563499100,4cyclictest0-21swapper/612:21:236
562199104,3cyclictest691-21systemd-logind12:31:324
562199103,6cyclictest6889-21sshd12:01:224
562199103,4cyclictest686-21dbus-daemon12:15:034
562199103,3cyclictest27052-21sshd10:33:144
562199102,7cyclictest1-21systemd09:23:194
562199102,4cyclictest9735-21bash11:16:484
562199101,4cyclictest15026-21sshd11:59:574
562199101,4cyclictest0-21swapper/409:38:064
562199100,4cyclictest27835-21sshd10:48:104
562199100,4cyclictest16266-21sshd09:20:164
562199100,4cyclictest12907-21sshd11:52:184
561999108,1cyclictest41-21ksoftirqd/308:59:313
561999108,1cyclictest41-21ksoftirqd/308:06:183
561499109,1cyclictest33-21ksoftirqd/208:31:332
561199109,1cyclictest25-21ksoftirqd/111:54:251
561199104,3cyclictest1-21systemd11:31:561
561199103,6cyclictest14554-21sshd11:11:331
561199103,1cyclictest0-21swapper/111:01:011
561199101,4cyclictest7690-21systemd-cgroups09:23:251
561199100,4cyclictest691-21systemd-logind12:27:231
561199100,4cyclictest17649-21systemd-cgroups10:29:011
561199100,4cyclictest16620-21bash10:34:321
561199100,4cyclictest1265-21sshd11:27:291
560599103,6cyclictest0-21swapper/010:52:370
560599103,1cyclictest18516-21sshd11:24:490
560599102,7cyclictest2870-21sshd09:21:210
560599102,7cyclictest16199-21sshd10:36:240
560599102,4cyclictest18096-21systemd09:53:400
560599100,4cyclictest1873-21sshd11:07:060
560599100,4cyclictest1362-21systemd-cgroups10:28:040
560599100,10cyclictest7760-21kworker/0:511:44:580
56419993,5cyclictest784-21runrttasks08:16:267
56419993,1cyclictest30021-21nfsd407:46:347
56419992,2cyclictest786-21snmpd07:54:277
56419992,2cyclictest786-21snmpd07:54:277
56419992,1cyclictest20830-21fschecks_time07:31:327
56419991,1cyclictest0-21swapper/708:46:327
56419991,1cyclictest0-21swapper/707:26:337
56419990,4cyclictest0-21swapper/707:36:307
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional