You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 22:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Tue May 26, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
175082990,0sleep00-21swapper/010:44:040
129212860,2sleep7714299cyclictest11:35:537
16182730,0sleep50-21swapper/509:30:495
256492540,0sleep00-21swapper/010:18:410
243542540,0sleep024344-21sshd11:25:210
695325126,9sleep30-21swapper/307:08:353
170842510,1sleep517082-21grepconf.sh11:47:215
222012490,2sleep6713699cyclictest10:27:456
693224825,8sleep00-21swapper/007:08:160
143182480,0sleep20-21swapper/211:52:462
81112470,0sleep30-21swapper/309:49:453
88392460,1sleep68831-21sshd12:31:356
54302460,0sleep00-21swapper/009:29:080
287562460,0sleep30-21swapper/310:26:133
278112460,2sleep585250irq/26-em1-tx-009:09:425
72912450,0sleep20-21swapper/210:28:452
327112450,0sleep50-21swapper/510:15:185
217902450,1sleep021791-21bash09:48:460
14982450,0sleep70-21swapper/712:23:437
56402440,1sleep25630-21cp12:12:492
9542430,1sleep3758-21runrttasks12:36:443
303472430,0sleep30-21swapper/311:29:253
205192430,0sleep20-21swapper/209:37:272
147162430,0sleep71-21systemd09:27:557
3512420,1sleep557-21ksoftirqd/509:40:025
298052420,0sleep20-21swapper/210:56:002
196822420,0sleep2311rcuc/211:32:362
14532420,0sleep60-21swapper/609:10:086
95492410,0sleep30-21swapper/311:48:473
79502410,0sleep10-21swapper/109:29:171
691624128,9sleep40-21swapper/407:08:044
665424129,8sleep70-21swapper/707:04:307
29482410,0sleep30-21swapper/311:24:043
103272410,0sleep40-21swapper/410:27:024
694724027,9sleep60-21swapper/607:08:306
667024027,9sleep50-21swapper/507:04:445
314142400,0sleep50-21swapper/511:01:395
13602400,0sleep50-21swapper/512:14:205
120092400,0sleep30-21swapper/310:54:573
94792390,0sleep70-21swapper/709:42:287
279602390,0sleep40-21swapper/410:15:014
144602390,0sleep70-21swapper/711:43:307
663923827,8sleep10-21swapper/107:04:161
449823826,9sleep20-21swapper/207:03:532
263572380,0sleep60-21swapper/610:22:246
263572380,0sleep60-21swapper/610:22:246
162452360,0sleep4471rcuc/412:00:174
7142992115,4cyclictest73-21ksoftirqd/712:32:577
7142992114,4cyclictest73-21ksoftirqd/711:45:227
712499213,2cyclictest0-21swapper/510:49:375
7124992112,5cyclictest26163-21sshd09:48:575
7109992118,3cyclictest41-21ksoftirqd/311:00:563
7142992015,3cyclictest73-21ksoftirqd/709:31:067
714299201,3cyclictest121rcu_preempt10:26:467
7124992013,6cyclictest4150-21sshd12:12:435
710999205,3cyclictest41-21ksoftirqd/309:35:203
7142991914,1cyclictest73-21ksoftirqd/711:25:547
7142991913,4cyclictest73-21ksoftirqd/710:48:197
710999192,1cyclictest131rcu_sched10:05:203
7109991917,1cyclictest41-21ksoftirqd/310:14:273
110762190,1sleep011053-21sshd09:35:000
7142991817,1cyclictest73-21ksoftirqd/711:18:167
7142991816,1cyclictest73-21ksoftirqd/712:01:127
7142991816,1cyclictest73-21ksoftirqd/711:29:587
7142991816,1cyclictest73-21ksoftirqd/710:17:427
7142991816,1cyclictest73-21ksoftirqd/710:10:387
7142991815,2cyclictest73-21ksoftirqd/711:08:557
7142991813,3cyclictest73-21ksoftirqd/712:38:187
7142991812,3cyclictest73-21ksoftirqd/712:23:077
714299180,17cyclictest10765-21kworker/7:512:07:337
714299180,17cyclictest10765-21kworker/7:512:07:337
7109991817,1cyclictest41-21ksoftirqd/310:35:313
7109991816,1cyclictest41-21ksoftirqd/311:23:423
7109991816,1cyclictest41-21ksoftirqd/310:23:013
7109991816,1cyclictest41-21ksoftirqd/310:23:013
7109991816,1cyclictest41-21ksoftirqd/309:47:333
7109991815,1cyclictest41-21ksoftirqd/312:31:393
7109991815,1cyclictest41-21ksoftirqd/312:13:533
7109991814,3cyclictest41-21ksoftirqd/309:16:023
7109991814,2cyclictest41-21ksoftirqd/312:12:273
7109991813,1cyclictest41-21ksoftirqd/310:45:113
7109991813,1cyclictest41-21ksoftirqd/309:22:123
710999181,1cyclictest131rcu_sched09:24:543
714299175,1cyclictest73-21ksoftirqd/710:59:017
7142991716,1cyclictest73-21ksoftirqd/709:55:537
7142991715,1cyclictest73-21ksoftirqd/711:48:497
7142991715,1cyclictest73-21ksoftirqd/711:19:477
7142991715,1cyclictest73-21ksoftirqd/710:20:117
7142991715,1cyclictest73-21ksoftirqd/710:20:117
7142991713,1cyclictest73-21ksoftirqd/710:00:277
714299171,1cyclictest131rcu_sched10:40:507
712499173,1cyclictest11232-21grepconf.sh11:15:195
712499170,1cyclictest0-21swapper/510:04:375
7109991716,1cyclictest41-21ksoftirqd/310:13:423
7109991715,1cyclictest41-21ksoftirqd/311:59:233
7109991714,2cyclictest41-21ksoftirqd/311:46:413
7109991714,1cyclictest41-21ksoftirqd/312:26:293
7109991713,1cyclictest41-21ksoftirqd/311:15:083
7109991713,1cyclictest41-21ksoftirqd/309:11:573
710999170,1cyclictest131rcu_sched10:29:003
187562170,1sleep118752-21sshd10:05:131
85512160,0sleep50-21swapper/512:25:575
7142991615,1cyclictest73-21ksoftirqd/709:47:377
7142991615,1cyclictest73-21ksoftirqd/709:11:147
7142991614,1cyclictest73-21ksoftirqd/712:09:337
7142991614,1cyclictest73-21ksoftirqd/711:57:197
7142991614,1cyclictest73-21ksoftirqd/710:05:597
7142991614,1cyclictest73-21ksoftirqd/709:19:597
7142991614,1cyclictest73-21ksoftirqd/709:15:427
7142991613,3cyclictest73-21ksoftirqd/710:34:427
7142991613,1cyclictest73-21ksoftirqd/709:33:557
7142991612,2cyclictest73-21ksoftirqd/709:51:397
7142991611,3cyclictest73-21ksoftirqd/710:28:557
712499160,2cyclictest0-21swapper/511:33:075
712499160,0cyclictest0-21swapper/511:20:095
7116991615,1cyclictest49-21ksoftirqd/411:43:254
7116991615,1cyclictest49-21ksoftirqd/410:45:354
710999165,3cyclictest41-21ksoftirqd/309:29:063
7109991615,1cyclictest41-21ksoftirqd/312:19:033
7109991615,1cyclictest41-21ksoftirqd/311:05:363
7109991614,1cyclictest41-21ksoftirqd/311:10:423
7109991614,1cyclictest41-21ksoftirqd/310:50:413
7109991613,2cyclictest41-21ksoftirqd/309:53:583
7109991612,1cyclictest41-21ksoftirqd/312:06:083
7109991612,1cyclictest41-21ksoftirqd/312:06:083
710999161,2cyclictest131rcu_sched09:58:593
710999160,1cyclictest121rcu_preempt11:58:333
710999160,1cyclictest0-21swapper/311:34:213
7101991612,3cyclictest33-21ksoftirqd/212:01:502
234972160,1sleep123469-21sshd10:33:241
7142991514,1cyclictest73-21ksoftirqd/711:03:467
7142991513,1cyclictest73-21ksoftirqd/712:16:387
7142991513,1cyclictest73-21ksoftirqd/710:57:017
7142991513,1cyclictest73-21ksoftirqd/710:48:557
713699150,9cyclictest5297-21sshd11:59:396
712499159,6cyclictest21774-21sshd11:53:135
712499158,2cyclictest11245-21sshd11:07:595
712499152,2cyclictest4038-21cp12:36:555
712499152,1cyclictest10427-21bash10:36:195
712499151,5cyclictest6960-21grepconf.sh11:57:555
712499150,3cyclictest0-21swapper/509:24:065
712499150,2cyclictest16151-21grepconf.sh11:37:595
7116991514,1cyclictest49-21ksoftirqd/412:21:234
7116991514,1cyclictest49-21ksoftirqd/411:15:424
7116991513,1cyclictest49-21ksoftirqd/410:29:394
7109991514,1cyclictest41-21ksoftirqd/311:42:313
7109991514,1cyclictest41-21ksoftirqd/310:38:473
710999151,1cyclictest121rcu_preempt09:40:453
710199159,3cyclictest33-21ksoftirqd/210:38:112
7101991513,1cyclictest13550irq/24-ahci[00010:08:502
708799153,9cyclictest0-21swapper/007:33:370
121642150,0sleep6631rcuc/610:01:096
94642140,0sleep09462-21sshd12:07:260
94642140,0sleep09462-21sshd12:07:260
713699142,4cyclictest13115-21sshd09:46:226
713699142,11cyclictest721-21dbus-daemon11:26:276
712499143,2cyclictest32662-21sshd10:20:515
712499143,2cyclictest32662-21sshd10:20:515
712499143,2cyclictest3017-21sshd11:27:555
712499143,1cyclictest663-21in:imjournal12:00:475
712499143,1cyclictest18292-21sshd12:06:035
712499143,1cyclictest18292-21sshd12:06:035
7124991412,1cyclictest57-21ksoftirqd/511:39:565
7124991411,1cyclictest11607-21sshd09:57:275
712499140,2cyclictest0-21swapper/512:21:315
712499140,1cyclictest0-21swapper/510:09:235
712499140,1cyclictest0-21swapper/509:59:275
7116991412,1cyclictest49-21ksoftirqd/411:57:034
7116991412,1cyclictest49-21ksoftirqd/411:00:104
7116991412,1cyclictest49-21ksoftirqd/409:23:534
7116991410,4cyclictest49-21ksoftirqd/412:17:054
7101991413,1cyclictest33-21ksoftirqd/211:37:182
7094991412,1cyclictest25-21ksoftirqd/109:38:071
7094991410,3cyclictest27310-21sshd11:05:071
709499140,14cyclictest498-21kworker/1:312:17:241
708799142,9cyclictest0-21swapper/008:54:070
33372140,0sleep20-21swapper/209:19:492
288392140,0sleep2321ktimersoftd/211:44:132
7142991311,1cyclictest73-21ksoftirqd/708:33:427
713699133,4cyclictest6954-21sshd12:23:576
713699132,5cyclictest24510-21grepconf.sh09:32:096
713699131,6cyclictest0-21swapper/609:16:036
713699130,12cyclictest10151-21sshd10:58:396
712499133,10cyclictest0-21swapper/508:34:325
712499132,2cyclictest5504-21grepconf.sh10:26:455
712499132,2cyclictest26516-21bash09:13:525
712499132,2cyclictest0-21swapper/511:08:595
712499132,0cyclictest0-21swapper/510:46:215
712499131,1cyclictest6363-21kworker/5:210:53:515
712499130,5cyclictest0-21swapper/509:20:065
712499130,4cyclictest0-21swapper/512:31:435
712499130,4cyclictest0-21swapper/510:31:575
712499130,4cyclictest0-21swapper/508:25:045
712499130,1cyclictest0-21swapper/509:47:435
711699138,3cyclictest49-21ksoftirqd/409:16:334
7116991312,1cyclictest49-21ksoftirqd/412:36:244
7116991312,1cyclictest49-21ksoftirqd/411:04:274
711699130,12cyclictest26642-21kworker/4:311:13:264
711699130,12cyclictest12562-21kworker/4:209:32:464
711699130,12cyclictest12472-21sshd09:50:004
710199139,3cyclictest33-21ksoftirqd/211:41:352
7101991312,1cyclictest33-21ksoftirqd/211:22:432
7101991311,1cyclictest21630-21sshd09:24:302
7094991311,1cyclictest25-21ksoftirqd/112:22:551
708799133,10cyclictest0-21swapper/012:32:560
7087991312,1cyclictest9-21ksoftirqd/010:22:460
7087991312,1cyclictest9-21ksoftirqd/010:22:460
708799130,10cyclictest0-21swapper/009:06:010
708799130,10cyclictest0-21swapper/007:59:110
708799130,10cyclictest0-21swapper/007:40:450
42732130,1sleep14272-21bash12:03:271
223102130,0sleep40-21swapper/409:20:554
180702130,0sleep2311rcuc/212:17:132
150802130,0sleep10-21swapper/110:51:261
7142991210,1cyclictest73-21ksoftirqd/708:13:437
713699125,6cyclictest30154-21kworker/6:112:38:016
713699123,4cyclictest8183-21sshd11:56:056
713699122,5cyclictest721-21dbus-daemon12:18:546
713699122,4cyclictest904-21bash10:17:146
713699122,4cyclictest29638-21sshd11:16:246
713699122,4cyclictest22396-21sshd12:08:126
713699122,4cyclictest22396-21sshd12:08:126
713699122,4cyclictest21902-21sshd12:17:276
713699122,4cyclictest18500-21sshd11:00:536
713699122,4cyclictest14978-21systemd-cgroups11:36:016
713699122,4cyclictest14407-21sshd09:50:076
713699122,4cyclictest1239-21sshd10:37:416
713699121,5cyclictest26452-21bash12:12:086
712499123,9cyclictest0-21swapper/508:30:085
712499120,9cyclictest0-21swapper/508:53:505
712499120,4cyclictest28256-21grep09:34:085
712499120,3cyclictest0-21swapper/510:39:235
712499120,3cyclictest0-21swapper/508:46:445
712499120,3cyclictest0-21swapper/507:25:165
712499120,3cyclictest0-21swapper/507:23:225
712499120,3cyclictest0-21swapper/507:16:165
712499120,3cyclictest0-21swapper/507:11:245
711699129,2cyclictest49-21ksoftirqd/410:02:384
7116991210,1cyclictest49-21ksoftirqd/412:05:564
7116991210,1cyclictest49-21ksoftirqd/412:05:564
7116991210,1cyclictest49-21ksoftirqd/411:30:344
7116991210,1cyclictest49-21ksoftirqd/410:43:224
7116991210,1cyclictest49-21ksoftirqd/410:04:004
7116991210,1cyclictest49-21ksoftirqd/409:57:134
7116991210,1cyclictest49-21ksoftirqd/409:43:424
711699120,2cyclictest2210-21sshd12:23:464
711699120,11cyclictest3244-21kworker/4:410:12:334
710199127,1cyclictest33-21ksoftirqd/212:23:482
7101991210,1cyclictest33-21ksoftirqd/211:00:502
7101991210,1cyclictest33-21ksoftirqd/209:15:012
710199120,2cyclictest10885-21bash12:35:242
710199120,12cyclictest8406-21kworker/2:412:22:182
710199120,1cyclictest0-21swapper/210:08:192
709499127,3cyclictest25-21ksoftirqd/109:50:321
7094991210,1cyclictest25-21ksoftirqd/109:24:361
709499120,12cyclictest1844-21nfsd10:58:421
709499120,11cyclictest13818-21sshd11:50:501
708799129,3cyclictest22953-21sshd12:28:420
708799126,3cyclictest21922-21id09:22:460
708799124,5cyclictest27742-21kill10:59:320
708799123,9cyclictest0-21swapper/008:14:110
708799123,9cyclictest0-21swapper/008:09:490
708799123,9cyclictest0-21swapper/007:19:570
708799123,9cyclictest0-21swapper/007:17:350
708799123,5cyclictest0-21swapper/011:55:460
708799123,5cyclictest0-21swapper/011:49:000
708799122,10cyclictest0-21swapper/008:53:390
7087991211,1cyclictest9-21ksoftirqd/011:33:400
708799121,6cyclictest0-21swapper/009:45:480
708799120,2cyclictest18167-21grep11:41:480
708799120,11cyclictest709-21systemd-logind09:43:190
708799120,11cyclictest0-21swapper/011:21:410
191882120,1sleep119190-21grepconf.sh11:26:581
184162129,1sleep09-21ksoftirqd/009:24:200
102382120,0sleep60-21swapper/609:36:516
714299119,1cyclictest73-21ksoftirqd/708:18:537
7142991110,1cyclictest73-21ksoftirqd/707:18:427
713699117,3cyclictest859-21gdbus09:39:006
713699114,6cyclictest702-21nscd10:12:556
713699113,7cyclictest669-21avahi-daemon09:24:486
713699113,7cyclictest1-21systemd10:50:576
713699112,4cyclictest31608-21sshd11:20:126
713699112,4cyclictest28091-21systemd-cgroups10:31:466
713699112,4cyclictest27037-21sshd10:39:046
713699112,4cyclictest20214-21systemd-cgroups11:30:446
7136991110,1cyclictest65-21ksoftirqd/610:48:236
713699111,4cyclictest21689-21sshd09:56:096
713699110,5cyclictest1-21systemd11:52:256
713699110,5cyclictest1-21systemd11:44:076
713699110,11cyclictest0-21swapper/609:20:266
713699110,1cyclictest28377-21systemctl10:07:436
712499111,1cyclictest22124-21df07:33:545
712499110,2cyclictest0-21swapper/509:00:065
712499110,2cyclictest0-21swapper/508:53:205
712499110,2cyclictest0-21swapper/508:15:225
712499110,2cyclictest0-21swapper/508:08:065
712499110,2cyclictest0-21swapper/507:57:425
712499110,2cyclictest0-21swapper/507:44:005
712499110,0cyclictest0-21swapper/507:29:585
711699119,2cyclictest49-21ksoftirqd/410:55:514
711699119,1cyclictest49-21ksoftirqd/411:52:004
711699119,1cyclictest49-21ksoftirqd/411:33:534
711699119,1cyclictest49-21ksoftirqd/411:18:574
711699119,1cyclictest32623-21kworker/4:112:29:134
711699119,1cyclictest0-21swapper/409:08:454
711699117,1cyclictest49-21ksoftirqd/410:22:414
711699117,1cyclictest49-21ksoftirqd/410:22:414
711699114,2cyclictest20797-21grep11:45:404
7116991110,1cyclictest49-21ksoftirqd/410:34:364
711699110,10cyclictest4193-21grepconf.sh09:36:294
710199119,2cyclictest33-21ksoftirqd/209:58:592
710199119,1cyclictest721-21dbus-daemon10:52:082
710199119,1cyclictest33-21ksoftirqd/210:39:282
710199119,1cyclictest33-21ksoftirqd/209:33:082
710199119,1cyclictest0-21swapper/210:19:112
710199119,1cyclictest0-21swapper/210:19:112
7101991110,1cyclictest33-21ksoftirqd/211:05:312
7101991110,1cyclictest33-21ksoftirqd/209:49:582
710199110,10cyclictest30698-21sshd11:10:542
710199110,10cyclictest21354-21sshd12:06:142
710199110,10cyclictest21354-21sshd12:06:142
709499119,1cyclictest25-21ksoftirqd/112:26:251
709499119,1cyclictest25-21ksoftirqd/111:34:191
709499119,1cyclictest25-21ksoftirqd/110:46:001
709499119,1cyclictest25-21ksoftirqd/110:25:451
709499119,1cyclictest25-21ksoftirqd/109:40:481
709499119,1cyclictest1-21systemd10:35:191
709499117,3cyclictest25-21ksoftirqd/109:18:571
7094991110,1cyclictest0-21swapper/110:39:341
709499110,1cyclictest0-21swapper/111:15:021
709499110,1cyclictest0-21swapper/110:00:001
708799119,1cyclictest9-21ksoftirqd/011:38:410
708799119,1cyclictest9-21ksoftirqd/009:17:480
708799118,2cyclictest721-21dbus-daemon12:02:120
708799112,9cyclictest0-21swapper/009:03:330
708799112,9cyclictest0-21swapper/007:57:510
708799111,10cyclictest0-21swapper/008:33:210
708799110,11cyclictest21593-21kworker/0:009:59:300
708799110,11cyclictest0-21swapper/007:33:570
708799110,10cyclictest0-21swapper/010:58:020
708799110,10cyclictest0-21swapper/007:49:310
708799110,1cyclictest0-21swapper/011:15:420
51142110,0sleep10-21swapper/111:33:391
116262110,0sleep00-21swapper/010:40:040
714299108,1cyclictest73-21ksoftirqd/709:08:437
713699103,6cyclictest2369-21sshd11:42:476
713699102,2cyclictest19331-21sshd11:04:386
713699100,10cyclictest22546-21kworker/6:211:11:116
712499100,10cyclictest0-21swapper/509:04:425
712499100,10cyclictest0-21swapper/508:38:485
712499100,10cyclictest0-21swapper/508:21:345
712499100,10cyclictest0-21swapper/508:11:585
712499100,10cyclictest0-21swapper/507:50:405
712499100,10cyclictest0-21swapper/507:41:285
712499100,1cyclictest0-21swapper/507:58:545
711699109,1cyclictest49-21ksoftirqd/412:09:244
711699109,1cyclictest49-21ksoftirqd/409:48:084
711699108,1cyclictest49-21ksoftirqd/411:26:064
711699103,6cyclictest2388-21sshd10:50:414
710199109,1cyclictest33-21ksoftirqd/209:57:592
710199108,2cyclictest33-21ksoftirqd/209:41:312
710199108,1cyclictest33-21ksoftirqd/210:43:482
710199108,1cyclictest33-21ksoftirqd/209:09:182
710199108,1cyclictest24166-21latency_hist07:38:422
710199107,2cyclictest338-21systemd12:29:092
710199107,1cyclictest33-21ksoftirqd/211:14:162
710199106,3cyclictest33-21ksoftirqd/211:55:562
710199101,5cyclictest8900-21grep11:26:212
710199100,9cyclictest11721-21kworker/2:309:44:062
710199100,10cyclictest23451-21kworker/2:310:23:562
709499108,1cyclictest25-21ksoftirqd/111:43:281
709499108,1cyclictest25-21ksoftirqd/111:01:381
709499108,1cyclictest0-21swapper/109:16:201
709499106,2cyclictest24501-21grep11:08:451
709499105,1cyclictest30180-21sshd12:08:391
709499105,1cyclictest30180-21sshd12:08:391
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional