You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 22:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Apr 22, 2026 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
212282990,0sleep721227-21systemd-cgroups11:10:137
179692730,2sleep5390699cyclictest11:54:485
253822710,1sleep125-21ksoftirqd/112:19:271
194702690,0sleep00-21swapper/009:57:330
83992670,1sleep6758-21runrttasks09:09:586
351925625,18sleep70-21swapper/707:07:337
49372550,3sleep7721ktimersoftd/709:17:447
122792540,0sleep70-21swapper/711:58:107
150122520,0sleep7721ktimersoftd/710:02:537
60302510,0sleep20-21swapper/211:40:592
38492510,2sleep0386399cyclictest12:03:160
200082510,1sleep320000-21sshd12:22:493
164742510,0sleep341-21ksoftirqd/311:32:193
15092500,0sleep40-21swapper/411:18:274
269212490,0sleep50-21swapper/512:00:485
48592480,0sleep30-21swapper/310:07:533
160192480,0sleep40-21swapper/409:16:294
159302480,0sleep415902-21sshd11:58:234
45382470,2sleep6391499cyclictest09:52:596
300252470,0sleep70-21swapper/710:55:477
187612470,0sleep10-21swapper/111:02:381
249572460,1sleep724956-21sshd09:28:097
198962460,1sleep1241ktimersoftd/112:09:491
98082450,1sleep585250irq/26-em1-tx-009:44:015
67922450,1sleep06774-21cp11:31:440
54332450,0sleep10-21swapper/111:29:531
233312450,0sleep70-21swapper/711:17:497
154712450,6sleep7392299cyclictest11:37:527
141002450,2sleep5390699cyclictest11:06:025
131312440,1sleep233-21ksoftirqd/210:23:142
323742430,0sleep40-21swapper/410:46:394
225352430,1sleep022523-21sshd11:38:170
111712430,0sleep50-21swapper/512:11:065
338824230,8sleep30-21swapper/307:05:443
296692420,1sleep529667-21systemd-cgroups12:23:235
218082420,1sleep721811-21kworker/u16:312:34:067
143892420,0sleep40-21swapper/410:14:034
143892420,0sleep40-21swapper/410:14:034
126102420,0sleep40-21swapper/409:34:554
364424129,8sleep50-21swapper/507:09:155
339124124,13sleep60-21swapper/607:05:476
338924129,9sleep40-21swapper/407:05:454
257272410,1sleep725721-21sshd09:39:227
231972410,0sleep00-21swapper/010:49:550
204392410,0sleep10-21swapper/111:51:071
137172410,1sleep513719-21sshd12:35:245
116822410,0sleep10-21swapper/110:38:031
11682410,0sleep10-21swapper/109:37:561
67872400,0sleep36785-21systemd-cgroups11:39:163
347224028,9sleep20-21swapper/207:06:562
304482400,0sleep00-21swapper/011:01:250
25532400,0sleep00-21swapper/010:15:110
49962390,0sleep60-21swapper/610:46:576
360423928,8sleep10-21swapper/107:08:391
344323926,9sleep00-21swapper/007:06:300
40732380,0sleep40-21swapper/411:29:484
152712380,0sleep10-21swapper/111:22:561
14152380,0sleep40-21swapper/411:42:374
36552300,0sleep10-21swapper/111:11:031
3872991917,1cyclictest25-21ksoftirqd/112:27:181
3898991814,3cyclictest49-21ksoftirqd/412:24:454
3872991816,1cyclictest25-21ksoftirqd/112:01:551
3872991814,1cyclictest25-21ksoftirqd/110:33:321
3922991714,2cyclictest73-21ksoftirqd/710:07:197
390699170,16cyclictest721-21dbus-daemon10:46:385
3898991712,1cyclictest49-21ksoftirqd/410:08:384
3872991715,1cyclictest25-21ksoftirqd/110:11:001
3872991715,1cyclictest25-21ksoftirqd/110:11:001
3872991714,2cyclictest25-21ksoftirqd/110:44:021
3872991714,1cyclictest25-21ksoftirqd/112:22:051
3872991713,1cyclictest25-21ksoftirqd/109:23:101
3863991713,3cyclictest9-21ksoftirqd/012:07:210
323042170,0sleep773-21ksoftirqd/711:01:327
390699160,15cyclictest0-21swapper/510:19:035
3898991612,3cyclictest49-21ksoftirqd/411:11:044
3898991612,1cyclictest49-21ksoftirqd/410:00:424
3872991615,1cyclictest25-21ksoftirqd/112:38:341
3872991615,1cyclictest25-21ksoftirqd/111:06:591
3872991614,1cyclictest25-21ksoftirqd/111:31:381
3872991614,1cyclictest25-21ksoftirqd/110:50:151
3872991610,2cyclictest25-21ksoftirqd/110:22:071
387299161,1cyclictest131rcu_sched11:47:281
3863991614,1cyclictest9-21ksoftirqd/009:38:360
60992150,0sleep20-21swapper/210:09:532
3872991514,1cyclictest25-21ksoftirqd/111:16:461
3872991513,1cyclictest25-21ksoftirqd/112:12:291
3872991513,1cyclictest25-21ksoftirqd/111:40:471
3872991513,1cyclictest25-21ksoftirqd/111:35:181
3872991513,1cyclictest25-21ksoftirqd/110:54:591
3872991513,1cyclictest25-21ksoftirqd/110:06:131
3872991513,1cyclictest25-21ksoftirqd/110:04:331
3872991513,1cyclictest25-21ksoftirqd/109:34:051
3872991511,1cyclictest25-21ksoftirqd/109:15:141
387299151,1cyclictest131rcu_sched10:15:511
300102150,0sleep50-21swapper/509:32:075
113132150,0sleep40-21swapper/409:51:294
391499140,11cyclictest8095-21sshd11:03:546
390699145,8cyclictest9757-21sshd11:17:015
390699145,8cyclictest25051-21grepconf.sh11:57:005
390699144,9cyclictest857-21polkitd10:03:535
390699144,9cyclictest25166-21rm11:36:325
390699144,3cyclictest13254-21id09:53:295
390699143,4cyclictest12902-21systemd10:56:425
389899148,4cyclictest49-21ksoftirqd/410:20:094
3898991412,1cyclictest49-21ksoftirqd/410:54:564
387299147,4cyclictest25-21ksoftirqd/109:39:581
3872991413,1cyclictest25-21ksoftirqd/111:55:401
3872991413,1cyclictest25-21ksoftirqd/109:56:481
3872991412,1cyclictest25-21ksoftirqd/110:44:581
3872991412,1cyclictest25-21ksoftirqd/110:25:171
3872991412,1cyclictest25-21ksoftirqd/109:50:021
3872991412,1cyclictest10760-21systemd12:31:331
3872991410,1cyclictest25-21ksoftirqd/109:45:111
3872991410,1cyclictest25-21ksoftirqd/109:13:401
387299140,13cyclictest1340-21kworker/1:009:27:241
3863991412,1cyclictest9-21ksoftirqd/012:18:000
3863991412,1cyclictest9-21ksoftirqd/011:15:280
3863991410,1cyclictest9-21ksoftirqd/011:09:280
191922140,0sleep40-21swapper/412:32:034
140362140,0sleep40-21swapper/412:09:284
110682140,1sleep011050-21bash12:25:580
43912130,1sleep7711rcuc/712:18:127
392299132,5cyclictest12201-21systemd-cgroups11:46:567
3922991311,1cyclictest73-21ksoftirqd/709:31:527
392299130,12cyclictest1-21systemd12:12:167
3914991311,1cyclictest65-21ksoftirqd/612:13:436
391499130,12cyclictest15179-21sshd11:15:256
390699135,7cyclictest3907-21grepconf.sh12:06:575
390699135,1cyclictest1-21systemd10:24:325
390699134,2cyclictest8968-21grep12:25:515
390699134,2cyclictest5774-21grep10:09:525
390699134,2cyclictest464-21systemd-journal11:46:475
390699134,2cyclictest17470-21bash11:43:355
390699133,4cyclictest2922-21sshd10:50:305
390699133,2cyclictest709-21systemd-logind11:21:475
390699133,2cyclictest3552-21grepconf.sh11:31:335
390699131,4cyclictest1-21systemd10:25:135
390699130,12cyclictest8335-21sd-pam11:28:095
3898991311,1cyclictest49-21ksoftirqd/411:06:174
3898991311,1cyclictest49-21ksoftirqd/411:00:124
388999139,3cyclictest41-21ksoftirqd/309:52:043
3889991311,1cyclictest41-21ksoftirqd/311:44:003
388999130,13cyclictest13380-21kworker/3:612:09:153
3881991310,2cyclictest33-21ksoftirqd/210:41:472
386399139,1cyclictest9-21ksoftirqd/010:00:360
3863991312,1cyclictest9-21ksoftirqd/012:38:140
3863991311,1cyclictest9-21ksoftirqd/010:40:240
3863991310,1cyclictest9-21ksoftirqd/012:34:270
31162130,0sleep60-21swapper/612:27:246
277722130,0sleep6631rcuc/611:47:526
254472130,0sleep70-21swapper/709:46:437
232712130,2sleep6391499cyclictest11:06:356
228172130,0sleep20-21swapper/210:46:052
213702130,0sleep40-21swapper/410:33:014
189122130,0sleep20-21swapper/212:37:382
121692130,0sleep60-21swapper/611:22:456
116412130,0sleep40-21swapper/411:39:334
392299129,2cyclictest17095-21grep10:14:137
392299129,2cyclictest17095-21grep10:14:137
392299122,4cyclictest3123-21id09:23:127
392299122,4cyclictest23151-21sshd10:40:307
392299122,4cyclictest11911-21sshd09:12:207
392299122,4cyclictest1-21systemd10:17:287
392299122,4cyclictest0-21swapper/710:37:487
3922991211,1cyclictest73-21ksoftirqd/711:26:257
3922991210,1cyclictest73-21ksoftirqd/712:09:397
391499127,5cyclictest0-21swapper/609:16:116
391499124,7cyclictest15566-21sshd12:00:126
391499122,4cyclictest857-21polkitd10:01:226
391499122,4cyclictest721-21dbus-daemon09:45:196
391499122,4cyclictest4973-21sshd12:31:126
391499122,4cyclictest21016-21sshd10:38:366
391499121,5cyclictest14783-21kill12:05:416
390699124,2cyclictest859-21gdbus10:35:155
390699124,1cyclictest8461-21grep09:55:065
390699123,2cyclictest7428-21sshd11:00:095
390699123,2cyclictest721-21dbus-daemon10:10:065
390699123,2cyclictest721-21dbus-daemon10:10:065
390699123,2cyclictest23749-21grepconf.sh09:10:545
390699123,2cyclictest19929-21if_err_em211:10:105
390699123,1cyclictest0-21swapper/508:03:455
390699122,2cyclictest857-21polkitd10:40:535
390699122,2cyclictest857-21polkitd09:35:075
390699122,2cyclictest857-21polkitd09:21:525
390699122,2cyclictest857-21polkitd09:15:475
390699122,2cyclictest709-21systemd-logind09:26:325
390699122,2cyclictest669-21avahi-daemon12:30:165
390699121,4cyclictest859-21gdbus09:45:065
390699121,2cyclictest17447-21sshd12:15:125
390699120,4cyclictest5160-21sshd10:30:135
389899125,3cyclictest15688-21sshd10:27:054
3898991210,1cyclictest709-21systemd-logind10:17:384
3898991210,1cyclictest49-21ksoftirqd/412:38:094
3898991210,1cyclictest49-21ksoftirqd/411:51:474
3898991210,1cyclictest49-21ksoftirqd/409:57:404
3898991210,1cyclictest49-21ksoftirqd/409:37:414
3898991210,1cyclictest49-21ksoftirqd/409:21:244
3889991211,1cyclictest41-21ksoftirqd/310:36:333
3889991210,1cyclictest41-21ksoftirqd/309:49:033
388999120,11cyclictest23851-21grepconf.sh09:22:323
388999120,11cyclictest1-21systemd10:16:243
388199123,6cyclictest30360-21sshd09:39:392
388199121,5cyclictest464-21systemd-journal11:04:592
388199120,2cyclictest5733-21sshd11:29:542
388199120,11cyclictest0-21swapper/212:32:292
386399128,1cyclictest9-21ksoftirqd/012:23:560
386399128,1cyclictest9-21ksoftirqd/011:12:050
3863991211,1cyclictest9-21ksoftirqd/011:20:370
3863991211,1cyclictest9-21ksoftirqd/009:46:450
215892120,0sleep21843-21nfsd09:59:352
90262110,0sleep30-21swapper/310:10:023
90262110,0sleep30-21swapper/310:10:023
73712110,0sleep60-21swapper/612:20:126
392299119,1cyclictest73-21ksoftirqd/712:00:387
392299119,1cyclictest73-21ksoftirqd/709:40:127
392299119,1cyclictest1-21systemd12:28:027
392299114,1cyclictest859-21gdbus11:51:207
392299112,4cyclictest29069-21sshd10:29:487
392299112,3cyclictest0-21swapper/709:56:177
392299111,4cyclictest22469-21sshd12:35:557
392299111,4cyclictest0-21swapper/710:50:577
391499119,1cyclictest709-21systemd-logind09:20:586
391499119,1cyclictest17014-21sshd11:37:576
391499114,4cyclictest721-21dbus-daemon11:31:486
391499113,7cyclictest2983-21bash11:40:496
391499113,7cyclictest14398-21grep10:32:366
391499112,4cyclictest721-21dbus-daemon09:43:356
391499111,4cyclictest23371-21sshd10:42:266
391499111,4cyclictest22563-21sshd09:59:396
391499111,4cyclictest0-21swapper/612:16:436
391499110,5cyclictest5475-21sd-pam10:22:486
391499110,5cyclictest24629-21sshd10:25:426
391499110,11cyclictest21479-21kworker/6:110:52:316
391499110,1cyclictest27425-21systemd09:33:536
391499110,1cyclictest0-21swapper/610:07:376
390699113,2cyclictest752-21snmpd07:34:385
390699112,2cyclictest4314-21cut07:10:085
389899119,1cyclictest49-21ksoftirqd/412:00:134
389899119,1cyclictest49-21ksoftirqd/411:31:434
389899119,1cyclictest49-21ksoftirqd/411:20:094
389899119,1cyclictest49-21ksoftirqd/410:55:124
389899119,1cyclictest49-21ksoftirqd/410:43:574
389899119,1cyclictest49-21ksoftirqd/409:26:154
389899119,1cyclictest1-21systemd10:39:144
388999119,1cyclictest41-21ksoftirqd/310:24:133
388999118,2cyclictest721-21dbus-daemon12:27:533
388999118,2cyclictest4578-21sshd11:05:293
388999118,1cyclictest2833-21sshd10:31:563
388999113,4cyclictest5408-21sshd09:41:513
388999112,5cyclictest721-21dbus-daemon09:26:463
388999111,4cyclictest0-21swapper/310:53:033
388999110,11cyclictest0-21swapper/310:46:433
388999110,10cyclictest721-21dbus-daemon09:31:313
388999110,1cyclictest0-21swapper/309:11:493
388199119,1cyclictest33-21ksoftirqd/212:13:252
388199119,1cyclictest33-21ksoftirqd/212:00:132
388199119,1cyclictest33-21ksoftirqd/210:30:552
388199116,3cyclictest33-21ksoftirqd/211:16:402
388199115,3cyclictest663-21in:imjournal12:05:012
388199114,6cyclictest857-21polkitd10:53:132
388199114,1cyclictest721-21dbus-daemon10:04:032
388199113,1cyclictest0-21swapper/211:00:582
388199112,4cyclictest7449-21sshd10:15:252
388199112,4cyclictest32270-21sshd09:30:202
388199112,4cyclictest21762-21sshd11:23:192
388199112,3cyclictest0-21swapper/211:10:012
388199110,5cyclictest0-21swapper/211:35:102
388199110,1cyclictest28512-21grepconf.sh09:50:352
386399119,1cyclictest9-21ksoftirqd/010:35:290
386399119,1cyclictest9-21ksoftirqd/010:34:560
386399119,1cyclictest9-21ksoftirqd/009:11:480
386399118,3cyclictest9-21ksoftirqd/009:21:590
386399118,2cyclictest17809-21systemd11:43:360
386399117,1cyclictest9-21ksoftirqd/010:20:430
386399113,0cyclictest0-21swapper/007:41:360
386399112,5cyclictest27450-21sshd11:59:040
3863991110,1cyclictest9-21ksoftirqd/011:54:510
386399110,10cyclictest8312-21kworker/0:012:13:480
386399110,10cyclictest18094-21sshd10:51:240
392299108,1cyclictest73-21ksoftirqd/712:21:117
392299108,1cyclictest73-21ksoftirqd/709:51:447
392299108,1cyclictest2431-21bash10:30:067
392299103,6cyclictest13871-21systemd11:20:567
392299101,4cyclictest4545-21sshd10:20:507
392299100,4cyclictest15249-21sshd11:41:327
392299100,4cyclictest0-21swapper/711:30:027
392299100,10cyclictest15075-21kworker/7:511:05:027
392299100,10cyclictest0-21swapper/710:47:467
391499107,2cyclictest65-21ksoftirqd/611:52:546
391499102,7cyclictest669-21avahi-daemon09:25:106
391499102,7cyclictest18022-21grepconf.sh11:26:476
391499102,7cyclictest16413-21sshd10:55:066
391499101,4cyclictest0-21swapper/612:37:556
391499101,4cyclictest0-21swapper/611:57:046
391499100,4cyclictest0-21swapper/610:10:396
391499100,4cyclictest0-21swapper/610:10:396
391499100,4cyclictest0-21swapper/609:35:246
390699103,2cyclictest752-21snmpd08:35:525
390699102,2cyclictest11879-21grep07:20:185
390699102,2cyclictest1-21systemd07:42:065
389899109,1cyclictest49-21ksoftirqd/412:25:114
389899109,1cyclictest0-21swapper/409:45:454
389899108,1cyclictest49-21ksoftirqd/412:15:014
389899108,1cyclictest49-21ksoftirqd/411:46:504
389899108,1cyclictest49-21ksoftirqd/409:13:054
389899102,5cyclictest21338-21sshd09:42:484
389899100,9cyclictest25144-21kworker/4:012:13:054
388999109,1cyclictest41-21ksoftirqd/310:40:203
388999109,1cyclictest41-21ksoftirqd/309:36:293
388999109,1cyclictest0-21swapper/311:29:553
388999108,1cyclictest41-21ksoftirqd/312:37:343
388999108,1cyclictest41-21ksoftirqd/311:21:593
388999107,3cyclictest41-21ksoftirqd/310:27:013
388999104,3cyclictest30705-21bash11:03:203
388999103,4cyclictest857-21polkitd11:12:533
388999103,4cyclictest1-21systemd10:02:073
388999102,4cyclictest32123-21grepconf.sh12:19:513
388999102,4cyclictest17706-21perl12:30:083
388999101,5cyclictest857-21polkitd11:17:293
388999101,5cyclictest1262-21bash12:10:303
388999100,10cyclictest13380-21kworker/3:611:45:523
388199108,2cyclictest33-21ksoftirqd/210:11:472
388199108,2cyclictest33-21ksoftirqd/210:11:472
388199108,1cyclictest33-21ksoftirqd/210:37:092
388199103,7cyclictest0-21swapper/211:30:382
388199103,4cyclictest30778-21sshd10:27:592
388199102,3cyclictest0-21swapper/211:50:092
388199101,8cyclictest14138-21cp09:40:282
388199101,4cyclictest20213-21sshd12:17:152
388199100,5cyclictest15039-21bash09:20:102
388199100,4cyclictest8112-21sshd09:16:002
388199100,10cyclictest25375-21kworker/2:512:26:342
388199100,10cyclictest0-21swapper/210:55:222
386399108,1cyclictest9-21ksoftirqd/011:46:120
386399108,1cyclictest9-21ksoftirqd/011:29:470
386399108,1cyclictest9-21ksoftirqd/009:26:400
386399106,0cyclictest0-21swapper/008:59:440
386399104,4cyclictest709-21systemd-logind10:25:260
386399102,2cyclictest0-21swapper/007:14:120
386399102,0cyclictest0-21swapper/008:00:020
386399101,5cyclictest23707-21grepconf.sh09:41:020
386399100,7cyclictest0-21swapper/010:54:580
39149992,1cyclictest730-21NetworkManager11:14:126
39069993,1cyclictest752-21snmpd09:06:415
39069993,1cyclictest752-21snmpd09:06:415
39069993,1cyclictest752-21snmpd08:20:225
39069992,1cyclictest3774-21cut09:00:135
39069991,4cyclictest0-21swapper/508:27:285
38899997,1cyclictest41-21ksoftirqd/312:02:423
38899997,1cyclictest41-21ksoftirqd/311:55:243
38899997,1cyclictest41-21ksoftirqd/311:50:173
38899997,1cyclictest41-21ksoftirqd/310:55:143
38899993,3cyclictest10578-21sshd09:16:103
38899990,9cyclictest0-21swapper/309:55:573
38899990,0cyclictest0-21swapper/308:30:113
38819997,1cyclictest33-21ksoftirqd/209:45:562
38819993,6cyclictest0-21swapper/211:57:252
38819993,1cyclictest0-21swapper/212:22:442
38819992,4cyclictest26210-21systemd09:11:042
38819992,4cyclictest1-21systemd09:27:032
38819990,4cyclictest14314-21bash11:47:042
38639998,1cyclictest9-21ksoftirqd/010:10:440
38639998,1cyclictest9-21ksoftirqd/010:10:440
38639997,1cyclictest9-21ksoftirqd/009:50:160
38639997,1cyclictest9-21ksoftirqd/009:32:300
38639997,1cyclictest9-21ksoftirqd/009:14:590
38639994,2cyclictest6087-21sshd10:06:030
38639990,3cyclictest0-21swapper/008:52:580
38639990,3cyclictest0-21swapper/008:20:220
38639990,0cyclictest0-21swapper/008:49:340
39149985,2cyclictest12514-21grepconf.sh10:15:426
39069982,1cyclictest758-21runrttasks08:09:395
39069982,1cyclictest758-21runrttasks08:09:395
39069982,1cyclictest752-21snmpd08:31:105
39069982,1cyclictest752-21snmpd07:39:475
39069980,1cyclictest0-21swapper/507:59:035
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional