You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 13:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Sep 02, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3157021040,0sleep00-21swapper/000:14:440
198332840,1sleep1576999cyclictest21:38:351
24822590,0sleep40-21swapper/421:41:104
90232520,0sleep69021-21sshd22:28:306
300132520,1sleep3401ktimersoftd/300:23:363
102502520,2sleep6578899cyclictest23:08:276
536825026,8sleep10-21swapper/119:01:171
265912480,1sleep226590-21sshd23:49:072
194132470,0sleep10-21swapper/122:34:341
87262460,0sleep70-21swapper/722:55:387
83142450,0sleep40-21swapper/423:46:134
294322450,0sleep60-21swapper/623:34:466
294322450,0sleep60-21swapper/623:34:466
242682440,0sleep40-21swapper/421:49:444
155612440,1sleep015533-21sshd23:10:290
73472430,0sleep20-21swapper/221:18:022
37142430,0sleep70-21swapper/700:09:317
285782430,0sleep70-21swapper/721:22:477
283912430,0sleep6631rcuc/622:16:536
160772430,0sleep30-21swapper/300:10:153
303282420,0sleep40-21swapper/400:23:374
273952420,0sleep30-21swapper/322:15:053
240062420,0sleep723986-21sshd23:00:117
83032410,0sleep50-21swapper/500:02:325
538924127,10sleep20-21swapper/219:01:342
280912410,0sleep50-21swapper/521:31:425
218892410,2sleep0576899cyclictest23:52:260
200682410,0sleep50-21swapper/522:02:025
557224028,9sleep30-21swapper/319:04:073
552624028,9sleep40-21swapper/419:03:284
536424028,8sleep60-21swapper/619:01:146
532024029,8sleep50-21swapper/519:00:415
304842400,1sleep730481-21sshd23:45:367
107152400,1sleep410714-21systemd22:25:004
548423928,8sleep00-21swapper/019:02:520
542323927,8sleep70-21swapper/719:02:037
144222390,2sleep6578899cyclictest21:56:186
120152390,0sleep00-21swapper/021:52:360
99712380,0sleep70-21swapper/721:09:107
56122380,0sleep40-21swapper/400:02:234
52652380,0sleep70-21swapper/723:19:017
186922380,0sleep30-21swapper/319:25:203
156912380,0sleep10-21swapper/123:03:171
161882370,0sleep60-21swapper/623:28:376
25342360,0sleep70-21swapper/722:44:337
243192340,1sleep30-21swapper/321:18:593
576999260,9cyclictest12900-21sshd23:26:351
576999240,9cyclictest29237-21systemd00:25:231
576999240,9cyclictest13693-21grepconf.sh22:03:311
576999230,9cyclictest17167-21grep22:28:581
576999230,8cyclictest15215-21kill00:13:471
576999230,7cyclictest22621-21grepconf.sh22:13:011
148952230,0sleep20-21swapper/223:17:442
576999220,9cyclictest29339-21bash23:43:491
576999220,9cyclictest29339-21bash23:43:491
576999220,10cyclictest11327-21grepconf.sh00:18:581
576999210,9cyclictest27881-21timerwakeupswit22:20:251
576999210,7cyclictest32048-21grep22:56:581
576999210,7cyclictest30925-21id23:54:471
576999210,10cyclictest30034-21grepconf.sh21:21:011
578899205,3cyclictest65-21ksoftirqd/623:45:186
576999200,9cyclictest4902-21grep00:02:201
576999200,9cyclictest28221-21sshd21:15:331
576999200,8cyclictest0-21swapper/121:05:581
576999200,7cyclictest721-21dbus-daemon22:48:341
576999200,7cyclictest24050-21systemd00:21:251
576999200,6cyclictest3503-21systemd-cgroups21:26:461
576999200,6cyclictest1-21systemd21:52:191
576999200,10cyclictest12970-21sshd22:05:171
576999200,10cyclictest12552-21grepconf.sh21:47:131
578899195,3cyclictest65-21ksoftirqd/622:50:206
5788991915,3cyclictest65-21ksoftirqd/623:15:266
5788991915,3cyclictest65-21ksoftirqd/622:35:436
5782991915,1cyclictest31639-21systemd21:26:325
576999190,9cyclictest9489-21sshd22:37:371
576999190,9cyclictest22010-21sshd22:40:131
576999190,9cyclictest11211-21sshd00:08:061
576999190,7cyclictest2300-21grepconf.sh21:43:031
576999190,7cyclictest21909-21grepconf.sh21:31:211
576999190,7cyclictest10551-21grepconf.sh23:55:221
576999190,6cyclictest0-21swapper/122:54:511
576999190,10cyclictest4654-21bash22:19:131
576999190,10cyclictest17127-21grepconf.sh23:12:261
275982190,0sleep227596-21systemd-cgroups00:34:252
5788991815,2cyclictest65-21ksoftirqd/623:55:066
5788991814,4cyclictest65-21ksoftirqd/622:12:346
578299180,4cyclictest0-21swapper/521:45:445
576999182,15cyclictest721-21dbus-daemon21:55:451
576999180,9cyclictest20506-21bash23:46:561
576999180,9cyclictest0-21swapper/123:15:361
576999180,8cyclictest859-21gdbus21:10:151
576999180,8cyclictest2136-21grepconf.sh23:07:571
576999180,7cyclictest6396-21grep23:20:471
576999180,7cyclictest27252-21bash00:30:401
576999180,10cyclictest23989-21bash23:36:101
95012170,2sleep4577999cyclictest23:30:034
95012170,2sleep4577999cyclictest23:30:034
5795991712,1cyclictest73-21ksoftirqd/721:56:127
578899177,1cyclictest65-21ksoftirqd/623:40:416
578899177,1cyclictest65-21ksoftirqd/623:40:416
578899173,2cyclictest65-21ksoftirqd/622:32:386
5788991715,2cyclictest65-21ksoftirqd/623:03:426
5788991715,1cyclictest65-21ksoftirqd/621:35:026
5788991714,1cyclictest65-21ksoftirqd/600:14:286
5788991713,1cyclictest65-21ksoftirqd/623:10:246
5788991713,1cyclictest65-21ksoftirqd/621:49:456
578899171,3cyclictest65-21ksoftirqd/622:07:436
578299175,7cyclictest15706-21sshd23:35:425
578299170,1cyclictest0-21swapper/523:22:105
576999170,6cyclictest0-21swapper/123:30:521
576999170,6cyclictest0-21swapper/123:30:521
5768991711,3cyclictest9-21ksoftirqd/000:22:590
58702160,1sleep55871-21grep22:12:035
5795991612,3cyclictest73-21ksoftirqd/723:13:027
578899164,3cyclictest65-21ksoftirqd/622:41:366
578899162,3cyclictest65-21ksoftirqd/600:30:176
5788991615,1cyclictest65-21ksoftirqd/622:55:166
5788991615,1cyclictest65-21ksoftirqd/600:17:466
5788991615,1cyclictest65-21ksoftirqd/600:07:596
5788991614,1cyclictest65-21ksoftirqd/623:54:436
5788991614,1cyclictest65-21ksoftirqd/621:54:046
5788991614,1cyclictest65-21ksoftirqd/621:21:446
5788991614,1cyclictest65-21ksoftirqd/621:19:446
5788991614,1cyclictest65-21ksoftirqd/621:06:266
5788991613,1cyclictest65-21ksoftirqd/621:42:136
5788991612,3cyclictest65-21ksoftirqd/623:21:256
5788991611,5cyclictest65-21ksoftirqd/600:20:146
5788991611,4cyclictest65-21ksoftirqd/600:00:316
578899161,1cyclictest65-21ksoftirqd/622:20:356
578899160,15cyclictest23281-21kworker/6:521:29:526
578899160,1cyclictest131rcu_sched23:35:186
5768991612,1cyclictest9-21ksoftirqd/023:48:340
5768991611,4cyclictest23040-21systemd22:21:590
49412160,0sleep60-21swapper/621:12:296
228062160,0sleep00-21swapper/000:01:310
176782160,0sleep70-21swapper/700:13:557
103812160,0sleep30-21swapper/322:24:593
5795991512,2cyclictest28655-21sshd22:38:467
5788991514,1cyclictest65-21ksoftirqd/621:35:316
5788991513,1cyclictest65-21ksoftirqd/622:45:246
5788991513,1cyclictest65-21ksoftirqd/622:00:246
5779991513,1cyclictest0-21swapper/421:37:274
5770991514,1cyclictest13550irq/24-ahci[00021:09:432
5642150,1sleep0562-21bash22:29:520
300002150,1sleep773-21ksoftirqd/700:25:257
126692150,0sleep30-21swapper/323:26:343
126332150,0sleep00-21swapper/021:40:020
579599149,3cyclictest73-21ksoftirqd/722:53:157
5788991412,1cyclictest65-21ksoftirqd/600:25:206
5782991410,3cyclictest57-21ksoftirqd/500:15:305
577999145,5cyclictest857-21polkitd23:10:014
5770991412,1cyclictest33-21ksoftirqd/222:16:092
5768991412,1cyclictest9-21ksoftirqd/000:08:190
224182140,0sleep50-21swapper/522:38:225
206922140,0sleep40-21swapper/421:31:174
579599136,3cyclictest857-21polkitd21:14:107
5795991311,1cyclictest73-21ksoftirqd/721:45:567
5795991311,1cyclictest73-21ksoftirqd/700:17:137
5795991310,1cyclictest73-21ksoftirqd/721:26:467
5782991311,1cyclictest57-21ksoftirqd/521:20:345
577999132,5cyclictest1-21systemd23:15:264
577999130,12cyclictest3909-21sshd21:21:234
577999130,12cyclictest0-21swapper/422:25:354
577999130,1cyclictest1-21systemd00:34:534
5772991310,2cyclictest709-21systemd-logind00:19:353
5768991311,1cyclictest9-21ksoftirqd/023:56:250
5768991311,1cyclictest9-21ksoftirqd/023:18:480
5768991311,1cyclictest23889-21sshd22:05:490
576899130,12cyclictest15104-21kworker/0:421:25:450
318932130,0sleep20-21swapper/223:53:002
291772130,0sleep30-21swapper/319:45:143
137682130,2sleep5578299cyclictest21:38:155
113322130,0sleep20-21swapper/222:08:482
579599124,5cyclictest17360-21bash23:55:447
579599123,5cyclictest5197-21bash23:22:347
5795991210,1cyclictest7954-21sshd23:26:187
5795991210,1cyclictest73-21ksoftirqd/723:44:047
5795991210,1cyclictest73-21ksoftirqd/723:44:047
5795991210,1cyclictest21323-21kworker/7:322:18:107
5788991210,2cyclictest65-21ksoftirqd/621:05:036
578299128,2cyclictest57-21ksoftirqd/523:40:145
578299128,2cyclictest57-21ksoftirqd/523:40:145
578299124,5cyclictest721-21dbus-daemon22:18:195
578299122,5cyclictest730-21NetworkManager21:06:485
578299122,4cyclictest16776-21sshd22:50:385
578299122,4cyclictest14204-21grepconf.sh23:33:545
578299122,4cyclictest14204-21grepconf.sh23:33:545
578299122,4cyclictest12892-21sshd23:57:195
5782991211,1cyclictest23069-21sshd21:40:305
5782991210,1cyclictest57-21ksoftirqd/523:46:105
578299121,5cyclictest28847-21sshd22:24:115
578299120,4cyclictest0-21swapper/523:27:005
577999125,6cyclictest0-21swapper/422:14:394
577999124,5cyclictest14830-21sshd23:39:254
577999122,4cyclictest5977-21bash22:01:144
577999122,4cyclictest28959-21sshd22:51:204
577999122,4cyclictest1-21systemd23:40:584
577999122,4cyclictest1-21systemd23:40:584
577999122,4cyclictest0-21swapper/423:22:174
5779991211,1cyclictest49-21ksoftirqd/423:58:184
5779991210,1cyclictest0-21swapper/421:27:324
577299129,2cyclictest14415-21sshd22:34:173
577299122,4cyclictest29480-21sshd21:31:473
577299122,4cyclictest2499-21systemd23:47:453
577299122,4cyclictest0-21swapper/323:31:443
577299122,4cyclictest0-21swapper/323:31:443
577299120,11cyclictest17193-21kworker/3:522:59:473
577099129,2cyclictest33-21ksoftirqd/223:38:232
577099129,2cyclictest33-21ksoftirqd/221:42:402
577099129,2cyclictest17269-21bash00:17:292
577099123,4cyclictest10689-21sshd21:36:122
577099122,4cyclictest17258-21systemd22:14:332
577099120,11cyclictest27628-21kworker/2:322:45:572
576899125,4cyclictest1-21systemd22:56:470
576899123,7cyclictest9449-21sshd21:30:390
5768991210,1cyclictest9-21ksoftirqd/023:43:240
5768991210,1cyclictest9-21ksoftirqd/023:43:240
5768991210,1cyclictest9-21ksoftirqd/023:38:240
5768991210,1cyclictest9-21ksoftirqd/021:56:290
5768991210,1cyclictest9-21ksoftirqd/021:46:330
5768991210,1cyclictest9-21ksoftirqd/021:41:420
5768991210,1cyclictest9-21ksoftirqd/000:19:340
576899120,11cyclictest464-21systemd-journal22:13:070
576899120,11cyclictest0-21swapper/023:26:350
576899120,11cyclictest0-21swapper/021:24:250
311392120,0sleep20-21swapper/223:42:032
311392120,0sleep20-21swapper/223:42:032
579599119,1cyclictest73-21ksoftirqd/723:50:247
579599110,10cyclictest649-21grep22:02:467
578299119,1cyclictest57-21ksoftirqd/523:50:375
578299119,1cyclictest57-21ksoftirqd/500:29:055
578299114,4cyclictest721-21dbus-daemon21:13:235
578299112,4cyclictest0-21swapper/523:02:085
5782991110,1cyclictest57-21ksoftirqd/500:34:545
578299111,4cyclictest4676-21grep21:54:025
578299110,5cyclictest6094-21systemd21:19:485
578299110,5cyclictest15158-21bash22:05:215
578299110,10cyclictest6567-21users23:15:245
578299110,10cyclictest10588-21kworker/5:723:10:145
577999119,1cyclictest49-21ksoftirqd/423:13:234
577999112,4cyclictest0-21swapper/423:51:474
577999111,4cyclictest22329-21sshd22:47:244
577999110,5cyclictest13503-21systemd22:35:574
577999110,11cyclictest22667-21kworker/4:000:29:244
577999110,1cyclictest721-21dbus-daemon22:55:214
577299119,1cyclictest41-21ksoftirqd/323:54:443
577299119,1cyclictest19379-21sshd23:07:053
577299113,7cyclictest721-21dbus-daemon22:06:273
577299113,7cyclictest16188-21sshd21:07:273
577299112,4cyclictest736-21gdbus21:48:303
577299112,4cyclictest709-21systemd-logind21:25:363
577299112,4cyclictest28740-21sshd23:18:303
577299112,4cyclictest25163-21grepconf.sh21:51:303
577299112,4cyclictest23954-21sshd22:14:553
577299112,4cyclictest21734-21sshd22:43:473
577299112,4cyclictest20054-21sshd23:21:343
577299112,4cyclictest10633-21sshd23:35:243
5772991110,1cyclictest41-21ksoftirqd/323:12:253
5772991110,1cyclictest23264-21grepconf.sh23:41:363
5772991110,1cyclictest23264-21grepconf.sh23:41:363
5772991110,1cyclictest0-21swapper/323:59:153
5772991110,1cyclictest0-21swapper/322:00:403
577299111,4cyclictest721-21dbus-daemon22:49:193
577299111,4cyclictest663-21in:imjournal00:07:483
577299111,4cyclictest27265-21systemd-cgroups21:57:023
577299111,4cyclictest0-21swapper/323:03:343
577299111,4cyclictest0-21swapper/321:36:553
577299110,5cyclictest998-21grepconf.sh21:42:593
577299110,10cyclictest24351-21bash21:22:333
577099119,1cyclictest33-21ksoftirqd/223:59:412
577099112,4cyclictest14010-21systemd-cgroups22:37:522
5770991110,1cyclictest33-21ksoftirqd/222:51:562
577099111,4cyclictest24599-21sshd21:31:302
577099111,4cyclictest11498-21sshd21:21:492
577099110,5cyclictest14260-21sshd23:23:052
577099110,11cyclictest721-21dbus-daemon22:41:472
577099110,11cyclictest31851-21kworker/2:023:33:352
577099110,11cyclictest31851-21kworker/2:023:33:352
577099110,11cyclictest22804-21kworker/2:100:25:302
576999111,9cyclictest752-21snmpd20:32:301
576999110,4cyclictest0-21swapper/120:45:171
576899119,1cyclictest9-21ksoftirqd/023:04:490
576899119,1cyclictest9-21ksoftirqd/022:43:070
576899119,1cyclictest9-21ksoftirqd/000:34:050
576899117,1cyclictest9-21ksoftirqd/022:15:480
576899117,1cyclictest9-21ksoftirqd/021:12:030
5768991110,1cyclictest9-21ksoftirqd/022:33:500
576899110,6cyclictest0-21swapper/000:25:040
576899110,10cyclictest0-21swapper/022:50:010
24692110,0sleep02460-21sshd22:37:130
181352110,0sleep20-21swapper/200:12:062
176132110,0sleep30-21swapper/322:27:073
140242110,0sleep50-21swapper/500:20:505
579599108,1cyclictest73-21ksoftirqd/722:20:157
579599108,1cyclictest73-21ksoftirqd/700:31:237
579599108,1cyclictest73-21ksoftirqd/700:03:177
579599106,1cyclictest24023-21systemd-cgroups21:42:257
579599105,2cyclictest16722-21sshd21:36:337
579599104,2cyclictest17227-21bash22:45:197
579599103,4cyclictest18446-21sshd23:30:277
579599103,4cyclictest18446-21sshd23:30:277
579599103,3cyclictest721-21dbus-daemon00:23:117
579599103,3cyclictest3258-21bash22:31:447
579599102,5cyclictest721-21dbus-daemon23:06:127
579599101,5cyclictest464-21systemd-journal21:19:157
579599100,9cyclictest9985-21kworker/7:321:50:087
579599100,10cyclictest0-21swapper/722:25:087
579599100,10cyclictest0-21swapper/722:06:417
578899108,1cyclictest17527-21cat20:20:196
578299109,1cyclictest57-21ksoftirqd/500:05:495
578299108,1cyclictest57-21ksoftirqd/522:58:035
578299108,1cyclictest57-21ksoftirqd/522:45:165
578299108,1cyclictest57-21ksoftirqd/500:13:095
578299103,6cyclictest2160-21sshd23:09:515
578299100,4cyclictest0-21swapper/522:33:565
578299100,10cyclictest0-21swapper/522:28:545
577999109,1cyclictest49-21ksoftirqd/422:40:164
577999108,1cyclictest49-21ksoftirqd/422:30:154
577999103,6cyclictest28876-21sshd23:27:304
577999103,6cyclictest23936-21sshd22:07:394
577999103,6cyclictest11926-21sshd21:56:094
577999103,6cyclictest0-21swapper/400:19:544
577999103,1cyclictest709-21systemd-logind23:01:154
577999103,1cyclictest709-21systemd-logind22:19:394
577999102,4cyclictest3526-21sshd00:11:164
577999100,4cyclictest0-21swapper/421:19:594
577999100,4cyclictest0-21swapper/421:08:144
577299108,1cyclictest41-21ksoftirqd/300:32:583
577299108,1cyclictest41-21ksoftirqd/300:00:213
577299103,3cyclictest709-21systemd-logind21:13:163
577299100,4cyclictest0-21swapper/322:36:323
577099108,1cyclictest33-21ksoftirqd/222:24:162
577099108,1cyclictest33-21ksoftirqd/200:05:172
577099108,1cyclictest0-21swapper/222:01:072
577099105,2cyclictest5085-21sshd22:57:172
577099103,6cyclictest1843-21nfsd21:57:252
577099100,5cyclictest28784-21sshd21:53:332
577099100,4cyclictest24781-21sshd23:03:482
577099100,4cyclictest0-21swapper/222:30:162
577099100,4cyclictest0-21swapper/221:28:082
577099100,10cyclictest8354-21kworker/2:522:27:062
577099100,10cyclictest18935-21kworker/2:200:20:212
577099100,10cyclictest16682-21kworker/2:021:12:442
577099100,10cyclictest0-21swapper/223:07:102
576999100,5cyclictest0-21swapper/119:51:051
576999100,10cyclictest0-21swapper/120:50:381
576899109,1cyclictest9-21ksoftirqd/021:15:400
576899108,1cyclictest9-21ksoftirqd/023:31:460
576899108,1cyclictest9-21ksoftirqd/023:31:460
576899108,1cyclictest9-21ksoftirqd/022:51:060
576899108,1cyclictest9-21ksoftirqd/021:05:370
576899108,1cyclictest0-21swapper/022:00:500
576899100,4cyclictest5415-21sshd23:20:440
576899100,10cyclictest7104-21kworker/0:023:06:040
57959993,3cyclictest31391-21sshd21:31:537
57959992,4cyclictest1554-21systemd22:10:047
57959990,8cyclictest19100-21kworker/7:123:35:087
57829997,1cyclictest57-21ksoftirqd/521:55:185
57829993,2cyclictest30567-21sshd22:40:355
57829990,9cyclictest0-21swapper/520:25:185
57799997,1cyclictest49-21ksoftirqd/400:05:194
57799993,3cyclictest18629-21sshd21:51:084
57799993,2cyclictest1785-21kill21:10:254
57729993,1cyclictest1843-21nfsd22:52:213
57729990,4cyclictest25709-21grepconf.sh00:25:153
57709998,1cyclictest33-21ksoftirqd/221:45:332
57709993,6cyclictest8416-21sshd23:11:562
57709993,4cyclictest0-21swapper/200:01:352
57709992,6cyclictest0-21swapper/223:25:142
57699993,5cyclictest752-21snmpd20:41:241
57699993,5cyclictest14666-21cat20:15:181
57699993,5cyclictest10813-21timerandwakeup19:10:241
57699990,9cyclictest0-21swapper/121:04:161
57699990,9cyclictest0-21swapper/120:20:051
57699990,9cyclictest0-21swapper/119:39:141
57699990,9cyclictest0-21swapper/119:28:511
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional