You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 08:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon Jul 06, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24908991060,105cyclictest5514-21kworker/0:100:14:140
24941999870,28cyclictest49-21ksoftirqd/400:14:154
24941998128,52cyclictest709-21systemd-logind21:47:134
2492399770,76cyclictest29419-21kworker/u16:100:14:152
24957997427,0cyclictest0-21swapper/600:14:156
75052730,2sleep02490899cyclictest00:19:200
159042700,0sleep00-21swapper/023:00:390
24941996936,1cyclictest17259-21latency_hist21:47:124
24957996750,17cyclictest0-21swapper/621:47:136
38972630,0sleep00-21swapper/022:50:140
2492399590,58cyclictest29425-21kworker/u16:321:47:132
96282510,2sleep22492399cyclictest22:46:402
207962510,0sleep50-21swapper/521:22:175
2491699500,49cyclictest29419-21kworker/u16:100:14:151
307152490,0sleep30-21swapper/322:37:443
2452624926,8sleep60-21swapper/619:03:506
2450424925,9sleep20-21swapper/219:03:302
107552490,1sleep61844-21nfsd22:17:286
24957994815,0cyclictest0-21swapper/621:47:126
123512480,0sleep10-21swapper/100:19:371
96442470,1sleep7721-21dbus-daemon22:21:147
2465024624,9sleep50-21swapper/519:05:335
19552460,0sleep10-21swapper/123:20:591
180582460,0sleep50-21swapper/522:17:515
28712450,0sleep20-21swapper/222:07:152
197522450,0sleep70-21swapper/700:14:157
196542450,0sleep60-21swapper/623:50:516
24934994423,1cyclictest0-21swapper/321:47:133
82792430,1sleep58281-21systemd-cgroups21:07:515
315802430,0sleep40-21swapper/422:47:544
262142430,0sleep70-21swapper/721:43:417
58772420,1sleep75874-21bash23:21:137
2445724222,8sleep30-21swapper/319:02:593
227772410,0sleep60-21swapper/621:55:186
209582410,0sleep60-21swapper/622:04:316
10742410,0sleep20-21swapper/221:17:252
2470324027,9sleep40-21swapper/419:06:204
202762400,0sleep20-21swapper/222:02:352
184722400,0sleep20-21swapper/223:17:552
156842400,1sleep715677-21sshd23:12:087
135452400,0sleep30-21swapper/321:14:223
2493499390,38cyclictest29419-21kworker/u16:100:14:153
2465223928,8sleep70-21swapper/719:05:357
2453823927,9sleep00-21swapper/019:04:000
2451223928,8sleep10-21swapper/119:03:371
206142390,1sleep520601-21bash22:37:145
280062380,0sleep70-21swapper/722:08:407
24908993837,1cyclictest20759-21kworker/0:521:47:140
313502370,2sleep62495799cyclictest23:30:176
24923993534,0cyclictest13550irq/24-ahci[00021:47:122
283902330,0sleep70-21swapper/721:40:057
24949993217,1cyclictest17763-21sshd21:47:135
24908993131,0cyclictest20759-21kworker/0:521:47:120
38462280,0sleep20-21swapper/223:36:292
38462280,0sleep20-21swapper/223:36:292
2494999280,17cyclictest17764-21sshd21:47:125
24941992611,2cyclictest49-21ksoftirqd/423:28:224
51832240,20sleep685150irq/25-em1-rx-023:09:346
2494199248,3cyclictest49-21ksoftirqd/421:24:004
2494199234,3cyclictest49-21ksoftirqd/423:13:154
2494199229,1cyclictest49-21ksoftirqd/423:08:044
2494199228,2cyclictest49-21ksoftirqd/421:14:394
2494199228,1cyclictest49-21ksoftirqd/422:42:254
2494199226,3cyclictest49-21ksoftirqd/423:01:544
2494199224,2cyclictest49-21ksoftirqd/421:17:554
24916992214,1cyclictest19920-21kworker/1:421:47:131
2495799211,3cyclictest65-21ksoftirqd/621:15:486
24949992111,1cyclictest0-21swapper/500:14:165
2494199214,3cyclictest49-21ksoftirqd/423:23:464
2494199214,3cyclictest49-21ksoftirqd/400:33:574
2494199214,1cyclictest49-21ksoftirqd/423:50:524
2494199214,1cyclictest49-21ksoftirqd/422:13:564
24941992113,3cyclictest49-21ksoftirqd/423:19:134
2491699210,20cyclictest10992-21kworker/u16:221:47:121
2496599200,19cyclictest0-21swapper/721:47:137
2495799205,4cyclictest65-21ksoftirqd/623:17:576
2495799204,3cyclictest65-21ksoftirqd/621:37:536
2494199208,2cyclictest49-21ksoftirqd/422:05:554
2494199207,1cyclictest49-21ksoftirqd/421:30:394
2494199207,1cyclictest49-21ksoftirqd/400:23:464
2494199206,3cyclictest49-21ksoftirqd/421:35:444
2494199205,4cyclictest49-21ksoftirqd/422:17:364
2494199204,4cyclictest49-21ksoftirqd/422:25:274
2494199204,1cyclictest49-21ksoftirqd/422:41:364
2494199203,3cyclictest49-21ksoftirqd/400:18:334
24941992013,4cyclictest49-21ksoftirqd/421:11:574
24941992013,3cyclictest49-21ksoftirqd/423:58:014
24941992010,2cyclictest49-21ksoftirqd/423:33:244
24941992010,2cyclictest49-21ksoftirqd/423:33:244
2495799198,1cyclictest65-21ksoftirqd/622:50:046
2495799196,1cyclictest65-21ksoftirqd/621:29:446
2495799195,3cyclictest65-21ksoftirqd/622:29:596
2495799195,3cyclictest65-21ksoftirqd/622:29:596
24957991915,1cyclictest65-21ksoftirqd/600:03:136
2494199198,2cyclictest49-21ksoftirqd/422:08:124
2494199196,2cyclictest49-21ksoftirqd/421:54:064
2494199194,1cyclictest49-21ksoftirqd/400:30:474
24941991916,3cyclictest49-21ksoftirqd/423:05:444
24941991916,3cyclictest49-21ksoftirqd/400:10:354
24941991915,4cyclictest49-21ksoftirqd/423:44:124
24941991914,3cyclictest49-21ksoftirqd/422:00:584
24941991910,1cyclictest49-21ksoftirqd/423:37:344
2494199191,3cyclictest49-21ksoftirqd/422:33:304
2495799186,3cyclictest65-21ksoftirqd/623:59:446
2495799183,2cyclictest65-21ksoftirqd/621:34:416
24957991814,3cyclictest65-21ksoftirqd/621:59:386
24957991811,5cyclictest65-21ksoftirqd/622:10:126
2494199187,2cyclictest49-21ksoftirqd/421:37:274
2494199186,4cyclictest49-21ksoftirqd/400:04:274
2494199186,3cyclictest49-21ksoftirqd/422:29:454
2494199186,3cyclictest49-21ksoftirqd/422:29:454
2494199182,3cyclictest49-21ksoftirqd/422:52:354
24941991816,1cyclictest49-21ksoftirqd/423:55:354
24934991816,1cyclictest10992-21kworker/u16:221:47:123
101192180,0sleep50-21swapper/522:52:275
2495799175,1cyclictest65-21ksoftirqd/623:03:286
2495799175,1cyclictest65-21ksoftirqd/622:57:186
2495799174,1cyclictest65-21ksoftirqd/622:33:196
2495799172,3cyclictest65-21ksoftirqd/621:22:256
24957991715,1cyclictest65-21ksoftirqd/600:27:326
24957991713,1cyclictest65-21ksoftirqd/622:56:276
24957991713,1cyclictest65-21ksoftirqd/600:09:536
24957991712,3cyclictest464-21systemd-journal00:35:466
24957991712,1cyclictest721-21dbus-daemon23:12:466
2495799171,3cyclictest65-21ksoftirqd/622:45:226
24908991715,1cyclictest9-21ksoftirqd/000:29:280
2495799166,2cyclictest65-21ksoftirqd/622:37:386
2495799165,1cyclictest65-21ksoftirqd/623:40:066
2495799164,1cyclictest65-21ksoftirqd/600:24:516
2495799163,1cyclictest65-21ksoftirqd/623:34:476
2495799163,1cyclictest65-21ksoftirqd/623:34:476
24957991614,1cyclictest65-21ksoftirqd/622:24:316
24957991614,1cyclictest65-21ksoftirqd/622:14:496
24957991614,1cyclictest65-21ksoftirqd/621:21:246
24957991614,1cyclictest65-21ksoftirqd/621:09:466
24957991614,1cyclictest65-21ksoftirqd/600:20:046
24957991610,3cyclictest65-21ksoftirqd/623:24:096
2495799160,1cyclictest0-21swapper/623:44:196
2491699160,15cyclictest0-21swapper/100:36:451
22682160,6sleep00-21swapper/023:18:580
198452160,1sleep319842-21systemd21:32:003
90542150,1sleep02490899cyclictest21:56:240
2496599159,3cyclictest73-21ksoftirqd/700:05:017
24965991513,1cyclictest73-21ksoftirqd/723:04:117
24957991512,2cyclictest65-21ksoftirqd/623:53:516
2494999152,4cyclictest26521-21kill21:17:035
2490899150,14cyclictest21697-21kill22:41:240
188172150,1sleep018814-21sshd21:41:260
81032140,0sleep1231rcuc/121:12:121
70602140,0sleep30-21swapper/323:00:023
24965991412,1cyclictest73-21ksoftirqd/723:59:527
24965991412,1cyclictest73-21ksoftirqd/723:17:007
24965991412,1cyclictest73-21ksoftirqd/722:48:207
24965991411,1cyclictest73-21ksoftirqd/722:59:197
24965991410,1cyclictest73-21ksoftirqd/723:29:197
2494999140,6cyclictest0-21swapper/523:26:145
24916991412,2cyclictest25-21ksoftirqd/123:56:451
24908991412,1cyclictest9-21ksoftirqd/023:34:130
24908991412,1cyclictest9-21ksoftirqd/023:34:130
24908991412,1cyclictest9-21ksoftirqd/023:24:560
24908991412,1cyclictest9-21ksoftirqd/022:35:560
24908991412,1cyclictest9-21ksoftirqd/022:04:030
24908991412,1cyclictest9-21ksoftirqd/000:00:440
125142140,0sleep20-21swapper/221:52:412
119692140,1sleep2311rcuc/221:35:192
116462140,0sleep50-21swapper/522:03:585
292192130,0sleep7721ktimersoftd/700:24:327
266282130,0sleep50-21swapper/522:59:165
24949991311,1cyclictest57-21ksoftirqd/523:39:195
24949991310,2cyclictest23932-21kill22:43:275
2493499136,4cyclictest709-21systemd-logind23:19:363
24934991311,1cyclictest41-21ksoftirqd/322:00:113
2493499130,12cyclictest23387-21bash23:06:533
2492399135,4cyclictest2139-21kill21:23:022
24916991312,1cyclictest0-21swapper/122:52:371
24908991310,3cyclictest9-21ksoftirqd/021:29:210
24908991310,1cyclictest9-21ksoftirqd/022:55:320
2490899130,12cyclictest5514-21kworker/0:100:11:330
172022130,0sleep10-21swapper/122:58:401
170652130,0sleep217063-21sshd22:37:022
250502120,0sleep30-21swapper/322:51:293
2496599126,4cyclictest16495-21grep23:33:117
2496599126,4cyclictest16495-21grep23:33:117
24965991211,1cyclictest0-21swapper/722:13:107
24965991210,1cyclictest73-21ksoftirqd/723:49:597
24965991210,1cyclictest73-21ksoftirqd/722:31:287
24965991210,1cyclictest73-21ksoftirqd/722:31:287
24965991210,1cyclictest73-21ksoftirqd/721:15:407
24965991210,1cyclictest1-21systemd23:25:297
2496599121,10cyclictest30877-21systemd-cgroups21:09:257
2496599120,12cyclictest21024-21kworker/7:422:53:227
2496599120,11cyclictest10498-21sshd22:00:127
2496599120,11cyclictest0-21swapper/721:22:507
2494999129,2cyclictest8653-21systemd23:54:015
2494999129,2cyclictest4004-21systemd00:32:485
2494999120,12cyclictest20270-21kworker/5:222:08:465
2494999120,11cyclictest15394-21kworker/5:222:47:565
2494999120,1cyclictest0-21swapper/523:33:225
2494999120,1cyclictest0-21swapper/523:33:225
2493499129,1cyclictest41-21ksoftirqd/321:09:343
24934991210,2cyclictest41-21ksoftirqd/322:10:393
24934991210,1cyclictest41-21ksoftirqd/322:20:153
24934991210,1cyclictest41-21ksoftirqd/321:56:093
24934991210,1cyclictest41-21ksoftirqd/300:19:193
24934991210,1cyclictest41-21ksoftirqd/300:09:503
2493499120,11cyclictest464-21systemd-journal00:32:293
2492399129,2cyclictest33-21ksoftirqd/223:10:592
2492399129,2cyclictest33-21ksoftirqd/200:19:432
24923991211,1cyclictest33-21ksoftirqd/200:29:132
24923991210,0cyclictest13550irq/24-ahci[00000:23:002
2492399120,2cyclictest20456-21bash00:33:472
2492399120,11cyclictest721-21dbus-daemon00:00:032
2492399120,11cyclictest6263-21kworker/2:122:47:402
2491699122,4cyclictest3486-21sshd23:13:161
2491699122,4cyclictest29977-21sendmail_mailst21:32:311
2491699122,4cyclictest12978-21systemd-cgroups23:42:481
24916991211,1cyclictest25-21ksoftirqd/122:30:491
24916991211,1cyclictest25-21ksoftirqd/122:30:491
24916991210,2cyclictest32482-21sshd21:38:231
2491699121,5cyclictest1-21systemd22:43:141
2491699120,11cyclictest25532-21kworker/1:100:08:181
2491699120,11cyclictest1-21systemd22:19:191
2490899129,1cyclictest9-21ksoftirqd/023:44:100
2490899129,1cyclictest9-21ksoftirqd/023:30:570
2490899129,1cyclictest9-21ksoftirqd/021:58:030
2490899128,1cyclictest9-21ksoftirqd/000:05:550
24908991211,1cyclictest9-21ksoftirqd/023:05:370
24908991211,1cyclictest9-21ksoftirqd/021:23:280
24908991211,1cyclictest0-21swapper/022:44:320
24908991210,1cyclictest9-21ksoftirqd/023:41:200
24908991210,1cyclictest9-21ksoftirqd/022:25:330
24908991210,1cyclictest9-21ksoftirqd/022:13:580
24908991210,1cyclictest9-21ksoftirqd/021:32:290
24908991210,1cyclictest9-21ksoftirqd/000:34:090
168592120,0sleep50-21swapper/522:23:285
133202120,0sleep50-21swapper/522:34:495
325842110,1sleep233-21ksoftirqd/221:09:322
2496599119,1cyclictest73-21ksoftirqd/721:33:227
2496599113,5cyclictest16449-21sshd23:43:017
2496599113,4cyclictest464-21systemd-journal23:38:557
2496599113,4cyclictest25494-21sshd23:53:017
2496599113,4cyclictest0-21swapper/721:56:187
2494999119,1cyclictest57-21ksoftirqd/523:13:305
2494999119,1cyclictest57-21ksoftirqd/521:27:215
2494999119,1cyclictest57-21ksoftirqd/500:23:005
2494999118,2cyclictest3069-21grepconf.sh23:46:065
2494999118,1cyclictest57-21ksoftirqd/523:21:045
2494999117,1cyclictest57-21ksoftirqd/521:57:475
2494999114,4cyclictest14759-21systemd-cgroups23:29:185
2494999113,5cyclictest11590-21sshd22:28:585
2494999113,5cyclictest11590-21sshd22:28:585
2494999113,1cyclictest0-21swapper/521:32:175
2494999111,4cyclictest13138-21sshd00:31:255
2494199119,1cyclictest49-21ksoftirqd/420:22:264
2494199119,1cyclictest49-21ksoftirqd/419:47:124
24941991110,1cyclictest49-21ksoftirqd/420:02:124
24941991110,1cyclictest24179-21kworker/4:020:39:364
2493499119,1cyclictest32595-21kworker/3:023:50:163
2493499118,1cyclictest41-21ksoftirqd/321:18:333
24934991110,1cyclictest41-21ksoftirqd/323:08:063
2493499110,10cyclictest23608-21sshd23:39:403
2493499110,1cyclictest0-21swapper/323:32:163
2493499110,1cyclictest0-21swapper/323:32:163
2493499110,1cyclictest0-21swapper/323:23:163
2492399119,2cyclictest13550irq/24-ahci[00021:30:582
2492399119,1cyclictest33-21ksoftirqd/221:15:082
2492399119,1cyclictest0-21swapper/222:12:322
2492399118,2cyclictest33-21ksoftirqd/223:55:312
2492399110,4cyclictest17551-21bash00:02:282
2491699119,1cyclictest0-21swapper/123:22:581
2491699112,4cyclictest3608-21systemd23:05:421
2491699112,4cyclictest32052-21sshd00:26:431
2491699112,4cyclictest0-21swapper/122:10:281
2491699112,4cyclictest0-21swapper/121:25:171
24916991110,1cyclictest25-21ksoftirqd/122:32:231
2491699111,5cyclictest7951-21systemd00:03:501
2491699111,4cyclictest24180-21sshd22:01:001
2491699111,4cyclictest18757-21sshd22:47:151
2491699111,4cyclictest17682-21sshd21:31:521
2491699111,4cyclictest1-21systemd22:05:231
2491699111,4cyclictest0-21swapper/100:29:021
2491699110,5cyclictest6919-21id23:32:351
2491699110,5cyclictest6919-21id23:32:351
2491699110,5cyclictest27968-21cp22:12:361
2491699110,5cyclictest17255-21sd-pam23:31:231
2491699110,4cyclictest0-21swapper/122:23:001
2491699110,11cyclictest29178-21kworker/1:221:20:271
2491699110,10cyclictest29305-21sshd22:41:511
2491699110,10cyclictest0-21swapper/123:41:551
2490899119,1cyclictest9-21ksoftirqd/022:20:130
2490899119,1cyclictest9-21ksoftirqd/021:09:480
2490899119,1cyclictest9-21ksoftirqd/000:22:300
2490899119,1cyclictest1-21systemd22:08:480
2490899118,2cyclictest9-21ksoftirqd/021:12:500
2490899113,4cyclictest16686-21perf23:12:110
2490899110,1cyclictest17624-21grepconf.sh22:29:190
2490899110,1cyclictest17624-21grepconf.sh22:29:190
176572110,0sleep717654-21systemd-cgroups21:29:567
152262110,0sleep20-21swapper/222:56:412
2496599108,1cyclictest73-21ksoftirqd/722:42:437
2496599108,1cyclictest73-21ksoftirqd/722:32:297
2496599108,1cyclictest73-21ksoftirqd/722:04:207
2496599102,5cyclictest16449-21sd-pam21:18:157
2496599102,4cyclictest29648-21irqstats00:32:277
2496599102,4cyclictest18095-21sshd00:31:467
2496599100,9cyclictest30614-21kworker/7:122:41:257
2496599100,9cyclictest20595-21kworker/7:400:07:187
2496599100,5cyclictest721-21dbus-daemon00:21:117
2496599100,10cyclictest0-21swapper/722:25:067
2495799108,1cyclictest65-21ksoftirqd/620:17:316
2494999108,1cyclictest57-21ksoftirqd/523:02:265
2494999107,2cyclictest57-21ksoftirqd/500:05:165
2494999104,4cyclictest0-21swapper/521:18:515
2494999103,4cyclictest857-21polkitd23:48:335
2494999103,4cyclictest30197-21sshd21:40:115
2494999103,4cyclictest20306-21systemd23:08:295
2494999103,3cyclictest709-21systemd-logind00:20:515
2494999103,3cyclictest18889-21grepconf.sh22:13:595
2494999100,4cyclictest1-21systemd00:08:095
2494999100,3cyclictest0-21swapper/500:01:155
2494199109,1cyclictest49-21ksoftirqd/420:17:354
2494199109,1cyclictest49-21ksoftirqd/420:07:264
2494199109,1cyclictest49-21ksoftirqd/419:22:124
2494199109,1cyclictest24179-21kworker/4:020:57:164
2494199109,1cyclictest24179-21kworker/4:020:03:324
2494199109,1cyclictest24179-21kworker/4:019:39:164
2494199109,1cyclictest24179-21kworker/4:019:34:144
2494199109,1cyclictest24179-21kworker/4:019:23:304
2494199109,1cyclictest24179-21kworker/4:019:14:504
2494199108,1cyclictest49-21ksoftirqd/420:27:294
24941991010,0cyclictest24179-21kworker/4:021:06:064
24941991010,0cyclictest24179-21kworker/4:019:08:144
2493499109,1cyclictest41-21ksoftirqd/322:44:553
2493499108,1cyclictest41-21ksoftirqd/323:31:163
2493499108,1cyclictest41-21ksoftirqd/322:55:213
2493499108,1cyclictest41-21ksoftirqd/322:30:483
2493499108,1cyclictest41-21ksoftirqd/322:30:483
2493499107,3cyclictest41-21ksoftirqd/300:28:593
2493499105,4cyclictest709-21systemd-logind00:24:463
2493499105,3cyclictest0-21swapper/323:17:113
2493499103,6cyclictest3867-21sshd22:22:413
2493499100,9cyclictest28245-21kworker/3:523:55:223
2493499100,10cyclictest11745-21kworker/3:222:05:223
2493499100,10cyclictest10374-21kworker/3:421:36:503
2492399108,1cyclictest33-21ksoftirqd/223:12:302
2492399107,2cyclictest22419-21grep23:47:152
2492399106,3cyclictest33-21ksoftirqd/223:02:532
2492399105,4cyclictest10053-21grepconf.sh23:27:122
2492399105,2cyclictest709-21systemd-logind21:41:242
2492399102,7cyclictest2802-21grepconf.sh21:57:502
2492399102,5cyclictest1-21systemd22:41:512
2492399101,6cyclictest23580-21sshd22:59:052
2492399100,5cyclictest900-21systemd-cgroups00:07:252
2492399100,10cyclictest6263-21kworker/2:122:23:272
2492399100,10cyclictest0-21swapper/222:18:222
2491699109,1cyclictest25-21ksoftirqd/121:53:021
2491699101,8cyclictest11380-21sshd23:07:571
2491699101,4cyclictest1-21systemd23:51:091
2491699100,4cyclictest1-21systemd23:57:231
2491699100,10cyclictest0-21swapper/121:12:281
2491699100,10cyclictest0-21swapper/120:07:311
2490899108,1cyclictest9-21ksoftirqd/023:52:520
2490899108,1cyclictest9-21ksoftirqd/023:47:410
2490899105,3cyclictest26462-21rm23:16:370
2490899100,10cyclictest0-21swapper/021:17:440
2490899100,1cyclictest0-21swapper/020:55:080
249659997,1cyclictest73-21ksoftirqd/719:52:127
249499992,4cyclictest24170-21nscd21:52:275
249419998,1cyclictest24179-21kworker/4:020:52:144
249419998,1cyclictest24179-21kworker/4:020:48:364
249419998,1cyclictest24179-21kworker/4:020:43:244
249419998,1cyclictest24179-21kworker/4:020:15:504
249419998,1cyclictest24179-21kworker/4:019:56:464
249419997,1cyclictest49-21ksoftirqd/419:47:234
249349998,1cyclictest41-21ksoftirqd/322:32:213
249349997,1cyclictest41-21ksoftirqd/322:12:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional