You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 06:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Tue Mar 17, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
159332960,1sleep215923-21sshd23:21:302
99932820,2sleep01444599cyclictest21:23:390
142172780,1sleep114213-21sshd21:44:221
23342760,3sleep71450299cyclictest23:33:457
276462740,0sleep50-21swapper/521:07:185
10282580,0sleep70-21swapper/722:15:197
253132550,10sleep125-21ksoftirqd/100:01:181
21322510,1sleep52131-21systemd-cgroups23:28:065
1411825126,9sleep50-21swapper/519:04:115
223922490,0sleep449-21ksoftirqd/400:10:264
202952490,0sleep20-21swapper/221:41:032
83852480,1sleep58373-21cp23:45:205
38632480,0sleep00-21swapper/022:47:080
309802480,0sleep70-21swapper/700:23:587
180222480,1sleep718020-21sshd00:36:247
147632480,0sleep014753-21sshd21:42:290
317632470,0sleep10-21swapper/122:09:371
216972470,1sleep421699-21id22:40:474
1421824725,8sleep70-21swapper/719:05:337
120812470,0sleep10-21swapper/123:34:191
98802460,0sleep69879-21sshd23:52:506
67492460,0sleep10-21swapper/123:09:441
64072460,0sleep40-21swapper/400:03:534
64072460,0sleep40-21swapper/400:03:534
56702460,1sleep35668-21bash00:35:403
44782460,1sleep04477-21grepconf.sh22:13:360
208872450,0sleep0797-21sshd23:34:500
99572440,0sleep60-21swapper/622:15:516
39382440,1sleep4784-21runrttasks22:45:204
265892440,0sleep70-21swapper/723:05:177
246092440,1sleep024597-21sshd22:53:570
86492430,0sleep78638-21sshd23:50:597
312232430,1sleep61-21systemd22:41:216
293682430,0sleep00-21swapper/021:34:040
198522430,0sleep60-21swapper/622:29:286
198522430,0sleep60-21swapper/622:29:286
167742430,0sleep40-21swapper/423:51:284
15572430,0sleep50-21swapper/519:37:095
149922430,1sleep665-21ksoftirqd/623:10:136
116192430,1sleep611615-21bash22:23:196
80272420,0sleep30-21swapper/321:49:363
62012420,1sleep773-21ksoftirqd/723:15:187
306372420,0sleep10-21swapper/100:10:551
262882410,0sleep30-21swapper/323:14:343
210572410,0sleep20-21swapper/200:06:392
210572410,0sleep20-21swapper/200:06:392
150372410,0sleep30-21swapper/323:28:523
1403524128,9sleep60-21swapper/619:03:086
121612410,0sleep00-21swapper/022:23:210
1183124129,8sleep40-21swapper/419:01:544
283152400,0sleep10-21swapper/122:33:401
268412400,0sleep20-21swapper/223:48:132
175862400,0sleep50-21swapper/522:01:245
152402400,0sleep40-21swapper/423:02:424
1418924028,9sleep00-21swapper/019:05:100
1401424028,9sleep30-21swapper/319:02:493
1182824028,8sleep10-21swapper/119:01:511
258602390,0sleep00-21swapper/022:33:310
173812390,1sleep017379-21grepconf.sh00:28:480
292322380,0sleep10-21swapper/121:22:511
1406423827,8sleep20-21swapper/219:03:282
276972370,0sleep60-21swapper/623:59:316
14502992611,1cyclictest73-21ksoftirqd/723:01:287
14502992410,1cyclictest73-21ksoftirqd/721:38:527
42122220,0sleep50-21swapper/500:20:365
1450299208,3cyclictest73-21ksoftirqd/722:46:057
1450299202,4cyclictest73-21ksoftirqd/722:34:137
14502992015,3cyclictest73-21ksoftirqd/723:41:477
14502992014,4cyclictest73-21ksoftirqd/722:49:387
14502992010,1cyclictest73-21ksoftirqd/721:49:257
1448699204,2cyclictest22848-21bash00:23:305
160382190,0sleep10-21swapper/122:53:261
1450299195,3cyclictest73-21ksoftirqd/721:59:487
14502991916,1cyclictest73-21ksoftirqd/722:04:077
14502991916,1cyclictest73-21ksoftirqd/721:23:007
14502991915,1cyclictest73-21ksoftirqd/722:07:187
14502991914,3cyclictest73-21ksoftirqd/721:12:227
14502991913,3cyclictest73-21ksoftirqd/722:39:577
1450299190,18cyclictest31970-21kworker/7:500:02:167
1450299190,18cyclictest31970-21kworker/7:500:02:167
14461991912,4cyclictest33-21ksoftirqd/221:29:232
14461991911,1cyclictest33-21ksoftirqd/200:21:442
1450299186,3cyclictest73-21ksoftirqd/700:21:097
1450299186,2cyclictest73-21ksoftirqd/722:28:117
1450299186,2cyclictest73-21ksoftirqd/722:28:117
1450299184,3cyclictest73-21ksoftirqd/722:54:137
1450299184,1cyclictest73-21ksoftirqd/723:44:267
14502991816,1cyclictest73-21ksoftirqd/723:53:137
14502991816,1cyclictest492-21systemd-journal21:19:037
14502991815,3cyclictest73-21ksoftirqd/700:12:467
14502991815,1cyclictest73-21ksoftirqd/721:53:217
14502991815,1cyclictest73-21ksoftirqd/721:44:487
14502991814,3cyclictest73-21ksoftirqd/722:20:387
14502991814,3cyclictest73-21ksoftirqd/721:29:237
14479991812,3cyclictest49-21ksoftirqd/422:49:244
8132170,0sleep50-21swapper/500:27:495
308122170,1sleep230786-21cp23:24:102
210052170,0sleep60-21swapper/622:05:176
192192170,0sleep20-21swapper/223:55:182
162182170,1sleep516217-21bash22:55:225
14502991715,1cyclictest73-21ksoftirqd/723:28:117
14502991715,1cyclictest73-21ksoftirqd/723:22:247
14502991715,1cyclictest73-21ksoftirqd/721:11:277
14502991715,1cyclictest73-21ksoftirqd/700:09:277
14502991714,2cyclictest492-21systemd-journal22:25:327
14502991712,3cyclictest73-21ksoftirqd/723:58:247
14502991711,3cyclictest73-21ksoftirqd/700:30:007
1450299170,17cyclictest25282-21kworker/7:021:32:487
14486991711,5cyclictest28410-21systemd23:05:245
14502991614,1cyclictest73-21ksoftirqd/723:18:347
14502991614,1cyclictest73-21ksoftirqd/723:06:497
14494991615,1cyclictest65-21ksoftirqd/621:47:506
14461991614,1cyclictest33-21ksoftirqd/222:05:522
14461991610,5cyclictest33-21ksoftirqd/221:46:492
1445399160,15cyclictest10678-21kworker/1:100:23:351
37142150,0sleep60-21swapper/622:07:586
14470991513,1cyclictest41-21ksoftirqd/322:51:483
1447099150,14cyclictest7487-21kworker/3:022:43:583
14461991513,1cyclictest33-21ksoftirqd/222:44:052
1445399150,14cyclictest23409-21grep23:03:111
142612150,1sleep21-21systemd22:29:082
142612150,1sleep21-21systemd22:29:082
251252140,1sleep21-21systemd23:42:292
14502991413,1cyclictest8747-21kworker/7:019:13:317
1448699140,13cyclictest797-21sshd23:50:405
1447999149,2cyclictest49-21ksoftirqd/421:42:564
14479991413,1cyclictest49-21ksoftirqd/423:32:054
14479991412,1cyclictest49-21ksoftirqd/422:55:454
14479991412,1cyclictest49-21ksoftirqd/422:16:384
14479991412,1cyclictest49-21ksoftirqd/421:32:194
14479991412,1cyclictest49-21ksoftirqd/400:00:064
14479991411,1cyclictest49-21ksoftirqd/400:30:064
14470991413,1cyclictest41-21ksoftirqd/323:32:063
14470991413,1cyclictest391rcuc/321:15:053
14470991412,2cyclictest7487-21kworker/3:023:03:483
14470991412,1cyclictest41-21ksoftirqd/321:17:573
1447099140,1cyclictest0-21swapper/300:21:593
14461991413,1cyclictest33-21ksoftirqd/200:23:212
14461991412,1cyclictest33-21ksoftirqd/223:02:352
14461991411,1cyclictest20930-1kworker/2:0H22:52:202
1445399148,1cyclictest25-21ksoftirqd/122:38:321
14445991411,1cyclictest5528-21kworker/0:423:23:550
133832140,1sleep665-21ksoftirqd/621:25:456
304122130,2sleep3401ktimersoftd/322:20:443
14502991312,1cyclictest73-21ksoftirqd/720:56:497
14502991311,1cyclictest73-21ksoftirqd/721:06:507
1449499139,3cyclictest65-21ksoftirqd/600:10:386
14494991310,2cyclictest29804-21grepconf.sh00:12:406
1448699135,7cyclictest27482-21grep23:12:435
1448699134,2cyclictest26468-21sshd21:50:445
1448699132,5cyclictest10247-21grepconf.sh23:39:485
14486991310,2cyclictest0-21swapper/522:35:235
1448699130,4cyclictest6207-21bash22:17:245
14479991311,1cyclictest49-21ksoftirqd/423:55:414
14479991311,1cyclictest49-21ksoftirqd/422:59:154
14479991311,1cyclictest16975-21systemd-cgroups23:08:254
14479991310,2cyclictest49-21ksoftirqd/400:33:504
1447099138,4cyclictest41-21ksoftirqd/322:28:193
1447099138,4cyclictest41-21ksoftirqd/322:28:193
14470991311,1cyclictest41-21ksoftirqd/321:42:493
14470991311,1cyclictest41-21ksoftirqd/300:15:573
14470991310,2cyclictest41-21ksoftirqd/323:37:373
1446199139,3cyclictest33-21ksoftirqd/221:24:382
1446199134,7cyclictest14532-21bash23:15:482
14461991312,1cyclictest33-21ksoftirqd/223:32:482
14461991312,1cyclictest33-21ksoftirqd/221:59:082
14461991312,1cyclictest33-21ksoftirqd/221:48:232
14461991311,1cyclictest33-21ksoftirqd/223:08:582
14461991311,1cyclictest33-21ksoftirqd/221:21:002
1446199130,12cyclictest583-21kworker/2:022:39:202
14453991313,0cyclictest0-21swapper/100:27:481
14453991311,1cyclictest25-21ksoftirqd/121:47:501
14445991312,1cyclictest9-21ksoftirqd/023:07:390
14445991312,1cyclictest1616-21kworker/0:200:15:340
14445991311,2cyclictest377-21kworker/0:622:09:070
14445991311,1cyclictest9-21ksoftirqd/021:55:530
14445991310,1cyclictest9-21ksoftirqd/021:30:310
1444599130,12cyclictest686-21dbus-daemon00:09:370
27732120,0sleep20-21swapper/222:13:302
1705621210,1sleep449-21ksoftirqd/421:55:474
14502991211,1cyclictest73-21ksoftirqd/719:52:107
14502991210,1cyclictest73-21ksoftirqd/720:26:487
14494991211,1cyclictest65-21ksoftirqd/621:42:486
14494991210,1cyclictest65-21ksoftirqd/622:21:046
14494991210,1cyclictest65-21ksoftirqd/600:23:556
14494991210,1cyclictest0-21swapper/622:55:536
1449499120,11cyclictest7838-21sshd23:24:446
1449499120,11cyclictest32533-21bash23:41:086
1448699129,3cyclictest0-21swapper/500:12:555
1448699125,6cyclictest1-21systemd00:08:085
1448699124,7cyclictest3817-21grep23:22:345
1448699124,7cyclictest20155-21cp23:59:045
1448699124,7cyclictest10271-21grep23:32:175
1448699124,2cyclictest7923-21sshd22:13:495
1448699124,2cyclictest686-21dbus-daemon22:48:355
1448699124,2cyclictest686-21dbus-daemon22:37:105
1448699124,2cyclictest4888-21bash23:54:275
1448699124,2cyclictest29207-21grepconf.sh21:34:035
1448699124,2cyclictest20974-21bash23:08:395
1448699124,2cyclictest11477-21sshd22:42:025
1448699124,2cyclictest10620-21grepconf.sh22:02:465
1448699124,1cyclictest11769-21systemd21:23:455
1448699123,8cyclictest15964-21rm23:17:405
1448699123,2cyclictest696-21nscd21:14:595
1448699123,2cyclictest686-21dbus-daemon22:57:195
1448699123,2cyclictest686-21dbus-daemon22:25:195
1448699122,3cyclictest10386-21sshd21:46:035
1448699122,2cyclictest691-21systemd-logind00:04:475
1448699122,2cyclictest691-21systemd-logind00:04:475
1448699122,2cyclictest686-21dbus-daemon21:29:295
1448699122,2cyclictest12685-21sshd00:32:135
14486991210,1cyclictest492-21systemd-journal22:06:515
1448699120,4cyclictest29756-21bash21:37:475
1448699120,3cyclictest23883-21rm21:20:465
1448699120,12cyclictest9396-21kworker/5:521:52:275
1447999129,2cyclictest49-21ksoftirqd/422:30:154
1447999129,2cyclictest49-21ksoftirqd/422:30:154
14479991211,1cyclictest49-21ksoftirqd/422:10:144
14479991210,1cyclictest691-21systemd-logind23:31:264
14479991210,1cyclictest49-21ksoftirqd/422:21:564
14479991210,1cyclictest49-21ksoftirqd/421:47:384
14479991210,1cyclictest49-21ksoftirqd/421:11:234
1447999120,12cyclictest849-21kworker/4:023:12:214
1447999120,11cyclictest1-21systemd23:45:204
1447099128,1cyclictest41-21ksoftirqd/300:03:203
1447099128,1cyclictest41-21ksoftirqd/300:03:203
1447099125,4cyclictest32119-21bash21:34:133
14470991211,1cyclictest41-21ksoftirqd/322:21:593
14470991211,1cyclictest41-21ksoftirqd/300:27:213
14470991210,1cyclictest41-21ksoftirqd/323:49:133
14470991210,1cyclictest41-21ksoftirqd/323:22:453
14470991210,1cyclictest41-21ksoftirqd/322:58:253
14470991210,1cyclictest41-21ksoftirqd/322:40:193
14470991210,1cyclictest41-21ksoftirqd/320:16:483
1447099120,12cyclictest0-21swapper/323:54:463
1447099120,11cyclictest31275-21sshd00:01:393
1447099120,11cyclictest25741-21kworker/3:421:24:483
1447099120,11cyclictest14973-21sshd22:34:473
1447099120,11cyclictest0-21swapper/323:21:273
1447099120,1cyclictest131rcu_sched21:38:513
1446199124,4cyclictest29612-21bash23:39:022
1446199122,3cyclictest10164-21systemd-cgroups22:49:232
14461991211,1cyclictest33-21ksoftirqd/200:28:242
14461991210,2cyclictest33-21ksoftirqd/222:22:022
14461991210,1cyclictest33-21ksoftirqd/222:17:062
14461991210,1cyclictest33-21ksoftirqd/221:15:172
14461991210,1cyclictest33-21ksoftirqd/200:32:262
14461991210,1cyclictest0-21swapper/221:56:212
1445399122,4cyclictest0-21swapper/122:22:311
1445399122,4cyclictest0-21swapper/121:36:241
14453991211,1cyclictest0-21swapper/121:14:341
14453991210,1cyclictest25-21ksoftirqd/123:17:021
1445399121,5cyclictest1-21systemd21:17:301
1445399120,11cyclictest16034-21sshd23:25:131
1444599129,1cyclictest9-21ksoftirqd/023:17:050
1444599128,1cyclictest3860-21kworker/0:400:33:260
1444599127,4cyclictest686-21dbus-daemon00:23:470
14445991211,1cyclictest9-21ksoftirqd/022:44:590
14445991211,1cyclictest9-21ksoftirqd/022:20:400
14445991211,1cyclictest9-21ksoftirqd/000:02:440
14445991211,1cyclictest9-21ksoftirqd/000:02:440
14445991210,1cyclictest9-21ksoftirqd/021:59:140
14445991210,1cyclictest9-21ksoftirqd/021:47:410
14445991210,0cyclictest3923-21kworker/0:122:57:070
1444599121,4cyclictest0-21swapper/023:40:150
129512120,0sleep1231rcuc/122:57:021
127322120,0sleep40-21swapper/422:01:074
1450299119,1cyclictest73-21ksoftirqd/720:11:487
1450299119,1cyclictest73-21ksoftirqd/719:42:007
1450299119,1cyclictest73-21ksoftirqd/719:26:497
14502991110,1cyclictest73-21ksoftirqd/720:12:077
14502991110,1cyclictest73-21ksoftirqd/720:01:597
1449499119,1cyclictest65-21ksoftirqd/623:47:166
1449499119,1cyclictest65-21ksoftirqd/622:32:486
1449499115,2cyclictest1-21systemd21:14:436
1449499113,5cyclictest5742-21sshd21:34:356
1449499112,5cyclictest20353-21systemd22:01:346
14494991110,1cyclictest65-21ksoftirqd/623:30:386
1449499110,7cyclictest29136-21systemd22:57:556
1448699112,2cyclictest9149-21sshd22:27:005
1448699112,2cyclictest9149-21sshd22:27:005
1447999119,1cyclictest49-21ksoftirqd/423:37:564
1447999119,1cyclictest49-21ksoftirqd/422:19:004
1447999119,1cyclictest49-21ksoftirqd/421:17:194
1447999119,1cyclictest49-21ksoftirqd/400:22:374
1447999119,1cyclictest49-21ksoftirqd/400:14:334
1447999118,2cyclictest49-21ksoftirqd/422:03:444
1447999118,2cyclictest49-21ksoftirqd/421:30:254
14479991110,1cyclictest49-21ksoftirqd/422:34:334
14479991110,1cyclictest49-21ksoftirqd/421:22:034
1447999110,11cyclictest0-21swapper/421:40:204
1447999110,1cyclictest15749-21sshd23:23:174
1447099119,2cyclictest41-21ksoftirqd/321:53:253
1447099119,1cyclictest41-21ksoftirqd/323:42:103
1447099119,1cyclictest41-21ksoftirqd/322:53:183
1447099119,1cyclictest41-21ksoftirqd/322:09:393
1447099119,1cyclictest41-21ksoftirqd/321:57:083
1447099119,1cyclictest41-21ksoftirqd/321:27:173
1447099119,1cyclictest41-21ksoftirqd/300:21:433
1447099119,1cyclictest41-21ksoftirqd/300:07:493
1447099117,1cyclictest41-21ksoftirqd/321:07:073
14470991110,1cyclictest41-21ksoftirqd/322:02:233
1446199119,1cyclictest33-21ksoftirqd/221:09:442
1446199118,2cyclictest20199-21systemd22:07:042
1446199118,1cyclictest33-21ksoftirqd/200:14:252
1446199117,3cyclictest33-21ksoftirqd/222:58:482
1446199115,3cyclictest31514-21sshd22:32:022
1446199112,3cyclictest0-21swapper/221:34:082
1446199110,4cyclictest5550-21cp23:30:142
1445399119,1cyclictest25-21ksoftirqd/121:58:371
1445399119,1cyclictest25-21ksoftirqd/100:03:201
1445399119,1cyclictest25-21ksoftirqd/100:03:201
1445399116,2cyclictest686-21dbus-daemon22:17:101
1445399112,4cyclictest8496-21sshd22:12:011
14453991110,1cyclictest25-21ksoftirqd/122:02:511
1445399111,4cyclictest32333-21sshd21:28:381
1445399111,4cyclictest0-21swapper/123:42:371
1445399111,4cyclictest0-21swapper/121:52:031
1445399110,11cyclictest16321-21kworker/1:322:42:021
1445399110,1cyclictest0-21swapper/123:28:311
1444599119,1cyclictest9-21ksoftirqd/022:27:310
1444599119,1cyclictest9-21ksoftirqd/022:27:310
1444599119,1cyclictest9-21ksoftirqd/021:41:320
1444599119,1cyclictest9-21ksoftirqd/021:10:180
1444599119,1cyclictest9-21ksoftirqd/000:19:280
1444599119,1cyclictest691-21systemd-logind23:29:080
1444599116,5cyclictest0-21swapper/019:33:430
1444599116,5cyclictest0-21swapper/019:33:430
1444599115,0cyclictest0-21swapper/020:34:170
1444599112,9cyclictest0-21swapper/020:00:110
1444599112,5cyclictest763-21NetworkManager22:02:150
14445991110,1cyclictest9-21ksoftirqd/023:57:030
1444599110,10cyclictest3860-21kworker/0:423:54:120
45322100,0sleep20-21swapper/220:42:002
45322100,0sleep20-21swapper/220:42:002
317622100,0sleep50-21swapper/520:32:025
289902100,1sleep665-21ksoftirqd/600:27:346
1450299109,1cyclictest73-21ksoftirqd/720:17:077
1450299109,1cyclictest73-21ksoftirqd/719:32:067
1450299109,1cyclictest73-21ksoftirqd/719:32:067
1450299109,1cyclictest73-21ksoftirqd/719:27:067
1450299109,1cyclictest73-21ksoftirqd/719:27:067
1450299108,1cyclictest73-21ksoftirqd/719:47:017
1450299107,2cyclictest73-21ksoftirqd/720:31:497
1449499109,1cyclictest0-21swapper/621:52:216
1449499108,1cyclictest65-21ksoftirqd/623:20:376
1449499108,1cyclictest65-21ksoftirqd/621:16:546
1449499108,1cyclictest65-21ksoftirqd/600:19:456
1449499107,1cyclictest65-21ksoftirqd/623:12:426
1449499103,4cyclictest885-21polkitd22:49:146
1449499102,3cyclictest718-21avahi-daemon23:32:236
14494991010,0cyclictest0-21swapper/621:41:286
1449499101,4cyclictest24800-21grepconf.sh23:42:286
1449499100,7cyclictest8854-21sd-pam00:32:036
1448699103,6cyclictest57-21ksoftirqd/520:44:205
1448699103,6cyclictest57-21ksoftirqd/520:44:205
1448699102,3cyclictest3290-21cat19:42:035
1448699102,2cyclictest0-21swapper/520:05:435
1448699102,2cyclictest0-21swapper/519:09:305
1447999109,1cyclictest49-21ksoftirqd/400:17:384
1447999108,1cyclictest49-21ksoftirqd/423:17:044
1447999103,2cyclictest18672-21sshd21:06:494
1447099109,1cyclictest41-21ksoftirqd/323:07:053
1447099109,1cyclictest41-21ksoftirqd/322:13:083
1446199108,1cyclictest33-21ksoftirqd/200:07:132
1446199103,4cyclictest5120-21bash00:00:062
1445399109,1cyclictest25-21ksoftirqd/100:16:501
1445399109,1cyclictest0-21swapper/100:14:331
1445399108,1cyclictest25-21ksoftirqd/123:13:031
1445399108,1cyclictest25-21ksoftirqd/121:37:061
1445399103,6cyclictest6490-21sshd22:47:161
1445399103,6cyclictest5949-21sshd23:54:311
1445399103,6cyclictest3918-21systemd-cgroups00:35:331
1445399103,4cyclictest22824-21sshd23:36:501
1445399100,9cyclictest0-21swapper/119:22:061
1445399100,4cyclictest887-21gdbus22:27:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional