You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 08:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Dec 12, 2025 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2610821180,2sleep32155799cyclictest21:48:283
2610821180,2sleep32155799cyclictest21:48:283
295402760,0sleep30-21swapper/321:43:073
199862610,1sleep2763-21runrttasks18:48:572
199862610,1sleep2763-21runrttasks18:48:572
49612560,0sleep70-21swapper/721:01:237
49612560,0sleep70-21swapper/721:01:237
146612520,0sleep6631rcuc/622:07:216
2115025126,8sleep40-21swapper/418:50:284
2115025126,8sleep40-21swapper/418:50:284
2124225027,9sleep50-21swapper/518:51:425
2124225027,9sleep50-21swapper/518:51:425
171212490,0sleep50-21swapper/521:22:115
2119724722,9sleep70-21swapper/718:51:047
2119724722,9sleep70-21swapper/718:51:047
102452470,0sleep10-21swapper/121:18:471
82892460,0sleep00-21swapper/022:03:550
300972460,0sleep60-21swapper/622:50:466
290922440,0sleep50-21swapper/521:40:055
65592430,1sleep341-21ksoftirqd/323:28:073
57142430,1sleep75716-21latency_hist22:23:407
240642430,1sleep09-21ksoftirqd/000:03:280
2121724331,8sleep00-21swapper/018:51:210
2121724331,8sleep00-21swapper/018:51:210
18632430,1sleep233-21ksoftirqd/221:40:342
263772420,0sleep60-21swapper/600:06:386
233412420,0sleep40-21swapper/400:03:244
265812410,0sleep4471rcuc/421:34:114
162442410,0sleep10-21swapper/100:11:301
145872410,0sleep40-21swapper/421:47:254
145872410,0sleep40-21swapper/421:47:254
10702410,0sleep70-21swapper/723:41:167
2115224028,8sleep60-21swapper/618:50:306
2115224028,8sleep60-21swapper/618:50:306
2105024028,9sleep30-21swapper/318:49:073
2105024028,9sleep30-21swapper/318:49:073
182282400,0sleep70-21swapper/723:37:167
137622400,0sleep60-21swapper/621:02:106
137622400,0sleep60-21swapper/621:02:106
10342400,0sleep40-21swapper/423:13:344
236532390,0sleep50-21swapper/522:05:125
176462390,0sleep7711rcuc/722:58:167
202172380,0sleep10-21swapper/123:34:381
246112370,0sleep00-21swapper/018:58:400
2106623725,9sleep10-21swapper/118:49:211
2106623725,9sleep10-21swapper/118:49:211
243992360,0sleep50-21swapper/522:16:415
2157999210,6cyclictest711-21dbus-daemon23:48:317
2154599210,20cyclictest15613-21kworker/1:022:41:271
2157999200,8cyclictest711-21dbus-daemon21:08:097
2156699202,0cyclictest0-21swapper/519:22:315
2156399209,1cyclictest49-21ksoftirqd/422:41:484
2154599202,17cyclictest4524-21bash22:09:131
267132190,0sleep40-21swapper/400:03:404
222902190,0sleep00-21swapper/023:48:380
2157999193,6cyclictest18528-21bash22:33:027
2157999190,9cyclictest21889-21id23:54:057
2157999190,9cyclictest0-21swapper/722:36:367
2157999190,8cyclictest16511-21sshd23:20:247
2157999190,10cyclictest10495-21bash21:15:527
2156699198,5cyclictest0-21swapper/523:41:555
2156699198,5cyclictest0-21swapper/523:30:355
2156699198,5cyclictest0-21swapper/520:54:395
2156699198,5cyclictest0-21swapper/520:54:395
2156699198,5cyclictest0-21swapper/519:43:115
2156699198,5cyclictest0-21swapper/519:27:175
2156699198,0cyclictest0-21swapper/520:20:195
2156699198,0cyclictest0-21swapper/519:33:235
2156699198,0cyclictest0-21swapper/519:17:435
2156699198,0cyclictest0-21swapper/518:59:075
2157999181,8cyclictest14260-21sshd21:36:007
2157999181,6cyclictest29570-21grepconf.sh21:40:077
2157999180,9cyclictest2060-21sshd22:39:467
2157999180,8cyclictest25675-21sshd00:03:377
2157999180,8cyclictest22861-21sshd23:04:067
2157999180,7cyclictest9704-21sshd22:12:387
2157999180,7cyclictest861-21gdbus23:12:287
2157999180,7cyclictest27348-21sshd22:50:297
2157999180,10cyclictest32493-21grepconf.sh23:30:117
2157999180,10cyclictest1808-21bash22:14:387
2156699181,8cyclictest10651-21sshd22:51:595
2156699180,0cyclictest0-21swapper/519:52:475
2156399187,1cyclictest49-21ksoftirqd/422:28:314
2156399185,3cyclictest49-21ksoftirqd/400:19:014
21563991814,3cyclictest49-21ksoftirqd/421:17:424
2156399180,18cyclictest22267-21kworker/4:022:15:054
2157999170,9cyclictest14783-21grepconf.sh22:04:257
2157999170,9cyclictest0-21swapper/721:09:417
2157999170,8cyclictest15446-21bash22:46:427
2157999170,7cyclictest28754-21bash00:12:407
2157999170,7cyclictest17161-21grepconf.sh20:56:177
2157999170,7cyclictest17161-21grepconf.sh20:56:177
2157999170,7cyclictest0-21swapper/700:18:107
2157999170,5cyclictest0-21swapper/721:44:057
2157999170,5cyclictest0-21swapper/721:44:057
2157999170,0cyclictest0-21swapper/721:53:357
2157299170,16cyclictest711-21dbus-daemon23:56:286
2156699176,5cyclictest0-21swapper/523:44:235
2156699176,5cyclictest0-21swapper/523:20:395
2156699176,5cyclictest0-21swapper/523:07:175
2156699176,5cyclictest0-21swapper/523:02:475
2156699176,5cyclictest0-21swapper/520:17:315
2156699176,5cyclictest0-21swapper/518:57:555
2156699176,1cyclictest0-21swapper/521:31:495
2156699176,0cyclictest0-21swapper/519:59:595
2156699170,5cyclictest0-21swapper/519:08:115
2156399176,3cyclictest49-21ksoftirqd/400:15:384
2156399173,2cyclictest49-21ksoftirqd/423:57:274
21563991712,3cyclictest49-21ksoftirqd/422:05:194
21563991711,4cyclictest49-21ksoftirqd/400:12:544
2156399170,3cyclictest49-21ksoftirqd/423:07:594
232352160,0sleep10-21swapper/121:36:491
2157999160,7cyclictest668-21systemd-logind21:27:337
2157999160,7cyclictest27161-21bash23:24:037
2157999160,7cyclictest10071-21sshd21:21:317
2157999160,6cyclictest711-21dbus-daemon21:59:217
2157999160,6cyclictest3901-21bash23:49:387
2157999160,6cyclictest10696-21sshd23:17:117
2157999160,6cyclictest0-21swapper/700:04:567
2157999160,10cyclictest7097-21bash23:02:517
2156699166,0cyclictest0-21swapper/520:41:395
2156699165,6cyclictest15381-21kworker/5:222:18:535
2156699165,5cyclictest0-21swapper/523:24:075
2156699165,5cyclictest0-21swapper/522:56:375
2156699165,5cyclictest0-21swapper/522:41:555
2156699165,5cyclictest0-21swapper/522:26:235
2156699165,5cyclictest0-21swapper/521:38:355
2156699165,5cyclictest0-21swapper/519:36:075
2156699165,5cyclictest0-21swapper/519:09:395
2156699160,4cyclictest0-21swapper/521:57:435
2156399165,3cyclictest49-21ksoftirqd/421:42:124
2156399162,2cyclictest49-21ksoftirqd/422:50:464
21563991615,1cyclictest49-21ksoftirqd/423:44:544
21563991615,1cyclictest49-21ksoftirqd/421:58:554
21563991614,1cyclictest49-21ksoftirqd/421:52:274
21563991613,3cyclictest49-21ksoftirqd/423:35:124
21563991613,3cyclictest49-21ksoftirqd/422:36:194
21563991613,3cyclictest49-21ksoftirqd/421:32:364
21563991613,2cyclictest15159-21cp22:29:514
21563991611,3cyclictest49-21ksoftirqd/423:21:504
21563991611,3cyclictest49-21ksoftirqd/422:54:094
2156399161,2cyclictest49-21ksoftirqd/422:45:014
21536991614,1cyclictest9-21ksoftirqd/000:12:320
2157999155,9cyclictest23435-21grep18:53:597
2157999150,8cyclictest27081-21bash21:57:007
2157999150,8cyclictest1-21systemd22:25:247
2157999150,6cyclictest1-21systemd00:22:387
2157999150,6cyclictest0-21swapper/721:30:347
2156699154,5cyclictest0-21swapper/521:27:035
2156699154,0cyclictest0-21swapper/520:24:275
2156699150,9cyclictest0-21swapper/521:45:235
2156699150,9cyclictest0-21swapper/521:45:235
2156699150,9cyclictest0-21swapper/519:44:395
2156699150,3cyclictest0-21swapper/522:09:015
2156399155,2cyclictest49-21ksoftirqd/423:24:204
21563991514,1cyclictest49-21ksoftirqd/423:33:084
21563991513,1cyclictest49-21ksoftirqd/422:21:514
21563991512,3cyclictest49-21ksoftirqd/421:56:574
21563991510,3cyclictest49-21ksoftirqd/420:58:524
21563991510,3cyclictest49-21ksoftirqd/420:58:524
2156399150,14cyclictest26400-21kworker/4:223:00:484
2155399150,13cyclictest2999-21id21:06:472
311592140,0sleep00-21swapper/021:40:160
2156699149,1cyclictest28105-21nfsd23:13:395
2156699143,5cyclictest0-21swapper/523:15:015
2156699142,6cyclictest0-21swapper/523:54:215
2156699142,0cyclictest0-21swapper/522:00:215
2156699140,8cyclictest0-21swapper/520:47:555
2156399149,1cyclictest49-21ksoftirqd/421:04:344
2156399142,1cyclictest49-21ksoftirqd/422:12:034
21563991413,1cyclictest49-21ksoftirqd/421:11:324
21563991412,1cyclictest49-21ksoftirqd/423:50:344
21563991412,1cyclictest49-21ksoftirqd/423:14:414
21563991412,1cyclictest49-21ksoftirqd/421:20:164
21563991410,3cyclictest49-21ksoftirqd/423:40:024
2156399140,2cyclictest49-21ksoftirqd/421:26:114
2156399140,2cyclictest131rcu_sched20:58:174
2156399140,2cyclictest131rcu_sched20:58:174
21536991413,1cyclictest9-21ksoftirqd/022:18:410
21536991412,1cyclictest9-21ksoftirqd/023:14:170
21536991412,1cyclictest9-21ksoftirqd/023:12:090
21536991412,1cyclictest9-21ksoftirqd/022:53:390
21536991412,1cyclictest9-21ksoftirqd/022:13:390
21536991412,1cyclictest9-21ksoftirqd/021:14:200
152402140,0sleep10-21swapper/123:45:111
2157999130,13cyclictest0-21swapper/719:48:397
2157299138,0cyclictest0-21swapper/622:09:436
2157299136,6cyclictest28699-21cp21:37:196
2156699138,5cyclictest0-21swapper/523:59:555
2156699138,5cyclictest0-21swapper/523:49:335
2156699138,5cyclictest0-21swapper/523:36:555
2156699138,5cyclictest0-21swapper/500:23:155
2156699138,5cyclictest0-21swapper/500:08:455
2156699138,0cyclictest0-21swapper/521:49:415
2156699134,6cyclictest0-21swapper/519:54:595
2156699132,5cyclictest0-21swapper/521:13:555
2156699132,5cyclictest0-21swapper/520:50:455
2156699132,5cyclictest0-21swapper/520:33:155
2156699132,5cyclictest0-21swapper/500:13:495
2156699131,6cyclictest0-21swapper/521:06:135
2156699130,7cyclictest0-21swapper/522:34:195
21536991312,1cyclictest9-21ksoftirqd/022:41:300
21536991312,1cyclictest9-21ksoftirqd/021:18:590
21536991312,1cyclictest9-21ksoftirqd/000:20:000
21536991312,1cyclictest9-21ksoftirqd/000:18:400
21536991311,1cyclictest9-21ksoftirqd/022:45:410
2153699130,13cyclictest29131-21kworker/0:022:30:510
186032130,0sleep50-21swapper/522:30:115
63952120,1sleep06396-21grep21:43:520
63952120,1sleep06396-21grep21:43:520
313992120,0sleep60-21swapper/619:08:556
269202120,0sleep10-21swapper/123:10:031
2157999120,6cyclictest0-21swapper/720:30:057
2157999120,12cyclictest0-21swapper/720:24:537
2157999120,0cyclictest0-21swapper/720:33:437
2157299129,1cyclictest65-21ksoftirqd/623:02:236
2157299122,4cyclictest4026-21sshd23:22:126
2157299122,4cyclictest28411-21grep22:44:536
2157299122,4cyclictest17262-21sshd23:48:136
2157299122,4cyclictest12554-21sshd21:52:576
2156699128,0cyclictest0-21swapper/522:47:335
2156699121,5cyclictest0-21swapper/521:03:335
2156699121,5cyclictest0-21swapper/521:03:335
2156699120,0cyclictest0-21swapper/500:05:595
2155799120,11cyclictest24722-21sshd23:18:253
2155399122,4cyclictest0-21swapper/221:03:222
2155399122,4cyclictest0-21swapper/221:03:222
21553991211,1cyclictest33-21ksoftirqd/221:55:462
2155399120,4cyclictest13605-21bash22:52:142
2155399120,11cyclictest20282-21grepconf.sh22:44:082
2154599128,3cyclictest25-21ksoftirqd/123:31:461
21545991210,1cyclictest25-21ksoftirqd/121:14:301
2154599120,11cyclictest6940-21sshd22:54:241
2154599120,11cyclictest28325-21sshd21:48:401
2154599120,11cyclictest28325-21sshd21:48:401
2154599120,11cyclictest19231-21grepconf.sh00:17:331
2153699129,3cyclictest9-21ksoftirqd/023:05:430
2153699129,2cyclictest987-21grepconf.sh21:12:150
2153699127,1cyclictest9-21ksoftirqd/022:55:250
21536991211,1cyclictest9-21ksoftirqd/023:54:120
21536991211,1cyclictest9-21ksoftirqd/021:58:390
21536991210,1cyclictest9-21ksoftirqd/023:30:180
21536991210,1cyclictest9-21ksoftirqd/023:18:440
21536991210,1cyclictest9-21ksoftirqd/019:28:400
2153699120,11cyclictest10662-21bash21:52:460
196292120,0sleep2763-21runrttasks23:51:052
169082120,0sleep30-21swapper/322:01:493
69572110,0sleep00-21swapper/021:26:540
2157999116,5cyclictest0-21swapper/719:26:437
2157999116,0cyclictest0-21swapper/719:20:197
2157999110,7cyclictest0-21swapper/720:04:137
2157999110,11cyclictest0-21swapper/719:40:277
2157999110,11cyclictest0-21swapper/719:37:557
2157999110,11cyclictest0-21swapper/719:30:557
2157999110,0cyclictest0-21swapper/719:10:117
2157299116,0cyclictest0-21swapper/623:08:376
2157299114,6cyclictest31927-21bash23:33:016
2157299112,4cyclictest18322-21sshd23:14:546
2157299112,4cyclictest15944-21sshd22:58:076
2157299112,4cyclictest0-21swapper/600:09:216
2157299111,4cyclictest9394-21bash00:19:416
2157299111,4cyclictest711-21dbus-daemon23:58:566
2157299111,4cyclictest5786-21sshd23:41:426
2157299111,4cyclictest14994-21sshd23:34:116
2156699116,5cyclictest0-21swapper/521:13:095
2156699116,5cyclictest0-21swapper/520:34:235
2156699116,5cyclictest0-21swapper/520:04:435
2156699110,0cyclictest0-21swapper/520:09:235
2156399119,1cyclictest49-21ksoftirqd/420:38:394
2155799113,4cyclictest31675-21nscd22:05:103
2155799112,5cyclictest32263-21bash21:17:533
21557991110,1cyclictest41-21ksoftirqd/300:09:063
2155799110,10cyclictest28353-21sshd00:06:493
2155799110,10cyclictest0-21swapper/321:01:353
2155799110,10cyclictest0-21swapper/321:01:353
2155799110,1cyclictest711-21dbus-daemon22:12:313
2155799110,1cyclictest0-21swapper/321:34:133
2155399116,5cyclictest0-21swapper/200:02:472
2155399112,4cyclictest711-21dbus-daemon22:10:362
2155399112,4cyclictest5609-21sshd23:13:532
2155399112,4cyclictest27682-21sshd23:27:062
2155399111,5cyclictest12096-21bash23:00:272
2155399110,10cyclictest7250-21sshd21:09:512
2155399110,10cyclictest10567-21grepconf.sh22:15:262
2154599116,2cyclictest17853-21sshd23:53:531
2154599110,11cyclictest0-21swapper/122:46:411
2154599110,1cyclictest0-21swapper/123:07:391
2153699119,1cyclictest9-21ksoftirqd/023:23:460
2153699119,1cyclictest9-21ksoftirqd/021:36:400
2153699119,1cyclictest14835-21grepconf.sh00:05:310
2153699116,1cyclictest9-21ksoftirqd/021:58:540
21536991110,1cyclictest9-21ksoftirqd/022:34:430
21536991110,1cyclictest9-21ksoftirqd/022:23:500
21536991110,1cyclictest9-21ksoftirqd/022:14:540
21536991110,1cyclictest9-21ksoftirqd/020:58:200
21536991110,1cyclictest9-21ksoftirqd/020:58:200
2153699110,11cyclictest3184-21kworker/0:122:59:160
169742110,0sleep60-21swapper/622:35:326
11592110,0sleep20-21swapper/200:15:552
2157999105,0cyclictest0-21swapper/719:01:417
2157999103,7cyclictest0-21swapper/720:45:517
2157999101,9cyclictest0-21swapper/720:14:597
2157999101,9cyclictest0-21swapper/719:59:597
2157999101,9cyclictest0-21swapper/719:49:417
2157999101,0cyclictest0-21swapper/719:14:517
2157999100,6cyclictest0-21swapper/720:40:297
2157999100,6cyclictest0-21swapper/720:23:257
2157999100,6cyclictest0-21swapper/720:12:537
2157999100,6cyclictest0-21swapper/719:56:457
2157999100,10cyclictest0-21swapper/720:49:597
2157299103,6cyclictest30219-21sshd21:23:216
2157299103,6cyclictest25985-21sshd21:42:476
2157299103,6cyclictest1622-21bash21:26:266
2157299103,2cyclictest17568-21bash21:58:586
2157299101,4cyclictest14148-21systemd-cgroups21:07:476
2157299101,4cyclictest0-21swapper/621:43:496
2157299101,4cyclictest0-21swapper/621:43:496
2157299100,9cyclictest0-21swapper/620:49:006
2157299100,4cyclictest4377-21sshd21:57:516
2156399108,1cyclictest49-21ksoftirqd/419:18:404
2155799108,1cyclictest41-21ksoftirqd/323:06:563
2155799108,1cyclictest41-21ksoftirqd/321:56:403
2155799105,2cyclictest24207-21kworker/3:122:57:313
2155799104,4cyclictest711-21dbus-daemon23:33:113
2155799103,4cyclictest11787-21bash23:50:213
2155799100,10cyclictest23792-21kworker/3:121:09:363
2155799100,1cyclictest0-21swapper/323:22:353
2155399109,1cyclictest33-21ksoftirqd/223:04:372
2155399108,2cyclictest33-21ksoftirqd/222:24:102
2155399102,3cyclictest22606-21sshd23:45:512
2155399102,3cyclictest16242-21sshd23:23:172
2155399102,3cyclictest0-21swapper/221:46:022
2155399102,3cyclictest0-21swapper/221:46:022
2155399101,4cyclictest31590-21sshd21:28:592
2155399101,4cyclictest30321-21sshd22:53:432
2155399101,4cyclictest27781-21cp22:02:522
2155399101,4cyclictest27293-21sshd00:06:432
2155399101,4cyclictest19725-21bash23:57:032
2155399101,4cyclictest13376-21systemd-cgroups21:24:332
2155399100,9cyclictest21084-21grep23:29:092
2155399100,10cyclictest0-21swapper/223:34:162
2154599109,1cyclictest25-21ksoftirqd/122:14:291
2154599109,1cyclictest25-21ksoftirqd/121:57:311
2154599108,1cyclictest25-21ksoftirqd/123:51:151
2154599108,1cyclictest25-21ksoftirqd/122:49:461
2154599108,1cyclictest25-21ksoftirqd/122:30:221
2154599108,1cyclictest25-21ksoftirqd/122:28:401
2154599103,5cyclictest15975-21bash23:00:471
2154599103,3cyclictest18123-21sshd21:42:031
2154599102,5cyclictest19531-21bash23:42:551
2154599101,5cyclictest12278-21sshd21:24:271
2154599101,2cyclictest15731-21id23:20:201
2154599100,10cyclictest0-21swapper/121:02:181
2154599100,10cyclictest0-21swapper/121:02:181
2153699109,1cyclictest9-21ksoftirqd/023:48:530
2153699109,1cyclictest9-21ksoftirqd/021:05:320
2153699108,1cyclictest9-21ksoftirqd/023:38:450
2153699108,1cyclictest9-21ksoftirqd/023:35:260
2153699108,1cyclictest9-21ksoftirqd/021:29:100
2153699107,1cyclictest9-21ksoftirqd/021:00:350
2153699107,1cyclictest9-21ksoftirqd/021:00:350
190432107,1sleep341-21ksoftirqd/321:53:333
3695290,2sleep12154599cyclictest21:09:331
215799994,5cyclictest0-21swapper/719:03:577
215729997,1cyclictest65-21ksoftirqd/600:15:416
215729993,6cyclictest0-21swapper/623:09:216
215729993,2cyclictest3976-21id22:14:506
215729992,6cyclictest9235-21sshd22:40:236
215729992,6cyclictest16384-21sshd21:13:376
215729992,4cyclictest6129-21grepconf.sh22:23:426
215729992,3cyclictest30372-21sshd22:19:576
215729991,3cyclictest0-21swapper/621:32:376
215639998,1cyclictest49-21ksoftirqd/420:23:524
215639998,1cyclictest49-21ksoftirqd/420:18:404
215639998,1cyclictest49-21ksoftirqd/419:13:404
215639997,1cyclictest49-21ksoftirqd/420:53:404
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional