You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 14:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Fri Dec 05, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
307391925948,7sleep40-21swapper/415:19:044
307390125443,7sleep50-21swapper/515:18:495
307451599530,52cyclictest3362686-21flatpak18:55:087
307407025219,29sleep70-21swapper/715:21:087
3074511994745,2cyclictest3272201-21kworker/u16:3+flush-8:018:23:056
3074511994644,2cyclictest3433951-21kworker/u16:1+events_unbound19:45:096
307408024434,7sleep60-21swapper/615:21:156
3074511994341,2cyclictest3575171-21kworker/u16:0+flush-8:020:52:386
3074511994341,2cyclictest3088858-21kworker/u16:3+events_unbound15:35:106
3074511994340,2cyclictest3171633-21kworker/u16:3+flush-8:017:32:416
3074515994237,4cyclictest3211669-21latency_hist17:42:397
3074511994240,2cyclictest3088858-21kworker/u16:3+events_unbound16:31:096
3074511994138,2cyclictest3073084-21kworker/u16:1+events_unbound16:00:096
3074511994037,3cyclictest3073084-21kworker/u16:1+flush-8:015:53:076
3074506993836,2cyclictest2449141-21kworker/u16:7+flush-8:015:27:455
3074506993835,2cyclictest3433842-21kworker/u16:0+flush-8:019:42:395
3074511993735,2cyclictest3536099-21kworker/u16:2+events_unbound20:36:096
3074515993631,4cyclictest3292304-21latency_hist18:22:407
3074511993634,2cyclictest3536099-21kworker/u16:2+flush-8:020:31:096
3074511993634,2cyclictest3514584-21kworker/u16:1+flush-8:020:10:106
3074511993634,2cyclictest3514584-21kworker/u16:1+flush-8:020:10:106
3074511993634,2cyclictest3433951-21kworker/u16:1+events_unbound19:53:496
3074506993634,2cyclictest3332610-21kworker/u16:4+events_unbound18:55:325
3074515993530,4cyclictest3423958-21latency_hist19:27:397
3074515993530,4cyclictest3423958-21latency_hist19:27:397
3074511993533,2cyclictest3433842-21kworker/u16:0+events_unbound20:07:106
3074511993533,2cyclictest3088858-21kworker/u16:3+flush-8:015:39:536
3074511993432,2cyclictest3332610-21kworker/u16:4+flush-8:018:47:366
3074502993432,2cyclictest3291991-21kworker/u16:0+flush-8:019:17:554
3074502993431,2cyclictest3514584-21kworker/u16:1+events_unbound20:12:524
3074502993429,4cyclictest3362752-21packagekitd18:55:254
3074511993330,2cyclictest3536099-21kworker/u16:2+events_unbound20:42:486
3074511993330,2cyclictest3231621-21kworker/u16:2+events_unbound18:37:496
3074511993330,2cyclictest3231621-21kworker/u16:2+events_unbound18:37:496
3074511993230,2cyclictest3433842-21kworker/u16:0+events_unbound20:18:286
3074502993229,2cyclictest3524960-21kworker/u16:3+flush-8:020:38:094
33833382310,1chrt0-21swapper/619:05:096
3074515993125,5cyclictest589235-21systemd-journal15:57:417
3074511993129,2cyclictest3524960-21kworker/u16:3+events_unbound20:24:496
3074511993129,2cyclictest3158537-21kworker/u16:5+flush-8:017:12:336
3074511993028,2cyclictest3291991-21kworker/u16:0+flush-8:018:49:496
3074511993028,2cyclictest3211419-21kworker/u16:0+flush-8:017:40:026
3074511993027,2cyclictest3088858-21kworker/u16:3+flush-8:016:45:456
3074506993028,2cyclictest3575171-21kworker/u16:0+events_unbound20:48:015
3074506993027,2cyclictest3433842-21kworker/u16:0+events_unbound19:52:545
3074502993028,2cyclictest3544152-21kworker/u16:4+flush-8:020:32:544
3074511992927,2cyclictest3433842-21kworker/u16:0+events_unbound19:50:376
3074511992927,2cyclictest3291991-21kworker/u16:0+flush-8:019:00:146
3074511992927,2cyclictest3231621-21kworker/u16:2+flush-8:018:05:176
3074511992927,2cyclictest3190697-21kworker/u16:5+flush-8:018:09:126
3074511992927,2cyclictest3158486-21kworker/u16:1+flush-8:017:13:406
3074511992927,2cyclictest2449141-21kworker/u16:7+events_unbound15:27:386
3074511992926,2cyclictest3088858-21kworker/u16:3+flush-8:017:04:216
3074511992926,2cyclictest3088858-21kworker/u16:3+flush-8:016:15:536
3074506992927,2cyclictest3088858-21kworker/u16:3+events_unbound15:38:045
3074506992925,3cyclictest3362963-21kworker/u16:6+flush-8:019:28:045
3074502992927,2cyclictest3291991-21kworker/u16:0+events_unbound19:02:544
3074511992826,2cyclictest3433842-21kworker/u16:0+flush-8:019:58:286
3074511992826,2cyclictest3413549-21kworker/u16:3+flush-8:019:27:246
3074511992826,2cyclictest3413549-21kworker/u16:3+flush-8:019:27:246
3074511992826,2cyclictest3231621-21kworker/u16:2+flush-8:018:28:386
3074511992826,2cyclictest3190697-21kworker/u16:5+flush-8:017:55:136
3074511992826,2cyclictest3170904-21kworker/u16:2+flush-8:017:24:096
3074511992826,2cyclictest3158486-21kworker/u16:1+events_unbound18:02:116
3074511992826,2cyclictest3088858-21kworker/u16:3+flush-8:016:10:466
3074511992825,2cyclictest3090490-21kworker/u16:0+flush-8:015:43:386
3074502992825,2cyclictest3158486-21kworker/u16:1+events_unbound17:38:054
3074515992722,4cyclictest3123371-21latency_hist16:12:397
3074511992725,2cyclictest3291991-21kworker/u16:0+flush-8:018:33:166
3074511992725,2cyclictest3190697-21kworker/u16:5+events_unbound18:21:226
3074511992725,2cyclictest3171633-21kworker/u16:3+events_unbound17:30:226
3074511992725,2cyclictest3112639-21kworker/u16:4+events_unbound16:23:106
3074515992621,4cyclictest3148022-21latency_hist16:52:407
3074511992624,2cyclictest3383250-21kworker/u16:3+events_unbound19:11:536
3074511992623,2cyclictest3088858-21kworker/u16:3+flush-8:016:57:546
3074506992624,2cyclictest3272201-21kworker/u16:3+flush-8:018:17:545
3074506992623,2cyclictest3073084-21kworker/u16:1+flush-8:016:02:405
3074502992624,2cyclictest2449141-21kworker/u16:7+flush-8:015:29:094
3074502992623,3cyclictest3144151-21kworker/u16:4+flush-8:016:38:054
3074502992622,3cyclictest3190697-21kworker/u16:5+flush-8:017:43:064
3074515992520,4cyclictest3555178-21latency_hist20:32:397
3074511992523,2cyclictest3433951-21kworker/u16:1+flush-8:019:35:306
3074511992523,2cyclictest3433842-21kworker/u16:0+events_unbound20:17:376
3074511992523,2cyclictest3211419-21kworker/u16:0+events_unbound17:46:536
3074511992523,2cyclictest3148065-21kworker/u16:0+events_unbound16:54:506
3074502992523,2cyclictest3171633-21kworker/u16:3+flush-8:017:33:024
3074511992422,2cyclictest3362713-21kworker/u16:5+events_unbound18:55:406
3074511992422,2cyclictest3158486-21kworker/u16:1+events_unbound18:17:226
3074511992421,2cyclictest3158537-21kworker/u16:5+events_unbound17:20:106
3074511992421,2cyclictest3088858-21kworker/u16:3+events_unbound16:35:296
3074511992421,2cyclictest3073084-21kworker/u16:1+events_unbound16:21:136
3074506992422,2cyclictest3161887-21kworker/u16:0+events_unbound17:23:025
3074502992421,2cyclictest3291991-21kworker/u16:0+flush-8:018:43:054
3074511992321,2cyclictest3403765-21kworker/u16:2+events_unbound19:22:216
3074511992321,2cyclictest3088858-21kworker/u16:3+events_unbound15:29:026
3074511992320,2cyclictest3088858-21kworker/u16:3+events_unbound16:03:346
3074506992320,2cyclictest3073084-21kworker/u16:1+flush-8:016:23:055
3074502992321,2cyclictest3190697-21kworker/u16:5+flush-8:018:08:044
3074515992217,4cyclictest3171234-21latency_hist17:22:407
3074515992216,5cyclictest3113296-21latency_hist16:07:407
3074511992220,2cyclictest3211419-21kworker/u16:0+events_unbound17:51:226
3074511992220,2cyclictest3100937-21kworker/u16:2+events_unbound15:49:146
3074515992116,4cyclictest3352798-21latency_hist18:52:397
3074511992119,2cyclictest3524960-21kworker/u16:3+events_unbound20:41:536
3074506992119,2cyclictest3433951-21kworker/u16:1+flush-8:019:33:045
3074506992119,2cyclictest3158486-21kworker/u16:1+events_unbound17:53:045
3074502992119,2cyclictest3088858-21kworker/u16:3+events_unbound16:08:054
3074511992018,2cyclictest3433842-21kworker/u16:0+events_unbound19:39:136
3074506992018,2cyclictest3433951-21kworker/u16:1+flush-8:019:43:035
3074506992018,2cyclictest3291991-21kworker/u16:0+flush-8:018:43:085
3074506992017,2cyclictest3536099-21kworker/u16:2+flush-8:020:33:035
3074506992017,2cyclictest3171633-21kworker/u16:3+flush-8:017:38:075
3074511991916,2cyclictest3144151-21kworker/u16:4+events_unbound16:48:466
3074506991917,2cyclictest3433951-21kworker/u16:1+events_unbound19:48:035
3074506991916,2cyclictest3291991-21kworker/u16:0+flush-8:019:18:055
3074502991917,2cyclictest3190697-21kworker/u16:5+flush-8:018:12:584
3074502991915,3cyclictest3433951-21kworker/u16:1+flush-8:019:48:014
3074515991813,4cyclictest3373408-21latency_hist19:02:397
3074511991816,2cyclictest3088858-21kworker/u16:3+flush-8:016:37:546
3074502991816,2cyclictest3524960-21kworker/u16:3+events_unbound20:47:514
3074506991715,2cyclictest3433842-21kworker/u16:0+flush-8:020:18:135
3074502991713,3cyclictest3088858-21kworker/u16:3+flush-8:015:42:394
307451599165,9cyclictest0-21swapper/716:22:597
3074511991614,2cyclictest3413549-21kworker/u16:3+flush-8:019:32:186
3074506991614,2cyclictest3362713-21kworker/u16:5+events_unbound19:03:045
307451599157,7cyclictest589235-21systemd-journal16:17:407
3074515991512,2cyclictest0-21swapper/717:42:397
3074515991512,2cyclictest0-21swapper/716:12:397
3074515991510,4cyclictest3413856-21latency_hist19:22:397
307451599150,2cyclictest3074499-21cyclictest19:28:057
307451599150,14cyclictest0-21swapper/720:38:067
3074511991513,2cyclictest3362963-21kworker/u16:6+flush-8:019:15:156
307450699150,15cyclictest0-21swapper/518:02:575
307451599147,6cyclictest27642-21gmain20:12:567
307451599146,7cyclictest589235-21systemd-journal19:52:087
3074515991411,2cyclictest4175659-21snmpd17:00:097
307451599140,1cyclictest0-21swapper/719:33:037
307451599140,13cyclictest0-21swapper/717:08:017
307451599140,12cyclictest3292697-21/usr/sbin/munin18:23:067
307450699140,8cyclictest0-21swapper/517:42:565
307450699140,13cyclictest0-21swapper/519:12:495
3074502991411,2cyclictest3433842-21kworker/u16:0+flush-8:020:08:054
3074502991411,2cyclictest3433842-21kworker/u16:0+flush-8:020:08:054
307451599135,7cyclictest3312805-21latency_hist18:32:397
307451599135,7cyclictest0-21swapper/717:27:457
307451599131,11cyclictest27642-21gmain19:41:087
3074515991310,2cyclictest4175659-21snmpd17:05:337
3074515991310,2cyclictest27944-21gnome-software15:29:097
307451599130,8cyclictest4175659-21snmpd19:08:007
307450699139,3cyclictest3269816-21kthreadcore18:08:015
3074506991311,2cyclictest3231621-21kworker/u16:2+flush-8:018:02:395
307450699130,1cyclictest0-21swapper/517:50:505
307450699130,12cyclictest0-21swapper/516:46:125
307450699130,0cyclictest0-21swapper/520:28:015
307450699130,0cyclictest0-21swapper/515:48:115
3074502991311,2cyclictest3433842-21kworker/u16:0+events_unbound20:03:084
3074502991311,2cyclictest3190697-21kworker/u16:5+flush-8:018:02:544
307451599129,2cyclictest4175659-21snmpd19:55:147
307451599129,2cyclictest4175659-21snmpd16:28:537
307451599129,2cyclictest4175659-21snmpd15:44:137
307451599128,3cyclictest948-21NetworkManager19:16:067
307451599128,3cyclictest4175659-21snmpd15:40:077
307451599128,3cyclictest27204-21gmain18:33:087
307451599127,4cyclictest984960-21gvfsd-wsdd17:52:597
307451599125,6cyclictest0-21swapper/717:22:407
307451599125,6cyclictest0-21swapper/716:38:097
307451599125,2cyclictest0-21swapper/718:38:057
307451599125,2cyclictest0-21swapper/718:38:057
307451599123,8cyclictest948-21NetworkManager16:53:107
307451599123,8cyclictest27394-21gmain18:13:007
307451599123,7cyclictest26931-21Xorg20:04:387
307451599122,4cyclictest3494843-21sed20:02:397
307450699126,6cyclictest0-21swapper/519:22:535
307450699126,6cyclictest0-21swapper/519:22:535
3074506991211,1cyclictest0-21swapper/520:10:405
3074506991211,1cyclictest0-21swapper/520:10:405
3074506991211,1cyclictest0-21swapper/519:01:185
3074506991210,2cyclictest3433842-21kworker/u16:0+flush-8:020:17:395
3074506991210,2cyclictest3170904-21kworker/u16:2+events_unbound17:27:535
307450699120,1cyclictest0-21swapper/517:21:595
307450699120,12cyclictest0-21swapper/516:04:455
307450699120,11cyclictest0-21swapper/517:15:225
307450699120,11cyclictest0-21swapper/516:48:445
3074502991211,1cyclictest0-21swapper/417:50:414
3074502991210,2cyclictest3362963-21kworker/u16:6+flush-8:019:28:034
307450299120,1cyclictest0-21swapper/418:48:134
307450299120,11cyclictest0-21swapper/416:30:084
307450299120,11cyclictest0-21swapper/416:17:504
307450299120,0cyclictest0-21swapper/417:23:444
307451599118,2cyclictest4175659-21snmpd16:33:057
307451599118,2cyclictest3333040-21/usr/sbin/munin18:43:037
307451599118,2cyclictest0-21swapper/719:03:047
307451599118,2cyclictest0-21swapper/717:58:047
307451599117,3cyclictest4175659-21snmpd17:50:377
307451599116,4cyclictest96-21ksoftirqd/720:47:597
307451599116,4cyclictest27763-21gvfs-afc-volume18:02:577
307451599115,5cyclictest27759-21gdbus15:48:287
307451599115,2cyclictest0-21swapper/716:47:357
307451599114,6cyclictest0-21swapper/715:36:457
307451599114,5cyclictest0-21swapper/718:08:017
307451599113,7cyclictest948-21NetworkManager20:17:567
307451599113,7cyclictest589253-21gmain20:45:477
307451599113,7cyclictest3078366-21tr15:22:567
307451599113,6cyclictest3106478-21cut15:52:577
307451599111,9cyclictest948-21NetworkManager19:42:557
307451599110,1cyclictest0-21swapper/720:08:007
307451599110,1cyclictest0-21swapper/720:08:007
307450699119,2cyclictest3171633-21kworker/u16:3+events_unbound17:32:545
307450699119,2cyclictest3148065-21kworker/u16:0+events_unbound16:52:535
307450699119,2cyclictest3088858-21kworker/u16:3+flush-8:016:07:505
3074506991110,1cyclictest0-21swapper/520:40:285
3074506991110,1cyclictest0-21swapper/519:08:435
3074506991110,1cyclictest0-21swapper/518:34:115
3074506991110,1cyclictest0-21swapper/517:06:135
3074506991110,1cyclictest0-21swapper/516:40:225
3074506991110,1cyclictest0-21swapper/515:45:405
307450699110,11cyclictest0-21swapper/520:47:055
307450699110,11cyclictest0-21swapper/519:58:225
307450299117,3cyclictest3536193-21cat20:22:554
3074502991110,1cyclictest0-21swapper/420:29:454
3074502991110,1cyclictest0-21swapper/419:16:454
3074502991110,1cyclictest0-21swapper/417:08:544
3074502991110,1cyclictest0-21swapper/417:05:364
3074502991110,1cyclictest0-21swapper/416:54:534
3074502991110,1cyclictest0-21swapper/416:26:024
3074502991110,1cyclictest0-21swapper/415:25:394
307450299110,11cyclictest0-21swapper/419:34:344
307450299110,10cyclictest0-21swapper/416:58:114
307451599107,2cyclictest4175659-21snmpd17:12:547
307451599104,5cyclictest965-21gmain20:23:527
307451599101,4cyclictest0-21swapper/720:32:577
307451599100,4cyclictest3196228-21kthreadcore17:32:577
307450699109,1cyclictest0-21swapper/520:23:555
307450699109,1cyclictest0-21swapper/517:08:455
307450699109,1cyclictest0-21swapper/515:25:295
307450699107,2cyclictest3088858-21kworker/u16:3+flush-8:016:13:445
307450699106,3cyclictest3303541-21cat18:27:535
307450299109,1cyclictest0-21swapper/419:11:524
307450299109,1cyclictest0-21swapper/418:27:064
307450299109,1cyclictest0-21swapper/417:31:084
307450299109,1cyclictest0-21swapper/416:48:154
307450299109,1cyclictest0-21swapper/415:51:304
307450299105,4cyclictest3323748-21cat18:37:554
307450299105,4cyclictest3323748-21cat18:37:554
307450299100,10cyclictest0-21swapper/418:21:254
30745069998,1cyclictest0-21swapper/518:26:005
30745069998,1cyclictest0-21swapper/516:20:305
30745069998,1cyclictest0-21swapper/515:54:015
30745069996,2cyclictest0-21swapper/518:38:005
30745069996,2cyclictest0-21swapper/518:38:005
30745029998,1cyclictest0-21swapper/420:43:474
30745029998,1cyclictest0-21swapper/419:02:064
30745029998,1cyclictest0-21swapper/416:13:444
30745029998,1cyclictest0-21swapper/415:44:534
30745029997,1cyclictest0-21swapper/419:42:594
30745029995,3cyclictest3433842-21kworker/u16:0+flush-8:019:53:024
30745029994,4cyclictest3313083-21tr18:32:514
30745029990,8cyclictest3445365-21iostat19:37:544
30745029990,6cyclictest3525379-21cpuspeed20:17:534
30745069987,1cyclictest0-21swapper/520:06:345
30745069987,1cyclictest0-21swapper/518:49:485
30745069987,1cyclictest0-21swapper/516:59:365
30745029987,1cyclictest0-21swapper/417:19:384
30745029987,1cyclictest0-21swapper/415:58:074
30745029986,1cyclictest0-21swapper/415:37:394
30745029984,3cyclictest0-21swapper/418:27:554
30745029984,2cyclictest0-21swapper/417:57:514
30745029983,4cyclictest3417319-21grep19:22:564
30745029983,4cyclictest3417319-21grep19:22:564
30745029983,4cyclictest3103701-21cut15:52:554
30745029982,5cyclictest3232328-21cat17:52:514
30745069976,1cyclictest0-21swapper/516:32:585
30745069976,1cyclictest0-21swapper/516:29:395
30745069970,6cyclictest3274390-21cut18:13:005
30745029976,1cyclictest0-21swapper/417:16:194
30745029973,3cyclictest3487600-21kthreadcore19:57:584
30745069960,1cyclictest0-21swapper/515:34:185
30745029965,1cyclictest0-21swapper/416:44:574
30745029960,5cyclictest0-21swapper/416:32:574
30745029950,4cyclictest3112936-21chrt16:02:544
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional