You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 02:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sun Dec 07, 2025 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
262321526048,8sleep40-21swapper/403:22:284
262312025840,15sleep60-21swapper/603:21:106
262314025545,7sleep50-21swapper/503:21:255
262356499480,46cyclictest3201959-21latency_hist08:07:337
262296324815,29sleep70-21swapper/703:19:027
262356499440,42cyclictest2929757-21latency_hist05:52:337
2623559994139,2cyclictest3273776-21kworker/u16:5+events_unbound08:48:045
2623564994032,7cyclictest2818751-21latency_hist04:57:337
2623554994037,2cyclictest3130340-21kworker/u16:2+flush-8:008:32:484
2623559993936,2cyclictest2758112-21kworker/u16:1+flush-8:004:37:345
2623559993836,2cyclictest3130340-21kworker/u16:2+events_unbound08:00:195
2623554993836,2cyclictest3130340-21kworker/u16:2+flush-8:007:55:284
2623554993735,2cyclictest2758112-21kworker/u16:1+events_unbound05:31:164
2623554993735,2cyclictest2758112-21kworker/u16:1+events_unbound05:21:454
2623554993734,2cyclictest2959976-21kworker/u16:4+flush-8:006:38:004
2623554993734,2cyclictest2959976-21kworker/u16:4+flush-8:006:38:004
2623559993634,2cyclictest2677638-21kworker/u16:1+flush-8:003:46:185
2623559993634,2cyclictest2633273-21kworker/u16:0+flush-8:003:34:175
2623554993634,2cyclictest2959976-21kworker/u16:4+events_unbound07:35:184
2623554993634,2cyclictest2613093-21kworker/u16:2+events_unbound03:24:594
2623559993533,2cyclictest2613093-21kworker/u16:2+events_unbound03:48:445
2623559993532,2cyclictest3202142-21kworker/u16:4+flush-8:008:37:445
2623554993533,2cyclictest3132374-21kworker/u16:3+events_unbound07:38:004
2623554993533,2cyclictest2798389-21kworker/u16:0+events_unbound05:10:084
2623564993429,4cyclictest589235-21systemd-journal06:04:167
2623559993432,2cyclictest2959976-21kworker/u16:4+events_unbound07:32:205
2623554993432,2cyclictest3202142-21kworker/u16:4+flush-8:008:22:154
2623554993432,2cyclictest3182167-21kworker/u16:1+events_unbound08:04:194
2623554993432,2cyclictest2633273-21kworker/u16:0+events_unbound03:30:204
2623559993331,2cyclictest3201271-21kworker/u16:0+events_unbound08:14:485
2623559993331,2cyclictest2909385-21kworker/u16:2+flush-8:006:30:355
2623559993331,2cyclictest2778338-21kworker/u16:2+events_unbound04:40:335
2623554993331,2cyclictest2929514-21kworker/u16:0+flush-8:006:07:594
2623554993331,2cyclictest2929514-21kworker/u16:0+events_unbound06:13:314
2623554993331,2cyclictest2758112-21kworker/u16:1+events_unbound04:39:524
2623554993331,2cyclictest2677638-21kworker/u16:1+events_unbound03:49:564
2623554993331,2cyclictest2633488-21kworker/u16:4+flush-8:004:04:444
2623554993331,2cyclictest2633488-21kworker/u16:4+events_unbound04:26:094
2623554993331,2cyclictest2633488-21kworker/u16:4+events_unbound04:16:134
2623564993225,6cyclictest589235-21systemd-journal05:25:007
2623561993230,2cyclictest2677638-21kworker/u16:1+flush-8:004:12:336
2623559993230,2cyclictest3232220-21kworker/u16:0+events_unbound08:23:245
2623559993230,2cyclictest3130340-21kworker/u16:2+events_unbound07:45:185
2623559993230,2cyclictest2909385-21kworker/u16:2+events_unbound06:16:365
2623559993230,2cyclictest2888500-21kworker/u16:3+events_unbound05:57:355
2623559993129,2cyclictest3202142-21kworker/u16:4+events_unbound08:34:215
2623559993129,2cyclictest3130340-21kworker/u16:2+events_unbound07:55:165
2623559993129,2cyclictest2929514-21kworker/u16:0+events_unbound05:53:565
2623559993129,2cyclictest2909385-21kworker/u16:2+events_unbound06:45:495
2623559993129,2cyclictest2909385-21kworker/u16:2+events_unbound05:39:365
2623559993128,2cyclictest3070887-21kworker/u16:3+events_unbound07:02:365
2623554993129,2cyclictest3201271-21kworker/u16:0+flush-8:008:08:204
2623554993129,2cyclictest3201271-21kworker/u16:0+flush-8:008:08:204
2623554993129,2cyclictest3130340-21kworker/u16:2+events_unbound08:31:314
2623554993129,2cyclictest2888500-21kworker/u16:3+events_unbound05:49:364
2623554993129,2cyclictest2758112-21kworker/u16:1+events_unbound05:27:254
2623564993024,5cyclictest589235-21systemd-journal04:06:167
2623559993028,2cyclictest2929514-21kworker/u16:0+events_unbound06:37:135
2623559993028,2cyclictest2929514-21kworker/u16:0+events_unbound06:21:455
2623559993028,2cyclictest2888500-21kworker/u16:3+flush-8:005:35:405
2623559993028,2cyclictest2758112-21kworker/u16:1+events_unbound05:06:445
2623559993028,2cyclictest2633273-21kworker/u16:0+flush-8:003:25:135
2623559993027,2cyclictest2613093-21kworker/u16:2+flush-8:004:07:445
2623554993028,2cyclictest2929514-21kworker/u16:0+flush-8:006:43:314
2623554993028,2cyclictest2909385-21kworker/u16:2+events_unbound07:15:164
2623554993028,2cyclictest2758112-21kworker/u16:1+events_unbound05:02:134
2623554993028,2cyclictest2758112-21kworker/u16:1+events_unbound04:51:244
2623554993028,2cyclictest2633273-21kworker/u16:0+events_unbound03:36:094
2623559992927,2cyclictest3132374-21kworker/u16:3+events_unbound07:48:335
2623559992927,2cyclictest3130340-21kworker/u16:2+events_unbound08:32:165
2623559992927,2cyclictest2959976-21kworker/u16:4+events_unbound07:25:205
2623559992927,2cyclictest2959976-21kworker/u16:4+events_unbound07:25:205
2623559992927,2cyclictest2959976-21kworker/u16:4+events_unbound06:11:245
2623559992927,2cyclictest2929514-21kworker/u16:0+events_unbound07:21:455
2623559992927,2cyclictest2888500-21kworker/u16:3+events_unbound05:46:325
2623559992927,2cyclictest2838977-21kworker/u16:4+flush-8:005:08:235
2623559992927,2cyclictest2758112-21kworker/u16:1+events_unbound05:52:115
2623554992927,2cyclictest3262766-21kworker/u16:1+events_unbound08:40:384
2623554992927,2cyclictest2929514-21kworker/u16:0+events_unbound07:22:344
2623554992927,2cyclictest2929514-21kworker/u16:0+events_unbound07:22:344
2623554992927,2cyclictest2929514-21kworker/u16:0+events_unbound06:32:244
2623561992824,3cyclictest3130340-21kworker/u16:2+flush-8:007:32:596
2623559992826,2cyclictest3201271-21kworker/u16:0+flush-8:008:09:445
2623559992826,2cyclictest3201271-21kworker/u16:0+flush-8:008:09:445
2623559992826,2cyclictest2909385-21kworker/u16:2+events_unbound07:09:525
2623559992826,2cyclictest2909385-21kworker/u16:2+events_unbound06:49:405
2623559992826,2cyclictest2798389-21kworker/u16:0+events_unbound05:17:005
2623559992826,2cyclictest2778338-21kworker/u16:2+events_unbound04:58:535
2623559992826,2cyclictest2778338-21kworker/u16:2+events_unbound04:57:205
2623559992826,2cyclictest2647615-21kworker/u16:3+events_unbound03:38:365
2623559992826,2cyclictest2633488-21kworker/u16:4+flush-8:004:25:485
2623559992826,2cyclictest2633488-21kworker/u16:4+events_unbound04:14:045
2623554992826,2cyclictest3202142-21kworker/u16:4+events_unbound08:26:034
2623554992826,2cyclictest3130340-21kworker/u16:2+flush-8:008:48:004
2623554992826,2cyclictest2929514-21kworker/u16:0+flush-8:006:33:314
2623554992826,2cyclictest2798389-21kworker/u16:0+events_unbound05:38:404
2623554992826,2cyclictest2798389-21kworker/u16:0+events_unbound05:17:214
2623554992826,2cyclictest2768245-21kworker/u16:0+events_unbound04:34:204
2623554992826,2cyclictest2677638-21kworker/u16:1+events_unbound03:46:044
2623559992725,2cyclictest3132374-21kworker/u16:3+events_unbound07:41:475
2623559992725,2cyclictest3130340-21kworker/u16:2+events_unbound07:34:525
2623559992725,2cyclictest2959976-21kworker/u16:4+events_unbound06:40:355
2623559992725,2cyclictest2959976-21kworker/u16:4+events_unbound06:40:355
2623559992725,2cyclictest2909385-21kworker/u16:2+events_unbound07:02:205
2623559992725,2cyclictest2798389-21kworker/u16:0+events_unbound05:21:165
2623559992725,2cyclictest2758112-21kworker/u16:1+events_unbound06:03:565
2623559992725,2cyclictest2758112-21kworker/u16:1+events_unbound05:26:365
2623559992725,2cyclictest2748044-21kworker/u16:2+events_unbound04:30:105
2623559992725,2cyclictest2633488-21kworker/u16:4+events_unbound03:54:125
2623554992725,2cyclictest3202142-21kworker/u16:4+events_unbound08:15:334
2623554992725,2cyclictest3182167-21kworker/u16:1+events_unbound07:59:424
2623554992725,2cyclictest3130340-21kworker/u16:2+events_unbound07:44:174
2623554992725,2cyclictest2888500-21kworker/u16:3+events_unbound05:55:084
2623554992725,2cyclictest2758112-21kworker/u16:1+events_unbound04:30:534
2623554992725,2cyclictest2633488-21kworker/u16:4+events_unbound04:44:184
2623554992725,2cyclictest2613093-21kworker/u16:2+flush-8:003:42:124
2623554992725,2cyclictest2613093-21kworker/u16:2+events_unbound03:57:204
2623554992724,2cyclictest3232220-21kworker/u16:0+events_unbound08:42:374
2623554992723,2cyclictest2909385-21kworker/u16:2+flush-8:007:11:434
2623564992624,1cyclictest0-21swapper/707:52:497
262356499260,24cyclictest2980125-21latency_hist06:17:347
2623559992624,2cyclictest3130340-21kworker/u16:2+events_unbound08:03:425
2623559992624,2cyclictest3100875-21kworker/u16:1+flush-8:007:17:335
2623559992624,2cyclictest2758112-21kworker/u16:1+flush-8:004:52:215
2623559992624,2cyclictest2613093-21kworker/u16:2+flush-8:003:29:335
2623559992623,2cyclictest3273776-21kworker/u16:5+flush-8:008:42:545
2623554992624,2cyclictest3000244-21kworker/u16:1+events_unbound07:00:354
2623554992624,2cyclictest2929514-21kworker/u16:0+flush-8:007:05:284
2623554992624,2cyclictest2929514-21kworker/u16:0+flush-8:005:58:444
2623564992520,4cyclictest589235-21systemd-journal05:02:167
2623564992520,4cyclictest3000269-21latency_hist06:27:337
2623559992523,2cyclictest3182167-21kworker/u16:1+events_unbound08:18:395
2623559992523,2cyclictest2758112-21kworker/u16:1+flush-8:005:29:435
2623559992523,2cyclictest2633488-21kworker/u16:4+events_unbound04:44:165
2623559992523,2cyclictest2613093-21kworker/u16:2+events_unbound04:03:455
2623554992523,2cyclictest2959976-21kworker/u16:4+flush-8:007:31:284
2623554992523,2cyclictest2959976-21kworker/u16:4+flush-8:007:19:174
2623554992523,2cyclictest2929514-21kworker/u16:0+events_unbound06:21:414
2623554992523,2cyclictest2909385-21kworker/u16:2+flush-8:005:45:364
2623554992523,2cyclictest2798389-21kworker/u16:0+events_unbound05:06:134
2623554992523,2cyclictest2633488-21kworker/u16:4+flush-8:004:20:364
2623559992422,2cyclictest2929514-21kworker/u16:0+flush-8:006:23:085
2623559992422,2cyclictest2929514-21kworker/u16:0+events_unbound06:56:325
2623559992422,2cyclictest2748044-21kworker/u16:2+flush-8:004:20:535
2623554992422,2cyclictest3130340-21kworker/u16:2+events_unbound07:48:164
2623554992422,2cyclictest2929514-21kworker/u16:0+events_unbound06:54:004
2623554992422,2cyclictest2798389-21kworker/u16:0+flush-8:004:53:434
2623554992422,2cyclictest2758112-21kworker/u16:1+events_unbound05:35:184
2623554992422,2cyclictest2633488-21kworker/u16:4+events_unbound04:02:344
2623561992321,2cyclictest2798389-21kworker/u16:0+flush-8:005:12:526
2623561992320,2cyclictest2798389-21kworker/u16:0+flush-8:005:33:026
2623559992321,2cyclictest2613093-21kworker/u16:2+events_unbound03:59:235
2623554992321,2cyclictest2888500-21kworker/u16:3+events_unbound06:07:084
2623554992321,2cyclictest2633488-21kworker/u16:4+events_unbound04:09:354
2623554992319,3cyclictest2929514-21kworker/u16:0+events_unbound06:47:564
2623564992217,4cyclictest589235-21systemd-journal07:23:177
2623564992217,4cyclictest589235-21systemd-journal07:23:177
2623564992217,4cyclictest2798550-21latency_hist04:47:347
31863392210,1sleep60-21swapper/607:57:526
2623564992116,4cyclictest3010349-21latency_hist06:32:337
2623564992014,5cyclictest2939833-21latency_hist05:57:337
2623564992012,7cyclictest2849025-21latency_hist05:12:337
2623561992018,2cyclictest2633488-21kworker/u16:4+flush-8:004:14:126
2623564991917,1cyclictest0-21swapper/703:27:497
2623564991914,4cyclictest589235-21systemd-journal06:52:287
2623564991912,6cyclictest4175659-21snmpd04:21:577
2623561991917,2cyclictest3000244-21kworker/u16:1+events_unbound07:07:486
262356499180,16cyclictest589235-21systemd-journal04:29:357
262356499180,16cyclictest2687904-21latency_hist03:52:347
2623561991816,2cyclictest2798389-21kworker/u16:0+flush-8:005:08:036
2623561991815,2cyclictest2959976-21kworker/u16:4+flush-8:006:07:476
2623561991814,3cyclictest2768245-21kworker/u16:0+flush-8:004:32:476
2623564991716,0cyclictest0-21swapper/708:08:007
2623564991716,0cyclictest0-21swapper/708:08:007
2623561991715,2cyclictest2633488-21kworker/u16:4+flush-8:004:02:496
262356499169,6cyclictest4175659-21snmpd04:42:137
2623564991614,1cyclictest0-21swapper/704:13:017
262356499160,15cyclictest3070667-21latency_hist07:02:337
2623561991613,2cyclictest0-21swapper/603:47:596
262356499157,6cyclictest589235-21systemd-journal05:32:347
262356499157,2cyclictest0-21swapper/707:57:527
2623564991512,2cyclictest0-21swapper/704:23:037
2623564991511,3cyclictest4175659-21snmpd07:36:177
2623564991510,4cyclictest589235-21systemd-journal07:32:287
2623564991510,4cyclictest3262553-21latency_hist08:37:337
2623564991510,4cyclictest3101010-21latency_hist07:17:337
262356499150,14cyclictest4175659-21snmpd04:10:277
262356499150,13cyclictest3252481-21latency_hist08:32:337
2623554991513,2cyclictest2909385-21kworker/u16:2+flush-8:006:25:524
262356499142,6cyclictest984960-21gvfsd-wsdd08:43:007
2623564991411,2cyclictest2830245-21irqcore05:02:527
2623564991411,2cyclictest0-21swapper/706:07:347
262356499140,2cyclictest3291870-21ntpq08:47:587
262356499140,13cyclictest2858161-21ntpq05:13:017
2623561991413,1cyclictest0-21swapper/607:52:296
2623561991412,2cyclictest3132374-21kworker/u16:3+flush-8:007:38:376
262356199140,13cyclictest0-21swapper/607:07:346
262356199140,13cyclictest0-21swapper/605:22:446
262356499139,3cyclictest589235-21systemd-journal07:40:257
262356499139,3cyclictest4175659-21snmpd06:54:467
262356499138,4cyclictest3090957-21latency_hist07:12:337
262356499137,5cyclictest2949909-21latency_hist06:02:337
262356499130,11cyclictest3025305-21kthreadcore06:37:557
262356499130,11cyclictest3025305-21kthreadcore06:37:557
2623561991311,2cyclictest2838977-21kworker/u16:4+events_unbound05:17:516
2623561991310,2cyclictest2647615-21kworker/u16:3+flush-8:003:38:036
262356199130,13cyclictest0-21swapper/607:13:436
262356199130,13cyclictest0-21swapper/606:57:576
262356199130,0cyclictest0-21swapper/603:52:526
262356499129,2cyclictest4175659-21snmpd08:40:067
262356499129,2cyclictest4175659-21snmpd05:43:147
262356499128,3cyclictest96-21ksoftirqd/708:23:017
262356499128,3cyclictest4175659-21snmpd07:19:077
262356499127,4cyclictest589235-21systemd-journal07:06:177
262356499126,5cyclictest27763-21gvfs-afc-volume05:18:027
262356499126,5cyclictest27174-21gnome-shell03:34:337
262356499122,4cyclictest27924-21gmain06:17:557
262356499120,11cyclictest589235-21systemd-journal04:37:287
262356499120,11cyclictest4175659-21snmpd08:16:517
262356499120,11cyclictest4175659-21snmpd05:37:147
262356199128,3cyclictest3130340-21kworker/u16:2+flush-8:008:32:506
2623561991211,1cyclictest0-21swapper/608:38:036
2623561991211,1cyclictest0-21swapper/607:54:136
2623561991211,1cyclictest0-21swapper/606:26:446
2623561991211,1cyclictest0-21swapper/603:28:176
2623561991210,2cyclictest3202142-21kworker/u16:4+events_unbound08:07:486
2623561991210,2cyclictest3202142-21kworker/u16:4+events_unbound08:07:486
2623561991210,1cyclictest2813369-21kthreadcore04:52:566
262356499118,2cyclictest4175659-21snmpd05:38:087
262356499118,2cyclictest4175659-21snmpd03:42:327
262356499117,3cyclictest4175659-21snmpd03:47:087
262356499116,4cyclictest96-21ksoftirqd/703:53:007
262356499113,7cyclictest0-21swapper/703:59:587
2623564991110,0cyclictest0-21swapper/707:42:537
262356499110,9cyclictest0-21swapper/706:32:487
262356499110,3cyclictest2801951-21kthreadcore04:47:527
262356199118,2cyclictest0-21swapper/606:27:496
262356199117,3cyclictest2959976-21kworker/u16:4+flush-8:007:22:586
262356199117,3cyclictest2959976-21kworker/u16:4+flush-8:007:22:586
2623561991110,1cyclictest0-21swapper/608:27:206
2623561991110,1cyclictest0-21swapper/606:36:306
2623561991110,1cyclictest0-21swapper/605:00:396
2623561991110,1cyclictest0-21swapper/604:32:266
2623561991110,1cyclictest0-21swapper/603:37:166
262356199110,1cyclictest0-21swapper/608:04:286
262356199110,11cyclictest0-21swapper/608:16:276
262356199110,11cyclictest0-21swapper/607:46:306
262356199110,11cyclictest0-21swapper/607:30:166
262356199110,11cyclictest0-21swapper/606:06:146
262356199110,11cyclictest0-21swapper/604:27:246
262356199110,11cyclictest0-21swapper/603:44:406
262356199110,0cyclictest0-21swapper/608:48:466
262356499107,2cyclictest4175659-21snmpd07:48:417
262356499107,2cyclictest0-21swapper/706:43:007
262356499100,9cyclictest0-21swapper/708:17:547
262356499100,9cyclictest0-21swapper/703:22:587
262356199109,1cyclictest0-21swapper/608:45:286
262356199109,1cyclictest0-21swapper/606:16:576
262356199109,1cyclictest0-21swapper/605:52:036
262356199109,1cyclictest0-21swapper/605:29:496
262356199109,1cyclictest0-21swapper/604:49:286
262356199106,3cyclictest3243576-21cat08:27:506
262356199106,3cyclictest2677638-21kworker/u16:1+flush-8:003:57:596
262356199100,0cyclictest0-21swapper/606:19:386
26235619998,1cyclictest0-21swapper/606:00:536
26235619998,1cyclictest0-21swapper/604:19:026
26235619987,1cyclictest0-21swapper/606:40:086
26235619987,1cyclictest0-21swapper/606:40:086
26235619987,1cyclictest0-21swapper/604:40:106
26235619987,1cyclictest0-21swapper/603:24:586
26235619985,2cyclictest0-21swapper/605:02:556
26235619984,3cyclictest3102183-21cat07:17:486
26235619983,4cyclictest3041403-21df06:47:456
26235619983,4cyclictest3037898-21cut06:42:546
26235619983,4cyclictest2909142-21cat05:38:036
26235619980,4cyclictest2917411-21kthreadcore05:42:566
26235619974,2cyclictest2790102-21kthreadcore04:42:536
26235619973,3cyclictest3223765-21sed08:17:516
26235619973,3cyclictest2930845-21grep05:52:486
26235619972,4cyclictest3053248-21cat06:52:526
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional