You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 19:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Thu Mar 19, 2026 12:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
37793192970,1sleep73779320-21sh09:21:327
349810825645,7sleep50-21swapper/507:01:015
349810825645,7sleep50-21swapper/507:01:015
349809124939,7sleep60-21swapper/607:00:466
349809124939,7sleep60-21swapper/607:00:466
3498568994745,2cyclictest4170275-21kworker/u16:2+events_unbound12:18:145
3498568994745,2cyclictest4170275-21kworker/u16:2+events_unbound12:18:145
3498571994543,2cyclictest3703191-21kworker/u16:4+flush-8:010:38:316
3498573994338,4cyclictest3559600-21latency_hist07:33:317
349812524333,7sleep40-21swapper/407:01:164
349812524333,7sleep40-21swapper/407:01:164
3498568994240,2cyclictest3722229-21kworker/u16:1+events_unbound09:03:555
3498568994139,2cyclictest4138847-21kworker/u16:1+events_unbound11:56:025
3498566994139,2cyclictest4097235-21kworker/u16:0+flush-8:011:44:144
34980162415,31sleep70-21swapper/706:59:437
34980162415,31sleep70-21swapper/706:59:437
3498568994038,2cyclictest4072624-21kworker/u16:2+events_unbound11:48:325
3498568994038,2cyclictest3853580-21kworker/u16:1+events_unbound10:08:215
3498566994038,2cyclictest3975372-21kworker/u16:1+events_unbound10:54:324
3498566994038,2cyclictest3975372-21kworker/u16:1+events_unbound10:54:324
3498566993937,2cyclictest3703191-21kworker/u16:4+events_unbound10:30:304
3498573993835,2cyclictest3578847-21latency_hist07:43:317
3498568993836,2cyclictest4072624-21kworker/u16:2+events_unbound11:35:345
3498568993836,2cyclictest4072624-21kworker/u16:2+events_unbound11:35:345
3498568993836,2cyclictest3999744-21kworker/u16:0+events_unbound11:01:425
3498568993836,2cyclictest3975374-21kworker/u16:3+events_unbound10:53:105
3498568993836,2cyclictest3804483-21kworker/u16:0+events_unbound10:15:035
3498568993836,2cyclictest3804483-21kworker/u16:0+events_unbound10:15:035
3498568993836,2cyclictest3722229-21kworker/u16:1+events_unbound09:13:345
3498566993836,2cyclictest3722229-21kworker/u16:1+flush-8:009:03:584
3498573993736,0cyclictest0-21swapper/710:28:507
3498568993735,2cyclictest4097235-21kworker/u16:0+events_unbound12:25:485
3498568993735,2cyclictest3703191-21kworker/u16:4+events_unbound10:32:255
3498568993735,2cyclictest3703191-21kworker/u16:4+events_unbound09:53:145
3498566993735,2cyclictest3975374-21kworker/u16:3+events_unbound11:29:414
3498566993735,2cyclictest3804483-21kworker/u16:0+events_unbound10:04:404
3498568993634,2cyclictest3975372-21kworker/u16:1+events_unbound10:54:555
3498568993634,2cyclictest3975372-21kworker/u16:1+events_unbound10:54:555
3498568993634,2cyclictest3804483-21kworker/u16:0+events_unbound09:40:345
3498568993634,2cyclictest3703191-21kworker/u16:4+events_unbound09:34:055
3498568993634,2cyclictest3703191-21kworker/u16:4+events_unbound09:34:055
3498566993634,2cyclictest3975374-21kworker/u16:3+events_unbound11:38:184
3498566993634,2cyclictest3975374-21kworker/u16:3+events_unbound11:38:184
3498566993634,2cyclictest3804483-21kworker/u16:0+events_unbound10:36:574
3498566993634,2cyclictest3722229-21kworker/u16:1+events_unbound09:12:064
3498571993532,2cyclictest3636264-21kworker/u16:0+flush-8:009:03:306
3498568993533,2cyclictest3999744-21kworker/u16:0+events_unbound11:04:105
3498568993533,2cyclictest3975374-21kworker/u16:3+events_unbound11:19:455
3498568993533,2cyclictest3975374-21kworker/u16:3+events_unbound10:46:165
3498566993533,2cyclictest4138847-21kworker/u16:1+events_unbound12:25:464
3498566993533,2cyclictest4045456-21kworker/u16:4+events_unbound11:14:464
3498566993533,2cyclictest3975374-21kworker/u16:3+events_unbound11:12:034
3498566993532,2cyclictest2784830-21kworker/u16:3+flush-8:009:29:144
349857399340,32cyclictest3987456-21ssh10:48:257
3498568993432,2cyclictest4170275-21kworker/u16:2+events_unbound12:07:495
3498568993432,2cyclictest3914472-21kworker/u16:5+events_unbound10:20:415
3498568993432,2cyclictest3853580-21kworker/u16:1+events_unbound10:11:325
3498568993432,2cyclictest3722229-21kworker/u16:1+events_unbound09:26:535
3498568993432,2cyclictest3549727-21kworker/u16:1+events_unbound07:53:185
3498568993432,2cyclictest3470110-21kworker/u16:2+events_unbound07:18:275
3498566993432,2cyclictest3722229-21kworker/u16:1+events_unbound09:15:544
3498566993432,2cyclictest3703191-21kworker/u16:4+events_unbound10:13:224
3498566993432,2cyclictest3549727-21kworker/u16:1+flush-8:007:48:534
3498566993432,2cyclictest3549727-21kworker/u16:1+flush-8:007:43:264
3498566993431,2cyclictest3703191-21kworker/u16:4+events_unbound10:23:394
3498566993431,2cyclictest3569371-21kworker/u16:2+flush-8:008:33:314
3498573993328,4cyclictest650-21systemd-journal07:38:307
3498568993331,2cyclictest4097235-21kworker/u16:0+events_unbound12:30:335
3498568993331,2cyclictest3975374-21kworker/u16:3+events_unbound11:15:325
3498568993331,2cyclictest3975374-21kworker/u16:3+events_unbound11:10:205
3498568993331,2cyclictest3703191-21kworker/u16:4+events_unbound10:43:275
3498568993331,2cyclictest3636264-21kworker/u16:0+events_unbound08:54:345
3498568993331,2cyclictest2784830-21kworker/u16:3+events_unbound09:29:415
3498566993331,2cyclictest4170275-21kworker/u16:2+events_unbound12:15:384
3498566993331,2cyclictest4170275-21kworker/u16:2+events_unbound12:15:384
3498566993331,2cyclictest3804483-21kworker/u16:0+events_unbound10:00:304
3498573993231,0cyclictest0-21swapper/711:33:517
3498573993231,0cyclictest0-21swapper/711:33:517
3498573993231,0cyclictest0-21swapper/709:43:517
3498571993230,2cyclictest4138847-21kworker/u16:1+events_unbound11:53:496
3498571993230,2cyclictest3975374-21kworker/u16:3+events_unbound11:03:496
3498571993230,2cyclictest2784830-21kworker/u16:3+flush-8:008:33:266
3498568993230,2cyclictest4072624-21kworker/u16:2+events_unbound11:45:035
3498568993230,2cyclictest3703191-21kworker/u16:4+events_unbound10:36:435
3498568993230,2cyclictest3703191-21kworker/u16:4+events_unbound09:58:095
3498566993231,1cyclictest3975374-21kworker/u16:3+events_unbound11:27:394
3498566993230,2cyclictest4170275-21kworker/u16:2+events_unbound12:20:494
3498566993230,2cyclictest3768375-21kworker/u16:0+events_unbound09:23:304
3498566993229,2cyclictest3804483-21kworker/u16:0+events_unbound09:33:324
3498566993229,2cyclictest3804483-21kworker/u16:0+events_unbound09:33:324
3498573993130,0cyclictest0-21swapper/710:53:577
3498573993130,0cyclictest0-21swapper/710:53:577
3498571993129,2cyclictest2784830-21kworker/u16:3+flush-8:009:08:266
3498568993129,2cyclictest4170275-21kworker/u16:2+events_unbound12:12:565
3498568993129,2cyclictest3975374-21kworker/u16:3+events_unbound11:42:275
3498568993129,2cyclictest3975374-21kworker/u16:3+events_unbound11:32:275
3498568993129,2cyclictest3914472-21kworker/u16:5+events_unbound10:26:595
3498568993129,2cyclictest3722229-21kworker/u16:1+events_unbound09:10:035
3498568993129,2cyclictest3569371-21kworker/u16:2+flush-8:008:04:005
3498568993129,2cyclictest2784830-21kworker/u16:3+events_unbound09:46:005
3498566993129,2cyclictest4138847-21kworker/u16:1+events_unbound12:02:424
3498566993129,2cyclictest3703191-21kworker/u16:4+flush-8:010:38:594
3498566993129,2cyclictest3703191-21kworker/u16:4+flush-8:009:48:314
3498573993030,0cyclictest0-21swapper/709:49:337
3498571993028,2cyclictest3530237-21kworker/u16:0+events_unbound07:33:506
3498568993028,2cyclictest3975374-21kworker/u16:3+events_unbound11:25:485
3498568993028,2cyclictest3549727-21kworker/u16:1+events_unbound07:41:355
3498568993028,2cyclictest2784830-21kworker/u16:3+events_unbound08:15:395
3498566993028,2cyclictest3975374-21kworker/u16:3+events_unbound10:49:414
3498566993028,2cyclictest3914472-21kworker/u16:5+events_unbound10:20:184
3498566993028,2cyclictest3722229-21kworker/u16:1+events_unbound09:24:584
3498566993028,2cyclictest3703191-21kworker/u16:4+flush-8:009:54:324
3498566993027,2cyclictest4170275-21kworker/u16:2+events_unbound12:11:014
3498571992926,2cyclictest4138847-21kworker/u16:1+events_unbound12:13:376
3498571992926,2cyclictest4138847-21kworker/u16:1+events_unbound12:13:376
3498568992927,2cyclictest3804483-21kworker/u16:0+events_unbound09:59:255
3498568992927,2cyclictest3569371-21kworker/u16:2+events_unbound08:48:175
3498568992927,2cyclictest3569371-21kworker/u16:2+events_unbound07:46:105
3498568992927,2cyclictest3470110-21kworker/u16:2+events_unbound07:20:545
3498568992927,2cyclictest2784830-21kworker/u16:3+events_unbound08:09:355
3498568992927,2cyclictest2784830-21kworker/u16:3+events_unbound08:09:355
3498566992927,2cyclictest3999744-21kworker/u16:0+events_unbound11:22:424
3498566992927,2cyclictest2784830-21kworker/u16:3+flush-8:008:08:564
3498566992927,2cyclictest2784830-21kworker/u16:3+flush-8:008:08:564
3498566992926,2cyclictest3999744-21kworker/u16:0+events_unbound11:03:414
3498573992827,0cyclictest0-21swapper/707:08:467
3498571992826,2cyclictest3569371-21kworker/u16:2+flush-8:008:38:316
3498568992826,2cyclictest4097235-21kworker/u16:0+events_unbound12:22:075
3498568992826,2cyclictest3768375-21kworker/u16:0+events_unbound09:22:255
3498568992826,2cyclictest3703191-21kworker/u16:4+events_unbound08:49:065
3498568992826,2cyclictest3636264-21kworker/u16:0+events_unbound08:32:275
3498568992826,2cyclictest3636264-21kworker/u16:0+events_unbound08:22:555
3498568992826,2cyclictest3569371-21kworker/u16:2+events_unbound08:41:175
3498568992826,2cyclictest3530237-21kworker/u16:0+events_unbound07:33:185
3498566992826,2cyclictest4170275-21kworker/u16:2+events_unbound12:07:534
3498566992826,2cyclictest4138847-21kworker/u16:1+events_unbound12:30:024
3498566992826,2cyclictest4138847-21kworker/u16:1+events_unbound11:55:304
3498566992826,2cyclictest3804483-21kworker/u16:0+events_unbound10:16:394
3498566992826,2cyclictest3804483-21kworker/u16:0+events_unbound10:16:394
3498571992725,2cyclictest3530237-21kworker/u16:0+events_unbound07:28:436
3498571992723,3cyclictest2784830-21kworker/u16:3+flush-8:008:53:566
3498568992725,2cyclictest3636264-21kworker/u16:0+events_unbound08:59:475
3498568992725,2cyclictest3569371-21kworker/u16:2+events_unbound08:35:065
3498568992725,2cyclictest2784830-21kworker/u16:3+events_unbound07:07:195
3498568992724,2cyclictest3530237-21kworker/u16:0+events_unbound07:33:325
3498566992725,2cyclictest4072624-21kworker/u16:2+events_unbound11:43:234
3498566992725,2cyclictest3804483-21kworker/u16:0+events_unbound09:40:304
3498573992621,4cyclictest3938741-21latency_hist10:28:307
3498571992624,2cyclictest3703191-21kworker/u16:4+events_unbound10:38:526
3498571992624,2cyclictest3569371-21kworker/u16:2+flush-8:008:03:556
3498571992623,3cyclictest3975372-21kworker/u16:1+flush-8:010:53:256
3498568992624,2cyclictest3569371-21kworker/u16:2+events_unbound08:25:065
3498568992624,2cyclictest2784830-21kworker/u16:3+events_unbound08:01:415
3498568992624,2cyclictest2784830-21kworker/u16:3+events_unbound07:57:465
3498568992523,2cyclictest4097235-21kworker/u16:0+events_unbound12:01:445
3498566992523,2cyclictest3999744-21kworker/u16:0+events_unbound10:59:584
3498566992523,2cyclictest3975374-21kworker/u16:3+events_unbound10:46:574
3498566992523,2cyclictest2784830-21kworker/u16:3+events_unbound09:46:224
40721592240,1chrt4072160-21ssh11:22:187
3498573992419,4cyclictest650-21systemd-journal09:18:317
3498571992422,2cyclictest3722229-21kworker/u16:1+events_unbound09:19:026
3498568992422,2cyclictest3530237-21kworker/u16:0+flush-8:007:24:065
3498568992422,2cyclictest3530237-21kworker/u16:0+flush-8:007:24:065
3498566992422,2cyclictest4138847-21kworker/u16:1+events_unbound11:49:014
3498571992321,2cyclictest3975374-21kworker/u16:3+flush-8:011:13:566
3498571992321,2cyclictest3804483-21kworker/u16:0+events_unbound10:04:186
3498571992320,2cyclictest3703191-21kworker/u16:4+flush-8:009:48:366
3498571992320,2cyclictest3636264-21kworker/u16:0+events_unbound08:18:506
3498573992215,6cyclictest3693505-21latency_hist08:43:307
3498571992221,1cyclictest3804483-21kworker/u16:0+events_unbound10:14:016
3498571992221,1cyclictest3804483-21kworker/u16:0+events_unbound10:14:016
3498571992220,2cyclictest4045456-21kworker/u16:4+events_unbound11:09:416
3498571992220,2cyclictest3975372-21kworker/u16:1+flush-8:010:44:016
3498571992220,2cyclictest2784830-21kworker/u16:3+flush-8:007:55:066
3498571992218,3cyclictest4072624-21kworker/u16:2+flush-8:011:48:256
3498568992220,2cyclictest3507089-21kworker/u16:1+events_unbound07:08:455
3498573992115,5cyclictest3731761-21latency_hist09:03:307
349857399211,2cyclictest4020866-21ssh10:58:527
3498571992018,2cyclictest4138847-21kworker/u16:1+events_unbound12:13:296
3498571992018,2cyclictest3975372-21kworker/u16:1+events_unbound10:57:306
3498571992018,2cyclictest3975372-21kworker/u16:1+events_unbound10:57:306
3498571992018,2cyclictest3722229-21kworker/u16:1+events_unbound09:25:236
3498571992018,2cyclictest3703191-21kworker/u16:4+events_unbound09:12:236
3498571992017,3cyclictest4138847-21kworker/u16:1+events_unbound11:58:546
3498571992017,3cyclictest2784830-21kworker/u16:3+flush-8:008:48:516
3498573991917,1cyclictest0-21swapper/710:13:477
3498573991917,1cyclictest0-21swapper/710:13:477
3498571991918,1cyclictest3703191-21kworker/u16:4+events_unbound09:18:036
3498571991917,2cyclictest3914472-21kworker/u16:5+flush-8:010:28:506
3498571991917,2cyclictest3569371-21kworker/u16:2+events_unbound08:08:546
3498571991917,2cyclictest3569371-21kworker/u16:2+events_unbound08:08:546
3498566991917,2cyclictest2784830-21kworker/u16:3+flush-8:008:23:544
3498566991915,3cyclictest3522252-21diskstats07:13:434
3498573991816,1cyclictest0-21swapper/711:48:487
3498573991812,5cyclictest3890061-21latency_hist10:08:307
349857399180,16cyclictest3635522-21expr08:08:587
349857399180,16cyclictest3635522-21expr08:08:587
3498571991816,2cyclictest2784830-21kworker/u16:3+flush-8:009:44:306
3498571991816,2cyclictest2784830-21kworker/u16:3+events_unbound07:13:486
3498566991816,2cyclictest3507089-21kworker/u16:1+flush-8:007:08:364
3498573991717,0cyclictest0-21swapper/711:39:507
3498573991716,1cyclictest0-21swapper/709:23:497
3498573991713,3cyclictest1267-21snmpd07:25:587
3498573991713,3cyclictest1267-21snmpd07:25:587
3498571991715,2cyclictest3804483-21kworker/u16:0+events_unbound09:38:526
3498571991715,2cyclictest3549727-21kworker/u16:1+events_unbound07:24:426
3498571991715,2cyclictest3549727-21kworker/u16:1+events_unbound07:24:426
349857399168,7cyclictest0-21swapper/711:13:507
349857399168,7cyclictest0-21swapper/709:58:497
349857399167,8cyclictest0-21swapper/711:58:547
349857399167,8cyclictest0-21swapper/711:03:417
349857399167,8cyclictest0-21swapper/709:33:537
349857399167,8cyclictest0-21swapper/709:33:537
3498573991611,4cyclictest4085043-21latency_hist11:28:307
3498571991614,2cyclictest4097235-21kworker/u16:0+flush-8:012:03:466
3498571991614,2cyclictest4072624-21kworker/u16:2+events_unbound11:24:386
3498571991614,2cyclictest3703191-21kworker/u16:4+events_unbound10:23:536
3498571991614,2cyclictest3569371-21kworker/u16:2+events_unbound07:58:546
3498571991613,2cyclictest3804483-21kworker/u16:0+flush-8:010:08:316
3498566991614,1cyclictest3542574-21kthreadcore07:23:464
3498566991614,1cyclictest3542574-21kthreadcore07:23:464
349857399157,7cyclictest6344-21gmain10:18:497
349857399157,7cyclictest0-21swapper/712:13:467
349857399157,7cyclictest0-21swapper/712:13:467
3498573991513,1cyclictest4130263-21ssh11:43:507
3498573991512,3cyclictest0-21swapper/710:42:147
3498573991512,2cyclictest3804853-21munin-run09:33:307
3498573991511,3cyclictest3656559-21irqcore08:23:467
3498573991511,3cyclictest1267-21snmpd12:24:517
3498571991513,2cyclictest3569371-21kworker/u16:2+events_unbound08:43:596
3498571991512,2cyclictest3975374-21kworker/u16:3+flush-8:011:18:476
3498571991512,2cyclictest0-21swapper/610:18:416
3498566991513,2cyclictest3569371-21kworker/u16:2+events_unbound07:58:564
349856699150,14cyclictest0-21swapper/408:23:314
349857399146,7cyclictest0-21swapper/712:18:427
349857399146,7cyclictest0-21swapper/711:10:227
349857399146,7cyclictest0-21swapper/710:33:337
349857399146,7cyclictest0-21swapper/707:49:167
349857399145,8cyclictest0-21swapper/709:08:537
349857399145,8cyclictest0-21swapper/709:03:467
349857399143,10cyclictest0-21swapper/710:52:277
3498573991412,1cyclictest4094128-21ssh11:28:557
3498573991412,1cyclictest0-21swapper/707:53:537
3498573991410,3cyclictest1267-21snmpd08:20:097
349857399140,1cyclictest0-21swapper/707:58:557
349857399140,1cyclictest0-21swapper/707:18:557
349857399140,13cyclictest0-21swapper/709:53:547
3498571991413,1cyclictest0-21swapper/611:29:446
3498571991412,2cyclictest4097235-21kworker/u16:0+events_unbound11:42:036
3498571991412,2cyclictest3975374-21kworker/u16:3+events_unbound11:02:036
3498571991412,2cyclictest3804483-21kworker/u16:0+events_unbound09:59:356
3498571991412,2cyclictest3507089-21kworker/u16:1+events_unbound07:09:006
3498571991412,2cyclictest2784830-21kworker/u16:3+events_unbound09:28:566
349857199140,14cyclictest0-21swapper/612:28:426
3498566991411,2cyclictest2784830-21kworker/u16:3+events_unbound07:03:444
349856699140,1cyclictest0-21swapper/408:13:444
349857399139,3cyclictest1267-21snmpd08:49:517
349857399139,3cyclictest1267-21snmpd07:07:467
349857399136,6cyclictest0-21swapper/712:31:037
349857399136,6cyclictest0-21swapper/712:08:307
349857399136,6cyclictest0-21swapper/712:03:477
349857399136,6cyclictest0-21swapper/710:09:157
349857399135,7cyclictest0-21swapper/711:53:537
3498573991312,0cyclictest0-21swapper/708:03:457
349857199139,3cyclictest3579857-21cat07:43:456
3498571991312,1cyclictest0-21swapper/612:24:266
3498571991311,2cyclictest3703191-21kworker/u16:4+events_unbound09:57:386
3498566991311,2cyclictest2784830-21kworker/u16:3+events_unbound08:38:464
3498566991310,3cyclictest3636264-21kworker/u16:0+flush-8:008:58:464
349857399128,3cyclictest1267-21snmpd08:28:397
349857399128,3cyclictest1267-21snmpd08:17:207
349857399128,3cyclictest1267-21snmpd07:15:287
349857399127,4cyclictest3722188-21latency_hist08:58:307
349857399125,6cyclictest0-21swapper/709:38:327
349857399120,10cyclictest0-21swapper/707:43:547
3498571991210,2cyclictest4138847-21kworker/u16:1+events_unbound12:21:426
3498571991210,2cyclictest3569371-21kworker/u16:2+events_unbound08:38:546
349857199120,1cyclictest0-21swapper/607:41:086
3498566991210,2cyclictest3549727-21kworker/u16:1+events_unbound07:45:314
3498566991210,2cyclictest3530237-21kworker/u16:0+events_unbound07:28:454
349857399118,2cyclictest3674751-21/usr/sbin/munin08:33:457
349857399114,6cyclictest0-21swapper/708:44:187
349857199119,2cyclictest3703191-21kworker/u16:4+events_unbound09:37:016
349857199119,2cyclictest3703191-21kworker/u16:4+events_unbound09:37:016
349857199119,2cyclictest3530237-21kworker/u16:0+flush-8:007:23:306
349857199119,2cyclictest3470110-21kworker/u16:2+events_unbound07:03:586
3498571991110,1cyclictest0-21swapper/611:36:126
3498571991110,1cyclictest0-21swapper/611:36:126
349857199110,11cyclictest0-21swapper/608:24:486
349856699118,3cyclictest3569371-21kworker/u16:2+flush-8:008:43:314
3498566991110,1cyclictest0-21swapper/407:56:144
349856699110,1cyclictest0-21swapper/407:34:484
349856699110,11cyclictest0-21swapper/408:53:194
349857199108,2cyclictest3636264-21kworker/u16:0+flush-8:008:13:466
349857199106,3cyclictest4135368-21sed11:48:466
349856699108,2cyclictest3470110-21kworker/u16:2+events_unbound07:23:264
349856699106,3cyclictest3713798-21cat08:53:454
34985719998,1cyclictest0-21swapper/607:49:206
34985669990,8cyclictest0-21swapper/408:03:474
34985669975,1cyclictest0-21swapper/408:33:444
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional