You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 00:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Wed Apr 01, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3342414996158,2cyclictest3915795-21kworker/u16:2+events_unbound11:22:546
3342414996058,2cyclictest4000340-21kworker/u16:4+events_unbound12:23:136
3342414996058,2cyclictest4000340-21kworker/u16:4+events_unbound12:23:136
3342414996058,2cyclictest3940020-21kworker/u16:5+events_unbound11:38:106
3342414995552,2cyclictest3342169-21kworker/u16:2+events_unbound07:47:546
3342414995350,2cyclictest3672725-21kworker/u16:2+events_unbound10:12:586
3342414995250,2cyclictest3966722-21kworker/u16:3+events_unbound11:53:096
3342414995250,2cyclictest3694759-21kworker/u16:0+flush-8:010:48:096
3342414995250,2cyclictest3672725-21kworker/u16:2+events_unbound09:43:086
3342414995250,2cyclictest3587652-21kworker/u16:4+events_unbound09:33:066
3342409995048,2cyclictest3855140-21kworker/u16:4+flush-8:011:18:095
3342414994947,2cyclictest3694759-21kworker/u16:0+events_unbound10:03:106
3342414994947,2cyclictest3356777-21kworker/u16:0+events_unbound07:18:116
3342404994945,3cyclictest3694759-21kworker/u16:0+flush-8:010:12:394
3342414994845,2cyclictest3842656-21kworker/u16:3+events_unbound10:53:086
3342414994745,2cyclictest3793403-21kworker/u16:1+events_unbound11:03:086
3342414994745,2cyclictest3793403-21kworker/u16:1+events_unbound11:03:086
3342414994745,2cyclictest3587652-21kworker/u16:4+events_unbound09:38:096
3342409994745,2cyclictest3468030-21kworker/u16:4+events_unbound08:17:575
3342404994744,2cyclictest3915795-21kworker/u16:2+flush-8:011:32:394
3342414994644,2cyclictest3793403-21kworker/u16:1+events_unbound11:08:076
3342414994644,2cyclictest3575852-21kworker/u16:1+flush-8:009:18:046
3342414994543,2cyclictest3963855-21kworker/u16:1+flush-8:012:08:096
3342409994543,2cyclictest3963855-21kworker/u16:1+events_unbound11:52:405
3342414994442,2cyclictest3939546-21kworker/u16:0+events_unbound12:18:106
3342414994442,2cyclictest3672725-21kworker/u16:2+events_unbound10:43:086
3342414994442,2cyclictest3468030-21kworker/u16:4+events_unbound08:03:086
3342409994442,2cyclictest4049030-21kworker/u16:3+events_unbound12:30:095
3342409994442,2cyclictest3537615-21kworker/u16:2+events_unbound09:03:125
3342409994439,2cyclictest3634563-21kworker/u16:3+events_unbound09:46:335
3342415994338,4cyclictest650-21systemd-journal11:12:337
3342414994341,2cyclictest3587652-21kworker/u16:4+flush-8:009:27:546
3342414994341,2cyclictest3479625-21kworker/u16:2+events_unbound08:32:546
3342414994340,2cyclictest3694759-21kworker/u16:0+events_unbound10:37:416
3342409994341,2cyclictest3587652-21kworker/u16:4+events_unbound09:39:415
3342409994340,2cyclictest4000340-21kworker/u16:4+events_unbound12:03:255
3342414994240,2cyclictest3939546-21kworker/u16:0+flush-8:012:12:546
3342414994240,2cyclictest3672725-21kworker/u16:2+events_unbound10:31:346
3342414994240,2cyclictest3479625-21kworker/u16:2+flush-8:008:13:086
3342414994239,2cyclictest3575852-21kworker/u16:1+events_unbound09:12:566
3342409994240,2cyclictest3915795-21kworker/u16:2+events_unbound11:27:555
3342409994240,2cyclictest3793403-21kworker/u16:1+flush-8:010:33:135
3342409994240,2cyclictest3694759-21kworker/u16:0+events_unbound11:10:415
3342409994240,2cyclictest3537615-21kworker/u16:2+flush-8:008:48:045
334191524232,7sleep40-21swapper/406:59:474
3342414994139,2cyclictest4000340-21kworker/u16:4+events_unbound12:28:456
3342414994139,2cyclictest3939546-21kworker/u16:0+events_unbound11:58:126
3342414994139,2cyclictest3939546-21kworker/u16:0+events_unbound11:33:456
3342414994139,2cyclictest3672725-21kworker/u16:2+events_unbound10:20:376
3342414994139,2cyclictest3575852-21kworker/u16:1+events_unbound09:04:346
3342414994139,2cyclictest3498052-21kworker/u16:3+events_unbound09:11:176
3342409994139,2cyclictest4000340-21kworker/u16:4+events_unbound12:18:065
3342409994139,2cyclictest3939546-21kworker/u16:0+events_unbound11:34:245
3342409994139,2cyclictest3694759-21kworker/u16:0+events_unbound11:14:105
3342414994038,2cyclictest3939546-21kworker/u16:0+events_unbound11:49:216
3342414994038,2cyclictest3915795-21kworker/u16:2+events_unbound11:30:416
3342414994038,2cyclictest3855140-21kworker/u16:4+events_unbound11:13:296
3342414994038,2cyclictest3694759-21kworker/u16:0+events_unbound10:26:136
3342414994038,2cyclictest3694759-21kworker/u16:0+events_unbound10:26:136
3342414994038,2cyclictest3672725-21kworker/u16:2+events_unbound10:36:096
3342414994038,2cyclictest3537615-21kworker/u16:2+events_unbound09:24:016
3342409994038,2cyclictest3966722-21kworker/u16:3+events_unbound11:50:335
3342409994038,2cyclictest3672725-21kworker/u16:2+events_unbound10:48:055
3342409994038,2cyclictest3587652-21kworker/u16:4+flush-8:009:28:005
3342409994037,2cyclictest3660616-21kworker/u16:1+events_unbound09:47:555
33338162403,30sleep70-21swapper/706:57:587
3342414993937,2cyclictest3842656-21kworker/u16:3+events_unbound10:58:466
3342414993937,2cyclictest3356777-21kworker/u16:0+flush-8:007:27:546
3342409993937,2cyclictest3963855-21kworker/u16:1+events_unbound12:11:375
3342409993937,2cyclictest3915795-21kworker/u16:2+events_unbound11:25:565
3342409993937,2cyclictest3694759-21kworker/u16:0+events_unbound10:15:095
3342409993937,2cyclictest3672725-21kworker/u16:2+events_unbound09:57:365
3342409993937,2cyclictest3634563-21kworker/u16:3+events_unbound10:04:225
3342409993937,2cyclictest3312527-21kworker/u16:1+flush-8:007:13:065
3342414993836,2cyclictest3963855-21kworker/u16:1+events_unbound11:45:266
3342414993836,2cyclictest3634563-21kworker/u16:3+events_unbound09:59:296
3342414993836,2cyclictest3537615-21kworker/u16:2+events_unbound08:47:576
3342414993836,2cyclictest3312527-21kworker/u16:1+flush-8:007:13:086
3342409993836,2cyclictest4049030-21kworker/u16:3+events_unbound12:27:025
3342409993836,2cyclictest4049030-21kworker/u16:3+events_unbound12:27:025
3342409993836,2cyclictest3939546-21kworker/u16:0+flush-8:012:13:095
3342409993836,2cyclictest3694759-21kworker/u16:0+events_unbound10:53:155
3342409993836,2cyclictest3694759-21kworker/u16:0+events_unbound10:47:185
3342409993836,2cyclictest3694759-21kworker/u16:0+events_unbound10:20:185
3342409993836,2cyclictest3672725-21kworker/u16:2+events_unbound10:23:455
3342409993836,2cyclictest3672725-21kworker/u16:2+events_unbound10:23:455
3342409993836,2cyclictest3537615-21kworker/u16:2+events_unbound09:19:255
3342409993836,2cyclictest3498052-21kworker/u16:3+events_unbound09:10:065
3342409993835,2cyclictest3963855-21kworker/u16:1+flush-8:011:43:095
3342409993735,2cyclictest3634563-21kworker/u16:3+events_unbound10:10:455
3342409993735,2cyclictest3587652-21kworker/u16:4+events_unbound09:35:425
3342409993735,2cyclictest3498052-21kworker/u16:3+events_unbound08:58:075
3342409993734,2cyclictest3498052-21kworker/u16:3+flush-8:008:52:555
3342404993734,2cyclictest3963855-21kworker/u16:1+flush-8:011:47:384
3342414993634,2cyclictest3694759-21kworker/u16:0+events_unbound11:20:166
3342414993634,2cyclictest3672725-21kworker/u16:2+events_unbound09:54:466
3342414993634,2cyclictest3342169-21kworker/u16:2+flush-8:007:33:056
3342414993634,2cyclictest3342169-21kworker/u16:2+flush-8:007:33:056
3342409993634,2cyclictest3767375-21kworker/u16:3+events_unbound10:30:245
3342409993634,2cyclictest3537615-21kworker/u16:2+events_unbound09:14:145
3342409993634,2cyclictest3479625-21kworker/u16:2+events_unbound08:13:045
3342414993533,2cyclictest4000340-21kworker/u16:4+events_unbound12:05:056
3342414993533,2cyclictest3672725-21kworker/u16:2+events_unbound09:48:056
3342409993533,2cyclictest3940020-21kworker/u16:5+flush-8:011:38:105
3342409993533,2cyclictest3672725-21kworker/u16:2+events_unbound10:37:555
3342409993533,2cyclictest3498052-21kworker/u16:3+events_unbound08:28:035
3342409993533,2cyclictest3356777-21kworker/u16:0+events_unbound07:18:095
3342409993533,2cyclictest3342169-21kworker/u16:2+events_unbound07:07:525
334195223525,7sleep50-21swapper/507:00:205
3342415993429,4cyclictest3963846-21latency_hist11:42:387
3342414993432,2cyclictest3694759-21kworker/u16:0+events_unbound10:10:536
3342409993432,2cyclictest3963855-21kworker/u16:1+events_unbound12:00:045
3342409993432,2cyclictest3694759-21kworker/u16:0+events_unbound10:58:545
3342409993432,2cyclictest3694759-21kworker/u16:0+events_unbound09:58:155
3342409993432,2cyclictest3468030-21kworker/u16:4+events_unbound08:03:045
3342404993432,2cyclictest3634563-21kworker/u16:3+flush-8:009:38:054
3342404993431,2cyclictest3672725-21kworker/u16:2+flush-8:010:28:544
3342415993328,4cyclictest650-21systemd-journal10:47:347
3342414993329,3cyclictest3479625-21kworker/u16:2+events_unbound08:18:056
3342409993331,2cyclictest3842656-21kworker/u16:3+events_unbound11:05:245
3342409993331,2cyclictest3842656-21kworker/u16:3+events_unbound11:05:245
3342404993331,1cyclictest3963855-21kworker/u16:1+events_unbound12:22:484
3342404993331,1cyclictest3963855-21kworker/u16:1+events_unbound12:22:484
3342414993230,2cyclictest3356777-21kworker/u16:0+events_unbound08:08:136
3342414993230,2cyclictest3356777-21kworker/u16:0+events_unbound07:53:026
3342409993230,2cyclictest3587652-21kworker/u16:4+events_unbound09:23:355
3342409993230,2cyclictest3440116-21kworker/u16:3+events_unbound07:49:495
3342404993229,2cyclictest3842656-21kworker/u16:3+flush-8:010:52:454
3342409993129,2cyclictest3498052-21kworker/u16:3+events_unbound08:25:155
3342404993129,2cyclictest3342169-21kworker/u16:2+flush-8:007:27:344
3342415993025,4cyclictest3903234-21latency_hist11:17:397
3342409993028,2cyclictest3517152-21kworker/u16:0+events_unbound08:39:235
3342409993028,2cyclictest3479625-21kworker/u16:2+events_unbound08:37:105
3342409993027,2cyclictest3356777-21kworker/u16:0+events_unbound08:07:525
334191723019,7sleep60-21swapper/606:59:496
3342409992927,2cyclictest3537615-21kworker/u16:2+events_unbound08:46:105
3342409992927,2cyclictest3440116-21kworker/u16:3+events_unbound07:58:135
3342404992927,2cyclictest3754701-21kworker/u16:1+events_unbound10:18:054
3342415992823,4cyclictest650-21systemd-journal11:32:397
3342414992824,3cyclictest3498052-21kworker/u16:3+events_unbound08:42:496
38684082270,1chrt3868411-21sed11:02:557
38684082270,1chrt3868411-21sed11:02:557
3342415992722,4cyclictest650-21systemd-journal10:22:387
3342415992722,4cyclictest3806087-21latency_hist10:37:397
3342414992725,2cyclictest3537615-21kworker/u16:2+events_unbound08:57:536
3342414992725,2cyclictest3498052-21kworker/u16:3+flush-8:008:42:346
3342409992725,2cyclictest3342169-21kworker/u16:2+events_unbound07:37:135
3342409992725,2cyclictest3342169-21kworker/u16:2+events_unbound07:37:135
3342409992725,2cyclictest3342169-21kworker/u16:2+events_unbound07:27:425
3342404992725,2cyclictest3672725-21kworker/u16:2+flush-8:010:47:344
3342414992624,2cyclictest3356777-21kworker/u16:0+events_unbound07:43:086
3342415992519,5cyclictest3634423-21pool-gnome-soft09:24:397
3342409992523,2cyclictest3294613-21kworker/u16:3+events_unbound07:07:305
39389762240,1chrt3938977-21sh11:31:327
3342415992419,4cyclictest4012367-21latency_hist12:02:397
3342414992422,2cyclictest3498052-21kworker/u16:3+events_unbound08:27:526
3342409992422,2cyclictest3342169-21kworker/u16:2+events_unbound07:23:475
3342404992423,1cyclictest3694759-21kworker/u16:0+events_unbound11:12:074
3342404992422,1cyclictest3842656-21kworker/u16:3+events_unbound11:02:544
3342404992422,1cyclictest3842656-21kworker/u16:3+events_unbound11:02:544
3342414992321,2cyclictest3356777-21kworker/u16:0+flush-8:007:37:596
3342409992321,2cyclictest3342169-21kworker/u16:2+events_unbound07:55:505
3342409992321,2cyclictest3312527-21kworker/u16:1+flush-8:007:43:065
3342415992218,3cyclictest4036568-21latency_hist12:12:397
3342415992119,1cyclictest3356739-21/usr/sbin/munin07:07:547
3342415992019,1cyclictest3575427-21diskmemload10:53:217
3342415992017,2cyclictest3664801-21kthreadcore09:38:017
3342414992018,2cyclictest3342169-21kworker/u16:2+events_unbound07:23:016
3342409992017,2cyclictest3342169-21kworker/u16:2+events_unbound07:37:405
3342404992017,2cyclictest3587652-21kworker/u16:4+events_unbound09:25:034
3342404992017,2cyclictest3356777-21kworker/u16:0+events_unbound07:17:584
3342415991918,1cyclictest0-21swapper/709:21:507
3342415991917,1cyclictest3838522-21cut10:48:037
3342415991915,3cyclictest4083659-21sh12:30:097
3342415991915,3cyclictest3606580-21cut09:13:027
3342414991917,2cyclictest3312527-21kworker/u16:1+events_unbound07:04:176
3342414991916,2cyclictest3498052-21kworker/u16:3+events_unbound08:52:506
3342414991916,2cyclictest3440116-21kworker/u16:3+flush-8:007:57:496
3342415991817,0cyclictest0-21swapper/709:57:547
3342415991816,1cyclictest3695019-21diskmemload09:49:077
3342415991813,4cyclictest3576751-21cat09:02:557
3342404991815,2cyclictest3440116-21kworker/u16:3+flush-8:007:57:574
3342415991717,0cyclictest0-21swapper/709:35:297
3342415991716,1cyclictest0-21swapper/711:50:087
3342415991716,0cyclictest0-21swapper/708:22:547
3342415991715,1cyclictest4059154-21ssh12:19:427
334241599170,16cyclictest0-21swapper/707:03:047
3342404991715,2cyclictest3356777-21kworker/u16:0+flush-8:007:27:574
3342415991613,2cyclictest3974146-21ssh11:44:187
3342404991614,2cyclictest3963855-21kworker/u16:1+events_unbound12:12:344
3342404991614,2cyclictest3587652-21kworker/u16:4+flush-8:009:22:394
40153242150,0sleep74015325-21grep12:02:587
3342415991512,2cyclictest1267-21snmpd10:38:247
3342415991511,3cyclictest3924395-21ntp_states11:23:087
334241599150,13cyclictest3546788-21turbostat08:47:397
3342404991513,2cyclictest3672725-21kworker/u16:2+events_unbound09:48:094
3342404991512,2cyclictest3498052-21kworker/u16:3+flush-8:008:58:114
334240499150,1cyclictest0-21swapper/409:11:464
334241599148,5cyclictest3527658-21latency_hist08:37:397
334241599146,7cyclictest0-21swapper/712:23:107
334241599146,7cyclictest0-21swapper/712:23:107
334241599146,7cyclictest0-21swapper/709:53:217
334241599145,8cyclictest0-21swapper/711:22:317
334241599142,10cyclictest3855297-21grep10:57:517
3342415991413,1cyclictest3575427-21diskmemload09:12:137
3342415991412,1cyclictest3998086-21ssh11:53:417
3342415991412,1cyclictest3683329-21ssh09:44:577
3342415991412,1cyclictest3575427-21diskmemload09:30:327
334241599140,13cyclictest3451131-21latency_hist07:57:397
3342414991412,2cyclictest3498052-21kworker/u16:3+events_unbound08:24:426
3342414991412,2cyclictest3342169-21kworker/u16:2+events_unbound07:07:426
3342404991413,1cyclictest0-21swapper/411:59:214
3342404991413,1cyclictest0-21swapper/411:53:124
3342404991413,1cyclictest0-21swapper/410:40:034
3342404991413,1cyclictest0-21swapper/410:17:024
3342404991413,1cyclictest0-21swapper/410:03:294
3342404991413,1cyclictest0-21swapper/409:46:184
3342404991411,2cyclictest3694759-21kworker/u16:0+flush-8:011:13:074
334240499140,1cyclictest0-21swapper/412:15:454
334240499140,1cyclictest0-21swapper/409:59:424
334240499140,14cyclictest0-21swapper/412:05:304
334240499140,13cyclictest0-21swapper/408:32:404
334241599139,3cyclictest1267-21snmpd08:58:247
334241599139,3cyclictest1267-21snmpd08:17:597
334241599139,3cyclictest1267-21snmpd07:58:147
334241599139,3cyclictest1267-21snmpd07:45:537
334241599139,3cyclictest1267-21snmpd07:24:077
334241599138,4cyclictest3486337-21kthreadcore08:13:017
334241599138,4cyclictest3414060-21cat07:37:547
334241599136,6cyclictest0-21swapper/710:28:337
334241599136,6cyclictest0-21swapper/710:12:497
334241599136,6cyclictest0-21swapper/710:09:327
334241599136,6cyclictest0-21swapper/710:03:187
334241599135,7cyclictest0-21swapper/712:12:457
334241599135,7cyclictest0-21swapper/710:23:227
334241599135,7cyclictest0-21swapper/710:23:227
334241599130,3cyclictest3470893-21cpuspeed_turbos08:07:527
334241599130,11cyclictest3547746-21fschecks_count08:47:547
334241599130,11cyclictest3536267-21ntpq08:38:047
3342404991312,1cyclictest0-21swapper/411:49:064
3342404991312,1cyclictest0-21swapper/411:22:564
3342404991312,1cyclictest0-21swapper/409:54:014
3342404991312,1cyclictest0-21swapper/409:13:494
3342404991312,1cyclictest0-21swapper/407:38:074
3342404991312,1cyclictest0-21swapper/407:33:054
3342404991312,1cyclictest0-21swapper/407:33:054
3342404991310,2cyclictest3694759-21kworker/u16:0+flush-8:010:32:564
334241599128,3cyclictest3461102-21/usr/sbin/munin08:02:517
334241599120,11cyclictest3564235-21kthreadcore08:53:027
334241599120,10cyclictest3395272-21irqcore07:27:577
3342404991211,1cyclictest0-21swapper/412:30:254
3342404991211,1cyclictest0-21swapper/411:36:584
3342404991211,1cyclictest0-21swapper/409:32:544
3342404991211,1cyclictest0-21swapper/408:24:104
334240499120,1cyclictest0-21swapper/408:09:204
334240499120,11cyclictest0-21swapper/408:17:424
334241599117,3cyclictest3375107-21/usr/sbin/munin07:17:537
334241599116,4cyclictest3433575-21sed07:47:567
334241599116,4cyclictest3366346-21cat07:12:557
334241599114,6cyclictest0-21swapper/707:35:457
334241599114,6cyclictest0-21swapper/707:35:457
334241599110,9cyclictest3508955-21/usr/sbin/munin08:27:537
334240499119,2cyclictest3498052-21kworker/u16:3+events_unbound08:53:044
3342404991110,1cyclictest0-21swapper/410:59:084
3342404991110,1cyclictest0-21swapper/409:07:314
334240499110,11cyclictest0-21swapper/408:39:084
334240499110,11cyclictest0-21swapper/407:12:074
334240499110,11cyclictest0-21swapper/407:03:174
334240499109,1cyclictest0-21swapper/408:47:484
334240499109,1cyclictest0-21swapper/408:13:264
33424049998,1cyclictest0-21swapper/412:19:514
33424049998,1cyclictest0-21swapper/410:49:314
33424049998,1cyclictest0-21swapper/408:07:174
33424049998,1cyclictest0-21swapper/407:14:574
33424049996,2cyclictest1551472-21abrt-dump-journ11:42:334
33424049987,1cyclictest0-21swapper/407:53:444
33424049965,1cyclictest0-21swapper/410:22:434
33424049965,1cyclictest0-21swapper/410:22:434
33424049965,1cyclictest0-21swapper/407:43:104
33424049964,1cyclictest0-21swapper/409:29:394
33424049963,2cyclictest35377432sleep408:42:524
33424049960,1cyclictest0-21swapper/411:19:494
33424049950,4cyclictest3509459-21taskset08:27:524
33424049950,4cyclictest3432396-21chrt07:47:464
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional