You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 01:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Sun Nov 23, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
328159127564,7sleep50-21swapper/503:20:325
3282117995752,4cyclictest3468040-21latency_hist04:53:297
328165525622,30sleep70-21swapper/703:21:237
3282113995551,3cyclictest3356469-21kworker/u16:0+flush-8:004:23:296
3282117995449,4cyclictest3710407-21latency_hist06:53:297
3282109994744,2cyclictest3841794-21kworker/u16:4+flush-8:008:43:285
328168224737,7sleep60-21swapper/603:21:466
3282109994542,2cyclictest3316038-21kworker/u16:0+flush-8:003:38:295
328165124534,8sleep40-21swapper/403:21:204
3282117994438,5cyclictest3579240-21latency_hist05:48:297
3282117994438,5cyclictest3437695-21latency_hist04:38:307
3282107994341,2cyclictest3901970-21kworker/u16:0+events_unbound08:26:124
3282107994341,2cyclictest3770692-21kworker/u16:0+events_unbound08:13:134
3282117994039,0cyclictest0-21swapper/706:30:397
3282117994035,4cyclictest3892152-21latency_hist08:23:297
3282117994035,4cyclictest3326381-21latency_hist03:43:297
3282109994038,2cyclictest3756063-21kworker/u16:1+events_unbound08:08:065
3282109994038,2cyclictest3356469-21kworker/u16:0+events_unbound04:08:325
3282117993934,4cyclictest3831493-21latency_hist07:53:287
3282117993933,5cyclictest3316279-21latency_hist03:38:297
3282109993937,2cyclictest3670094-21kworker/u16:0+events_unbound06:38:125
3282109993936,2cyclictest3407300-21kworker/u16:4+events_unbound06:08:305
3282109993936,2cyclictest3356469-21kworker/u16:0+flush-8:004:19:135
3282109993836,2cyclictest3770692-21kworker/u16:0+flush-8:007:45:125
3282109993836,2cyclictest3407300-21kworker/u16:4+events_unbound05:58:305
3282109993835,2cyclictest3756063-21kworker/u16:1+events_unbound08:18:315
3282117993732,4cyclictest3649878-21latency_hist06:23:297
3282109993735,2cyclictest3608534-21kworker/u16:0+events_unbound06:21:185
3282109993735,2cyclictest3478076-21kworker/u16:1+events_unbound05:00:125
3282109993735,2cyclictest2568943-21kworker/u16:4+events_unbound03:30:125
3282109993734,2cyclictest3568803-21kworker/u16:2+flush-8:005:48:305
3282107993735,2cyclictest3756063-21kworker/u16:1+flush-8:008:48:554
3282107993735,2cyclictest3756063-21kworker/u16:1+events_unbound07:57:134
3282117993633,2cyclictest3931937-21timerwakeupswit08:38:597
3282109993634,2cyclictest3770692-21kworker/u16:0+events_unbound07:41:295
3282109993634,2cyclictest3770692-21kworker/u16:0+events_unbound07:28:125
3282109993634,2cyclictest3740597-21kworker/u16:2+flush-8:007:16:265
3282109993634,2cyclictest3568803-21kworker/u16:2+events_unbound06:45:125
3282107993634,2cyclictest3608534-21kworker/u16:0+events_unbound06:00:134
3282107993633,2cyclictest3756063-21kworker/u16:1+events_unbound07:18:314
3282117993534,0cyclictest0-21swapper/704:07:147
3282109993533,2cyclictest3841794-21kworker/u16:4+events_unbound08:12:125
3282109993533,2cyclictest3770692-21kworker/u16:0+flush-8:008:00:135
3282109993531,3cyclictest3912280-40logrotate08:32:515
3282107993533,2cyclictest3376657-21kworker/u16:1+events_unbound04:18:134
3282107993532,2cyclictest3407300-21kworker/u16:4+flush-8:006:43:394
3282107993532,2cyclictest3356469-21kworker/u16:0+flush-8:004:18:324
3282113993432,2cyclictest3841794-21kworker/u16:4+flush-8:008:13:286
3282113993432,2cyclictest3608534-21kworker/u16:0+events_unbound06:18:476
3282113993430,3cyclictest3670094-21kworker/u16:0+flush-8:007:08:286
3282113993430,3cyclictest3356469-21kworker/u16:0+flush-8:004:48:596
3282109993432,2cyclictest3478076-21kworker/u16:1+events_unbound05:28:125
3282109993432,2cyclictest3407300-21kworker/u16:4+flush-8:005:41:085
3282109993432,2cyclictest3407300-21kworker/u16:4+flush-8:004:53:355
3282109993432,2cyclictest3326171-21kworker/u16:4+events_unbound03:45:135
3282107993432,2cyclictest3446797-21kworker/u16:1+events_unbound04:48:324
3282107993432,2cyclictest3291862-21kworker/u16:1+flush-8:003:34:404
3282107993431,2cyclictest3670094-21kworker/u16:0+flush-8:007:13:394
3282117993332,0cyclictest0-21swapper/706:26:347
3282117993332,0cyclictest0-21swapper/705:53:587
3282113993330,2cyclictest3356469-21kworker/u16:0+events_unbound04:33:516
3282109993331,2cyclictest3650065-21kworker/u16:1+flush-8:006:28:145
3282107993331,2cyclictest3811144-21kworker/u16:3+flush-8:007:50:394
3282107993331,2cyclictest3528980-21kworker/u16:3+events_unbound05:27:274
3282117993231,0cyclictest0-21swapper/708:15:127
3282117993231,0cyclictest0-21swapper/706:55:517
3282117993231,0cyclictest0-21swapper/705:13:307
3282113993230,2cyclictest3770692-21kworker/u16:0+flush-8:008:03:506
3282109993230,2cyclictest3670094-21kworker/u16:0+events_unbound07:11:125
3282109993230,2cyclictest3407300-21kworker/u16:4+events_unbound07:04:125
3282107993230,2cyclictest3478076-21kworker/u16:1+flush-8:004:59:394
3282107993230,2cyclictest3407300-21kworker/u16:4+flush-8:004:35:154
3282117993130,0cyclictest0-21swapper/708:10:407
3282117993130,0cyclictest0-21swapper/707:32:477
3282117993130,0cyclictest0-21swapper/703:28:157
3282113993128,2cyclictest3478076-21kworker/u16:1+events_unbound04:58:426
3282109993129,2cyclictest3841794-21kworker/u16:4+events_unbound08:47:135
3282109993129,2cyclictest3841794-21kworker/u16:4+events_unbound08:18:125
3282109993129,2cyclictest3478076-21kworker/u16:1+events_unbound05:13:135
3282107993129,2cyclictest3356652-21kworker/u16:2+events_unbound05:04:124
3282107993129,2cyclictest3356469-21kworker/u16:0+flush-8:004:13:144
3282107993129,2cyclictest3326171-21kworker/u16:4+events_unbound03:53:124
3282107993129,2cyclictest2568943-21kworker/u16:4+events_unbound03:30:394
3282107993128,2cyclictest3356652-21kworker/u16:2+flush-8:004:01:074
3282109993028,2cyclictest3670094-21kworker/u16:0+events_unbound06:41:205
3282109993028,2cyclictest3568803-21kworker/u16:2+flush-8:006:51:225
3282109993028,2cyclictest3568803-21kworker/u16:2+events_unbound06:16:195
3282109993028,2cyclictest3407300-21kworker/u16:4+events_unbound04:25:405
3282109993028,2cyclictest3356469-21kworker/u16:0+flush-8:004:03:575
3282107993028,2cyclictest3756063-21kworker/u16:1+events_unbound08:44:134
3282107993028,2cyclictest3756063-21kworker/u16:1+events_unbound07:27:154
3282107993028,2cyclictest3740597-21kworker/u16:2+events_unbound07:10:584
3282107993028,2cyclictest3568803-21kworker/u16:2+events_unbound06:51:124
3282107993028,2cyclictest3446797-21kworker/u16:1+flush-8:004:48:284
3282107993028,2cyclictest1741888-21kworker/u16:3+flush-8:003:39:144
3282117992928,0cyclictest0-21swapper/707:39:127
3282117992928,0cyclictest0-21swapper/707:27:317
3282117992928,0cyclictest0-21swapper/707:14:107
3282113992927,2cyclictest3356652-21kworker/u16:2+flush-8:004:00:436
3282113992926,2cyclictest3291862-21kworker/u16:1+flush-8:003:53:516
3282107992927,2cyclictest3770692-21kworker/u16:0+flush-8:007:44:104
3282107992927,2cyclictest3756063-21kworker/u16:1+events_unbound08:19:494
3282107992927,2cyclictest3568803-21kworker/u16:2+flush-8:005:50:194
3282107992927,2cyclictest3568803-21kworker/u16:2+events_unbound06:26:034
3282107992927,2cyclictest3407300-21kworker/u16:4+flush-8:005:42:404
3282107992927,2cyclictest3407300-21kworker/u16:4+events_unbound07:01:274
3282107992926,2cyclictest3407300-21kworker/u16:4+flush-8:004:53:314
3282117992827,0cyclictest0-21swapper/705:39:567
3282117992826,1cyclictest0-21swapper/703:48:477
3282113992826,2cyclictest3407300-21kworker/u16:4+flush-8:006:54:006
3282113992826,2cyclictest3407300-21kworker/u16:4+events_unbound07:08:456
3282113992826,2cyclictest3407300-21kworker/u16:4+events_unbound06:13:526
3282109992826,2cyclictest3356469-21kworker/u16:0+flush-8:003:57:425
3282107992826,2cyclictest3841794-21kworker/u16:4+events_unbound08:18:274
3282107992826,2cyclictest3756063-21kworker/u16:1+events_unbound07:41:514
3282117992727,0cyclictest0-21swapper/708:08:267
3282117992726,0cyclictest0-21swapper/708:31:517
3282117992726,0cyclictest0-21swapper/707:47:357
3282117992726,0cyclictest0-21swapper/704:11:207
3282113992725,2cyclictest3872324-21kworker/u16:3+events_unbound08:32:536
3282113992725,2cyclictest3478076-21kworker/u16:1+flush-8:005:10:436
3282109992725,2cyclictest3756063-21kworker/u16:1+flush-8:008:50:135
3282109992725,2cyclictest3528980-21kworker/u16:3+events_unbound05:56:135
3282109992725,2cyclictest3407300-21kworker/u16:4+events_unbound07:02:145
3282109992725,2cyclictest3407300-21kworker/u16:4+events_unbound06:33:155
3282107992725,2cyclictest3841794-21kworker/u16:4+flush-8:008:00:034
3282107992725,2cyclictest3407300-21kworker/u16:4+flush-8:006:33:534
3282107992725,2cyclictest3407300-21kworker/u16:4+flush-8:005:22:524
3282107992725,2cyclictest3356652-21kworker/u16:2+events_unbound04:07:514
3282107992725,2cyclictest3356469-21kworker/u16:0+events_unbound04:28:144
3282117992625,0cyclictest0-21swapper/704:23:457
3282109992624,2cyclictest3756063-21kworker/u16:1+events_unbound07:51:125
3282107992624,2cyclictest3841794-21kworker/u16:4+events_unbound08:06:384
3282107992624,2cyclictest3670094-21kworker/u16:0+events_unbound07:05:304
3282117992524,0cyclictest0-21swapper/707:58:387
3282117992524,0cyclictest0-21swapper/705:03:477
3282117992524,0cyclictest0-21swapper/703:43:397
3282113992523,2cyclictest3528554-21kworker/u16:2+flush-8:005:25:186
3282113992522,2cyclictest3528554-21kworker/u16:2+events_unbound05:23:296
3282109992523,2cyclictest3841794-21kworker/u16:4+events_unbound08:37:505
3282109992523,2cyclictest3326162-21kworker/u16:2+events_unbound03:42:035
3282109992522,2cyclictest3478076-21kworker/u16:1+flush-8:005:28:325
3282107992523,2cyclictest3670094-21kworker/u16:0+flush-8:006:40:284
3282107992523,2cyclictest3650065-21kworker/u16:1+flush-8:006:32:304
3282107992523,2cyclictest3478076-21kworker/u16:1+events_unbound05:36:074
3282107992523,2cyclictest3427255-21kworker/u16:3+events_unbound04:32:194
3282107992523,2cyclictest3407300-21kworker/u16:4+events_unbound05:09:524
3282107992523,2cyclictest3261504-21kworker/u16:0+flush-8:003:25:274
3282117992423,0cyclictest0-21swapper/707:37:357
3282117992423,0cyclictest0-21swapper/707:18:527
3282117992419,4cyclictest3457917-21latency_hist04:48:307
3282113992422,2cyclictest3568803-21kworker/u16:2+flush-8:006:24:436
3282109992422,2cyclictest3478076-21kworker/u16:1+events_unbound05:17:125
3282109992422,2cyclictest3356469-21kworker/u16:0+flush-8:004:46:315
3282109992422,2cyclictest3291862-21kworker/u16:1+flush-8:003:53:265
3282107992422,2cyclictest3756063-21kworker/u16:1+flush-8:007:34:064
3282107992422,2cyclictest3568803-21kworker/u16:2+flush-8:006:10:294
3282107992422,2cyclictest3568803-21kworker/u16:2+events_unbound06:21:474
3282107992422,2cyclictest3407300-21kworker/u16:4+events_unbound04:42:034
3282117992322,0cyclictest0-21swapper/708:38:067
3282117992322,0cyclictest0-21swapper/706:33:587
3282117992322,0cyclictest0-21swapper/704:40:047
3282113992321,2cyclictest3872324-21kworker/u16:3+flush-8:008:22:426
3282109992321,2cyclictest3811144-21kworker/u16:3+events_unbound07:53:565
3282109992321,2cyclictest3407300-21kworker/u16:4+events_unbound06:56:325
3282107992322,1cyclictest3841794-21kworker/u16:4+events_unbound08:38:514
3282107992321,2cyclictest3568803-21kworker/u16:2+events_unbound05:55:304
3282107992321,2cyclictest3407300-21kworker/u16:4+events_unbound05:46:444
3282107992320,2cyclictest3756063-21kworker/u16:1+flush-8:008:33:384
3282107992320,2cyclictest3478076-21kworker/u16:1+flush-8:005:28:554
3282117992221,0cyclictest0-21swapper/708:43:347
3282117992221,0cyclictest0-21swapper/707:53:587
3282117992221,0cyclictest0-21swapper/707:10:387
3282117992220,1cyclictest0-21swapper/705:12:437
328211799220,21cyclictest4175659-21snmpd04:31:017
3282113992220,2cyclictest3756063-21kworker/u16:1+flush-8:008:18:296
3282113992220,2cyclictest3568803-21kworker/u16:2+events_unbound06:43:546
3282109992220,2cyclictest3756063-21kworker/u16:1+events_unbound07:34:215
3282109992220,2cyclictest3756063-21kworker/u16:1+events_unbound07:21:275
3282109992220,2cyclictest3407300-21kworker/u16:4+flush-8:004:40:435
3282107992220,2cyclictest3756063-21kworker/u16:1+flush-8:008:28:504
3282107992220,2cyclictest3478076-21kworker/u16:1+flush-8:005:13:444
3282107992220,2cyclictest3291862-21kworker/u16:1+events_unbound03:56:024
3282107992220,2cyclictest3291862-21kworker/u16:1+events_unbound03:43:574
3282113992119,2cyclictest3756063-21kworker/u16:1+flush-8:007:33:586
3282113992119,2cyclictest3291862-21kworker/u16:1+flush-8:003:49:016
3282113992118,2cyclictest3291862-21kworker/u16:1+flush-8:003:33:436
3282109992119,2cyclictest3407300-21kworker/u16:4+flush-8:006:03:395
3282109992119,2cyclictest3356652-21kworker/u16:2+flush-8:003:58:535
3282109992119,2cyclictest1741888-21kworker/u16:3+events_unbound03:27:125
3282107992119,2cyclictest3756063-21kworker/u16:1+flush-8:007:30:124
3282107992119,2cyclictest3407300-21kworker/u16:4+flush-8:006:53:534
3282117992020,0cyclictest0-21swapper/705:38:277
3282117992019,0cyclictest0-21swapper/707:00:197
3282117992019,0cyclictest0-21swapper/705:59:117
3282113992018,2cyclictest3356469-21kworker/u16:0+flush-8:004:13:466
3282113992017,2cyclictest3407300-21kworker/u16:4+flush-8:006:48:586
3282109992018,2cyclictest3407300-21kworker/u16:4+flush-8:005:07:515
3282109992018,2cyclictest3356469-21kworker/u16:0+flush-8:004:29:005
3282117991918,0cyclictest0-21swapper/705:03:147
3282113991917,2cyclictest3811144-21kworker/u16:3+events_unbound07:48:516
3282113991917,2cyclictest3407300-21kworker/u16:4+flush-8:004:23:446
3282113991917,2cyclictest3407300-21kworker/u16:4+events_unbound06:38:536
3282117991818,0cyclictest0-21swapper/708:27:117
3282117991818,0cyclictest0-21swapper/706:18:107
3282117991817,0cyclictest0-21swapper/704:18:277
3282117991817,0cyclictest0-21swapper/703:28:547
3282113991816,2cyclictest3650065-21kworker/u16:1+flush-8:006:28:486
3282113991816,2cyclictest3356652-21kworker/u16:2+flush-8:005:03:496
3282109991816,2cyclictest3528980-21kworker/u16:3+flush-8:005:43:415
3282109991816,2cyclictest3528980-21kworker/u16:3+events_unbound05:34:025
3282109991816,2cyclictest3467714-21kworker/u16:3+flush-8:004:50:385
3282107991816,2cyclictest3568803-21kworker/u16:2+flush-8:006:17:514
3282117991716,0cyclictest0-21swapper/707:08:267
3282117991716,0cyclictest0-21swapper/706:46:077
3282117991716,0cyclictest0-21swapper/705:48:457
3282113991715,2cyclictest3528980-21kworker/u16:3+flush-8:005:43:286
3282113991715,2cyclictest3356469-21kworker/u16:0+flush-8:004:08:556
3282113991713,3cyclictest3841794-21kworker/u16:4+flush-8:008:48:426
3282109991715,2cyclictest3872324-21kworker/u16:3+events_unbound08:23:545
3282117991615,0cyclictest0-21swapper/704:55:157
3282117991615,0cyclictest0-21swapper/704:22:117
3282113991614,2cyclictest3528980-21kworker/u16:3+flush-8:005:43:556
3282113991614,2cyclictest3528980-21kworker/u16:3+flush-8:005:33:536
3282113991614,2cyclictest3407300-21kworker/u16:4+flush-8:006:33:486
3282113991613,3cyclictest3670094-21kworker/u16:0+flush-8:006:58:436
3282117991514,0cyclictest0-21swapper/706:39:147
3282117991514,0cyclictest0-21swapper/703:58:527
3282117991512,2cyclictest4175659-21snmpd05:31:047
3282113991513,2cyclictest3841794-21kworker/u16:4+flush-8:008:27:026
3282113991513,2cyclictest3841794-21kworker/u16:4+flush-8:007:59:426
3282113991513,2cyclictest3407300-21kworker/u16:4+flush-8:005:13:456
3282113991512,2cyclictest3740597-21kworker/u16:2+flush-8:007:18:426
3282113991512,2cyclictest3528980-21kworker/u16:3+events_unbound05:58:496
3282109991513,2cyclictest3407300-21kworker/u16:4+events_unbound05:19:525
3282109991513,2cyclictest3356469-21kworker/u16:0+flush-8:004:13:435
3282117991414,0cyclictest0-21swapper/705:26:377
3282117991413,0cyclictest0-21swapper/706:04:027
3282117991413,0cyclictest0-21swapper/705:20:517
3282117991410,3cyclictest96-21ksoftirqd/708:48:457
328211799140,1cyclictest0-21swapper/706:08:537
3282113991412,2cyclictest3770692-21kworker/u16:0+flush-8:007:43:536
3282113991412,2cyclictest3478076-21kworker/u16:1+flush-8:005:28:456
3282113991411,3cyclictest3427255-21kworker/u16:3+flush-8:004:30:556
3282113991311,2cyclictest3740597-21kworker/u16:2+flush-8:007:28:446
3282113991311,2cyclictest3740597-21kworker/u16:2+events_unbound07:38:476
3282113991311,2cyclictest3608534-21kworker/u16:0+events_unbound06:03:526
3282113991311,2cyclictest3326162-21kworker/u16:2+flush-8:003:41:296
3282109991311,2cyclictest3756063-21kworker/u16:1+flush-8:007:29:205
3282109991311,2cyclictest3356469-21kworker/u16:0+events_unbound04:34:435
3282107991311,2cyclictest3568803-21kworker/u16:2+events_unbound06:05:514
3282113991210,2cyclictest3756063-21kworker/u16:1+events_unbound07:23:466
3282113991210,2cyclictest3528980-21kworker/u16:3+flush-8:005:58:296
328211399120,1cyclictest0-21swapper/604:54:436
328211399120,12cyclictest0-21swapper/606:11:486
328211799118,2cyclictest4175659-21snmpd03:57:387
328211399119,2cyclictest3841794-21kworker/u16:4+flush-8:008:33:556
328211399119,2cyclictest3356469-21kworker/u16:0+flush-8:004:43:556
328211399119,2cyclictest2568943-21kworker/u16:4+flush-8:003:28:346
3282113991110,1cyclictest0-21swapper/608:48:116
3282113991110,1cyclictest0-21swapper/603:26:076
328211399110,1cyclictest0-21swapper/604:04:166
328211399110,11cyclictest0-21swapper/608:42:496
328211399108,2cyclictest3568803-21kworker/u16:2+flush-8:005:50:246
32821139987,1cyclictest0-21swapper/607:56:386
32821139986,2cyclictest3670094-21kworker/u16:0+events_unbound07:13:446
32821139983,4cyclictest3331974-21grep03:43:516
32821139972,4cyclictest3438847-21hwlatdetect04:38:486
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional