You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 16:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Sat Aug 01, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
264359325646,7sleep50-21swapper/507:07:165
264346025419,30sleep70-21swapper/707:05:257
264360224534,8sleep40-21swapper/407:07:234
2643977994438,5cyclictest2813121-21latency_hist08:33:487
2643975994441,2cyclictest2799853-21kworker/u16:2+events_unbound09:48:496
2643977994238,3cyclictest1067-21rs:main7
2643970994240,2cyclictest2784378-21kworker/u16:3+events_unbound08:44:195
2643977994136,4cyclictest2991540-21latency_hist09:53:487
2643970994139,2cyclictest2823277-21kworker/u16:0+flush-8:009:24:215
2643975994038,2cyclictest3028724-21kworker/u16:0+events_unbound10:37:346
2643975993735,2cyclictest2799853-21kworker/u16:2+events_unbound09:24:236
2643975993734,2cyclictest2784378-21kworker/u16:3+flush-8:008:33:506
2643970993634,2cyclictest3028724-21kworker/u16:0+events_unbound11:00:265
2643970993634,2cyclictest2799853-21kworker/u16:2+events_unbound09:32:575
2643970993634,2cyclictest2799853-21kworker/u16:2+events_unbound09:11:455
2643970993533,2cyclictest3321223-21kworker/u16:1+events_unbound12:38:175
2643970993533,2cyclictest3200115-21kworker/u16:2+events_unbound12:11:135
2643970993533,2cyclictest3200115-21kworker/u16:2+events_unbound11:22:295
2643970993533,2cyclictest2799853-21kworker/u16:2+events_unbound09:47:465
2643975993432,2cyclictest3077472-21kworker/u16:3+events_unbound10:32:576
2643975993432,2cyclictest3028724-21kworker/u16:0+events_unbound10:52:186
2643970993432,2cyclictest3321223-21kworker/u16:1+events_unbound12:15:295
2643970993432,2cyclictest3258656-21kworker/u16:1+events_unbound11:40:505
2643970993432,2cyclictest3200115-21kworker/u16:2+events_unbound12:22:125
2643970993432,2cyclictest3028724-21kworker/u16:0+events_unbound10:43:305
2643970993432,2cyclictest3028724-21kworker/u16:0+events_unbound10:13:185
2643970993432,2cyclictest3001438-21kworker/u16:4+flush-8:010:30:495
2643970993432,2cyclictest2927053-21kworker/u16:1+events_unbound10:05:225
2643970993432,2cyclictest2823277-21kworker/u16:0+flush-8:009:40:495
2643970993432,2cyclictest2823277-21kworker/u16:0+events_unbound09:21:355
2643970993331,2cyclictest3273413-21kworker/u16:3+events_unbound12:03:065
2643970993331,2cyclictest3200115-21kworker/u16:2+events_unbound11:45:535
2643970993331,2cyclictest3200115-21kworker/u16:2+events_unbound11:45:535
2643970993331,2cyclictest3151397-21kworker/u16:5+events_unbound11:07:505
2643970993331,2cyclictest3001438-21kworker/u16:4+events_unbound10:01:375
2643970993331,2cyclictest2823277-21kworker/u16:0+events_unbound09:52:535
2643970993330,2cyclictest3028724-21kworker/u16:0+events_unbound10:33:485
2643975993230,2cyclictest3028724-21kworker/u16:0+events_unbound10:22:266
2643970993230,2cyclictest3151397-21kworker/u16:5+events_unbound11:27:425
2643970993230,2cyclictest3090045-21kworker/u16:1+events_unbound11:17:215
2643970993230,2cyclictest3090045-21kworker/u16:1+events_unbound11:11:035
2643970993230,2cyclictest3028724-21kworker/u16:0+events_unbound10:53:345
2643970993230,2cyclictest3028724-21kworker/u16:0+events_unbound10:47:215
2643977993130,0cyclictest0-21swapper/710:39:127
2643977993127,3cyclictest3261072-21latency_hist11:43:477
2643977993126,4cyclictest3248841-21latency_hist11:38:477
2643975993130,1cyclictest3028724-21kworker/u16:0+events_unbound11:25:196
2643975993129,2cyclictest3321223-21kworker/u16:1+flush-8:012:29:416
2643975993129,2cyclictest3200115-21kworker/u16:2+events_unbound11:19:576
2643975993128,2cyclictest2676624-21kworker/u16:0+events_unbound07:39:036
2643970993129,2cyclictest3321223-21kworker/u16:1+flush-8:012:26:015
2643970993129,2cyclictest3321223-21kworker/u16:1+flush-8:012:26:015
2643970993129,2cyclictest3200115-21kworker/u16:2+events_unbound11:32:335
2643970993129,2cyclictest3090045-21kworker/u16:1+events_unbound10:58:375
2643970993129,2cyclictest3028724-21kworker/u16:0+events_unbound10:20:215
2643970993129,2cyclictest2799853-21kworker/u16:2+events_unbound09:38:145
2643975993028,2cyclictest3200115-21kworker/u16:2+events_unbound11:39:456
2643975993028,2cyclictest3090045-21kworker/u16:1+events_unbound10:47:096
2643975993028,2cyclictest3001438-21kworker/u16:4+events_unbound09:59:556
2643975993028,2cyclictest2927053-21kworker/u16:1+events_unbound10:06:386
2643970993028,2cyclictest3200115-21kworker/u16:2+flush-8:012:07:255
2643970993028,2cyclictest2927053-21kworker/u16:1+events_unbound10:14:545
2643970993028,2cyclictest2799853-21kworker/u16:2+events_unbound09:14:495
2643975992927,2cyclictest3200115-21kworker/u16:2+events_unbound12:20:056
2643975992927,2cyclictest3028724-21kworker/u16:0+events_unbound12:00:576
2643975992927,2cyclictest3028724-21kworker/u16:0+events_unbound11:48:376
2643975992927,2cyclictest3028724-21kworker/u16:0+events_unbound11:48:376
2643975992927,2cyclictest2799853-21kworker/u16:2+events_unbound09:13:176
2643970992927,2cyclictest3028724-21kworker/u16:0+flush-8:011:34:495
2643970992927,2cyclictest3001438-21kworker/u16:4+events_unbound10:24:375
2643970992927,2cyclictest3001438-21kworker/u16:4+events_unbound10:24:375
2643967992926,3cyclictest2927053-21kworker/u16:1+flush-8:009:59:214
26435172297,7sleep60-21swapper/607:06:126
2643977992826,1cyclictest3321366-21ssh12:07:047
2643975992826,2cyclictest3001438-21kworker/u16:4+events_unbound10:40:306
2643975992826,2cyclictest2823277-21kworker/u16:0+flush-8:009:23:096
2643975992826,2cyclictest2823277-21kworker/u16:0+events_unbound09:18:356
2643970992826,2cyclictest3321223-21kworker/u16:1+flush-8:012:31:285
2643970992826,2cyclictest2676624-21kworker/u16:0+events_unbound07:36:585
31751192270,1chrt3175118-21ssh11:08:137
2643977992726,0cyclictest0-21swapper/709:12:097
2643977992725,1cyclictest0-21swapper/711:00:217
2643975992725,2cyclictest3151397-21kworker/u16:5+events_unbound11:37:586
2643977992625,0cyclictest0-21swapper/708:02:147
2643977992624,1cyclictest3332365-21ssh12:09:517
2643977992624,1cyclictest3308971-21ssh12:01:447
2643975992624,2cyclictest3321223-21kworker/u16:1+events_unbound12:16:146
2643975992624,2cyclictest3200115-21kworker/u16:2+flush-8:012:06:186
2643975992624,2cyclictest3200115-21kworker/u16:2+events_unbound11:56:496
2643975992624,2cyclictest3151397-21kworker/u16:5+events_unbound11:10:016
2643975992624,2cyclictest3151397-21kworker/u16:5+events_unbound11:06:266
2643975992624,2cyclictest3062012-21kworker/u16:2+events_unbound10:27:136
2643975992624,2cyclictest3062012-21kworker/u16:2+events_unbound10:27:136
2643975992624,2cyclictest2823277-21kworker/u16:0+events_unbound09:43:466
2643970992624,2cyclictest3151397-21kworker/u16:5+events_unbound11:53:515
2643970992624,2cyclictest2686899-21kworker/u16:1+events_unbound07:31:515
2643970992624,2cyclictest2676624-21kworker/u16:0+events_unbound07:54:125
2643970992623,2cyclictest2823277-21kworker/u16:0+events_unbound08:48:575
2643970992623,2cyclictest2735269-21kworker/u16:1+events_unbound08:38:515
2643967992623,2cyclictest2823277-21kworker/u16:0+flush-8:009:17:574
2643977992524,0cyclictest0-21swapper/710:27:287
2643977992524,0cyclictest0-21swapper/710:27:287
2643977992524,0cyclictest0-21swapper/708:25:027
2643975992523,2cyclictest3200115-21kworker/u16:2+events_unbound11:31:176
2643975992523,2cyclictest3090045-21kworker/u16:1+events_unbound11:03:146
2643975992523,2cyclictest2927053-21kworker/u16:1+flush-8:009:47:136
2643970992523,2cyclictest1949794-21kworker/u16:4+events_unbound07:24:515
2643967992523,2cyclictest3001438-21kworker/u16:4+events_unbound10:14:034
2643967992523,2cyclictest2676624-21kworker/u16:0+flush-8:007:44:134
2643977992423,0cyclictest0-21swapper/710:47:327
2643977992423,0cyclictest0-21swapper/710:38:177
2643977992423,0cyclictest0-21swapper/708:41:057
2643977992423,0cyclictest0-21swapper/708:08:187
2643977992423,0cyclictest0-21swapper/707:40:077
2643975992422,2cyclictest3356560-21kworker/u16:0+events_unbound12:36:026
2643975992422,2cyclictest3151397-21kworker/u16:5+events_unbound11:53:456
2643975992422,2cyclictest2989151-21kworker/u16:3+events_unbound09:56:096
2643970992422,2cyclictest2927053-21kworker/u16:1+events_unbound09:56:445
2643970992422,2cyclictest2676624-21kworker/u16:0+events_unbound07:44:575
2643970992422,2cyclictest1949794-21kworker/u16:4+events_unbound07:49:215
2643967992422,2cyclictest3151397-21kworker/u16:5+events_unbound11:04:154
2643977992322,0cyclictest0-21swapper/712:35:027
2643977992322,0cyclictest0-21swapper/709:07:027
2643977992322,0cyclictest0-21swapper/709:07:027
2643977992322,0cyclictest0-21swapper/708:35:347
2643977992322,0cyclictest0-21swapper/707:57:147
2643977992318,3cyclictest125-21kswapd011:48:477
2643977992318,3cyclictest125-21kswapd011:48:477
2643975992321,2cyclictest3200115-21kworker/u16:2+events_unbound12:25:176
2643975992321,2cyclictest3200115-21kworker/u16:2+events_unbound12:25:176
2643975992321,2cyclictest3028724-21kworker/u16:0+events_unbound10:11:196
2643975992321,2cyclictest2823277-21kworker/u16:0+flush-8:009:36:336
2643975992321,2cyclictest2676624-21kworker/u16:0+events_unbound07:51:596
2643975992321,2cyclictest1949794-21kworker/u16:4+events_unbound07:54:576
2643970992321,2cyclictest3200115-21kworker/u16:2+events_unbound11:52:125
2643970992321,2cyclictest1949794-21kworker/u16:4+events_unbound08:01:145
2643967992321,2cyclictest2595617-21kworker/u16:2+flush-8:007:34:184
2643967992321,2cyclictest1949794-21kworker/u16:4+flush-8:007:13:534
2643967992320,2cyclictest2784378-21kworker/u16:3+events_unbound08:44:024
2643977992221,0cyclictest0-21swapper/712:20:247
2643977992221,0cyclictest0-21swapper/711:15:127
2643977992221,0cyclictest0-21swapper/709:47:527
2643977992221,0cyclictest0-21swapper/709:43:327
2643977992221,0cyclictest0-21swapper/708:46:267
2643977992220,1cyclictest3296284-21ssh11:55:597
2643975992220,2cyclictest3139066-21kworker/u16:3+events_unbound10:57:306
2643970992220,2cyclictest2850024-21kworker/u16:1+events_unbound09:00:175
2643970992220,2cyclictest1949794-21kworker/u16:4+events_unbound07:09:545
2643967992220,2cyclictest3356560-21kworker/u16:0+events_unbound12:24:154
2643967992220,2cyclictest3356560-21kworker/u16:0+events_unbound12:24:154
2643967992220,2cyclictest2784377-21kworker/u16:0+events_unbound08:24:174
2643967992219,2cyclictest3001438-21kworker/u16:4+events_unbound10:19:164
2643977992120,0cyclictest0-21swapper/709:31:167
2643977992120,0cyclictest0-21swapper/709:26:397
2643977992120,0cyclictest0-21swapper/709:03:257
2643977992120,0cyclictest0-21swapper/707:38:307
2643977992120,0cyclictest0-21swapper/707:33:197
2643975992119,2cyclictest3273413-21kworker/u16:3+events_unbound12:11:296
2643975992119,2cyclictest3151397-21kworker/u16:5+events_unbound11:16:186
2643975992119,2cyclictest2644204-21kworker/u16:1+events_unbound07:12:586
2643970992119,2cyclictest2784377-21kworker/u16:0+events_unbound08:21:225
2643970992119,2cyclictest2735269-21kworker/u16:1+events_unbound08:32:185
2643967992119,2cyclictest3200115-21kworker/u16:2+flush-8:012:34:174
2643977992019,0cyclictest0-21swapper/708:20:067
2643977992019,0cyclictest0-21swapper/708:11:267
2643977992019,0cyclictest0-21swapper/707:23:157
2643977992018,1cyclictest0-21swapper/710:55:147
2643977992015,4cyclictest3371256-21latency_hist12:28:477
2643977992015,4cyclictest3371256-21latency_hist12:28:477
264397799200,18cyclictest1302-21snmpd11:19:277
2643975992018,2cyclictest2927053-21kworker/u16:1+events_unbound09:31:456
2643975992018,2cyclictest2799853-21kworker/u16:2+events_unbound08:50:586
2643975992018,2cyclictest2784378-21kworker/u16:3+flush-8:008:39:196
2643975992018,2cyclictest2595617-21kworker/u16:2+events_unbound07:26:586
2643970992018,2cyclictest2850024-21kworker/u16:1+events_unbound09:06:345
2643970992018,2cyclictest2850024-21kworker/u16:1+events_unbound09:06:345
2643967992017,3cyclictest3200115-21kworker/u16:2+events_unbound12:09:024
2643967992017,2cyclictest3200115-21kworker/u16:2+flush-8:011:19:044
2643967992017,2cyclictest2927053-21kworker/u16:1+events_unbound10:09:044
2643977991917,1cyclictest0-21swapper/709:16:367
2643975991917,2cyclictest3028724-21kworker/u16:0+events_unbound10:18:456
2643975991917,2cyclictest2735269-21kworker/u16:1+events_unbound08:00:586
2643975991917,2cyclictest2676624-21kworker/u16:0+events_unbound07:37:576
2643970991917,2cyclictest2850024-21kworker/u16:1+events_unbound08:54:235
2643970991917,2cyclictest2644204-21kworker/u16:1+events_unbound07:18:145
2643967991917,2cyclictest3200115-21kworker/u16:2+events_unbound11:29:164
2643977991817,0cyclictest0-21swapper/711:26:187
2643977991817,0cyclictest0-21swapper/711:09:097
2643977991817,0cyclictest0-21swapper/709:58:257
2643977991817,0cyclictest0-21swapper/708:18:337
2643977991817,0cyclictest0-21swapper/707:12:227
264397799181,15cyclictest3233525-21ssh11:29:127
2643975991816,2cyclictest2850024-21kworker/u16:1+events_unbound09:00:586
2643970991816,2cyclictest2799853-21kworker/u16:2+events_unbound08:36:055
2643970991816,2cyclictest1949794-21kworker/u16:4+events_unbound08:08:145
2643970991816,2cyclictest1949794-21kworker/u16:4+events_unbound07:41:065
2643967991816,2cyclictest3356560-21kworker/u16:0+events_unbound12:29:144
2643967991816,2cyclictest3200115-21kworker/u16:2+events_unbound12:17:014
2643977991716,0cyclictest0-21swapper/707:45:267
2643977991715,1cyclictest0-21swapper/712:14:057
264397799170,1cyclictest0-21swapper/707:24:127
264397799170,16cyclictest0-21swapper/710:09:137
2643975991715,2cyclictest2784378-21kworker/u16:3+flush-8:008:44:086
2643975991715,2cyclictest2595617-21kworker/u16:2+events_unbound08:12:596
2643975991714,2cyclictest2676624-21kworker/u16:0+events_unbound07:43:506
2643975991714,2cyclictest1949794-21kworker/u16:4+flush-8:008:13:586
2643970991715,2cyclictest2676624-21kworker/u16:0+events_unbound07:22:545
2643967991714,2cyclictest2676624-21kworker/u16:0+flush-8:007:33:484
2643977991615,0cyclictest0-21swapper/710:29:597
2643977991615,0cyclictest0-21swapper/707:16:467
2643977991614,1cyclictest2881322-21diskmemload10:03:547
2643977991611,4cyclictest2861832-21latency_hist08:58:477
2643975991614,2cyclictest2823277-21kworker/u16:0+events_unbound09:04:456
2643975991614,2cyclictest2823277-21kworker/u16:0+events_unbound09:04:456
2643975991614,2cyclictest2784378-21kworker/u16:3+flush-8:008:19:036
2643975991614,2cyclictest2686899-21kworker/u16:1+flush-8:007:29:186
2643970991614,2cyclictest2735269-21kworker/u16:1+events_unbound08:27:025
2643970991614,2cyclictest1949794-21kworker/u16:4+events_unbound08:09:265
2643967991614,2cyclictest3001438-21kworker/u16:4+flush-8:010:39:174
2643967991614,2cyclictest2784378-21kworker/u16:3+flush-8:008:39:174
2643967991612,3cyclictest2840107-21kworker/u16:4+flush-8:008:54:144
2643977991514,0cyclictest0-21swapper/708:51:257
2643977991510,4cyclictest2918072-21latency_hist09:23:487
2643975991513,2cyclictest2784378-21kworker/u16:3+events_unbound08:30:586
2643975991513,2cyclictest2735269-21kworker/u16:1+events_unbound08:05:596
264397799149,4cyclictest3052867-21latency_hist10:18:477
2643977991412,1cyclictest2881322-21diskmemload11:49:107
2643975991412,2cyclictest1949794-21kworker/u16:4+events_unbound07:14:026
2643970991412,2cyclictest2735269-21kworker/u16:1+events_unbound08:16:135
2643967991412,2cyclictest3200115-21kworker/u16:2+flush-8:011:39:194
2643967991412,2cyclictest3200115-21kworker/u16:2+events_unbound11:24:014
2643967991412,2cyclictest2644204-21kworker/u16:1+events_unbound07:09:034
2643967991411,3cyclictest3001438-21kworker/u16:4+flush-8:010:24:034
2643967991411,3cyclictest3001438-21kworker/u16:4+flush-8:010:24:034
264396799140,1cyclictest0-21swapper/409:23:594
264396799140,1cyclictest0-21swapper/407:49:134
2643977991312,0cyclictest0-21swapper/709:59:187
2643977991312,0cyclictest0-21swapper/709:34:107
2643977991312,0cyclictest0-21swapper/707:48:527
2643967991312,1cyclictest0-21swapper/410:36:024
264396799130,12cyclictest0-21swapper/410:48:484
264397799129,2cyclictest1302-21snmpd12:33:417
264397599120,1cyclictest0-21swapper/608:55:346
2643967991211,1cyclictest0-21swapper/410:55:264
2643967991210,2cyclictest3151397-21kworker/u16:5+events_unbound10:59:024
2643967991210,2cyclictest3001438-21kworker/u16:4+flush-8:010:44:144
2643967991210,2cyclictest2784377-21kworker/u16:0+events_unbound08:29:114
264396799120,1cyclictest0-21swapper/408:23:174
264396799120,12cyclictest0-21swapper/412:02:354
264396799120,12cyclictest0-21swapper/409:19:254
264396799120,11cyclictest0-21swapper/407:53:574
264396799120,0cyclictest0-21swapper/411:55:014
264397799117,3cyclictest1302-21snmpd10:21:377
264397599119,2cyclictest2799853-21kworker/u16:2+events_unbound08:24:106
2643967991110,1cyclictest0-21swapper/411:38:284
2643967991110,1cyclictest0-21swapper/411:14:114
2643967991110,1cyclictest0-21swapper/411:11:404
2643967991110,1cyclictest0-21swapper/409:02:424
2643967991110,1cyclictest0-21swapper/408:13:304
264396799110,11cyclictest0-21swapper/410:30:594
264396799110,11cyclictest0-21swapper/408:51:024
264396799110,11cyclictest0-21swapper/408:15:334
264396799110,11cyclictest0-21swapper/408:03:444
264396799110,11cyclictest0-21swapper/407:41:394
264396799110,0cyclictest0-21swapper/410:08:174
264396799109,1cyclictest0-21swapper/412:05:354
264396799109,1cyclictest0-21swapper/409:51:064
264396799109,1cyclictest0-21swapper/409:46:034
264396799109,1cyclictest0-21swapper/409:29:304
264396799109,1cyclictest0-21swapper/409:09:474
264396799108,2cyclictest3151397-21kworker/u16:5+flush-8:011:44:204
264396799108,2cyclictest3151397-21kworker/u16:5+flush-8:011:44:204
264396799108,2cyclictest2823277-21kworker/u16:0+flush-8:009:39:124
26439759995,3cyclictest2667703-21cat07:18:596
26439679998,1cyclictest0-21swapper/409:07:164
26439679998,1cyclictest0-21swapper/409:07:164
26439679998,1cyclictest0-21swapper/408:07:504
26439679995,3cyclictest3274566-21cat11:49:024
26439679987,1cyclictest0-21swapper/407:21:004
26439679986,2cyclictest2989151-21kworker/u16:3+events_unbound09:54:034
26439679984,3cyclictest2677618-21tr07:24:004
26439679983,4cyclictest2947539-21tr09:34:074
26439679983,4cyclictest2815197-21grep08:34:054
26439679972,4cyclictest3347780-21expr12:19:004
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional