You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 12:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sun May 03, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27055725747,7sleep50-21swapper/519:04:395
27085425645,8sleep40-21swapper/419:08:474
271147994744,2cyclictest733972-21kworker/u16:4+events_unbound23:08:474
271158994443,0cyclictest0-21swapper/722:04:217
271158994439,4cyclictest601161-21latency_hist21:48:477
2707712432,36sleep70-21swapper/719:07:387
271158993833,3cyclictest610203-21ntpq21:49:137
271158993433,0cyclictest0-21swapper/721:28:457
271158993432,1cyclictest0-21swapper/721:21:017
271153993432,2cyclictest888046-21kworker/u16:1+flush-8:000:03:476
271152993432,2cyclictest187891-21kworker/u16:2+events_unbound19:24:025
271147993431,2cyclictest217282-21kworker/u16:3+flush-8:019:43:484
271158993332,0cyclictest0-21swapper/722:43:507
271158993331,1cyclictest504802-21diskmemload22:36:467
271158993331,1cyclictest504802-21diskmemload22:36:467
271158993231,0cyclictest0-21swapper/719:13:497
271158993230,1cyclictest671581-21ssh22:15:027
271158993227,4cyclictest914541-21latency_hist23:58:477
271158993227,4cyclictest914541-21latency_hist23:58:477
271153993228,3cyclictest938773-21kworker/u16:5+flush-8:000:28:476
271158993130,0cyclictest0-21swapper/721:09:027
271158993129,1cyclictest0-21swapper/723:26:057
27115899310,29cyclictest890415-21latency_hist23:48:487
271158993029,0cyclictest0-21swapper/723:50:097
271158993027,2cyclictest961941-21ssh00:17:017
271152993027,2cyclictest328920-21kworker/u16:4+flush-8:019:53:495
271158992928,0cyclictest0-21swapper/721:59:487
271158992928,0cyclictest0-21swapper/700:08:577
271158992927,1cyclictest577028-21ssh21:38:397
271158992927,1cyclictest0-21swapper/722:56:547
271152992927,2cyclictest904238-21kworker/u16:0+flush-8:000:14:035
271147992927,2cyclictest597797-21kworker/u16:2+flush-8:022:04:024
271158992827,0cyclictest0-21swapper/700:00:457
271158992826,1cyclictest0-21swapper/722:42:347
271158992826,1cyclictest0-21swapper/700:26:527
271153992826,2cyclictest456885-21kworker/u16:0+events_unbound21:09:096
271152992826,2cyclictest866699-21kworker/u16:2+events_unbound00:09:025
271147992827,1cyclictest597797-21kworker/u16:2+events_unbound21:46:054
271147992824,3cyclictest733972-21kworker/u16:4+flush-8:000:18:524
271158992725,1cyclictest0-21swapper/721:15:227
271152992725,2cyclictest445013-21kworker/u16:3+flush-8:021:48:485
271152992725,2cyclictest418574-21kworker/u16:2+flush-8:020:41:055
271147992725,2cyclictest733972-21kworker/u16:4+flush-8:023:59:574
271147992725,2cyclictest456885-21kworker/u16:0+flush-8:021:09:454
27056722717,7sleep60-21swapper/619:04:486
271158992625,0cyclictest0-21swapper/723:34:457
271158992625,0cyclictest0-21swapper/722:10:297
271158992625,0cyclictest0-21swapper/721:29:177
271153992624,2cyclictest904238-21kworker/u16:0+flush-8:000:18:476
271152992624,2cyclictest682581-21kworker/u16:0+events_unbound22:29:145
271152992624,2cyclictest418574-21kworker/u16:2+events_unbound20:51:065
271152992624,2cyclictest370975-21kworker/u16:1+events_unbound20:15:185
271152992624,2cyclictest370975-21kworker/u16:1+events_unbound20:07:415
271152992624,2cyclictest217282-21kworker/u16:3+events_unbound20:12:345
271152992623,3cyclictest456885-21kworker/u16:0+flush-8:020:54:145
271152992623,2cyclictest682581-21kworker/u16:0+events_unbound23:44:005
271147992624,2cyclictest830128-21kworker/u16:1+events_unbound23:28:474
271147992624,2cyclictest613324-21kworker/u16:4+events_unbound22:18:454
271158992524,0cyclictest0-21swapper/723:17:547
271158992524,0cyclictest0-21swapper/723:17:547
271158992523,1cyclictest878037-21ssh23:43:137
271158992523,1cyclictest697480-21ssh22:28:217
271153992523,2cyclictest719611-21kworker/u16:3+flush-8:022:59:046
271153992523,2cyclictest597797-21kworker/u16:2+events_unbound22:13:506
271153992523,2cyclictest353621-21kworker/u16:0+flush-8:020:28:476
271152992523,2cyclictest719611-21kworker/u16:3+flush-8:023:29:015
271152992523,2cyclictest187891-21kworker/u16:2+flush-8:019:35:335
271152992522,2cyclictest733972-21kworker/u16:4+events_unbound23:13:545
271152992522,2cyclictest733972-21kworker/u16:4+events_unbound23:13:545
271147992523,2cyclictest987123-21kworker/u16:0+events_unbound00:31:584
271147992522,2cyclictest682581-21kworker/u16:0+events_unbound23:44:054
271158992423,0cyclictest0-21swapper/722:59:387
271158992423,0cyclictest0-21swapper/700:32:287
271158992422,1cyclictest974303-21ssh00:22:247
271158992422,1cyclictest0-21swapper/719:19:147
271152992422,2cyclictest938773-21kworker/u16:5+flush-8:000:34:025
271152992422,2cyclictest904238-21kworker/u16:0+events_unbound23:56:425
271152992422,2cyclictest904238-21kworker/u16:0+events_unbound23:56:425
271152992422,2cyclictest682581-21kworker/u16:0+events_unbound23:41:355
271152992422,2cyclictest418574-21kworker/u16:2+flush-8:020:38:375
271152992422,2cyclictest418574-21kworker/u16:2+events_unbound21:02:095
271152992422,2cyclictest370975-21kworker/u16:1+events_unbound20:20:455
271152992422,2cyclictest370975-21kworker/u16:1+events_unbound19:59:075
271152992422,2cyclictest208076-21kworker/u16:0+events_unbound19:20:495
271147992421,2cyclictest530868-21kworker/u16:4+flush-8:021:34:034
271158992322,0cyclictest0-21swapper/723:19:177
271158992321,1cyclictest0-21swapper/723:07:217
271158992319,3cyclictest756648-21rm22:51:167
271153992321,2cyclictest987583-21kworker/u16:1+events_unbound00:34:096
271153992320,2cyclictest328920-21kworker/u16:4+flush-8:020:09:056
271152992321,2cyclictest682581-21kworker/u16:0+events_unbound23:19:385
271152992320,3cyclictest733972-21kworker/u16:4+flush-8:022:49:135
271152992320,2cyclictest456885-21kworker/u16:0+events_unbound21:03:485
271147992321,2cyclictest888046-21kworker/u16:1+flush-8:000:03:534
271147992321,2cyclictest418574-21kworker/u16:2+flush-8:020:39:044
271147992321,2cyclictest328920-21kworker/u16:4+events_unbound20:14:574
271147992320,2cyclictest370975-21kworker/u16:1+events_unbound19:59:014
271147992320,2cyclictest217282-21kworker/u16:3+flush-8:019:49:124
271158992221,0cyclictest0-21swapper/723:29:087
271158992221,0cyclictest0-21swapper/723:13:177
271158992221,0cyclictest0-21swapper/719:59:587
271153992220,2cyclictest530868-21kworker/u16:4+events_unbound21:24:186
271153992220,2cyclictest530868-21kworker/u16:4+events_unbound21:19:136
271153992220,2cyclictest187891-21kworker/u16:2+events_unbound19:24:066
271152992220,2cyclictest938773-21kworker/u16:5+events_unbound00:29:025
271152992220,2cyclictest733972-21kworker/u16:4+events_unbound22:48:145
271152992220,2cyclictest719611-21kworker/u16:3+events_unbound22:55:345
271152992220,2cyclictest445013-21kworker/u16:3+events_unbound21:56:215
271152992220,2cyclictest328920-21kworker/u16:4+events_unbound20:31:345
271152992220,2cyclictest328920-21kworker/u16:4+events_unbound20:31:345
271152992220,2cyclictest217282-21kworker/u16:3+events_unbound19:47:285
271152992220,2cyclictest187891-21kworker/u16:2+events_unbound19:16:335
271147992220,2cyclictest733972-21kworker/u16:4+events_unbound23:34:584
271147992220,2cyclictest682581-21kworker/u16:0+events_unbound22:51:534
271147992219,2cyclictest682581-21kworker/u16:0+events_unbound22:38:494
271158992120,0cyclictest0-21swapper/719:32:587
271158992119,1cyclictest708831-21ssh22:32:107
27115899210,20cyclictest1698-21dockerd00:35:297
271153992119,2cyclictest719611-21kworker/u16:3+events_unbound23:04:216
271153992119,2cyclictest682581-21kworker/u16:0+flush-8:022:39:116
271153992119,2cyclictest682581-21kworker/u16:0+flush-8:022:19:126
271153992119,2cyclictest525691-21kworker/u16:1+events_unbound22:28:456
271153992119,2cyclictest418574-21kworker/u16:2+events_unbound20:49:096
271153992118,2cyclictest217282-21kworker/u16:3+flush-8:019:44:086
271152992119,2cyclictest733972-21kworker/u16:4+flush-8:023:00:365
271152992119,2cyclictest682581-21kworker/u16:0+events_unbound22:34:025
271152992119,2cyclictest682581-21kworker/u16:0+events_unbound22:34:025
271152992119,2cyclictest597797-21kworker/u16:2+flush-8:021:46:325
271152992119,2cyclictest530868-21kworker/u16:4+events_unbound21:19:505
271152992119,2cyclictest456885-21kworker/u16:0+flush-8:021:26:145
271152992119,2cyclictest208076-21kworker/u16:0+events_unbound19:30:455
271147992119,2cyclictest733972-21kworker/u16:4+events_unbound23:53:444
271147992119,2cyclictest682581-21kworker/u16:0+flush-8:023:39:104
271147992119,2cyclictest682581-21kworker/u16:0+events_unbound22:56:344
271147992119,2cyclictest597797-21kworker/u16:2+events_unbound21:50:584
271147992119,2cyclictest525691-21kworker/u16:1+events_unbound21:30:584
271147992118,2cyclictest456885-21kworker/u16:0+flush-8:021:39:024
271147992118,2cyclictest445013-21kworker/u16:3+flush-8:021:13:574
271158992019,0cyclictest0-21swapper/722:19:337
271153992018,2cyclictest888046-21kworker/u16:1+flush-8:000:04:006
271153992018,2cyclictest370975-21kworker/u16:1+events_unbound19:59:036
271153992017,2cyclictest613324-21kworker/u16:4+flush-8:021:59:066
271152992018,2cyclictest733972-21kworker/u16:4+events_unbound00:24:135
271152992018,2cyclictest613324-21kworker/u16:4+flush-8:022:17:255
271152992018,2cyclictest613324-21kworker/u16:4+events_unbound22:03:115
271152992018,2cyclictest445013-21kworker/u16:3+flush-8:021:43:185
271152992018,2cyclictest328920-21kworker/u16:4+events_unbound20:25:565
271152992017,2cyclictest456885-21kworker/u16:0+events_unbound21:08:555
271147992018,2cyclictest904238-21kworker/u16:0+flush-8:000:09:074
271147992018,2cyclictest682581-21kworker/u16:0+events_unbound23:18:534
271147992018,2cyclictest445013-21kworker/u16:3+events_unbound21:54:574
271147992018,2cyclictest445013-21kworker/u16:3+events_unbound20:44:084
271147992018,2cyclictest187891-21kworker/u16:2+flush-8:019:14:034
271147992017,2cyclictest530868-21kworker/u16:4+events_unbound21:23:504
271158991918,0cyclictest0-21swapper/700:05:417
271158991915,3cyclictest1234-21snmpd20:28:447
271153991917,2cyclictest597797-21kworker/u16:2+events_unbound21:54:006
271153991917,2cyclictest530868-21kworker/u16:4+events_unbound21:33:486
271153991917,2cyclictest456885-21kworker/u16:0+flush-8:020:54:166
271152991917,2cyclictest938773-21kworker/u16:5+flush-8:000:22:415
271152991917,2cyclictest682581-21kworker/u16:0+events_unbound22:40:445
271152991917,2cyclictest328920-21kworker/u16:4+events_unbound19:42:135
271152991917,2cyclictest217282-21kworker/u16:3+events_unbound19:50:375
271152991916,2cyclictest719611-21kworker/u16:3+flush-8:023:33:535
271152991916,2cyclictest525691-21kworker/u16:1+events_unbound22:23:505
271147991917,2cyclictest682581-21kworker/u16:0+events_unbound22:20:544
271147991917,2cyclictest597797-21kworker/u16:2+events_unbound22:24:584
271147991916,2cyclictest597797-21kworker/u16:2+events_unbound22:28:534
271158991817,0cyclictest0-21swapper/721:39:227
271158991817,0cyclictest0-21swapper/720:59:487
271158991817,0cyclictest0-21swapper/720:32:587
271158991817,0cyclictest0-21swapper/720:32:587
27115899180,17cyclictest0-21swapper/720:09:107
271153991816,2cyclictest682581-21kworker/u16:0+events_unbound22:54:026
271153991816,2cyclictest353621-21kworker/u16:0+flush-8:020:14:096
271152991816,2cyclictest682581-21kworker/u16:0+events_unbound22:20:155
271152991816,2cyclictest597797-21kworker/u16:2+events_unbound22:05:245
271152991816,2cyclictest530868-21kworker/u16:4+events_unbound21:30:155
271152991816,2cyclictest418574-21kworker/u16:2+flush-8:020:47:095
271147991816,2cyclictest733972-21kworker/u16:4+flush-8:023:32:564
271147991816,2cyclictest733972-21kworker/u16:4+events_unbound23:17:584
271147991816,2cyclictest733972-21kworker/u16:4+events_unbound23:17:584
271147991816,2cyclictest525691-21kworker/u16:1+flush-8:021:18:584
271147991816,2cyclictest418574-21kworker/u16:2+events_unbound20:29:134
271147991816,2cyclictest418574-21kworker/u16:2+events_unbound20:29:134
271158991716,0cyclictest0-21swapper/720:49:587
271158991716,0cyclictest0-21swapper/720:43:497
271153991715,2cyclictest719611-21kworker/u16:3+events_unbound22:49:126
271153991715,2cyclictest418574-21kworker/u16:2+events_unbound20:59:036
271152991715,2cyclictest733972-21kworker/u16:4+events_unbound00:07:155
271152991715,2cyclictest682581-21kworker/u16:0+events_unbound23:07:415
271152991715,2cyclictest208076-21kworker/u16:0+events_unbound19:13:255
271147991715,2cyclictest719611-21kworker/u16:3+flush-8:023:10:454
271147991715,2cyclictest719611-21kworker/u16:3+events_unbound22:44:534
271147991715,2cyclictest682581-21kworker/u16:0+flush-8:022:34:454
271147991715,2cyclictest682581-21kworker/u16:0+flush-8:022:34:454
271147991715,2cyclictest217282-21kworker/u16:3+events_unbound19:44:104
271158991615,0cyclictest0-21swapper/721:55:577
271158991615,0cyclictest0-21swapper/720:21:577
271158991612,3cyclictest1234-21snmpd19:40:227
27115899160,14cyclictest485590-21latency_hist20:58:487
271153991614,2cyclictest938773-21kworker/u16:5+events_unbound00:19:166
271153991614,2cyclictest187891-21kworker/u16:2+flush-8:019:29:106
271153991613,3cyclictest525691-21kworker/u16:1+events_unbound22:04:166
271152991614,2cyclictest888046-21kworker/u16:1+events_unbound23:50:325
271152991614,2cyclictest456885-21kworker/u16:0+events_unbound21:18:285
27115299160,15cyclictest0-21swapper/523:09:035
271147991614,2cyclictest938773-21kworker/u16:5+events_unbound00:28:374
271147991614,2cyclictest208076-21kworker/u16:0+events_unbound19:29:034
271147991614,2cyclictest187891-21kworker/u16:2+events_unbound19:24:044
27115899150,14cyclictest0-21swapper/720:34:127
271153991514,1cyclictest0-21swapper/622:43:486
271153991513,2cyclictest830128-21kworker/u16:1+events_unbound23:24:176
271153991513,2cyclictest719611-21kworker/u16:3+events_unbound23:10:586
271152991513,2cyclictest830128-21kworker/u16:1+flush-8:023:28:155
271147991513,2cyclictest951199-21kworker/u16:3+events_unbound00:16:574
271147991513,2cyclictest597797-21kworker/u16:2+events_unbound22:09:154
271147991512,2cyclictest187891-21kworker/u16:2+events_unbound19:34:064
27114799150,15cyclictest0-21swapper/421:59:044
271158991413,0cyclictest0-21swapper/719:43:587
271153991413,1cyclictest0-21swapper/622:31:306
271153991413,1cyclictest0-21swapper/621:14:056
271153991412,2cyclictest682581-21kworker/u16:0+events_unbound22:34:086
271153991412,2cyclictest682581-21kworker/u16:0+events_unbound22:34:086
27115399140,1cyclictest0-21swapper/621:44:316
271152991412,2cyclictest904238-21kworker/u16:0+events_unbound00:02:595
271147991412,2cyclictest904238-21kworker/u16:0+events_unbound23:55:534
271147991412,2cyclictest904238-21kworker/u16:0+events_unbound23:55:534
271147991412,2cyclictest733972-21kworker/u16:4+events_unbound23:03:304
271147991412,2cyclictest1009337-21kworker/u16:2+events_unbound00:37:304
27114799140,13cyclictest0-21swapper/420:58:514
27115899138,4cyclictest6101-21gmain19:24:137
271158991312,0cyclictest0-21swapper/720:03:587
271158991312,0cyclictest0-21swapper/719:34:037
271153991312,1cyclictest0-21swapper/623:32:506
271153991312,1cyclictest0-21swapper/622:10:416
271153991312,1cyclictest0-21swapper/621:53:306
271153991311,2cyclictest987123-21kworker/u16:0+flush-8:000:29:036
271153991311,2cyclictest866699-21kworker/u16:2+events_unbound23:54:016
271153991311,2cyclictest866699-21kworker/u16:2+events_unbound23:54:016
271153991311,2cyclictest682581-21kworker/u16:0+events_unbound23:34:546
271153991311,2cyclictest445013-21kworker/u16:3+flush-8:020:44:186
271153991311,2cyclictest418574-21kworker/u16:2+flush-8:020:39:156
271153991311,2cyclictest370975-21kworker/u16:1+events_unbound20:19:016
271153991310,2cyclictest187891-21kworker/u16:2+events_unbound19:14:166
27115399130,13cyclictest0-21swapper/621:36:106
271152991311,2cyclictest597797-21kworker/u16:2+flush-8:022:11:075
271152991311,2cyclictest445013-21kworker/u16:3+events_unbound21:34:165
271147991312,1cyclictest0-21swapper/420:37:244
271147991311,2cyclictest370975-21kworker/u16:1+events_unbound20:09:034
271147991311,2cyclictest208076-21kworker/u16:0+events_unbound19:09:034
271147991310,2cyclictest418574-21kworker/u16:2+events_unbound20:49:074
27115899128,3cyclictest6032-21gmain19:49:017
27115899128,3cyclictest1234-21snmpd19:55:077
27115899128,3cyclictest1234-21snmpd19:12:397
271153991210,2cyclictest682581-21kworker/u16:0+events_unbound23:39:126
271153991210,2cyclictest328920-21kworker/u16:4+events_unbound19:34:126
27114799120,1cyclictest0-21swapper/420:06:304
27115899117,3cyclictest1234-21snmpd20:41:297
27115399119,2cyclictest86-21ksoftirqd/623:14:576
27115399119,2cyclictest86-21ksoftirqd/623:14:576
27115399119,2cyclictest418574-21kworker/u16:2+flush-8:021:04:176
271147991111,0cyclictest0-21swapper/419:57:314
271147991110,1cyclictest0-21swapper/421:06:064
27115899106,3cyclictest5729-21ssh-agent21:04:067
27115899103,6cyclictest5975-21gmain20:16:017
27115399108,2cyclictest86-21ksoftirqd/623:46:416
27115399108,2cyclictest719611-21kworker/u16:3+events_unbound23:21:496
27115399108,2cyclictest418574-21kworker/u16:2+flush-8:020:29:056
27115399108,2cyclictest418574-21kworker/u16:2+flush-8:020:29:056
27115399108,2cyclictest217282-21kworker/u16:3+flush-8:019:13:436
27115399107,2cyclictest332634-21/usr/sbin/munin19:39:096
27115399104,5cyclictest0-21swapper/623:49:066
27115399100,9cyclictest358303-21kthreadcore19:49:086
27114799108,2cyclictest328920-21kworker/u16:4+flush-8:020:24:014
2711539997,2cyclictest328920-21kworker/u16:4+flush-8:019:54:076
2711539997,1cyclictest0-21swapper/620:34:096
2711539995,3cyclictest328920-21kworker/u16:4+flush-8:020:04:086
2711539990,8cyclictest942201-21kthreadcore00:09:056
2711539990,8cyclictest301240-21kthreadcore19:19:086
2711479997,2cyclictest456885-21kworker/u16:0+events_unbound20:54:104
2711479995,3cyclictest302555-21netstat19:19:104
2711479986,2cyclictest353621-21kworker/u16:0+flush-8:020:19:144
2711539973,4cyclictest0-21swapper/621:39:016
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional