You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 03:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Thu Jul 09, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
63309825848,7sleep40-21swapper/419:09:084
633459994237,4cyclictest1213813-21latency_hist23:29:507
6329032404,30sleep70-21swapper/719:06:227
633449993735,2cyclictest969416-21kworker/u16:2+events_unbound21:53:084
633449993735,2cyclictest1018024-21kworker/u16:2+events_unbound22:47:494
633449993734,2cyclictest1018024-21kworker/u16:2+events_unbound22:18:174
633449993634,2cyclictest1152697-21kworker/u16:3+events_unbound23:37:494
633449993634,2cyclictest1152697-21kworker/u16:3+events_unbound23:37:494
633449993634,2cyclictest1116354-21kworker/u16:1+events_unbound23:07:044
633449993533,2cyclictest993562-21kworker/u16:5+events_unbound22:57:494
633449993533,2cyclictest993562-21kworker/u16:5+events_unbound22:57:494
633449993533,2cyclictest1325666-21kworker/u16:2+events_unbound00:37:164
633449993533,2cyclictest1201705-21kworker/u16:4+events_unbound23:49:294
633449993532,2cyclictest1018024-21kworker/u16:2+events_unbound23:20:004
633453993430,3cyclictest942107-21kworker/u16:0+flush-8:022:24:565
633449993432,2cyclictest993562-21kworker/u16:5+events_unbound22:29:374
633449993432,2cyclictest991110-21kworker/u16:1+events_unbound21:58:134
633449993432,2cyclictest775114-21kworker/u16:1+events_unbound21:38:014
633449993432,2cyclictest1262945-21kworker/u16:0+events_unbound23:58:204
633449993432,2cyclictest1262945-21kworker/u16:0+events_unbound23:51:404
63289123423,8sleep60-21swapper/619:06:136
633459993332,0cyclictest0-21swapper/721:49:537
633459993331,1cyclictest1018421-21ssh22:09:577
633459993331,1cyclictest1018421-21ssh22:09:577
633454993331,2cyclictest1190658-21kworker/u16:0+events_unbound23:35:036
633454993331,2cyclictest1190658-21kworker/u16:0+events_unbound23:35:036
633453993329,4cyclictest1116354-21kworker/u16:1+events_unbound22:54:515
633449993331,2cyclictest870295-21kworker/u16:3+flush-8:022:43:084
633449993331,2cyclictest870295-21kworker/u16:3+events_unbound22:23:084
633449993331,2cyclictest870295-21kworker/u16:3+events_unbound21:47:284
633449993331,2cyclictest870295-21kworker/u16:3+events_unbound21:41:214
633449993331,2cyclictest1201705-21kworker/u16:4+events_unbound00:12:524
633449993331,2cyclictest1201705-21kworker/u16:4+events_unbound00:09:484
633453993230,2cyclictest665148-21kworker/u16:1+flush-8:019:54:515
633449993230,2cyclictest1201705-21kworker/u16:4+events_unbound23:44:044
633449993230,2cyclictest1018024-21kworker/u16:2+events_unbound23:27:534
633449993230,2cyclictest1018024-21kworker/u16:2+events_unbound23:18:014
633449993229,2cyclictest942107-21kworker/u16:0+events_unbound22:13:204
633449993229,2cyclictest942107-21kworker/u16:0+events_unbound22:13:204
633449993129,2cyclictest870295-21kworker/u16:3+events_unbound22:31:014
633449993129,2cyclictest870295-21kworker/u16:3+events_unbound22:04:284
633449993129,2cyclictest763807-21kworker/u16:0+events_unbound21:21:564
633449993129,2cyclictest1325666-21kworker/u16:2+events_unbound00:31:404
633449993129,2cyclictest1325666-21kworker/u16:2+events_unbound00:24:244
633449993129,2cyclictest1018024-21kworker/u16:2+events_unbound23:14:164
633449993128,2cyclictest1116354-21kworker/u16:1+flush-8:023:01:444
63312023120,8sleep50-21swapper/519:09:255
633459993027,1cyclictest1177089-21perf23:14:517
633449993028,2cyclictest1152697-21kworker/u16:3+events_unbound00:28:204
633449993028,2cyclictest1101507-21kworker/u16:0+events_unbound22:51:444
633449993028,2cyclictest1018024-21kworker/u16:2+events_unbound23:32:404
633449993027,2cyclictest870295-21kworker/u16:3+events_unbound21:18:504
633453992927,2cyclictest1152697-21kworker/u16:3+events_unbound00:35:055
633449992927,2cyclictest993562-21kworker/u16:5+events_unbound22:07:494
633449992927,2cyclictest775114-21kworker/u16:1+events_unbound21:13:574
633449992927,2cyclictest763807-21kworker/u16:0+events_unbound21:26:044
633449992926,2cyclictest942107-21kworker/u16:0+events_unbound22:35:014
633453992826,2cyclictest613429-21kworker/u16:0+flush-8:019:10:175
633449992826,2cyclictest895520-21kworker/u16:4+events_unbound21:31:404
633449992826,2cyclictest665148-21kworker/u16:1+events_unbound20:00:524
633449992826,2cyclictest665148-21kworker/u16:1+events_unbound20:00:524
633459992721,5cyclictest812547-21latency_hist20:39:517
633454992721,6cyclictest895520-21kworker/u16:4+events_unbound21:32:456
633453992725,2cyclictest993562-21kworker/u16:5+flush-8:022:39:515
633453992725,2cyclictest665148-21kworker/u16:1+flush-8:019:30:095
633453992724,2cyclictest743256-21kworker/u16:6+flush-8:020:05:065
633449992725,2cyclictest1201705-21kworker/u16:4+events_unbound00:02:444
633459992624,1cyclictest1043826-21ssh22:20:067
633454992624,2cyclictest860509-21kworker/u16:4+events_unbound21:06:576
633453992622,4cyclictest763807-21kworker/u16:0+flush-8:021:29:515
633449992624,2cyclictest1262945-21kworker/u16:0+events_unbound00:17:414
633449992624,2cyclictest1262945-21kworker/u16:0+events_unbound00:17:414
633449992623,2cyclictest665148-21kworker/u16:1+events_unbound19:30:014
633459992523,1cyclictest0-21swapper/723:20:087
633459992523,1cyclictest0-21swapper/721:39:537
633453992523,2cyclictest942107-21kworker/u16:0+events_unbound21:40:045
633449992523,2cyclictest569248-21kworker/u16:2+events_unbound19:55:214
633459992422,1cyclictest0-21swapper/720:30:177
633459992419,3cyclictest906305-21ssh21:22:177
633454992422,2cyclictest870295-21kworker/u16:3+events_unbound22:36:256
633454992422,2cyclictest1018024-21kworker/u16:2+events_unbound22:18:306
633454992421,2cyclictest743256-21kworker/u16:6+flush-8:020:29:566
633453992422,2cyclictest942107-21kworker/u16:0+events_unbound22:04:525
633453992422,2cyclictest763807-21kworker/u16:0+events_unbound20:35:175
633453992422,2cyclictest623468-21kworker/u16:3+flush-8:019:59:515
633449992422,2cyclictest665148-21kworker/u16:1+events_unbound19:28:544
633449992421,2cyclictest763807-21kworker/u16:0+flush-8:020:15:054
633449992420,3cyclictest743256-21kworker/u16:6+events_unbound20:10:014
633459992320,2cyclictest1077770-21ssh22:32:177
633454992321,2cyclictest1116354-21kworker/u16:1+events_unbound23:00:496
633453992321,2cyclictest665148-21kworker/u16:1+flush-8:020:00:215
633453992321,2cyclictest665148-21kworker/u16:1+flush-8:020:00:215
633453992321,2cyclictest1201705-21kworker/u16:4+flush-8:023:45:085
633453992321,2cyclictest1018024-21kworker/u16:2+flush-8:023:40:165
633453992321,2cyclictest1018024-21kworker/u16:2+flush-8:023:15:085
633449992321,2cyclictest804363-21kworker/u16:2+events_unbound21:00:014
633449992321,2cyclictest743256-21kworker/u16:6+events_unbound20:27:014
633449992320,2cyclictest763807-21kworker/u16:0+events_unbound21:05:114
633459992221,0cyclictest0-21swapper/719:15:167
633459992220,1cyclictest0-21swapper/721:00:087
633454992220,2cyclictest993562-21kworker/u16:5+flush-8:022:00:296
633454992220,2cyclictest694485-21kworker/u16:0+flush-8:019:51:536
633454992220,2cyclictest694485-21kworker/u16:0+events_unbound19:40:566
633453992219,2cyclictest1152697-21kworker/u16:3+events_unbound23:54:535
633449992220,2cyclictest569248-21kworker/u16:2+events_unbound19:40:014
633449992219,2cyclictest804363-21kworker/u16:2+flush-8:020:50:014
633449992219,2cyclictest804363-21kworker/u16:2+flush-8:020:50:014
633459992120,0cyclictest0-21swapper/721:15:507
633459992118,2cyclictest943651-21taskset21:38:177
63345999210,19cyclictest1186178-21ssh23:15:157
633454992119,2cyclictest665148-21kworker/u16:1+events_unbound19:28:136
633454992119,2cyclictest623468-21kworker/u16:3+events_unbound19:24:136
633454992119,2cyclictest1275402-21kworker/u16:1+events_unbound00:15:426
633454992119,2cyclictest1275402-21kworker/u16:1+events_unbound00:15:426
633449992118,2cyclictest694485-21kworker/u16:0+flush-8:019:45:074
633459992019,0cyclictest0-21swapper/722:56:177
633459992019,0cyclictest0-21swapper/722:56:177
633459992018,1cyclictest0-21swapper/721:46:537
633454992018,2cyclictest969416-21kworker/u16:2+events_unbound21:50:086
633454992018,2cyclictest694485-21kworker/u16:0+events_unbound19:57:526
633454992018,2cyclictest1018024-21kworker/u16:2+events_unbound22:10:206
633454992018,2cyclictest1018024-21kworker/u16:2+events_unbound22:10:206
633453992018,2cyclictest624639-21kworker/u16:4+events_unbound19:14:545
633453992018,2cyclictest1275402-21kworker/u16:1+events_unbound00:09:505
633453992017,2cyclictest1152697-21kworker/u16:3+flush-8:000:25:015
633449992018,2cyclictest763807-21kworker/u16:0+events_unbound20:55:374
633449992018,2cyclictest613429-21kworker/u16:0+events_unbound19:10:224
633459991917,1cyclictest0-21swapper/723:02:567
633459991917,1cyclictest0-21swapper/719:55:067
633454991917,2cyclictest942107-21kworker/u16:0+events_unbound21:55:236
633454991917,2cyclictest775114-21kworker/u16:1+events_unbound20:49:276
633454991917,2cyclictest763807-21kworker/u16:0+events_unbound21:20:066
633454991917,2cyclictest763807-21kworker/u16:0+events_unbound20:53:366
633454991917,2cyclictest763807-21kworker/u16:0+events_unbound20:53:366
633454991917,2cyclictest694485-21kworker/u16:0+events_unbound19:37:306
633454991917,2cyclictest665148-21kworker/u16:1+events_unbound20:05:376
633454991917,2cyclictest665148-21kworker/u16:1+events_unbound19:31:416
633454991917,2cyclictest1201705-21kworker/u16:4+flush-8:023:50:166
633453991917,2cyclictest993562-21kworker/u16:5+events_unbound22:40:065
633453991917,2cyclictest775114-21kworker/u16:1+events_unbound21:15:155
633453991917,2cyclictest1152697-21kworker/u16:3+events_unbound23:50:185
633453991916,2cyclictest1262945-21kworker/u16:0+events_unbound00:00:045
633459991816,1cyclictest0-21swapper/722:50:157
633459991816,1cyclictest0-21swapper/700:00:087
633459991815,2cyclictest1274-21snmpd19:54:397
633454991816,2cyclictest665148-21kworker/u16:1+flush-8:020:14:046
633454991816,2cyclictest569248-21kworker/u16:2+flush-8:019:46:256
633454991816,2cyclictest1262945-21kworker/u16:0+events_unbound00:25:366
633454991816,2cyclictest1201705-21kworker/u16:4+flush-8:023:45:006
633453991816,2cyclictest763807-21kworker/u16:0+events_unbound20:15:085
633453991816,2cyclictest1018024-21kworker/u16:2+flush-8:022:45:165
633449991816,2cyclictest613429-21kworker/u16:0+events_unbound19:18:154
633459991716,0cyclictest0-21swapper/722:42:017
633459991715,1cyclictest1002760-21ssh22:00:187
63345999170,15cyclictest1312107-21rm00:09:567
63345999170,15cyclictest1274-21snmpd23:08:487
633454991715,2cyclictest775114-21kworker/u16:1+flush-8:020:40:216
633454991715,2cyclictest775114-21kworker/u16:1+events_unbound21:04:366
633453991715,2cyclictest1201705-21kworker/u16:4+events_unbound23:28:525
633453991714,2cyclictest993562-21kworker/u16:5+events_unbound22:30:065
633453991714,2cyclictest942107-21kworker/u16:0+events_unbound22:00:025
633453991714,2cyclictest1018024-21kworker/u16:2+flush-8:023:05:045
633449991715,2cyclictest763807-21kworker/u16:0+events_unbound20:44:014
633449991715,2cyclictest743256-21kworker/u16:6+events_unbound20:20:504
633459991615,0cyclictest0-21swapper/721:55:127
633459991615,0cyclictest0-21swapper/720:05:047
633459991615,0cyclictest0-21swapper/700:15:097
633459991615,0cyclictest0-21swapper/700:15:097
633459991614,1cyclictest1362451-21ssh00:30:077
633459991614,1cyclictest0-21swapper/700:25:117
633459991613,2cyclictest916823-21ssh21:25:147
63345999160,14cyclictest0-21swapper/723:40:167
633454991614,2cyclictest763807-21kworker/u16:0+events_unbound20:55:416
633454991614,2cyclictest1201705-21kworker/u16:4+flush-8:000:07:046
633454991610,2cyclictest775114-21kworker/u16:1+events_unbound20:38:116
633453991614,2cyclictest694485-21kworker/u16:0+events_unbound19:45:065
63345999159,5cyclictest822295-21latency_hist20:44:517
633459991512,2cyclictest1274-21snmpd00:06:097
633459991512,2cyclictest0-21swapper/723:29:517
633459991512,1cyclictest0-21swapper/723:45:157
633454991513,2cyclictest870295-21kworker/u16:3+events_unbound22:07:266
633454991513,2cyclictest733623-21kworker/u16:5+flush-8:020:19:326
63345499150,1cyclictest0-21swapper/622:48:326
633453991513,2cyclictest733623-21kworker/u16:5+flush-8:020:30:065
633453991513,2cyclictest1275402-21kworker/u16:1+events_unbound00:15:175
633453991513,2cyclictest1275402-21kworker/u16:1+events_unbound00:15:175
633453991511,3cyclictest1370178-21switchtime00:30:185
63345399150,14cyclictest989889-21kthreadcore21:55:105
633449991513,2cyclictest763807-21kworker/u16:0+events_unbound20:45:194
633449991513,2cyclictest694485-21kworker/u16:0+events_unbound19:36:264
633449991513,2cyclictest623468-21kworker/u16:3+events_unbound19:20:114
63345999149,4cyclictest705184-21latency_hist19:44:527
633459991413,0cyclictest0-21swapper/722:05:037
633454991413,1cyclictest0-21swapper/622:31:596
633454991412,2cyclictest743256-21kworker/u16:6+flush-8:020:21:146
633454991412,2cyclictest613429-21kworker/u16:0+flush-8:019:10:046
633454991412,2cyclictest1018024-21kworker/u16:2+flush-8:023:15:266
63345499140,14cyclictest0-21swapper/622:24:536
63345499140,14cyclictest0-21swapper/621:45:106
63345499140,14cyclictest0-21swapper/621:39:296
633453991413,1cyclictest993562-21kworker/u16:5+events_unbound22:09:535
633453991413,1cyclictest993562-21kworker/u16:5+events_unbound22:09:535
633453991413,1cyclictest0-21swapper/523:11:385
633453991413,1cyclictest0-21swapper/523:03:555
633453991412,2cyclictest993562-21kworker/u16:5+events_unbound22:55:055
633453991412,2cyclictest993562-21kworker/u16:5+events_unbound22:55:055
633453991412,2cyclictest775114-21kworker/u16:1+events_unbound21:14:465
633453991412,2cyclictest763807-21kworker/u16:0+flush-8:020:55:085
63345399140,14cyclictest0-21swapper/523:33:335
63345399140,14cyclictest0-21swapper/523:20:475
63345999139,3cyclictest1274-21snmpd22:25:287
63345999139,3cyclictest1274-21snmpd21:13:087
63345999139,3cyclictest1274-21snmpd20:21:527
63345999139,3cyclictest1274-21snmpd19:30:037
633459991312,0cyclictest0-21swapper/723:56:177
633459991312,0cyclictest0-21swapper/700:39:287
633459991310,2cyclictest0-21swapper/720:49:517
633459991310,2cyclictest0-21swapper/720:49:517
633459991310,1cyclictest0-21swapper/719:25:147
633454991312,1cyclictest0-21swapper/622:57:316
633454991312,1cyclictest0-21swapper/622:57:316
633454991312,1cyclictest0-21swapper/600:38:256
633454991311,2cyclictest870295-21kworker/u16:3+events_unbound21:28:076
633454991311,2cyclictest743256-21kworker/u16:6+flush-8:020:27:536
633454991311,2cyclictest623468-21kworker/u16:3+events_unbound19:15:456
633454991311,2cyclictest1101507-21kworker/u16:0+flush-8:022:50:496
633454991311,2cyclictest1018024-21kworker/u16:2+flush-8:023:40:456
633454991311,2cyclictest1018024-21kworker/u16:2+events_unbound23:07:066
63345499130,0cyclictest0-21swapper/622:43:116
633453991312,1cyclictest0-21swapper/520:11:175
633453991311,2cyclictest694485-21kworker/u16:0+flush-8:019:35:225
63345399130,1cyclictest0-21swapper/519:40:145
63345999129,2cyclictest1274-21snmpd20:03:407
63345999129,2cyclictest1274-21snmpd20:03:407
63345999129,2cyclictest1089339-21ssh22:35:567
63345999128,3cyclictest1274-21snmpd21:31:207
63345999128,3cyclictest1274-21snmpd19:47:067
63345999128,3cyclictest1274-21snmpd19:12:277
63345999128,3cyclictest1274-21snmpd00:21:497
63345999126,5cyclictest6240-21gvfs-afc-volume23:51:417
63345499129,2cyclictest1283943-21needreboot23:55:126
63345499126,5cyclictest1205057-21tr23:25:066
633454991211,1cyclictest0-21swapper/622:22:416
633454991210,2cyclictest942107-21kworker/u16:0+events_unbound21:40:536
633454991210,2cyclictest870295-21kworker/u16:3+events_unbound21:16:496
633454991210,2cyclictest763807-21kworker/u16:0+events_unbound21:12:336
633454991210,2cyclictest1325666-21kworker/u16:2+events_unbound00:22:366
633454991210,2cyclictest1201705-21kworker/u16:4+events_unbound00:11:026
633454991210,2cyclictest1201705-21kworker/u16:4+events_unbound00:01:016
633454991210,2cyclictest1018024-21kworker/u16:2+events_unbound23:23:256
633453991211,1cyclictest0-21swapper/523:37:115
633453991211,1cyclictest0-21swapper/523:37:115
633453991211,1cyclictest0-21swapper/521:49:025
633453991211,1cyclictest0-21swapper/521:35:005
633453991211,1cyclictest0-21swapper/520:42:585
633453991210,2cyclictest870295-21kworker/u16:3+events_unbound21:30:365
63345399120,12cyclictest0-21swapper/521:07:535
63345399120,12cyclictest0-21swapper/520:24:505
633449991210,2cyclictest665148-21kworker/u16:1+events_unbound20:06:164
63345999118,2cyclictest1274-21snmpd23:35:027
63345999118,2cyclictest1274-21snmpd23:35:027
63345999118,2cyclictest1274-21snmpd22:15:437
63345999118,2cyclictest1274-21snmpd20:57:357
63345999118,2cyclictest0-21swapper/719:35:047
63345999117,3cyclictest1274-21snmpd22:47:467
63345999117,3cyclictest1274-21snmpd20:29:077
63345999117,3cyclictest1274-21snmpd19:22:247
63345499117,3cyclictest1215095-21cat23:30:056
633454991110,1cyclictest0-21swapper/620:03:286
633454991110,1cyclictest0-21swapper/620:03:286
63345399119,2cyclictest1275402-21kworker/u16:1+flush-8:000:10:145
633453991110,1cyclictest0-21swapper/520:53:135
633453991110,1cyclictest0-21swapper/520:53:135
633453991110,1cyclictest0-21swapper/520:48:485
633453991110,1cyclictest0-21swapper/520:27:595
633449991110,1cyclictest0-21swapper/419:53:044
63345999107,2cyclictest1274-21snmpd20:10:317
63345999107,2cyclictest0-21swapper/720:44:517
63345999100,9cyclictest1274-21snmpd21:07:507
63345499100,9cyclictest1365953-21kthreadcore00:30:106
63345399109,1cyclictest0-21swapper/521:22:235
63345399109,1cyclictest0-21swapper/519:22:245
63345399108,2cyclictest942107-21kworker/u16:0+events_unbound22:17:535
6334599994,4cyclictest773344-21seq20:17:297
6334549997,2cyclictest1152697-21kworker/u16:3+flush-8:023:10:016
6334499998,1cyclictest0-21swapper/420:36:444
6334499997,2cyclictest763807-21kworker/u16:0+events_unbound20:31:364
6334539987,1cyclictest0-21swapper/519:26:305
6334539984,3cyclictest852694-21cat21:00:065
6334539984,3cyclictest1049550-21cut22:20:105
6334539983,4cyclictest976561-21cut21:50:115
6334539974,2cyclictest1337437-21hwlatdetect00:20:055
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional