You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 12:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Tue Apr 14, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
63921125949,7sleep60-21swapper/618:57:386
639797995753,3cyclictest710435-21kworker/u16:2+flush-8:020:11:495
63945625545,7sleep50-21swapper/519:01:065
639793995351,2cyclictest1135156-21kworker/u16:4+events_unbound23:31:484
63945525343,7sleep40-21swapper/419:01:054
639807995046,2cyclictest1207987-21/usr/sbin/munin23:21:497
639807994643,2cyclictest124-21kswapd023:06:497
639797994440,3cyclictest956979-21kworker/u16:4+flush-8:021:51:495
6369552443,34sleep70-21swapper/718:57:157
639807994035,4cyclictest872946-21latency_hist21:01:497
639793994039,1cyclictest1028454-21kworker/u16:0+events_unbound22:58:404
639793994038,2cyclictest1135156-21kworker/u16:4+flush-8:023:16:494
639797993937,2cyclictest863361-21kworker/u16:2+flush-8:021:16:445
639797993935,3cyclictest1028454-21kworker/u16:0+flush-8:022:22:085
639807993834,2cyclictest1277132-21sed23:47:197
639807993833,4cyclictest1052333-21latency_hist22:16:497
639805993735,2cyclictest992561-21kworker/u16:2+events_unbound22:41:446
639805993735,2cyclictest739447-21kworker/u16:0+events_unbound19:52:046
639797993735,2cyclictest1028454-21kworker/u16:0+flush-8:023:27:115
639793993735,2cyclictest4131780-21kworker/u16:5+events_unbound19:07:134
639805993432,2cyclictest739447-21kworker/u16:0+events_unbound20:17:036
639805993432,2cyclictest739447-21kworker/u16:0+events_unbound20:17:036
639797993432,2cyclictest992561-21kworker/u16:2+events_unbound23:02:035
10165082330,1chrt0-21swapper/422:01:494
639793993229,3cyclictest956589-21kworker/u16:1+flush-8:022:46:444
639807993029,0cyclictest0-21swapper/720:17:117
639807993029,0cyclictest0-21swapper/720:17:117
63980799290,27cyclictest650-21systemd-journal20:46:497
639805992927,2cyclictest1240909-21kworker/u16:5+events_unbound23:46:436
639797992927,2cyclictest921110-21kworker/u16:3+flush-8:021:26:445
639807992823,4cyclictest650-21systemd-journal22:46:507
639805992826,2cyclictest806406-21kworker/u16:1+events_unbound20:37:196
639797992826,2cyclictest739447-21kworker/u16:0+events_unbound20:17:135
639797992826,2cyclictest739447-21kworker/u16:0+events_unbound20:17:135
639807992722,4cyclictest863348-21latency_hist20:56:497
639797992725,2cyclictest992561-21kworker/u16:2+flush-8:023:17:205
639793992725,2cyclictest1281054-21kworker/u16:3+flush-8:023:56:444
639793992724,3cyclictest610129-21kworker/u16:2+flush-8:019:06:504
639797992624,2cyclictest992561-21kworker/u16:2+flush-8:022:32:125
639797992624,2cyclictest1314116-21kworker/u16:1+flush-8:000:21:445
639793992623,2cyclictest710435-21kworker/u16:2+flush-8:020:32:204
9476722250,1sleep4947673-21kthreadcore21:32:084
639807992523,1cyclictest0-21swapper/719:47:087
639807992521,3cyclictest1372413-21ntpq00:27:167
639805992523,2cyclictest992561-21kworker/u16:2+events_unbound22:58:446
639805992422,2cyclictest806406-21kworker/u16:1+events_unbound21:11:056
639805992422,2cyclictest4131780-21kworker/u16:5+events_unbound19:06:556
639805992422,2cyclictest1253570-21kworker/u16:1+events_unbound23:40:516
639797992422,2cyclictest956979-21kworker/u16:4+flush-8:021:46:445
639805992321,2cyclictest956979-21kworker/u16:4+events_unbound21:57:406
639805992321,2cyclictest691448-21kworker/u16:1+events_unbound19:47:116
639793992321,2cyclictest739447-21kworker/u16:0+events_unbound20:52:024
639793992320,2cyclictest921110-21kworker/u16:3+flush-8:021:42:054
63980799220,21cyclictest1305219-21sed00:02:057
639805992220,2cyclictest992561-21kworker/u16:2+events_unbound22:45:356
639805992220,2cyclictest956979-21kworker/u16:4+events_unbound21:45:196
639805992220,2cyclictest863733-21kworker/u16:4+events_unbound21:05:516
639805992220,2cyclictest806406-21kworker/u16:1+events_unbound21:21:486
639805992220,2cyclictest1281054-21kworker/u16:3+events_unbound00:04:246
639807992120,0cyclictest0-21swapper/723:06:517
639807992120,0cyclictest0-21swapper/721:36:517
639807992120,0cyclictest0-21swapper/721:36:517
639807992120,0cyclictest0-21swapper/719:56:447
639807992115,5cyclictest932642-21latency_hist21:26:507
63980799210,20cyclictest1075625-21sh22:25:357
639805992119,2cyclictest956979-21kworker/u16:4+events_unbound21:54:206
639805992119,2cyclictest956589-21kworker/u16:1+events_unbound22:08:196
639805992119,2cyclictest921110-21kworker/u16:3+events_unbound21:41:196
639805992119,2cyclictest921110-21kworker/u16:3+events_unbound21:41:196
639805992119,2cyclictest921110-21kworker/u16:3+events_unbound21:32:196
639805992119,2cyclictest1281054-21kworker/u16:3+events_unbound00:22:056
639805992119,2cyclictest1280271-21kworker/u16:2+events_unbound23:59:356
639805992119,2cyclictest1135156-21kworker/u16:4+events_unbound23:16:146
639805992119,2cyclictest1135156-21kworker/u16:4+events_unbound22:50:516
639805992119,2cyclictest1028454-21kworker/u16:0+events_unbound23:20:006
639797992118,3cyclictest863361-21kworker/u16:2+flush-8:021:02:065
639793992118,2cyclictest691448-21kworker/u16:1+flush-8:019:47:134
639807992014,5cyclictest1064325-21latency_hist22:21:497
639807992014,5cyclictest1064325-21latency_hist22:21:497
639805992018,2cyclictest691448-21kworker/u16:1+events_unbound19:46:126
639797992018,2cyclictest992561-21kworker/u16:2+flush-8:022:07:215
639797992018,2cyclictest681340-21kworker/u16:0+flush-8:019:22:155
639793992019,1cyclictest1028454-21kworker/u16:0+flush-8:023:37:214
639793992018,2cyclictest992561-21kworker/u16:2+flush-8:022:47:054
639793992018,2cyclictest956979-21kworker/u16:4+events_unbound22:02:084
639793992018,2cyclictest691448-21kworker/u16:1+events_unbound19:32:144
639793992018,2cyclictest691448-21kworker/u16:1+events_unbound19:32:144
639805991917,2cyclictest992561-21kworker/u16:2+events_unbound22:53:316
639805991917,2cyclictest992561-21kworker/u16:2+events_unbound22:32:486
639805991917,2cyclictest992561-21kworker/u16:2+events_unbound22:19:176
639805991917,2cyclictest992561-21kworker/u16:2+events_unbound22:19:176
639805991917,2cyclictest863361-21kworker/u16:2+events_unbound21:28:276
639805991917,2cyclictest758386-21kworker/u16:3+events_unbound20:16:006
639805991917,2cyclictest1281054-21kworker/u16:3+events_unbound00:16:196
639805991917,2cyclictest1253570-21kworker/u16:1+events_unbound23:50:556
639805991917,2cyclictest1028454-21kworker/u16:0+events_unbound23:55:446
639797991917,2cyclictest992561-21kworker/u16:2+flush-8:022:02:165
639797991917,2cyclictest1135156-21kworker/u16:4+events_unbound22:52:135
639793991917,2cyclictest710435-21kworker/u16:2+events_unbound20:27:094
639793991916,2cyclictest739447-21kworker/u16:0+events_unbound20:07:074
639793991914,2cyclictest921110-21kworker/u16:3+events_unbound21:37:184
639793991914,2cyclictest921110-21kworker/u16:3+events_unbound21:37:184
639807991810,7cyclictest0-21swapper/723:32:187
639805991816,2cyclictest956589-21kworker/u16:1+events_unbound22:15:316
639805991816,2cyclictest921110-21kworker/u16:3+events_unbound21:48:196
639805991816,2cyclictest863361-21kworker/u16:2+events_unbound21:14:116
639805991816,2cyclictest649242-21kworker/u16:1+events_unbound19:12:496
639805991816,2cyclictest4131780-21kworker/u16:5+flush-8:019:02:476
639805991816,2cyclictest1028454-21kworker/u16:0+events_unbound22:31:196
639797991816,2cyclictest710435-21kworker/u16:2+events_unbound20:27:135
639797991815,2cyclictest4131780-21kworker/u16:5+events_unbound19:42:025
639793991816,2cyclictest1281054-21kworker/u16:3+events_unbound23:57:044
639807991716,0cyclictest0-21swapper/722:27:127
639807991716,0cyclictest0-21swapper/720:12:067
639807991713,3cyclictest1334196-21cut00:12:117
639805991715,2cyclictest956979-21kworker/u16:4+events_unbound22:06:166
639805991715,2cyclictest863733-21kworker/u16:4+events_unbound20:59:596
639805991715,2cyclictest681340-21kworker/u16:0+events_unbound19:32:596
639805991715,2cyclictest681340-21kworker/u16:0+events_unbound19:32:596
639805991715,2cyclictest681340-21kworker/u16:0+events_unbound19:20:566
639805991715,2cyclictest1314116-21kworker/u16:1+events_unbound00:19:396
639805991715,2cyclictest1135156-21kworker/u16:4+events_unbound23:09:256
639805991715,2cyclictest1028454-21kworker/u16:0+events_unbound23:26:296
639805991714,2cyclictest1314156-21kworker/u16:4+events_unbound00:07:006
639797991715,2cyclictest863361-21kworker/u16:2+events_unbound21:07:135
639793991715,2cyclictest894628-21kworker/u16:0+events_unbound21:12:044
639793991715,2cyclictest863733-21kworker/u16:4+flush-8:021:02:144
639793991714,2cyclictest758386-21kworker/u16:3+flush-8:020:47:054
63980799169,6cyclictest0-21swapper/721:12:147
63980799167,8cyclictest0-21swapper/722:07:097
63980799167,8cyclictest0-21swapper/721:32:117
63980799167,7cyclictest0-21swapper/722:42:087
639807991615,0cyclictest0-21swapper/719:27:197
639807991614,1cyclictest1245179-21ssh23:37:087
63980799160,15cyclictest944607-21latency_hist21:31:497
639805991614,2cyclictest992561-21kworker/u16:2+events_unbound22:25:426
639805991614,2cyclictest691448-21kworker/u16:1+events_unbound19:38:046
639805991614,2cyclictest610129-21kworker/u16:2+events_unbound19:23:036
639805991614,2cyclictest1135156-21kworker/u16:4+events_unbound23:33:436
639797991614,2cyclictest739447-21kworker/u16:0+events_unbound20:12:145
639797991613,3cyclictest992561-21kworker/u16:2+flush-8:022:31:495
639793991613,3cyclictest806406-21kworker/u16:1+events_unbound21:07:034
63980799157,7cyclictest0-21swapper/722:51:497
63980799157,7cyclictest0-21swapper/722:02:107
63980799156,7cyclictest0-21swapper/721:02:057
639807991511,3cyclictest1267-21snmpd20:02:567
639805991513,2cyclictest921110-21kworker/u16:3+events_unbound21:26:126
639805991513,2cyclictest739447-21kworker/u16:0+events_unbound20:10:156
639805991513,2cyclictest710435-21kworker/u16:2+events_unbound20:34:326
639797991514,1cyclictest0-21swapper/523:08:585
639797991513,2cyclictest691448-21kworker/u16:1+flush-8:019:37:055
639797991513,2cyclictest1028454-21kworker/u16:0+events_unbound22:12:155
639793991513,2cyclictest992561-21kworker/u16:2+events_unbound22:07:164
63980799149,4cyclictest729537-21latency_hist19:46:497
63980799149,4cyclictest1317081-21cat00:07:047
63980799147,6cyclictest5750-21gmain19:07:157
63980799147,6cyclictest0-21swapper/723:57:157
63980799146,7cyclictest0-21swapper/722:37:177
63980799146,7cyclictest0-21swapper/721:17:077
63980799145,8cyclictest0-21swapper/722:32:007
63980799144,9cyclictest1288849-21ntpq23:52:237
639807991413,0cyclictest0-21swapper/720:27:047
639807991412,1cyclictest971898-21ssh21:42:067
639807991411,2cyclictest1216966-21ntpq23:22:177
639807991410,3cyclictest1267-21snmpd23:30:267
63980799140,2cyclictest872949-21diskmemload21:07:157
639805991412,2cyclictest758386-21kworker/u16:3+flush-8:020:22:146
639805991412,2cyclictest1135156-21kworker/u16:4+events_unbound23:27:476
639797991413,1cyclictest0-21swapper/523:43:295
639797991413,1cyclictest0-21swapper/521:54:425
639797991411,2cyclictest1028454-21kworker/u16:0+flush-8:022:17:065
639797991411,2cyclictest1028454-21kworker/u16:0+flush-8:022:17:065
63979799140,1cyclictest0-21swapper/521:38:195
63979799140,1cyclictest0-21swapper/521:38:195
63979799140,14cyclictest0-21swapper/500:28:165
639793991412,2cyclictest739447-21kworker/u16:0+events_unbound20:06:494
639793991411,2cyclictest739447-21kworker/u16:0+events_unbound20:42:024
639793991410,3cyclictest758386-21kworker/u16:3+flush-8:020:37:074
63979399140,13cyclictest800190-21grep20:22:094
63980799139,3cyclictest1267-21snmpd20:40:337
63980799139,3cyclictest1267-21snmpd19:15:037
63980799136,6cyclictest0-21swapper/723:43:367
63980799136,6cyclictest0-21swapper/721:52:267
63980799136,6cyclictest0-21swapper/721:47:157
63980799136,6cyclictest0-21swapper/700:22:027
63980799136,6cyclictest0-21swapper/700:18:207
63980799135,7cyclictest0-21swapper/721:56:547
639807991310,2cyclictest0-21swapper/722:56:497
63980799130,12cyclictest0-21swapper/719:21:537
639805991312,1cyclictest1169068-21ntpq23:02:136
639805991311,2cyclictest739447-21kworker/u16:0+events_unbound20:46:006
639805991311,2cyclictest1281054-21kworker/u16:3+events_unbound00:28:546
639805991310,2cyclictest692673-21cut19:27:066
639797991312,1cyclictest0-21swapper/522:47:225
639797991312,1cyclictest0-21swapper/521:20:395
639797991312,1cyclictest0-21swapper/500:26:225
639797991311,2cyclictest894628-21kworker/u16:0+events_unbound21:27:135
639797991310,2cyclictest4131780-21kworker/u16:5+flush-8:019:02:155
63979799130,13cyclictest0-21swapper/523:41:365
63979799130,13cyclictest0-21swapper/523:32:185
63979799130,13cyclictest0-21swapper/522:01:205
63979799130,13cyclictest0-21swapper/500:08:525
63979799130,0cyclictest0-21swapper/521:36:445
639793991310,2cyclictest921110-21kworker/u16:3+flush-8:021:21:554
639793991310,2cyclictest691448-21kworker/u16:1+events_unbound19:57:034
63980799129,2cyclictest1267-21snmpd20:22:267
63980799128,3cyclictest1267-21snmpd20:34:147
63980799128,3cyclictest1267-21snmpd19:05:037
63980799125,6cyclictest0-21swapper/723:12:067
63980799125,6cyclictest0-21swapper/719:38:507
639807991211,0cyclictest0-21swapper/720:47:087
639807991211,0cyclictest0-21swapper/719:32:127
639807991211,0cyclictest0-21swapper/719:32:127
63980599129,1cyclictest201rcu_preempt20:27:136
639805991211,1cyclictest851248-21cut20:47:106
639805991210,1cyclictest854858-21tune2fs20:52:046
639805991210,1cyclictest841rcuc/619:57:066
639797991211,1cyclictest1253570-21kworker/u16:1+events_unbound23:49:075
639797991211,1cyclictest0-21swapper/522:59:585
639793991211,1cyclictest0-21swapper/423:23:274
639793991211,1cyclictest0-21swapper/400:03:304
63979399120,1cyclictest0-21swapper/422:53:024
63979399120,12cyclictest0-21swapper/423:44:544
63979399120,12cyclictest0-21swapper/422:18:114
63979399120,12cyclictest0-21swapper/422:18:114
63979399120,11cyclictest0-21swapper/421:47:044
63980799117,3cyclictest1267-21snmpd20:08:447
63980799117,3cyclictest1267-21snmpd19:19:257
639807991111,0cyclictest0-21swapper/719:59:527
63980599119,1cyclictest0-21swapper/620:02:026
63979799119,2cyclictest691448-21kworker/u16:1+flush-8:019:32:135
63979799119,2cyclictest691448-21kworker/u16:1+flush-8:019:32:135
63979799117,3cyclictest739447-21kworker/u16:0+flush-8:020:52:165
639797991110,1cyclictest0-21swapper/520:03:535
639797991110,1cyclictest0-21swapper/519:11:515
639797991110,1cyclictest0-21swapper/500:14:425
639797991110,1cyclictest0-21swapper/500:04:565
63979799110,1cyclictest0-21swapper/520:37:565
63979799110,11cyclictest0-21swapper/520:49:075
63979399119,2cyclictest894628-21kworker/u16:0+flush-8:021:27:134
63979399118,2cyclictest673202-21tune2fs19:17:024
639793991110,1cyclictest0-21swapper/423:51:034
639793991110,1cyclictest0-21swapper/423:19:404
639793991110,1cyclictest0-21swapper/422:27:104
63979399110,11cyclictest0-21swapper/422:38:034
63979399110,11cyclictest0-21swapper/422:25:264
63979399110,11cyclictest0-21swapper/421:55:104
63979399110,11cyclictest0-21swapper/420:17:444
63979399110,11cyclictest0-21swapper/420:17:444
63979399110,11cyclictest0-21swapper/419:43:414
63979399110,11cyclictest0-21swapper/419:28:244
63979399110,11cyclictest0-21swapper/419:26:114
63979399110,11cyclictest0-21swapper/419:12:384
626589110,1rtkit-daemon0-21swapper/520:35:045
63979799109,1cyclictest0-21swapper/523:23:185
63979799109,1cyclictest0-21swapper/523:14:195
63979799109,1cyclictest0-21swapper/520:23:165
63979799109,1cyclictest0-21swapper/519:27:275
63979799109,1cyclictest0-21swapper/500:00:595
63979799108,1cyclictest749718-21fschecks_time19:57:035
63979399109,1cyclictest956589-21kworker/u16:1+events_unbound22:12:134
63979399109,1cyclictest0-21swapper/423:02:294
63979399109,1cyclictest0-21swapper/422:34:254
63979399109,1cyclictest0-21swapper/400:13:544
63979399108,2cyclictest739447-21kworker/u16:0+flush-8:020:12:154
6397979996,2cyclictest758386-21kworker/u16:3+flush-8:020:42:155
6397939998,1cyclictest0-21swapper/423:32:554
6397939997,2cyclictest863733-21kworker/u16:4+flush-8:020:57:134
6397939997,2cyclictest691448-21kworker/u16:1+events_unbound19:37:034
6397979987,1cyclictest0-21swapper/523:55:005
6397979987,1cyclictest0-21swapper/522:42:005
6397979986,2cyclictest863361-21kworker/u16:2+flush-8:020:57:005
6397979986,1cyclictest0-21swapper/519:17:065
6397979983,4cyclictest651172-21cut19:06:535
6397979983,4cyclictest1107988-21cut22:37:105
6397939987,1cyclictest0-21swapper/400:18:004
6397939980,5cyclictest739570-21cat19:52:024
6397979974,2cyclictest0-21swapper/519:52:075
6397979972,4cyclictest730968-21cut19:47:065
6397939976,1cyclictest0-21swapper/400:22:064
6397939975,1cyclictest0-21swapper/421:17:024
6397939965,1cyclictest0-21swapper/400:07:364
6397939960,3cyclictest5873-21gsd-housekeepin00:27:334
6397939960,1cyclictest0-21swapper/423:09:244
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional