You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 13:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Sep 04, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
297552980,0sleep30-21swapper/321:19:583
132532930,2sleep11549399cyclictest21:36:301
171372710,0sleep00-21swapper/021:34:530
1517125322,17sleep60-21swapper/619:02:216
105572530,1sleep4857-21polkitd21:52:034
181952520,0sleep20-21swapper/223:44:222
299452510,1sleep629947-21sshd00:10:296
126882510,0sleep70-21swapper/723:47:557
116192510,0sleep60-21swapper/600:01:326
310842500,0sleep5561ktimersoftd/523:54:585
274962500,0sleep60-21swapper/619:25:116
195362500,1sleep119537-21grepconf.sh23:03:121
254652490,0sleep70-21swapper/722:34:117
130292490,1sleep113030-21sshd21:34:381
262902470,0sleep20-21swapper/223:05:292
208122470,0sleep00-21swapper/000:19:520
205912470,0sleep50-21swapper/500:15:485
48022460,1sleep14782-21sshd22:29:001
292562460,0sleep70-21swapper/700:22:157
237412460,0sleep70-21swapper/723:25:057
223492460,0sleep00-21swapper/022:24:110
15022460,0sleep31498-21sshd21:53:303
76342450,0sleep57628-21sshd22:36:575
302542450,0sleep10-21swapper/100:14:321
148052450,0sleep20-21swapper/200:23:222
121642450,0sleep7721ktimersoftd/722:43:087
116272450,1sleep711594-21sshd00:05:257
210012440,0sleep30-21swapper/323:42:313
1509024431,9sleep70-21swapper/719:01:187
9702430,0sleep30-21swapper/323:23:413
77132430,0sleep50-21swapper/500:13:085
72952430,2sleep21549499cyclictest21:28:222
28482430,0sleep60-21swapper/600:24:386
1521824331,9sleep20-21swapper/219:02:582
30902420,0sleep40-21swapper/422:01:244
260682420,0sleep30-21swapper/322:30:143
1531324229,9sleep30-21swapper/319:04:193
136722420,0sleep30-21swapper/323:02:503
1289624237,2sleep00-21swapper/019:00:070
55642410,0sleep10-21swapper/121:49:521
54202410,0sleep20-21swapper/221:20:212
1523924130,8sleep50-21swapper/519:03:175
305382400,0sleep20-21swapper/200:14:332
281852400,0sleep60-21swapper/621:17:536
26672400,0sleep30-21swapper/300:14:503
173702400,0sleep20-21swapper/222:04:182
145172400,1sleep7758-21runrttasks22:37:237
289892390,0sleep60-21swapper/622:50:046
289892390,0sleep60-21swapper/622:50:046
156642390,0sleep40-21swapper/423:55:534
1522923927,9sleep40-21swapper/419:03:084
1504823928,8sleep10-21swapper/119:00:401
84682380,0sleep50-21swapper/521:40:115
60732380,0sleep70-21swapper/722:01:357
161012370,0sleep20-21swapper/222:59:052
193032360,0sleep00-21swapper/023:26:420
1549499232,5cyclictest27275-21bash22:24:292
1549499232,3cyclictest23750-21perf22:39:582
15497992210,1cyclictest22756-21sshd22:18:195
1549499224,6cyclictest709-21systemd-logind22:11:082
1549499223,6cyclictest18426-21sshd23:24:462
1549499221,6cyclictest0-21swapper/222:48:492
105842220,0sleep20-21swapper/223:10:262
1549499213,5cyclictest23698-21cp21:35:142
1549499213,3cyclictest2802-21sshd00:16:442
1549499213,17cyclictest25506-21sshd23:58:302
1549499212,4cyclictest31332-21uname21:10:142
1549499211,2cyclictest23737-21sh23:15:142
1549499203,6cyclictest4757-21packagekitd21:56:572
1549499203,5cyclictest721-21dbus-daemon23:52:052
1549499203,5cyclictest28743-21grep23:46:542
1549499203,3cyclictest1-21systemd22:41:202
1549499202,6cyclictest721-21dbus-daemon21:49:342
1549499202,5cyclictest8513-21sshd23:39:512
1549499202,5cyclictest8513-21sshd23:39:512
1549499202,5cyclictest31968-21grepconf.sh22:09:072
1549499202,3cyclictest2182-21sshd00:34:262
1549499202,3cyclictest0-21swapper/200:01:382
1549499202,2cyclictest6519-21bash00:28:462
1549499193,7cyclictest0-21swapper/222:28:232
1549499193,5cyclictest5946-21bash00:05:102
1549499193,5cyclictest20622-21sshd21:50:392
1549499193,5cyclictest15962-21sshd21:32:482
1549499193,5cyclictest11392-21grepconf.sh22:33:182
1549499193,4cyclictest22529-21sshd21:40:582
1549499193,4cyclictest13048-21bash22:17:432
1549499192,6cyclictest13741-21bash21:09:132
1549499192,4cyclictest14339-21bash21:15:082
1549499192,3cyclictest28811-21bash23:31:112
1549499192,2cyclictest0-21swapper/223:01:432
119592190,0sleep70-21swapper/721:06:417
1549499183,5cyclictest21307-21sshd23:26:502
1549499183,5cyclictest21281-21grep22:53:302
1549499183,5cyclictest21281-21grep22:53:302
248702170,1sleep124869-21bash00:29:541
15493991713,1cyclictest1230-21sshd23:39:251
15493991713,1cyclictest1230-21sshd23:39:251
15498991613,2cyclictest15202-21sshd23:48:056
1549799169,3cyclictest57-21ksoftirqd/523:17:335
59702150,0sleep30-21swapper/322:19:173
250252150,0sleep70-21swapper/723:30:577
1549799150,3cyclictest0-21swapper/519:32:475
1549799150,1cyclictest0-21swapper/519:35:005
15495991511,3cyclictest41-21ksoftirqd/323:46:173
15492991513,1cyclictest9-21ksoftirqd/022:05:520
15492991512,2cyclictest15614-21sshd21:52:220
318492140,0sleep60-21swapper/600:30:156
247962140,0sleep10-21swapper/121:17:401
15498991412,1cyclictest65-21ksoftirqd/622:22:076
1549799149,1cyclictest25750-21sshd21:56:535
15497991413,1cyclictest57-21ksoftirqd/523:38:005
15497991413,1cyclictest57-21ksoftirqd/523:38:005
15497991412,1cyclictest57-21ksoftirqd/523:06:535
15497991412,1cyclictest57-21ksoftirqd/521:53:055
1549799140,0cyclictest0-21swapper/520:01:295
15495991412,1cyclictest41-21ksoftirqd/322:51:523
15495991412,1cyclictest41-21ksoftirqd/322:51:523
15495991412,1cyclictest41-21ksoftirqd/321:39:173
1549599140,14cyclictest0-21swapper/300:29:513
1549499142,5cyclictest32749-21perl20:30:122
1549499142,5cyclictest32729-21cat19:34:582
1549499142,4cyclictest21709-21cat20:10:142
1549499142,4cyclictest17856-21iostat_ios21:00:132
1549499142,4cyclictest12698-21perl19:55:112
15493991412,1cyclictest25-21ksoftirqd/123:41:301
15493991412,1cyclictest25-21ksoftirqd/123:28:211
15492991412,1cyclictest9-21ksoftirqd/023:52:510
15492991412,1cyclictest9-21ksoftirqd/022:37:340
15492991412,1cyclictest9-21ksoftirqd/022:12:300
15492991411,2cyclictest32327-21sshd22:34:360
15492991411,1cyclictest9-21ksoftirqd/021:17:270
1549299140,1cyclictest0-21swapper/023:57:250
175612130,0sleep00-21swapper/021:58:240
1549999130,12cyclictest17376-21kworker/7:400:32:227
1549999130,12cyclictest0-21swapper/722:22:507
1549899134,5cyclictest29467-21bash21:45:196
15498991312,1cyclictest65-21ksoftirqd/623:29:316
15498991311,1cyclictest65-21ksoftirqd/623:18:356
1549799139,1cyclictest4227-21sshd00:30:295
15497991312,1cyclictest57-21ksoftirqd/522:05:285
15497991312,1cyclictest57-21ksoftirqd/521:32:565
15497991311,1cyclictest57-21ksoftirqd/521:19:045
1549799130,12cyclictest5706-21kworker/5:221:45:085
1549799130,0cyclictest0-21swapper/520:47:235
1549799130,0cyclictest0-21swapper/519:43:095
1549699130,12cyclictest20642-21grepconf.sh23:11:044
1549699130,1cyclictest0-21swapper/423:48:204
15495991311,1cyclictest41-21ksoftirqd/323:08:243
1549599130,12cyclictest1278-21bash22:44:283
1549499132,5cyclictest8322-21grep20:45:092
1549499132,5cyclictest3617-21sed20:35:132
1549499132,5cyclictest18215-21df20:05:092
1549499132,4cyclictest27742-21diskstats19:25:122
1549499132,4cyclictest23749-21ls20:15:102
1549499132,4cyclictest16227-21df19:05:092
1549499132,2cyclictest4405-21iostat19:40:142
1549499131,5cyclictest10313-21sed19:50:162
1549499131,5cyclictest10313-21sed19:50:162
1549399136,6cyclictest32305-21grepconf.sh00:02:501
1549399132,5cyclictest15661-21bash22:23:461
15492991312,1cyclictest9-21ksoftirqd/023:10:380
15492991312,1cyclictest9-21ksoftirqd/021:42:420
15492991311,1cyclictest9-21ksoftirqd/022:17:460
15492991311,1cyclictest9-21ksoftirqd/021:45:150
15492991311,1cyclictest9-21ksoftirqd/021:39:440
76032120,0sleep30-21swapper/321:24:313
65742120,0sleep60-21swapper/621:55:416
183412120,1sleep51-21systemd22:00:215
1549999122,5cyclictest28231-21bash00:18:197
1549999122,4cyclictest7810-21sshd22:15:227
1549999122,4cyclictest31444-21sshd22:46:127
1549999122,4cyclictest23996-21sshd23:50:307
1549999122,4cyclictest0-21swapper/722:56:387
1549999122,4cyclictest0-21swapper/722:05:007
1549999121,5cyclictest27518-21bash22:28:247
1549999120,12cyclictest0-21swapper/700:27:297
1549899129,2cyclictest27562-21bash22:00:546
1549899129,2cyclictest18187-21grepconf.sh21:50:306
1549899129,2cyclictest1-21systemd23:12:496
15498991210,1cyclictest65-21ksoftirqd/623:56:256
1549899120,11cyclictest28883-21bash00:16:206
1549799128,1cyclictest8635-21sshd21:26:275
1549799128,1cyclictest57-21ksoftirqd/523:33:055
1549799123,0cyclictest0-21swapper/519:15:485
15497991211,1cyclictest57-21ksoftirqd/523:45:345
15497991211,1cyclictest57-21ksoftirqd/523:23:045
15497991210,1cyclictest57-21ksoftirqd/522:59:585
15497991210,1cyclictest57-21ksoftirqd/522:42:395
15497991210,1cyclictest57-21ksoftirqd/522:25:075
15497991210,1cyclictest57-21ksoftirqd/521:22:305
1549799121,2cyclictest0-21swapper/520:52:115
1549799120,3cyclictest0-21swapper/520:32:175
1549799120,3cyclictest0-21swapper/520:10:375
1549799120,1cyclictest0-21swapper/519:13:385
1549799120,0cyclictest0-21swapper/520:35:595
1549799120,0cyclictest0-21swapper/520:16:555
1549799120,0cyclictest0-21swapper/519:07:005
1549699122,4cyclictest0-21swapper/423:00:034
1549699122,4cyclictest0-21swapper/421:20:514
1549699121,5cyclictest10168-21sshd00:15:134
1549699120,11cyclictest721-21dbus-daemon23:22:324
15495991211,1cyclictest41-21ksoftirqd/323:30:503
15495991211,1cyclictest41-21ksoftirqd/322:11:303
15495991210,1cyclictest41-21ksoftirqd/321:43:403
1549599120,11cyclictest0-21swapper/321:11:373
1549499122,4cyclictest22020-21fschecks_count19:15:122
1549499121,3cyclictest16815-21cat20:59:592
1549399126,2cyclictest3521-21bash22:30:471
1549399120,11cyclictest23537-21sshd23:58:231
15492991211,1cyclictest9-21ksoftirqd/022:49:450
15492991211,1cyclictest9-21ksoftirqd/000:30:350
15492991210,1cyclictest9-21ksoftirqd/023:39:190
15492991210,1cyclictest9-21ksoftirqd/023:39:190
15492991210,1cyclictest9-21ksoftirqd/022:25:130
15492991210,1cyclictest9-21ksoftirqd/000:22:100
15492991210,1cyclictest9-21ksoftirqd/000:05:370
1549299120,12cyclictest22924-21kworker/0:423:33:390
151352120,0sleep30-21swapper/323:59:533
8692110,0sleep60-21swapper/623:31:286
200262110,1sleep320028-21grepconf.sh00:15:463
1549999119,1cyclictest6270-21sshd23:35:427
1549999119,1cyclictest6270-21sshd23:35:427
1549999112,4cyclictest3459-21sshd23:57:087
1549999112,4cyclictest25990-21sshd21:37:187
1549999112,4cyclictest11190-21sshd21:22:447
15499991110,1cyclictest73-21ksoftirqd/721:26:337
1549999111,4cyclictest5025-21systemd-cgroups21:59:387
1549999111,4cyclictest25845-21bash23:03:367
1549999111,4cyclictest12635-21sshd21:30:347
1549999111,4cyclictest10115-21sshd00:11:167
1549999110,1cyclictest0-21swapper/723:21:027
1549999110,1cyclictest0-21swapper/721:53:517
1549899119,1cyclictest65-21ksoftirqd/623:08:456
1549899119,1cyclictest65-21ksoftirqd/622:48:196
1549899119,1cyclictest65-21ksoftirqd/622:06:286
1549899119,1cyclictest65-21ksoftirqd/600:27:096
1549899118,2cyclictest65-21ksoftirqd/622:55:176
1549899114,4cyclictest24089-21sshd23:52:316
1549899112,6cyclictest15356-21sshd22:25:376
15498991110,1cyclictest65-21ksoftirqd/621:37:376
1549799119,1cyclictest57-21ksoftirqd/523:42:085
1549799119,1cyclictest57-21ksoftirqd/523:12:265
1549799119,1cyclictest31037-21sshd23:58:515
1549799118,3cyclictest57-21ksoftirqd/522:22:105
1549799117,1cyclictest57-21ksoftirqd/500:01:215
1549799115,3cyclictest857-21polkitd22:51:345
1549799115,3cyclictest857-21polkitd22:51:345
1549799113,3cyclictest0-21swapper/500:05:375
1549799112,2cyclictest0-21swapper/523:01:395
15497991110,1cyclictest8244-21sshd21:10:455
1549799110,2cyclictest0-21swapper/520:55:455
1549799110,2cyclictest0-21swapper/520:08:315
1549799110,0cyclictest0-21swapper/521:04:175
1549799110,0cyclictest0-21swapper/520:43:035
1549799110,0cyclictest0-21swapper/520:21:495
1549799110,0cyclictest0-21swapper/519:45:275
1549699119,1cyclictest49-21ksoftirqd/400:08:514
1549699119,1cyclictest0-21swapper/422:56:414
1549699118,2cyclictest49-21ksoftirqd/422:32:044
15496991110,1cyclictest49-21ksoftirqd/421:59:584
1549699111,4cyclictest6129-21sshd00:24:504
1549699111,4cyclictest5850-21sshd22:42:454
1549699111,4cyclictest31118-21sshd00:10:334
1549699111,4cyclictest19802-21sshd22:18:084
1549699110,5cyclictest31577-21sshd23:33:234
1549699110,5cyclictest15567-21sshd21:09:204
1549699110,3cyclictest0-21swapper/421:38:524
1549699110,10cyclictest0-21swapper/421:16:064
1549599119,1cyclictest41-21ksoftirqd/323:51:283
1549599119,1cyclictest41-21ksoftirqd/322:49:123
1549599119,1cyclictest41-21ksoftirqd/321:58:523
1549599118,1cyclictest41-21ksoftirqd/323:14:243
1549599110,10cyclictest27230-21grepconf.sh21:33:303
1549499113,1cyclictest0-21swapper/219:10:232
1549499111,4cyclictest15865-21iostat20:00:152
1549399117,3cyclictest23459-21sshd23:15:131
1549399116,3cyclictest30166-21kworker/1:021:21:551
1549399111,4cyclictest7097-21sshd21:59:461
1549399111,4cyclictest709-21systemd-logind22:02:121
1549399111,4cyclictest32061-21sshd00:06:431
1549399111,4cyclictest27338-21sshd22:55:451
1549399111,4cyclictest2290-21sshd22:15:091
1549399111,4cyclictest12675-21sshd00:15:191
1549399110,11cyclictest0-21swapper/122:11:111
1549399110,10cyclictest17255-21id21:29:001
1549399110,1cyclictest0-21swapper/122:35:281
1549399110,1cyclictest0-21swapper/121:50:231
1549299119,1cyclictest9-21ksoftirqd/023:45:130
1549299119,1cyclictest9-21ksoftirqd/022:02:410
1549299115,3cyclictest30951-21sshd00:26:150
1549299112,5cyclictest25905-21grep21:09:580
15492991110,1cyclictest9-21ksoftirqd/022:55:570
15492991110,1cyclictest9-21ksoftirqd/022:51:310
15492991110,1cyclictest9-21ksoftirqd/022:51:310
15492991110,1cyclictest9-21ksoftirqd/021:20:340
1549299110,10cyclictest730-21NetworkManager21:28:360
1549299110,10cyclictest23793-21id23:07:220
1549299110,1cyclictest0-21swapper/023:44:050
1549299110,1cyclictest0-21swapper/023:03:060
1549999109,1cyclictest0-21swapper/722:51:427
1549999109,1cyclictest0-21swapper/722:51:427
1549999108,1cyclictest73-21ksoftirqd/721:15:307
1549999108,1cyclictest73-21ksoftirqd/700:04:587
1549999102,7cyclictest32000-21sshd22:10:597
1549999101,4cyclictest7978-21sshd21:45:587
1549999101,4cyclictest0-21swapper/723:06:157
1549999100,4cyclictest31054-21bash21:43:317
1549999100,4cyclictest18997-21sshd23:10:577
1549999100,4cyclictest0-21swapper/723:16:157
1549899109,1cyclictest0-21swapper/620:15:176
1549899108,1cyclictest65-21ksoftirqd/622:40:396
1549899108,1cyclictest65-21ksoftirqd/621:20:066
1549899107,2cyclictest65-21ksoftirqd/623:01:306
1549899103,4cyclictest85150irq/25-em1-rx-023:42:326
1549899102,5cyclictest9105-21sshd21:42:096
1549899102,5cyclictest25960-21bash23:36:556
1549899102,5cyclictest25960-21bash23:36:556
1549899102,4cyclictest9778-21sshd21:32:256
1549899102,4cyclictest22654-21grep22:31:596
1549899101,5cyclictest22151-21sshd22:10:226
1549899100,10cyclictest15566-21kworker/6:222:36:256
1549899100,10cyclictest0-21swapper/621:13:086
1549899100,10cyclictest0-21swapper/621:06:126
1549799109,1cyclictest57-21ksoftirqd/522:45:045
1549799109,1cyclictest57-21ksoftirqd/522:30:195
1549799108,1cyclictest57-21ksoftirqd/522:14:235
1549799108,1cyclictest57-21ksoftirqd/521:39:095
1549799108,1cyclictest57-21ksoftirqd/500:20:405
1549799102,6cyclictest0-21swapper/500:25:005
1549799102,0cyclictest0-21swapper/519:51:595
1549799102,0cyclictest0-21swapper/519:51:595
1549699109,1cyclictest49-21ksoftirqd/421:40:494
1549699108,1cyclictest49-21ksoftirqd/422:52:494
1549699108,1cyclictest49-21ksoftirqd/422:52:494
1549699108,1cyclictest49-21ksoftirqd/422:12:364
1549699108,1cyclictest49-21ksoftirqd/400:27:094
1549699108,1cyclictest49-21ksoftirqd/400:01:164
1549699103,6cyclictest32545-21sshd22:36:294
1549699101,4cyclictest13448-21sshd21:32:394
1549699101,4cyclictest0-21swapper/422:07:244
1549699100,4cyclictest669-21avahi-daemon22:24:304
1549699100,4cyclictest30301-21rm23:37:114
1549699100,4cyclictest30301-21rm23:37:114
1549699100,4cyclictest27811-21systemd-cgroups21:27:384
1549699100,4cyclictest0-21swapper/423:50:354
1549699100,4cyclictest0-21swapper/423:29:294
1549699100,10cyclictest0-21swapper/423:07:534
1549699100,10cyclictest0-21swapper/421:12:384
1549599109,1cyclictest41-21ksoftirqd/323:35:193
1549599109,1cyclictest41-21ksoftirqd/323:35:193
1549599109,1cyclictest41-21ksoftirqd/321:27:093
1549599109,1cyclictest0-21swapper/322:58:213
1549599108,1cyclictest41-21ksoftirqd/323:15:043
1549599108,1cyclictest41-21ksoftirqd/321:45:093
1549599108,1cyclictest41-21ksoftirqd/300:00:503
1549599108,1cyclictest17666-21kworker/3:000:32:043
1549599107,3cyclictest0-21swapper/323:27:403
1549599103,4cyclictest5487-21sshd22:07:283
1549599103,4cyclictest25719-21sshd00:06:183
1549599103,4cyclictest11705-21sshd22:37:123
1549599102,5cyclictest14171-21id00:21:193
1549599100,9cyclictest15127-21kworker/3:122:01:173
1549499103,1cyclictest0-21swapper/219:49:402
1549499100,3cyclictest0-21swapper/220:40:152
1549399109,1cyclictest25-21ksoftirqd/122:52:241
1549399109,1cyclictest25-21ksoftirqd/122:52:241
1549399109,1cyclictest25-21ksoftirqd/121:40:271
1549399108,1cyclictest8326-21grepconf.sh22:07:381
1549399108,1cyclictest25-21ksoftirqd/123:22:021
1549399108,1cyclictest15353-21sshd00:31:111
1549399103,6cyclictest25022-21sshd23:13:221
1549399102,3cyclictest2032-21sshd23:33:341
1549399102,3cyclictest11885-21sshd00:21:101
1549399101,4cyclictest721-21dbus-daemon22:45:311
1549399101,4cyclictest14986-21sshd21:13:111
1549399100,4cyclictest882-21sshd21:05:501
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional