You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 08:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Jun 26, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
89272980,0sleep6631rcuc/621:59:546
105122920,2sleep51163699cyclictest00:13:205
43032870,2sleep31162099cyclictest21:39:083
118742810,0sleep70-21swapper/723:42:557
227242730,2sleep71165299cyclictest23:07:317
247532710,0sleep71165299cyclictest23:19:087
270842580,2sleep11160499cyclictest22:37:211
264682540,0sleep20-21swapper/200:06:452
83522520,0sleep70-21swapper/723:40:557
1143725045,2sleep50-21swapper/519:07:295
241252490,0sleep20-21swapper/222:00:542
165622490,1sleep716546-21bash23:50:487
152652490,0sleep20-21swapper/223:54:352
140242490,0sleep50-21swapper/521:45:195
1119024924,9sleep30-21swapper/319:04:063
68252480,0sleep00-21swapper/022:01:480
1140624824,9sleep10-21swapper/119:07:011
146122470,0sleep50-21swapper/500:11:445
224492460,1sleep622445-21sshd22:33:106
58932450,0sleep70-21swapper/721:18:467
56332450,0sleep70-21swapper/722:15:097
45092450,0sleep30-21swapper/321:35:243
233382450,0sleep00-21swapper/023:21:010
160562450,1sleep125-21ksoftirqd/122:51:471
160562450,1sleep125-21ksoftirqd/122:51:471
252632440,0sleep425257-21sshd21:27:244
9572420,0sleep0953-21sshd21:37:050
1111124226,12sleep70-21swapper/719:03:067
57922410,0sleep5551rcuc/521:48:325
307402410,0sleep10-21swapper/121:53:401
262062410,0sleep30-21swapper/320:27:493
158462410,0sleep40-21swapper/422:00:244
151832410,0sleep50-21swapper/523:56:305
1141124130,8sleep60-21swapper/619:07:066
45532400,0sleep74552-21sshd00:20:437
41532400,0sleep20-21swapper/222:34:022
26362400,0sleep10-21swapper/122:54:431
227692400,0sleep11160499cyclictest00:04:351
139712400,0sleep50-21swapper/522:53:275
315612390,0sleep631562-21fschecks_count20:37:456
255812390,0sleep40-21swapper/422:04:484
236212390,0sleep10-21swapper/121:10:151
1130723926,9sleep00-21swapper/019:05:400
1128423926,9sleep40-21swapper/419:05:204
896123826,8sleep20-21swapper/219:02:372
88492380,2sleep11160499cyclictest22:40:021
313182380,0sleep70-21swapper/721:44:257
157112380,0sleep10-21swapper/121:07:351
287292370,0sleep10-21swapper/121:40:351
286262360,1sleep557-21ksoftirqd/523:49:345
235012300,0sleep40-21swapper/423:24:504
66182290,0sleep30-21swapper/323:20:003
11852250,0sleep30-21swapper/323:08:073
11604992412,2cyclictest25-21ksoftirqd/121:17:071
1161399223,4cyclictest5943-21grepconf.sh23:14:072
1161399221,6cyclictest0-21swapper/222:28:352
11652992114,3cyclictest73-21ksoftirqd/721:31:007
1161399213,4cyclictest24419-21grepconf.sh23:21:052
1161399212,5cyclictest22518-21systemd00:23:332
1161399212,5cyclictest0-21swapper/200:15:012
1161399212,4cyclictest30696-21bash23:04:062
1161399212,2cyclictest3173-21bash00:18:392
11652992016,3cyclictest73-21ksoftirqd/700:22:567
11652992016,1cyclictest73-21ksoftirqd/721:36:417
11652992013,4cyclictest73-21ksoftirqd/723:23:167
1161399204,3cyclictest707-21bash21:50:082
1161399204,3cyclictest4114-21bash21:35:232
1161399203,7cyclictest721-21dbus-daemon21:19:152
1161399203,6cyclictest26276-21sshd22:23:532
1161399203,16cyclictest22800-21sshd00:29:172
1161399203,16cyclictest22800-21sshd00:29:172
1161399202,7cyclictest0-21swapper/222:06:472
1161399202,6cyclictest709-21systemd-logind23:49:022
1161399202,5cyclictest17382-21sshd21:15:442
1161399202,5cyclictest10508-21sshd23:58:022
1161399202,5cyclictest0-21swapper/200:33:492
1161399202,5cyclictest0-21swapper/200:33:492
1161399201,3cyclictest12336-21sshd22:13:362
1160499203,1cyclictest25-21ksoftirqd/123:27:531
1165299195,3cyclictest73-21ksoftirqd/722:25:287
1165299193,3cyclictest73-21ksoftirqd/722:57:517
11652991917,1cyclictest73-21ksoftirqd/722:04:027
1161399194,6cyclictest3712-21bash00:09:082
1161399193,5cyclictest721-21dbus-daemon22:56:382
1161399193,4cyclictest29611-21bash23:42:102
1161399193,4cyclictest17239-21bash22:21:322
1161399193,3cyclictest23405-21bash21:12:202
1161399192,6cyclictest24931-21systemd-cgroups21:27:232
1161399192,5cyclictest22510-21systemd22:48:152
1161399192,5cyclictest22510-21systemd22:48:152
11604991916,2cyclictest25-21ksoftirqd/122:43:231
11604991915,3cyclictest25-21ksoftirqd/123:06:271
11604991915,3cyclictest25-21ksoftirqd/121:25:061
11604991915,1cyclictest464-21systemd-journal23:44:121
1160499190,9cyclictest5650-21kworker/1:100:26:221
60192180,0sleep10-21swapper/100:09:161
255812180,0sleep70-21swapper/721:53:227
1165299188,1cyclictest73-21ksoftirqd/721:27:047
1165299186,1cyclictest73-21ksoftirqd/722:47:337
11652991816,1cyclictest73-21ksoftirqd/722:22:277
11652991816,1cyclictest73-21ksoftirqd/721:58:387
1161399183,6cyclictest18388-21grepconf.sh23:43:172
1161399183,5cyclictest27722-21bash23:09:422
1161399183,3cyclictest23601-21sshd23:34:162
1161399183,3cyclictest23601-21sshd23:34:162
1161399182,6cyclictest4925-21grep23:31:192
1161399182,5cyclictest7380-21systemd21:28:072
1161399182,5cyclictest31870-21systemctl23:27:182
1161399182,5cyclictest0-21swapper/221:39:382
1161399182,4cyclictest663-21in:imjournal22:58:102
1161399182,4cyclictest19400-21systemd21:43:432
1160499189,1cyclictest131rcu_sched21:27:491
11604991816,1cyclictest25-21ksoftirqd/122:16:391
11604991813,3cyclictest25-21ksoftirqd/123:52:171
11604991813,1cyclictest25-21ksoftirqd/121:19:131
35912170,1sleep1241ktimersoftd/100:33:511
35912170,1sleep1241ktimersoftd/100:33:511
271392170,2sleep61164499cyclictest23:07:466
171332170,1sleep71-21systemd00:11:547
1165299174,3cyclictest73-21ksoftirqd/700:29:147
1165299174,3cyclictest73-21ksoftirqd/700:29:147
1165299173,1cyclictest73-21ksoftirqd/700:02:507
1165299172,2cyclictest73-21ksoftirqd/722:09:517
1165299172,1cyclictest73-21ksoftirqd/700:32:537
1165299172,1cyclictest73-21ksoftirqd/700:32:537
11652991715,2cyclictest73-21ksoftirqd/721:37:587
11652991715,1cyclictest73-21ksoftirqd/722:47:537
11652991715,1cyclictest73-21ksoftirqd/722:47:537
11652991715,1cyclictest73-21ksoftirqd/722:34:207
11652991714,2cyclictest73-21ksoftirqd/721:51:127
11652991714,1cyclictest73-21ksoftirqd/722:40:427
11652991713,4cyclictest73-21ksoftirqd/700:17:317
1165299170,1cyclictest131rcu_sched22:55:507
1161399173,5cyclictest13075-21bash22:38:212
1161399173,13cyclictest13550irq/24-ahci[00022:07:582
1161399172,6cyclictest0-21swapper/221:53:422
1161399172,3cyclictest23983-21sshd22:44:382
1160499172,3cyclictest25-21ksoftirqd/123:22:551
11604991715,1cyclictest25-21ksoftirqd/122:25:261
11604991714,2cyclictest25-21ksoftirqd/123:58:361
11604991714,2cyclictest25-21ksoftirqd/123:13:381
11604991713,3cyclictest25-21ksoftirqd/121:32:371
11604991712,3cyclictest25-21ksoftirqd/122:59:141
1160499171,1cyclictest25-21ksoftirqd/122:01:551
36572160,0sleep50-21swapper/521:31:425
250262160,0sleep30-21swapper/323:28:413
1165299167,3cyclictest73-21ksoftirqd/723:08:027
11652991614,2cyclictest73-21ksoftirqd/722:30:057
11652991614,1cyclictest73-21ksoftirqd/721:13:147
11652991613,2cyclictest73-21ksoftirqd/723:52:487
11652991612,3cyclictest73-21ksoftirqd/723:33:487
11652991612,3cyclictest73-21ksoftirqd/723:33:487
11652991612,1cyclictest121rcu_preempt23:29:177
11652991611,2cyclictest73-21ksoftirqd/723:57:567
11604991615,1cyclictest25-21ksoftirqd/123:32:391
11604991615,1cyclictest25-21ksoftirqd/123:32:391
11604991615,1cyclictest25-21ksoftirqd/122:31:351
11604991615,1cyclictest25-21ksoftirqd/122:12:181
11604991615,1cyclictest25-21ksoftirqd/121:47:121
11604991614,1cyclictest464-21systemd-journal00:17:251
11604991614,1cyclictest25-21ksoftirqd/123:54:471
11604991614,1cyclictest25-21ksoftirqd/123:37:421
11604991614,1cyclictest25-21ksoftirqd/122:02:581
11604991614,1cyclictest25-21ksoftirqd/121:52:321
11604991614,1cyclictest25-21ksoftirqd/100:27:531
11604991614,1cyclictest25-21ksoftirqd/100:27:531
11604991613,2cyclictest25-21ksoftirqd/123:07:451
11604991613,2cyclictest25-21ksoftirqd/122:18:321
11595991613,1cyclictest9-21ksoftirqd/023:01:380
115922160,1sleep41-21systemd22:15:304
232282150,2sleep41162899cyclictest21:51:274
147122150,1sleep514711-21grepconf.sh21:52:485
11652991514,1cyclictest73-21ksoftirqd/721:08:087
11652991513,1cyclictest73-21ksoftirqd/723:13:227
1164499159,1cyclictest0-21swapper/623:58:016
11620991514,1cyclictest41-21ksoftirqd/322:57:093
11620991513,1cyclictest41-21ksoftirqd/300:25:533
11604991513,1cyclictest25-21ksoftirqd/123:19:201
11604991511,1cyclictest25-21ksoftirqd/100:17:521
258182140,1sleep50-21swapper/500:27:385
258182140,1sleep50-21swapper/500:27:385
244032140,0sleep3401ktimersoftd/321:53:183
118382140,1sleep6709-21systemd-logind23:33:336
118382140,1sleep6709-21systemd-logind23:33:336
1164499143,5cyclictest709-21systemd-logind22:45:016
11620991413,1cyclictest41-21ksoftirqd/322:28:083
1161399142,4cyclictest29122-21cat19:37:452
11595991412,1cyclictest9-21ksoftirqd/000:30:130
11595991412,1cyclictest9-21ksoftirqd/000:30:130
11595991410,1cyclictest9-21ksoftirqd/000:05:540
311462130,0sleep40-21swapper/421:31:254
1164499133,4cyclictest709-21systemd-logind22:19:356
1164499132,5cyclictest24720-21sshd23:01:536
11644991311,1cyclictest65-21ksoftirqd/622:32:346
1164499131,5cyclictest20602-21sshd21:36:206
1164499131,11cyclictest16361-21sshd21:11:576
1162899138,1cyclictest49-21ksoftirqd/422:07:524
11620991312,1cyclictest41-21ksoftirqd/322:35:073
11620991311,1cyclictest41-21ksoftirqd/323:46:333
11620991311,1cyclictest41-21ksoftirqd/323:03:063
11620991311,1cyclictest41-21ksoftirqd/321:47:473
11620991311,1cyclictest41-21ksoftirqd/321:31:003
11620991311,1cyclictest41-21ksoftirqd/321:23:063
11620991311,1cyclictest41-21ksoftirqd/321:18:543
11620991311,1cyclictest41-21ksoftirqd/300:36:253
11620991311,1cyclictest41-21ksoftirqd/300:36:253
1162099130,13cyclictest0-21swapper/323:47:553
1162099130,12cyclictest11913-21grepconf.sh21:58:083
1161399132,2cyclictest4658-21cat20:47:442
1161399131,4cyclictest18020-21df19:17:452
11604991313,0cyclictest7540-21kworker/1:220:54:581
11604991313,0cyclictest7540-21kworker/1:220:54:581
1159599132,5cyclictest27324-21bash23:25:030
1159599131,11cyclictest30827-21sshd23:36:380
1159599131,11cyclictest30827-21sshd23:36:380
114102130,1sleep011398-21sshd21:32:090
47552120,1sleep54749-21sshd23:29:235
11652991210,1cyclictest73-21ksoftirqd/721:07:357
1164499127,4cyclictest65-21ksoftirqd/623:53:386
1164499125,6cyclictest709-21systemd-logind00:14:526
1164499125,1cyclictest857-21polkitd21:53:066
1164499124,5cyclictest857-21polkitd00:31:106
1164499124,5cyclictest857-21polkitd00:31:106
1164499122,4cyclictest17943-21sshd22:04:206
11644991210,1cyclictest65-21ksoftirqd/600:34:186
11644991210,1cyclictest65-21ksoftirqd/600:34:186
1164499121,5cyclictest736-21gdbus21:18:186
1164499121,4cyclictest721-21dbus-daemon23:16:416
1163699124,4cyclictest857-21polkitd23:38:575
1163699123,4cyclictest730-21NetworkManager21:36:335
1163699122,4cyclictest8340-21sshd22:58:475
1163699122,4cyclictest721-21dbus-daemon22:46:185
1163699122,4cyclictest30318-21sshd23:32:485
1163699122,4cyclictest30318-21sshd23:32:485
1163699122,4cyclictest21997-21systemd-cgroups21:21:365
1163699122,4cyclictest0-21swapper/523:13:565
1163699120,1cyclictest0-21swapper/523:11:105
1162899129,3cyclictest49-21ksoftirqd/422:56:294
11628991211,1cyclictest49-21ksoftirqd/400:29:484
11628991211,1cyclictest49-21ksoftirqd/400:29:484
1162899120,12cyclictest24203-21kworker/4:422:35:344
1162899120,11cyclictest0-21swapper/400:17:064
1162099129,3cyclictest41-21ksoftirqd/323:25:513
11620991211,1cyclictest41-21ksoftirqd/300:07:203
11620991211,1cyclictest15-21kswork22:08:543
11620991210,1cyclictest5996-21kworker/3:122:25:263
11620991210,1cyclictest41-21ksoftirqd/323:34:393
11620991210,1cyclictest41-21ksoftirqd/323:34:393
11620991210,1cyclictest41-21ksoftirqd/300:00:063
1162099120,1cyclictest0-21swapper/323:53:033
1161399122,5cyclictest26584-21expr20:27:512
1161399122,2cyclictest18197-21/usr/sbin/munin20:12:522
1161399121,5cyclictest28650-21df_inode20:32:472
1161399121,5cyclictest14287-21df20:07:462
1161399121,2cyclictest32530-21ntp_states20:37:502
11604991211,1cyclictest7540-21kworker/1:220:37:481
11604991211,1cyclictest29601-21kworker/1:019:25:001
1159599129,3cyclictest9-21ksoftirqd/022:44:380
11595991211,1cyclictest9-21ksoftirqd/000:37:230
11595991211,1cyclictest9-21ksoftirqd/000:37:230
106242120,0sleep30-21swapper/321:17:143
34012110,0sleep43398-21sshd23:17:534
259282110,0sleep60-21swapper/623:28:446
235192110,0sleep50-21swapper/521:25:255
221912110,0sleep00-21swapper/023:41:440
21662110,0sleep00-21swapper/019:47:350
1165299110,1cyclictest0-21swapper/719:17:517
1164499114,6cyclictest766-21sshd23:06:136
1164499113,7cyclictest13723-21sshd00:23:016
1164499111,4cyclictest721-21dbus-daemon23:26:176
1164499110,5cyclictest8382-21sshd00:11:216
1164499110,5cyclictest820-21kill00:03:106
1164499110,5cyclictest19102-21bash00:21:346
1164499110,11cyclictest28556-21kworker/6:121:25:556
1164499110,11cyclictest21163-21kworker/6:522:24:436
1164499110,11cyclictest21163-21kworker/6:522:15:216
1164499110,11cyclictest1955-21kworker/6:323:46:106
1164499110,11cyclictest17138-21kworker/6:422:54:376
1164499110,1cyclictest12017-21sshd23:20:216
1164499110,1cyclictest0-21swapper/623:48:246
1163699119,1cyclictest57-21ksoftirqd/500:21:145
1163699114,6cyclictest404-21sshd00:24:095
1163699112,8cyclictest730-21NetworkManager22:05:455
1163699112,8cyclictest17597-21systemd00:04:175
1163699112,4cyclictest709-21systemd-logind22:00:585
1163699112,4cyclictest0-21swapper/522:29:165
1163699111,4cyclictest28078-21sshd23:23:115
1163699111,4cyclictest1-21systemd22:18:505
1163699110,10cyclictest21249-21kworker/5:323:05:105
1162899119,1cyclictest49-21ksoftirqd/423:58:274
1162899118,2cyclictest25076-21bash21:36:364
1162899115,3cyclictest11141-21kworker/4:021:13:034
1162899112,5cyclictest11344-21sshd21:37:414
1162899112,4cyclictest32061-21grepconf.sh21:53:454
11628991110,1cyclictest5621-21sshd21:09:014
11628991110,1cyclictest49-21ksoftirqd/421:21:374
11628991110,1cyclictest24330-21kworker/4:223:12:374
1162899110,10cyclictest0-21swapper/423:00:104
1162099119,2cyclictest41-21ksoftirqd/300:18:113
1162099119,1cyclictest41-21ksoftirqd/323:42:253
1162099119,1cyclictest41-21ksoftirqd/322:19:503
1162099119,1cyclictest41-21ksoftirqd/321:09:083
1162099118,2cyclictest41-21ksoftirqd/322:42:413
1162099118,2cyclictest41-21ksoftirqd/322:37:483
11620991110,1cyclictest41-21ksoftirqd/300:14:333
11620991110,1cyclictest0-21swapper/322:06:573
1162099110,2cyclictest5216-21systemd00:28:133
1162099110,2cyclictest5216-21systemd00:28:133
1162099110,11cyclictest8384-21kworker/3:521:43:073
1161399111,5cyclictest12738-21idleruntime19:07:482
1161399111,4cyclictest9069-21irqstats19:57:502
1161399111,4cyclictest7657-21df20:52:442
1161399111,4cyclictest7657-21df20:52:442
1161399111,4cyclictest15168-21df19:12:462
1161399111,4cyclictest13400-21df21:02:472
1161399111,2cyclictest11398-21cstates20:02:462
11604991110,1cyclictest25-21ksoftirqd/119:47:341
1159599119,1cyclictest9-21ksoftirqd/023:28:080
1159599119,1cyclictest9-21ksoftirqd/022:29:010
1159599119,1cyclictest9-21ksoftirqd/021:42:370
1159599119,1cyclictest9-21ksoftirqd/000:12:510
1159599115,3cyclictest16890-21sshd21:21:180
1159599114,4cyclictest14376-21systemd22:38:260
11595991110,1cyclictest9-21ksoftirqd/021:10:530
1159599110,2cyclictest22539-21grepconf.sh22:35:090
1159599110,1cyclictest0-21swapper/000:01:510
245502100,0sleep4481ktimersoftd/400:20:004
130112100,2sleep41162899cyclictest21:47:104
126992100,0sleep612701-21sshd22:49:366
126992100,0sleep612701-21sshd22:49:366
1165299108,1cyclictest73-21ksoftirqd/719:27:347
1164499103,6cyclictest32645-21sshd21:44:306
1164499103,6cyclictest31715-21sshd21:40:456
1164499100,4cyclictest9780-21systemd21:48:466
1164499100,4cyclictest21935-21sshd23:39:496
1164499100,4cyclictest16037-21kworker/6:221:15:476
1164499100,10cyclictest0-21swapper/621:29:506
1163699109,1cyclictest57-21ksoftirqd/521:09:495
1163699103,4cyclictest17413-21grepconf.sh00:36:415
1163699103,4cyclictest17413-21grepconf.sh00:36:415
1163699102,4cyclictest464-21systemd-journal21:16:365
1163699101,4cyclictest17835-21sshd22:42:295
1163699101,4cyclictest0-21swapper/521:37:595
1163699100,4cyclictest9804-21sshd23:59:585
1163699100,4cyclictest857-21polkitd22:23:135
1163699100,4cyclictest721-21dbus-daemon23:18:335
1163699100,4cyclictest721-21dbus-daemon22:51:305
1163699100,4cyclictest721-21dbus-daemon22:51:305
1163699100,4cyclictest420-21sshd22:35:455
1163699100,4cyclictest0-21swapper/522:12:515
1163699100,4cyclictest0-21swapper/522:12:275
1162899109,1cyclictest14503-21bash22:44:054
1162899109,1cyclictest0-21swapper/423:30:164
1162899108,1cyclictest49-21ksoftirqd/423:51:004
1162899108,1cyclictest49-21ksoftirqd/422:27:034
1162899105,3cyclictest22827-21sshd23:05:364
1162899105,2cyclictest5993-21sshd23:35:094
1162899105,2cyclictest5993-21sshd23:35:094
1162899103,4cyclictest26859-21sshd23:40:064
1162899102,5cyclictest709-21systemd-logind00:10:534
1162899102,4cyclictest721-21dbus-daemon22:51:194
1162899102,4cyclictest721-21dbus-daemon22:51:194
1162899102,4cyclictest6376-21id00:22:424
1162899100,9cyclictest11023-21kworker/4:023:55:154
1162899100,6cyclictest1060-21grepconf.sh00:33:424
1162899100,6cyclictest1060-21grepconf.sh00:33:424
1162899100,10cyclictest24595-21kworker/4:622:28:584
1162899100,10cyclictest11023-21kworker/4:000:02:534
1162099109,1cyclictest41-21ksoftirqd/322:12:543
1162099108,1cyclictest41-21ksoftirqd/323:17:173
1162099108,1cyclictest41-21ksoftirqd/322:59:333
1162099108,1cyclictest41-21ksoftirqd/322:50:403
1162099108,1cyclictest41-21ksoftirqd/322:50:403
1162099103,3cyclictest15008-21grep00:07:533
1161399102,5cyclictest11027-21iostat20:57:492
1161399100,10cyclictest0-21swapper/219:27:342
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional