You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 21:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Apr 23, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
244892700,1sleep31796999cyclictest09:47:403
133672540,2sleep31796999cyclictest12:24:543
319492510,0sleep00-21swapper/011:41:180
232462510,1sleep09-21ksoftirqd/010:06:110
26302490,0sleep10-21swapper/109:12:541
42132480,0sleep70-21swapper/710:51:277
162502480,0sleep116240-21sshd10:16:531
77832470,1sleep233-21ksoftirqd/211:12:052
1780624725,8sleep10-21swapper/107:09:481
168352470,2sleep585250irq/26-em1-tx-010:54:065
4582460,0sleep20-21swapper/212:20:212
16202460,1sleep61625-21bash10:23:316
128112450,1sleep212770-21sshd11:38:242
102452450,1sleep010231-21sshd09:31:590
102042450,0sleep40-21swapper/410:16:324
55962440,0sleep20-21swapper/210:49:462
1761024431,9sleep40-21swapper/407:07:034
159912440,1sleep415989-21grep10:28:024
131112440,2sleep61799099cyclictest09:11:236
86152430,0sleep00-21swapper/010:53:370
42942430,0sleep30-21swapper/312:35:273
312452430,0sleep00-21swapper/012:29:400
312452430,0sleep00-21swapper/012:29:400
17802430,0sleep00-21swapper/010:45:440
17042430,0sleep40-21swapper/410:56:534
158482430,0sleep40-21swapper/411:10:394
62822420,0sleep10-21swapper/109:59:391
303682420,0sleep30-21swapper/312:07:163
27872420,0sleep10-21swapper/109:42:421
25912420,1sleep02590-21grepconf.sh09:42:410
153852420,0sleep00-21swapper/012:23:070
112572420,2sleep01794799cyclictest10:31:260
290242410,0sleep70-21swapper/712:20:107
269982410,0sleep10-21swapper/112:29:251
269982410,0sleep10-21swapper/112:29:251
180832410,0sleep30-21swapper/310:28:093
1752124129,9sleep30-21swapper/307:05:493
1748724129,8sleep70-21swapper/707:05:217
56072400,0sleep40-21swapper/409:28:034
258142400,0sleep10-21swapper/110:50:491
179562400,0sleep30-21swapper/310:55:563
1759124027,9sleep50-21swapper/507:06:485
155212400,0sleep30-21swapper/310:48:273
214392390,0sleep70-21swapper/710:28:217
1772023927,8sleep00-21swapper/007:08:350
1757923928,8sleep20-21swapper/207:06:372
1752423926,9sleep60-21swapper/607:05:526
85052380,0sleep70-21swapper/709:57:537
280972380,2sleep71799199cyclictest12:25:387
280972380,2sleep71799199cyclictest12:25:387
262982380,0sleep20-21swapper/209:42:102
68672370,1sleep11-21systemd11:13:561
15442360,0sleep50-21swapper/510:36:285
15442360,0sleep50-21swapper/510:36:285
222362340,1sleep31796999cyclictest11:38:573
322682280,1sleep5561ktimersoftd/511:24:415
17988992511,1cyclictest57-21ksoftirqd/511:13:435
17988992510,4cyclictest57-21ksoftirqd/509:15:325
17988992510,3cyclictest57-21ksoftirqd/509:27:595
17988992412,3cyclictest57-21ksoftirqd/512:17:485
17988992410,3cyclictest57-21ksoftirqd/510:04:105
1798899238,1cyclictest57-21ksoftirqd/510:33:045
1798899236,3cyclictest57-21ksoftirqd/510:15:005
17988992312,1cyclictest57-21ksoftirqd/511:40:115
1794799232,5cyclictest1-21systemd10:39:310
1794799232,5cyclictest1-21systemd10:39:310
1798899229,3cyclictest57-21ksoftirqd/511:45:265
1798899228,3cyclictest57-21ksoftirqd/511:37:535
17988992210,3cyclictest57-21ksoftirqd/512:28:315
17988992210,3cyclictest57-21ksoftirqd/512:28:315
1794799222,6cyclictest9075-21sshd09:11:070
1794799222,5cyclictest30638-21rm11:52:250
1798899217,1cyclictest57-21ksoftirqd/512:31:435
1794799212,5cyclictest31864-21bash09:20:150
1794799212,4cyclictest22706-21bash11:16:380
1794799212,4cyclictest21009-21sshd11:20:140
1794799212,4cyclictest19394-21grep10:28:140
1794799212,3cyclictest721-21dbus-daemon10:43:280
1794799212,3cyclictest721-21dbus-daemon10:43:280
1798899209,4cyclictest57-21ksoftirqd/510:28:565
1798899209,3cyclictest57-21ksoftirqd/511:30:135
1798899209,3cyclictest57-21ksoftirqd/511:30:135
1798899209,3cyclictest57-21ksoftirqd/510:44:015
1798899209,3cyclictest57-21ksoftirqd/510:44:015
1798899208,3cyclictest57-21ksoftirqd/511:51:205
1798899208,3cyclictest57-21ksoftirqd/511:26:145
1798899207,3cyclictest57-21ksoftirqd/509:55:055
1798899207,1cyclictest57-21ksoftirqd/512:20:345
1798899206,2cyclictest57-21ksoftirqd/512:36:195
1798899204,3cyclictest57-21ksoftirqd/511:19:475
17988992010,3cyclictest57-21ksoftirqd/509:39:035
17988992010,3cyclictest57-21ksoftirqd/509:21:255
17988992010,3cyclictest57-21ksoftirqd/509:12:335
17988992010,1cyclictest57-21ksoftirqd/511:58:335
1798899201,3cyclictest131rcu_sched10:55:075
1798899201,1cyclictest57-21ksoftirqd/509:41:395
1794799204,4cyclictest8226-21systemd11:26:570
1794799203,5cyclictest21515-21sshd12:08:390
1794799203,4cyclictest16236-21switchtime09:45:160
1794799203,2cyclictest721-21dbus-daemon10:18:070
1794799202,6cyclictest709-21systemd-logind09:54:180
1794799202,5cyclictest721-21dbus-daemon12:15:170
1794799202,5cyclictest721-21dbus-daemon09:56:080
1794799202,5cyclictest0-21swapper/011:00:050
1794799202,4cyclictest0-21swapper/009:36:580
1794799201,4cyclictest0-21swapper/010:20:320
1798899199,1cyclictest57-21ksoftirqd/511:07:295
1798899197,3cyclictest57-21ksoftirqd/512:04:295
1798899194,3cyclictest57-21ksoftirqd/510:46:085
1798899193,2cyclictest57-21ksoftirqd/512:09:325
17988991910,3cyclictest57-21ksoftirqd/509:31:565
1794799193,5cyclictest26142-21bash11:39:110
1794799193,5cyclictest10270-21sshd09:28:200
1794799193,2cyclictest3432-21systemd11:56:240
1794799192,6cyclictest0-21swapper/012:00:410
1794799192,4cyclictest9585-21sshd12:35:460
1794799192,3cyclictest0-21swapper/011:10:200
1794799192,2cyclictest0-21swapper/012:10:040
1794799191,4cyclictest25717-21sshd11:48:260
1794799191,2cyclictest0-21swapper/011:05:100
1794799190,7cyclictest0-21swapper/012:30:310
172662190,2sleep61799099cyclictest12:38:116
311352180,1sleep1721-21dbus-daemon10:28:551
304512180,0sleep70-21swapper/712:10:577
283912180,0sleep10-21swapper/111:57:531
204662180,1sleep2758-21runrttasks10:19:032
1798899185,2cyclictest57-21ksoftirqd/510:21:175
1798899185,2cyclictest57-21ksoftirqd/509:52:465
17988991817,1cyclictest551rcuc/510:13:545
17988991813,1cyclictest57-21ksoftirqd/511:00:075
17988991812,3cyclictest57-21ksoftirqd/509:45:095
1798899181,1cyclictest0-21swapper/510:05:165
17978991816,1cyclictest49-21ksoftirqd/411:03:454
17978991813,3cyclictest49-21ksoftirqd/409:43:574
1794799183,5cyclictest2987-21rm10:55:080
1794799183,5cyclictest28252-21rm09:16:210
1794799182,5cyclictest25700-21sshd11:31:400
1794799182,5cyclictest25700-21sshd11:31:400
1794799182,4cyclictest18494-21sshd10:02:100
1794799181,5cyclictest0-21swapper/010:14:190
325062170,1sleep3721-21dbus-daemon11:07:573
209582170,0sleep40-21swapper/411:09:104
17991991712,2cyclictest24229-21sshd09:42:037
1798899177,3cyclictest57-21ksoftirqd/512:09:565
17978991715,1cyclictest17601-21bash11:40:274
57942160,0sleep70-21swapper/712:30:037
17991991614,1cyclictest73-21ksoftirqd/711:21:127
17991991612,2cyclictest73-21ksoftirqd/711:06:477
17978991614,1cyclictest49-21ksoftirqd/409:35:574
17978991614,1cyclictest49-21ksoftirqd/409:22:474
17978991612,3cyclictest49-21ksoftirqd/411:36:224
1797899160,15cyclictest3542-21kworker/4:012:00:194
1796999160,15cyclictest6726-21kworker/3:011:59:213
310232150,0sleep731015-21sshd09:20:137
17991991513,1cyclictest73-21ksoftirqd/709:49:507
1797899158,3cyclictest49-21ksoftirqd/412:34:534
17978991513,1cyclictest49-21ksoftirqd/412:39:064
17978991513,1cyclictest49-21ksoftirqd/410:12:044
17978991513,1cyclictest49-21ksoftirqd/409:19:254
17978991512,3cyclictest49-21ksoftirqd/410:50:104
17978991512,1cyclictest49-21ksoftirqd/411:25:054
17978991511,3cyclictest49-21ksoftirqd/409:48:484
17969991513,1cyclictest41-21ksoftirqd/310:17:333
144342150,1sleep114435-21sshd09:48:581
120562150,1sleep6758-21runrttasks10:55:356
5422140,0sleep60-21swapper/610:27:086
252102140,1sleep125069-21sshd10:10:051
221902140,1sleep122187-21sshd11:29:421
1799199147,4cyclictest73-21ksoftirqd/709:51:247
17991991412,1cyclictest73-21ksoftirqd/711:14:347
17991991412,1cyclictest73-21ksoftirqd/709:31:307
17991991412,1cyclictest73-21ksoftirqd/709:26:507
1799199140,13cyclictest2445-21kworker/7:211:33:467
1799199140,13cyclictest2445-21kworker/7:211:33:467
17990991412,1cyclictest65-21ksoftirqd/611:15:116
17990991411,2cyclictest65-21ksoftirqd/610:35:116
17990991411,2cyclictest65-21ksoftirqd/610:35:116
17988991410,3cyclictest57-21ksoftirqd/509:00:125
1797899149,4cyclictest49-21ksoftirqd/410:33:594
1797899148,2cyclictest49-21ksoftirqd/409:31:384
17978991413,1cyclictest49-21ksoftirqd/412:07:574
17978991412,1cyclictest49-21ksoftirqd/412:19:024
17978991412,1cyclictest49-21ksoftirqd/411:56:534
17978991412,1cyclictest49-21ksoftirqd/411:15:164
17978991412,1cyclictest49-21ksoftirqd/410:20:324
17978991412,1cyclictest49-21ksoftirqd/409:56:044
17978991410,1cyclictest49-21ksoftirqd/411:46:344
1797899140,13cyclictest31254-21kworker/4:512:20:384
17969991413,1cyclictest41-21ksoftirqd/312:03:023
17969991413,1cyclictest41-21ksoftirqd/311:31:433
17969991413,1cyclictest41-21ksoftirqd/311:31:433
17969991413,1cyclictest41-21ksoftirqd/309:36:293
1794799141,6cyclictest0-21swapper/008:05:070
1799199139,1cyclictest73-21ksoftirqd/709:35:187
17991991312,1cyclictest73-21ksoftirqd/709:19:127
17991991311,1cyclictest73-21ksoftirqd/712:35:187
17991991311,1cyclictest73-21ksoftirqd/711:55:507
17991991311,1cyclictest73-21ksoftirqd/711:02:537
17991991311,1cyclictest73-21ksoftirqd/710:40:017
17991991311,1cyclictest73-21ksoftirqd/710:40:017
17991991311,1cyclictest73-21ksoftirqd/710:36:557
17991991311,1cyclictest73-21ksoftirqd/710:36:557
17991991310,3cyclictest73-21ksoftirqd/712:18:417
1799099138,2cyclictest65-21ksoftirqd/612:27:096
1799099138,2cyclictest65-21ksoftirqd/612:27:096
1799099138,1cyclictest65-21ksoftirqd/611:14:066
1799099130,12cyclictest721-21dbus-daemon11:24:346
1797899139,1cyclictest49-21ksoftirqd/409:10:474
17978991311,1cyclictest49-21ksoftirqd/411:51:294
17978991311,1cyclictest49-21ksoftirqd/411:34:274
17978991311,1cyclictest49-21ksoftirqd/411:34:274
17978991311,1cyclictest49-21ksoftirqd/410:45:364
17978991311,1cyclictest49-21ksoftirqd/410:07:424
17978991311,1cyclictest49-21ksoftirqd/410:00:234
17978991311,1cyclictest49-21ksoftirqd/409:52:474
17978991310,1cyclictest49-21ksoftirqd/410:42:254
17978991310,1cyclictest49-21ksoftirqd/410:42:254
17969991312,1cyclictest41-21ksoftirqd/309:55:073
17969991312,1cyclictest41-21ksoftirqd/309:28:543
17969991311,1cyclictest41-21ksoftirqd/311:27:203
17969991311,1cyclictest41-21ksoftirqd/311:02:123
17969991311,1cyclictest41-21ksoftirqd/310:42:003
17969991311,1cyclictest41-21ksoftirqd/310:42:003
1796999130,2cyclictest23218-21grepconf.sh11:24:093
17961991310,2cyclictest19511-21sshd10:24:342
1795499139,1cyclictest25-21ksoftirqd/112:30:511
1795499138,1cyclictest25-21ksoftirqd/111:54:221
17954991311,1cyclictest25-21ksoftirqd/111:19:541
17954991311,1cyclictest25-21ksoftirqd/110:45:141
1795499130,1cyclictest131rcu_sched11:31:371
1795499130,1cyclictest131rcu_sched11:31:371
1794799132,5cyclictest22179-21sed07:15:110
1794799132,5cyclictest16205-21date08:59:550
1794799132,5cyclictest11718-21wc07:55:060
1794799132,2cyclictest28197-21awk07:25:110
1794799131,6cyclictest0-21swapper/008:00:080
1794799131,5cyclictest0-21swapper/007:45:050
1794799131,5cyclictest0-21swapper/007:20:110
1794799131,4cyclictest0-21swapper/008:50:080
1794799131,4cyclictest0-21swapper/008:25:110
1794799131,4cyclictest0-21swapper/008:14:540
151982130,0sleep20-21swapper/212:36:062
127252130,0sleep30-21swapper/310:22:163
55802120,0sleep30-21swapper/310:36:423
55802120,0sleep30-21swapper/310:36:423
297342120,0sleep229733-21sshd12:01:382
1799199129,3cyclictest73-21ksoftirqd/710:30:267
1799199127,1cyclictest73-21ksoftirqd/709:12:537
17991991211,1cyclictest73-21ksoftirqd/710:11:427
17991991211,1cyclictest73-21ksoftirqd/710:05:597
17991991210,1cyclictest73-21ksoftirqd/711:51:567
17991991210,1cyclictest73-21ksoftirqd/711:48:577
17991991210,1cyclictest73-21ksoftirqd/711:15:577
17991991210,1cyclictest73-21ksoftirqd/710:59:337
17991991210,1cyclictest73-21ksoftirqd/710:23:287
17991991210,1cyclictest73-21ksoftirqd/710:00:257
17991991210,1cyclictest0-21swapper/711:41:457
1799199120,2cyclictest31912-21systemctl11:37:377
1799099129,1cyclictest65-21ksoftirqd/611:29:086
1799099128,1cyclictest23080-21sshd09:49:296
1799099124,7cyclictest16341-21grepconf.sh11:42:176
17990991210,1cyclictest65-21ksoftirqd/612:05:126
1799099120,11cyclictest30794-21systemd09:55:236
1799099120,11cyclictest0-21swapper/611:50:286
1799099120,1cyclictest1-21systemd10:00:076
17988991211,1cyclictest57-21ksoftirqd/508:35:115
17978991210,1cyclictest49-21ksoftirqd/412:26:484
17978991210,1cyclictest49-21ksoftirqd/412:26:484
17978991210,1cyclictest49-21ksoftirqd/412:11:054
17978991210,1cyclictest49-21ksoftirqd/411:20:154
17978991210,1cyclictest49-21ksoftirqd/410:35:114
17978991210,1cyclictest49-21ksoftirqd/410:35:114
17969991211,1cyclictest41-21ksoftirqd/311:49:203
17969991211,1cyclictest41-21ksoftirqd/309:18:583
17969991210,1cyclictest41-21ksoftirqd/312:15:553
17969991210,1cyclictest41-21ksoftirqd/310:30:173
17969991210,1cyclictest41-21ksoftirqd/309:51:093
1796199128,3cyclictest33-21ksoftirqd/211:17:082
1796199122,4cyclictest3547-21sshd11:02:362
1796199122,4cyclictest1-21systemd10:58:212
1796199122,4cyclictest1-21systemd10:39:552
1796199122,4cyclictest1-21systemd10:39:552
1796199120,11cyclictest10577-21kworker/2:510:32:042
1795499128,4cyclictest25-21ksoftirqd/111:41:351
1795499128,3cyclictest25-21ksoftirqd/109:39:151
17954991210,1cyclictest25-21ksoftirqd/110:38:021
17954991210,1cyclictest25-21ksoftirqd/110:38:021
1795499121,1cyclictest131rcu_sched12:21:581
1795499120,11cyclictest884-21bash10:30:491
1794799122,4cyclictest16536-21cpuspeed_turbos09:00:050
1794799122,2cyclictest23555-21df_inode08:15:080
1794799121,5cyclictest721-21dbus-daemon09:09:550
1794799121,5cyclictest0-21swapper/007:10:070
1794799121,3cyclictest30638-21sshd07:30:110
1794799120,4cyclictest0-21swapper/008:20:060
1799199119,1cyclictest73-21ksoftirqd/712:00:307
1799199119,1cyclictest73-21ksoftirqd/711:25:107
1799199119,1cyclictest73-21ksoftirqd/710:47:437
1799199118,1cyclictest73-21ksoftirqd/710:19:387
1799099119,1cyclictest65-21ksoftirqd/612:21:376
1799099119,1cyclictest65-21ksoftirqd/611:35:076
1799099119,1cyclictest65-21ksoftirqd/609:51:206
1799099119,1cyclictest65-21ksoftirqd/609:31:286
1799099116,2cyclictest65-21ksoftirqd/611:04:146
1799099115,2cyclictest11328-21sshd12:04:226
1799099114,4cyclictest27024-21sshd11:46:356
1799099114,4cyclictest1-21systemd10:09:306
1799099113,4cyclictest25122-21cp11:05:376
1799099112,6cyclictest11830-21id11:56:546
1799099112,5cyclictest0-21swapper/610:13:246
1799099112,1cyclictest0-21swapper/610:48:286
17990991110,1cyclictest65-21ksoftirqd/609:38:116
17990991110,1cyclictest0-21swapper/609:25:546
1798899118,3cyclictest57-21ksoftirqd/508:12:145
1798899114,1cyclictest57-21ksoftirqd/509:09:255
1798899114,1cyclictest57-21ksoftirqd/508:27:035
1798899114,1cyclictest57-21ksoftirqd/508:08:255
1798899114,1cyclictest57-21ksoftirqd/507:52:155
1798899111,1cyclictest2687-21latency_hist07:39:555
17978991110,1cyclictest49-21ksoftirqd/408:54:554
1796999119,1cyclictest41-21ksoftirqd/311:17:083
1796999119,1cyclictest41-21ksoftirqd/310:06:113
1796999119,1cyclictest41-21ksoftirqd/310:00:503
1796999119,1cyclictest41-21ksoftirqd/309:10:413
1796999119,1cyclictest11712-21bash11:43:553
1796999118,2cyclictest1-21systemd09:31:203
17969991110,1cyclictest41-21ksoftirqd/312:34:323
17969991110,1cyclictest41-21ksoftirqd/312:11:173
17969991110,1cyclictest41-21ksoftirqd/311:53:083
17969991110,1cyclictest41-21ksoftirqd/310:50:013
17969991110,1cyclictest41-21ksoftirqd/310:13:363
1796999110,1cyclictest131rcu_sched12:25:063
1796999110,1cyclictest131rcu_sched12:25:063
1796199119,1cyclictest33-21ksoftirqd/212:28:472
1796199119,1cyclictest33-21ksoftirqd/212:28:472
1796199114,4cyclictest19794-21sshd12:19:432
1796199113,5cyclictest18632-21grep09:56:352
17961991110,1cyclictest0-21swapper/212:10:212
1796199111,4cyclictest0-21swapper/212:08:382
1796199110,11cyclictest5376-21kworker/2:111:53:042
1796199110,11cyclictest13944-21kworker/2:309:53:092
1796199110,11cyclictest10577-21kworker/2:510:10:112
1796199110,1cyclictest0-21swapper/209:30:012
1795499119,1cyclictest25-21ksoftirqd/112:06:111
1795499119,1cyclictest25-21ksoftirqd/111:48:411
1795499119,1cyclictest25-21ksoftirqd/111:39:251
1795499119,1cyclictest25-21ksoftirqd/111:02:271
1795499119,1cyclictest25-21ksoftirqd/110:55:121
1795499119,1cyclictest25-21ksoftirqd/110:40:111
1795499119,1cyclictest25-21ksoftirqd/110:40:111
1795499119,1cyclictest25-21ksoftirqd/109:18:401
1795499115,3cyclictest721-21dbus-daemon10:00:401
1795499113,7cyclictest32114-21sshd09:27:421
17954991110,1cyclictest25-21ksoftirqd/112:35:551
17954991110,1cyclictest25-21ksoftirqd/111:06:121
1795499110,10cyclictest3825-21kworker/1:009:50:571
1795499110,10cyclictest18772-21kworker/1:010:09:231
1799199108,2cyclictest73-21ksoftirqd/712:05:247
1799099108,1cyclictest65-21ksoftirqd/612:16:006
1799099108,1cyclictest65-21ksoftirqd/610:50:526
1799099108,1cyclictest65-21ksoftirqd/610:32:186
1799099108,1cyclictest65-21ksoftirqd/610:15:396
1799099108,1cyclictest65-21ksoftirqd/609:16:386
1799099106,3cyclictest65-21ksoftirqd/609:21:366
1799099102,5cyclictest28651-21grepconf.sh12:12:446
1799099100,10cyclictest0-21swapper/611:32:346
1799099100,10cyclictest0-21swapper/611:32:346
1798899103,1cyclictest57-21ksoftirqd/508:46:595
1798899103,1cyclictest57-21ksoftirqd/508:30:575
1798899103,1cyclictest57-21ksoftirqd/507:55:125
1798899103,1cyclictest57-21ksoftirqd/507:43:175
1798899103,1cyclictest57-21ksoftirqd/507:27:485
1798899103,1cyclictest57-21ksoftirqd/507:15:115
1798899102,1cyclictest57-21ksoftirqd/508:00:005
1798899102,1cyclictest57-21ksoftirqd/507:10:145
1798899101,1cyclictest57-21ksoftirqd/508:20:155
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional