You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 00:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Dec 25, 2025 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
42232720,0sleep40-21swapper/410:19:134
324222550,1sleep632423-21bash10:15:146
122562530,2sleep12052599cyclictest09:29:361
38492500,0sleep10-21swapper/110:46:011
165002500,0sleep11-21systemd12:04:411
275922470,1sleep527591-21systemd-cgroups11:42:115
5812460,0sleep00-21swapper/012:09:450
5812460,0sleep00-21swapper/012:09:450
260622460,0sleep30-21swapper/312:05:313
244072460,1sleep665-21ksoftirqd/611:04:566
291612450,0sleep70-21swapper/711:42:217
132692450,0sleep50-21swapper/509:19:395
104152440,0sleep60-21swapper/611:23:466
50652430,0sleep60-21swapper/612:23:366
2021424330,9sleep60-21swapper/607:07:136
2019124330,9sleep30-21swapper/307:06:543
35502420,0sleep30-21swapper/309:28:423
206562420,0sleep70-21swapper/712:04:557
20642420,0sleep30-21swapper/311:59:473
2007124229,9sleep70-21swapper/707:05:147
1759724228,9sleep00-21swapper/007:04:350
74102410,0sleep00-21swapper/009:32:240
73622410,0sleep70-21swapper/711:19:547
224802410,0sleep40-21swapper/410:34:344
2032624128,9sleep50-21swapper/507:08:485
211312400,0sleep20-21swapper/211:31:272
2007724027,9sleep40-21swapper/407:05:194
157342400,2sleep22053399cyclictest11:54:332
157342400,2sleep22053399cyclictest11:54:332
79392390,1sleep449-21ksoftirqd/409:59:274
236042390,0sleep30-21swapper/310:34:413
232262390,2sleep52056099cyclictest10:37:565
2009323928,8sleep20-21swapper/207:05:332
1790923926,9sleep10-21swapper/107:04:361
119952390,2sleep72057499cyclictest09:29:347
278752380,2sleep22053399cyclictest10:41:452
265732380,0sleep10-21swapper/111:45:191
162762370,0sleep00-21swapper/012:18:020
2055299240,8cyclictest30087-21sd-pam09:34:464
2055299230,6cyclictest14359-21kill11:37:294
2055299220,9cyclictest13349-21grepconf.sh09:39:464
20574992116,3cyclictest73-21ksoftirqd/709:12:287
2057499206,3cyclictest73-21ksoftirqd/709:58:067
20574992015,3cyclictest73-21ksoftirqd/711:10:557
20574992015,3cyclictest73-21ksoftirqd/710:24:537
2055299200,7cyclictest0-21swapper/410:08:444
20574991912,4cyclictest73-21ksoftirqd/712:00:097
2055299190,7cyclictest30547-21sshd10:01:424
2055299190,6cyclictest885-21polkitd11:19:344
2055299190,5cyclictest686-21dbus-daemon09:09:504
12152190,1sleep31213-21grepconf.sh10:22:083
208752180,0sleep00-21swapper/011:31:250
20574991817,1cyclictest73-21ksoftirqd/710:01:577
20574991815,2cyclictest73-21ksoftirqd/712:13:437
20574991815,2cyclictest73-21ksoftirqd/712:13:437
20574991812,3cyclictest73-21ksoftirqd/711:47:167
2056699187,2cyclictest65-21ksoftirqd/611:47:396
20566991815,1cyclictest65-21ksoftirqd/612:08:596
20566991814,1cyclictest65-21ksoftirqd/609:53:276
20566991813,3cyclictest492-21systemd-journal10:50:196
20566991812,4cyclictest65-21ksoftirqd/610:39:056
2056699181,1cyclictest65-21ksoftirqd/610:55:256
2055299180,8cyclictest1-21systemd12:13:274
2055299180,8cyclictest1-21systemd12:13:274
2055299180,8cyclictest0-21swapper/411:47:504
2055299180,7cyclictest11810-21rm11:54:074
2055299180,7cyclictest11810-21rm11:54:074
2055299180,6cyclictest686-21dbus-daemon11:40:004
2055299180,6cyclictest686-21dbus-daemon09:49:004
2055299180,6cyclictest11162-21systemd11:00:124
2055299180,5cyclictest686-21dbus-daemon12:07:284
2055299180,5cyclictest6756-21systemd-cgroups11:06:334
2055299180,5cyclictest0-21swapper/411:18:404
2055299180,5cyclictest0-21swapper/411:18:404
2055299180,17cyclictest27955-21sshd12:32:424
20518991815,2cyclictest23863-21kworker/u16:409:56:140
2057499173,3cyclictest73-21ksoftirqd/710:29:567
2057499173,3cyclictest73-21ksoftirqd/710:29:567
20574991716,1cyclictest73-21ksoftirqd/712:33:557
20574991715,1cyclictest73-21ksoftirqd/712:14:477
20574991713,3cyclictest73-21ksoftirqd/710:54:417
20574991713,1cyclictest73-21ksoftirqd/710:09:047
2057499170,1cyclictest73-21ksoftirqd/711:28:167
20566991714,3cyclictest65-21ksoftirqd/610:06:526
20566991713,1cyclictest65-21ksoftirqd/609:33:286
2056699170,1cyclictest131rcu_sched10:40:016
2055299170,9cyclictest23561-21systemd10:44:474
2055299170,9cyclictest11473-21systemd10:23:154
2055299170,8cyclictest22910-21sd-pam11:55:034
2055299170,8cyclictest0-21swapper/412:21:294
2055299170,7cyclictest2856-21systemd10:29:124
2055299170,7cyclictest26916-21kill10:41:394
2055299170,7cyclictest16071-21systemd09:26:334
2055299170,7cyclictest1-21systemd09:53:004
2055299170,6cyclictest775-21gdbus12:01:494
2055299170,6cyclictest31050-21systemd10:55:324
2055299170,6cyclictest21598-21sshd12:15:044
2055299170,6cyclictest0-21swapper/411:32:004
2055299170,10cyclictest29474-21grepconf.sh12:26:014
2055299170,10cyclictest0-21swapper/410:12:384
20533991713,4cyclictest33-21ksoftirqd/210:51:302
20518991715,2cyclictest23249-21kworker/u16:010:19:040
20574991614,2cyclictest73-21ksoftirqd/711:50:367
20574991614,2cyclictest73-21ksoftirqd/711:50:367
20574991614,1cyclictest73-21ksoftirqd/712:19:397
20574991614,1cyclictest73-21ksoftirqd/711:54:477
20574991614,1cyclictest73-21ksoftirqd/711:05:307
20574991614,1cyclictest73-21ksoftirqd/710:46:397
20574991614,1cyclictest73-21ksoftirqd/710:43:057
20574991614,1cyclictest73-21ksoftirqd/709:38:127
20574991614,1cyclictest73-21ksoftirqd/709:19:387
20574991612,1cyclictest73-21ksoftirqd/712:39:027
2057499161,1cyclictest131rcu_sched10:23:117
2057499160,1cyclictest73-21ksoftirqd/711:31:097
2056699168,5cyclictest65-21ksoftirqd/610:27:136
2056699163,3cyclictest65-21ksoftirqd/609:13:486
2056699162,2cyclictest65-21ksoftirqd/612:31:306
20566991615,1cyclictest65-21ksoftirqd/609:41:136
20566991615,1cyclictest65-21ksoftirqd/609:19:546
20566991614,1cyclictest65-21ksoftirqd/611:57:406
20566991614,1cyclictest65-21ksoftirqd/611:30:596
20566991614,1cyclictest65-21ksoftirqd/611:26:196
20566991614,1cyclictest65-21ksoftirqd/609:58:056
20566991613,2cyclictest65-21ksoftirqd/611:12:476
2056699160,1cyclictest121rcu_preempt12:25:096
2055299161,6cyclictest691-21systemd-logind10:33:164
2055299161,6cyclictest691-21systemd-logind10:33:164
2055299160,9cyclictest26719-21grep09:20:534
2055299160,9cyclictest20017-21rm11:11:144
2055299160,8cyclictest686-21dbus-daemon09:15:424
2055299160,7cyclictest1-21systemd10:53:534
2055299160,6cyclictest6112-21kill12:37:074
2055299160,6cyclictest11350-21systemd-cgroups11:27:064
2055299160,10cyclictest25853-21sshd09:30:534
20518991612,3cyclictest28556-21systemd11:52:250
20518991612,3cyclictest28556-21systemd11:52:250
20518991612,2cyclictest10473-21kworker/u16:011:25:310
111752160,0sleep50-21swapper/512:34:245
218362150,0sleep5561ktimersoftd/511:34:505
2057499159,3cyclictest73-21ksoftirqd/710:34:357
2057499156,1cyclictest73-21ksoftirqd/709:24:367
20574991513,1cyclictest73-21ksoftirqd/711:18:417
20574991513,1cyclictest73-21ksoftirqd/711:18:417
20574991513,1cyclictest73-21ksoftirqd/710:12:067
20574991513,1cyclictest73-21ksoftirqd/709:50:337
20574991513,1cyclictest492-21systemd-journal10:49:457
20574991511,1cyclictest73-21ksoftirqd/709:46:037
2057499150,2cyclictest73-21ksoftirqd/712:25:367
2057499150,2cyclictest121rcu_preempt09:43:227
2057499150,2cyclictest121rcu_preempt09:14:477
20566991514,1cyclictest65-21ksoftirqd/612:35:216
20566991514,1cyclictest65-21ksoftirqd/612:00:506
20566991514,1cyclictest65-21ksoftirqd/610:34:136
20566991514,1cyclictest65-21ksoftirqd/610:34:136
20566991514,1cyclictest65-21ksoftirqd/609:14:546
20566991513,1cyclictest65-21ksoftirqd/612:12:256
20566991513,1cyclictest65-21ksoftirqd/612:12:256
20566991513,1cyclictest65-21ksoftirqd/611:00:206
20566991513,1cyclictest65-21ksoftirqd/609:44:576
20566991513,1cyclictest492-21systemd-journal11:43:246
20566991513,1cyclictest492-21systemd-journal10:19:416
20566991511,1cyclictest65-21ksoftirqd/609:36:586
2056699151,3cyclictest65-21ksoftirqd/611:14:556
2056699151,3cyclictest65-21ksoftirqd/611:14:556
2056699151,1cyclictest131rcu_sched10:46:516
2056699150,2cyclictest65-21ksoftirqd/609:59:476
2056699150,14cyclictest26985-21cp11:35:196
2056699150,1cyclictest131rcu_sched10:11:176
20533991513,1cyclictest33-21ksoftirqd/210:59:342
20533991513,1cyclictest33-21ksoftirqd/209:31:272
20525991514,1cyclictest25-21ksoftirqd/110:58:451
20518991514,0cyclictest29112-21kworker/u16:210:03:260
20518991514,0cyclictest10825-21kworker/u16:211:42:030
20518991513,2cyclictest25539-21kworker/u16:110:58:080
20574991412,2cyclictest73-21ksoftirqd/710:59:407
20574991412,1cyclictest73-21ksoftirqd/711:35:237
20574991412,1cyclictest73-21ksoftirqd/710:15:037
20566991413,1cyclictest65-21ksoftirqd/607:24:346
20566991412,1cyclictest65-21ksoftirqd/612:15:386
20566991412,1cyclictest65-21ksoftirqd/611:49:556
20566991412,1cyclictest65-21ksoftirqd/611:49:556
20566991412,1cyclictest492-21systemd-journal09:26:276
20518991412,2cyclictest5393-21grepconf.sh10:05:460
20518991412,2cyclictest23249-21kworker/u16:010:38:040
20518991412,2cyclictest23249-21kworker/u16:010:20:440
20518991412,1cyclictest23598-21kworker/u16:509:22:420
20518991411,2cyclictest10825-21kworker/u16:212:25:270
259442130,0sleep20-21swapper/211:48:482
20574991312,1cyclictest73-21ksoftirqd/708:39:347
2056099138,4cyclictest1-21systemd11:47:165
20560991311,1cyclictest775-21gdbus12:06:565
2056099130,5cyclictest0-21swapper/512:17:085
2056099130,5cyclictest0-21swapper/511:01:235
2054099134,5cyclictest12043-21kill11:50:333
2054099134,5cyclictest12043-21kill11:50:333
20533991312,1cyclictest33-21ksoftirqd/210:01:422
20525991311,1cyclictest25-21ksoftirqd/112:24:341
20525991310,2cyclictest686-21dbus-daemon10:27:251
20518991312,0cyclictest9288-21kworker/u16:210:48:340
20518991311,1cyclictest9-21ksoftirqd/012:37:540
20518991311,1cyclictest9-21ksoftirqd/011:22:060
20518991311,0cyclictest29101-21kworker/u16:512:01:450
20518991310,1cyclictest25539-21kworker/u16:111:06:000
53962120,0sleep5686-21dbus-daemon09:52:235
20574991210,1cyclictest73-21ksoftirqd/707:59:347
20566991211,1cyclictest65-21ksoftirqd/607:39:466
2056099124,5cyclictest1-21systemd11:18:595
2056099124,5cyclictest1-21systemd11:18:595
2056099123,9cyclictest0-21swapper/509:25:075
2056099122,10cyclictest0-21swapper/510:07:155
20560991210,1cyclictest57-21ksoftirqd/510:26:515
2056099120,4cyclictest0-21swapper/510:50:415
2056099120,4cyclictest0-21swapper/510:46:235
2056099120,11cyclictest492-21systemd-journal12:10:105
2056099120,11cyclictest492-21systemd-journal12:10:105
2054099129,2cyclictest18922-21systemd-cgroups11:24:393
2054099122,4cyclictest32201-21systemd11:22:373
2053399128,3cyclictest33-21ksoftirqd/211:58:432
20533991211,1cyclictest33-21ksoftirqd/209:37:002
20533991210,1cyclictest33-21ksoftirqd/210:14:192
20533991210,1cyclictest17569-21sshd09:40:032
2053399120,11cyclictest0-21swapper/210:48:102
2052599124,2cyclictest763-21NetworkManager09:37:001
2052599122,4cyclictest14526-21systemd-cgroups11:40:461
2052599122,4cyclictest0-21swapper/110:43:101
2051899128,2cyclictest19951-21systemd-cgroups09:26:580
20518991212,0cyclictest3896-21kworker/u16:012:20:590
20518991211,1cyclictest9-21ksoftirqd/011:12:570
20518991210,1cyclictest9-21ksoftirqd/010:52:580
200092120,0sleep10-21swapper/110:10:371
198132120,1sleep019812-21bash10:10:360
168482120,0sleep20-21swapper/210:07:012
71952110,0sleep10-21swapper/109:45:461
2057499119,1cyclictest73-21ksoftirqd/708:49:477
20574991110,1cyclictest73-21ksoftirqd/708:14:517
2056699119,1cyclictest65-21ksoftirqd/607:29:546
20566991110,1cyclictest65-21ksoftirqd/607:19:346
2056099119,1cyclictest1-21systemd10:14:275
2056099119,1cyclictest0-21swapper/511:21:465
2056099117,1cyclictest0-21swapper/510:01:025
2056099116,4cyclictest26418-21systemd11:11:575
2056099115,6cyclictest691-21systemd-logind12:20:545
2056099115,3cyclictest0-21swapper/508:39:095
2056099115,2cyclictest23392-21kill11:55:065
2056099114,4cyclictest686-21dbus-daemon12:26:445
2056099114,4cyclictest0-21swapper/508:14:115
2056099113,4cyclictest1-21systemd09:34:325
20560991110,1cyclictest0-21swapper/509:58:045
2056099110,11cyclictest0-21swapper/512:38:145
2056099110,11cyclictest0-21swapper/511:53:205
2056099110,11cyclictest0-21swapper/511:53:205
2056099110,11cyclictest0-21swapper/511:32:215
2056099110,11cyclictest0-21swapper/510:29:395
2056099110,11cyclictest0-21swapper/510:29:395
2056099110,1cyclictest6368-21sshd09:49:155
2055299110,4cyclictest0-21swapper/408:46:554
2054099115,4cyclictest3873-21bash11:33:063
2054099112,4cyclictest686-21dbus-daemon11:47:183
2054099111,4cyclictest29103-21sshd09:34:423
2054099110,11cyclictest13824-21kworker/3:210:05:033
2054099110,11cyclictest1076-21kworker/3:312:15:313
2054099110,10cyclictest2317-21sshd12:23:183
2054099110,1cyclictest0-21swapper/311:10:033
2054099110,1cyclictest0-21swapper/310:10:333
2053399119,1cyclictest33-21ksoftirqd/212:14:102
2053399119,1cyclictest33-21ksoftirqd/212:14:102
2053399119,1cyclictest33-21ksoftirqd/210:59:482
2053399117,3cyclictest33-21ksoftirqd/207:59:342
2053399117,2cyclictest33-21ksoftirqd/211:39:572
2053399112,3cyclictest1-21systemd12:22:482
2052599119,1cyclictest25-21ksoftirqd/111:29:161
2052599119,1cyclictest25-21ksoftirqd/111:19:121
2052599119,1cyclictest25-21ksoftirqd/111:19:121
2052599114,6cyclictest763-21NetworkManager12:14:521
2052599111,4cyclictest686-21dbus-daemon12:02:131
2052599111,4cyclictest2286-21systemd-cgroups12:09:501
2052599111,4cyclictest2286-21systemd-cgroups12:09:501
2052599110,5cyclictest20036-21sshd09:13:381
2052599110,11cyclictest6946-21kworker/1:210:35:221
2052599110,10cyclictest686-21dbus-daemon09:22:531
2051899119,2cyclictest3896-21kworker/u16:012:31:350
2051899119,2cyclictest14754-21kworker/0:310:26:240
2051899119,1cyclictest9-21ksoftirqd/012:06:470
2051899119,1cyclictest9-21ksoftirqd/011:59:220
2051899119,1cyclictest9-21ksoftirqd/010:29:360
2051899119,1cyclictest9-21ksoftirqd/010:29:360
2051899119,1cyclictest25692-21kworker/0:509:48:360
2051899116,2cyclictest3867-21kworker/u16:009:41:100
2051899115,3cyclictest10473-21kworker/u16:011:17:320
2051899115,3cyclictest10473-21kworker/u16:011:17:320
2051899110,11cyclictest18620-21kworker/0:011:44:570
188942110,1sleep318892-21bash12:38:313
100862110,0sleep10-21swapper/109:25:521
2057499109,1cyclictest73-21ksoftirqd/707:19:347
2056699108,1cyclictest65-21ksoftirqd/607:59:346
2056099105,3cyclictest3399-21systemd09:38:475
2056099103,4cyclictest691-21systemd-logind10:19:585
2056099102,4cyclictest0-21swapper/509:15:075
2056099100,9cyclictest3019-21kworker/5:509:40:535
2056099100,6cyclictest0-21swapper/508:23:135
2056099100,2cyclictest0-21swapper/512:00:175
2056099100,10cyclictest0-21swapper/511:24:355
2056099100,10cyclictest0-21swapper/511:05:115
2056099100,10cyclictest0-21swapper/510:42:335
2056099100,10cyclictest0-21swapper/510:14:415
2056099100,10cyclictest0-21swapper/509:08:135
2056099100,10cyclictest0-21swapper/509:03:035
2056099100,10cyclictest0-21swapper/508:42:395
2056099100,10cyclictest0-21swapper/507:55:515
2056099100,10cyclictest0-21swapper/507:13:555
2056099100,0cyclictest0-21swapper/510:55:255
2055299100,10cyclictest0-21swapper/408:09:054
2054099109,1cyclictest41-21ksoftirqd/310:33:573
2054099109,1cyclictest41-21ksoftirqd/310:33:573
2054099109,1cyclictest41-21ksoftirqd/309:41:263
2054099108,1cyclictest41-21ksoftirqd/310:14:353
2054099103,4cyclictest18875-21sshd11:58:113
2054099103,1cyclictest686-21dbus-daemon09:45:503
2054099102,2cyclictest691-21systemd-logind11:39:073
2054099100,4cyclictest686-21dbus-daemon09:16:143
2054099100,4cyclictest492-21systemd-journal09:49:543
2054099100,4cyclictest30187-21sshd10:52:103
2054099100,4cyclictest27515-21sshd12:12:273
2054099100,4cyclictest27515-21sshd12:12:273
2054099100,4cyclictest0-21swapper/311:42:133
2054099100,10cyclictest8748-21kworker/3:110:56:123
2053399109,1cyclictest33-21ksoftirqd/211:34:462
2053399109,1cyclictest33-21ksoftirqd/209:25:552
2053399109,1cyclictest0-21swapper/211:06:362
2053399108,1cyclictest33-21ksoftirqd/212:01:552
2053399108,1cyclictest33-21ksoftirqd/211:16:532
2053399108,1cyclictest33-21ksoftirqd/211:16:532
2053399108,1cyclictest33-21ksoftirqd/210:18:532
2053399108,1cyclictest33-21ksoftirqd/209:12:192
2053399107,2cyclictest33-21ksoftirqd/211:25:572
2053399104,4cyclictest33-21ksoftirqd/212:16:052
2053399101,5cyclictest0-21swapper/210:30:372
2053399101,5cyclictest0-21swapper/210:30:372
2053399100,7cyclictest0-21swapper/210:26:232
2053399100,3cyclictest1-21systemd12:35:142
2053399100,1cyclictest2141-21systemd09:58:492
2053399100,1cyclictest0-21swapper/209:21:272
2052599108,1cyclictest28418-21sshd11:05:221
2052599104,3cyclictest686-21dbus-daemon09:43:371
2052599103,6cyclictest691-21systemd-logind10:52:251
2052599103,6cyclictest5630-21systemd-cgroups11:36:321
2052599103,3cyclictest691-21systemd-logind11:03:251
2052599103,1cyclictest885-21polkitd11:31:391
2052599103,1cyclictest18462-21sshd09:50:181
2052599102,3cyclictest0-21swapper/111:57:551
2052599101,4cyclictest5549-21systemd-cgroups09:15:171
2052599100,9cyclictest13892-21sshd10:33:411
2052599100,9cyclictest13892-21sshd10:33:411
2052599100,10cyclictest26492-21kworker/1:310:18:251
2052599100,10cyclictest26128-21kworker/1:509:54:591
2052599100,10cyclictest16557-21kworker/1:412:24:501
2052599100,1cyclictest0-21swapper/110:05:561
2051899100,10cyclictest0-21swapper/009:50:400
2051899100,10cyclictest0-21swapper/009:16:460
136012100,0sleep30-21swapper/309:22:583
205749998,1cyclictest73-21ksoftirqd/708:49:347
205749998,1cyclictest73-21ksoftirqd/707:39:347
205749997,1cyclictest73-21ksoftirqd/708:19:487
205669998,1cyclictest65-21ksoftirqd/608:49:476
205669997,1cyclictest65-21ksoftirqd/609:09:346
205669997,1cyclictest65-21ksoftirqd/608:14:476
205669997,1cyclictest65-21ksoftirqd/607:09:516
205609995,4cyclictest0-21swapper/508:46:095
205609995,0cyclictest0-21swapper/507:24:355
205609993,3cyclictest0-21swapper/507:48:155
205609993,3cyclictest0-21swapper/507:48:155
205609990,9cyclictest0-21swapper/508:49:475
205609990,9cyclictest0-21swapper/507:22:555
205609990,8cyclictest24985-21kworker/5:309:10:555
205609990,6cyclictest0-21swapper/508:24:435
205609990,6cyclictest0-21swapper/507:18:555
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional