You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 00:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Tue Dec 23, 2025 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
127252730,0sleep60-21swapper/611:04:206
223172700,0sleep10-21swapper/110:34:271
1444125847,8sleep50-21swapper/507:05:565
1438925645,8sleep20-21swapper/207:05:132
146292500,1sleep514628-21bash10:12:295
1438125039,8sleep30-21swapper/307:05:063
187012490,1sleep618699-21bash09:27:456
91092480,0sleep60-21swapper/612:16:596
167212480,0sleep10-21swapper/109:38:131
1465324836,9sleep70-21swapper/707:08:557
240762460,2sleep01482199cyclictest11:57:310
252642440,1sleep025265-21kill10:27:380
175282440,1sleep417496-21sshd12:28:194
114412440,0sleep0101ktimersoftd/010:22:490
95782430,0sleep00-21swapper/009:54:380
95782430,0sleep00-21swapper/009:54:380
93032430,0sleep1241ktimersoftd/111:20:561
63632430,0sleep70-21swapper/709:26:267
1446424323,4sleep10-21swapper/107:06:161
319932420,0sleep10-21swapper/111:47:391
151172420,0sleep00-21swapper/011:04:380
269422410,0sleep341-21ksoftirqd/312:08:313
1454824128,9sleep00-21swapper/007:07:270
54592400,0sleep70-21swapper/710:39:307
43972400,0sleep50-21swapper/512:23:315
271882400,0sleep627183-21sshd10:44:586
259052400,0sleep70-21swapper/712:32:387
187652400,0sleep40-21swapper/412:14:414
1453624028,9sleep60-21swapper/607:07:176
1440023927,9sleep40-21swapper/407:05:234
12562360,0sleep30-21swapper/310:42:223
1483499220,9cyclictest686-21dbus-daemon12:34:592
1483499220,7cyclictest14844-21grep11:25:052
1483499220,7cyclictest14844-21grep11:25:052
1483499210,7cyclictest2448-21grepconf.sh09:53:512
1483499210,7cyclictest2448-21grepconf.sh09:53:512
1483499210,11cyclictest1-21systemd09:39:192
1483499200,9cyclictest0-21swapper/211:54:342
1483499200,8cyclictest10937-21systemd10:46:442
1483499200,6cyclictest3541sshd12:33:232
1483499200,10cyclictest31442-21sshd11:23:322
1483499200,10cyclictest28656-21kill10:03:442
1483499200,10cyclictest25001-21systemd12:08:192
57292190,0sleep10-21swapper/110:04:481
1483499190,9cyclictest31635-21kill12:15:522
1483499190,9cyclictest2653-21systemd12:12:572
1483499190,9cyclictest21915-21bash12:00:482
1483499190,9cyclictest0-21swapper/211:45:132
1483499190,8cyclictest12478-21kworker/2:412:26:482
1483499190,7cyclictest413-21systemd10:59:322
1483499190,7cyclictest25692-21sd-pam11:57:422
1483499190,6cyclictest686-21dbus-daemon09:27:002
1483499190,6cyclictest0-21swapper/210:06:092
1483499190,11cyclictest0-21swapper/209:20:452
1483499190,10cyclictest22023-21systemd11:36:192
1483499181,8cyclictest18018-21kworker/2:110:40:482
1483499180,9cyclictest7290-21grep10:32:392
1483499180,9cyclictest4791-21grepconf.sh10:28:562
1483499180,9cyclictest3178-21grepconf.sh10:18:252
1483499180,9cyclictest15670-21sd-pam09:17:012
1483499180,7cyclictest436-21grepconf.sh11:16:392
1483499180,7cyclictest3679-21grepconf.sh11:13:392
1483499180,7cyclictest27252-21grepconf.sh11:09:192
1483499180,7cyclictest2680-21sshd11:30:472
1483499180,7cyclictest13390-21systemd09:41:142
1483499180,6cyclictest4712-21sshd09:57:302
1483499180,6cyclictest30032-21grepconf.sh11:44:102
1483499180,6cyclictest26059-21systemd11:02:092
1483499180,6cyclictest0-21swapper/210:38:292
1483499180,5cyclictest0-21swapper/210:10:142
14827991816,1cyclictest25-21ksoftirqd/111:07:281
14827991815,2cyclictest25-21ksoftirqd/112:00:571
1486799170,16cyclictest32200-21bash10:04:087
14854991712,1cyclictest20287-21systemd11:39:395
1483499170,9cyclictest492-21systemd-journal09:11:022
1483499170,9cyclictest28001-21systemd10:51:582
1483499170,8cyclictest19743-21systemd09:45:142
1483499170,7cyclictest11125-21bash12:24:152
1483499170,6cyclictest0-21swapper/210:20:332
14827991715,1cyclictest25-21ksoftirqd/109:54:541
14827991715,1cyclictest25-21ksoftirqd/109:29:571
14827991715,1cyclictest25-21ksoftirqd/109:11:261
14821991714,2cyclictest9-21ksoftirqd/012:34:380
1486799166,4cyclictest885-21polkitd09:16:387
1486799160,15cyclictest0-21swapper/709:32:277
1486099160,15cyclictest28488-21kworker/6:109:34:406
1483499160,5cyclictest0-21swapper/209:30:382
14827991615,1cyclictest30655-21kworker/1:010:21:481
14827991615,1cyclictest25-21ksoftirqd/111:31:291
14827991615,1cyclictest25-21ksoftirqd/109:26:101
14827991614,2cyclictest25-21ksoftirqd/111:03:481
14827991614,1cyclictest25-21ksoftirqd/112:25:021
14827991614,1cyclictest25-21ksoftirqd/111:11:341
14827991614,1cyclictest25-21ksoftirqd/110:55:011
14827991614,1cyclictest25-21ksoftirqd/110:37:031
14827991614,1cyclictest25-21ksoftirqd/110:02:201
14827991614,1cyclictest25-21ksoftirqd/109:41:211
14827991613,3cyclictest25-21ksoftirqd/109:54:231
14827991613,3cyclictest25-21ksoftirqd/109:54:231
14821991615,0cyclictest7633-21kworker/u16:511:26:430
14821991615,0cyclictest7633-21kworker/u16:511:26:430
14821991615,0cyclictest17412-21kworker/u16:412:14:580
14821991614,1cyclictest9-21ksoftirqd/011:49:380
14821991610,3cyclictest24202-21kworker/u16:212:03:420
188682150,1sleep7887-21gdbus11:11:417
14854991512,2cyclictest7632-21systemd09:40:365
14850991511,2cyclictest49-21ksoftirqd/411:45:574
14842991513,1cyclictest7633-21kworker/u16:511:54:523
14827991514,1cyclictest25-21ksoftirqd/112:16:511
14827991514,1cyclictest25-21ksoftirqd/110:45:471
14827991514,1cyclictest14737-21kworker/1:110:14:521
14827991513,1cyclictest25-21ksoftirqd/112:37:191
14827991513,1cyclictest25-21ksoftirqd/112:30:171
14827991513,1cyclictest25-21ksoftirqd/112:14:201
14827991513,1cyclictest25-21ksoftirqd/111:41:261
14827991513,1cyclictest25-21ksoftirqd/110:49:521
14827991513,1cyclictest25-21ksoftirqd/110:10:041
14827991513,1cyclictest25-21ksoftirqd/109:45:291
14827991513,1cyclictest25-21ksoftirqd/109:23:141
14827991512,1cyclictest25-21ksoftirqd/111:36:041
1482799150,14cyclictest27919-21kworker/1:410:40:281
14821991514,0cyclictest6595-21kworker/u16:110:19:350
14821991514,0cyclictest6595-21kworker/u16:110:09:110
14821991513,2cyclictest7633-21kworker/u16:511:31:540
14821991513,1cyclictest27901-21latency_hist12:39:380
14821991513,1cyclictest1-21systemd11:19:470
14821991512,3cyclictest23790-21kworker/u16:009:45:330
14821991511,2cyclictest22211-21kworker/u16:009:22:050
14854991412,1cyclictest57-21ksoftirqd/510:31:005
14827991413,1cyclictest25-21ksoftirqd/112:19:421
14827991413,1cyclictest25-21ksoftirqd/111:16:441
14827991412,1cyclictest25-21ksoftirqd/112:07:511
14827991412,1cyclictest25-21ksoftirqd/111:54:381
14827991412,1cyclictest25-21ksoftirqd/111:50:111
14827991412,1cyclictest25-21ksoftirqd/110:27:051
14827991411,3cyclictest25-21ksoftirqd/109:19:291
1482199149,2cyclictest23790-21kworker/u16:009:33:550
14821991413,0cyclictest23414-21kworker/u16:112:14:100
14821991412,2cyclictest809-21kworker/u16:410:12:110
14821991412,2cyclictest7633-21kworker/u16:511:54:220
14821991412,2cyclictest6595-21kworker/u16:110:38:430
14821991412,2cyclictest3682-21kworker/u16:010:58:310
14821991412,2cyclictest15533-21kworker/u16:009:10:230
14821991412,1cyclictest28225-21kworker/0:011:08:330
14821991412,1cyclictest19017-21kworker/u16:411:11:580
14821991412,0cyclictest23790-21kworker/u16:009:56:170
14821991412,0cyclictest22272-21kworker/u16:509:39:530
14821991411,1cyclictest27693-21kworker/0:107:33:450
165422130,0sleep70-21swapper/707:09:587
1486799135,7cyclictest887-21gdbus09:54:367
1486799135,7cyclictest887-21gdbus09:54:367
1485499139,4cyclictest57-21ksoftirqd/512:36:345
1485499137,4cyclictest57-21ksoftirqd/511:05:065
14854991311,1cyclictest57-21ksoftirqd/511:24:575
14854991311,1cyclictest57-21ksoftirqd/511:24:575
14854991311,1cyclictest24711-21systemd12:01:055
14854991310,2cyclictest24722-21systemd09:24:585
1484299133,7cyclictest27890-21sshd12:01:273
14827991311,1cyclictest25-21ksoftirqd/111:26:021
14827991311,1cyclictest25-21ksoftirqd/111:26:021
1482199138,2cyclictest5988-21kworker/u16:409:28:170
14821991311,2cyclictest20512-21kworker/u16:210:31:430
14821991311,2cyclictest18702-21kworker/u16:209:15:070
14821991311,2cyclictest1429-21kworker/u16:312:05:260
14821991311,1cyclictest9-21ksoftirqd/010:02:530
14821991310,3cyclictest3682-21kworker/u16:010:51:370
1486799125,6cyclictest9749-21sshd12:10:047
1486799125,6cyclictest1-21systemd11:41:047
1486799124,7cyclictest17317-21grepconf.sh10:50:477
1486799124,7cyclictest15058-21bash10:12:327
1486799123,2cyclictest691-21systemd-logind11:34:267
1486799121,10cyclictest1-21systemd10:28:287
1486799120,11cyclictest31436-21systemd09:11:167
1486799120,0cyclictest0-21swapper/712:03:017
14860991211,1cyclictest65-21ksoftirqd/610:07:596
14860991211,1cyclictest65-21ksoftirqd/609:42:086
14860991210,1cyclictest65-21ksoftirqd/609:48:466
1485499128,4cyclictest57-21ksoftirqd/510:21:215
1485499128,3cyclictest57-21ksoftirqd/512:26:015
1485499128,1cyclictest57-21ksoftirqd/510:47:365
1485499127,5cyclictest21050-21systemd09:52:165
1485499127,5cyclictest21050-21systemd09:52:165
1485499127,1cyclictest21828-21systemd10:02:545
14854991211,1cyclictest57-21ksoftirqd/510:26:005
14854991210,1cyclictest57-21ksoftirqd/510:37:175
14854991210,1cyclictest57-21ksoftirqd/509:55:115
1485499120,12cyclictest25817-21kworker/5:412:19:185
1485499120,11cyclictest7943-21bash11:17:285
1485099128,3cyclictest49-21ksoftirqd/409:14:164
1485099128,1cyclictest49-21ksoftirqd/410:17:484
14850991211,1cyclictest49-21ksoftirqd/410:44:154
1484299122,4cyclictest885-21polkitd12:15:473
1484299122,4cyclictest16852-21sshd11:21:523
1484299122,4cyclictest11610-21sshd10:29:393
1484299120,2cyclictest810-21systemd10:59:343
1483499120,9cyclictest1878-21cat07:39:592
14821991212,0cyclictest32305-21kworker/u16:011:17:050
14821991211,0cyclictest22272-21kworker/u16:509:35:530
14821991210,1cyclictest9-21ksoftirqd/011:40:390
1482199120,11cyclictest691-21systemd-logind11:34:430
307482110,0sleep40-21swapper/411:40:384
1486799116,4cyclictest2446-21bash10:59:437
1486799114,6cyclictest686-21dbus-daemon10:39:537
1486799114,6cyclictest686-21dbus-daemon10:30:517
1486799114,6cyclictest13565-21grep10:15:507
1486799114,6cyclictest12092-21grep11:56:057
1486799114,6cyclictest11717-21nscd09:39:567
1486799114,6cyclictest11351-21systemd-cgroups11:52:257
1486799114,6cyclictest1-21systemd10:54:557
1486799114,2cyclictest12980-21ystemctl12:34:447
1486799114,1cyclictest9716-21iostat09:19:527
1486799114,1cyclictest28765-21latency_hist09:39:387
1486799113,3cyclictest5287-21sshd12:06:097
1486799113,2cyclictest686-21dbus-daemon11:05:477
1486799113,2cyclictest686-21dbus-daemon09:55:017
1486799113,2cyclictest14631-21kill11:25:037
1486799113,2cyclictest14631-21kill11:25:037
1486799113,1cyclictest1-21systemd11:17:097
1486799112,2cyclictest691-21systemd-logind11:35:547
1486799112,2cyclictest686-21dbus-daemon12:15:447
1486799112,2cyclictest686-21dbus-daemon11:45:467
1486799111,3cyclictest23608-21sd-pam10:44:457
1486799111,2cyclictest775-21gdbus09:44:567
1486799110,2cyclictest26820-21grepconf.sh12:25:447
1486799110,2cyclictest15475-21systemd10:05:427
1486799110,11cyclictest24938-21kworker/7:411:22:117
1486799110,0cyclictest0-21swapper/712:19:437
1486099119,1cyclictest686-21dbus-daemon10:25:476
1486099119,1cyclictest65-21ksoftirqd/612:13:086
1486099119,1cyclictest65-21ksoftirqd/610:42:496
1486099118,2cyclictest691-21systemd-logind11:33:326
1486099118,2cyclictest10350-21systemd11:21:076
1486099115,3cyclictest763-21NetworkManager12:02:376
1486099113,4cyclictest1-21systemd09:59:376
14860991110,1cyclictest65-21ksoftirqd/611:59:326
14860991110,1cyclictest65-21ksoftirqd/611:46:486
1485499119,1cyclictest57-21ksoftirqd/512:05:165
1485499119,1cyclictest57-21ksoftirqd/511:36:435
1485499119,1cyclictest30372-21systemd12:12:255
14854991110,1cyclictest57-21ksoftirqd/510:06:155
14854991110,1cyclictest57-21ksoftirqd/509:47:105
1485499110,1cyclictest18994-21sshd10:50:585
1485499110,1cyclictest0-21swapper/511:33:325
1485099119,1cyclictest49-21ksoftirqd/411:09:084
1485099119,1cyclictest49-21ksoftirqd/410:37:484
1485099119,1cyclictest49-21ksoftirqd/409:30:164
1485099113,5cyclictest691-21systemd-logind11:49:454
1485099110,10cyclictest0-21swapper/411:56:474
1484299118,2cyclictest26486-21bash10:06:553
1484299113,7cyclictest691-21systemd-logind10:27:583
1484299113,7cyclictest10710-21sshd09:30:143
14842991110,1cyclictest41-21ksoftirqd/311:50:523
1484299110,5cyclictest691-21systemd-logind09:43:333
1484299110,11cyclictest9437-21kworker/3:511:02:333
1484299110,11cyclictest6107-21kworker/3:309:47:153
1484299110,11cyclictest29688-21kworker/3:210:00:593
1484299110,11cyclictest26411-21kworker/3:012:27:443
1484299110,10cyclictest19553-21kworker/3:209:37:533
1484299110,10cyclictest17797-21systemd-cgroups09:27:393
1484299110,1cyclictest0-21swapper/309:53:503
1484299110,1cyclictest0-21swapper/309:53:503
1483499110,8cyclictest8530-21egrep07:54:492
1482199119,2cyclictest23414-21kworker/u16:112:24:400
14821991110,1cyclictest9-21ksoftirqd/010:46:440
126892110,1sleep557-21ksoftirqd/510:57:145
82652100,0sleep30-21swapper/307:54:383
1486799103,2cyclictest786-21snmpd07:34:097
1486799103,2cyclictest5645-21cat08:44:537
1486799103,1cyclictest786-21snmpd08:36:177
1486799103,1cyclictest786-21snmpd07:46:137
1486799103,1cyclictest26591-21cat08:24:547
1486799102,1cyclictest885-21polkitd10:19:397
1486099109,1cyclictest65-21ksoftirqd/612:19:526
1486099109,1cyclictest65-21ksoftirqd/611:28:176
1486099109,1cyclictest65-21ksoftirqd/611:28:176
1486099109,1cyclictest65-21ksoftirqd/609:49:536
1486099109,1cyclictest65-21ksoftirqd/609:49:536
1486099109,1cyclictest29232-21sshd12:08:536
1486099108,1cyclictest65-21ksoftirqd/611:42:526
1486099107,2cyclictest1459-21bash12:36:486
1486099104,4cyclictest31520-21systemd09:15:156
1486099104,3cyclictest492-21systemd-journal11:05:376
1486099104,1cyclictest686-21dbus-daemon10:55:196
1486099103,4cyclictest15841-21systemd11:39:126
1486099103,4cyclictest13744-21systemd09:20:116
1486099102,5cyclictest686-21dbus-daemon10:23:336
1486099102,4cyclictest1-21systemd11:49:396
1486099100,3cyclictest15424-21sshd10:50:356
1486099100,1cyclictest492-21systemd-journal10:34:566
1485499108,1cyclictest57-21ksoftirqd/512:32:415
1485499108,1cyclictest57-21ksoftirqd/511:50:045
1485499108,1cyclictest57-21ksoftirqd/511:24:095
1485499108,1cyclictest57-21ksoftirqd/510:16:095
1485499108,1cyclictest27255-21systemd09:32:045
1485499106,1cyclictest28316-21kworker/5:311:58:305
1485499100,1cyclictest0-21swapper/511:09:525
1485499100,1cyclictest0-21swapper/511:03:265
1485499100,1cyclictest0-21swapper/510:43:345
1485099109,1cyclictest0-21swapper/409:38:124
1485099108,1cyclictest49-21ksoftirqd/412:08:104
1485099108,1cyclictest49-21ksoftirqd/410:20:334
1485099108,1cyclictest49-21ksoftirqd/410:08:164
1485099107,2cyclictest49-21ksoftirqd/409:40:364
1485099103,6cyclictest29042-21grep10:03:474
1485099103,4cyclictest3468-21sshd11:16:584
1485099103,3cyclictest1-21systemd11:34:134
1485099102,5cyclictest26781-21systemd10:10:154
1485099102,4cyclictest686-21dbus-daemon11:26:104
1485099102,4cyclictest686-21dbus-daemon11:26:104
1485099100,10cyclictest0-21swapper/410:34:204
1485099100,1cyclictest0-21swapper/411:00:014
1485099100,0cyclictest30763-21sshd12:01:494
1484299109,1cyclictest41-21ksoftirqd/311:44:123
1484299108,1cyclictest41-21ksoftirqd/310:45:143
1484299103,6cyclictest885-21polkitd12:31:423
1484299103,6cyclictest17542-21sshd10:37:133
1484299103,1cyclictest763-21NetworkManager11:33:293
1484299103,1cyclictest21231-21sshd09:09:513
1484299103,1cyclictest0-21swapper/310:50:433
1484299102,3cyclictest0-21swapper/311:29:083
1484299102,3cyclictest0-21swapper/311:29:083
1484299101,4cyclictest0-21swapper/312:36:383
1484299100,10cyclictest7113-21kworker/3:012:12:503
1484299100,10cyclictest29622-21kworker/3:311:35:063
1484299100,10cyclictest13392-21kworker/3:310:11:393
1483499100,7cyclictest4356-21idleruntime-cro08:44:382
1483499100,10cyclictest0-21swapper/208:34:542
1482199108,2cyclictest31494-21kworker/u16:510:41:510
19665296,1sleep665-21ksoftirqd/609:09:446
148679993,6cyclictest0-21swapper/709:03:507
148679993,6cyclictest0-21swapper/709:03:507
148679993,1cyclictest14249-21/usr/sbin/munin08:05:007
148679992,2cyclictest786-21snmpd07:41:157
148679992,2cyclictest0-21swapper/708:55:117
148679992,1cyclictest786-21snmpd07:27:307
148679992,1cyclictest19358-21awk07:14:547
148679992,1cyclictest0-21swapper/707:54:527
148679990,4cyclictest0-21swapper/708:39:477
148679990,4cyclictest0-21swapper/707:59:517
148609999,0cyclictest0-21swapper/607:14:526
148609997,1cyclictest65-21ksoftirqd/611:12:056
148609997,1cyclictest65-21ksoftirqd/610:10:566
148609993,3cyclictest3122-21systemd12:30:026
148609993,3cyclictest17258-21systemd11:14:566
148609993,2cyclictest0-21swapper/610:00:046
148609992,4cyclictest19462-21systemd10:30:206
148609992,4cyclictest14438-21grepconf.sh10:15:566
148609990,5cyclictest0-21swapper/609:31:146
148609990,0cyclictest0-21swapper/612:27:396
148549998,1cyclictest57-21ksoftirqd/511:46:395
148549997,1cyclictest57-21ksoftirqd/509:36:255
148549997,1cyclictest57-21ksoftirqd/509:11:475
148549996,3cyclictest57-21ksoftirqd/509:19:565
148549993,4cyclictest686-21dbus-daemon09:15:575
148509998,1cyclictest0-21swapper/412:35:024
148509997,1cyclictest49-21ksoftirqd/412:20:124
148509997,1cyclictest49-21ksoftirqd/412:11:294
148509997,1cyclictest49-21ksoftirqd/409:47:034
148509996,2cyclictest18758-21systemd12:31:464
148509993,3cyclictest5125-21systemd-cgroups09:26:184
148509993,3cyclictest24838-21sshd11:12:214
148509992,4cyclictest0-21swapper/411:35:164
148509992,3cyclictest885-21polkitd10:47:174
148509990,9cyclictest0-21swapper/410:57:024
148509990,9cyclictest0-21swapper/409:21:014
148509990,8cyclictest22343-21kworker/4:009:18:174
148429999,0cyclictest0-21swapper/312:20:363
148429997,1cyclictest41-21ksoftirqd/308:54:383
148429996,2cyclictest2822-21grepconf.sh10:21:473
148429993,1cyclictest3285-21sshd11:44:443
148429992,6cyclictest31114-21systemd-cgroups11:13:053
148429992,3cyclictest686-21dbus-daemon09:22:053
148429990,9cyclictest0-21swapper/309:56:213
148349993,5cyclictest786-21snmpd08:16:342
148349993,5cyclictest786-21snmpd08:03:522
148349993,5cyclictest786-21snmpd07:23:272
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional