You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 21:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Sep 17, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
187072920,1sleep11795299cyclictest08:56:441
281842610,0sleep5551rcuc/510:07:125
149062580,0sleep6641ktimersoftd/610:10:096
1772125350,1sleep00-21swapper/007:03:540
4822510,0sleep70-21swapper/709:11:077
173602510,0sleep60-21swapper/612:01:346
81922500,1sleep58178-21sshd10:00:235
66172490,0sleep20-21swapper/210:26:392
319152490,0sleep0101ktimersoftd/010:50:320
182002490,0sleep70-21swapper/712:09:127
1751724925,8sleep30-21swapper/307:01:083
1749724824,9sleep10-21swapper/107:00:501
123282480,1sleep712329-21grepconf.sh09:05:547
288222470,1sleep028791-21sshd09:48:320
1758224725,18sleep40-21swapper/407:01:574
1528324725,8sleep50-21swapper/506:59:345
301542450,0sleep00-21swapper/011:22:190
102072450,0sleep00-21swapper/011:45:500
169592440,0sleep40-21swapper/412:12:534
169592440,0sleep40-21swapper/412:12:534
165832440,0sleep10-21swapper/111:32:541
133472440,0sleep30-21swapper/309:36:183
63012430,0sleep40-21swapper/410:41:394
175542430,0sleep50-21swapper/511:48:115
162012430,0sleep30-21swapper/311:38:323
227082420,1sleep722642-21sshd09:40:307
172872410,0sleep00-21swapper/010:34:460
1761624027,9sleep70-21swapper/707:02:247
1748924029,8sleep20-21swapper/207:00:432
120322400,0sleep20-21swapper/209:39:532
1743423928,8sleep60-21swapper/606:59:596
296362380,0sleep30-21swapper/311:43:133
1795099250,10cyclictest10685-21sshd11:09:550
1795099240,10cyclictest7496-21systemd-cgroups12:04:460
1795099233,7cyclictest721-21dbus-daemon09:44:110
1795099230,9cyclictest15119-21id12:33:150
1795099230,7cyclictest32416-21grepconf.sh09:14:480
1795099230,6cyclictest721-21dbus-daemon11:38:330
1795099230,5cyclictest0-21swapper/011:30:530
1797399220,2cyclictest30848-21sshd11:03:425
17963992218,3cyclictest41-21ksoftirqd/309:13:573
1795099220,9cyclictest4584-21cp10:22:500
1795099220,9cyclictest22263-21grepconf.sh09:25:370
1795099220,9cyclictest15307-21grepconf.sh10:27:090
1795099220,7cyclictest5780-21sshd11:19:060
1795099220,7cyclictest17207-21sshd10:45:580
1795099220,7cyclictest1275-21grepconf.sh11:28:180
1795099220,6cyclictest0-21swapper/009:13:370
1795099220,10cyclictest28432-21systemd12:04:100
1795099220,10cyclictest13663-21bash11:00:440
1795099220,10cyclictest1-21systemd12:26:000
1795099210,9cyclictest9430-21sshd10:06:050
1795099210,9cyclictest26634-21kworker/0:510:56:530
1795099210,9cyclictest10565-21grepconf.sh09:53:060
1795099210,8cyclictest25229-21sshd10:03:190
1795099210,8cyclictest11413-21bash12:10:380
1795099210,8cyclictest11413-21bash12:10:380
1795099210,8cyclictest1-21systemd09:55:150
1795099210,7cyclictest1-21systemd09:33:370
1795099210,7cyclictest0-21swapper/011:42:320
1795099210,7cyclictest0-21swapper/010:15:270
1795099210,6cyclictest857-21polkitd10:11:010
1795099210,6cyclictest10278-21grepconf.sh11:59:220
1795099210,5cyclictest0-21swapper/009:21:070
101762210,1sleep710175-21grepconf.sh11:09:537
274132200,1sleep3391rcuc/312:07:483
1797399204,7cyclictest19197-21sshd09:27:205
17963992016,3cyclictest41-21ksoftirqd/311:48:493
17963992014,4cyclictest41-21ksoftirqd/312:28:533
1795099200,9cyclictest31204-21systemd-cgroups12:15:290
1795099200,9cyclictest27027-21grepconf.sh10:29:440
1795099200,8cyclictest13407-21cp11:51:410
1795099200,7cyclictest1-21systemd12:19:490
1795099200,12cyclictest6046-21sshd10:39:450
1795099200,10cyclictest721-21dbus-daemon11:08:570
1795099200,10cyclictest721-21dbus-daemon11:08:570
1795099200,10cyclictest13932-21kill09:06:010
1795099200,10cyclictest13015-21systemd09:36:170
17963991917,1cyclictest41-21ksoftirqd/310:39:523
17963991916,2cyclictest41-21ksoftirqd/312:22:543
193232180,0sleep30-21swapper/311:08:373
193232180,0sleep30-21swapper/311:08:373
17963991816,1cyclictest41-21ksoftirqd/311:02:513
17963991816,1cyclictest41-21ksoftirqd/310:29:043
17963991816,1cyclictest41-21ksoftirqd/310:11:393
17963991816,1cyclictest391rcuc/312:14:293
17963991815,2cyclictest41-21ksoftirqd/310:45:273
17963991814,1cyclictest41-21ksoftirqd/310:29:413
1795099180,7cyclictest20942-21date07:09:290
121492180,0sleep40-21swapper/410:58:534
67192170,1sleep56718-21systemd-cgroups09:39:405
1797399172,8cyclictest22949-21id09:48:125
1797399170,2cyclictest20834-21systemd11:27:335
17963991716,1cyclictest41-21ksoftirqd/312:11:553
17963991716,1cyclictest41-21ksoftirqd/312:11:553
17963991715,1cyclictest41-21ksoftirqd/312:02:243
17963991715,1cyclictest41-21ksoftirqd/311:54:283
17963991715,1cyclictest41-21ksoftirqd/310:53:523
17963991715,1cyclictest41-21ksoftirqd/310:20:163
17963991715,1cyclictest41-21ksoftirqd/310:18:293
17963991715,1cyclictest41-21ksoftirqd/309:50:583
17963991715,1cyclictest41-21ksoftirqd/309:40:023
17963991715,1cyclictest41-21ksoftirqd/309:20:443
17963991715,1cyclictest41-21ksoftirqd/309:08:353
17963991714,2cyclictest41-21ksoftirqd/311:58:093
17963991713,2cyclictest41-21ksoftirqd/309:55:573
17963991712,4cyclictest41-21ksoftirqd/311:23:133
84752160,1sleep18408-21sshd11:49:361
288882160,0sleep50-21swapper/510:24:185
182692160,0sleep617884-21latency_hist11:44:286
1798399160,16cyclictest0-21swapper/709:29:597
1797399164,7cyclictest26687-21grep11:16:285
17963991615,1cyclictest41-21ksoftirqd/311:33:433
17963991614,1cyclictest41-21ksoftirqd/312:32:343
17963991614,1cyclictest41-21ksoftirqd/311:15:203
17963991614,1cyclictest41-21ksoftirqd/310:04:343
17963991614,1cyclictest41-21ksoftirqd/310:04:253
17963991614,1cyclictest41-21ksoftirqd/309:29:233
17963991613,1cyclictest41-21ksoftirqd/309:47:183
17963991612,1cyclictest121rcu_preempt11:11:053
17963991610,4cyclictest41-21ksoftirqd/309:31:383
1796399161,1cyclictest41-21ksoftirqd/311:25:413
1795099160,9cyclictest0-21swapper/007:14:490
78942150,0sleep60-21swapper/611:55:096
69702150,0sleep20-21swapper/212:25:172
325302150,0sleep20-21swapper/210:37:362
258272150,0sleep20-21swapper/211:54:252
241142150,0sleep624111-21systemd-cgroups10:25:476
17973991513,1cyclictest57-21ksoftirqd/510:10:495
17963991513,1cyclictest41-21ksoftirqd/310:54:303
17963991513,1cyclictest41-21ksoftirqd/310:34:493
17963991513,1cyclictest41-21ksoftirqd/309:19:223
17960991513,1cyclictest33-21ksoftirqd/209:32:082
17952991514,1cyclictest0-21swapper/111:44:591
17952991511,3cyclictest25-21ksoftirqd/109:52:181
1795099150,9cyclictest29659-21if_err_em208:19:420
1795099150,9cyclictest22798-21sed07:09:480
1795099150,9cyclictest22798-21sed07:09:480
1795099150,7cyclictest9568-21cat07:44:400
1795099150,7cyclictest4664-21latency_hist08:34:290
1795099150,7cyclictest32508-21cpu07:29:390
1795099150,7cyclictest16416-21/usr/sbin/munin08:54:440
1795099150,6cyclictest8089-21cstates08:39:390
1795099150,6cyclictest27752-21cat08:14:510
1795099150,5cyclictest19962-21latency_hist08:04:280
145012150,2sleep21796099cyclictest11:44:162
126342150,0sleep4471rcuc/411:23:124
33992140,0sleep70-21swapper/711:57:037
27692140,0sleep61-21systemd09:31:566
273142140,0sleep20-21swapper/212:02:102
1797399148,5cyclictest730-21NetworkManager12:25:055
1797399140,2cyclictest10881-21sshd10:26:545
1797399140,13cyclictest3866-21sshd11:13:225
1796999140,13cyclictest15492-21kworker/4:111:24:554
1796099149,1cyclictest25478-21kworker/2:110:19:542
17960991410,1cyclictest33-21ksoftirqd/211:11:252
17952991412,1cyclictest25-21ksoftirqd/111:10:121
1795099140,6cyclictest13294-21switchtime07:49:480
29612130,1sleep72935-21bash12:34:277
17978991311,1cyclictest65-21ksoftirqd/609:14:356
1797399135,7cyclictest1949550sshd12:09:175
1797399134,8cyclictest23129-21grepconf.sh11:52:165
1797399133,9cyclictest1-21systemd10:47:075
1797399130,2cyclictest8273-21sshd11:41:535
1797399130,2cyclictest721-21dbus-daemon11:23:155
1797399130,2cyclictest27980-21sshd09:33:275
1797399130,2cyclictest25639-21kill11:37:075
1797399130,1cyclictest0-21swapper/510:37:555
17963991312,0cyclictest31303-21sensors07:24:483
1796099139,3cyclictest33-21ksoftirqd/211:29:452
1796099139,3cyclictest1473-21kworker/2:411:36:472
17960991312,1cyclictest33-21ksoftirqd/212:21:222
17960991312,1cyclictest33-21ksoftirqd/211:00:052
17960991311,1cyclictest33-21ksoftirqd/210:14:502
17960991311,1cyclictest33-21ksoftirqd/210:00:012
17960991311,1cyclictest33-21ksoftirqd/209:50:482
17960991311,1cyclictest33-21ksoftirqd/209:34:402
17960991310,2cyclictest33-21ksoftirqd/211:04:532
17960991310,2cyclictest33-21ksoftirqd/211:04:532
17960991310,2cyclictest33-21ksoftirqd/209:09:462
17960991310,1cyclictest33-21ksoftirqd/211:14:432
1796099131,11cyclictest2934-21cp09:28:182
1796099130,12cyclictest1473-21kworker/2:411:48:222
1796099130,12cyclictest1247-21kworker/2:610:11:232
1795299133,4cyclictest0-21swapper/110:03:421
17952991312,1cyclictest25-21ksoftirqd/112:17:171
17952991312,1cyclictest25-21ksoftirqd/109:25:311
1795099130,8cyclictest4738-21sed07:34:470
141162130,0sleep60-21swapper/609:23:236
68422120,1sleep7721ktimersoftd/709:24:457
67102120,0sleep70-21swapper/711:47:337
58102120,0sleep20-21swapper/209:07:422
50822120,0sleep60-21swapper/609:35:496
218522120,0sleep60-21swapper/612:31:466
1798399123,6cyclictest25682-21bash12:11:287
1798399123,6cyclictest25682-21bash12:11:287
1798399123,5cyclictest31094-21grepconf.sh10:13:047
17983991210,1cyclictest73-21ksoftirqd/710:26:207
1798399121,5cyclictest15520-21sd-pam10:36:377
1797899129,2cyclictest11762-21id09:51:156
1797899123,6cyclictest31476-21id10:31:526
1797899122,6cyclictest857-21polkitd11:17:146
1797899122,3cyclictest571-21sshd11:24:286
1797899122,3cyclictest0-21swapper/611:50:396
17978991211,1cyclictest65-21ksoftirqd/611:04:046
17978991211,1cyclictest65-21ksoftirqd/610:39:416
17978991210,1cyclictest65-21ksoftirqd/612:28:086
17978991210,1cyclictest65-21ksoftirqd/612:18:116
17978991210,1cyclictest65-21ksoftirqd/612:08:226
17978991210,1cyclictest65-21ksoftirqd/610:36:596
1797399126,5cyclictest1-21systemd12:11:585
1797399126,5cyclictest1-21systemd12:11:585
1797399125,6cyclictest3277-21rm11:30:115
1797399125,6cyclictest1-21systemd10:43:055
1797399124,7cyclictest31221-21sshd10:50:295
1797399124,7cyclictest31002-21sh11:54:415
1797399124,7cyclictest22882-21sshd10:29:315
1797399124,7cyclictest17105-21grep12:29:405
1797399123,8cyclictest9653-21sshd09:15:225
1797399123,8cyclictest17766-21grep09:57:155
1797399123,8cyclictest15304-21sshd12:22:065
1797399123,8cyclictest14875-21sshd09:36:235
1797399123,2cyclictest721-21dbus-daemon09:13:315
1797399123,2cyclictest721-21dbus-daemon09:07:225
1797399123,2cyclictest26980-21bash10:14:415
1797399120,3cyclictest10208-21bash09:21:125
1797399120,2cyclictest32401-21bash10:58:115
1797399120,2cyclictest16345-21systemd12:01:315
1797399120,11cyclictest4099-21kworker/5:311:05:265
1797399120,11cyclictest4099-21kworker/5:311:05:265
1797399120,1cyclictest1-21systemd12:14:595
1796999129,3cyclictest49-21ksoftirqd/411:16:584
1796999129,2cyclictest9330-21bash11:43:584
1796999127,1cyclictest49-21ksoftirqd/409:28:494
17969991211,1cyclictest49-21ksoftirqd/411:03:234
17969991210,1cyclictest49-21ksoftirqd/411:10:044
17969991210,1cyclictest49-21ksoftirqd/410:18:034
17969991210,1cyclictest25875-21sshd09:38:574
1796999120,11cyclictest1041-21systemd12:28:444
1796999120,11cyclictest1-21systemd09:14:504
1796099129,2cyclictest33-21ksoftirqd/210:48:252
1796099129,1cyclictest33-21ksoftirqd/211:56:532
1796099128,4cyclictest33-21ksoftirqd/212:10:502
1796099128,4cyclictest33-21ksoftirqd/212:10:502
1796099128,1cyclictest33-21ksoftirqd/212:34:122
1796099126,3cyclictest33-21ksoftirqd/210:57:472
17960991211,1cyclictest33-21ksoftirqd/211:22:522
17960991211,1cyclictest33-21ksoftirqd/210:29:552
17960991211,1cyclictest33-21ksoftirqd/209:46:142
17960991211,1cyclictest33-21ksoftirqd/209:24:072
17960991210,2cyclictest33-21ksoftirqd/209:56:482
17960991210,1cyclictest33-21ksoftirqd/212:05:272
17960991210,1cyclictest33-21ksoftirqd/210:50:052
17960991210,1cyclictest33-21ksoftirqd/209:15:202
1796099120,12cyclictest27400-21kworker/2:210:41:422
1795299127,3cyclictest859-21gdbus11:07:501
1795299127,3cyclictest859-21gdbus11:07:501
1795299122,4cyclictest0-21swapper/112:11:281
1795299122,4cyclictest0-21swapper/112:11:281
17952991210,1cyclictest25-21ksoftirqd/111:20:281
17952991210,1cyclictest0-21swapper/109:36:241
1795099120,8cyclictest31603-21/usr/sbin/munin08:24:430
1795099120,8cyclictest31603-21/usr/sbin/munin08:24:430
1795099120,5cyclictest0-21swapper/007:41:180
1795099120,5cyclictest0-21swapper/007:23:530
161952120,1sleep516196-21grep09:49:425
159812120,0sleep2321ktimersoftd/210:06:292
293132110,0sleep40-21swapper/411:31:454
1798399119,1cyclictest73-21ksoftirqd/709:59:577
1798399115,3cyclictest721-21dbus-daemon11:17:397
1798399114,4cyclictest4760-21gdbus10:50:217
1798399112,4cyclictest0-21swapper/710:07:177
1798399111,4cyclictest756-21sshd12:26:487
1798399111,4cyclictest29905-21sshd11:29:517
1798399111,4cyclictest0-21swapper/711:36:517
1798399110,1cyclictest1-21systemd09:50:257
1797899119,1cyclictest65-21ksoftirqd/612:09:396
1797899119,1cyclictest65-21ksoftirqd/612:09:396
1797899119,1cyclictest65-21ksoftirqd/610:15:406
1797899119,1cyclictest65-21ksoftirqd/609:10:086
1797899118,3cyclictest65-21ksoftirqd/609:59:186
1797899113,4cyclictest0-21swapper/610:51:336
1797899112,6cyclictest13969-21grepconf.sh09:45:436
1797899112,5cyclictest730-21NetworkManager10:05:546
1797899112,5cyclictest13743-21sshd11:25:066
1797899111,7cyclictest0-21swapper/610:21:006
1797899110,10cyclictest26679-21kworker/6:110:01:376
1797899110,10cyclictest25911-21kworker/6:511:14:286
1797899110,10cyclictest12992-21sshd12:21:586
1797399110,2cyclictest30571-21iostat_ios07:24:435
1796999119,1cyclictest49-21ksoftirqd/412:00:134
1796999119,1cyclictest49-21ksoftirqd/411:56:274
1796999119,1cyclictest49-21ksoftirqd/409:33:334
1796999118,2cyclictest20402-21bash10:34:554
1796999117,1cyclictest0-21swapper/412:29:374
1796999116,4cyclictest49-21ksoftirqd/410:02:454
1796999115,3cyclictest2934-21kworker/4:010:20:254
1796999113,5cyclictest18177-21bash09:21:414
1796999113,4cyclictest859-21gdbus11:38:424
1796999110,10cyclictest899-21sshd10:05:354
1796399119,1cyclictest41-21ksoftirqd/307:49:393
1796099117,3cyclictest33-21ksoftirqd/211:24:462
1796099110,1cyclictest131rcu_sched12:14:432
1795299119,1cyclictest7495-21systemd-cgroups10:49:141
1795299119,1cyclictest25-21ksoftirqd/111:54:421
1795299119,1cyclictest25-21ksoftirqd/109:48:261
1795299118,1cyclictest25-21ksoftirqd/109:59:031
1795299115,3cyclictest709-21systemd-logind12:05:531
1795299113,4cyclictest857-21polkitd11:02:221
1795299112,5cyclictest13769-21bash10:32:441
1795299112,4cyclictest23735-21sshd12:28:101
1795299111,4cyclictest6813-21sshd10:50:571
1795299111,4cyclictest24464-21bash09:29:331
1795299111,4cyclictest0-21swapper/110:05:151
1795299110,5cyclictest27006-21sshd09:40:481
1795299110,5cyclictest15861-21sshd10:25:181
1795299110,1cyclictest857-21polkitd11:59:521
1795299110,1cyclictest4760-21gdbus10:19:451
1795299110,1cyclictest0-21swapper/112:19:431
1795099110,8cyclictest23276-21cstates08:09:400
1795099110,8cyclictest23276-21cstates08:09:400
1795099110,5cyclictest0-21swapper/008:04:400
1795099110,10cyclictest20533-21awk08:59:460
165462110,0sleep40-21swapper/410:51:324
112452119,1sleep125-21ksoftirqd/110:38:161
1798399108,1cyclictest73-21ksoftirqd/711:40:047
1798399108,1cyclictest73-21ksoftirqd/711:03:447
1798399108,1cyclictest73-21ksoftirqd/710:54:357
1798399108,1cyclictest73-21ksoftirqd/709:56:057
1798399108,1cyclictest73-21ksoftirqd/709:46:587
1798399106,3cyclictest31994-21sshd09:35:307
1798399105,1cyclictest16016-21sshd11:04:417
1798399105,1cyclictest16016-21sshd11:04:417
1798399104,3cyclictest709-21systemd-logind10:43:067
1798399103,6cyclictest3069-21sshd10:45:087
1798399103,4cyclictest13568-21sed11:49:477
1798399103,1cyclictest4264-21sshd12:15:487
1798399102,7cyclictest1896-21sshd12:19:297
1798399102,5cyclictest857-21polkitd09:19:197
1798399102,5cyclictest18553-21grepconf.sh09:21:427
1798399100,4cyclictest8943-21grepconf.sh10:17:257
1798399100,4cyclictest18849-21grepconf.sh10:19:487
1797899109,1cyclictest65-21ksoftirqd/609:40:316
1797899109,1cyclictest19422-21sshd10:48:006
1797899108,1cyclictest65-21ksoftirqd/610:55:486
1797899108,1cyclictest65-21ksoftirqd/609:08:556
1797899108,1cyclictest14608-21grep11:32:476
1797899103,6cyclictest721-21dbus-daemon11:49:086
1797899102,3cyclictest19515-21sshd09:25:276
1797899100,9cyclictest17491-21kworker/6:111:07:286
1797899100,9cyclictest17491-21kworker/6:111:07:286
1797899100,9cyclictest11513-21kworker/6:011:37:416
1797399105,4cyclictest57-21ksoftirqd/507:57:185
1797399104,5cyclictest4570-21/usr/sbin/munin08:34:295
1797399104,5cyclictest22648-21proc_pri07:09:475
1797399104,5cyclictest22648-21proc_pri07:09:475
1797399103,2cyclictest752-21snmpd08:39:355
1797399102,2cyclictest752-21snmpd08:11:465
1797399102,2cyclictest752-21snmpd08:11:465
1796999108,1cyclictest49-21ksoftirqd/412:07:504
1796999108,1cyclictest49-21ksoftirqd/411:44:584
1796999108,1cyclictest49-21ksoftirqd/410:45:494
1796999108,1cyclictest49-21ksoftirqd/410:24:484
1796999108,1cyclictest49-21ksoftirqd/409:57:174
1796999107,2cyclictest29365-21grepconf.sh09:46:374
1796999107,1cyclictest49-21ksoftirqd/410:09:464
1796999103,3cyclictest721-21dbus-daemon12:18:264
1796999103,3cyclictest721-21dbus-daemon11:08:014
1796999103,3cyclictest721-21dbus-daemon11:08:014
1796999102,5cyclictest27810-21bash10:33:334
1796999102,5cyclictest16416-21systemd11:49:574
1796999100,9cyclictest5632-21kworker/4:009:51:384
1796999100,9cyclictest31351-21kworker/4:409:06:384
1796999100,5cyclictest22359-21systemd-cgroups09:12:224
1796399109,1cyclictest41-21ksoftirqd/307:14:423
1796399108,1cyclictest16690-21sshd07:56:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional