You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 22:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Sep 03, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
115162620,0sleep50-21swapper/509:44:045
1802425847,8sleep30-21swapper/307:03:403
247652570,0sleep20-21swapper/211:52:402
34282550,1sleep23432-21bash10:28:462
1791025329,8sleep50-21swapper/507:02:055
77782500,1sleep37773-21sshd10:13:173
74082500,0sleep37409-21nfsd412:15:153
279252490,0sleep30-21swapper/311:31:103
201442480,0sleep10-21swapper/110:31:411
314712470,1sleep131431-21sshd10:10:431
192582470,1sleep665-21ksoftirqd/611:36:346
296442460,1sleep529630-21sshd09:11:525
115872460,0sleep111583-21sshd09:57:451
273822450,0sleep40-21swapper/410:47:544
224582450,0sleep422457-21sshd12:22:054
316572440,0sleep50-21swapper/512:05:005
177932440,0sleep20-21swapper/209:28:472
253432430,0sleep70-21swapper/712:04:387
1782624331,8sleep70-21swapper/707:00:557
85152420,0sleep20-21swapper/212:07:292
180162420,0sleep10-21swapper/109:15:091
1782824229,9sleep00-21swapper/007:00:560
73812410,0sleep60-21swapper/611:45:396
239312410,0sleep20-21swapper/209:40:492
231002410,0sleep40-21swapper/411:52:344
1779424128,9sleep40-21swapper/407:00:284
169582410,0sleep30-21swapper/312:02:023
162332410,0sleep10-21swapper/111:00:571
1791624029,8sleep20-21swapper/207:02:102
47052390,0sleep50-21swapper/512:28:555
311212390,0sleep50-21swapper/509:39:235
1802723928,8sleep60-21swapper/607:03:436
1796423928,8sleep10-21swapper/107:02:491
169512380,0sleep60-21swapper/609:50:146
102062380,0sleep00-21swapper/012:07:350
99182370,2sleep21831499cyclictest09:53:462
249952370,0sleep40-21swapper/409:27:134
155542360,0sleep20-21swapper/211:10:432
155542360,0sleep20-21swapper/211:10:432
105492330,0sleep60-21swapper/609:10:416
1832999276,1cyclictest49-21ksoftirqd/410:05:214
18329992511,2cyclictest49-21ksoftirqd/412:31:034
18329992411,3cyclictest49-21ksoftirqd/411:57:014
18329992411,3cyclictest49-21ksoftirqd/411:57:014
1832999237,1cyclictest49-21ksoftirqd/412:09:374
1832999234,3cyclictest49-21ksoftirqd/411:21:594
18329992310,1cyclictest49-21ksoftirqd/410:29:444
1832999229,1cyclictest49-21ksoftirqd/411:18:504
1832999229,1cyclictest49-21ksoftirqd/411:05:484
1832999224,2cyclictest49-21ksoftirqd/410:41:484
1832999219,1cyclictest49-21ksoftirqd/410:12:064
1832999218,3cyclictest49-21ksoftirqd/409:31:524
1832999218,2cyclictest49-21ksoftirqd/409:10:014
1832999218,1cyclictest49-21ksoftirqd/411:42:314
1832999218,1cyclictest131rcu_sched09:06:514
1832999217,1cyclictest49-21ksoftirqd/410:38:454
1832999217,1cyclictest49-21ksoftirqd/409:46:264
1832999216,3cyclictest49-21ksoftirqd/411:10:294
1832999216,3cyclictest49-21ksoftirqd/411:10:294
1832999216,1cyclictest49-21ksoftirqd/411:45:244
1832999212,2cyclictest49-21ksoftirqd/409:16:004
18329992110,1cyclictest49-21ksoftirqd/409:42:484
1832999208,3cyclictest49-21ksoftirqd/412:25:004
1832999208,3cyclictest49-21ksoftirqd/411:32:034
1832999208,1cyclictest49-21ksoftirqd/412:13:594
1832999207,3cyclictest49-21ksoftirqd/412:17:424
1832999206,3cyclictest49-21ksoftirqd/410:21:144
1832999205,1cyclictest49-21ksoftirqd/410:30:234
1832999204,3cyclictest49-21ksoftirqd/411:35:174
18329992015,3cyclictest49-21ksoftirqd/411:02:344
18329992011,1cyclictest49-21ksoftirqd/410:18:344
45902190,0sleep20-21swapper/209:45:292
287342190,1sleep128733-21grepconf.sh09:23:341
1832999197,3cyclictest49-21ksoftirqd/410:51:524
1832999196,3cyclictest49-21ksoftirqd/411:29:564
1832999195,2cyclictest49-21ksoftirqd/412:04:164
1832999193,3cyclictest49-21ksoftirqd/409:54:234
18329991917,1cyclictest49-21ksoftirqd/409:21:574
18329991917,1cyclictest471rcuc/410:00:594
309772180,1sleep130970-21sshd09:10:041
204522180,8sleep665-21ksoftirqd/610:00:156
1832999187,2cyclictest49-21ksoftirqd/410:55:454
1832999180,3cyclictest49-21ksoftirqd/409:38:414
90962170,0sleep3401ktimersoftd/311:28:063
1832999178,1cyclictest49-21ksoftirqd/409:55:044
18314991715,1cyclictest33-21ksoftirqd/209:17:572
1831499170,16cyclictest19681-21kworker/2:010:51:442
18298991710,1cyclictest1-21systemd11:03:120
96962160,2sleep51833799cyclictest11:41:535
88002160,1sleep28793-21bash10:03:312
5432160,0sleep60-21swapper/610:08:566
38732160,0sleep60-21swapper/612:03:176
246232160,2sleep71835199cyclictest11:46:447
226102160,1sleep773-21ksoftirqd/710:24:027
18337991614,1cyclictest57-21ksoftirqd/511:54:115
18337991614,1cyclictest57-21ksoftirqd/509:15:125
18337991611,1cyclictest25590-21sshd12:18:225
18314991614,2cyclictest33-21ksoftirqd/209:32:052
18314991614,1cyclictest33-21ksoftirqd/209:39:142
18314991614,1cyclictest33-21ksoftirqd/209:21:122
18314991613,2cyclictest33-21ksoftirqd/209:14:302
18306991613,2cyclictest736-21gdbus10:09:211
154292160,1sleep215431-21grepconf.sh11:58:002
154292160,1sleep215431-21grepconf.sh11:58:002
18314991514,1cyclictest33-21ksoftirqd/210:09:352
18314991513,1cyclictest33-21ksoftirqd/212:20:572
18314991513,1cyclictest33-21ksoftirqd/212:01:562
18314991513,1cyclictest33-21ksoftirqd/211:27:192
18314991513,1cyclictest33-21ksoftirqd/210:22:202
18314991512,1cyclictest33-21ksoftirqd/210:47:092
1831499150,1cyclictest131rcu_sched12:30:172
1830699150,14cyclictest8993-21sshd11:47:471
1829899150,10cyclictest20332-21sshd10:51:220
54782140,0sleep60-21swapper/609:43:416
1834599140,1cyclictest0-21swapper/609:16:156
18337991413,1cyclictest57-21ksoftirqd/511:08:395
18329991413,1cyclictest12472-21kworker/4:209:01:234
18314991413,1cyclictest33-21ksoftirqd/211:45:442
18314991413,1cyclictest33-21ksoftirqd/210:40:112
18314991412,1cyclictest33-21ksoftirqd/212:18:032
18314991412,1cyclictest33-21ksoftirqd/211:22:382
18314991412,1cyclictest33-21ksoftirqd/210:13:312
1831499140,2cyclictest131rcu_sched11:06:242
18306991413,1cyclictest25-21ksoftirqd/111:39:381
18298991412,1cyclictest9-21ksoftirqd/009:20:320
179612140,0sleep00-21swapper/012:31:380
109612140,0sleep70-21swapper/709:26:207
2374221310,1sleep125-21ksoftirqd/109:33:041
236632130,0sleep0111rcuc/009:35:020
224782130,1sleep322436-21sshd11:09:163
1835199133,4cyclictest7347-21grep09:35:557
1835199132,5cyclictest7521-21grepconf.sh11:39:527
18351991311,1cyclictest73-21ksoftirqd/712:20:447
1834599138,1cyclictest65-21ksoftirqd/610:56:386
1834599132,3cyclictest28091-21sshd10:14:336
1834599130,13cyclictest0-21swapper/610:32:376
1833799139,1cyclictest57-21ksoftirqd/511:34:175
18337991311,1cyclictest57-21ksoftirqd/511:35:585
18337991311,1cyclictest57-21ksoftirqd/511:25:375
18337991311,1cyclictest57-21ksoftirqd/511:14:515
18337991311,1cyclictest57-21ksoftirqd/511:14:515
18337991311,1cyclictest57-21ksoftirqd/510:25:145
1833799130,13cyclictest0-21swapper/512:31:355
18321991312,1cyclictest41-21ksoftirqd/310:44:363
18321991311,1cyclictest41-21ksoftirqd/311:14:023
18321991311,1cyclictest41-21ksoftirqd/311:14:023
18321991311,1cyclictest41-21ksoftirqd/310:09:343
18314991312,1cyclictest33-21ksoftirqd/212:14:042
18314991312,1cyclictest33-21ksoftirqd/211:00:302
18314991312,1cyclictest33-21ksoftirqd/210:31:242
18314991312,1cyclictest33-21ksoftirqd/210:18:242
18314991311,1cyclictest33-21ksoftirqd/212:25:172
18314991311,1cyclictest33-21ksoftirqd/211:40:512
18314991311,1cyclictest33-21ksoftirqd/211:30:222
18314991311,1cyclictest33-21ksoftirqd/211:19:412
18314991311,1cyclictest33-21ksoftirqd/209:09:402
1830699139,3cyclictest25-21ksoftirqd/110:24:131
1830699137,2cyclictest7485-21bash10:38:511
18306991311,1cyclictest25-21ksoftirqd/109:39:461
9812120,0sleep10-21swapper/111:21:391
1835199129,2cyclictest30273-21bash10:32:197
1835199122,4cyclictest6409-21grepconf.sh11:57:267
1835199122,4cyclictest6409-21grepconf.sh11:57:267
1835199122,4cyclictest5078-21sshd11:53:277
1835199122,4cyclictest18189-21bash10:35:287
18351991210,1cyclictest73-21ksoftirqd/710:25:247
1835199120,11cyclictest4760-21gdbus09:45:027
1835199120,11cyclictest17672-21bash10:47:187
1835199120,11cyclictest0-21swapper/711:33:397
1834599128,3cyclictest65-21ksoftirqd/612:31:316
1834599122,4cyclictest721-21dbus-daemon10:18:576
1834599122,4cyclictest709-21systemd-logind10:24:046
1834599122,4cyclictest4556-21bash09:57:196
1834599122,4cyclictest351-21sshd12:09:006
1834599122,4cyclictest22562-21sshd12:25:596
1834599122,4cyclictest21868-21grep09:48:366
1834599122,4cyclictest16886-21grep10:51:096
1834599122,4cyclictest0-21swapper/611:50:366
1834599122,4cyclictest0-21swapper/611:26:396
1834599122,4cyclictest0-21swapper/611:00:396
1834599121,5cyclictest7857-21grepconf.sh10:40:456
1834599121,5cyclictest2134-21rm11:31:356
1834599120,2cyclictest9513-21bash11:59:396
1834599120,2cyclictest9513-21bash11:59:396
1834599120,2cyclictest1-21systemd12:21:246
1833799129,2cyclictest57-21ksoftirqd/510:07:075
1833799128,1cyclictest7335-21sshd09:51:345
1833799122,10cyclictest57-21ksoftirqd/509:33:015
18337991211,1cyclictest57-21ksoftirqd/510:37:565
18337991211,1cyclictest57-21ksoftirqd/510:01:005
18337991210,1cyclictest57-21ksoftirqd/511:59:555
18337991210,1cyclictest57-21ksoftirqd/511:59:555
18337991210,1cyclictest57-21ksoftirqd/511:21:135
18337991210,1cyclictest57-21ksoftirqd/510:50:525
18337991210,1cyclictest57-21ksoftirqd/510:22:025
1833799121,5cyclictest28448-21bash10:45:575
18329991212,0cyclictest12472-21kworker/4:208:47:224
18329991211,1cyclictest49-21ksoftirqd/408:50:174
18329991211,1cyclictest49-21ksoftirqd/408:05:004
18329991210,1cyclictest49-21ksoftirqd/407:30:004
18321991210,1cyclictest41-21ksoftirqd/310:17:013
18321991210,1cyclictest41-21ksoftirqd/309:18:273
18321991210,1cyclictest41-21ksoftirqd/309:10:123
18321991210,1cyclictest0-21swapper/311:54:523
18314991211,1cyclictest33-21ksoftirqd/210:57:402
18314991211,1cyclictest33-21ksoftirqd/210:39:342
18314991211,1cyclictest33-21ksoftirqd/209:55:152
18314991210,1cyclictest33-21ksoftirqd/211:35:002
1830699129,2cyclictest20466-21bash12:18:031
18306991210,1cyclictest25-21ksoftirqd/111:51:511
18306991210,1cyclictest25-21ksoftirqd/111:40:491
18306991210,1cyclictest25-21ksoftirqd/110:46:041
18306991210,1cyclictest25-21ksoftirqd/110:44:051
1829899122,4cyclictest730-21NetworkManager10:57:070
18298991210,1cyclictest9-21ksoftirqd/011:35:390
18298991210,1cyclictest9-21ksoftirqd/011:17:320
18298991210,1cyclictest9-21ksoftirqd/010:48:570
18298991210,1cyclictest9-21ksoftirqd/010:42:350
1829899120,11cyclictest18441-21grepconf.sh10:37:300
314982110,0sleep50-21swapper/510:16:405
297692110,0sleep10-21swapper/109:47:041
1835199119,1cyclictest24116-21sshd11:09:227
1835199119,1cyclictest0-21swapper/711:41:047
1835199111,4cyclictest22049-21bash10:55:237
1835199111,4cyclictest13760-21sshd10:09:457
1834599113,7cyclictest21883-21bash10:39:456
1834599113,7cyclictest0-21swapper/611:12:386
1834599113,7cyclictest0-21swapper/611:12:386
1834599112,4cyclictest9964-21cp09:36:056
1834599112,4cyclictest21165-21sshd12:10:136
1834599112,4cyclictest0-21swapper/611:21:056
18345991110,1cyclictest0-21swapper/609:20:256
1834599111,4cyclictest4291-21sshd09:27:576
1834599111,4cyclictest25179-21sshd11:07:256
1834599110,5cyclictest24535-21id11:17:136
1833799119,1cyclictest57-21ksoftirqd/512:01:575
1833799119,1cyclictest57-21ksoftirqd/511:45:485
1833799119,1cyclictest57-21ksoftirqd/510:42:425
1833799119,1cyclictest57-21ksoftirqd/510:32:175
1833799119,1cyclictest57-21ksoftirqd/510:10:225
1833799119,1cyclictest57-21ksoftirqd/509:57:335
1833799119,1cyclictest57-21ksoftirqd/509:29:275
1833799117,3cyclictest57-21ksoftirqd/509:07:145
1833799117,1cyclictest3306-21sshd09:47:265
18337991110,1cyclictest57-21ksoftirqd/509:20:455
18329991111,0cyclictest12472-21kworker/4:208:44:134
18329991111,0cyclictest12472-21kworker/4:207:52:044
18329991110,1cyclictest12472-21kworker/4:207:44:484
18329991110,1cyclictest12472-21kworker/4:207:15:404
1832199119,1cyclictest41-21ksoftirqd/312:13:113
1832199119,1cyclictest41-21ksoftirqd/310:50:453
1832199110,11cyclictest0-21swapper/311:17:433
1832199110,10cyclictest721-21dbus-daemon12:34:073
1832199110,10cyclictest5046-21sshd09:31:533
1830699119,1cyclictest25-21ksoftirqd/112:21:111
1830699119,1cyclictest25-21ksoftirqd/109:29:121
1830699118,2cyclictest32485-21sshd11:19:431
1830699118,1cyclictest25-21ksoftirqd/112:00:521
1830699113,5cyclictest3835-21bash10:15:021
18306991110,1cyclictest25-21ksoftirqd/109:40:431
1830699110,2cyclictest18267-21cp11:58:111
1830699110,2cyclictest18267-21cp11:58:111
1829899119,1cyclictest9-21ksoftirqd/011:59:450
1829899119,1cyclictest9-21ksoftirqd/011:59:450
1829899119,1cyclictest9-21ksoftirqd/011:25:220
1829899119,1cyclictest9-21ksoftirqd/010:00:590
1829899119,1cyclictest13845-21sshd09:34:260
1829899119,1cyclictest0-21swapper/012:16:300
1829899114,1cyclictest859-21gdbus09:08:470
1829899113,7cyclictest13498-21bash09:55:520
1829899111,4cyclictest2606-21systemd-cgroups11:08:010
1829899111,4cyclictest26032-21sshd12:10:270
1829899110,5cyclictest25684-21sshd09:42:560
1829899110,5cyclictest25348-21sshd09:48:480
1829899110,5cyclictest12700-21sshd12:23:300
1829899110,1cyclictest0-21swapper/009:53:500
1835199108,1cyclictest73-21ksoftirqd/712:26:197
1835199108,1cyclictest73-21ksoftirqd/711:16:067
1835199108,1cyclictest31600-21sshd10:10:437
1835199107,2cyclictest12459-21cp10:15:277
1835199103,6cyclictest20753-21sshd10:00:157
1835199102,4cyclictest3841-21sshd10:52:227
1835199101,4cyclictest0-21swapper/712:11:257
1835199101,3cyclictest30507-21sshd09:19:487
1835199100,9cyclictest32016-21grep11:23:357
1835199100,4cyclictest709-21systemd-logind09:13:307
1835199100,4cyclictest27285-21sshd11:27:127
1835199100,4cyclictest25631-21sshd12:08:337
1835199100,4cyclictest18104-21sshd12:31:397
1835199100,10cyclictest0-21swapper/709:44:147
1834599108,1cyclictest65-21ksoftirqd/610:25:436
1834599103,6cyclictest12494-21sshd11:40:096
1834599102,7cyclictest10780-21grepconf.sh12:15:256
1834599102,4cyclictest23780-21sshd09:31:026
1834599102,3cyclictest30141-21sshd10:46:046
1833799108,1cyclictest57-21ksoftirqd/512:14:455
1833799108,1cyclictest57-21ksoftirqd/510:56:085
1833799107,2cyclictest57-21ksoftirqd/511:03:055
1833799100,9cyclictest10796-21kworker/5:011:15:225
1832999109,1cyclictest12472-21kworker/4:208:21:324
1832999109,1cyclictest12472-21kworker/4:207:24:204
1832999109,1cyclictest12472-21kworker/4:207:12:024
1832999108,1cyclictest49-21ksoftirqd/407:55:134
18329991010,0cyclictest12472-21kworker/4:208:05:364
18329991010,0cyclictest12472-21kworker/4:207:48:364
18329991010,0cyclictest12472-21kworker/4:207:05:064
1832199109,1cyclictest41-21ksoftirqd/312:29:563
1832199109,1cyclictest0-21swapper/310:55:373
1832199108,1cyclictest41-21ksoftirqd/309:38:373
1832199108,1cyclictest10824-21sshd11:00:383
1832199105,2cyclictest22802-21sshd09:58:283
1832199104,3cyclictest0-21swapper/309:24:003
1832199103,2cyclictest18751-21cp11:20:443
1832199102,3cyclictest0-21swapper/312:07:273
1832199100,10cyclictest0-21swapper/311:36:163
1832199100,10cyclictest0-21swapper/310:38:533
1832199100,1cyclictest0-21swapper/312:20:053
1832199100,1cyclictest0-21swapper/310:28:193
1830699109,1cyclictest25-21ksoftirqd/112:31:441
1830699109,1cyclictest25-21ksoftirqd/112:09:471
1830699109,1cyclictest25-21ksoftirqd/109:50:531
1830699108,1cyclictest25-21ksoftirqd/111:30:021
1830699108,1cyclictest25-21ksoftirqd/110:57:211
1830699107,2cyclictest774-21grep10:00:591
1830699106,1cyclictest25-21ksoftirqd/111:26:121
1830699100,10cyclictest0-21swapper/110:51:011
1829899108,1cyclictest9-21ksoftirqd/011:50:100
1829899108,1cyclictest9-21ksoftirqd/010:18:400
1829899103,6cyclictest9249-21sshd09:26:140
1829899102,4cyclictest19850-21bash10:33:420
1829899102,4cyclictest16291-21bash10:21:380
183519999,0cyclictest0-21swapper/709:31:097
183519998,1cyclictest73-21ksoftirqd/709:50:037
183519997,1cyclictest73-21ksoftirqd/712:18:257
183519997,1cyclictest73-21ksoftirqd/709:22:097
183519997,1cyclictest5114-21df11:10:107
183519997,1cyclictest5114-21df11:10:107
183519997,1cyclictest10075-21sshd10:44:567
183519992,1cyclictest0-21swapper/711:01:217
183519990,9cyclictest0-21swapper/708:50:107
183519990,1cyclictest0-21swapper/709:09:407
183459992,6cyclictest10373-21sshd09:06:216
183379990,7cyclictest20233-21bash12:20:025
183299999,0cyclictest12472-21kworker/4:208:37:174
183299999,0cyclictest12472-21kworker/4:208:28:284
183299999,0cyclictest12472-21kworker/4:208:10:584
183299998,1cyclictest12472-21kworker/4:208:56:114
183299998,1cyclictest12472-21kworker/4:208:17:444
183299991,1cyclictest49-21ksoftirqd/407:35:164
183299990,1cyclictest49-21ksoftirqd/407:30:174
183219999,0cyclictest0-21swapper/311:49:303
183219999,0cyclictest0-21swapper/311:40:333
183219998,1cyclictest41-21ksoftirqd/309:45:153
183219997,1cyclictest41-21ksoftirqd/310:33:013
183219997,1cyclictest41-21ksoftirqd/309:09:353
183219995,1cyclictest0-21swapper/310:20:413
183219994,4cyclictest28957-21systemd-cgroups10:00:433
183219993,3cyclictest721-21dbus-daemon09:50:423
183219990,9cyclictest0-21swapper/309:26:033
183219990,5cyclictest15178-21sshd09:42:173
183069998,1cyclictest25-21ksoftirqd/110:26:011
183069997,1cyclictest25-21ksoftirqd/112:10:401
183069997,1cyclictest25-21ksoftirqd/111:05:521
183069994,3cyclictest19701-21sshd11:10:591
183069994,3cyclictest19701-21sshd11:10:591
183069991,4cyclictest10827-21sshd09:06:231
183069990,9cyclictest0-21swapper/112:25:181
182989999,0cyclictest0-21swapper/011:30:380
182989998,1cyclictest9-21ksoftirqd/012:26:510
182989998,1cyclictest9-21ksoftirqd/009:18:120
182989997,1cyclictest9-21ksoftirqd/011:45:230
182989997,1cyclictest9-21ksoftirqd/009:10:100
182989991,7cyclictest21057-21sshd11:13:060
182989991,7cyclictest21057-21sshd11:13:060
182989990,9cyclictest0-21swapper/012:02:000
182989990,9cyclictest0-21swapper/008:10:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional