You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 23:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Jul 02, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
42802850,0sleep233-21ksoftirqd/211:00:062
178802610,0sleep00-21swapper/011:14:220
20772530,1sleep52083-21fschecks_count12:27:315
1901824925,9sleep30-21swapper/307:04:403
141832490,0sleep10-21swapper/112:22:311
71602480,0sleep40-21swapper/412:35:314
276782470,1sleep727676-21grepconf.sh12:30:547
167332470,0sleep30-21swapper/311:53:173
167332470,0sleep30-21swapper/311:53:173
324132460,2sleep31936999cyclictest12:19:453
64442450,0sleep20-21swapper/210:35:152
39542450,0sleep70-21swapper/712:12:047
296652450,0sleep20-21swapper/209:33:002
303892440,0sleep0101ktimersoftd/010:15:430
303892440,0sleep0101ktimersoftd/010:15:430
213262440,0sleep30-21swapper/310:40:133
1890224424,16sleep10-21swapper/107:03:021
27412430,0sleep00-21swapper/011:34:480
222962430,0sleep40-21swapper/409:57:374
221642430,0sleep70-21swapper/709:30:417
134072430,0sleep30-21swapper/311:10:163
224452420,1sleep022446-21bash09:30:420
199362420,0sleep20-21swapper/211:43:392
1892624228,10sleep70-21swapper/707:03:247
32982410,0sleep30-21swapper/311:50:293
310632410,0sleep50-21swapper/510:52:085
230252410,0sleep623023-21systemd-cgroups11:51:446
1915024129,8sleep50-21swapper/507:06:345
72632400,0sleep20-21swapper/212:27:452
303152400,0sleep20-21swapper/210:23:142
229322400,0sleep70-21swapper/711:12:457
237032390,0sleep60-21swapper/610:55:306
234292390,0sleep00-21swapper/009:11:520
212952390,0sleep50-21swapper/510:01:225
1913623926,9sleep00-21swapper/007:06:210
1905023928,8sleep40-21swapper/407:05:054
1894523927,8sleep60-21swapper/607:03:396
1674023927,8sleep20-21swapper/207:02:232
159432390,1sleep315941-21sshd11:29:473
124072380,0sleep00-21swapper/012:26:140
99942370,0sleep30-21swapper/310:43:173
5062350,2sleep71940399cyclictest11:54:267
5062350,2sleep71940399cyclictest11:54:267
1936199259,3cyclictest33-21ksoftirqd/212:08:592
19369992411,1cyclictest41-21ksoftirqd/309:52:193
1936999228,3cyclictest41-21ksoftirqd/309:27:323
1936999228,3cyclictest41-21ksoftirqd/309:12:223
1936199220,3cyclictest752-21snmpd10:55:012
1936999215,3cyclictest41-21ksoftirqd/312:01:493
19369992111,3cyclictest41-21ksoftirqd/311:15:563
1936999211,4cyclictest41-21ksoftirqd/311:42:353
1936199217,3cyclictest33-21ksoftirqd/210:05:032
1936199217,3cyclictest33-21ksoftirqd/209:51:502
19361992110,3cyclictest33-21ksoftirqd/212:02:322
326162200,0sleep00-21swapper/010:32:490
1939599204,1cyclictest65-21ksoftirqd/609:59:166
19395992016,3cyclictest65-21ksoftirqd/611:36:566
19395992012,4cyclictest65-21ksoftirqd/609:31:016
1936999209,1cyclictest41-21ksoftirqd/311:37:343
1936999207,3cyclictest41-21ksoftirqd/310:12:213
1936999207,3cyclictest41-21ksoftirqd/310:12:213
1936999207,1cyclictest41-21ksoftirqd/309:39:033
19369992012,3cyclictest41-21ksoftirqd/311:33:273
1936199208,3cyclictest33-21ksoftirqd/211:18:232
1936199207,3cyclictest33-21ksoftirqd/209:30:222
1936199206,3cyclictest33-21ksoftirqd/212:19:542
1936199206,3cyclictest33-21ksoftirqd/212:13:082
1936199200,6cyclictest721-21dbus-daemon12:36:312
1936199200,5cyclictest19957-21sshd11:32:052
19395991913,3cyclictest65-21ksoftirqd/612:04:086
1936999199,3cyclictest41-21ksoftirqd/312:28:403
1936999197,2cyclictest41-21ksoftirqd/312:35:073
1936999197,1cyclictest41-21ksoftirqd/310:26:103
1936999195,2cyclictest41-21ksoftirqd/310:52:293
19369991918,1cyclictest391rcuc/311:05:243
19369991918,1cyclictest391rcuc/309:46:103
19369991912,3cyclictest41-21ksoftirqd/310:30:493
19369991910,3cyclictest41-21ksoftirqd/311:01:003
19369991910,3cyclictest41-21ksoftirqd/310:21:093
1936999191,3cyclictest41-21ksoftirqd/309:11:163
1936999191,3cyclictest18765-21sshd09:36:163
1936199198,1cyclictest33-21ksoftirqd/209:54:262
1936199197,3cyclictest33-21ksoftirqd/211:49:552
1936199197,2cyclictest33-21ksoftirqd/209:12:322
1936199196,3cyclictest33-21ksoftirqd/210:43:522
1936199196,3cyclictest33-21ksoftirqd/209:58:222
1936199192,2cyclictest14313-21bash11:04:382
1936199190,5cyclictest2177-21sshd09:42:552
1936199190,3cyclictest10654-21sshd10:10:312
1939599185,1cyclictest65-21ksoftirqd/609:18:556
1939599183,3cyclictest65-21ksoftirqd/610:11:086
19395991816,1cyclictest65-21ksoftirqd/612:28:176
19395991816,1cyclictest65-21ksoftirqd/609:10:056
19395991815,1cyclictest65-21ksoftirqd/610:40:196
19395991814,3cyclictest65-21ksoftirqd/609:16:176
19395991813,3cyclictest65-21ksoftirqd/612:18:506
19395991813,3cyclictest65-21ksoftirqd/609:55:266
1936999188,3cyclictest41-21ksoftirqd/312:12:283
1936999188,3cyclictest41-21ksoftirqd/309:20:163
1936999187,3cyclictest41-21ksoftirqd/309:55:403
1936999185,3cyclictest41-21ksoftirqd/310:03:103
19369991815,1cyclictest41-21ksoftirqd/309:23:303
1936199187,3cyclictest33-21ksoftirqd/211:56:042
1936199187,3cyclictest33-21ksoftirqd/211:56:042
1936199187,3cyclictest33-21ksoftirqd/211:15:222
1936199187,3cyclictest33-21ksoftirqd/210:28:202
1936199187,2cyclictest33-21ksoftirqd/209:42:032
1936199186,3cyclictest33-21ksoftirqd/211:25:152
1936199186,1cyclictest33-21ksoftirqd/210:19:452
19361991810,3cyclictest33-21ksoftirqd/212:25:232
1936199180,1cyclictest0-21swapper/210:14:042
1936199180,1cyclictest0-21swapper/210:14:042
118192180,0sleep70-21swapper/710:41:377
106682180,0sleep50-21swapper/511:43:025
1939599177,1cyclictest65-21ksoftirqd/610:28:546
1939599174,1cyclictest65-21ksoftirqd/611:43:196
19395991716,1cyclictest65-21ksoftirqd/612:10:316
19395991715,1cyclictest65-21ksoftirqd/611:10:216
19395991715,1cyclictest65-21ksoftirqd/610:51:416
19395991715,1cyclictest65-21ksoftirqd/609:23:216
19395991712,3cyclictest65-21ksoftirqd/612:16:196
19387991712,1cyclictest57-21ksoftirqd/509:48:085
1936999178,3cyclictest41-21ksoftirqd/311:23:073
1936999176,3cyclictest41-21ksoftirqd/312:23:143
1936999176,3cyclictest41-21ksoftirqd/311:20:373
1936999176,3cyclictest41-21ksoftirqd/310:34:263
1936999176,1cyclictest41-21ksoftirqd/312:03:583
1936999175,3cyclictest41-21ksoftirqd/309:58:543
1936999171,3cyclictest0-21swapper/310:51:093
1936999171,2cyclictest0-21swapper/312:08:493
1936999170,3cyclictest41-21ksoftirqd/310:07:313
1936199179,3cyclictest33-21ksoftirqd/211:08:202
1936199177,3cyclictest33-21ksoftirqd/211:32:362
1936199177,3cyclictest33-21ksoftirqd/209:21:172
19361991710,4cyclictest33-21ksoftirqd/207:27:192
1936199170,5cyclictest709-21systemd-logind11:39:442
1936199170,5cyclictest27538-21sshd10:48:032
1936199170,5cyclictest10755-21grep10:37:332
1936199170,3cyclictest709-21systemd-logind09:22:262
249182160,0sleep00-21swapper/010:40:260
1939599162,1cyclictest65-21ksoftirqd/611:55:116
1939599162,1cyclictest65-21ksoftirqd/611:55:116
19395991615,1cyclictest65-21ksoftirqd/612:23:066
19395991614,1cyclictest65-21ksoftirqd/611:58:396
19395991614,1cyclictest65-21ksoftirqd/611:32:106
19395991614,1cyclictest65-21ksoftirqd/611:25:206
19395991614,1cyclictest65-21ksoftirqd/611:15:346
19395991612,3cyclictest65-21ksoftirqd/610:32:326
19395991612,3cyclictest65-21ksoftirqd/609:33:236
19395991612,1cyclictest65-21ksoftirqd/611:17:306
19395991612,1cyclictest65-21ksoftirqd/610:04:446
19395991611,3cyclictest65-21ksoftirqd/610:43:166
1939599161,4cyclictest65-21ksoftirqd/609:42:386
1939599161,1cyclictest131rcu_sched11:39:526
1939599161,1cyclictest131rcu_sched10:12:216
1939599161,1cyclictest131rcu_sched10:12:216
1939599160,3cyclictest121rcu_preempt09:51:116
19387991614,2cyclictest7018-21sshd12:22:075
19387991612,3cyclictest57-21ksoftirqd/510:15:015
19387991612,3cyclictest57-21ksoftirqd/510:15:015
1936199167,3cyclictest33-21ksoftirqd/209:08:512
1935399160,1cyclictest0-21swapper/111:03:101
83052150,2sleep11935399cyclictest11:15:431
79132150,1sleep77908-21sshd09:26:007
62632150,1sleep125-21ksoftirqd/112:35:281
19395991513,1cyclictest65-21ksoftirqd/612:32:326
19395991513,1cyclictest65-21ksoftirqd/611:01:086
19395991513,1cyclictest65-21ksoftirqd/610:24:406
19395991513,1cyclictest65-21ksoftirqd/610:17:396
19395991513,1cyclictest65-21ksoftirqd/609:38:206
19395991512,2cyclictest65-21ksoftirqd/611:02:346
19387991513,1cyclictest709-21systemd-logind10:36:065
19387991511,3cyclictest57-21ksoftirqd/509:26:095
1938799150,14cyclictest24661-21kworker/5:109:37:385
1935399150,2cyclictest1751-21systemd12:11:561
1935399150,1cyclictest28324-21systemd11:56:081
1935399150,1cyclictest28324-21systemd11:56:081
1934599159,2cyclictest10166-21kill11:43:000
1934599153,11cyclictest464-21systemd-journal09:33:020
188552150,0sleep50-21swapper/510:03:075
126622150,0sleep00-21swapper/010:45:230
19403991412,1cyclictest73-21ksoftirqd/710:20:227
19403991411,1cyclictest73-21ksoftirqd/710:24:277
19387991412,1cyclictest57-21ksoftirqd/511:49:485
19387991412,1cyclictest57-21ksoftirqd/511:03:265
19387991410,3cyclictest57-21ksoftirqd/511:24:415
19380991413,1cyclictest49-21ksoftirqd/410:37:424
1936199141,1cyclictest0-21swapper/211:57:302
1935399146,2cyclictest27576-21grepconf.sh09:25:151
161332140,1sleep416102-21sshd11:33:404
266262130,0sleep40-21swapper/411:57:514
243202130,0sleep70-21swapper/711:28:157
19403991310,1cyclictest73-21ksoftirqd/709:42:347
1938799139,3cyclictest57-21ksoftirqd/511:52:355
1938799139,3cyclictest57-21ksoftirqd/511:52:355
19387991312,1cyclictest57-21ksoftirqd/512:00:195
19387991311,2cyclictest18540-21sshd11:12:335
19387991311,1cyclictest57-21ksoftirqd/509:52:225
19387991310,1cyclictest57-21ksoftirqd/510:24:575
19380991312,1cyclictest49-21ksoftirqd/412:06:584
19380991311,1cyclictest49-21ksoftirqd/411:46:144
19380991311,1cyclictest49-21ksoftirqd/410:48:554
19380991311,1cyclictest49-21ksoftirqd/410:30:024
19380991311,1cyclictest4119-21sshd10:37:134
19380991310,2cyclictest721-21dbus-daemon10:57:194
1938099130,12cyclictest5189-21sshd12:27:394
1938099130,12cyclictest4385-21kworker/4:211:28:244
1935399135,2cyclictest24681-21id10:21:051
1935399135,2cyclictest12224-21sshd11:41:101
1935399135,2cyclictest11461-21grep10:58:371
1935399134,2cyclictest25074-21sshd10:34:261
1934599135,7cyclictest1680-21systemd10:11:560
19345991311,1cyclictest9-21ksoftirqd/010:59:200
136592130,1sleep557-21ksoftirqd/511:12:195
111722130,0sleep70-21swapper/711:02:287
302132120,1sleep09-21ksoftirqd/010:03:500
1940399129,3cyclictest73-21ksoftirqd/711:24:417
1940399128,1cyclictest73-21ksoftirqd/710:32:527
1940399127,3cyclictest73-21ksoftirqd/709:41:407
19403991210,1cyclictest73-21ksoftirqd/712:36:247
19403991210,1cyclictest73-21ksoftirqd/712:23:497
19403991210,1cyclictest73-21ksoftirqd/711:20:437
19403991210,1cyclictest73-21ksoftirqd/710:57:367
19403991210,1cyclictest73-21ksoftirqd/710:44:597
19403991210,1cyclictest73-21ksoftirqd/710:00:447
19403991210,1cyclictest73-21ksoftirqd/709:56:267
19403991210,1cyclictest73-21ksoftirqd/709:32:307
19403991210,1cyclictest73-21ksoftirqd/709:21:317
1940399120,11cyclictest709-21systemd-logind12:03:487
19387991211,1cyclictest57-21ksoftirqd/509:30:395
19387991210,1cyclictest57-21ksoftirqd/512:03:345
19387991210,1cyclictest57-21ksoftirqd/511:18:575
19387991210,1cyclictest57-21ksoftirqd/510:57:365
19387991210,1cyclictest57-21ksoftirqd/510:27:495
19387991210,1cyclictest57-21ksoftirqd/510:19:365
19387991210,1cyclictest57-21ksoftirqd/509:35:535
19387991210,1cyclictest57-21ksoftirqd/509:17:575
1938799120,12cyclictest24508-21kworker/5:211:39:415
1938799120,12cyclictest20182-21kworker/5:112:12:275
1938799120,11cyclictest30811-21systemd10:55:555
1938799120,11cyclictest30279-21kworker/5:411:36:015
1938799120,1cyclictest131rcu_sched09:12:405
1938099127,4cyclictest49-21ksoftirqd/409:41:374
19380991211,1cyclictest49-21ksoftirqd/409:34:414
19380991211,1cyclictest49-21ksoftirqd/409:21:124
19380991210,1cyclictest49-21ksoftirqd/412:22:374
19380991210,1cyclictest49-21ksoftirqd/411:19:314
19380991210,1cyclictest49-21ksoftirqd/409:54:114
19380991210,1cyclictest49-21ksoftirqd/409:47:184
19380991210,1cyclictest49-21ksoftirqd/409:28:294
19380991210,1cyclictest49-21ksoftirqd/409:22:524
19380991210,1cyclictest0-21swapper/411:24:274
19380991210,1cyclictest0-21swapper/409:07:264
1938099120,1cyclictest0-21swapper/412:10:074
1936999123,2cyclictest41-21ksoftirqd/308:57:203
1936199120,1cyclictest0-21swapper/208:52:192
1935399125,2cyclictest721-21dbus-daemon10:28:011
1935399122,4cyclictest1-21systemd10:49:051
19353991211,1cyclictest25-21ksoftirqd/112:18:151
1935399121,5cyclictest25244-21sd-pam12:05:351
1935399120,8cyclictest0-21swapper/111:43:401
1935399120,6cyclictest18119-21sshd09:40:061
1935399120,11cyclictest24219-21grepconf.sh11:57:431
1935399120,11cyclictest24049-21kworker/1:210:07:571
1935399120,11cyclictest21985-21kill12:13:001
1935399120,11cyclictest0-21swapper/110:04:031
1934599126,5cyclictest32341-21grepconf.sh11:58:120
1934599122,4cyclictest721-21dbus-daemon12:13:400
1934599122,4cyclictest6716-21grepconf.sh12:04:290
1934599122,4cyclictest31254-21sshd10:55:560
1934599122,4cyclictest19639-21sshd11:20:140
1934599122,4cyclictest18277-21systemd-cgroups10:24:280
19345991211,1cyclictest9-21ksoftirqd/009:48:320
1934599121,5cyclictest6063-21bash09:52:440
1934599120,11cyclictest6633-21systemd-cgroups12:27:420
1934599120,11cyclictest29420-21bash12:32:540
310782110,0sleep10-21swapper/109:27:231
1940399119,1cyclictest73-21ksoftirqd/712:20:557
1940399119,1cyclictest73-21ksoftirqd/711:48:437
1940399119,1cyclictest73-21ksoftirqd/711:40:037
1940399119,1cyclictest721-21dbus-daemon10:54:077
1940399118,1cyclictest73-21ksoftirqd/710:02:497
19403991110,1cyclictest73-21ksoftirqd/709:12:567
1940399110,1cyclictest0-21swapper/710:28:167
1939599119,1cyclictest65-21ksoftirqd/608:52:196
19395991110,1cyclictest65-21ksoftirqd/607:57:206
1938799119,1cyclictest57-21ksoftirqd/512:22:235
1938799119,1cyclictest57-21ksoftirqd/510:08:425
1938799119,1cyclictest57-21ksoftirqd/509:12:205
1938799119,1cyclictest5359-21iostat_ios07:37:355
1938799119,1cyclictest0-21swapper/509:44:305
1938799118,2cyclictest57-21ksoftirqd/510:45:555
19387991110,1cyclictest57-21ksoftirqd/512:07:305
19387991110,1cyclictest57-21ksoftirqd/511:29:285
1938099119,1cyclictest49-21ksoftirqd/412:21:504
1938099119,1cyclictest49-21ksoftirqd/411:40:414
1938099119,1cyclictest49-21ksoftirqd/411:12:364
1938099119,1cyclictest49-21ksoftirqd/411:11:394
1938099119,1cyclictest49-21ksoftirqd/411:05:554
1938099119,1cyclictest49-21ksoftirqd/410:08:054
1938099119,1cyclictest49-21ksoftirqd/409:13:094
1938099118,2cyclictest49-21ksoftirqd/411:47:484
1938099118,2cyclictest31587-21bash10:19:284
1938099118,2cyclictest13218-21systemd09:49:224
19380991110,1cyclictest49-21ksoftirqd/410:58:454
19380991110,1cyclictest49-21ksoftirqd/410:42:374
19380991110,1cyclictest49-21ksoftirqd/410:13:514
19380991110,1cyclictest49-21ksoftirqd/410:13:514
19380991110,1cyclictest49-21ksoftirqd/410:02:384
19380991110,1cyclictest15191-21kworker/u16:310:22:374
1936999114,1cyclictest41-21ksoftirqd/308:45:213
1936999114,1cyclictest41-21ksoftirqd/308:38:503
1936999114,1cyclictest41-21ksoftirqd/308:02:223
1936999114,1cyclictest41-21ksoftirqd/307:48:363
1936999114,1cyclictest41-21ksoftirqd/307:45:273
1936999114,1cyclictest41-21ksoftirqd/307:45:273
1936999114,1cyclictest41-21ksoftirqd/307:32:143
1936999114,1cyclictest41-21ksoftirqd/307:26:153
1936999114,1cyclictest41-21ksoftirqd/307:12:223
1936999114,1cyclictest41-21ksoftirqd/307:07:373
1936999114,1cyclictest41-21ksoftirqd/307:07:373
19361991110,1cyclictest33-21ksoftirqd/208:07:352
19361991110,1cyclictest33-21ksoftirqd/207:57:332
19361991110,1cyclictest33-21ksoftirqd/207:57:202
19361991110,1cyclictest33-21ksoftirqd/207:47:322
1935399119,1cyclictest1-21systemd09:43:431
1935399117,0cyclictest0-21swapper/109:32:311
1935399114,2cyclictest19957-21bash09:15:201
1935399113,2cyclictest859-21gdbus10:16:351
1935399113,2cyclictest859-21gdbus10:16:351
1935399113,2cyclictest16167-21grepconf.sh09:51:341
1935399110,5cyclictest857-21polkitd09:58:061
1935399110,11cyclictest7119-21kworker/1:311:28:431
1935399110,11cyclictest27257-21kworker/1:211:10:381
1935399110,11cyclictest24231-21kworker/1:309:11:191
1935399110,11cyclictest23303-21kworker/1:209:19:011
1934599119,1cyclictest9-21ksoftirqd/010:27:340
1934599114,4cyclictest6737-21sshd11:23:200
1934599113,7cyclictest22452-21systemd09:19:110
1934599113,7cyclictest13015-21kill11:41:130
1934599112,4cyclictest0-21swapper/009:57:240
1934599112,4cyclictest0-21swapper/009:13:540
1934599112,3cyclictest0-21swapper/012:09:150
19345991110,1cyclictest9-21ksoftirqd/012:18:050
19345991110,1cyclictest9-21ksoftirqd/010:47:410
1934599110,5cyclictest9930-21sshd09:26:080
1940399109,1cyclictest73-21ksoftirqd/709:09:487
1940399109,1cyclictest0-21swapper/711:35:317
1940399108,1cyclictest73-21ksoftirqd/711:08:337
1940399108,1cyclictest73-21ksoftirqd/710:48:157
1940399108,1cyclictest73-21ksoftirqd/710:12:317
1940399108,1cyclictest73-21ksoftirqd/710:12:317
1940399108,1cyclictest73-21ksoftirqd/710:09:377
1940399107,3cyclictest73-21ksoftirqd/709:50:177
1940399106,1cyclictest73-21ksoftirqd/712:16:127
1940399103,4cyclictest25936-21sshd11:44:037
1939599100,2cyclictest121rcu_preempt09:02:206
1939599100,2cyclictest121rcu_preempt07:27:196
1938799108,1cyclictest57-21ksoftirqd/510:39:515
1938799105,2cyclictest30869-21bash12:32:595
1938099108,1cyclictest49-21ksoftirqd/412:12:254
1938099107,2cyclictest49-21ksoftirqd/411:56:284
1938099107,2cyclictest49-21ksoftirqd/411:56:284
1936999103,1cyclictest41-21ksoftirqd/309:04:533
1936999103,1cyclictest41-21ksoftirqd/308:12:273
1936999103,1cyclictest41-21ksoftirqd/307:52:503
1936999101,3cyclictest25849-21diskstats07:17:323
1936999101,3cyclictest17153-21awk07:57:363
1936999101,3cyclictest0-21swapper/308:37:193
1936999101,2cyclictest0-21swapper/308:47:333
1936999101,1cyclictest18234-21expr08:57:323
1936999101,1cyclictest121rcu_preempt08:22:203
1936199109,1cyclictest33-21ksoftirqd/208:02:322
1936199109,1cyclictest33-21ksoftirqd/207:37:312
1936199109,1cyclictest33-21ksoftirqd/207:32:392
1936199104,3cyclictest33-21ksoftirqd/208:22:322
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional