You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 23:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Aug 13, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
95142940,0sleep30-21swapper/312:28:353
67482890,0sleep00-21swapper/012:32:010
284102890,0sleep1241ktimersoftd/111:00:471
284102890,0sleep1241ktimersoftd/111:00:471
235692880,0sleep7711rcuc/710:42:197
29982840,0sleep20-21swapper/209:17:482
135662810,0sleep40-21swapper/411:48:564
135662810,0sleep40-21swapper/411:48:564
130652710,1sleep112457-21sshd11:14:251
32942700,0sleep10-21swapper/109:19:401
273342700,0sleep10-21swapper/110:18:581
1931026049,8sleep30-21swapper/307:03:303
319872540,0sleep30-21swapper/309:21:103
1917025127,8sleep60-21swapper/607:01:326
151272510,0sleep50-21swapper/512:30:465
1944825026,8sleep00-21swapper/007:05:270
160962490,1sleep516098-21bash09:20:245
317542480,0sleep631732-21sshd10:30:096
308072480,0sleep60-21swapper/610:55:326
11172480,0sleep60-21swapper/611:40:576
33292470,0sleep70-21swapper/709:41:167
1928024735,9sleep40-21swapper/407:03:074
46082460,0sleep70-21swapper/712:21:027
34762460,2sleep41964299cyclictest11:31:584
165752460,0sleep60-21swapper/611:47:146
165752460,0sleep60-21swapper/611:47:146
94092450,2sleep51965199cyclictest10:50:425
54192450,0sleep50-21swapper/510:55:555
1944424534,8sleep50-21swapper/507:05:245
126622450,1sleep712660-21bash10:12:407
150202440,2sleep01960999cyclictest11:14:320
130602440,0sleep60-21swapper/612:32:236
82472430,0sleep50-21swapper/512:33:585
53842430,2sleep41964299cyclictest12:04:504
244022430,0sleep60-21swapper/612:04:046
242782430,0sleep50-21swapper/511:29:355
220582430,0sleep20-21swapper/211:42:052
166432430,0sleep3401ktimersoftd/309:27:343
62432420,0sleep00-21swapper/010:57:420
28752420,0sleep50-21swapper/511:57:225
28752420,0sleep50-21swapper/511:57:225
256402420,1sleep125630-21sshd11:31:231
229472420,0sleep50-21swapper/512:16:365
1915824230,9sleep70-21swapper/707:01:257
51242410,0sleep70-21swapper/711:44:507
307652410,0sleep30-21swapper/312:31:323
28602410,0sleep20-21swapper/211:31:562
201722410,0sleep20-21swapper/210:09:302
171102410,1sleep417111-21sshd09:15:024
66652400,0sleep70-21swapper/709:30:437
214832400,0sleep40-21swapper/410:24:064
79042390,0sleep00-21swapper/009:39:490
290462390,0sleep40-21swapper/410:33:354
1938523928,8sleep20-21swapper/207:04:332
7722380,0sleep50-21swapper/508:25:465
1924123827,8sleep10-21swapper/107:02:321
131112380,0sleep50-21swapper/512:10:435
104262380,1sleep710427-21grepconf.sh11:59:407
104262380,1sleep710427-21grepconf.sh11:59:407
201012320,0sleep70-21swapper/711:31:057
281772280,0sleep00-21swapper/011:06:070
281772280,0sleep00-21swapper/011:06:070
111412270,0sleep70-21swapper/712:34:087
1964299247,3cyclictest49-21ksoftirqd/410:06:344
1964299204,1cyclictest49-21ksoftirqd/409:46:184
19642992017,2cyclictest49-21ksoftirqd/410:05:174
19642992017,1cyclictest49-21ksoftirqd/412:20:044
1961699206,3cyclictest25-21ksoftirqd/111:36:551
1961699203,1cyclictest25-21ksoftirqd/110:38:221
19616992018,1cyclictest25-21ksoftirqd/110:41:001
19616992010,3cyclictest25-21ksoftirqd/111:41:051
19651991917,1cyclictest57-21ksoftirqd/509:50:575
19651991917,1cyclictest57-21ksoftirqd/509:12:375
1964299194,3cyclictest49-21ksoftirqd/411:00:004
1964299194,3cyclictest49-21ksoftirqd/409:23:174
1964299192,3cyclictest49-21ksoftirqd/411:21:484
1964299192,3cyclictest49-21ksoftirqd/411:19:224
19642991916,2cyclictest49-21ksoftirqd/411:52:574
19642991916,1cyclictest49-21ksoftirqd/411:56:084
19642991916,1cyclictest49-21ksoftirqd/411:56:084
19642991915,1cyclictest49-21ksoftirqd/410:46:004
1961699194,2cyclictest25-21ksoftirqd/109:49:111
19616991914,3cyclictest25-21ksoftirqd/112:22:131
1964299186,3cyclictest49-21ksoftirqd/411:28:374
1964299184,3cyclictest49-21ksoftirqd/410:10:594
19642991816,1cyclictest49-21ksoftirqd/409:54:144
19642991816,1cyclictest49-21ksoftirqd/409:34:214
19642991815,3cyclictest49-21ksoftirqd/410:37:224
19642991813,3cyclictest49-21ksoftirqd/411:06:534
19642991813,3cyclictest49-21ksoftirqd/411:06:534
1964299181,3cyclictest49-21ksoftirqd/409:41:064
1964299181,1cyclictest49-21ksoftirqd/412:21:084
1964299181,1cyclictest49-21ksoftirqd/411:02:514
1964299181,1cyclictest49-21ksoftirqd/411:02:514
1961699188,3cyclictest25-21ksoftirqd/111:16:241
1961699187,3cyclictest25-21ksoftirqd/112:26:401
1961699187,3cyclictest25-21ksoftirqd/112:18:281
1961699185,1cyclictest25-21ksoftirqd/112:02:301
19616991816,1cyclictest25-21ksoftirqd/112:31:111
19616991814,1cyclictest25-21ksoftirqd/111:25:251
1965199175,1cyclictest57-21ksoftirqd/511:15:275
19651991716,1cyclictest57-21ksoftirqd/511:17:255
19651991712,2cyclictest57-21ksoftirqd/510:01:025
1965199170,3cyclictest1-21systemd10:16:055
1964299176,1cyclictest49-21ksoftirqd/411:36:354
1964299175,1cyclictest49-21ksoftirqd/412:30:594
1964299172,2cyclictest49-21ksoftirqd/409:39:214
19642991716,1cyclictest49-21ksoftirqd/410:51:244
19642991715,1cyclictest49-21ksoftirqd/412:09:234
19642991715,1cyclictest49-21ksoftirqd/410:19:154
19642991715,1cyclictest49-21ksoftirqd/409:58:174
19642991713,3cyclictest49-21ksoftirqd/410:28:514
1961699179,4cyclictest25-21ksoftirqd/110:28:151
1961699178,1cyclictest25-21ksoftirqd/109:12:341
1961699175,3cyclictest25-21ksoftirqd/109:27:151
1961699173,4cyclictest25-21ksoftirqd/110:15:301
19616991716,1cyclictest25-21ksoftirqd/112:06:341
19616991716,1cyclictest25-21ksoftirqd/110:06:081
19616991716,1cyclictest25-21ksoftirqd/109:44:191
19616991715,1cyclictest25-21ksoftirqd/112:00:131
19616991715,1cyclictest25-21ksoftirqd/112:00:131
19616991715,1cyclictest25-21ksoftirqd/110:21:531
19616991715,1cyclictest25-21ksoftirqd/110:02:381
19616991715,1cyclictest25-21ksoftirqd/109:36:021
19616991715,1cyclictest25-21ksoftirqd/109:30:591
19616991714,1cyclictest25-21ksoftirqd/111:46:331
19616991714,1cyclictest25-21ksoftirqd/111:46:331
19616991713,3cyclictest25-21ksoftirqd/111:26:161
19616991713,1cyclictest25-21ksoftirqd/109:53:061
19616991712,2cyclictest25-21ksoftirqd/110:51:431
19658991612,1cyclictest65-21ksoftirqd/609:53:066
1965199162,1cyclictest131rcu_sched11:51:045
19651991614,1cyclictest57-21ksoftirqd/511:24:335
19651991614,1cyclictest57-21ksoftirqd/511:03:285
19651991614,1cyclictest57-21ksoftirqd/511:03:285
19651991613,2cyclictest57-21ksoftirqd/510:00:425
19651991613,1cyclictest57-21ksoftirqd/509:36:205
1964299165,2cyclictest49-21ksoftirqd/412:29:304
19642991614,1cyclictest49-21ksoftirqd/412:10:564
19642991614,1cyclictest49-21ksoftirqd/410:41:004
19642991612,1cyclictest49-21ksoftirqd/411:41:044
19642991611,4cyclictest49-21ksoftirqd/409:20:384
1964299161,1cyclictest131rcu_sched09:25:584
19616991614,1cyclictest25-21ksoftirqd/111:52:431
19616991614,1cyclictest25-21ksoftirqd/111:06:471
19616991614,1cyclictest25-21ksoftirqd/111:06:471
19616991614,1cyclictest25-21ksoftirqd/110:46:081
19616991614,1cyclictest25-21ksoftirqd/110:35:031
19616991614,1cyclictest25-21ksoftirqd/109:23:021
19616991612,1cyclictest25-21ksoftirqd/112:12:261
1961699161,1cyclictest131rcu_sched09:56:191
1961699161,1cyclictest121rcu_preempt10:59:041
83412150,0sleep30-21swapper/311:08:423
83412150,0sleep30-21swapper/311:08:423
19658991513,1cyclictest65-21ksoftirqd/611:58:076
19658991513,1cyclictest65-21ksoftirqd/611:58:076
19658991513,1cyclictest65-21ksoftirqd/610:57:566
19651991514,1cyclictest57-21ksoftirqd/509:33:065
19651991512,1cyclictest464-21systemd-journal10:06:045
19642991513,1cyclictest49-21ksoftirqd/409:07:384
1964299150,1cyclictest121rcu_preempt11:11:514
1962399159,5cyclictest33-21ksoftirqd/211:29:502
1961699150,1cyclictest0-21swapper/109:06:061
64952140,0sleep30-21swapper/311:50:233
64952140,0sleep30-21swapper/311:50:233
64442140,0sleep00-21swapper/009:45:090
53532140,0sleep2321ktimersoftd/208:31:042
282362140,2sleep21962399cyclictest09:30:062
19658991413,1cyclictest65-21ksoftirqd/612:18:476
19658991412,2cyclictest65-21ksoftirqd/611:15:596
19658991412,1cyclictest65-21ksoftirqd/610:47:246
19658991412,1cyclictest65-21ksoftirqd/610:22:256
19658991412,1cyclictest65-21ksoftirqd/609:12:556
1965199148,2cyclictest57-21ksoftirqd/509:05:545
19651991412,2cyclictest57-21ksoftirqd/511:33:495
19651991412,1cyclictest57-21ksoftirqd/511:48:215
19651991412,1cyclictest57-21ksoftirqd/511:48:215
19651991412,1cyclictest57-21ksoftirqd/511:37:305
19651991412,1cyclictest57-21ksoftirqd/510:52:285
19651991412,1cyclictest57-21ksoftirqd/510:31:025
19651991412,1cyclictest57-21ksoftirqd/510:11:245
19651991412,1cyclictest57-21ksoftirqd/509:21:305
19651991411,3cyclictest57-21ksoftirqd/512:03:125
19651991410,3cyclictest57-21ksoftirqd/510:43:165
19651991410,1cyclictest57-21ksoftirqd/511:06:005
19651991410,1cyclictest57-21ksoftirqd/511:06:005
19651991410,1cyclictest57-21ksoftirqd/510:29:425
1965199141,1cyclictest121rcu_preempt09:28:555
1965199140,2cyclictest121rcu_preempt10:35:595
1965199140,14cyclictest15027-21kworker/5:009:49:205
1965199140,13cyclictest2608-21kworker/5:212:25:125
1965199140,13cyclictest19220-21kworker/5:112:11:135
19631991412,1cyclictest41-21ksoftirqd/311:44:253
19631991412,1cyclictest41-21ksoftirqd/311:03:273
19631991412,1cyclictest41-21ksoftirqd/311:03:273
19609991412,1cyclictest9-21ksoftirqd/011:28:560
160082140,1sleep615956-21systemd11:07:176
160082140,1sleep615956-21systemd11:07:176
114662140,1sleep557-21ksoftirqd/511:45:125
203232130,0sleep7711rcuc/709:55:027
1966699135,7cyclictest709-21systemd-logind12:07:317
1966699133,4cyclictest18911-21sshd10:05:497
19666991311,1cyclictest721-21dbus-daemon09:56:267
19658991312,1cyclictest65-21ksoftirqd/610:10:596
19658991311,1cyclictest65-21ksoftirqd/610:09:026
19658991311,1cyclictest65-21ksoftirqd/609:44:346
19658991310,2cyclictest65-21ksoftirqd/609:58:386
1965899130,12cyclictest25843-21sshd11:31:236
19651991311,1cyclictest57-21ksoftirqd/510:23:235
19651991311,1cyclictest57-21ksoftirqd/509:44:005
1963199132,5cyclictest857-21polkitd09:10:393
19631991311,1cyclictest41-21ksoftirqd/311:59:153
19631991311,1cyclictest41-21ksoftirqd/311:59:153
19631991311,1cyclictest41-21ksoftirqd/311:35:003
1962399139,3cyclictest33-21ksoftirqd/210:57:242
19623991311,1cyclictest33-21ksoftirqd/210:35:342
19623991310,3cyclictest13550irq/24-ahci[00011:04:322
19623991310,3cyclictest13550irq/24-ahci[00011:04:322
1960999138,3cyclictest9-21ksoftirqd/010:29:350
19609991311,1cyclictest9-21ksoftirqd/009:50:180
162142130,0sleep70-21swapper/711:05:347
162142130,0sleep70-21swapper/711:05:347
113212130,0sleep70-21swapper/709:32:437
313462120,0sleep20-21swapper/211:39:012
268332120,0sleep70-21swapper/709:10:087
1966699122,4cyclictest6003-21bash10:54:067
1966699122,4cyclictest26730-21sshd11:51:257
1966699122,4cyclictest24223-21sshd11:18:397
1966699122,4cyclictest15053-21sshd10:56:217
1966699122,4cyclictest0-21swapper/712:17:117
19666991210,1cyclictest73-21ksoftirqd/711:24:037
1966699120,11cyclictest5434-21kworker/7:212:27:417
1966699120,11cyclictest10602-21sshd11:26:567
1966699120,11cyclictest0-21swapper/711:09:357
1966699120,11cyclictest0-21swapper/711:09:357
1965899129,2cyclictest65-21ksoftirqd/611:12:586
1965899128,3cyclictest65-21ksoftirqd/610:31:376
1965899128,3cyclictest65-21ksoftirqd/610:18:576
19658991210,2cyclictest65-21ksoftirqd/612:26:426
19658991210,1cyclictest65-21ksoftirqd/612:10:556
19658991210,1cyclictest65-21ksoftirqd/611:51:026
19658991210,1cyclictest65-21ksoftirqd/611:04:206
19658991210,1cyclictest65-21ksoftirqd/611:04:206
19658991210,1cyclictest65-21ksoftirqd/609:38:546
19658991210,1cyclictest65-21ksoftirqd/609:25:476
19658991210,1cyclictest65-21ksoftirqd/609:23:226
1963199123,8cyclictest21522-21grepconf.sh12:20:143
1963199122,4cyclictest5792-21sshd09:36:023
1963199122,4cyclictest18638-21sshd10:58:253
1963199120,2cyclictest7803-21sshd09:41:323
1963199120,11cyclictest18332-21kworker/3:310:24:553
1962399122,6cyclictest0-21swapper/212:21:372
19623991211,1cyclictest33-21ksoftirqd/210:40:212
19623991211,1cyclictest33-21ksoftirqd/210:20:572
19623991210,1cyclictest33-21ksoftirqd/211:18:372
19623991210,1cyclictest33-21ksoftirqd/210:13:212
1962399120,11cyclictest25496-21sshd11:15:082
1962399120,11cyclictest1-21systemd12:10:472
1960999129,2cyclictest30392-21bash09:19:210
1960999129,2cyclictest1-21systemd12:12:090
1960999125,6cyclictest24450-21sshd10:00:420
1960999122,4cyclictest721-21dbus-daemon12:00:340
1960999122,4cyclictest721-21dbus-daemon12:00:340
1960999122,4cyclictest604-21sshd10:41:030
1960999122,4cyclictest0-21swapper/012:05:120
19609991211,1cyclictest9-21ksoftirqd/010:18:530
19609991210,1cyclictest9-21ksoftirqd/010:11:230
19609991210,1cyclictest9-21ksoftirqd/009:25:000
19609991210,1cyclictest0-21swapper/010:34:330
1960999120,1cyclictest0-21swapper/011:36:490
17302120,1sleep61729-21bash09:17:446
284792110,0sleep30-21swapper/309:51:453
1966699119,1cyclictest73-21ksoftirqd/710:34:527
1966699119,1cyclictest73-21ksoftirqd/710:25:287
1966699119,1cyclictest73-21ksoftirqd/710:02:237
1966699119,1cyclictest73-21ksoftirqd/709:21:497
1966699119,1cyclictest73-21ksoftirqd/709:13:397
1966699113,2cyclictest25198-21systemd10:17:007
1966699111,4cyclictest8166-21systemd-cgroups12:12:107
1966699111,4cyclictest20268-21sshd10:47:357
1966699111,4cyclictest12197-21sshd09:16:297
1966699111,4cyclictest0-21swapper/711:36:407
1966699110,5cyclictest15925-21sshd09:38:257
1966699110,5cyclictest12523-21sshd09:47:157
1966699110,11cyclictest3063-21kworker/7:512:03:237
1966699110,1cyclictest26759-21sshd10:29:517
1966699110,1cyclictest0-21swapper/711:11:487
1965899119,1cyclictest65-21ksoftirqd/611:37:186
1965899119,1cyclictest65-21ksoftirqd/610:37:206
1965899119,1cyclictest65-21ksoftirqd/609:49:166
1965899118,3cyclictest65-21ksoftirqd/611:29:356
1965899118,1cyclictest65-21ksoftirqd/611:21:526
1965899114,4cyclictest721-21dbus-daemon12:06:206
1965899113,5cyclictest12317-21grep12:23:186
1965899110,1cyclictest29941-21sshd09:33:476
19642991110,1cyclictest7061-21kworker/4:208:25:584
19642991110,1cyclictest24309-21kworker/4:007:22:004
1963199119,1cyclictest41-21ksoftirqd/310:05:463
1963199119,1cyclictest41-21ksoftirqd/309:05:463
1963199113,7cyclictest9964-21sshd10:37:573
1963199112,4cyclictest721-21dbus-daemon10:31:523
19631991110,1cyclictest41-21ksoftirqd/312:03:413
19631991110,1cyclictest0-21swapper/309:32:333
1963199111,4cyclictest25933-21sshd11:22:213
1963199110,11cyclictest31326-21kworker/3:211:19:333
1963199110,11cyclictest30442-21kworker/3:111:38:463
1963199110,11cyclictest12995-21kworker/3:010:48:423
1963199110,11cyclictest0-21swapper/310:11:323
1963199110,10cyclictest12995-21kworker/3:010:41:143
1962399119,1cyclictest33-21ksoftirqd/212:16:212
1962399119,1cyclictest13369-21systemd09:07:072
1962399116,2cyclictest33-21ksoftirqd/209:57:202
1962399116,1cyclictest33-21ksoftirqd/209:47:312
1962399113,4cyclictest5805-21grepconf.sh10:01:212
1962399112,6cyclictest5029-21sshd09:45:052
1962399112,6cyclictest1844-21nfsd12:25:562
19623991110,1cyclictest33-21ksoftirqd/212:06:032
19623991110,1cyclictest33-21ksoftirqd/211:56:012
19623991110,1cyclictest33-21ksoftirqd/211:56:012
19623991110,1cyclictest33-21ksoftirqd/211:24:232
1962399110,11cyclictest23856-21kworker/2:409:34:332
1962399110,11cyclictest0-21swapper/210:47:232
1961699119,1cyclictest25-21ksoftirqd/108:50:461
19616991111,0cyclictest24394-21kworker/1:108:20:411
19616991110,1cyclictest17935-21kworker/1:207:30:251
1960999119,1cyclictest9-21ksoftirqd/011:34:200
1960999119,1cyclictest9-21ksoftirqd/010:23:280
1960999119,1cyclictest721-21dbus-daemon12:16:150
1960999119,1cyclictest10871-21kworker/u16:409:27:140
1960999119,1cyclictest0-21swapper/010:00:490
1960999112,4cyclictest2235-21sshd09:52:060
1960999112,4cyclictest1844-21nfsd11:22:520
1960999112,4cyclictest15630-21sshd09:32:580
19609991110,1cyclictest8856-21sshd10:54:160
19609991110,1cyclictest0-21swapper/011:48:390
19609991110,1cyclictest0-21swapper/011:48:390
1966699102,4cyclictest3103-21sshd10:37:337
1966699100,4cyclictest0-21swapper/711:45:527
1966699100,4cyclictest0-21swapper/711:45:527
1965899109,1cyclictest65-21ksoftirqd/610:41:016
1965899106,3cyclictest65-21ksoftirqd/609:09:016
1964299109,1cyclictest7061-21kworker/4:208:19:324
1964299108,1cyclictest24309-21kworker/4:007:36:024
1963199109,1cyclictest41-21ksoftirqd/310:06:243
1963199109,1cyclictest0-21swapper/312:09:533
1963199108,1cyclictest41-21ksoftirqd/309:18:133
1963199101,4cyclictest709-21systemd-logind10:16:293
1963199101,4cyclictest5981-21bash09:12:323
1963199101,4cyclictest32488-21grepconf.sh09:57:273
1963199101,4cyclictest24112-21sshd10:26:023
1963199100,1cyclictest19717-21sshd12:21:523
1962399109,1cyclictest33-21ksoftirqd/210:28:292
1962399108,2cyclictest33-21ksoftirqd/210:55:142
1962399105,4cyclictest13550irq/24-ahci[00010:43:042
1962399104,3cyclictest857-21polkitd09:11:572
1962399102,5cyclictest6735-21sshd09:37:542
1962399101,6cyclictest16919-21sshd10:20:132
1962399101,5cyclictest31361-21sshd12:02:362
1962399101,3cyclictest0-21swapper/211:47:102
1962399101,3cyclictest0-21swapper/211:47:102
1962399100,9cyclictest24915-21kworker/2:309:21:012
1962399100,10cyclictest0-21swapper/209:50:472
1961699109,1cyclictest25-21ksoftirqd/107:50:471
1960999109,1cyclictest0-21swapper/012:08:030
1960999109,1cyclictest0-21swapper/009:14:280
1960999106,4cyclictest0-21swapper/010:07:110
1960999104,2cyclictest25252-21systemd11:20:350
1960999103,1cyclictest5899-21sshd10:35:580
1960999102,2cyclictest31640-21grep11:04:350
1960999102,2cyclictest31640-21grep11:04:350
1960999100,4cyclictest20059-21sshd09:09:450
196589992,4cyclictest28804-21systemd10:00:566
196519990,3cyclictest0-21swapper/508:08:055
196519990,3cyclictest0-21swapper/507:14:195
196429998,1cyclictest7061-21kworker/4:208:22:404
196429998,1cyclictest7061-21kworker/4:207:49:444
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional