You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-07 - 23:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sat Mar 07, 2026 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
266892920,1sleep126675-21bash10:22:171
103392860,1sleep7711rcuc/712:25:257
324262680,0sleep70-21swapper/709:56:447
306192610,0sleep10-21swapper/110:53:571
306192610,0sleep10-21swapper/110:53:571
66982590,12sleep687950irq/25-em1-rx-011:35:106
68322550,0sleep50-21swapper/511:16:435
230622530,2sleep21301099cyclictest12:24:162
256232510,0sleep30-21swapper/310:49:583
1253325025,8sleep40-21swapper/407:02:414
1253325025,8sleep40-21swapper/407:02:414
322392480,0sleep40-21swapper/410:11:314
209792470,1sleep220980-21bash11:04:312
156442470,0sleep60-21swapper/611:19:006
211032460,1sleep71305099cyclictest12:27:497
53492450,0sleep50-21swapper/510:26:375
269922450,0sleep426989-21sshd12:28:104
26652450,1sleep02643-21bash11:25:430
242332450,0sleep00-21swapper/011:39:530
172852450,0sleep30-21swapper/309:41:023
141452450,0sleep10-21swapper/110:40:031
128382450,0sleep70-21swapper/709:11:117
111542450,0sleep40-21swapper/410:45:274
22102440,0sleep30-21swapper/307:42:273
141052440,0sleep3686-21dbus-daemon09:52:003
80362430,2sleep31301699cyclictest11:53:413
74882430,0sleep60-21swapper/609:29:206
1270124331,8sleep70-21swapper/707:05:007
1270124331,8sleep70-21swapper/707:05:007
117382430,1sleep611736-21systemd-cgroups11:02:106
213962420,0sleep60-21swapper/610:51:376
98062410,0sleep30-21swapper/309:27:333
95242410,0sleep60-21swapper/611:50:086
78152410,0sleep60-21swapper/609:46:026
293802410,0sleep5686-21dbus-daemon09:25:035
139232410,2sleep013924-21grepconf.sh12:01:310
127902410,0sleep40-21swapper/411:53:584
1268124123,14sleep00-21swapper/007:04:450
1268124123,14sleep00-21swapper/007:04:450
116962410,0sleep20-21swapper/210:49:092
101562410,0sleep30-21swapper/312:29:053
93622400,0sleep4481ktimersoftd/412:17:534
92192400,0sleep60-21swapper/609:57:156
326402400,0sleep40-21swapper/410:50:234
245232400,0sleep10-21swapper/109:47:011
22452400,0sleep40-21swapper/412:04:324
195882400,0sleep70-21swapper/711:30:237
188752400,0sleep20-21swapper/210:40:202
159652400,0sleep40-21swapper/410:21:404
139732400,0sleep513972-21systemd-cgroups09:29:435
1261024027,9sleep50-21swapper/507:03:465
1261024027,9sleep50-21swapper/507:03:465
1259024029,8sleep30-21swapper/307:03:283
1259024029,8sleep30-21swapper/307:03:283
63862390,0sleep50-21swapper/510:47:045
57792390,0sleep70-21swapper/711:38:487
295002390,0sleep00-21swapper/011:29:040
232482390,0sleep10-21swapper/110:31:221
171562390,0sleep50-21swapper/511:56:085
1273123926,9sleep10-21swapper/107:05:261
1273123926,9sleep10-21swapper/107:05:261
1254423927,8sleep60-21swapper/607:02:516
1254423927,8sleep60-21swapper/607:02:516
32032380,0sleep10-21swapper/111:33:051
1260723827,8sleep20-21swapper/207:03:432
1260723827,8sleep20-21swapper/207:03:432
110062380,0sleep40-21swapper/409:38:474
98402360,0sleep60-21swapper/609:53:316
36552360,1sleep03584-21systemd09:21:450
13034992210,1cyclictest57-21ksoftirqd/512:13:565
1303499217,13cyclictest57-21ksoftirqd/511:51:455
1303499205,4cyclictest57-21ksoftirqd/511:35:275
1303499204,3cyclictest57-21ksoftirqd/510:14:315
1303499202,3cyclictest57-21ksoftirqd/509:18:205
13034992018,1cyclictest57-21ksoftirqd/509:16:425
13034992013,4cyclictest57-21ksoftirqd/512:33:085
13016992018,1cyclictest41-21ksoftirqd/310:37:233
49992190,0sleep60-21swapper/610:59:546
1305099191,6cyclictest18589-21grepconf.sh09:57:417
1303499194,3cyclictest57-21ksoftirqd/509:44:065
1303499193,3cyclictest57-21ksoftirqd/511:10:055
13034991916,3cyclictest57-21ksoftirqd/510:17:145
13034991915,3cyclictest57-21ksoftirqd/510:40:355
13034991915,3cyclictest57-21ksoftirqd/510:35:095
13034991914,3cyclictest57-21ksoftirqd/511:45:175
13010991913,4cyclictest33-21ksoftirqd/211:16:152
70172180,1sleep4686-21dbus-daemon11:14:504
1305099182,4cyclictest4551-21bash10:48:447
1305099182,1cyclictest3763-21systemd-cgroups10:45:017
1305099181,7cyclictest25574-21cp12:07:407
1305099181,5cyclictest14443-21bash09:13:027
1305099181,2cyclictest4087-21id11:44:157
1305099180,8cyclictest0-21swapper/712:32:267
1303499185,3cyclictest57-21ksoftirqd/511:23:585
1303499182,2cyclictest57-21ksoftirqd/511:02:215
13034991816,1cyclictest57-21ksoftirqd/512:02:335
13034991816,1cyclictest57-21ksoftirqd/511:57:335
13034991816,1cyclictest57-21ksoftirqd/510:53:295
13034991816,1cyclictest57-21ksoftirqd/510:53:295
13034991816,1cyclictest492-21systemd-journal09:59:125
13034991814,3cyclictest57-21ksoftirqd/512:09:375
13034991812,3cyclictest57-21ksoftirqd/510:57:295
1303499181,1cyclictest121rcu_preempt10:06:425
13010991816,1cyclictest33-21ksoftirqd/212:13:272
13010991816,1cyclictest33-21ksoftirqd/210:58:392
13010991816,1cyclictest18813-21kworker/2:011:22:252
13010991815,2cyclictest33-21ksoftirqd/211:42:522
13010991814,4cyclictest33-21ksoftirqd/210:37:022
13010991814,3cyclictest33-21ksoftirqd/210:16:062
13010991813,4cyclictest33-21ksoftirqd/209:41:472
13010991810,4cyclictest33-21ksoftirqd/211:40:162
1301099180,17cyclictest9962-21kworker/2:009:13:212
13002991816,1cyclictest25-21ksoftirqd/111:22:291
1305099173,1cyclictest885-21polkitd12:12:437
1305099171,3cyclictest27238-21bash12:20:517
1305099170,2cyclictest0-21swapper/710:23:107
1305099170,1cyclictest73-21ksoftirqd/711:22:467
1303499176,1cyclictest57-21ksoftirqd/510:50:435
13034991716,1cyclictest57-21ksoftirqd/510:29:165
13034991716,1cyclictest57-21ksoftirqd/509:52:105
13034991716,1cyclictest57-21ksoftirqd/509:10:465
13034991715,2cyclictest57-21ksoftirqd/510:10:135
13034991715,1cyclictest57-21ksoftirqd/512:25:585
13034991715,1cyclictest57-21ksoftirqd/511:39:135
13034991715,1cyclictest57-21ksoftirqd/511:18:545
13034991714,1cyclictest57-21ksoftirqd/509:47:215
1303499170,1cyclictest57-21ksoftirqd/511:27:315
13016991713,1cyclictest41-21ksoftirqd/309:22:323
13010991716,1cyclictest33-21ksoftirqd/210:30:002
13010991715,2cyclictest33-21ksoftirqd/211:32:102
13010991715,1cyclictest33-21ksoftirqd/211:20:522
13010991715,1cyclictest33-21ksoftirqd/211:10:012
13010991715,1cyclictest33-21ksoftirqd/209:20:122
13002991715,1cyclictest25-21ksoftirqd/112:23:461
13002991715,1cyclictest25-21ksoftirqd/111:09:031
12994991716,1cyclictest9-21ksoftirqd/010:28:070
12994991715,1cyclictest28957-21systemd09:10:040
12994991714,2cyclictest10754-21kworker/0:110:41:100
1305099162,4cyclictest2397-21systemd09:19:467
1305099161,5cyclictest9812-21sshd09:27:337
1305099161,5cyclictest5694-21bash10:11:517
1305099161,5cyclictest1-21systemd09:24:417
1305099160,6cyclictest686-21dbus-daemon09:37:237
1305099160,3cyclictest31010-21bash10:03:597
1303499162,1cyclictest57-21ksoftirqd/509:37:275
13034991614,1cyclictest492-21systemd-journal12:27:105
13034991614,1cyclictest492-21systemd-journal09:34:525
13034991612,3cyclictest57-21ksoftirqd/512:18:495
13027991615,1cyclictest49-21ksoftirqd/411:05:284
13016991614,2cyclictest41-21ksoftirqd/310:43:493
13016991614,1cyclictest41-21ksoftirqd/312:36:313
13016991614,1cyclictest41-21ksoftirqd/311:10:113
13010991615,1cyclictest33-21ksoftirqd/210:55:132
13010991615,1cyclictest33-21ksoftirqd/210:55:132
13010991614,1cyclictest33-21ksoftirqd/212:32:572
13010991614,1cyclictest33-21ksoftirqd/212:03:232
13010991614,1cyclictest33-21ksoftirqd/211:52:262
13010991614,1cyclictest33-21ksoftirqd/211:50:442
13010991614,1cyclictest33-21ksoftirqd/210:09:582
13010991614,1cyclictest33-21ksoftirqd/210:03:562
13010991614,1cyclictest33-21ksoftirqd/209:42:222
13010991614,1cyclictest33-21ksoftirqd/209:11:222
13010991613,3cyclictest33-21ksoftirqd/210:44:472
13010991613,3cyclictest33-21ksoftirqd/209:59:202
13010991613,2cyclictest33-21ksoftirqd/212:28:362
13010991613,2cyclictest33-21ksoftirqd/212:20:142
13002991614,1cyclictest25-21ksoftirqd/112:07:291
13002991614,1cyclictest25-21ksoftirqd/111:54:431
13002991614,1cyclictest25-21ksoftirqd/110:15:031
13002991614,1cyclictest25-21ksoftirqd/110:05:201
12994991615,1cyclictest9-21ksoftirqd/010:17:400
12994991615,0cyclictest24739-21kworker/u16:111:16:160
12994991615,0cyclictest14271-21kworker/u16:110:44:500
12994991615,0cyclictest13257-21kworker/u16:110:12:300
12994991614,1cyclictest16597-21kworker/0:410:01:300
12994991613,3cyclictest19725-21kworker/u16:409:44:280
278272150,0sleep327824-21sshd10:18:353
274512150,0sleep60-21swapper/609:09:586
14242150,1sleep01-21systemd12:10:040
1305099152,5cyclictest16498-21grep11:35:447
1305099152,1cyclictest0-21swapper/710:38:107
1305099151,6cyclictest19077-21sshd10:32:537
1305099151,5cyclictest30255-21sshd10:15:037
1305099151,5cyclictest2715-21bash10:57:527
1305099151,5cyclictest26811-21sshd11:04:527
1305099151,5cyclictest23356-21bash10:18:197
1305099151,4cyclictest887-21gdbus11:54:187
1305099151,3cyclictest1-21systemd11:09:327
1305099150,5cyclictest31629-21sshd11:16:177
1305099150,5cyclictest17949-21grep11:57:567
1305099150,5cyclictest11208-21sshd11:48:197
1305099150,5cyclictest1-21systemd09:43:397
1305099150,3cyclictest0-21swapper/712:04:247
1305099150,2cyclictest686-21dbus-daemon11:17:397
1305099150,2cyclictest686-21dbus-daemon09:47:547
13034991510,2cyclictest0-21swapper/508:44:235
13016991513,1cyclictest41-21ksoftirqd/311:39:113
13016991513,1cyclictest41-21ksoftirqd/311:28:273
13016991513,1cyclictest41-21ksoftirqd/310:58:323
13016991510,3cyclictest41-21ksoftirqd/309:21:373
1301699150,1cyclictest131rcu_sched11:22:453
13010991514,1cyclictest33-21ksoftirqd/209:32:192
13010991513,1cyclictest33-21ksoftirqd/209:53:272
13010991513,1cyclictest33-21ksoftirqd/209:47:132
13010991513,1cyclictest33-21ksoftirqd/209:27:232
13010991512,1cyclictest33-21ksoftirqd/211:27:412
13002991514,1cyclictest25-21ksoftirqd/112:16:391
13002991514,1cyclictest25-21ksoftirqd/111:15:401
13002991514,1cyclictest25-21ksoftirqd/110:46:201
13002991514,1cyclictest25-21ksoftirqd/109:13:501
13002991514,1cyclictest25-21ksoftirqd/109:10:091
13002991513,1cyclictest25-21ksoftirqd/112:18:071
13002991513,1cyclictest25-21ksoftirqd/111:51:491
13002991513,1cyclictest25-21ksoftirqd/111:27:531
13002991513,1cyclictest25-21ksoftirqd/110:36:271
13002991513,1cyclictest25-21ksoftirqd/110:19:241
13002991513,1cyclictest25-21ksoftirqd/110:11:261
13002991513,1cyclictest25-21ksoftirqd/109:39:461
13002991513,1cyclictest25-21ksoftirqd/109:32:151
13002991513,1cyclictest25-21ksoftirqd/109:17:191
13002991512,2cyclictest25-21ksoftirqd/111:37:281
1300299150,1cyclictest0-21swapper/109:58:311
12994991514,0cyclictest13001-21kworker/u16:209:28:160
12994991513,1cyclictest9-21ksoftirqd/012:21:090
12994991513,1cyclictest9-21ksoftirqd/010:58:260
12994991512,2cyclictest24865-21kworker/u16:311:56:280
1299499150,1cyclictest131rcu_sched10:49:200
1305099143,1cyclictest0-21swapper/709:32:357
1305099140,5cyclictest31162-21bash10:28:017
1305099140,5cyclictest12300-21grep10:54:467
1305099140,5cyclictest12300-21grep10:54:467
13042991410,4cyclictest65-21ksoftirqd/612:24:236
13034991413,1cyclictest57-21ksoftirqd/508:17:295
13027991412,1cyclictest49-21ksoftirqd/410:36:204
1301699149,3cyclictest41-21ksoftirqd/310:04:103
13016991413,1cyclictest41-21ksoftirqd/311:50:293
13016991412,1cyclictest41-21ksoftirqd/312:23:003
13016991412,1cyclictest41-21ksoftirqd/312:16:283
13016991412,1cyclictest41-21ksoftirqd/312:05:473
13016991412,1cyclictest41-21ksoftirqd/311:04:123
13016991412,1cyclictest41-21ksoftirqd/310:35:273
13016991412,1cyclictest41-21ksoftirqd/310:28:523
13016991412,1cyclictest41-21ksoftirqd/309:52:273
1301699140,14cyclictest31639-21kworker/3:211:34:533
13010991413,1cyclictest33-21ksoftirqd/209:22:302
13010991412,1cyclictest33-21ksoftirqd/212:07:412
13010991412,1cyclictest33-21ksoftirqd/210:19:272
13010991412,1cyclictest33-21ksoftirqd/209:07:082
13010991412,1cyclictest311rcuc/210:22:212
13010991410,1cyclictest33-21ksoftirqd/211:59:452
13002991413,1cyclictest25-21ksoftirqd/112:01:401
13002991413,1cyclictest25-21ksoftirqd/111:18:341
13002991412,1cyclictest25-21ksoftirqd/111:45:051
13002991412,1cyclictest25-21ksoftirqd/110:58:381
13002991412,1cyclictest25-21ksoftirqd/110:47:271
13002991412,1cyclictest25-21ksoftirqd/109:55:581
13002991412,1cyclictest25-21ksoftirqd/109:23:551
1300299140,13cyclictest32105-21kworker/1:309:50:241
12994991413,0cyclictest13628-21kworker/u16:109:24:440
12994991412,2cyclictest8184-21kworker/u16:008:01:440
12994991412,2cyclictest29710-21kworker/0:011:17:160
12994991412,2cyclictest21721-21kworker/u16:012:31:540
12994991412,2cyclictest1943-21kworker/u16:112:22:540
12994991412,2cyclictest14977-21kworker/u16:210:11:040
12994991412,1cyclictest9-21ksoftirqd/012:04:150
12994991412,1cyclictest28077-21kworker/0:411:11:420
12994991412,1cyclictest1-21systemd12:34:460
13042991310,1cyclictest65-21ksoftirqd/611:54:006
13034991311,1cyclictest57-21ksoftirqd/508:07:195
1302799133,4cyclictest1838-21sshd11:36:474
13027991311,1cyclictest49-21ksoftirqd/412:23:244
13027991311,1cyclictest49-21ksoftirqd/409:58:504
13027991311,1cyclictest1-21systemd09:14:594
13027991310,2cyclictest21762-21systemd-cgroups11:41:384
13027991310,1cyclictest49-21ksoftirqd/409:19:444
13016991312,1cyclictest41-21ksoftirqd/310:25:003
13016991311,1cyclictest41-21ksoftirqd/312:18:273
13016991311,1cyclictest41-21ksoftirqd/311:45:113
13016991311,1cyclictest41-21ksoftirqd/310:12:233
13016991311,1cyclictest41-21ksoftirqd/309:58:203
13016991311,1cyclictest41-21ksoftirqd/309:42:143
13016991311,1cyclictest41-21ksoftirqd/309:15:083
13002991312,1cyclictest25-21ksoftirqd/112:02:451
13002991312,1cyclictest25-21ksoftirqd/109:30:321
13002991311,1cyclictest25-21ksoftirqd/112:34:551
13002991311,1cyclictest25-21ksoftirqd/111:06:091
12994991312,1cyclictest9-21ksoftirqd/011:36:350
12994991311,2cyclictest22932-21kworker/u16:310:52:220
12994991311,2cyclictest22932-21kworker/u16:310:52:220
12994991311,1cyclictest9-21ksoftirqd/009:37:220
12994991311,1cyclictest9-21ksoftirqd/009:36:110
12994991311,1cyclictest24739-21kworker/u16:111:04:500
12994991310,2cyclictest24974-21kworker/0:010:35:100
1299499130,7cyclictest0-21swapper/009:47:440
1305099125,1cyclictest73-21ksoftirqd/707:28:377
1305099120,1cyclictest73-21ksoftirqd/707:07:257
1304299128,1cyclictest65-21ksoftirqd/610:56:306
1304299128,1cyclictest65-21ksoftirqd/610:56:306
1304299122,7cyclictest16221-21bash12:07:146
13042991211,1cyclictest65-21ksoftirqd/611:27:226
13042991210,1cyclictest65-21ksoftirqd/612:14:416
13042991210,1cyclictest65-21ksoftirqd/610:36:456
13042991210,1cyclictest65-21ksoftirqd/609:18:426
1304299120,2cyclictest12071-21systemd10:04:466
1304299120,11cyclictest12208-21sshd11:24:236
1303499129,2cyclictest57-21ksoftirqd/508:12:265
1303499129,1cyclictest57-21ksoftirqd/508:56:215
1303499122,1cyclictest13600-21cstates07:07:195
13034991211,1cyclictest57-21ksoftirqd/507:52:225
13034991211,1cyclictest57-21ksoftirqd/507:32:215
13034991211,1cyclictest57-21ksoftirqd/507:22:085
13034991210,0cyclictest0-21swapper/508:25:395
13034991210,0cyclictest0-21swapper/508:25:395
1302799123,4cyclictest0-21swapper/411:26:374
1302799122,4cyclictest15258-21sshd11:00:304
1302799120,11cyclictest28106-21kworker/4:510:22:324
1302799120,11cyclictest17167-21kworker/4:209:26:464
1302799120,1cyclictest2855-21systemd12:32:244
1301699129,2cyclictest41-21ksoftirqd/311:14:183
1301699128,3cyclictest41-21ksoftirqd/312:09:143
1301699127,2cyclictest41-21ksoftirqd/309:08:263
13016991211,1cyclictest41-21ksoftirqd/309:35:413
13016991210,1cyclictest41-21ksoftirqd/311:57:193
13016991210,1cyclictest41-21ksoftirqd/311:19:013
1301699120,11cyclictest0-21swapper/310:55:113
1301699120,11cyclictest0-21swapper/310:55:113
13002991210,1cyclictest25-21ksoftirqd/112:27:261
1299499128,1cyclictest9-21ksoftirqd/009:54:310
1299499125,5cyclictest492-21systemd-journal09:12:200
1299499120,2cyclictest4069-21grep11:47:540
305242110,0sleep30-21swapper/308:32:233
1304299119,1cyclictest65-21ksoftirqd/612:03:276
1304299119,1cyclictest65-21ksoftirqd/610:42:066
1304299115,3cyclictest3253-21grepconf.sh09:12:266
1304299113,4cyclictest20944-21systemd09:39:226
1304299112,5cyclictest24485-21bash10:20:166
13042991110,1cyclictest65-21ksoftirqd/609:26:016
1304299110,10cyclictest0-21swapper/610:44:586
1303499119,1cyclictest57-21ksoftirqd/507:42:085
1303499118,3cyclictest6049-21kworker/5:007:22:455
1302799119,1cyclictest49-21ksoftirqd/412:12:154
1302799119,1cyclictest49-21ksoftirqd/412:07:494
1302799116,4cyclictest477-21memory09:47:264
1302799112,5cyclictest885-21polkitd11:43:394
1302799112,4cyclictest686-21dbus-daemon09:31:384
1302799112,4cyclictest0-21swapper/410:31:394
1302799111,4cyclictest8611-21sshd10:52:394
1302799111,4cyclictest8611-21sshd10:52:394
1302799111,4cyclictest32056-21sshd10:15:104
1302799111,4cyclictest16605-21sshd11:20:594
1302799111,4cyclictest15473-21sshd09:11:204
1302799111,4cyclictest15176-21sshd11:07:504
1302799110,5cyclictest691-21systemd-logind09:43:454
1301699119,1cyclictest41-21ksoftirqd/310:07:133
1299499119,1cyclictest9-21ksoftirqd/012:13:130
1299499119,1cyclictest9-21ksoftirqd/010:02:190
1299499116,0cyclictest0-21swapper/007:24:080
1299499110,11cyclictest28077-21kworker/0:410:24:550
1304299109,1cyclictest0-21swapper/611:14:376
1304299107,2cyclictest12514-21bash12:29:146
1304299103,4cyclictest0-21swapper/611:10:086
1304299102,4cyclictest691-21systemd-logind11:40:106
1304299102,4cyclictest492-21systemd-journal11:42:526
1304299102,4cyclictest29086-21bash10:24:136
1304299102,4cyclictest10946-21grepconf.sh10:13:566
1304299102,1cyclictest5377-21cp11:59:066
1304299101,1cyclictest0-21swapper/612:33:016
1304299100,9cyclictest23089-21kworker/6:109:32:196
1304299100,9cyclictest17739-21kworker/6:312:19:006
1303499109,1cyclictest57-21ksoftirqd/508:47:285
1303499109,1cyclictest57-21ksoftirqd/507:47:215
1303499109,1cyclictest57-21ksoftirqd/507:12:295
1303499109,0cyclictest0-21swapper/508:37:275
1303499108,1cyclictest57-21ksoftirqd/509:07:085
1303499108,1cyclictest57-21ksoftirqd/507:57:265
1302799107,2cyclictest29930-21sshd10:37:184
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional