You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 11:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon Dec 22, 2025 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
54102970,2sleep51131999cyclictest22:04:155
112122730,0sleep10-21swapper/123:15:231
309342720,0sleep60-21swapper/622:25:466
1103525847,8sleep50-21swapper/519:08:155
247632550,1sleep524764-21grepconf.sh22:50:525
1092725342,8sleep40-21swapper/419:06:464
52722510,0sleep70-21swapper/721:57:367
52722510,0sleep70-21swapper/721:57:367
1091725026,8sleep30-21swapper/319:06:373
48592470,0sleep30-21swapper/322:16:543
230512470,0sleep20-21swapper/222:50:412
41032440,1sleep24100-21sshd23:14:522
243992440,0sleep60-21swapper/600:19:026
209402440,0sleep50-21swapper/521:10:095
264422430,2sleep51131999cyclictest23:04:135
264422430,2sleep51131999cyclictest23:04:135
1098224319,9sleep10-21swapper/119:07:311
1087724331,9sleep70-21swapper/719:06:097
317012420,0sleep331698-21sshd23:27:103
63922410,0sleep00-21swapper/023:14:580
289462410,0sleep50-21swapper/500:32:235
208962410,0sleep00-21swapper/000:12:000
203922410,0sleep70-21swapper/723:03:357
203922410,0sleep70-21swapper/723:03:357
254932400,0sleep50-21swapper/500:19:095
238092400,0sleep623807-21systemd-cgroups22:31:396
199982400,0sleep30-21swapper/323:32:303
1110924027,9sleep60-21swapper/619:09:126
1109424028,8sleep00-21swapper/019:08:580
69262390,0sleep10-21swapper/122:33:181
269062390,0sleep20-21swapper/221:24:402
17442390,1sleep11740-21systemd-cgroups00:13:291
274092380,2sleep61132699cyclictest00:29:036
207922380,0sleep40-21swapper/422:34:414
1085023827,8sleep20-21swapper/219:05:482
70272360,0sleep40-21swapper/422:55:394
5452360,2sleep71133499cyclictest23:14:337
97002340,0sleep30-21swapper/322:11:023
1127799230,2cyclictest31552-21sd-pam22:38:570
1127799230,2cyclictest10322-21sd-pam21:29:190
1127799230,1cyclictest1053-21systemd-cgroups23:30:310
1127799210,2cyclictest23527-21grepconf.sh22:50:440
46562200,0sleep50-21swapper/521:22:185
1127799203,7cyclictest18031-21cp22:21:190
1127799200,3cyclictest21477-21systemd00:08:550
1127799200,2cyclictest686-21dbus-daemon21:15:070
1127799200,2cyclictest1-21systemd22:01:410
1127799200,1cyclictest0-21swapper/000:16:560
210452190,0sleep60-21swapper/622:50:296
11293991915,3cyclictest33-21ksoftirqd/221:35:152
1127799193,7cyclictest9002-21bash22:14:150
1127799190,2cyclictest686-21dbus-daemon21:53:150
1127799190,2cyclictest22298-21systemd00:31:420
1127799190,2cyclictest10344-21sd-pam22:07:580
1127799190,1cyclictest17716-21grepconf.sh00:01:480
1127799190,1cyclictest0-21swapper/022:41:230
54762180,0sleep60-21swapper/623:24:416
11313991816,1cyclictest49-21ksoftirqd/423:10:414
11293991814,3cyclictest33-21ksoftirqd/200:05:252
1127799180,2cyclictest32726-21systemd21:44:190
1127799180,2cyclictest27058-21grepconf.sh23:26:410
1127799180,2cyclictest24116-21bash21:30:270
1127799180,2cyclictest16840-21kill22:34:190
1127799180,2cyclictest1-21systemd23:35:150
1127799180,1cyclictest0-21swapper/022:45:260
1127799180,1cyclictest0-21swapper/022:19:040
79062170,2sleep41131399cyclictest00:27:014
11313991715,1cyclictest49-21ksoftirqd/423:39:074
11313991715,1cyclictest49-21ksoftirqd/421:32:594
11301991714,2cyclictest41-21ksoftirqd/322:57:043
11293991714,3cyclictest33-21ksoftirqd/222:40:112
11293991714,2cyclictest33-21ksoftirqd/222:15:242
1129399171,1cyclictest33-21ksoftirqd/200:10:082
1128599170,16cyclictest17749-21kworker/1:021:22:191
1127799170,2cyclictest775-21gdbus21:14:000
1127799170,2cyclictest686-21dbus-daemon23:52:160
1127799170,2cyclictest4605-21kill23:08:290
1127799170,2cyclictest3356-21sshd23:57:100
1127799170,2cyclictest27937-21systemd23:46:260
1127799170,2cyclictest20302-21id21:46:090
1127799170,2cyclictest19279-21grep21:55:400
1127799170,2cyclictest19279-21grep21:55:400
1127799170,2cyclictest18184-21grep21:36:210
1127799170,2cyclictest1-21systemd00:37:090
1127799170,1cyclictest19152-21sshd22:24:470
1127799170,1cyclictest1-21systemd23:22:330
1127799170,1cyclictest0-21swapper/023:40:160
1127799170,1cyclictest0-21swapper/021:22:290
119942160,0sleep50-21swapper/521:16:425
11313991614,1cyclictest49-21ksoftirqd/422:33:154
11313991614,1cyclictest49-21ksoftirqd/422:09:584
11313991614,1cyclictest49-21ksoftirqd/421:26:314
11313991614,1cyclictest49-21ksoftirqd/400:07:264
11313991613,1cyclictest49-21ksoftirqd/421:17:284
11313991612,3cyclictest49-21ksoftirqd/423:55:024
11313991612,1cyclictest49-21ksoftirqd/422:44:314
11293991614,2cyclictest33-21ksoftirqd/221:55:022
11293991614,2cyclictest33-21ksoftirqd/221:55:022
11293991614,1cyclictest33-21ksoftirqd/222:31:062
11293991613,1cyclictest33-21ksoftirqd/223:54:172
1129399160,15cyclictest29671-21kworker/2:321:40:012
1129399160,15cyclictest16924-21kworker/2:322:10:032
1129399160,15cyclictest15180-21kworker/2:121:29:572
1127799160,3cyclictest6499-21sd-pam00:20:190
1127799160,1cyclictest686-21dbus-daemon23:00:470
1127799160,1cyclictest686-21dbus-daemon23:00:470
1127799160,1cyclictest18021-21systemd23:12:590
1127799160,1cyclictest0-21swapper/022:54:490
1127799160,1cyclictest0-21swapper/000:27:090
1131999150,14cyclictest28192-21kworker/5:000:24:595
11313991514,1cyclictest49-21ksoftirqd/422:16:174
11313991514,1cyclictest49-21ksoftirqd/400:34:584
11313991514,1cyclictest49-21ksoftirqd/400:17:324
11313991513,2cyclictest49-21ksoftirqd/423:00:544
11313991513,2cyclictest49-21ksoftirqd/423:00:544
11313991513,1cyclictest49-21ksoftirqd/423:54:174
11313991513,1cyclictest49-21ksoftirqd/423:42:514
11313991513,1cyclictest49-21ksoftirqd/423:26:254
11313991513,1cyclictest49-21ksoftirqd/423:22:474
11313991513,1cyclictest49-21ksoftirqd/423:15:054
11313991513,1cyclictest49-21ksoftirqd/422:28:034
11313991513,1cyclictest49-21ksoftirqd/422:19:534
11313991513,1cyclictest49-21ksoftirqd/421:59:144
11313991513,1cyclictest49-21ksoftirqd/421:59:144
11313991513,1cyclictest49-21ksoftirqd/421:45:084
11313991513,1cyclictest49-21ksoftirqd/421:39:494
11313991513,1cyclictest49-21ksoftirqd/400:24:054
11313991513,1cyclictest49-21ksoftirqd/400:09:474
11313991512,1cyclictest49-21ksoftirqd/422:04:284
11313991511,1cyclictest49-21ksoftirqd/423:05:284
11301991514,1cyclictest41-21ksoftirqd/300:37:083
11301991513,1cyclictest41-21ksoftirqd/323:15:393
11301991513,1cyclictest41-21ksoftirqd/322:06:133
11301991513,1cyclictest41-21ksoftirqd/322:00:193
11301991513,1cyclictest41-21ksoftirqd/321:35:453
11293991514,1cyclictest33-21ksoftirqd/223:47:052
11293991514,1cyclictest33-21ksoftirqd/223:25:352
11293991514,1cyclictest33-21ksoftirqd/200:35:482
11293991513,2cyclictest33-21ksoftirqd/221:53:582
11293991513,1cyclictest33-21ksoftirqd/222:56:472
11293991513,1cyclictest33-21ksoftirqd/222:36:352
11293991513,1cyclictest33-21ksoftirqd/222:20:212
11293991513,1cyclictest33-21ksoftirqd/222:00:122
11293991513,1cyclictest33-21ksoftirqd/221:45:252
11293991513,1cyclictest33-21ksoftirqd/221:28:362
11293991513,1cyclictest33-21ksoftirqd/221:16:122
11293991513,1cyclictest33-21ksoftirqd/221:10:242
11293991513,1cyclictest33-21ksoftirqd/200:21:262
11293991512,2cyclictest33-21ksoftirqd/222:48:552
1129399150,2cyclictest121rcu_preempt23:11:552
1129399150,14cyclictest12543-21kworker/2:200:01:122
1128599159,5cyclictest27661-21systemd23:20:151
11285991513,2cyclictest1042-21kworker/u16:521:31:411
11285991513,1cyclictest25-21ksoftirqd/122:39:131
11285991513,1cyclictest25-21ksoftirqd/122:05:521
11285991512,2cyclictest10348-21kworker/1:622:47:231
139822140,0sleep10-21swapper/100:21:061
11313991413,1cyclictest49-21ksoftirqd/421:22:494
11313991413,1cyclictest49-21ksoftirqd/421:10:184
11313991412,1cyclictest49-21ksoftirqd/423:30:074
11313991412,1cyclictest49-21ksoftirqd/422:51:224
11313991412,1cyclictest49-21ksoftirqd/422:46:514
11313991412,1cyclictest49-21ksoftirqd/422:07:194
11313991412,1cyclictest49-21ksoftirqd/400:33:464
11313991410,1cyclictest49-21ksoftirqd/423:59:554
11301991412,1cyclictest41-21ksoftirqd/323:23:223
11301991412,1cyclictest41-21ksoftirqd/323:12:593
11301991412,1cyclictest41-21ksoftirqd/322:54:413
11301991412,1cyclictest41-21ksoftirqd/322:21:513
11301991412,1cyclictest41-21ksoftirqd/321:58:203
11301991412,1cyclictest41-21ksoftirqd/321:58:203
11301991412,1cyclictest41-21ksoftirqd/300:27:163
11293991413,1cyclictest33-21ksoftirqd/223:20:192
11293991413,1cyclictest33-21ksoftirqd/223:03:142
11293991413,1cyclictest33-21ksoftirqd/223:03:142
11293991413,1cyclictest33-21ksoftirqd/222:06:012
11293991412,2cyclictest33-21ksoftirqd/222:24:492
11293991412,1cyclictest33-21ksoftirqd/223:55:182
11293991412,1cyclictest33-21ksoftirqd/223:39:522
11293991412,1cyclictest33-21ksoftirqd/223:34:572
11293991412,1cyclictest33-21ksoftirqd/223:29:532
11293991412,1cyclictest33-21ksoftirqd/223:05:472
11293991412,1cyclictest33-21ksoftirqd/200:31:522
1129399140,1cyclictest131rcu_sched00:26:052
1129399140,1cyclictest131rcu_sched00:14:472
1128599149,2cyclictest25-21ksoftirqd/100:02:391
11285991413,1cyclictest25-21ksoftirqd/122:14:451
11285991413,1cyclictest25-21ksoftirqd/121:52:411
11285991412,1cyclictest25-21ksoftirqd/123:24:591
11285991412,1cyclictest25-21ksoftirqd/123:13:431
11285991412,1cyclictest25-21ksoftirqd/100:36:591
11285991412,1cyclictest25-21ksoftirqd/100:15:001
1127799140,1cyclictest0-21swapper/020:34:540
1127799140,1cyclictest0-21swapper/019:44:550
225062130,0sleep60-21swapper/600:09:016
11334991311,1cyclictest73-21ksoftirqd/723:31:267
11334991311,1cyclictest73-21ksoftirqd/722:54:557
11334991311,1cyclictest73-21ksoftirqd/722:31:497
1132699133,4cyclictest0-21swapper/622:37:276
1132699132,5cyclictest686-21dbus-daemon22:03:496
1131399139,3cyclictest49-21ksoftirqd/421:51:484
11313991312,1cyclictest49-21ksoftirqd/423:44:584
11313991312,1cyclictest49-21ksoftirqd/421:38:514
1130199139,3cyclictest41-21ksoftirqd/300:06:153
1130199136,3cyclictest41-21ksoftirqd/322:29:563
11301991312,1cyclictest41-21ksoftirqd/323:50:333
11301991312,1cyclictest41-21ksoftirqd/300:13:193
11301991311,1cyclictest41-21ksoftirqd/323:35:363
11301991311,1cyclictest41-21ksoftirqd/323:00:113
11301991311,1cyclictest41-21ksoftirqd/323:00:113
11301991311,1cyclictest41-21ksoftirqd/322:34:543
11301991311,1cyclictest41-21ksoftirqd/321:51:093
11301991311,1cyclictest41-21ksoftirqd/300:33:103
11301991311,1cyclictest41-21ksoftirqd/300:01:183
11285991312,1cyclictest25-21ksoftirqd/122:21:311
11285991312,1cyclictest25-21ksoftirqd/122:04:251
11285991312,1cyclictest25-21ksoftirqd/121:42:141
11285991312,1cyclictest25-21ksoftirqd/121:39:021
11285991312,1cyclictest25-21ksoftirqd/100:04:531
11285991311,1cyclictest25-21ksoftirqd/123:54:281
11285991311,1cyclictest25-21ksoftirqd/123:07:331
11285991311,1cyclictest25-21ksoftirqd/122:57:391
11285991311,1cyclictest25-21ksoftirqd/100:31:321
11285991310,1cyclictest25-21ksoftirqd/100:28:011
101822130,0sleep70-21swapper/722:01:217
190472120,0sleep70-21swapper/700:24:567
11334991211,1cyclictest73-21ksoftirqd/723:19:217
11334991210,1cyclictest73-21ksoftirqd/722:13:347
11334991210,1cyclictest73-21ksoftirqd/721:28:587
11334991210,1cyclictest73-21ksoftirqd/700:17:407
1132699123,6cyclictest0-21swapper/623:12:446
1132699122,4cyclictest4283-21id22:07:216
1132699120,11cyclictest6170-21kworker/6:421:21:366
1132699120,11cyclictest14296-21kworker/6:422:13:106
1131999122,4cyclictest686-21dbus-daemon23:25:325
1131999122,4cyclictest1422-21sshd21:34:515
1131999122,10cyclictest0-21swapper/521:57:515
1131999122,10cyclictest0-21swapper/521:57:515
1131999120,12cyclictest29613-21kworker/5:500:11:325
1131999120,11cyclictest19793-21bash23:45:355
11301991211,1cyclictest41-21ksoftirqd/323:40:593
11301991211,1cyclictest391rcuc/321:44:573
11301991210,1cyclictest41-21ksoftirqd/323:56:173
11301991210,1cyclictest41-21ksoftirqd/322:46:343
11301991210,1cyclictest41-21ksoftirqd/322:26:173
11301991210,1cyclictest41-21ksoftirqd/321:30:283
11301991210,1cyclictest41-21ksoftirqd/321:24:223
11301991210,1cyclictest41-21ksoftirqd/321:14:423
11301991210,1cyclictest41-21ksoftirqd/300:20:023
11301991210,1cyclictest41-21ksoftirqd/300:15:023
1128599125,3cyclictest25-21ksoftirqd/123:45:401
11285991211,1cyclictest25-21ksoftirqd/123:41:201
11285991211,1cyclictest25-21ksoftirqd/123:30:321
11285991211,1cyclictest25-21ksoftirqd/122:49:451
11285991211,1cyclictest25-21ksoftirqd/121:10:261
11285991210,1cyclictest25-21ksoftirqd/123:57:471
11285991210,1cyclictest25-21ksoftirqd/121:25:001
11285991210,1cyclictest25-21ksoftirqd/121:17:191
91262110,0sleep10-21swapper/121:54:501
91262110,0sleep10-21swapper/121:54:501
82822110,0sleep50-21swapper/523:11:585
1133499119,1cyclictest73-21ksoftirqd/723:05:417
1133499119,1cyclictest73-21ksoftirqd/722:24:197
1133499119,1cyclictest73-21ksoftirqd/700:06:337
1133499114,4cyclictest1-21systemd22:40:017
11334991110,1cyclictest73-21ksoftirqd/722:16:407
1133499110,11cyclictest0-21swapper/722:36:137
1132699119,1cyclictest65-21ksoftirqd/600:03:366
1132699119,1cyclictest1-21systemd22:40:396
1132699113,2cyclictest1188-21bash22:48:386
1132699112,4cyclictest691-21systemd-logind21:37:206
1132699112,4cyclictest0-21swapper/623:29:566
1132699110,11cyclictest16013-21kworker/6:123:27:026
1132699110,11cyclictest15799-21kworker/6:121:14:286
1132699110,10cyclictest7946-21systemd23:15:026
1132699110,10cyclictest28777-21sshd21:24:496
1131999114,6cyclictest887-21gdbus00:38:535
1131999112,5cyclictest885-21polkitd22:09:155
1131999112,4cyclictest14117-21sshd22:34:025
1131999112,4cyclictest1350-21sshd23:43:535
1131999111,4cyclictest3843-21systemd22:19:585
1131999111,4cyclictest0-21swapper/521:31:005
1131999110,5cyclictest691-21systemd-logind23:15:155
1131999110,11cyclictest8319-21kworker/5:023:36:075
1131999110,10cyclictest13078-21kworker/5:122:25:065
1131399119,1cyclictest49-21ksoftirqd/420:09:414
1130199119,1cyclictest41-21ksoftirqd/323:44:593
1130199119,1cyclictest41-21ksoftirqd/323:07:413
1130199119,1cyclictest41-21ksoftirqd/321:29:383
1130199119,1cyclictest41-21ksoftirqd/321:16:173
11301991110,1cyclictest41-21ksoftirqd/321:39:453
1128599119,1cyclictest25-21ksoftirqd/122:41:131
1128599119,1cyclictest25-21ksoftirqd/121:44:531
11285991110,1cyclictest25-21ksoftirqd/122:24:431
84602100,0sleep60-21swapper/621:51:276
1133499109,1cyclictest73-21ksoftirqd/723:56:017
1133499109,1cyclictest73-21ksoftirqd/721:24:147
1133499109,1cyclictest73-21ksoftirqd/700:32:527
1133499108,1cyclictest73-21ksoftirqd/723:54:237
1133499108,1cyclictest73-21ksoftirqd/723:39:567
1133499108,1cyclictest73-21ksoftirqd/722:48:047
1133499108,1cyclictest73-21ksoftirqd/721:11:367
1133499108,1cyclictest73-21ksoftirqd/700:36:097
1133499107,3cyclictest73-21ksoftirqd/721:45:317
1133499105,4cyclictest73-21ksoftirqd/722:08:257
1133499104,3cyclictest887-21gdbus21:16:177
1133499104,3cyclictest10226-21systemd-cgroups22:52:437
1133499103,4cyclictest887-21gdbus21:54:417
1132699109,1cyclictest0-21swapper/622:55:476
1132699103,6cyclictest887-21gdbus22:15:086
1132699103,6cyclictest1-21systemd23:58:096
1132699103,1cyclictest87950irq/25-em1-rx-023:35:396
1132699100,4cyclictest686-21dbus-daemon21:34:416
1131999103,6cyclictest31822-21sshd21:47:195
1131999103,4cyclictest29799-21kill23:49:585
1131999103,1cyclictest0-21swapper/523:55:135
1131999100,4cyclictest686-21dbus-daemon00:06:365
1131999100,4cyclictest12557-21systemd-cgroups22:56:155
1131999100,4cyclictest0-21swapper/523:09:085
1131999100,10cyclictest0-21swapper/523:21:465
1131399108,1cyclictest49-21ksoftirqd/419:49:544
1130199108,1cyclictest41-21ksoftirqd/319:49:413
1130199104,3cyclictest12736-21systemd-cgroups22:40:083
1128599108,1cyclictest25-21ksoftirqd/123:34:561
1128599100,10cyclictest6151-21kworker/1:122:59:551
1128599100,10cyclictest6151-21kworker/1:122:59:551
1127799103,6cyclictest786-21snmpd20:56:370
1127799103,6cyclictest786-21snmpd20:19:540
1127799100,1cyclictest13897-21cstates20:09:570
1127799100,1cyclictest0-21swapper/019:55:010
1127799100,1cyclictest0-21swapper/019:54:410
7923290,0sleep7711rcuc/721:35:187
113349997,1cyclictest73-21ksoftirqd/723:45:147
113349997,1cyclictest73-21ksoftirqd/723:25:397
113349997,1cyclictest73-21ksoftirqd/721:41:467
113349997,1cyclictest73-21ksoftirqd/721:30:177
113349997,1cyclictest73-21ksoftirqd/700:20:157
113349997,1cyclictest73-21ksoftirqd/700:02:007
113349993,5cyclictest887-21gdbus23:23:217
113349992,3cyclictest2799-21systemd-cgroups22:29:347
113269999,0cyclictest0-21swapper/623:45:086
113269997,1cyclictest65-21ksoftirqd/623:02:576
113269997,1cyclictest65-21ksoftirqd/623:02:576
113269993,1cyclictest25757-21sshd21:40:136
113269992,6cyclictest686-21dbus-daemon21:14:536
113269992,3cyclictest691-21systemd-logind21:54:456
113269992,3cyclictest691-21systemd-logind21:54:456
113269992,1cyclictest691-21systemd-logind00:36:036
113269991,3cyclictest0-21swapper/623:53:066
113269991,2cyclictest14451-21systemd21:45:316
113269990,9cyclictest0-21swapper/622:23:006
113269990,0cyclictest0-21swapper/600:20:276
113199997,1cyclictest57-21ksoftirqd/523:29:565
113199996,2cyclictest22566-21bash21:49:415
113199993,6cyclictest0-21swapper/522:47:525
113199993,6cyclictest0-21swapper/521:27:465
113199993,5cyclictest20346-21memory20:19:575
113199993,1cyclictest1985-21sshd00:03:355
113199990,9cyclictest0-21swapper/522:16:215
113199990,5cyclictest0-21swapper/522:35:445
113199990,0cyclictest0-21swapper/522:11:095
113199990,0cyclictest0-21swapper/519:53:505
113139998,1cyclictest25496-21kworker/4:219:12:094
113139998,1cyclictest25496-21kworker/4:219:12:094
112939992,4cyclictest0-21swapper/221:00:372
112859997,2cyclictest25-21ksoftirqd/122:10:011
112779993,5cyclictest786-21snmpd19:30:230
112779993,5cyclictest786-21snmpd19:29:350
112779993,5cyclictest10326-21idleruntime-cro20:04:410
112779992,6cyclictest786-21snmpd21:06:590
112779992,6cyclictest786-21snmpd21:06:590
112779992,6cyclictest786-21snmpd21:03:520
112779992,6cyclictest4666-21grep20:49:550
112779992,6cyclictest18654-21grep19:19:590
112779992,6cyclictest18452-21grep20:15:050
112779991,7cyclictest12250-21tr20:04:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional