You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 05:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sat May 09, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1900921000,2sleep4220999cyclictest21:10:044
74402580,0sleep0218199cyclictest21:48:050
265332580,1sleep026534-21sshd21:16:490
35692570,2sleep5221499cyclictest21:15:265
67752510,0sleep20-21swapper/223:26:102
258032510,0sleep60-21swapper/622:12:056
115432510,1sleep011541-21grepconf.sh22:43:550
299062490,6sleep685150irq/25-em1-rx-000:21:246
114152490,0sleep20-21swapper/222:17:062
142102480,0sleep40-21swapper/421:57:544
142102480,0sleep40-21swapper/421:57:544
39132460,1sleep03893-21sshd00:25:350
251792460,0sleep50-21swapper/523:50:245
230332460,0sleep00-21swapper/022:54:200
207422460,0sleep10-21swapper/121:52:381
207012460,0sleep40-21swapper/422:11:474
149172460,0sleep40-21swapper/422:49:444
57142450,0sleep70-21swapper/700:00:517
224082450,0sleep10-21swapper/121:58:231
224082450,0sleep10-21swapper/121:58:231
191432450,0sleep10-21swapper/100:34:091
179792450,1sleep617956-21bash23:11:166
208432440,0sleep20-21swapper/222:31:002
136282440,1sleep125-21ksoftirqd/119:29:201
33622430,0sleep50-21swapper/522:54:575
290712430,0sleep50-21swapper/523:35:265
229892430,1sleep422985-21bash23:00:014
187562430,1sleep518745-21sshd22:11:405
118232430,0sleep711802-21sshd23:07:097
59212420,0sleep00-21swapper/023:14:310
83412410,0sleep50-21swapper/522:03:235
200124128,9sleep00-21swapper/019:08:540
200124128,9sleep00-21swapper/019:08:540
199812410,0sleep00-21swapper/021:10:080
181724129,9sleep40-21swapper/419:06:424
181724129,9sleep40-21swapper/419:06:424
13982410,0sleep20-21swapper/223:06:322
275162400,0sleep40-21swapper/423:52:314
254912400,0sleep50-21swapper/522:25:265
232622400,1sleep023261-21grepconf.sh23:31:130
187024027,9sleep30-21swapper/319:07:133
187024027,9sleep30-21swapper/319:07:133
173672400,0sleep70-21swapper/700:30:067
173124028,8sleep20-21swapper/219:05:362
173124028,8sleep20-21swapper/219:05:362
170524028,8sleep70-21swapper/719:05:177
170524028,8sleep70-21swapper/719:05:177
3192823927,8sleep50-21swapper/519:04:275
3192823927,8sleep50-21swapper/519:04:275
208042390,0sleep00-21swapper/022:07:590
185423927,9sleep60-21swapper/619:07:006
185423927,9sleep60-21swapper/619:07:006
158352390,0sleep60-21swapper/623:05:246
321982380,0sleep60-21swapper/622:33:366
169923827,8sleep10-21swapper/119:05:111
169923827,8sleep10-21swapper/119:05:111
161542370,2sleep6221999cyclictest22:57:396
62612330,0sleep70-21swapper/723:59:077
45432310,0sleep20-21swapper/223:18:172
14822310,0sleep5561ktimersoftd/521:30:405
218499228,1cyclictest25-21ksoftirqd/122:40:031
218499226,3cyclictest25-21ksoftirqd/121:35:211
38052200,2sleep5221499cyclictest21:38:245
251612190,0sleep4471rcuc/400:26:514
218499197,2cyclictest25-21ksoftirqd/121:15:291
2184991916,1cyclictest25-21ksoftirqd/123:42:551
2184991915,3cyclictest25-21ksoftirqd/122:03:271
2184991915,1cyclictest25-21ksoftirqd/123:13:531
2184991914,3cyclictest25-21ksoftirqd/100:38:371
2184991914,3cyclictest25-21ksoftirqd/100:11:241
2184991913,4cyclictest25-21ksoftirqd/100:05:231
2184991911,3cyclictest25-21ksoftirqd/100:00:111
2219991813,1cyclictest65-21ksoftirqd/623:00:116
2202991816,1cyclictest41-21ksoftirqd/300:04:213
218499185,1cyclictest25-21ksoftirqd/122:54:411
218499185,1cyclictest121rcu_preempt22:44:311
218499183,3cyclictest25-21ksoftirqd/100:17:291
2184991816,1cyclictest464-21systemd-journal23:34:011
2184991816,1cyclictest25-21ksoftirqd/123:51:221
2184991816,1cyclictest25-21ksoftirqd/122:23:291
2184991816,1cyclictest25-21ksoftirqd/121:29:121
2184991815,2cyclictest464-21systemd-journal21:20:301
2184991814,3cyclictest25-21ksoftirqd/123:58:281
2184991814,3cyclictest25-21ksoftirqd/122:16:021
2184991813,3cyclictest464-21systemd-journal00:23:091
2184991813,3cyclictest25-21ksoftirqd/122:29:531
2184991813,3cyclictest25-21ksoftirqd/122:27:411
2184991810,4cyclictest25-21ksoftirqd/122:49:441
218499180,3cyclictest14151-21sshd22:34:271
2202991715,2cyclictest41-21ksoftirqd/323:58:253
2202991715,1cyclictest41-21ksoftirqd/322:28:353
2202991713,1cyclictest41-21ksoftirqd/322:23:543
218499177,2cyclictest25-21ksoftirqd/122:09:341
218499177,1cyclictest25-21ksoftirqd/121:46:001
218499175,3cyclictest25-21ksoftirqd/121:42:291
218499172,1cyclictest25-21ksoftirqd/123:36:301
2184991715,1cyclictest25-21ksoftirqd/123:48:371
2184991715,1cyclictest25-21ksoftirqd/123:00:131
2184991715,1cyclictest25-21ksoftirqd/121:12:481
2219991614,1cyclictest65-21ksoftirqd/623:20:146
221499162,12cyclictest17021-21sshd23:44:175
2214991613,2cyclictest57-21ksoftirqd/522:05:365
2202991613,3cyclictest41-21ksoftirqd/323:59:313
220299160,15cyclictest32293-21kworker/3:121:59:373
2184991614,1cyclictest25-21ksoftirqd/123:26:411
2184991614,1cyclictest25-21ksoftirqd/123:23:261
2184991614,1cyclictest25-21ksoftirqd/123:17:051
2184991614,1cyclictest25-21ksoftirqd/123:04:251
2184991612,1cyclictest25-21ksoftirqd/122:05:011
218499160,1cyclictest131rcu_sched00:25:581
150562160,1sleep715053-21bash22:55:397
2214991513,1cyclictest1854-21kworker/5:222:20:195
2214991511,2cyclictest4499-21sshd00:10:185
2214991511,1cyclictest57-21ksoftirqd/521:59:055
2214991511,1cyclictest57-21ksoftirqd/521:59:055
220299152,12cyclictest366-21jbd2/sda2-822:45:443
2202991514,1cyclictest41-21ksoftirqd/323:52:423
2202991514,1cyclictest41-21ksoftirqd/321:57:173
2202991514,1cyclictest41-21ksoftirqd/321:57:173
2202991513,1cyclictest41-21ksoftirqd/322:57:003
220299150,14cyclictest27257-21kworker/3:223:23:423
220299150,14cyclictest17280-21kworker/3:221:18:513
2184991513,1cyclictest752-21snmpd20:28:371
2184991512,1cyclictest25-21ksoftirqd/121:29:231
218199156,9cyclictest0-21swapper/020:12:470
190572150,0sleep50-21swapper/500:30:125
80342140,0sleep00-21swapper/021:23:220
49292140,0sleep70-21swapper/722:12:467
309562140,0sleep70-21swapper/719:59:217
226292140,0sleep40-21swapper/422:42:394
2226991412,1cyclictest8166-21sshd22:20:417
2226991410,1cyclictest73-21ksoftirqd/721:39:407
2219991412,1cyclictest65-21ksoftirqd/622:07:456
2214991412,1cyclictest57-21ksoftirqd/523:29:315
2214991412,1cyclictest57-21ksoftirqd/522:43:305
2214991412,1cyclictest57-21ksoftirqd/522:33:415
2214991412,1cyclictest57-21ksoftirqd/521:26:435
2214991412,1cyclictest57-21ksoftirqd/500:05:305
2214991411,3cyclictest57-21ksoftirqd/500:19:065
220999142,2cyclictest721-21dbus-daemon22:34:414
2209991412,1cyclictest49-21ksoftirqd/423:59:344
2209991411,2cyclictest49-21ksoftirqd/423:26:304
2202991413,1cyclictest41-21ksoftirqd/323:40:553
2202991413,1cyclictest41-21ksoftirqd/323:35:533
2202991413,1cyclictest41-21ksoftirqd/300:31:233
2202991412,1cyclictest41-21ksoftirqd/323:26:003
2202991412,1cyclictest41-21ksoftirqd/321:23:413
2202991412,1cyclictest41-21ksoftirqd/300:17:423
2202991410,3cyclictest41-21ksoftirqd/323:17:173
2196991412,1cyclictest23611-21sshd23:54:162
211682140,0sleep20-21swapper/200:03:422
151052140,0sleep60-21swapper/600:14:446
147162140,0sleep60-21swapper/600:10:596
8222130,0sleep70-21swapper/723:41:217
59912130,0sleep00-21swapper/023:28:080
33272130,1sleep773-21ksoftirqd/723:47:137
285362130,0sleep50-21swapper/523:46:475
222699138,3cyclictest73-21ksoftirqd/722:15:517
2226991311,1cyclictest73-21ksoftirqd/722:41:527
221999139,3cyclictest65-21ksoftirqd/623:55:436
221999130,12cyclictest21644-21kworker/6:221:38:346
2214991310,2cyclictest29095-21sshd21:45:305
2214991310,1cyclictest57-21ksoftirqd/522:47:365
221499130,2cyclictest16172-21sshd23:03:365
220999137,3cyclictest49-21ksoftirqd/400:15:204
2209991312,1cyclictest49-21ksoftirqd/422:31:114
2209991312,1cyclictest49-21ksoftirqd/422:21:094
2209991311,1cyclictest49-21ksoftirqd/422:56:034
2209991311,1cyclictest49-21ksoftirqd/421:48:104
2209991311,1cyclictest49-21ksoftirqd/421:42:384
2209991310,2cyclictest49-21ksoftirqd/423:09:534
2209991310,2cyclictest49-21ksoftirqd/400:13:544
220999130,12cyclictest4326-21grepconf.sh22:47:184
220299139,4cyclictest41-21ksoftirqd/322:11:153
220299139,1cyclictest41-21ksoftirqd/323:05:163
220299139,1cyclictest41-21ksoftirqd/322:07:573
220299138,4cyclictest41-21ksoftirqd/322:34:263
2202991312,1cyclictest41-21ksoftirqd/323:47:263
2202991312,1cyclictest41-21ksoftirqd/300:21:423
2202991311,2cyclictest41-21ksoftirqd/300:38:053
2202991311,1cyclictest41-21ksoftirqd/322:49:373
2202991311,1cyclictest41-21ksoftirqd/321:52:313
2202991311,1cyclictest41-21ksoftirqd/321:29:223
2202991311,1cyclictest41-21ksoftirqd/321:13:553
2202991311,1cyclictest41-21ksoftirqd/300:24:283
2202991311,1cyclictest41-21ksoftirqd/300:13:443
220299130,12cyclictest24710-21kworker/3:123:01:473
219699133,4cyclictest32659-21systemd-cgroups23:47:022
2196991310,2cyclictest721-21dbus-daemon23:01:162
218199131,2cyclictest0-21swapper/019:19:150
218199130,3cyclictest0-21swapper/023:04:170
218199130,3cyclictest0-21swapper/020:22:410
218199130,12cyclictest17992-21sshd00:03:310
184182130,0sleep20-21swapper/221:43:022
289252120,0sleep70-21swapper/721:32:187
232592120,0sleep023244-21sshd21:39:320
222699127,2cyclictest15463-21bash22:30:417
2226991210,1cyclictest73-21ksoftirqd/723:30:497
2226991210,1cyclictest73-21ksoftirqd/700:12:407
222699121,1cyclictest131rcu_sched21:18:057
221999129,2cyclictest15362-21systemd00:01:256
2219991211,1cyclictest65-21ksoftirqd/623:29:346
2219991211,1cyclictest65-21ksoftirqd/623:15:026
2219991210,1cyclictest65-21ksoftirqd/621:26:216
2219991210,1cyclictest65-21ksoftirqd/621:21:146
2219991210,1cyclictest65-21ksoftirqd/621:16:476
2219991210,1cyclictest1-21systemd22:16:166
221999120,11cyclictest8573-21bash00:25:516
221999120,11cyclictest2398-21grepconf.sh22:43:236
221499129,2cyclictest57-21ksoftirqd/523:54:585
221499129,2cyclictest57-21ksoftirqd/500:00:255
221499128,1cyclictest57-21ksoftirqd/523:12:185
221499125,6cyclictest17316-21id21:20:025
221499124,4cyclictest3849-21cp22:37:335
2214991211,1cyclictest57-21ksoftirqd/522:50:225
2214991210,1cyclictest57-21ksoftirqd/523:20:235
2214991210,1cyclictest31940-21sshd23:08:205
2214991210,1cyclictest27435-21sshd22:16:085
220999124,4cyclictest857-21polkitd23:15:344
2209991210,2cyclictest49-21ksoftirqd/421:21:524
2209991210,2cyclictest49-21ksoftirqd/421:17:224
2209991210,1cyclictest49-21ksoftirqd/423:31:374
2209991210,1cyclictest49-21ksoftirqd/422:14:314
2209991210,1cyclictest49-21ksoftirqd/422:02:064
2209991210,1cyclictest49-21ksoftirqd/421:29:394
2209991210,1cyclictest49-21ksoftirqd/400:22:384
2209991210,1cyclictest49-21ksoftirqd/400:04:404
220999120,12cyclictest29455-21kworker/4:323:20:184
220999120,11cyclictest14846-21grepconf.sh23:07:194
220999120,11cyclictest0-21swapper/423:44:134
220299129,2cyclictest41-21ksoftirqd/321:46:413
220299128,3cyclictest41-21ksoftirqd/323:11:523
2202991211,1cyclictest41-21ksoftirqd/321:35:443
2202991210,1cyclictest41-21ksoftirqd/322:42:113
2202991210,1cyclictest41-21ksoftirqd/322:31:373
2202991210,1cyclictest41-21ksoftirqd/321:26:593
219699129,2cyclictest33-21ksoftirqd/222:20:242
219699125,4cyclictest2683-21sshd00:10:112
219699125,3cyclictest709-21systemd-logind23:11:222
219699122,4cyclictest721-21dbus-daemon23:41:112
219699122,4cyclictest709-21systemd-logind00:17:082
219699122,4cyclictest2147-21sshd23:31:552
219699122,4cyclictest14465-21sshd23:55:352
219699122,4cyclictest1-21systemd21:47:162
2196991211,1cyclictest33-21ksoftirqd/221:34:402
2196991210,1cyclictest33-21ksoftirqd/222:07:352
2184991211,1cyclictest25-21ksoftirqd/121:09:211
218199127,3cyclictest9-21ksoftirqd/023:47:350
218199127,1cyclictest9-21ksoftirqd/022:10:410
218199123,9cyclictest0-21swapper/020:30:450
218199123,9cyclictest0-21swapper/019:27:110
218199123,9cyclictest0-21swapper/019:12:090
218199123,6cyclictest0-21swapper/021:04:030
218199123,5cyclictest721-21dbus-daemon00:05:470
2181991211,1cyclictest9-21ksoftirqd/022:30:080
2181991210,1cyclictest9-21ksoftirqd/023:55:120
2181991210,1cyclictest9-21ksoftirqd/023:10:270
2181991210,1cyclictest9-21ksoftirqd/021:35:320
2181991210,1cyclictest9-21ksoftirqd/000:34:050
218199120,3cyclictest0-21swapper/020:09:150
218199120,3cyclictest0-21swapper/019:40:150
118622120,0sleep70-21swapper/700:37:277
114772120,0sleep20-21swapper/200:29:452
80372110,0sleep70-21swapper/721:09:277
306242110,0sleep70-21swapper/723:52:427
222699119,1cyclictest73-21ksoftirqd/722:46:107
222699119,1cyclictest73-21ksoftirqd/721:53:257
222699118,2cyclictest73-21ksoftirqd/721:36:117
222699114,4cyclictest8877-21bash21:25:137
222699114,4cyclictest4787-21bash23:26:037
2226991110,1cyclictest73-21ksoftirqd/723:14:417
2226991110,1cyclictest73-21ksoftirqd/722:37:107
2226991110,1cyclictest0-21swapper/722:07:227
222699110,1cyclictest0-21swapper/721:44:597
221999119,1cyclictest65-21ksoftirqd/622:21:096
221999119,1cyclictest65-21ksoftirqd/600:34:006
221999118,1cyclictest65-21ksoftirqd/622:34:366
221999116,4cyclictest65-21ksoftirqd/622:25:246
221999113,5cyclictest9675-21systemd21:51:596
2219991110,1cyclictest65-21ksoftirqd/623:47:436
2219991110,1cyclictest65-21ksoftirqd/623:38:586
2219991110,1cyclictest65-21ksoftirqd/622:51:396
221999110,1cyclictest19708-21systemd23:25:006
221999110,1cyclictest0-21swapper/621:34:206
221499119,1cyclictest57-21ksoftirqd/521:53:305
221499119,1cyclictest57-21ksoftirqd/500:36:135
221499117,1cyclictest20004-21sshd00:20:505
221499113,3cyclictest23035-21sshd21:39:315
221499111,4cyclictest0-21swapper/523:26:305
220999119,1cyclictest49-21ksoftirqd/423:47:354
220999119,1cyclictest49-21ksoftirqd/423:35:394
220999119,1cyclictest49-21ksoftirqd/421:52:154
220999119,1cyclictest49-21ksoftirqd/400:34:214
220999119,1cyclictest10964-21systemd-cgroups21:27:224
2209991110,1cyclictest0-21swapper/400:29:324
220999110,1cyclictest25299-21sshd22:27:264
220299119,1cyclictest41-21ksoftirqd/323:31:083
220299119,1cyclictest41-21ksoftirqd/321:40:343
2202991110,1cyclictest41-21ksoftirqd/322:14:293
219699113,7cyclictest2453-21systemd-cgroups21:24:492
219699113,7cyclictest17546-21sshd22:55:492
219699112,4cyclictest5434-21sshd00:35:082
219699111,4cyclictest18000-21sshd22:38:272
219699111,4cyclictest16765-21sshd22:48:022
219699110,5cyclictest4611-21grepconf.sh21:19:242
219699110,5cyclictest4398-21sshd00:19:522
219699110,5cyclictest15151-21systemd22:49:452
219699110,11cyclictest3597-21kworker/2:223:20:382
219699110,11cyclictest15360-21kworker/2:522:28:362
219699110,11cyclictest12232-21kworker/2:022:11:022
219699110,10cyclictest1157-21systemd-cgroups00:27:212
219699110,1cyclictest6349-21sshd21:55:322
219699110,1cyclictest6349-21sshd21:55:322
2184991110,1cyclictest7486-21kworker/1:019:56:261
2184991110,1cyclictest25-21ksoftirqd/120:39:381
218199119,1cyclictest9-21ksoftirqd/022:56:110
218199119,1cyclictest9-21ksoftirqd/022:47:100
218199119,1cyclictest9-21ksoftirqd/022:23:100
218199119,1cyclictest9-21ksoftirqd/022:18:000
218199119,1cyclictest25276-21sshd00:19:190
218199118,1cyclictest9-21ksoftirqd/023:21:180
218199114,4cyclictest14056-21sshd00:12:510
218199113,4cyclictest0-21swapper/020:56:090
218199112,9cyclictest0-21swapper/020:47:430
218199112,9cyclictest0-21swapper/020:27:170
2181991110,1cyclictest9-21ksoftirqd/022:01:390
218199111,6cyclictest0-21swapper/019:56:410
218199111,10cyclictest0-21swapper/020:41:170
218199111,10cyclictest0-21swapper/019:47:590
218199110,11cyclictest6032-21kworker/0:000:36:400
218199110,11cyclictest0-21swapper/020:01:590
218199110,10cyclictest4439-21sshd00:21:490
222699109,1cyclictest73-21ksoftirqd/723:20:297
222699108,2cyclictest73-21ksoftirqd/721:21:427
222699108,1cyclictest73-21ksoftirqd/723:37:147
222699108,1cyclictest73-21ksoftirqd/722:25:367
222699108,1cyclictest73-21ksoftirqd/722:03:167
222699108,1cyclictest73-21ksoftirqd/700:19:527
222699105,1cyclictest73-21ksoftirqd/723:01:347
222699102,5cyclictest709-21systemd-logind23:11:177
222699102,5cyclictest11866-21sshd00:26:037
222699102,4cyclictest13635-21systemd00:18:367
222699100,10cyclictest8819-21kworker/7:000:08:537
221999109,1cyclictest65-21ksoftirqd/621:55:416
221999109,1cyclictest65-21ksoftirqd/621:55:416
221999108,1cyclictest65-21ksoftirqd/623:41:016
221999108,1cyclictest65-21ksoftirqd/600:06:596
221999104,3cyclictest30718-21sshd21:41:516
221999103,4cyclictest13823-21sshd23:49:426
221999103,3cyclictest0-21swapper/621:45:146
221999102,5cyclictest18876-21cp22:44:236
221999102,4cyclictest17867-21bash21:12:126
221499108,1cyclictest57-21ksoftirqd/523:17:485
221499108,1cyclictest57-21ksoftirqd/521:09:575
220999108,1cyclictest49-21ksoftirqd/422:08:114
220999107,2cyclictest49-21ksoftirqd/421:36:314
219699108,1cyclictest33-21ksoftirqd/221:18:372
219699103,6cyclictest721-21dbus-daemon22:41:142
219699103,6cyclictest721-21dbus-daemon00:05:002
219699100,4cyclictest23263-21sshd21:50:482
219699100,4cyclictest0-21swapper/223:34:472
219699100,10cyclictest21907-21kworker/2:121:31:052
218499109,1cyclictest7486-21kworker/1:020:01:381
218499109,1cyclictest7486-21kworker/1:019:21:161
218499109,1cyclictest7486-21kworker/1:019:09:281
218499109,1cyclictest25-21ksoftirqd/120:59:321
218499109,1cyclictest25-21ksoftirqd/120:44:331
218499108,1cyclictest25-21ksoftirqd/120:34:321
218199109,1cyclictest9-21ksoftirqd/023:36:380
218199109,1cyclictest9-21ksoftirqd/022:27:250
218199108,1cyclictest9-21ksoftirqd/023:52:510
218199108,1cyclictest9-21ksoftirqd/023:39:290
218199108,1cyclictest9-21ksoftirqd/023:08:380
218199108,1cyclictest9-21ksoftirqd/021:57:140
218199108,1cyclictest9-21ksoftirqd/021:57:140
218199108,1cyclictest9-21ksoftirqd/021:49:390
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional