You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-15 - 04:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun Nov 15, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
143972840,0sleep2311rcuc/221:16:482
199582760,1sleep319959-21sshd22:41:233
141582750,2sleep11561499cyclictest22:46:501
141582750,2sleep11561499cyclictest22:46:501
131132740,0sleep10-21swapper/119:07:131
188262700,0sleep60-21swapper/622:48:556
122622530,1sleep612260-21grepconf.sh21:24:056
29732500,2sleep61563399cyclictest20:46:576
1485525028,8sleep50-21swapper/518:59:575
61262490,1sleep06125-21bash21:29:280
303942490,0sleep10-21swapper/120:46:041
189532480,0sleep30-21swapper/322:43:073
189532480,0sleep30-21swapper/322:43:073
210582470,0sleep10-21swapper/121:52:351
134432470,0sleep50-21swapper/523:11:135
41122460,0sleep34110-21sshd00:14:383
79412450,1sleep1721-21dbus-daemon23:32:151
66922450,0sleep70-21swapper/700:12:267
325222450,1sleep4721-21dbus-daemon23:19:374
307622440,0sleep40-21swapper/422:28:354
29732440,0sleep60-21swapper/600:00:236
259162440,0sleep20-21swapper/222:47:312
143192430,0sleep7758-21runrttasks21:42:567
117152430,0sleep50-21swapper/500:01:025
116212430,0sleep20-21swapper/221:22:172
96382420,0sleep7721ktimersoftd/719:27:377
1500924227,8sleep60-21swapper/619:02:066
323982410,0sleep60-21swapper/621:40:236
285852410,0sleep3401ktimersoftd/323:21:443
275242410,0sleep20-21swapper/222:02:222
271212410,1sleep416470-21kworker/4:021:40:054
237472410,0sleep00-21swapper/022:43:280
237472410,0sleep00-21swapper/022:43:280
23262410,0sleep20-21swapper/222:32:332
220402410,0sleep00-21swapper/000:13:310
151092410,0sleep3401ktimersoftd/320:22:193
98352400,0sleep30-21swapper/322:57:493
304242400,0sleep50-21swapper/523:36:115
1487224027,9sleep40-21swapper/419:00:124
1475924029,8sleep20-21swapper/218:58:422
306722390,0sleep70-21swapper/723:57:367
1350423927,8sleep70-21swapper/718:57:357
125162390,1sleep61563399cyclictest22:38:546
52552380,0sleep10-21swapper/120:25:541
1474823826,8sleep00-21swapper/018:58:320
1255223826,8sleep30-21swapper/318:57:233
1255023827,8sleep10-21swapper/118:57:211
284372360,1sleep4758-21runrttasks21:34:284
221472360,2sleep21561599cyclictest21:28:262
240922230,0sleep70-21swapper/723:23:407
1561699228,1cyclictest41-21ksoftirqd/323:27:203
278242210,2sleep31561699cyclictest00:04:293
1561699217,3cyclictest41-21ksoftirqd/322:05:193
1561699211,3cyclictest41-21ksoftirqd/323:49:563
1561699207,2cyclictest41-21ksoftirqd/321:46:123
1561699202,3cyclictest41-21ksoftirqd/321:24:233
69772190,0sleep40-21swapper/422:32:434
1563999197,2cyclictest73-21ksoftirqd/723:36:537
1563999190,5cyclictest121rcu_preempt19:56:267
1561699194,3cyclictest41-21ksoftirqd/322:01:463
15616991917,1cyclictest41-21ksoftirqd/322:17:403
1561699190,1cyclictest131rcu_sched21:49:133
1561699190,1cyclictest131rcu_sched21:49:133
96802180,0sleep60-21swapper/623:46:386
5692180,0sleep2321ktimersoftd/220:08:572
1563999186,3cyclictest73-21ksoftirqd/722:24:507
15639991814,1cyclictest73-21ksoftirqd/721:22:087
15639991811,4cyclictest73-21ksoftirqd/721:38:577
1561699185,3cyclictest41-21ksoftirqd/323:13:453
1561699185,2cyclictest41-21ksoftirqd/323:06:033
1561699185,2cyclictest41-21ksoftirqd/321:35:033
1561699185,1cyclictest41-21ksoftirqd/323:09:253
1561699184,3cyclictest41-21ksoftirqd/300:08:503
1561699183,3cyclictest41-21ksoftirqd/322:51:583
1561699182,3cyclictest41-21ksoftirqd/321:54:023
15616991816,1cyclictest41-21ksoftirqd/322:53:553
15616991816,1cyclictest41-21ksoftirqd/322:23:263
15616991816,1cyclictest41-21ksoftirqd/321:15:243
15616991816,1cyclictest41-21ksoftirqd/300:27:223
15616991815,3cyclictest41-21ksoftirqd/323:38:103
15616991814,1cyclictest131rcu_sched22:34:093
1563999175,11cyclictest73-21ksoftirqd/700:04:457
15639991715,1cyclictest73-21ksoftirqd/722:30:357
15639991715,1cyclictest73-21ksoftirqd/722:12:297
15639991715,1cyclictest73-21ksoftirqd/721:37:097
15639991715,1cyclictest721-21dbus-daemon21:24:347
15639991714,1cyclictest73-21ksoftirqd/700:25:327
15639991713,3cyclictest73-21ksoftirqd/723:42:597
15639991713,1cyclictest73-21ksoftirqd/722:52:217
15639991712,2cyclictest73-21ksoftirqd/721:54:587
1561699173,3cyclictest41-21ksoftirqd/322:15:003
1561699172,3cyclictest41-21ksoftirqd/323:44:013
1561699172,2cyclictest41-21ksoftirqd/323:32:333
15616991715,1cyclictest41-21ksoftirqd/321:41:443
15616991715,1cyclictest41-21ksoftirqd/300:00:453
15616991715,1cyclictest391rcuc/322:27:253
15616991714,2cyclictest464-21systemd-journal21:06:033
15616991713,3cyclictest41-21ksoftirqd/321:28:143
15616991713,1cyclictest41-21ksoftirqd/319:56:263
1561699170,1cyclictest131rcu_sched00:25:313
15614991713,3cyclictest25-21ksoftirqd/122:19:091
124302170,0sleep50-21swapper/523:56:225
1563999166,4cyclictest73-21ksoftirqd/723:31:087
15639991615,1cyclictest73-21ksoftirqd/722:43:217
15639991615,1cyclictest73-21ksoftirqd/722:43:217
15639991614,1cyclictest73-21ksoftirqd/722:57:327
15639991614,1cyclictest73-21ksoftirqd/722:38:247
15639991614,1cyclictest73-21ksoftirqd/722:11:527
15639991614,1cyclictest73-21ksoftirqd/700:10:457
15639991612,3cyclictest73-21ksoftirqd/723:17:267
15639991612,1cyclictest73-21ksoftirqd/722:32:217
15639991611,4cyclictest73-21ksoftirqd/723:55:487
15639991611,1cyclictest73-21ksoftirqd/721:27:227
1563999161,2cyclictest131rcu_sched22:06:087
1563999160,0cyclictest131rcu_sched21:13:077
15629991613,1cyclictest57-21ksoftirqd/522:49:435
15622991614,1cyclictest49-21ksoftirqd/423:38:344
1561699162,3cyclictest41-21ksoftirqd/321:07:303
15616991615,1cyclictest41-21ksoftirqd/323:54:103
15616991615,1cyclictest41-21ksoftirqd/323:25:163
15616991614,1cyclictest41-21ksoftirqd/322:08:103
15616991614,1cyclictest41-21ksoftirqd/321:17:423
15616991613,3cyclictest41-21ksoftirqd/319:35:263
15616991612,1cyclictest131rcu_sched20:24:083
1561699160,1cyclictest131rcu_sched20:45:453
1561599169,5cyclictest33-21ksoftirqd/222:44:502
1561599169,5cyclictest33-21ksoftirqd/222:44:502
71722150,0sleep00-21swapper/019:48:370
261122150,0sleep10-21swapper/120:39:551
15639991514,1cyclictest73-21ksoftirqd/723:49:147
15639991513,1cyclictest73-21ksoftirqd/723:17:057
15639991513,1cyclictest73-21ksoftirqd/723:07:377
15639991513,1cyclictest73-21ksoftirqd/721:58:307
15639991513,1cyclictest73-21ksoftirqd/700:19:247
15639991511,2cyclictest73-21ksoftirqd/721:49:137
15639991511,2cyclictest73-21ksoftirqd/721:49:137
15639991510,3cyclictest73-21ksoftirqd/721:07:567
1563999150,15cyclictest6772-21kworker/7:122:48:587
1563999150,14cyclictest13997-21kworker/7:022:17:227
1562999159,4cyclictest7355-21sshd22:46:265
1562999159,4cyclictest7355-21sshd22:46:265
15629991513,2cyclictest26242-21sshd23:05:025
15622991514,1cyclictest49-21ksoftirqd/423:29:414
15622991514,1cyclictest49-21ksoftirqd/421:21:084
15622991513,1cyclictest49-21ksoftirqd/422:42:394
15622991513,1cyclictest49-21ksoftirqd/422:42:394
15622991513,1cyclictest49-21ksoftirqd/421:10:334
15622991512,3cyclictest49-21ksoftirqd/423:01:574
1561699155,1cyclictest41-21ksoftirqd/319:45:193
15616991514,1cyclictest41-21ksoftirqd/320:06:563
15616991513,1cyclictest721-21dbus-daemon20:33:463
15616991513,1cyclictest41-21ksoftirqd/319:05:323
15616991512,3cyclictest41-21ksoftirqd/320:15:113
15616991511,1cyclictest41-21ksoftirqd/300:20:263
1561699150,15cyclictest14059-21kworker/3:220:49:433
15615991512,1cyclictest9446-21sshd22:40:452
15614991513,1cyclictest25-21ksoftirqd/121:47:211
15614991513,1cyclictest25-21ksoftirqd/121:47:211
1561499150,1cyclictest131rcu_sched22:34:431
256702140,0sleep20-21swapper/223:26:152
1563999149,1cyclictest73-21ksoftirqd/720:45:457
1563999145,1cyclictest73-21ksoftirqd/723:37:517
1563999142,2cyclictest73-21ksoftirqd/719:32:527
15639991412,1cyclictest73-21ksoftirqd/720:12:227
15639991412,1cyclictest73-21ksoftirqd/700:27:367
15639991411,3cyclictest73-21ksoftirqd/720:57:377
15639991411,3cyclictest73-21ksoftirqd/720:57:377
15639991410,3cyclictest73-21ksoftirqd/719:49:027
15639991410,1cyclictest73-21ksoftirqd/721:04:157
15629991412,1cyclictest57-21ksoftirqd/521:20:305
15622991413,1cyclictest49-21ksoftirqd/422:17:374
15622991413,1cyclictest49-21ksoftirqd/421:52:414
15622991413,1cyclictest49-21ksoftirqd/421:46:294
15622991413,1cyclictest49-21ksoftirqd/421:28:504
15622991412,1cyclictest49-21ksoftirqd/422:09:244
15622991412,1cyclictest49-21ksoftirqd/400:24:584
15622991411,2cyclictest49-21ksoftirqd/400:00:044
15622991410,3cyclictest49-21ksoftirqd/421:04:014
1562299140,1cyclictest131rcu_sched22:16:544
15616991413,1cyclictest41-21ksoftirqd/320:01:523
15616991412,1cyclictest41-21ksoftirqd/320:59:083
15616991412,1cyclictest41-21ksoftirqd/320:59:083
15616991412,1cyclictest41-21ksoftirqd/320:37:313
15616991410,1cyclictest41-21ksoftirqd/319:14:303
1561699141,3cyclictest41-21ksoftirqd/319:21:453
15615991412,2cyclictest33-21ksoftirqd/221:07:522
1561499149,4cyclictest25-21ksoftirqd/122:50:331
15614991413,1cyclictest25-21ksoftirqd/122:11:181
15614991413,1cyclictest25-21ksoftirqd/121:59:401
15614991413,1cyclictest25-21ksoftirqd/121:17:101
15614991413,1cyclictest25-21ksoftirqd/121:07:401
15614991412,1cyclictest25-21ksoftirqd/123:08:251
15614991412,1cyclictest25-21ksoftirqd/122:04:291
15614991412,1cyclictest25-21ksoftirqd/121:03:201
15614991410,1cyclictest25-21ksoftirqd/122:29:201
15613991412,1cyclictest9-21ksoftirqd/021:04:210
1561399140,1cyclictest0-21swapper/023:55:450
289672130,0sleep00-21swapper/000:04:340
254632130,2sleep225462-21grep22:55:002
197622130,0sleep60-21swapper/623:30:366
196272130,0sleep60-21swapper/622:33:336
194272130,0sleep40-21swapper/419:50:494
186072130,0sleep00-21swapper/021:45:060
182762130,0sleep5561ktimersoftd/519:45:135
1563999136,4cyclictest73-21ksoftirqd/719:22:407
15639991311,1cyclictest73-21ksoftirqd/723:02:207
15639991311,1cyclictest73-21ksoftirqd/719:58:427
15639991311,1cyclictest73-21ksoftirqd/719:19:087
1563399132,5cyclictest24754-21bash00:23:266
15633991311,1cyclictest65-21ksoftirqd/621:45:396
1562999138,2cyclictest28667-21sshd21:49:205
1562999138,2cyclictest28667-21sshd21:49:205
15629991312,1cyclictest57-21ksoftirqd/523:01:075
15629991312,1cyclictest57-21ksoftirqd/522:17:375
15629991311,1cyclictest57-21ksoftirqd/522:15:115
15622991311,1cyclictest49-21ksoftirqd/423:12:374
15622991311,1cyclictest49-21ksoftirqd/423:02:214
15622991311,1cyclictest49-21ksoftirqd/422:04:394
15622991311,1cyclictest49-21ksoftirqd/400:31:254
15622991310,1cyclictest49-21ksoftirqd/423:48:174
15616991312,1cyclictest41-21ksoftirqd/320:10:153
15616991311,1cyclictest41-21ksoftirqd/320:31:093
15616991311,1cyclictest41-21ksoftirqd/319:47:323
15616991311,1cyclictest41-21ksoftirqd/319:32:203
1561499138,3cyclictest25-21ksoftirqd/100:04:331
15614991311,1cyclictest25-21ksoftirqd/123:35:341
15614991311,1cyclictest25-21ksoftirqd/123:16:041
15614991311,1cyclictest25-21ksoftirqd/122:22:341
15614991311,1cyclictest25-21ksoftirqd/121:34:061
15614991311,1cyclictest25-21ksoftirqd/100:27:451
15614991311,1cyclictest25-21ksoftirqd/100:12:561
1561399138,1cyclictest9-21ksoftirqd/023:12:520
1561399132,5cyclictest29044-21sshd23:00:560
15613991311,1cyclictest9-21ksoftirqd/000:30:280
15613991310,1cyclictest9-21ksoftirqd/020:12:360
86562120,0sleep50-21swapper/521:44:305
48932120,1sleep54892-21grepconf.sh22:01:045
47162120,0sleep10-21swapper/100:07:311
288752120,0sleep50-21swapper/522:37:495
249582120,1sleep09-21ksoftirqd/022:05:560
238822120,0sleep20-21swapper/220:12:412
224282120,0sleep50-21swapper/500:11:115
220612120,0sleep40-21swapper/421:48:544
220612120,0sleep40-21swapper/421:48:544
1563999128,1cyclictest73-21ksoftirqd/719:08:477
15639991211,1cyclictest73-21ksoftirqd/720:12:197
15639991210,1cyclictest73-21ksoftirqd/720:49:277
15639991210,1cyclictest73-21ksoftirqd/720:36:437
15639991210,1cyclictest73-21ksoftirqd/720:04:397
15639991210,1cyclictest73-21ksoftirqd/719:46:127
15639991210,1cyclictest73-21ksoftirqd/719:17:067
1563399129,2cyclictest14843-21systemd21:11:126
1563399122,4cyclictest7974-21sshd22:14:226
1563399122,4cyclictest721-21dbus-daemon21:50:126
1563399122,4cyclictest721-21dbus-daemon21:50:126
1563399122,4cyclictest21635-21sshd23:25:576
1563399122,4cyclictest16080-21grep21:59:486
1563399122,4cyclictest15813-21systemd-cgroups20:00:576
1563399122,4cyclictest0-21swapper/623:02:246
1563399122,3cyclictest0-21swapper/619:09:026
15633991211,1cyclictest65-21ksoftirqd/623:55:506
15633991211,1cyclictest65-21ksoftirqd/621:12:276
15633991210,1cyclictest65-21ksoftirqd/622:29:596
1562999129,3cyclictest21919-21sshd23:14:045
1562999128,3cyclictest57-21ksoftirqd/521:04:335
15629991210,1cyclictest663-21in:imjournal23:38:145
15629991210,1cyclictest57-21ksoftirqd/522:04:105
15629991210,1cyclictest57-21ksoftirqd/521:12:375
15629991210,1cyclictest57-21ksoftirqd/521:11:075
15629991210,1cyclictest57-21ksoftirqd/500:23:365
1562999120,4cyclictest0-21swapper/523:45:225
1562999120,11cyclictest29356-21kworker/5:323:25:075
1562299129,1cyclictest49-21ksoftirqd/400:19:224
1562299126,4cyclictest49-21ksoftirqd/422:23:464
1562299125,4cyclictest19554-21bash21:15:124
1562299123,5cyclictest12439-21sshd21:57:374
15622991211,1cyclictest49-21ksoftirqd/422:38:204
15622991211,1cyclictest49-21ksoftirqd/421:22:204
15622991211,1cyclictest49-21ksoftirqd/419:12:564
15622991210,1cyclictest49-21ksoftirqd/423:44:204
15622991210,1cyclictest49-21ksoftirqd/423:32:224
15622991210,1cyclictest49-21ksoftirqd/423:22:374
15622991210,1cyclictest49-21ksoftirqd/422:53:524
15622991210,1cyclictest49-21ksoftirqd/420:16:014
15622991210,1cyclictest49-21ksoftirqd/400:16:394
15622991210,1cyclictest49-21ksoftirqd/400:10:494
15622991210,1cyclictest49-21ksoftirqd/400:04:374
15622991210,1cyclictest16670-21kworker/4:022:48:064
1561699124,5cyclictest41-21ksoftirqd/320:53:573
15616991210,1cyclictest41-21ksoftirqd/319:37:513
15616991210,1cyclictest41-21ksoftirqd/319:07:373
1561599122,4cyclictest7264-21sshd21:53:362
1561599122,4cyclictest17480-21bash00:30:092
1561599122,4cyclictest0-21swapper/223:57:272
15615991211,1cyclictest33-21ksoftirqd/222:15:332
1561599120,12cyclictest2651-21bash21:34:522
1561599120,11cyclictest7484-21/usr/sbin/munin20:47:342
1561599120,11cyclictest2610-21bash21:40:322
1561499128,1cyclictest25-21ksoftirqd/121:44:201
1561499127,5cyclictest25-21ksoftirqd/123:06:381
15614991211,1cyclictest25-21ksoftirqd/123:49:461
15614991211,1cyclictest25-21ksoftirqd/121:24:581
15614991211,1cyclictest25-21ksoftirqd/120:53:121
15614991211,1cyclictest25-21ksoftirqd/120:32:361
15614991211,1cyclictest25-21ksoftirqd/100:20:161
15614991210,1cyclictest25-21ksoftirqd/123:42:071
15614991210,1cyclictest25-21ksoftirqd/122:56:551
15614991210,1cyclictest25-21ksoftirqd/122:15:441
15614991210,1cyclictest25-21ksoftirqd/121:19:211
15614991210,1cyclictest25-21ksoftirqd/100:26:291
1561499120,12cyclictest0-21swapper/119:34:231
1561399129,2cyclictest19395-21systemd23:18:360
1561399129,2cyclictest14851-21sshd22:25:560
1561399122,4cyclictest11218-21sshd23:08:360
1561399122,4cyclictest1-21systemd22:30:060
1561399122,4cyclictest0-21swapper/021:53:090
1561399122,4cyclictest0-21swapper/021:26:310
1561399122,4cyclictest0-21swapper/021:07:310
15613991211,1cyclictest9-21ksoftirqd/023:51:130
15613991210,1cyclictest730-21NetworkManager20:29:350
1561399120,12cyclictest27334-21kworker/0:522:15:090
1561399120,12cyclictest22465-21kworker/0:021:40:100
1561399120,11cyclictest23285-21kworker/0:322:56:250
1561399120,11cyclictest13142-21kworker/0:222:39:230
90182110,0sleep10-21swapper/119:59:431
75052110,0sleep10-21swapper/121:27:371
59532110,0sleep50-21swapper/520:42:075
28612110,0sleep20-21swapper/220:36:122
276172110,0sleep20-21swapper/200:04:282
219082110,1sleep021905-21grepconf.sh22:02:040
1563999119,1cyclictest73-21ksoftirqd/720:54:117
1563999119,1cyclictest73-21ksoftirqd/720:17:377
1563999119,1cyclictest73-21ksoftirqd/719:37:377
1563999118,3cyclictest73-21ksoftirqd/719:07:057
1563999118,2cyclictest73-21ksoftirqd/720:37:547
1563999117,1cyclictest73-21ksoftirqd/720:24:407
15639991110,1cyclictest73-21ksoftirqd/720:27:557
1563399119,1cyclictest65-21ksoftirqd/622:08:596
1563399119,1cyclictest19730-21sshd22:52:436
1563399112,4cyclictest32713-21sshd21:17:446
1563399112,4cyclictest22519-21systemd22:24:286
1563399112,4cyclictest17078-21sshd22:03:316
1563399112,4cyclictest0-21swapper/622:19:116
1563399112,3cyclictest0-21swapper/622:42:296
1563399112,3cyclictest0-21swapper/622:42:296
1563399110,11cyclictest4807-21kworker/6:423:08:366
1563399110,11cyclictest18071-21kworker/6:019:47:506
1563399110,11cyclictest15337-21kworker/6:419:45:126
1563399110,11cyclictest10564-21kworker/6:321:32:446
1563399110,1cyclictest0-21swapper/620:24:326
1562999119,2cyclictest57-21ksoftirqd/521:38:095
1562999119,1cyclictest57-21ksoftirqd/523:30:135
1562999119,1cyclictest57-21ksoftirqd/522:54:465
1562999119,1cyclictest57-21ksoftirqd/522:26:035
1562999119,1cyclictest57-21ksoftirqd/522:09:045
1562999119,1cyclictest57-21ksoftirqd/521:53:335
1562999119,1cyclictest57-21ksoftirqd/521:34:115
1562999119,1cyclictest57-21ksoftirqd/521:22:395
1562999118,2cyclictest721-21dbus-daemon19:06:215
15629991110,1cyclictest57-21ksoftirqd/522:33:295
15629991110,1cyclictest57-21ksoftirqd/521:27:505
1562999111,4cyclictest0-21swapper/523:51:155
1562999110,9cyclictest7440-21systemd23:17:385
1562999110,10cyclictest0-21swapper/500:30:065
1562299119,1cyclictest49-21ksoftirqd/423:53:144
1562299119,1cyclictest49-21ksoftirqd/419:32:274
1562299119,1cyclictest21094-21sshd20:44:234
15622991110,1cyclictest49-21ksoftirqd/423:08:194
15622991110,1cyclictest49-21ksoftirqd/419:10:154
15616991110,1cyclictest41-21ksoftirqd/319:25:343
1561599119,2cyclictest33-21ksoftirqd/222:27:362
1561599119,2cyclictest33-21ksoftirqd/222:00:452
1561599119,2cyclictest33-21ksoftirqd/221:23:262
1561599119,1cyclictest0-21swapper/221:42:262
1561599118,3cyclictest33-21ksoftirqd/221:51:312
1561599118,3cyclictest33-21ksoftirqd/221:51:312
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional