You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 09:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Thu May 21, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2582021290,3sleep13189599cyclictest21:38:101
2818821150,1sleep328187-21sshd22:54:273
31497210833,44sleep10-21swapper/119:08:121
319322880,1sleep041ktimersoftd/022:15:130
114182880,2sleep10-21swapper/122:48:561
131502870,1sleep03-21ksoftirqd/022:38:250
131502870,1sleep03-21ksoftirqd/022:38:240
161242840,2sleep10-21swapper/123:14:161
158732840,3sleep20-21swapper/221:47:332
10502840,4sleep20-21swapper/223:12:362
3161328234,44sleep30-21swapper/319:09:413
208202800,2sleep20-21swapper/222:50:042
270642790,3sleep20-21swapper/200:34:202
189852790,1sleep10-21swapper/123:21:451
288022780,1sleep10-21swapper/100:27:301
135752780,2sleep32512-21runrttasks00:00:513
74902770,0sleep00-21swapper/022:59:090
276752770,1sleep20-21swapper/223:08:202
159232770,1sleep08-21rcu_preempt23:06:530
82622760,0sleep00-21swapper/021:25:430
119502760,1sleep311940-21sshd21:43:333
242532740,1sleep10-21swapper/121:27:281
64412730,2sleep26444-21grep20:35:132
44792730,5sleep33189799cyclictest22:11:503
177942730,1sleep30-21swapper/322:09:543
3144927232,11sleep20-21swapper/219:07:362
168892710,0sleep041ktimersoftd/023:43:330
275132690,3sleep13189599cyclictest22:36:051
275132690,3sleep13189599cyclictest22:36:051
154402690,0sleep041ktimersoftd/021:54:490
116502690,2sleep30-21swapper/300:36:103
116502690,2sleep30-21swapper/300:36:093
256562680,1sleep125648-21sshd22:43:301
182212680,0sleep00-21swapper/021:44:140
179592680,2sleep217956-21bash00:12:002
157172650,2sleep115709-21sshd21:47:321
16112640,4sleep23189699cyclictest21:53:182
321972620,3sleep23189699cyclictest22:18:432
3153625732,13sleep00-21swapper/019:08:430
36612400,2sleep10-21swapper/123:35:121
292672330,0sleep00-21swapper/000:09:500
147342320,29sleep1144650irq/27-eth022:24:001
8512280,1sleep10-21swapper/121:11:051
255662280,1sleep025559-21sshd21:13:490
193392280,6sleep30-21swapper/322:02:453
30302270,2sleep33027-21sshd23:05:243
272222260,2sleep327219-21bash22:43:403
39652250,2sleep20-21swapper/223:59:582
113632250,1sleep10-21swapper/123:57:121
112582253,20sleep1144650irq/27-eth000:21:421
87152240,22sleep3144650irq/27-eth021:25:473
133592240,22sleep1144650irq/27-eth023:53:491
261542230,2sleep33189799cyclictest21:38:123
208562230,4sleep13189599cyclictest00:19:201
74342220,2sleep27337-21sshd23:20:192
3189699225,16cyclictest33-21ksoftirqd/200:02:032
226132220,20sleep1144650irq/27-eth000:12:321
3189799210,11cyclictest10307-21bash22:45:153
31896992116,3cyclictest0-21swapper/223:03:562
303532210,2sleep230344-21sshd23:19:182
131472210,2sleep20-21swapper/221:36:482
3189699205,1cyclictest33-21ksoftirqd/200:20:142
31895992018,1cyclictest0-21swapper/122:53:311
3189499200,18cyclictest0-21swapper/021:32:420
292372200,0sleep129234-21cp22:14:571
257882200,1sleep08-21rcu_preempt00:23:280
213892200,2sleep041ktimersoftd/023:47:420
43582190,17sleep3144650irq/27-eth000:07:053
3189699195,13cyclictest33-21ksoftirqd/222:07:082
31896991915,3cyclictest31692-21sshd23:52:152
3189599190,14cyclictest0-21swapper/121:21:031
114522190,1sleep011450-21sshd23:39:320
81062180,2sleep30-21swapper/321:19:013
3189799183,13cyclictest0-21swapper/322:15:123
3189699185,11cyclictest33-21ksoftirqd/223:35:032
3189699183,1cyclictest11344-21sshd21:33:132
31896991813,4cyclictest20828-21sshd23:47:382
3189599188,8cyclictest0-21swapper/122:55:221
31895991815,2cyclictest3832-21bash22:26:251
31895991810,6cyclictest0-21swapper/100:31:111
64872170,15sleep1144650irq/27-eth021:53:501
3189699176,10cyclictest33-21ksoftirqd/200:29:132
3189699175,11cyclictest33-21ksoftirqd/222:31:122
3189699175,10cyclictest33-21ksoftirqd/222:20:112
3189699174,12cyclictest33-21ksoftirqd/223:33:552
3189699174,12cyclictest33-21ksoftirqd/221:12:332
3189699172,14cyclictest33-21ksoftirqd/222:47:332
3189699170,16cyclictest33-21ksoftirqd/222:13:552
3189599170,12cyclictest2470-21sshd23:27:511
3189599170,11cyclictest6490-21sshd21:18:511
31894991711,5cyclictest8674-21sshd21:57:320
3189499170,13cyclictest0-21swapper/023:00:010
110542170,15sleep1144650irq/27-eth023:06:201
321252160,0sleep00-21swapper/000:38:470
321252160,0sleep00-21swapper/000:38:470
3189799168,6cyclictest0-21swapper/323:30:193
3189799165,4cyclictest0-21swapper/300:22:483
3189799163,5cyclictest144650irq/27-eth021:31:013
3189799161,3cyclictest0-21swapper/323:02:103
3189799160,14cyclictest29065-21sshd21:45:183
3189799160,14cyclictest0-21swapper/323:20:243
3189799160,12cyclictest704-21sshd00:17:073
3189699166,9cyclictest33-21ksoftirqd/200:19:382
3189699165,10cyclictest33-21ksoftirqd/222:27:402
3189699164,11cyclictest33-21ksoftirqd/222:01:422
3189699164,11cyclictest33-21ksoftirqd/200:05:502
3189699163,7cyclictest33-21ksoftirqd/222:58:462
3189699163,6cyclictest33-21ksoftirqd/221:20:292
3189699163,3cyclictest33-21ksoftirqd/223:44:562
3189699163,12cyclictest33-21ksoftirqd/222:42:082
3189599168,4cyclictest24013-21sshd23:47:591
3189599162,13cyclictest2024-21nfsd00:00:191
3189599160,15cyclictest0-21swapper/100:36:441
3189599160,15cyclictest0-21swapper/100:36:441
3189599160,14cyclictest16667-21bash22:17:011
3189599160,14cyclictest0-21swapper/123:32:271
31894991614,1cyclictest25233-21cpuspeed_turbos23:15:140
31894991611,4cyclictest3-21ksoftirqd/022:32:160
3189499160,15cyclictest3-21ksoftirqd/022:12:360
3189499160,15cyclictest0-21swapper/022:25:060
110052160,2sleep311003-21sshd23:46:323
3189799158,6cyclictest0-21swapper/321:59:063
3189799158,5cyclictest18130-21bash22:56:453
3189799154,6cyclictest0-21swapper/323:56:513
3189799153,10cyclictest21333-21sshd22:35:193
3189799153,10cyclictest21333-21sshd22:35:193
3189799153,0cyclictest12952-21sshd23:25:103
31897991511,3cyclictest28640-21sshd23:41:153
3189799150,3cyclictest2264-21id22:33:113
3189799150,3cyclictest0-21swapper/323:17:293
3189799150,14cyclictest0-21swapper/320:20:183
3189799150,14cyclictest0-21swapper/300:25:533
3189799150,13cyclictest144650irq/27-eth023:10:223
3189799150,13cyclictest0-21swapper/321:50:033
3189799150,11cyclictest1438-21df_abs20:25:113
3189699158,6cyclictest2024-21nfsd21:40:202
3189699156,8cyclictest33-21ksoftirqd/222:35:132
3189699156,8cyclictest33-21ksoftirqd/222:35:122
3189699154,2cyclictest25297-21iostat20:05:172
3189699154,10cyclictest33-21ksoftirqd/200:37:442
3189699154,10cyclictest33-21ksoftirqd/200:37:442
31896991512,2cyclictest30550-21sshd23:27:172
31896991512,2cyclictest24668-21sshd21:55:382
31896991512,2cyclictest0-21swapper/221:25:142
3189699150,14cyclictest33-21ksoftirqd/220:52:532
3189599150,6cyclictest28019-21bash22:07:291
3189599150,4cyclictest0-21swapper/121:59:491
3189599150,14cyclictest14863-21bash22:34:391
3189599150,13cyclictest28548-21sshd23:01:171
3189499157,7cyclictest3-21ksoftirqd/023:56:460
3189499156,8cyclictest3-21ksoftirqd/022:05:560
3189499156,8cyclictest30510-21sshd00:27:410
3189499155,9cyclictest3-21ksoftirqd/021:45:130
3189499151,6cyclictest8-21rcu_preempt00:00:000
31894991510,4cyclictest0-21swapper/021:39:290
3189799148,2cyclictest144650irq/27-eth019:55:203
3189799142,11cyclictest144650irq/27-eth022:25:523
3189799142,11cyclictest144650irq/27-eth020:40:273
31897991412,1cyclictest0-21swapper/323:35:423
31897991410,3cyclictest144650irq/27-eth020:03:103
3189799140,13cyclictest0-21swapper/321:21:133
3189799140,13cyclictest0-21swapper/319:16:473
3189799140,13cyclictest0-21swapper/300:30:453
3189799140,13cyclictest0-21swapper/300:10:183
3189799140,12cyclictest14716-21sshd22:20:143
3189799140,12cyclictest12206-21sshd23:50:123
3189799140,12cyclictest0-21swapper/320:35:153
3189699144,1cyclictest33-21ksoftirqd/219:54:592
3189699140,13cyclictest0-21swapper/221:05:232
3189699140,13cyclictest0-21swapper/221:02:292
3189699140,13cyclictest0-21swapper/220:55:292
3189699140,13cyclictest0-21swapper/220:31:012
3189699140,13cyclictest0-21swapper/220:31:002
3189699140,13cyclictest0-21swapper/220:04:462
3189699140,13cyclictest0-21swapper/219:42:032
3189699140,13cyclictest0-21swapper/219:33:532
3189699140,13cyclictest0-21swapper/219:22:372
3189699140,13cyclictest0-21swapper/219:14:372
3189699140,12cyclictest14041-21bash21:16:062
3189599149,4cyclictest144650irq/27-eth020:38:301
3189599142,11cyclictest144650irq/27-eth019:41:051
3189599140,13cyclictest28950irq/26-ahci[00020:30:221
3189599140,13cyclictest28950irq/26-ahci[00020:30:221
3189599140,13cyclictest20639-21sshd00:05:151
3189599140,13cyclictest0-21swapper/121:44:421
3189599140,13cyclictest0-21swapper/120:15:171
3189599140,12cyclictest23312-21sshd21:30:591
3189599140,10cyclictest0-21swapper/119:49:111
3189499148,5cyclictest8-21rcu_preempt21:17:310
3189499146,7cyclictest3-21ksoftirqd/022:51:200
3189499145,8cyclictest3-21ksoftirqd/022:01:030
3189499144,3cyclictest3-21ksoftirqd/000:30:460
3189499143,5cyclictest3-21ksoftirqd/021:23:450
3189499143,1cyclictest3-21ksoftirqd/022:45:170
31894991412,1cyclictest3-21ksoftirqd/023:25:100
3189499140,3cyclictest0-21swapper/021:07:080
3189499140,13cyclictest0-21swapper/023:34:340
3189499140,13cyclictest0-21swapper/023:13:200
3189499140,13cyclictest0-21swapper/020:20:160
3189499140,13cyclictest0-21swapper/019:56:240
102702140,12sleep1144650irq/27-eth022:01:361
3189799139,3cyclictest144650irq/27-eth019:40:283
3189799138,4cyclictest23976-21cpuspeed_turbos21:10:133
3189799138,3cyclictest15790-21munin-node19:45:123
3189799137,5cyclictest0-21swapper/319:25:353
3189799131,6cyclictest144650irq/27-eth020:15:183
3189799131,11cyclictest28950irq/26-ahci[00020:55:083
31897991311,1cyclictest0-21swapper/320:10:153
3189799130,9cyclictest144650irq/27-eth019:10:163
3189799130,4cyclictest19749-21df21:05:123
3189799130,4cyclictest10324-21munin-node20:45:173
3189799130,12cyclictest12079-21munin-node19:35:193
3189799130,12cyclictest0-21swapper/319:32:063
3189799130,11cyclictest4107-21munin-node19:20:203
3189799130,11cyclictest17920-21irqstats21:00:173
3189699137,5cyclictest2024-21nfsd19:35:042
3189699131,10cyclictest27065-21df20:10:112
3189699130,5cyclictest0-21swapper/220:15:582
3189699130,12cyclictest8057-21munin-node20:40:292
3189699130,12cyclictest21662-21runrttasks19:55:392
3189699130,12cyclictest0-21swapper/220:47:272
3189699130,12cyclictest0-21swapper/219:25:252
3189699130,12cyclictest0-21swapper/219:15:202
3189699130,11cyclictest1434-21df20:25:112
3189599138,4cyclictest144650irq/27-eth019:52:271
3189599137,5cyclictest0-21swapper/120:40:181
3189599137,5cyclictest0-21swapper/120:23:061
3189599134,7cyclictest25694-21bash23:15:141
3189599132,6cyclictest2132-21sshd23:40:131
3189599132,10cyclictest144650irq/27-eth019:10:101
3189599130,12cyclictest28950irq/26-ahci[00021:00:271
3189599130,12cyclictest0-21swapper/121:06:481
3189599130,12cyclictest0-21swapper/120:58:121
3189599130,12cyclictest0-21swapper/120:52:211
3189599130,12cyclictest0-21swapper/120:11:411
3189599130,12cyclictest0-21swapper/120:01:441
3189599130,12cyclictest0-21swapper/119:25:251
3189599130,12cyclictest0-21swapper/119:23:511
3189599130,11cyclictest11789-21memory19:35:161
3189499138,4cyclictest8-21rcu_preempt23:52:480
3189499137,5cyclictest3-21ksoftirqd/022:42:290
3189499137,5cyclictest0-21swapper/019:10:100
3189499134,8cyclictest3-21ksoftirqd/023:21:010
3189499134,8cyclictest3-21ksoftirqd/000:16:490
31894991311,1cyclictest41ktimersoftd/000:10:500
31894991311,1cyclictest0-21swapper/020:50:520
3189499130,12cyclictest0-21swapper/022:22:320
3189499130,12cyclictest0-21swapper/020:14:530
3189499130,12cyclictest0-21swapper/019:40:050
3189499130,12cyclictest0-21swapper/019:20:470
3189799120,11cyclictest0-21swapper/320:32:293
3189799120,11cyclictest0-21swapper/320:32:283
3189799120,10cyclictest25304-21iostat_ios20:05:163
3189799120,10cyclictest0-21swapper/320:50:103
3189799120,10cyclictest0-21swapper/319:50:133
3189699124,7cyclictest33-21ksoftirqd/220:20:142
3189699124,7cyclictest33-21ksoftirqd/219:45:132
3189599128,3cyclictest21649-21runrttasks19:55:281
31895991210,1cyclictest0-21swapper/119:30:421
3189599120,4cyclictest0-21swapper/120:45:271
3189599120,11cyclictest0-21swapper/120:26:071
3189599120,11cyclictest0-21swapper/120:07:211
3189599120,11cyclictest0-21swapper/119:15:041
3189499122,1cyclictest0-21swapper/020:55:120
31894991210,1cyclictest3-21ksoftirqd/019:15:110
31894991210,1cyclictest0-21swapper/019:45:310
3189499120,11cyclictest0-21swapper/021:00:070
3189499120,11cyclictest0-21swapper/020:45:180
3189499120,11cyclictest0-21swapper/020:40:320
3189499120,11cyclictest0-21swapper/020:35:030
3189499120,11cyclictest0-21swapper/020:30:040
3189499120,11cyclictest0-21swapper/020:30:030
3189499120,11cyclictest0-21swapper/020:25:110
3189499120,11cyclictest0-21swapper/020:15:370
3189499120,11cyclictest0-21swapper/020:00:220
3189499120,11cyclictest0-21swapper/019:51:440
3189499120,11cyclictest0-21swapper/019:35:470
3189499120,11cyclictest0-21swapper/019:34:520
3189499120,11cyclictest0-21swapper/019:29:060
3189499110,10cyclictest0-21swapper/020:05:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional