You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-23 - 07:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Wed Apr 23, 2025 00:44:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
236452990,0sleep30-21swapper/323:15:453
149312900,1sleep314903-21sshd22:49:343
175712870,0sleep20-21swapper/200:16:492
3342840,1sleep11759199cyclictest23:55:091
23522620,1sleep22350-21bash21:56:532
90172610,1sleep08989-21sshd00:26:320
83062610,0sleep20-21swapper/221:32:002
207362570,1sleep28396-21diskmemload22:01:502
200762570,1sleep120075-21sshd21:26:481
326152560,1sleep032585-21sshd23:42:170
262732550,3sleep119-21rcuc/121:46:381
120422550,2sleep21759299cyclictest21:54:442
276422540,0sleep30-21swapper/300:35:413
180212520,0sleep10-21swapper/122:17:391
1710925225,9sleep20-21swapper/219:07:112
245502510,0sleep024552-21bash23:19:030
230952510,0sleep20-21swapper/221:11:182
159182500,0sleep20-21swapper/223:37:272
1722324925,9sleep00-21swapper/019:08:370
299222480,0sleep00-21swapper/000:01:010
1714524825,19sleep10-21swapper/119:07:381
165932480,1sleep116594-21bash22:36:451
162182480,0sleep20-21swapper/223:40:362
137442480,1sleep30-21swapper/322:04:273
293902470,0sleep20-21swapper/200:25:102
257672470,1sleep01722-21runrttasks22:05:390
1710024725,18sleep30-21swapper/319:07:033
139022470,0sleep30-21swapper/323:43:413
265312460,0sleep10-21swapper/122:47:261
233222460,0sleep00-21swapper/022:30:560
123372450,0sleep10-21swapper/100:09:191
94982440,0sleep09497-21seq22:23:110
252772430,0sleep225278-21bash23:25:302
134112430,0sleep10-21swapper/122:04:241
1759299410,41cyclictest0-21swapper/222:30:002
1759299380,38cyclictest0-21swapper/221:19:142
229342370,1sleep11759199cyclictest22:11:421
1759299290,29cyclictest0-21swapper/219:27:372
205552280,0sleep020554-21bash00:06:420
17592992624,2cyclictest2416-21bash23:07:162
3142250,5sleep121-21ksoftirqd/100:04:341
17591992422,1cyclictest2691-21sshd22:41:461
1759299230,23cyclictest0-21swapper/222:56:492
1759399210,16cyclictest7906-21sshd00:19:243
1759399210,15cyclictest8623-21sshd00:02:083
17592992116,4cyclictest28592-21sshd22:18:452
1759399208,8cyclictest18035-21sshd22:11:143
17593992019,1cyclictest0-21swapper/321:44:513
17590992019,1cyclictest19729-21sshd23:12:140
17590992019,1cyclictest19210-21sshd22:40:170
17590992016,3cyclictest17386-21sshd00:38:110
207702190,2sleep31759399cyclictest21:39:433
1759399199,5cyclictest0-21swapper/321:11:483
17593991918,1cyclictest0-21swapper/323:39:423
1759399190,14cyclictest0-21swapper/323:20:283
1759399190,13cyclictest3744-21sshd21:53:553
1759299192,16cyclictest0-21swapper/223:46:232
1759299190,19cyclictest0-21swapper/222:46:592
1759399188,6cyclictest28649-21sshd22:25:073
17593991816,1cyclictest0-21swapper/321:32:183
1759399181,2cyclictest0-21swapper/322:16:283
17593991812,5cyclictest2920-21sshd23:45:513
17593991811,6cyclictest29455-21rm23:57:523
1759399180,9cyclictest0-21swapper/322:59:473
1759399180,2cyclictest25215-21sshd23:12:493
1759399180,14cyclictest22965-21sshd23:25:163
1759399180,10cyclictest7273-21sshd23:33:223
1759299180,18cyclictest0-21swapper/221:00:202
1759299180,18cyclictest0-21swapper/220:49:112
1759299180,18cyclictest0-21swapper/200:39:572
1759099180,17cyclictest0-21swapper/021:59:070
1759399178,5cyclictest115950irq/25-eth000:28:003
1759399177,6cyclictest0-21swapper/323:08:003
1759399171,3cyclictest0-21swapper/300:10:133
1759399171,2cyclictest0-21swapper/322:31:523
17593991710,6cyclictest115950irq/25-eth021:25:173
1759399170,2cyclictest19765-21sshd23:02:273
1759399170,1cyclictest0-21swapper/322:50:103
1759399170,1cyclictest0-21swapper/322:50:093
1759399170,1cyclictest0-21swapper/321:17:343
1759399170,16cyclictest7899-21bash00:22:473
1759399170,16cyclictest1591-21sshd22:42:273
1759399170,16cyclictest0-21swapper/322:23:123
1759399170,0cyclictest10150irq/24-ahci[00023:54:273
17592991715,2cyclictest22811-21grep19:19:592
17592991714,3cyclictest5552-21sshd00:05:052
17592991714,2cyclictest28374-21sshd00:14:332
116112170,0sleep311610-21sshd00:05:443
1759399169,6cyclictest0-21swapper/321:48:333
1759399168,4cyclictest0-21swapper/322:36:143
1759399161,1cyclictest0-21swapper/321:20:283
1759399160,15cyclictest17172-21bash00:30:553
1759399160,15cyclictest0-21swapper/322:06:533
17592991614,2cyclictest2971-21sshd22:54:452
17592991614,2cyclictest2971-21sshd22:54:452
17592991614,1cyclictest21497-21sshd23:34:532
1759299160,15cyclictest0-21swapper/221:43:252
1759199169,3cyclictest21-21ksoftirqd/123:44:551
1759099169,4cyclictest0-21swapper/022:39:380
65722150,0sleep20-21swapper/222:29:252
51332150,0sleep05132-21sshd22:57:590
1759399150,1cyclictest0-21swapper/321:55:203
1759399150,1cyclictest0-21swapper/320:55:013
1759299159,5cyclictest31047-21sshd21:24:382
17592991513,1cyclictest18338-21sshd23:50:262
1759199155,1cyclictest21-21ksoftirqd/123:29:341
1759199154,2cyclictest26344-21sshd21:33:501
17591991513,1cyclictest21-21ksoftirqd/100:13:551
17591991513,1cyclictest19-21rcuc/122:07:511
17591991512,3cyclictest21-21ksoftirqd/123:15:411
17591991511,1cyclictest21-21ksoftirqd/122:28:591
1759099159,1cyclictest0-21swapper/023:39:450
17590991513,1cyclictest0-21swapper/023:48:100
17590991512,2cyclictest0-21swapper/021:10:060
1759099150,14cyclictest0-21swapper/000:31:320
1759099150,14cyclictest0-21swapper/000:11:450
1759099150,12cyclictest0-21swapper/022:10:230
1759099150,12cyclictest0-21swapper/021:48:580
223752140,1sleep222347-21sshd23:57:102
1759399144,9cyclictest4358-21munin-node19:50:223
1759399140,13cyclictest0-21swapper/320:00:183
1759299149,4cyclictest0-21swapper/223:18:182
1759299149,4cyclictest0-21swapper/200:23:532
17592991413,1cyclictest5304-21sshd21:25:172
17592991413,1cyclictest10150irq/24-ahci[00000:31:532
1759299140,13cyclictest0-21swapper/221:38:562
1759299140,11cyclictest0-21swapper/222:06:312
1759199144,9cyclictest21-21ksoftirqd/100:23:161
1759199144,10cyclictest21-21ksoftirqd/123:12:191
17591991413,1cyclictest21-21ksoftirqd/123:08:301
17591991413,1cyclictest21-21ksoftirqd/121:17:361
17591991412,1cyclictest21-21ksoftirqd/123:00:461
17591991412,1cyclictest21-21ksoftirqd/121:12:461
17591991410,1cyclictest21-21ksoftirqd/121:58:151
1759199140,2cyclictest17542-21sshd00:27:291
1759099149,4cyclictest0-21swapper/021:20:430
1759099148,3cyclictest0-21swapper/023:25:530
1759099144,9cyclictest6581-21sshd00:19:150
17590991412,1cyclictest24908-21bash21:27:160
1759099140,5cyclictest0-21swapper/022:26:200
1759099140,3cyclictest15046-21sshd21:32:410
1759099140,3cyclictest0-21swapper/022:54:260
1759099140,3cyclictest0-21swapper/022:54:260
1759099140,13cyclictest0-21swapper/023:04:290
1759099140,12cyclictest0-21swapper/021:38:190
1759099140,11cyclictest24693-21sshd22:15:120
1759099140,11cyclictest2111-21sshd23:23:120
1759099140,11cyclictest0-21swapper/000:20:300
1759099140,10cyclictest0-21swapper/022:48:510
79722130,0sleep10-21swapper/123:30:121
1759399135,7cyclictest20160-21munin-node19:15:013
1759399134,8cyclictest21070-21munin-node20:25:223
1759299139,3cyclictest25244-21sshd23:03:012
1759299138,4cyclictest17695-21sshd21:45:452
17592991311,1cyclictest3322-21grep19:50:172
17592991311,1cyclictest13580-21sshd23:11:362
1759199139,1cyclictest0-21swapper/121:35:121
1759199138,2cyclictest24812-21sshd22:21:301
1759199133,9cyclictest21-21ksoftirqd/100:35:431
1759199133,1cyclictest10967-21sshd23:46:391
1759199131,1cyclictest115950irq/25-eth021:52:031
1759199131,1cyclictest10150irq/24-ahci[00023:21:071
1759199130,12cyclictest15072-21sshd22:30:151
1759199130,12cyclictest0-21swapper/123:54:511
1759199130,12cyclictest0-21swapper/121:41:031
1759199130,12cyclictest0-21swapper/121:24:341
1759199130,12cyclictest0-21swapper/119:20:001
1759099137,3cyclictest0-21swapper/023:06:090
1759099131,1cyclictest0-21swapper/023:57:420
1759099130,9cyclictest0-21swapper/021:40:380
1759099130,2cyclictest29668-21sshd21:15:060
1759099130,2cyclictest0-21swapper/023:51:150
1759099130,12cyclictest6688-21sshd22:00:230
1759099130,12cyclictest0-21swapper/023:33:460
1759099130,12cyclictest0-21swapper/021:52:110
1759399125,6cyclictest1722-21runrttasks20:11:113
1759399125,6cyclictest15783-21if_eth020:15:193
1759399123,1cyclictest2180-21munin-node19:45:233
1759299129,2cyclictest0-21swapper/223:20:262
1759299129,2cyclictest0-21swapper/222:40:252
1759299129,2cyclictest0-21swapper/200:00:182
1759299121,2cyclictest0-21swapper/222:10:152
1759299120,9cyclictest0-21swapper/219:42:592
1759299120,1cyclictest115950irq/25-eth022:21:342
1759299120,11cyclictest0-21swapper/222:35:592
1759199121,2cyclictest21-21ksoftirqd/100:19:241
17591991211,1cyclictest21-21ksoftirqd/123:35:191
17591991211,1cyclictest0-21swapper/122:50:181
17591991211,1cyclictest0-21swapper/122:50:181
17591991210,1cyclictest21-21ksoftirqd/100:33:501
1759199120,11cyclictest15038-21sshd22:55:471
1759399119,1cyclictest0-21swapper/320:05:153
1759399115,5cyclictest30685-21cat19:40:003
1759399114,6cyclictest32342-21if_eth020:50:203
1759399114,6cyclictest32342-21if_eth020:50:203
1759399114,1cyclictest18335-21missed_timers20:20:223
1759399113,1cyclictest30412-21munin-node20:45:223
1759399111,2cyclictest0-21swapper/319:55:143
1759399110,6cyclictest0-21swapper/321:01:183
1759399110,5cyclictest0-21swapper/319:14:023
1759399110,1cyclictest0-21swapper/319:34:383
1759299119,1cyclictest0-21swapper/219:35:182
1759099111,6cyclictest0-21swapper/020:05:140
17590991110,1cyclictest0-21swapper/019:45:310
1759099110,1cyclictest0-21swapper/019:43:120
1759099110,11cyclictest0-21swapper/021:03:560
1759099110,11cyclictest0-21swapper/020:35:360
1759099110,10cyclictest0-21swapper/020:29:060
1759399101,2cyclictest0-21swapper/321:05:233
1759399100,5cyclictest0-21swapper/320:35:333
1759399100,10cyclictest0-21swapper/319:21:023
1759299109,1cyclictest0-21swapper/220:55:172
1759299109,1cyclictest0-21swapper/220:43:182
17592991010,0cyclictest0-21swapper/219:30:082
17592991010,0cyclictest0-21swapper/219:10:232
1759299100,9cyclictest0-21swapper/220:15:182
1759299100,1cyclictest6965-21perl21:05:162
1759299100,1cyclictest20401-21perl20:25:152
1759299100,1cyclictest0-21swapper/220:07:112
1759299100,10cyclictest0-21swapper/220:53:252
1759299100,10cyclictest0-21swapper/220:53:252
1759199109,1cyclictest0-21swapper/120:38:041
1759199108,1cyclictest27524-21grep20:40:191
1759199100,9cyclictest0-21swapper/119:20:171
1759199100,1cyclictest2210-21perl20:55:161
1759199100,1cyclictest0-21swapper/119:56:151
1759199100,10cyclictest0-21swapper/119:43:211
1759099109,1cyclictest0-21swapper/020:41:240
1759099109,1cyclictest0-21swapper/020:30:190
1759099109,1cyclictest0-21swapper/020:01:550
1759099109,1cyclictest0-21swapper/019:16:090
1759099108,1cyclictest0-21swapper/020:10:190
1759099100,9cyclictest2196-21fschecks_time20:55:160
1759099100,9cyclictest0-21swapper/019:55:160
1759099100,1cyclictest0-21swapper/020:48:440
1759099100,1cyclictest0-21swapper/020:20:180
1759099100,10cyclictest0-21swapper/019:10:480
175939991,2cyclictest0-21swapper/320:40:163
175939991,2cyclictest0-21swapper/320:30:143
175939991,2cyclictest0-21swapper/319:40:113
175939991,2cyclictest0-21swapper/319:25:073
175929990,9cyclictest0-21swapper/220:30:172
175929990,6cyclictest0-21swapper/219:46:332
175929990,6cyclictest0-21swapper/219:23:122
175929990,4cyclictest0-21swapper/220:21:472
175919999,0cyclictest0-21swapper/119:35:191
175919998,1cyclictest0-21swapper/120:14:361
175919997,1cyclictest6946-21perl21:05:151
175919990,9cyclictest0-21swapper/120:00:201
175919990,1cyclictest0-21swapper/119:25:201
175909997,1cyclictest0-21swapper/021:05:150
175909990,1cyclictest15146-21cpuspeed_turbos20:15:160
175929983,5cyclictest0-21swapper/220:12:352
175929983,5cyclictest0-21swapper/220:00:112
175929983,5cyclictest0-21swapper/219:56:272
175919987,1cyclictest0-21swapper/120:09:011
175919981,6cyclictest0-21swapper/119:45:161
175919980,8cyclictest0-21swapper/121:04:541
175919980,1cyclictest0-21swapper/120:29:081
175909980,7cyclictest0-21swapper/019:30:140
175909980,7cyclictest0-21swapper/019:20:160
175919976,1cyclictest0-21swapper/119:50:191
175919976,1cyclictest0-21swapper/119:30:051
175919971,5cyclictest0-21swapper/120:45:151
175919971,5cyclictest0-21swapper/120:30:151
175919971,4cyclictest0-21swapper/119:10:201
175919970,6cyclictest0-21swapper/120:50:141
175919970,6cyclictest0-21swapper/120:50:141
175919970,6cyclictest0-21swapper/120:20:151
175919970,6cyclictest0-21swapper/120:15:181
175909976,1cyclictest0-21swapper/020:51:390
175909976,1cyclictest0-21swapper/020:51:380
175909970,6cyclictest0-21swapper/019:28:050
175909970,5cyclictest0-21swapper/019:35:200
175929962,2cyclictest0-21swapper/220:35:192
175909960,6cyclictest0-21swapper/019:50:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional