You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-02 - 07:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackaslot0.osadl.org (updated Sun Nov 02, 2025 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
250492860,0sleep125042-21sshd00:25:551
296402620,0sleep329636-21sshd21:58:313
287842620,0sleep028783-21lockdev00:17:530
317902600,0sleep30-21swapper/323:13:383
268792580,0sleep2291ktimersoftd/222:20:292
135442580,1sleep013534-21sshd22:52:480
155122570,1sleep315486-21sshd23:22:553
2778525634,18sleep00-21swapper/019:09:210
104622560,0sleep00-21swapper/000:23:570
97922550,5sleep339-21ksoftirqd/323:07:213
175112550,1sleep30-21swapper/323:19:313
109262540,1sleep337-21rcuc/300:07:383
106022540,0sleep10-21swapper/123:52:141
2752125330,19sleep30-21swapper/319:07:283
179762530,1sleep317971-21rm21:53:263
125812530,0sleep00-21swapper/021:52:460
277622520,0sleep30-21swapper/322:58:123
2741025230,8sleep10-21swapper/119:06:411
139412520,1sleep01722-21runrttasks23:33:540
87172500,0sleep10-21swapper/121:11:221
2742125027,9sleep20-21swapper/219:06:472
299232490,0sleep10-21swapper/123:31:561
302542470,0sleep00-21swapper/023:28:170
267582470,0sleep30-21swapper/323:01:483
261202470,0sleep00-21swapper/023:09:180
147632460,0sleep30-21swapper/321:34:313
143492460,0sleep00-21swapper/021:30:350
107192450,1sleep21722-21runrttasks22:37:242
22272410,0sleep30-21swapper/322:17:463
64142380,1sleep10-21swapper/121:44:431
8582340,0sleep30-21swapper/322:36:133
28125991917,1cyclictest0-21swapper/321:16:213
28121991917,1cyclictest0-21swapper/221:59:132
28113991918,1cyclictest30104-21sshd22:28:260
28121991816,1cyclictest0-21swapper/222:57:372
28116991817,1cyclictest2775-21sshd22:51:281
48492170,0sleep10-21swapper/123:59:151
2812199176,1cyclictest30-21ksoftirqd/222:40:492
28121991716,1cyclictest291ktimersoftd/219:53:572
28121991716,1cyclictest291ktimersoftd/219:47:212
2811399170,17cyclictest0-21swapper/021:35:200
54172160,0sleep30-21swapper/300:23:123
50222160,1sleep20-21swapper/222:25:262
28113991611,4cyclictest0-21swapper/021:28:480
2811399160,14cyclictest0-21swapper/023:46:320
276162160,1sleep01722-21runrttasks00:35:190
244442160,1sleep30-21swapper/300:13:193
213902160,1sleep01591-21sshd21:16:330
131872160,1sleep113169-21sshd22:19:031
114252160,0sleep00-21swapper/022:48:470
61442150,1sleep328089-21diskmemload23:32:573
303932150,0sleep2291ktimersoftd/221:10:152
284222150,1sleep128421-21sshd22:20:391
28125991513,1cyclictest7496-21sshd21:48:313
2812199158,6cyclictest0-21swapper/221:23:342
2812199158,6cyclictest0-21swapper/221:23:342
28121991514,1cyclictest291ktimersoftd/219:58:092
28121991513,1cyclictest30-21ksoftirqd/200:25:352
2812199150,14cyclictest0-21swapper/222:13:352
2811399159,3cyclictest0-21swapper/021:45:310
2811399158,6cyclictest0-21swapper/019:10:150
2811399158,4cyclictest1960-21sshd23:51:110
2811399157,7cyclictest3-21ksoftirqd/023:40:070
2811399150,6cyclictest16522-21bash00:12:170
2811399150,14cyclictest30157-21sshd22:17:130
2811399150,13cyclictest0-21swapper/000:27:500
2811399150,12cyclictest0-21swapper/000:00:470
58482140,0sleep00-21swapper/023:59:220
34262140,1sleep23424-21sshd23:47:392
289862140,0sleep10-21swapper/100:05:481
2812599149,4cyclictest0-21swapper/321:12:423
28125991412,1cyclictest16414-21bash22:26:483
2812599140,13cyclictest28275-21sshd21:39:473
2812599140,13cyclictest0-21swapper/323:48:533
2812599140,13cyclictest0-21swapper/322:11:543
2812599140,13cyclictest0-21swapper/321:20:453
2812599140,13cyclictest0-21swapper/321:20:453
2812599140,11cyclictest0-21swapper/300:28:273
2812199149,4cyclictest0-21swapper/222:17:152
2812199149,4cyclictest0-21swapper/222:08:302
2812199141,4cyclictest0-21swapper/221:31:522
28121991413,0cyclictest291ktimersoftd/220:05:092
28121991412,1cyclictest30-21ksoftirqd/221:15:572
28121991410,1cyclictest115950irq/25-eth023:00:002
2812199140,13cyclictest4598-21sshd23:25:192
2812199140,13cyclictest14202-21sshd21:52:592
2812199140,13cyclictest0-21swapper/223:35:042
2812199140,13cyclictest0-21swapper/223:35:042
2812199140,13cyclictest0-21swapper/221:37:502
2811699149,4cyclictest0-21swapper/122:25:271
2811699148,6cyclictest663-21sshd23:10:071
28116991412,1cyclictest21204-21bash21:50:071
28116991412,1cyclictest11444-21sshd23:37:201
28116991412,1cyclictest11444-21sshd23:37:191
2811699140,13cyclictest0-21swapper/123:28:061
2811699140,13cyclictest0-21swapper/123:03:411
2811699140,13cyclictest0-21swapper/122:01:191
2811699140,11cyclictest0-21swapper/121:58:071
2811399149,4cyclictest0-21swapper/022:39:550
2811399149,4cyclictest0-21swapper/022:03:490
2811399144,9cyclictest19382-21sshd00:08:440
2811399140,13cyclictest3670-21sshd22:10:220
2811399140,13cyclictest0-21swapper/022:08:070
2811399140,13cyclictest0-21swapper/021:56:440
2811399140,13cyclictest0-21swapper/020:10:270
174602140,0sleep00-21swapper/022:56:570
2812599139,3cyclictest0-21swapper/300:01:173
2812599138,4cyclictest29642-21id00:31:033
2812599138,2cyclictest31950-21sshd23:50:543
2812599133,1cyclictest12523-21sshd22:48:563
28125991311,1cyclictest7295-21cp22:07:063
2812599131,11cyclictest0-21swapper/319:40:173
2812599131,11cyclictest0-21swapper/300:35:433
2812599130,1cyclictest0-21swapper/322:40:413
2812599130,12cyclictest7413-21sshd22:03:243
2812599130,12cyclictest18307-21sshd22:30:433
2812599130,12cyclictest0-21swapper/323:42:343
2812599130,12cyclictest0-21swapper/323:35:093
2812599130,12cyclictest0-21swapper/323:35:093
2812599130,12cyclictest0-21swapper/323:25:373
2812599130,12cyclictest0-21swapper/322:52:303
2812599130,10cyclictest23542-21sshd00:17:133
2812199138,4cyclictest17375-21sshd22:04:362
2812199137,5cyclictest0-21swapper/223:22:482
2812199133,9cyclictest30-21ksoftirqd/223:56:542
28121991312,1cyclictest30-21ksoftirqd/223:51:462
28121991312,1cyclictest30-21ksoftirqd/200:13:582
28121991311,1cyclictest30-21ksoftirqd/223:42:032
28121991311,1cyclictest23469-21sshd00:30:182
28121991311,1cyclictest15684-21perl20:45:152
2812199131,11cyclictest0-21swapper/221:42:042
2812199130,12cyclictest7388-21sshd22:52:022
2812199130,12cyclictest20916-21sshd00:20:512
2812199130,12cyclictest0-21swapper/223:19:582
2812199130,12cyclictest0-21swapper/223:09:162
2812199130,12cyclictest0-21swapper/200:36:002
2812199130,12cyclictest0-21swapper/200:17:502
2811699139,3cyclictest0-21swapper/120:35:151
2811699138,4cyclictest0-21swapper/100:11:051
2811699131,9cyclictest115950irq/25-eth000:34:131
2811699131,1cyclictest115950irq/25-eth021:35:091
28116991311,1cyclictest29005-21sshd00:21:521
2811699131,11cyclictest0-21swapper/122:45:051
2811699131,11cyclictest0-21swapper/120:40:251
2811699130,4cyclictest10120-21bash00:19:391
2811699130,2cyclictest904-21sshd22:06:191
2811699130,1cyclictest28089-21diskmemload21:15:431
2811699130,12cyclictest5738-21sshd23:40:221
2811699130,12cyclictest26360-21sshd22:39:171
2811699130,12cyclictest17710-21sshd22:30:391
2811699130,12cyclictest10525-21bash22:11:091
2811699130,12cyclictest0-21swapper/123:48:241
2811699130,12cyclictest0-21swapper/123:20:111
2811699130,12cyclictest0-21swapper/123:17:181
2811699130,12cyclictest0-21swapper/122:44:381
2811699130,12cyclictest0-21swapper/121:26:361
2811699130,12cyclictest0-21swapper/119:26:051
2811399138,4cyclictest0-21swapper/000:30:050
2811399138,3cyclictest0-21swapper/021:11:420
2811399130,9cyclictest3032-21sshd21:40:260
2811399130,2cyclictest0-21swapper/023:23:200
2811399130,12cyclictest2174-21sshd23:10:150
2811399130,12cyclictest0-21swapper/023:16:180
2811399130,12cyclictest0-21swapper/022:20:210
2811399130,12cyclictest0-21swapper/019:45:160
2811399130,11cyclictest29545-21sshd23:35:340
2811399130,11cyclictest29545-21sshd23:35:340
2811399130,11cyclictest0-21swapper/023:02:380
2811399130,11cyclictest0-21swapper/022:43:340
11882130,1sleep20-21swapper/222:32:352
2812599129,2cyclictest2288-21sshd22:21:263
2812599129,2cyclictest0-21swapper/319:30:133
2812599128,3cyclictest28089-21diskmemload21:25:483
2812599128,3cyclictest0-21swapper/320:15:253
2812599121,2cyclictest0-21swapper/323:55:173
2812599121,10cyclictest0-21swapper/320:20:173
2812599121,10cyclictest0-21swapper/319:45:223
2812599120,1cyclictest0-21swapper/321:40:213
2812599120,11cyclictest0-21swapper/320:40:193
2812199129,2cyclictest0-21swapper/223:33:012
2812199129,2cyclictest0-21swapper/223:14:162
2812199129,2cyclictest0-21swapper/221:25:032
2812199129,2cyclictest0-21swapper/221:05:172
2812199122,1cyclictest23090-21sshd22:46:142
28121991211,1cyclictest30-21ksoftirqd/200:06:082
28121991211,1cyclictest291ktimersoftd/220:01:572
28121991211,1cyclictest291ktimersoftd/219:44:052
2812199121,10cyclictest0-21swapper/221:46:052
2812199121,10cyclictest0-21swapper/221:00:172
2812199121,10cyclictest0-21swapper/220:20:152
2812199121,10cyclictest0-21swapper/219:25:212
2812199121,10cyclictest0-21swapper/219:15:012
2812199120,1cyclictest11942-21sshd00:00:052
2812199120,11cyclictest0-21swapper/219:35:152
2811699129,2cyclictest0-21swapper/122:55:251
2811699129,2cyclictest0-21swapper/121:20:561
2811699129,2cyclictest0-21swapper/121:20:561
2811699129,2cyclictest0-21swapper/120:25:141
2811699129,2cyclictest0-21swapper/120:10:191
2811699128,3cyclictest0-21swapper/119:40:191
2811699121,10cyclictest0-21swapper/121:47:481
2811699121,10cyclictest0-21swapper/119:20:151
2811699120,1cyclictest13015-21sshd21:30:261
2811699120,11cyclictest26652-21sshd23:05:271
2811699120,11cyclictest0-21swapper/121:05:171
2811699120,11cyclictest0-21swapper/120:00:161
2811699120,11cyclictest0-21swapper/119:30:221
2811699120,11cyclictest0-21swapper/100:02:051
2811699120,10cyclictest0-21swapper/100:38:321
2811399129,2cyclictest0-21swapper/021:00:250
2811399129,2cyclictest0-21swapper/020:30:150
2811399129,2cyclictest0-21swapper/019:15:270
2811399121,2cyclictest0-21swapper/020:55:150
2811399121,2cyclictest0-21swapper/020:45:150
2811399121,2cyclictest0-21swapper/020:00:150
2811399120,12cyclictest115950irq/25-eth021:22:170
2811399120,12cyclictest115950irq/25-eth021:22:170
2811399120,11cyclictest0-21swapper/022:30:460
129652120,0sleep00-21swapper/020:40:170
2812599119,1cyclictest0-21swapper/320:30:173
2812599119,1cyclictest0-21swapper/319:35:163
2812599118,2cyclictest0-21swapper/321:05:233
2812599118,2cyclictest0-21swapper/319:55:143
2812599118,2cyclictest0-21swapper/319:15:163
2812599110,10cyclictest0-21swapper/320:25:133
2812599110,10cyclictest0-21swapper/320:10:253
2812599110,10cyclictest0-21swapper/319:25:163
2812599110,10cyclictest0-21swapper/319:10:193
28121991110,1cyclictest28-21rcuc/219:30:162
2812199110,11cyclictest0-21swapper/220:36:192
2812199110,10cyclictest31897-21perl20:15:162
2812199110,10cyclictest0-21swapper/220:55:132
2812199110,10cyclictest0-21swapper/220:10:202
2812199110,10cyclictest0-21swapper/219:10:152
2811699119,1cyclictest0-21swapper/119:45:171
2811699118,2cyclictest0-21swapper/119:55:171
2811699110,2cyclictest0-21swapper/119:50:131
2811699110,10cyclictest31639-21df20:15:161
2811699110,10cyclictest0-21swapper/120:50:131
2811699110,10cyclictest0-21swapper/120:45:131
2811399119,2cyclictest0-21swapper/020:05:150
2811399118,2cyclictest0-21swapper/019:35:240
2811399110,8cyclictest8425-21ntpdc19:30:210
2811399110,2cyclictest0-21swapper/020:25:170
2811399110,2cyclictest0-21swapper/019:55:140
2811399110,10cyclictest0-21swapper/020:20:230
2811399110,10cyclictest0-21swapper/019:20:130
2812599108,1cyclictest2243-21diskstats19:20:143
2812599108,1cyclictest19146-21sh19:50:203
2812599108,1cyclictest17585-21apache_volume20:50:123
2812599100,9cyclictest26642-21perl20:05:173
2812599100,9cyclictest0-21swapper/320:55:143
2812599100,1cyclictest23228-21apache_processe20:00:133
2812599100,1cyclictest17337-21latency_hist20:50:003
2812199100,1cyclictest6855-21cat20:30:002
2812199100,1cyclictest3091-21ntp_states19:20:202
2812199100,1cyclictest13895-21ls20:40:232
2811699109,1cyclictest0-21swapper/119:13:381
2811699108,1cyclictest31871-21expr19:15:181
2811699108,1cyclictest26709-21smartctl20:05:191
2811699108,1cyclictest0-21swapper/120:20:191
2811699100,9cyclictest7209-21expr20:30:171
2811699100,9cyclictest10865-21memory19:35:201
2811699100,9cyclictest0-21swapper/121:00:201
2811699100,9cyclictest0-21swapper/120:55:191
2811399109,1cyclictest0-21swapper/019:29:310
2811399107,2cyclictest0-21swapper/021:05:160
2811399100,9cyclictest0-21swapper/019:50:130
2811399100,9cyclictest0-21swapper/019:40:220
2811399100,1cyclictest32010-21grep20:15:160
281259998,1cyclictest0-21swapper/320:35:223
281259990,9cyclictest0-21swapper/321:00:183
281219998,1cyclictest18668-21ls20:50:192
281219990,9cyclictest8411-21ls20:30:252
281139998,1cyclictest0-21swapper/020:50:120
281139990,9cyclictest0-21swapper/020:35:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional