You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 12:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackaslot0.osadl.org (updated Sat Jul 12, 2025 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
80702580,1sleep08068-21sshd23:09:310
205442580,0sleep00-21swapper/021:15:490
261182550,1sleep11507-21nfsd00:22:261
44742540,0sleep14473-21sshd21:17:301
33872540,1sleep08-21rcu_preempt21:37:000
278402540,0sleep337-21rcuc/322:21:543
238202540,0sleep00-21swapper/000:10:560
232612540,0sleep323264-21sshd21:52:053
264812530,0sleep10-21swapper/123:57:311
206182530,1sleep320600-21sshd22:57:273
319042510,0sleep30-21swapper/323:21:393
19172510,0sleep30-21swapper/322:09:363
124312510,0sleep3381ktimersoftd/321:21:333
110062510,0sleep10-21swapper/122:49:561
54112500,0sleep00-21swapper/023:38:420
235002500,0sleep30-21swapper/321:42:203
191342500,0sleep20-21swapper/223:00:342
191342500,0sleep20-21swapper/223:00:342
181192500,1sleep318115-21bash23:46:353
37652490,1sleep23753-21sshd21:24:002
151724926,19sleep10-21swapper/119:08:031
111132490,0sleep00-21swapper/022:13:450
33752480,0sleep10-21swapper/122:35:501
274272480,0sleep00-21swapper/020:00:200
241992480,0sleep00-21swapper/023:04:340
241992480,0sleep00-21swapper/023:04:340
237912480,0sleep30-21swapper/322:41:083
16292480,0sleep00-21swapper/023:48:150
161924825,9sleep20-21swapper/219:09:122
151452480,0sleep315146-21bash00:10:073
70262470,0sleep00-21swapper/022:36:140
168824724,9sleep30-21swapper/319:09:563
164362470,0sleep00-21swapper/000:29:020
149624724,19sleep00-21swapper/019:07:530
283612460,0sleep10-21swapper/121:33:011
139262450,0sleep20-21swapper/223:32:562
11032450,0sleep00-21swapper/021:49:580
198402440,0sleep219841-21sshd23:56:482
5522410,1sleep327071-21diskmemload00:08:263
161202410,0sleep10-21swapper/123:20:081
142612400,0sleep228-21rcuc/222:20:282
167052370,2sleep2195499cyclictest22:57:022
69842350,0sleep16985-21sshd23:09:231
195499260,25cyclictest0-21swapper/221:03:482
270932230,0sleep10-21swapper/123:37:351
43462210,1sleep04312-21sshd22:29:290
1958992119,1cyclictest2260-21sshd22:39:043
1958992119,1cyclictest0-21swapper/322:10:163
1954992119,1cyclictest11707-21awk22:50:002
1949992119,1cyclictest8945-21sshd22:10:171
1946992119,1cyclictest10071-21sshd22:49:500
33482200,0sleep00-21swapper/022:59:050
1954992018,1cyclictest29077-21sshd22:05:402
195499200,19cyclictest0-21swapper/220:58:172
1954991817,1cyclictest0-21swapper/221:41:252
1954991816,1cyclictest21391-21sshd21:55:142
195499180,1cyclictest0-21swapper/200:30:402
1946991813,2cyclictest0-21swapper/000:08:550
1949991715,1cyclictest6457-21sshd21:24:161
15222170,0sleep00-21swapper/021:10:360
20702160,1sleep12064-21sshd22:52:161
194699168,6cyclictest0-21swapper/022:24:260
194699160,4cyclictest0-21swapper/023:30:140
194699160,13cyclictest0-21swapper/023:57:180
194699160,13cyclictest0-21swapper/022:43:500
270452150,0sleep10-21swapper/121:36:051
194699159,3cyclictest0-21swapper/022:33:250
194699157,5cyclictest24298-21sshd21:22:470
1946991514,1cyclictest8698-21sshd21:53:570
194699150,1cyclictest20279-21sshd23:53:310
194699150,12cyclictest0-21swapper/023:15:080
194699150,12cyclictest0-21swapper/022:09:050
237802140,0sleep027071-21diskmemload22:51:080
226012140,0sleep1201ktimersoftd/123:33:501
195899141,4cyclictest18752-21sshd21:38:373
195899141,12cyclictest0-21swapper/300:20:223
195899140,13cyclictest7589-21sshd23:52:113
195899140,13cyclictest21364-21sshd00:29:453
195899140,13cyclictest0-21swapper/323:55:343
195899140,13cyclictest0-21swapper/300:37:153
195499149,2cyclictest0-21swapper/222:34:312
195499149,2cyclictest0-21swapper/221:39:342
195499142,11cyclictest0-21swapper/221:53:192
1954991412,1cyclictest20770-21bash22:14:462
1954991410,1cyclictest0-21swapper/221:17:002
195499140,13cyclictest0-21swapper/221:13:382
195499140,13cyclictest0-21swapper/200:13:202
195499140,12cyclictest0-21swapper/222:39:062
194999140,13cyclictest27071-21diskmemload21:26:321
194699148,3cyclictest5039-21sshd00:20:050
194699142,11cyclictest0-21swapper/000:30:430
1946991411,2cyclictest7443-21sshd22:00:190
1946991411,1cyclictest0-21swapper/021:30:440
1946991410,1cyclictest0-21swapper/000:00:510
194699140,3cyclictest28677-21bash00:19:080
194699140,3cyclictest0-21swapper/000:39:490
194699140,13cyclictest2553-21sshd23:12:080
194699140,13cyclictest19040-21sshd21:41:520
194699140,11cyclictest27119-21sshd23:40:500
194699140,10cyclictest26433-21sshd21:26:100
87182130,0sleep10-21swapper/122:20:041
72412130,0sleep227071-21diskmemload00:05:282
295422130,0sleep20-21swapper/223:18:092
195899138,4cyclictest20855-21sshd22:50:493
195899137,1cyclictest0-21swapper/321:47:033
1958991311,2cyclictest0-21swapper/320:00:153
195899130,4cyclictest30993-21sshd23:05:143
195899130,4cyclictest28614-21sshd00:19:073
195899130,12cyclictest8694-21sshd21:11:233
195899130,12cyclictest27122-21sshd21:16:303
195899130,12cyclictest25639-21sshd00:04:053
195899130,12cyclictest19629-21cp23:10:313
195899130,12cyclictest18898-21sshd23:43:253
195899130,12cyclictest0-21swapper/323:36:013
195899130,12cyclictest0-21swapper/322:45:413
195899130,12cyclictest0-21swapper/322:26:513
195899130,12cyclictest0-21swapper/322:16:403
195899130,12cyclictest0-21swapper/300:30:313
195499139,1cyclictest0-21swapper/223:26:222
195499138,4cyclictest13000-21id21:47:492
195499138,2cyclictest0-21swapper/223:20:272
195499133,9cyclictest0-21swapper/223:45:082
195499133,1cyclictest30-21ksoftirqd/221:30:492
1954991311,1cyclictest30824-21cp00:39:392
1954991311,1cyclictest0-21swapper/223:41:182
195499130,9cyclictest0-21swapper/222:40:182
195499130,4cyclictest4116-21sshd00:01:492
195499130,4cyclictest19168-21sshd22:54:062
195499130,2cyclictest3247-21sshd23:05:352
195499130,12cyclictest0-21swapper/222:29:002
195499130,12cyclictest0-21swapper/222:15:562
195499130,10cyclictest3879-21bash00:27:142
195499130,10cyclictest0-21swapper/200:20:422
194999138,4cyclictest0-21swapper/122:58:381
194999138,0cyclictest0-21swapper/100:05:561
1949991311,1cyclictest23861-21cp23:47:121
194999130,2cyclictest0-21swapper/123:15:021
194999130,12cyclictest24050-21sshd23:50:291
194999130,12cyclictest0-21swapper/123:12:141
194999130,12cyclictest0-21swapper/122:32:421
194999130,12cyclictest0-21swapper/122:05:561
194999130,12cyclictest0-21swapper/121:48:251
194999130,12cyclictest0-21swapper/100:34:361
194699130,4cyclictest24343-21sshd21:55:250
194699130,12cyclictest0-21swapper/023:20:070
194699130,11cyclictest0-21swapper/022:15:110
194699130,10cyclictest0-21swapper/023:25:370
127692130,0sleep30-21swapper/322:00:463
101302130,1sleep210128-21bash23:39:132
195899129,2cyclictest0-21swapper/323:30:123
195899129,2cyclictest0-21swapper/321:25:583
195899121,10cyclictest0-21swapper/321:32:303
1958991210,1cyclictest19590-21bash21:55:033
1958991210,1cyclictest19351-21sshd22:30:543
1958991210,1cyclictest0-21swapper/323:16:063
195899120,11cyclictest0-21swapper/323:26:093
195499129,2cyclictest0-21swapper/221:25:222
195499129,2cyclictest0-21swapper/220:00:162
195499121,10cyclictest0-21swapper/219:35:152
195499120,1cyclictest0-21swapper/222:02:112
195499120,12cyclictest31726-21sshd00:19:282
195499120,12cyclictest0-21swapper/223:10:532
195499120,10cyclictest0-21swapper/223:52:092
194999129,2cyclictest0-21swapper/123:40:131
194999129,2cyclictest0-21swapper/100:11:091
194999128,4cyclictest16527-21sshd23:26:341
194999122,1cyclictest0-21swapper/121:10:111
1949991211,1cyclictest0-21swapper/123:03:011
1949991211,1cyclictest0-21swapper/123:03:001
194999121,10cyclictest0-21swapper/121:56:161
194999120,3cyclictest0-21swapper/122:16:341
194999120,1cyclictest27071-21diskmemload22:00:151
194999120,1cyclictest27071-21diskmemload21:53:251
194999120,1cyclictest0-21swapper/122:26:221
194999120,12cyclictest0-21swapper/121:43:131
194999120,11cyclictest23720-21sshd00:00:271
194999120,11cyclictest14840-21sshd00:17:351
184622120,0sleep118460-21sshd22:40:341
195899119,2cyclictest0-21swapper/320:50:153
195899118,2cyclictest12607-21sshd23:00:023
195899118,2cyclictest12607-21sshd23:00:023
195899111,10cyclictest0-21swapper/319:15:003
195899110,1cyclictest0-21swapper/320:47:333
195899110,1cyclictest0-21swapper/319:45:163
195899110,11cyclictest0-21swapper/319:35:243
195499119,1cyclictest0-21swapper/220:50:142
195499111,9cyclictest0-21swapper/219:50:172
1949991110,1cyclictest0-21swapper/120:16:111
1949991110,1cyclictest0-21swapper/120:07:221
1949991110,1cyclictest0-21swapper/119:45:031
1949991110,1cyclictest0-21swapper/119:27:241
1949991110,1cyclictest0-21swapper/119:15:121
194999110,2cyclictest0-21swapper/120:00:161
194999110,1cyclictest0-21swapper/120:55:411
194999110,1cyclictest0-21swapper/120:47:331
194999110,1cyclictest0-21swapper/119:35:251
194999110,1cyclictest0-21swapper/119:33:471
194999110,11cyclictest0-21swapper/119:13:551
194999110,10cyclictest21943-21sshd00:25:321
194999110,10cyclictest0-21swapper/120:10:151
194999110,10cyclictest0-21swapper/100:35:141
194699110,1cyclictest0-21swapper/021:05:090
194699110,11cyclictest0-21swapper/020:17:030
194699110,11cyclictest0-21swapper/019:27:120
194699110,10cyclictest5950-21ipmitool19:15:180
194699110,10cyclictest0-21swapper/020:35:160
195899108,1cyclictest0-21swapper/320:40:173
195899100,9cyclictest31936-21fw_forwarded_lo20:10:143
195899100,9cyclictest0-21swapper/321:10:013
195899100,9cyclictest0-21swapper/320:35:163
195899100,9cyclictest0-21swapper/319:55:183
195499108,2cyclictest0-21swapper/221:05:142
195499108,1cyclictest11321-21grep20:35:162
195499100,9cyclictest8084-21perl19:20:132
195499100,9cyclictest4380-21df19:15:012
195499100,9cyclictest13651-21fschecks_time20:40:172
195499100,9cyclictest0-21swapper/219:45:182
194999109,1cyclictest0-21swapper/120:42:051
194999109,1cyclictest0-21swapper/120:26:251
194999109,1cyclictest0-21swapper/119:42:021
194999109,1cyclictest0-21swapper/119:21:081
194999108,1cyclictest18189-21diskstats20:50:151
194999100,1cyclictest0-21swapper/120:21:111
194999100,10cyclictest0-21swapper/120:35:161
194999100,10cyclictest0-21swapper/120:31:591
194699109,1cyclictest0-21swapper/020:31:480
194699109,1cyclictest0-21swapper/020:26:140
194699109,1cyclictest0-21swapper/020:08:140
194699100,9cyclictest22427-21perl19:50:170
194699100,9cyclictest0-21swapper/020:50:150
194699100,9cyclictest0-21swapper/020:10:150
194699100,1cyclictest16128-21tune2fs20:45:160
194699100,1cyclictest0-21swapper/021:00:170
194699100,10cyclictest0-21swapper/019:40:130
194699100,10cyclictest0-21swapper/019:20:560
19549999,0cyclictest0-21swapper/220:05:202
19549997,1cyclictest12927-21perl19:30:152
19549991,5cyclictest0-21swapper/219:43:462
19549990,9cyclictest0-21swapper/220:25:142
19549990,9cyclictest0-21swapper/220:10:142
19549990,9cyclictest0-21swapper/219:10:152
19549990,4cyclictest0-21swapper/219:29:462
19549990,0cyclictest0-21swapper/220:24:512
19499998,1cyclictest0-21swapper/119:50:171
19499990,9cyclictest27191-21cat21:10:011
19499990,9cyclictest24817-21smartctl19:55:191
19469998,1cyclictest0-21swapper/019:55:130
19469994,2cyclictest0-21swapper/019:45:220
19469990,7cyclictest0-21swapper/020:55:140
19469990,5cyclictest15165-21perf20:45:000
19589988,0cyclictest0-21swapper/319:50:163
19589986,2cyclictest0-21swapper/320:25:133
19589980,8cyclictest0-21swapper/319:20:173
19549987,1cyclictest0-21swapper/220:32:172
19469987,1cyclictest0-21swapper/019:11:520
19469980,6cyclictest0-21swapper/019:31:210
19589970,7cyclictest0-21swapper/320:55:113
19589970,6cyclictest1716-21tune2fs20:15:143
19549975,1cyclictest1900-21fschecks_time20:15:152
19549972,5cyclictest0-21swapper/219:55:502
19549970,6cyclictest0-21swapper/220:45:142
19499970,6cyclictest23929-21sensors_fan21:00:231
19469974,1cyclictest0-21swapper/020:20:070
19469973,1cyclictest0-21swapper/019:35:140
19589960,6cyclictest0-21swapper/320:30:003
19589960,1cyclictest0-21swapper/321:00:013
19589960,1cyclictest0-21swapper/320:20:103
19589960,1cyclictest0-21swapper/320:05:023
19589960,1cyclictest0-21swapper/319:40:013
19589960,1cyclictest0-21swapper/319:30:023
19589960,1cyclictest0-21swapper/319:25:003
19589960,1cyclictest0-21swapper/319:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional