You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 16:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Thu Nov 13, 2025 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
156312640,1sleep31505-21nfsd22:41:063
197632580,0sleep319751-21sshd22:26:193
111142540,0sleep30-21swapper/321:50:413
288182530,0sleep30-21swapper/322:46:223
359025229,19sleep20-21swapper/219:09:282
334125229,19sleep30-21swapper/319:07:403
318502520,0sleep00-21swapper/021:13:090
311525225,23sleep10-21swapper/119:06:021
284662520,0sleep128465-21bash23:16:571
194672520,0sleep30-21swapper/319:35:233
231182510,0sleep20-21swapper/222:03:392
322725027,19sleep00-21swapper/019:06:490
88532490,0sleep00-21swapper/022:47:520
62912490,0sleep10-21swapper/121:57:451
318492490,0sleep11722-21runrttasks22:00:421
212332490,1sleep321230-21bash21:59:353
58042480,0sleep20-21swapper/221:35:392
326142480,1sleep032618-21switchtime21:00:230
292732480,0sleep329272-21id21:20:143
208932460,1sleep11722-21runrttasks21:11:501
207772460,0sleep10-21swapper/121:48:161
17912460,0sleep00-21swapper/021:24:270
115442460,0sleep20-21swapper/223:07:162
322932420,2sleep2393099cyclictest23:48:062
318172370,0sleep331818-21bash23:13:343
324312310,0sleep2291ktimersoftd/222:58:192
392699250,24cyclictest10-21rcuc/023:20:400
249462250,0sleep124945-21bash22:15:201
3926992220,1cyclictest16100-21sshd22:33:430
3930992119,1cyclictest0-21swapper/221:22:042
3931991917,1cyclictest0-21swapper/321:39:533
393099195,1cyclictest19488-21bash22:07:002
3930991916,2cyclictest0-21swapper/221:12:102
3926991917,1cyclictest25126-21sshd22:07:410
393199180,18cyclictest0-21swapper/320:35:533
393099186,7cyclictest0-21swapper/223:28:232
393099174,3cyclictest5942-21sshd22:13:072
393099173,13cyclictest23305-21bash23:04:582
3930991711,2cyclictest25931-21sshd22:53:442
3930991711,2cyclictest1067-21sshd23:17:362
3930991710,2cyclictest0-21swapper/221:34:522
392999170,16cyclictest0-21swapper/122:38:231
392699176,2cyclictest0-21swapper/021:47:300
392699170,16cyclictest0-21swapper/022:20:350
216302170,1sleep121614-21sshd22:07:151
393199161,14cyclictest10092-21sshd22:32:583
393099165,10cyclictest27019-21sshd22:35:012
393099165,10cyclictest20565-21sshd22:30:202
393099164,4cyclictest18466-21sshd21:15:172
393099164,11cyclictest4003-21sshd21:57:272
393099164,11cyclictest16369-21ntpq20:30:212
393099164,11cyclictest14363-21sshd22:25:392
393099163,12cyclictest17464-21sshd21:40:322
393099163,12cyclictest17464-21sshd21:40:312
393099162,13cyclictest2168-21sshd23:13:532
393099162,13cyclictest0-21swapper/223:20:272
393099162,13cyclictest0-21swapper/221:51:512
3930991613,2cyclictest7374-21cp22:20:592
3930991613,2cyclictest18747-21sshd22:45:182
3930991612,3cyclictest15728-21sshd22:41:072
3930991611,4cyclictest20191-21idleruntime-cro20:39:592
3929991614,1cyclictest4177-21sshd21:35:271
3926991611,4cyclictest25306-21sshd23:05:110
393099154,10cyclictest25575-21apache_processe21:45:142
393099154,10cyclictest0-21swapper/221:25:582
393099153,11cyclictest21035-21fschecks_time20:40:162
3930991512,2cyclictest25266-21munin-node22:15:212
392699154,10cyclictest0-21swapper/021:17:030
3926991513,1cyclictest13211-21sshd22:40:470
392699150,14cyclictest26573-21sshd23:01:260
392699150,14cyclictest0-21swapper/021:37:560
316042150,1sleep3381ktimersoftd/321:27:423
28462150,0sleep32841-21bash22:54:523
28362150,0sleep30-21swapper/321:31:433
24122150,1sleep32396-21sshd23:06:093
77032140,0sleep30-21swapper/322:55:203
393199149,2cyclictest7073-21sshd23:03:003
393199140,1cyclictest29625-21sshd21:16:333
393199140,13cyclictest0-21swapper/321:44:203
393199140,13cyclictest0-21swapper/321:44:193
393099144,9cyclictest29155-21diskstats19:55:122
393099143,10cyclictest3918-21grep00:10:012
3930991412,1cyclictest6127-21users20:10:252
392999149,1cyclictest0-21swapper/121:29:081
3929991410,3cyclictest30683-21sshd23:01:551
392999140,5cyclictest0-21swapper/122:42:371
392999140,13cyclictest0-21swapper/122:10:361
392999140,13cyclictest0-21swapper/121:34:481
392699145,6cyclictest3531-21sshd23:14:050
392699143,10cyclictest0-21swapper/022:25:180
392699141,12cyclictest1531-21sshd22:54:410
392699140,9cyclictest0-21swapper/022:38:550
392699140,14cyclictest0-21swapper/023:17:080
392699140,0cyclictest0-21swapper/021:55:240
269222140,0sleep026921-21seq21:30:440
262532140,0sleep00-21swapper/019:50:150
393199139,1cyclictest31941-21bash22:39:223
393199138,2cyclictest28685-21sshd22:04:213
393199131,3cyclictest0-21swapper/321:14:163
393199131,11cyclictest0-21swapper/319:15:013
393199130,2cyclictest0-21swapper/321:48:003
393199130,12cyclictest3979-21sshd22:16:433
393199130,12cyclictest0-21swapper/323:17:353
393199130,12cyclictest0-21swapper/322:22:293
392999139,1cyclictest0-21swapper/122:47:171
392999138,4cyclictest7340-21sshd21:43:081
392999138,4cyclictest7340-21sshd21:43:081
392999131,11cyclictest0-21swapper/122:51:591
392999130,4cyclictest0-21swapper/122:56:411
392999130,2cyclictest0-21swapper/123:11:051
392999130,12cyclictest5088-21id22:20:411
392999130,12cyclictest24238-21sshd22:30:401
392999130,12cyclictest24137-21sshd23:05:031
392999130,12cyclictest0-21swapper/122:28:531
392999130,12cyclictest0-21swapper/121:51:161
392999130,12cyclictest0-21swapper/121:16:481
392699136,6cyclictest0-21swapper/021:40:120
392699136,6cyclictest0-21swapper/021:40:120
3926991312,1cyclictest13113-21sshd22:10:080
3926991311,1cyclictest3-21ksoftirqd/022:00:510
392699131,11cyclictest0-21swapper/020:15:150
392699130,12cyclictest19228-21sshd21:51:400
392699130,12cyclictest0-21swapper/022:56:180
392699130,12cyclictest0-21swapper/022:15:120
392699130,12cyclictest0-21swapper/021:25:050
393199129,2cyclictest0-21swapper/323:20:223
393199129,2cyclictest0-21swapper/322:05:153
393199129,2cyclictest0-21swapper/320:50:153
393199129,2cyclictest0-21swapper/320:00:123
393199129,2cyclictest0-21swapper/319:55:113
393199122,9cyclictest0-21swapper/322:11:173
393199121,2cyclictest0-21swapper/319:10:143
3931991211,1cyclictest0-21swapper/323:58:463
393199121,10cyclictest0-21swapper/321:05:133
393199121,10cyclictest0-21swapper/319:20:153
393199120,11cyclictest0-21swapper/319:30:243
393099121,2cyclictest0-21swapper/221:00:142
393099121,2cyclictest0-21swapper/219:45:152
393099121,2cyclictest0-21swapper/219:15:122
3930991210,1cyclictest0-21swapper/220:20:202
392999129,2cyclictest0-21swapper/120:45:121
392999129,2cyclictest0-21swapper/120:35:161
392999129,2cyclictest0-21swapper/120:20:141
392999129,2cyclictest0-21swapper/120:10:131
392999129,2cyclictest0-21swapper/119:55:101
392999129,2cyclictest0-21swapper/119:50:141
392999128,1cyclictest0-21swapper/123:20:371
392999121,10cyclictest0-21swapper/121:20:091
392999120,3cyclictest0-21swapper/120:15:191
392999120,12cyclictest0-21swapper/120:25:231
392999120,11cyclictest0-21swapper/119:15:171
392999120,11cyclictest0-21swapper/100:36:591
392999120,11cyclictest0-21swapper/100:21:031
3926991211,1cyclictest0-21swapper/000:06:170
392699121,10cyclictest0-21swapper/019:30:200
392699121,10cyclictest0-21swapper/019:15:100
392699120,11cyclictest0-21swapper/020:50:130
392699120,11cyclictest0-21swapper/019:10:160
393199119,1cyclictest0-21swapper/320:34:593
393199118,2cyclictest0-21swapper/319:40:243
393199118,1cyclictest10150irq/24-ahci[00020:20:003
393199110,11cyclictest0-21swapper/323:41:553
393199110,11cyclictest0-21swapper/323:38:263
393199110,10cyclictest7825-21perl20:15:173
393199110,10cyclictest0-21swapper/320:55:133
393199110,10cyclictest0-21swapper/320:25:213
393199110,10cyclictest0-21swapper/320:05:223
393199110,10cyclictest0-21swapper/319:45:203
393199110,10cyclictest0-21swapper/300:35:013
393099118,2cyclictest0-21swapper/219:50:132
393099118,2cyclictest0-21swapper/219:40:152
393099118,2cyclictest0-21swapper/219:10:202
393099112,9cyclictest3855-21diskmemload00:10:012
393099111,9cyclictest0-21swapper/219:20:212
3930991110,1cyclictest0-21swapper/200:16:122
393099110,2cyclictest13054-21df19:25:182
393099110,10cyclictest8159-21uname20:15:212
393099110,10cyclictest29235-21hddtemp_smartct20:55:182
393099110,10cyclictest0-21swapper/220:50:152
393099110,10cyclictest0-21swapper/220:25:202
393099110,10cyclictest0-21swapper/220:05:152
393099110,10cyclictest0-21swapper/220:00:232
392999119,1cyclictest0-21swapper/120:55:151
3929991110,1cyclictest0-21swapper/123:43:191
3929991110,1cyclictest0-21swapper/100:19:471
392999110,2cyclictest0-21swapper/119:10:141
392999110,1cyclictest0-21swapper/120:34:491
392999110,11cyclictest0-21swapper/119:40:151
392999110,11cyclictest0-21swapper/100:07:061
392999110,11cyclictest0-21swapper/100:02:571
392999110,10cyclictest2158-21cut21:05:141
392999110,10cyclictest0-21swapper/120:50:221
392999110,10cyclictest0-21swapper/119:45:171
392999110,10cyclictest0-21swapper/119:35:141
392999110,10cyclictest0-21swapper/119:25:171
392999110,0cyclictest3855-21diskmemload23:28:271
392699119,2cyclictest0-21swapper/000:26:220
392699118,2cyclictest0-21swapper/020:55:210
392699118,2cyclictest0-21swapper/020:40:130
392699118,2cyclictest0-21swapper/020:10:140
392699118,2cyclictest0-21swapper/019:45:170
392699117,4cyclictest0-21swapper/019:40:200
3926991110,1cyclictest0-21swapper/000:16:440
392699110,2cyclictest0-21swapper/020:25:280
392699110,2cyclictest0-21swapper/020:20:130
392699110,2cyclictest0-21swapper/019:25:190
392699110,1cyclictest0-21swapper/023:42:280
392699110,1cyclictest0-21swapper/023:25:230
392699110,11cyclictest0-21swapper/023:56:380
392699110,11cyclictest0-21swapper/020:47:190
392699110,11cyclictest0-21swapper/020:30:120
392699110,10cyclictest0-21swapper/020:35:180
392699110,10cyclictest0-21swapper/020:00:130
392699110,10cyclictest0-21swapper/019:55:130
393199109,1cyclictest0-21swapper/323:45:463
393199109,1cyclictest0-21swapper/323:33:483
393199109,1cyclictest0-21swapper/300:27:343
393199109,1cyclictest0-21swapper/300:11:123
393199109,1cyclictest0-21swapper/300:09:073
393199108,2cyclictest0-21swapper/300:15:003
393199108,1cyclictest3039-21sed00:05:013
393199107,2cyclictest0-21swapper/320:45:133
393199107,2cyclictest0-21swapper/320:10:163
393199100,9cyclictest12675-21apache_volume19:25:173
393199100,1cyclictest21704-21ntp_states20:40:203
393199100,10cyclictest0-21swapper/323:29:573
393099108,1cyclictest7428-21munin-run00:30:012
393099108,1cyclictest2956-21sed00:05:002
393099108,1cyclictest23759-21perl20:45:142
393099104,5cyclictest2199-21fw_packets21:05:162
393099104,5cyclictest16180-21ls19:30:152
393099100,9cyclictest3855-21diskmemload23:50:012
393099100,9cyclictest0-21swapper/219:35:162
392999109,1cyclictest0-21swapper/123:32:021
392999108,1cyclictest31133-21apache_processe21:00:121
392999100,9cyclictest32697-21ntp_states20:00:211
392999100,9cyclictest30969-21cat23:40:001
392999100,9cyclictest0-21swapper/100:35:011
392999100,1cyclictest10787-21hddtemp_smartct19:20:161
392999100,1cyclictest0-21swapper/123:57:291
392999100,1cyclictest0-21swapper/120:05:121
392999100,1cyclictest0-21swapper/119:30:151
392999100,10cyclictest0-21swapper/120:40:211
392699109,1cyclictest0-21swapper/000:32:040
392699109,1cyclictest0-21swapper/000:02:070
392699108,1cyclictest1376-21apache_volume21:05:130
392699107,2cyclictest0-21swapper/020:05:130
392699100,9cyclictest19114-21grep19:35:200
392699100,1cyclictest9994-21apache_processe19:20:130
392699100,1cyclictest0-21swapper/023:50:010
392699100,1cyclictest0-21swapper/023:50:000
392699100,1cyclictest0-21swapper/023:31:130
392699100,1cyclictest0-21swapper/000:38:210
392699100,1cyclictest0-21swapper/000:22:260
39319998,1cyclictest0-21swapper/323:51:553
39319997,1cyclictest8334-21latency_hist00:35:003
39319990,9cyclictest0-21swapper/321:00:183
39319990,9cyclictest0-21swapper/319:50:143
39309995,3cyclictest30531-21seq23:38:242
39309995,3cyclictest1991-21perf00:00:002
39309995,3cyclictest1722-21runrttasks23:31:522
39309995,3cyclictest1572-21utnservice23:43:092
39309994,4cyclictest0-21swapper/200:25:002
39309990,9cyclictest0-21swapper/200:30:002
39299998,1cyclictest0-21swapper/123:52:561
39299998,1cyclictest0-21swapper/123:48:031
39299990,9cyclictest0-21swapper/100:30:001
39309985,2cyclictest9052-21taskset00:38:442
39269980,8cyclictest0-21swapper/000:13:240
39269980,2cyclictest0-21swapper/023:35:320
39319974,1cyclictest3855-21diskmemload00:24:243
39299963,2cyclictest0-21swapper/100:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional