You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-13 - 03:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Tue May 13, 2025 00:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1720921070,0sleep217208-21sshd23:13:392
176572970,0sleep017654-21bash22:54:020
270192950,0sleep026990-21sshd21:46:200
111662920,0sleep03-21ksoftirqd/022:56:350
194432850,0sleep119432-21sshd23:07:221
53522610,1sleep05348-21sshd22:10:160
3009126024,18sleep00-21swapper/019:05:400
282242560,0sleep30-21swapper/322:45:163
314872530,0sleep131486-21sshd00:08:031
255372530,1sleep325531-21sshd21:13:263
92302520,0sleep00-21swapper/022:26:580
320302520,0sleep30-21swapper/323:54:193
57072510,1sleep35697-21sshd23:45:063
47272510,0sleep10-21swapper/123:48:111
42812510,0sleep14271-21sshd23:31:491
31642510,1sleep03157-21sshd00:08:330
216322510,0sleep10-21swapper/122:54:281
206462510,0sleep30-21swapper/321:29:213
149292510,2sleep010-21rcuc/023:23:080
3023425024,9sleep20-21swapper/219:07:292
212802500,1sleep321262-21sshd21:16:113
104012500,0sleep00-21swapper/021:31:300
29342490,1sleep22933-21bash22:45:552
149122490,0sleep214896-21sshd22:37:222
94012480,0sleep00-21swapper/020:40:150
8432480,0sleep223219-21diskmemload21:10:532
2955724824,19sleep30-21swapper/319:05:223
255332480,0sleep01722-21runrttasks21:55:580
204012480,0sleep223219-21diskmemload22:31:212
119182480,1sleep011916-21sshd00:21:320
116702480,0sleep111669-21sshd23:35:461
174172470,0sleep30-21swapper/322:50:373
2807524624,18sleep10-21swapper/119:05:001
240992460,0sleep324097-21sshd21:55:493
111852460,0sleep30-21swapper/323:09:523
50662450,0sleep30-21swapper/320:30:163
50662450,0sleep30-21swapper/320:30:163
133822450,0sleep00-21swapper/021:15:230
202302430,0sleep00-21swapper/023:53:030
201592420,1sleep320138-21sshd23:59:553
30692992725,1cyclictest28-21rcuc/200:00:272
3069299270,27cyclictest0-21swapper/219:16:302
30692992421,2cyclictest29891-21sshd23:31:062
30692992421,1cyclictest31923-21munin-node00:20:272
30690992421,2cyclictest3679-21sshd22:20:000
30692992320,2cyclictest29694-21sshd23:50:392
3069299231,20cyclictest0-21swapper/219:22:102
30692992217,4cyclictest1484-21sshd22:13:102
252522220,0sleep00-21swapper/023:11:100
30691992019,1cyclictest26971-21sshd00:27:141
3069099201,18cyclictest0-21swapper/023:38:090
134602200,0sleep20-21swapper/221:28:352
30692991917,2cyclictest10861-21bash21:21:452
3069099193,15cyclictest7401-21sshd22:43:130
3069099192,1cyclictest14217-21id22:37:170
3069099191,17cyclictest21435-21sshd23:40:080
3069099191,17cyclictest0-21swapper/023:26:440
30690991910,8cyclictest8975-21bash21:51:020
209262190,5sleep03-21ksoftirqd/022:21:370
209262190,5sleep03-21ksoftirqd/022:21:370
163482190,0sleep10-21swapper/122:30:571
30692991816,1cyclictest31468-21sshd00:08:032
3069099188,4cyclictest0-21swapper/021:26:130
3069099182,4cyclictest7643-21sshd23:45:150
3069099181,16cyclictest18864-21id22:01:490
3069099180,17cyclictest31509-21bash21:10:420
298862180,1sleep229881-21cp22:51:562
308172170,1sleep130798-21sshd21:30:191
3069299179,2cyclictest0-21swapper/221:32:392
3069299170,16cyclictest0-21swapper/200:27:392
30690991712,4cyclictest15433-21sshd00:10:030
3069099171,15cyclictest0-21swapper/022:30:190
3069099171,12cyclictest8259-21sshd22:07:160
282222170,0sleep128221-21sshd21:53:021
118822170,0sleep30-21swapper/322:20:403
118822170,0sleep30-21swapper/322:20:403
320002160,1sleep123219-21diskmemload21:59:591
3069299162,13cyclictest0-21swapper/219:59:582
30692991615,1cyclictest1507-21nfsd22:26:572
30692991614,2cyclictest6902-21bash21:44:262
30691991615,1cyclictest3689-21sshd21:47:171
3069099169,5cyclictest0-21swapper/021:40:190
3069099169,3cyclictest0-21swapper/022:48:420
3069099169,3cyclictest0-21swapper/021:35:260
3069099163,4cyclictest24849-21sshd00:26:560
3069099163,4cyclictest22935-21sshd23:01:050
3069099162,5cyclictest9915-21sshd21:21:390
3069099162,13cyclictest18017-21cp23:30:020
3069099161,6cyclictest0-21swapper/023:19:490
30690991613,3cyclictest29733-21sshd00:31:410
3069099161,13cyclictest0-21swapper/000:36:280
3069099160,13cyclictest0-21swapper/023:08:470
209022160,0sleep220899-21bash23:49:542
3069399155,9cyclictest23219-21diskmemload23:43:493
3069399150,12cyclictest0-21swapper/321:32:433
30692991514,1cyclictest115950irq/25-eth021:52:102
30692991514,1cyclictest11141-21sshd23:35:422
30692991513,2cyclictest26158-21sshd21:39:492
30692991513,2cyclictest1507-21nfsd23:21:142
3069199155,9cyclictest31842-21sshd22:42:241
30691991514,1cyclictest19626-21sshd22:47:401
3069099153,4cyclictest9988-21bash23:55:170
3069099153,4cyclictest26768-21bash00:15:150
3069099152,4cyclictest22822-21sshd00:00:110
251452150,0sleep228-21rcuc/223:40:242
90642140,1sleep30-21swapper/323:32:203
30693991413,1cyclictest0-21swapper/322:13:453
3069399141,2cyclictest17520-21sshd23:39:463
3069399140,13cyclictest12469-21sshd22:37:073
30692991411,2cyclictest0-21swapper/200:35:162
3069299140,13cyclictest30852-21sshd22:09:372
3069299140,13cyclictest23355-21sshd21:49:192
3069299140,13cyclictest16203-21sshd00:10:092
3069199149,4cyclictest0-21swapper/123:18:151
3069199149,2cyclictest25261-21sshd22:12:151
3069199141,2cyclictest17370-21sshd23:56:031
3069199140,13cyclictest0-21swapper/122:36:141
3069199140,13cyclictest0-21swapper/121:29:201
3069199140,13cyclictest0-21swapper/121:16:151
3069199140,13cyclictest0-21swapper/100:20:541
294012140,0sleep18-21rcu_preempt23:50:361
7402130,0sleep11722-21runrttasks00:32:071
3069399138,2cyclictest380-21sshd23:18:273
3069399138,2cyclictest0-21swapper/321:47:303
3069399138,1cyclictest0-21swapper/322:05:343
3069399130,4cyclictest25160-21chrt23:20:493
3069399130,2cyclictest0-21swapper/323:14:543
3069399130,1cyclictest0-21swapper/322:59:483
3069399130,12cyclictest30347-21sshd23:27:543
3069399130,12cyclictest25424-21sshd00:23:093
3069399130,12cyclictest1198-21rm22:29:333
3069399130,12cyclictest0-21swapper/321:41:213
3069399130,10cyclictest24265-21sshd21:52:373
30692991311,1cyclictest15925-21rm23:16:422
3069299131,10cyclictest0-21swapper/223:00:202
30692991310,2cyclictest20992-21sshd21:16:092
3069299130,1cyclictest0-21swapper/222:55:352
3069299130,12cyclictest26319-21cp22:22:112
3069299130,12cyclictest26319-21cp22:22:112
3069299130,12cyclictest0-21swapper/223:59:542
3069299130,12cyclictest0-21swapper/221:56:112
3069299130,10cyclictest1730-21sshd23:25:042
3069199138,2cyclictest6029-21sshd22:00:281
3069199138,1cyclictest0-21swapper/121:20:141
3069199137,5cyclictest0-21swapper/123:42:591
3069199131,1cyclictest115950irq/25-eth022:15:491
3069199131,1cyclictest10150irq/24-ahci[00000:12:041
30691991311,1cyclictest19-21rcuc/121:41:221
3069199131,11cyclictest0-21swapper/123:11:201
3069199131,11cyclictest0-21swapper/123:00:251
3069199130,4cyclictest115950irq/25-eth021:12:351
3069199130,2cyclictest0-21swapper/122:27:141
3069199130,1cyclictest115950irq/25-eth022:05:361
3069199130,12cyclictest23219-21diskmemload22:55:391
3069199130,12cyclictest0-21swapper/123:26:321
3069199130,12cyclictest0-21swapper/121:38:351
3069199130,12cyclictest0-21swapper/100:01:591
3069199130,10cyclictest2474-21sshd22:23:061
3069199130,10cyclictest2474-21sshd22:23:061
30690991310,2cyclictest0-21swapper/021:05:130
3069399129,2cyclictest0-21swapper/321:35:173
3069399129,2cyclictest0-21swapper/320:20:163
3069399129,2cyclictest0-21swapper/300:25:193
3069399128,4cyclictest0-21swapper/300:14:453
30693991210,1cyclictest18156-21bash00:38:013
3069399120,9cyclictest0-21swapper/300:07:193
3069399120,1cyclictest0-21swapper/322:15:103
3069399120,1cyclictest0-21swapper/300:01:353
3069399120,11cyclictest15747-21sshd22:01:303
3069399120,11cyclictest0-21swapper/322:30:093
3069399120,11cyclictest0-21swapper/300:30:033
3069399120,10cyclictest0-21swapper/300:16:373
3069299129,2cyclictest0-21swapper/222:01:072
3069299129,2cyclictest0-21swapper/200:32:052
3069299121,10cyclictest0-21swapper/223:05:262
3069299121,10cyclictest0-21swapper/222:41:312
3069299121,10cyclictest0-21swapper/222:15:072
3069299120,11cyclictest0-21swapper/200:15:382
3069199129,1cyclictest0-21swapper/100:35:101
3069199121,2cyclictest0-21swapper/123:22:371
3069199120,1cyclictest0-21swapper/100:15:371
3069099121,2cyclictest0-21swapper/019:15:010
3069099120,10cyclictest0-21swapper/020:10:170
3069399119,2cyclictest0-21swapper/321:20:243
30693991110,1cyclictest26581-21timerandwakeup20:05:233
30693991110,1cyclictest0-21swapper/320:44:393
3069399110,1cyclictest0-21swapper/320:53:213
3069399110,11cyclictest0-21swapper/323:00:323
3069399110,11cyclictest0-21swapper/319:40:253
3069399110,10cyclictest0-21swapper/322:40:133
3069399110,10cyclictest0-21swapper/320:47:333
3069399110,10cyclictest0-21swapper/319:50:193
30692991110,1cyclictest0-21swapper/220:02:282
3069299110,1cyclictest0-21swapper/221:06:002
3069299110,1cyclictest0-21swapper/220:07:272
3069299110,1cyclictest0-21swapper/219:43:032
3069299110,1cyclictest0-21swapper/219:33:102
3069299110,11cyclictest0-21swapper/220:57:382
3069299110,11cyclictest0-21swapper/220:32:332
3069299110,11cyclictest0-21swapper/220:32:332
3069299110,11cyclictest0-21swapper/219:11:202
3069299110,10cyclictest0-21swapper/220:25:172
3069099112,8cyclictest20866-21latency_hist21:05:010
3069099110,1cyclictest0-21swapper/020:35:010
3069099110,1cyclictest0-21swapper/020:05:170
3069399108,1cyclictest28164-21fschecks_time20:10:183
3069399108,1cyclictest2126-21perl19:15:173
3069399100,9cyclictest21056-21fw_forwarded_lo19:55:153
3069399100,9cyclictest0-21swapper/320:00:163
3069399100,1cyclictest0-21swapper/320:18:033
3069399100,10cyclictest0-21swapper/319:38:193
3069399100,10cyclictest0-21swapper/319:13:273
3069299109,1cyclictest0-21swapper/220:39:172
3069299109,1cyclictest0-21swapper/220:11:312
3069299109,1cyclictest0-21swapper/219:47:482
3069299100,9cyclictest30449-21tune2fs20:15:132
3069299100,9cyclictest0-21swapper/220:40:172
3069299100,10cyclictest0-21swapper/221:01:422
3069299100,10cyclictest0-21swapper/220:23:572
3069299100,10cyclictest0-21swapper/219:28:242
3069199109,1cyclictest0-21swapper/121:00:211
3069199108,1cyclictest852-21ls19:15:011
3069199108,1cyclictest30456-21perl20:15:131
3069199108,1cyclictest25800-21fw_conntrack20:05:151
3069199100,9cyclictest0-21swapper/119:55:141
3069199100,1cyclictest18360-21diskstats19:50:171
3069199100,1cyclictest17044-21perl20:55:141
3069199100,10cyclictest0-21swapper/121:09:391
3069199100,10cyclictest0-21swapper/120:32:151
3069199100,10cyclictest0-21swapper/120:32:151
3069099109,1cyclictest0-21swapper/020:25:570
3069099109,1cyclictest0-21swapper/020:15:580
3069099101,8cyclictest0-21swapper/019:30:140
3069099100,9cyclictest0-21swapper/019:45:160
3069099100,9cyclictest0-21swapper/019:10:160
3069099100,1cyclictest4408-21perl19:20:190
306939999,0cyclictest0-21swapper/320:28:163
306939998,1cyclictest0-21swapper/320:38:433
306939998,1cyclictest0-21swapper/319:24:083
306939990,9cyclictest0-21swapper/319:34:573
306929998,1cyclictest0-21swapper/220:46:222
306929998,1cyclictest0-21swapper/219:52:342
306919997,1cyclictest7583-21grep20:35:181
306919994,5cyclictest0-21swapper/119:48:181
306919990,1cyclictest0-21swapper/119:35:151
306909998,1cyclictest0-21swapper/020:55:140
306909998,1cyclictest0-21swapper/020:47:330
306909991,7cyclictest5936-21cat20:30:240
306909991,7cyclictest5936-21cat20:30:240
306909991,7cyclictest20271-21munin-node19:55:210
306909990,9cyclictest0-21swapper/019:25:540
306909990,8cyclictest0-21swapper/020:00:150
306909990,7cyclictest0-21swapper/019:50:260
306909990,1cyclictest0-21swapper/020:53:160
306929983,5cyclictest0-21swapper/220:52:152
306929981,6cyclictest0-21swapper/219:35:122
306919987,1cyclictest0-21swapper/120:24:561
306919986,1cyclictest0-21swapper/120:00:151
306919980,8cyclictest0-21swapper/120:11:121
306919980,7cyclictest0-21swapper/120:41:341
306909987,1cyclictest0-21swapper/019:42:380
306909985,2cyclictest0-21swapper/020:20:130
306909980,0cyclictest0-21swapper/019:35:160
306939976,1cyclictest0-21swapper/319:45:163
306939970,6cyclictest0-21swapper/321:05:253
306939970,6cyclictest0-21swapper/319:25:123
306919975,1cyclictest8471-21munin-node19:30:121
306919975,1cyclictest7731-21date19:25:231
306919975,1cyclictest15315-21grep20:50:241
306919971,5cyclictest0-21swapper/119:40:151
306919970,7cyclictest0-21swapper/119:20:491
306919970,7cyclictest0-21swapper/119:14:181
306919970,6cyclictest0-21swapper/120:25:171
306939965,1cyclictest0-21swapper/321:01:573
306939960,5cyclictest0-21swapper/320:55:103
306919960,5cyclictest0-21swapper/120:45:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional