You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 04:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackaslot0.osadl.org (updated Mon May 05, 2025 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
609821090,0sleep36061-21sshd21:28:403
2878121020,0sleep028778-21sshd23:53:100
77632690,0sleep37758-21bash22:48:403
266682590,0sleep30-21swapper/322:05:543
220072590,2sleep0535799cyclictest22:05:270
48102580,0sleep20-21swapper/221:13:332
301812580,0sleep10-21swapper/122:27:001
301812580,0sleep10-21swapper/122:27:001
108972550,1sleep210896-21sshd00:03:112
311632530,0sleep331162-21id00:02:033
86892520,0sleep20-21swapper/222:22:032
86892520,0sleep20-21swapper/222:22:032
276342520,1sleep10-21swapper/123:05:261
65532510,1sleep06552-21sshd23:36:080
310422510,0sleep231041-21sshd23:11:472
248942510,0sleep324863-21sshd22:53:133
7602500,0sleep20-21swapper/221:42:532
59612500,0sleep10-21swapper/121:46:181
277362500,0sleep10-21swapper/121:33:351
276082500,0sleep15354-21cyclictest23:14:311
243012500,0sleep30-21swapper/321:15:183
211512500,0sleep221132-21sshd22:32:062
209072500,1sleep120900-21sshd21:27:021
62142490,0sleep26198-21sshd23:45:082
245362490,1sleep20-21swapper/222:14:422
111352490,1sleep111134-21bash23:57:211
490124825,19sleep20-21swapper/219:07:302
480624824,20sleep10-21swapper/119:06:181
477324826,18sleep00-21swapper/019:05:520
126372480,1sleep230292-21diskmemload23:39:442
477624724,19sleep30-21swapper/319:05:543
27142470,1sleep228-21rcuc/223:18:082
190272460,1sleep010-21rcuc/021:32:460
294962450,0sleep00-21swapper/023:41:090
162412440,0sleep20-21swapper/221:38:252
117932440,0sleep10-21swapper/100:22:131
295202430,0sleep00-21swapper/022:24:010
295202430,0sleep00-21swapper/022:24:010
4992380,0sleep20-21swapper/221:34:042
295782370,1sleep1536099cyclictest21:51:271
270382370,2sleep010-21rcuc/022:35:310
75212360,0sleep20-21swapper/200:25:062
10862360,0sleep20-21swapper/223:03:062
256392300,0sleep10-21swapper/122:05:491
5362992220,1cyclictest0-21swapper/300:10:473
536299210,20cyclictest0-21swapper/321:39:253
5360991917,1cyclictest20128-21sshd00:37:001
307392190,1sleep21722-21runrttasks23:20:372
154722190,1sleep10-21swapper/100:09:551
5357991817,1cyclictest30798-21sshd23:20:360
5357991816,1cyclictest27888-21sshd23:11:290
5361991716,0cyclictest291ktimersoftd/220:55:052
536099170,5cyclictest0-21swapper/100:33:421
535799179,5cyclictest0-21swapper/022:29:340
535799179,5cyclictest0-21swapper/022:29:340
5357991715,1cyclictest3322-21sshd00:24:410
306052170,0sleep10-21swapper/121:19:011
298152170,1sleep20-21swapper/221:24:592
112762170,0sleep00-21swapper/022:43:040
5512160,2sleep228-21rcuc/222:45:082
5357991614,1cyclictest11614-21sshd22:04:380
535799160,1cyclictest9999-21sshd22:10:210
535799160,15cyclictest0-21swapper/021:16:140
322082160,0sleep232209-21sshd22:56:532
189962160,0sleep10-21swapper/121:44:371
181552160,0sleep10-21swapper/122:58:401
78892150,0sleep10-21swapper/123:33:261
5361991514,1cyclictest0-21swapper/221:48:472
5361991513,1cyclictest0-21swapper/221:27:592
536199150,2cyclictest26195-21sshd22:05:512
536199150,1cyclictest0-21swapper/222:26:132
536199150,1cyclictest0-21swapper/222:26:132
536099159,2cyclictest14015-21sshd22:43:201
536099151,10cyclictest0-21swapper/122:03:431
536099150,2cyclictest29717-21sshd21:24:581
536099150,1cyclictest7536-21crond22:25:011
536099150,1cyclictest7536-21crond22:25:011
535799159,4cyclictest0-21swapper/022:33:580
535799159,3cyclictest1324-21sshd00:38:380
5357991510,2cyclictest0-21swapper/023:03:360
5357991510,2cyclictest0-21swapper/021:21:130
535799150,1cyclictest16441-21ipmitool19:30:190
304992150,0sleep00-21swapper/023:17:410
20312150,1sleep130292-21diskmemload00:27:461
117562150,1sleep111752-21bash23:39:391
536299148,5cyclictest0-21swapper/300:15:403
536299148,4cyclictest0-21swapper/322:35:363
5362991413,1cyclictest39-21ksoftirqd/323:58:183
5362991412,1cyclictest0-21swapper/322:16:363
5362991412,1cyclictest0-21swapper/322:16:363
536299140,13cyclictest618-21id23:17:563
536299140,13cyclictest0-21swapper/323:51:063
536299140,13cyclictest0-21swapper/323:00:323
536199149,1cyclictest0-21swapper/222:50:242
536199148,1cyclictest18985-21sshd23:52:162
5361991413,1cyclictest291ktimersoftd/220:10:172
5361991411,2cyclictest0-21swapper/220:05:182
536199140,5cyclictest0-21swapper/222:44:262
536199140,4cyclictest0-21swapper/200:20:352
536199140,2cyclictest24306-21bash21:53:582
536199140,13cyclictest0-21swapper/223:44:512
536199140,10cyclictest0-21swapper/222:36:042
536099149,2cyclictest0-21swapper/122:35:451
536099148,1cyclictest115950irq/25-eth022:10:511
5360991413,1cyclictest21-21ksoftirqd/123:29:411
5360991413,1cyclictest21-21ksoftirqd/121:38:041
5360991412,1cyclictest21-21ksoftirqd/123:22:531
536099140,13cyclictest0-21swapper/100:18:501
536099140,11cyclictest0-21swapper/122:17:461
536099140,11cyclictest0-21swapper/122:17:461
535799148,3cyclictest22018-21sshd23:05:010
535799148,3cyclictest0-21swapper/000:26:210
535799142,1cyclictest0-21swapper/021:58:250
5357991412,1cyclictest8152-21sshd23:45:160
5357991412,1cyclictest30292-21diskmemload00:30:270
535799140,9cyclictest0-21swapper/021:26:410
535799140,5cyclictest0-21swapper/000:01:500
535799140,3cyclictest8262-21cp23:30:240
535799140,1cyclictest0-21swapper/022:55:210
535799140,13cyclictest10048-21sshd21:40:430
535799140,12cyclictest0-21swapper/021:54:210
535799140,11cyclictest0-21swapper/023:55:150
293592140,1sleep30-21swapper/322:29:573
293592140,1sleep30-21swapper/322:29:573
536299138,4cyclictest0-21swapper/300:36:163
536299138,2cyclictest9997-21sshd23:39:283
536299138,2cyclictest0-21swapper/322:10:063
5362991311,1cyclictest39-21ksoftirqd/321:57:093
536299130,9cyclictest115950irq/25-eth023:25:383
536299130,4cyclictest10080-21sshd22:22:113
536299130,4cyclictest10080-21sshd22:22:113
536299130,2cyclictest0-21swapper/321:42:533
536299130,12cyclictest12576-21sshd23:07:043
536299130,12cyclictest0-21swapper/323:42:423
536299130,12cyclictest0-21swapper/300:32:003
536199139,3cyclictest30-21ksoftirqd/223:06:072
536199138,4cyclictest20311-21sshd23:55:182
536199138,4cyclictest0-21swapper/200:32:342
536199138,1cyclictest0-21swapper/200:19:012
5361991312,1cyclictest30-21ksoftirqd/221:57:352
5361991311,0cyclictest291ktimersoftd/221:17:092
536199130,1cyclictest26971-21sshd23:32:102
536199130,1cyclictest18651-21bash23:25:262
536199130,1cyclictest0-21swapper/200:06:212
536199130,12cyclictest7463-21cp22:01:142
536199130,12cyclictest3927-21id22:15:382
536199130,12cyclictest3927-21id22:15:382
536199130,11cyclictest0-21swapper/200:11:052
536099139,1cyclictest0-21swapper/123:15:251
536099138,1cyclictest5846-21sshd22:30:391
536099138,1cyclictest21-21ksoftirqd/121:11:491
5360991312,1cyclictest21-21ksoftirqd/123:40:481
5360991312,1cyclictest21-21ksoftirqd/122:53:511
5360991312,1cyclictest21-21ksoftirqd/122:46:091
536099130,12cyclictest6614-21sshd23:00:311
536099130,12cyclictest22982-21sshd21:56:441
536099130,12cyclictest14227-21sshd23:51:491
536099130,12cyclictest0-21swapper/100:14:531
536099130,10cyclictest15235-21sshd23:45:521
535799138,2cyclictest670-21bash22:53:590
535799135,4cyclictest0-21swapper/000:05:180
535799131,1cyclictest0-21swapper/023:26:060
5357991311,1cyclictest3475-21wc00:15:010
5357991310,2cyclictest0-21swapper/022:16:390
5357991310,2cyclictest0-21swapper/022:16:390
535799130,1cyclictest9303-21bash21:10:560
535799130,1cyclictest30292-21diskmemload22:45:300
535799130,12cyclictest5516-21sshd00:15:130
535799130,12cyclictest17885-21sshd21:35:310
535799130,10cyclictest28786-21bash21:48:270
214482130,1sleep31722-21runrttasks23:31:383
536299129,2cyclictest0-21swapper/322:01:223
536299129,2cyclictest0-21swapper/321:46:003
536299129,2cyclictest0-21swapper/321:30:193
536299128,2cyclictest27954-21sshd22:44:393
536299128,1cyclictest0-21swapper/322:56:383
536299128,1cyclictest0-21swapper/322:30:503
536299121,2cyclictest0-21swapper/300:05:173
536299120,1cyclictest2950-21sshd23:21:023
536299120,1cyclictest1591-21sshd23:10:593
536299120,1cyclictest115950irq/25-eth021:50:333
536299120,1cyclictest0-21swapper/321:22:553
536299120,1cyclictest0-21swapper/300:20:343
536299120,11cyclictest0-21swapper/323:45:133
536299120,11cyclictest0-21swapper/321:11:353
5361991211,1cyclictest21323-21sshd00:37:082
536199121,10cyclictest0-21swapper/219:15:162
536099128,3cyclictest10581-21awk19:20:001
536099127,1cyclictest17155-21sshd00:00:451
535799120,11cyclictest0-21swapper/019:15:190
536299110,3cyclictest0-21swapper/320:00:173
536299110,11cyclictest0-21swapper/320:25:423
536299110,11cyclictest0-21swapper/320:08:023
536299110,11cyclictest0-21swapper/319:18:543
536299110,10cyclictest0-21swapper/300:25:133
536199111,9cyclictest0-21swapper/220:45:172
536199111,1cyclictest0-21swapper/220:00:182
536199110,11cyclictest0-21swapper/220:21:202
536199110,11cyclictest0-21swapper/219:28:142
5360991110,1cyclictest0-21swapper/120:00:141
5360991110,1cyclictest0-21swapper/119:50:561
536099110,11cyclictest0-21swapper/119:23:311
536099110,10cyclictest0-21swapper/120:29:011
535799119,1cyclictest0-21swapper/020:35:160
5357991110,1cyclictest0-21swapper/019:38:400
535799110,1cyclictest0-21swapper/020:00:170
535799110,11cyclictest0-21swapper/020:45:140
535799110,10cyclictest0-21swapper/019:20:190
536299109,1cyclictest0-21swapper/321:05:473
536299109,1cyclictest0-21swapper/319:50:503
536299109,1cyclictest0-21swapper/319:34:073
536299109,1cyclictest0-21swapper/319:27:503
536299108,1cyclictest20994-21grep19:40:143
536299100,1cyclictest0-21swapper/320:52:463
536299100,10cyclictest0-21swapper/319:11:353
536199109,1cyclictest0-21swapper/220:38:462
536199109,1cyclictest0-21swapper/219:59:442
536199109,1cyclictest0-21swapper/219:35:472
536199109,1cyclictest0-21swapper/219:11:092
536199108,1cyclictest0-21swapper/220:50:162
536199100,9cyclictest28872-21fschecks_time21:05:172
536199100,1cyclictest0-21swapper/220:15:212
536199100,10cyclictest0-21swapper/219:49:092
536099109,1cyclictest0-21swapper/121:02:141
536099109,1cyclictest0-21swapper/120:41:201
536099109,1cyclictest0-21swapper/120:16:571
536099108,1cyclictest28851-21tune2fs21:05:171
536099100,9cyclictest16240-21perl19:30:171
536099100,10cyclictest0-21swapper/120:55:451
536099100,10cyclictest0-21swapper/120:30:401
535799109,1cyclictest0-21swapper/019:43:400
535799101,8cyclictest0-21swapper/020:30:220
535799100,10cyclictest0-21swapper/019:28:550
53629998,1cyclictest0-21swapper/321:00:203
53629998,1cyclictest0-21swapper/320:57:323
53629998,1cyclictest0-21swapper/320:45:203
53629998,1cyclictest0-21swapper/320:41:583
53619997,0cyclictest729-40kipmi019:30:182
53619990,6cyclictest0-21swapper/219:22:022
53609998,1cyclictest0-21swapper/119:58:221
53609994,4cyclictest21-21ksoftirqd/119:35:201
53609990,9cyclictest0-21swapper/120:50:161
53609990,1cyclictest0-21swapper/120:05:221
53579999,0cyclictest0-21swapper/020:41:240
53579998,1cyclictest0-21swapper/021:06:080
53579998,1cyclictest0-21swapper/020:22:550
53579995,2cyclictest21549-21kworker/0:220:26:230
53579991,7cyclictest0-21swapper/019:10:160
53579990,9cyclictest0-21swapper/020:12:480
53579990,9cyclictest0-21swapper/020:05:200
53579990,6cyclictest0-21swapper/019:50:170
53579990,1cyclictest0-21swapper/020:58:140
53629983,4cyclictest12003-21nfsd419:20:223
53629980,5cyclictest0-21swapper/320:22:403
53619987,1cyclictest0-21swapper/220:30:382
53619987,1cyclictest0-21swapper/220:25:032
53619983,5cyclictest0-21swapper/220:44:232
53609987,1cyclictest0-21swapper/119:14:141
53579988,0cyclictest0-21swapper/021:00:200
53579983,5cyclictest21549-21kworker/0:220:15:160
53579981,2cyclictest0-21swapper/019:45:180
53579980,5cyclictest29496-21munin-run20:00:000
53629976,1cyclictest0-21swapper/320:10:193
53629971,5cyclictest0-21swapper/319:45:163
53619970,6cyclictest0-21swapper/221:00:212
53619970,6cyclictest0-21swapper/219:40:142
53619970,3cyclictest0-21swapper/219:50:182
53609976,1cyclictest0-21swapper/119:48:021
53609975,1cyclictest19393-21perl20:45:161
53609975,1cyclictest13260-21atenall_rapower19:25:161
53609971,5cyclictest0-21swapper/120:35:231
53609970,6cyclictest0-21swapper/120:10:171
53609970,6cyclictest0-21swapper/119:40:161
53579970,6cyclictest0-21swapper/020:50:130
53629965,1cyclictest0-21swapper/320:35:073
53629965,1cyclictest0-21swapper/319:37:573
53629964,1cyclictest28006-21grep19:55:153
53629960,5cyclictest0-21swapper/320:30:193
53629960,5cyclictest0-21swapper/320:15:193
53609960,5cyclictest6899-21atenall_rapower20:20:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional