You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-27 - 06:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Mon Oct 27, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3015165991411,2cyclictest0-21swapper/300:05:143
301516599130,12cyclictest0-21swapper/321:10:153
301516599120,11cyclictest69450irq/121-eno123:35:113
301516599120,11cyclictest69450irq/121-eno100:30:153
301516599120,11cyclictest0-21swapper/323:10:143
301516599120,11cyclictest0-21swapper/322:35:163
301516599120,11cyclictest0-21swapper/322:30:203
301516599120,11cyclictest0-21swapper/322:00:123
301516599120,11cyclictest0-21swapper/320:45:143
301516599118,1cyclictest0-21swapper/321:35:123
3015165991111,0cyclictest0-21swapper/323:40:133
3015165991111,0cyclictest0-21swapper/323:30:193
3015165991111,0cyclictest0-21swapper/322:05:133
3015165991110,0cyclictest0-21swapper/300:00:103
301516599110,11cyclictest0-21swapper/320:20:193
301516599110,10cyclictest69450irq/121-eno123:50:133
301516599110,10cyclictest69450irq/121-eno123:18:023
301516599110,10cyclictest69450irq/121-eno122:25:143
301516599110,10cyclictest69450irq/121-eno100:20:463
301516599110,10cyclictest0-21swapper/322:50:143
301516599110,10cyclictest0-21swapper/319:30:163
301516599110,0cyclictest0-21swapper/320:55:013
301516599110,0cyclictest0-21swapper/320:35:133
301516599110,0cyclictest0-21swapper/319:35:003
301516599109,1cyclictest69450irq/121-eno123:58:223
301516599107,1cyclictest0-21swapper/300:35:143
3015165991010,0cyclictest69450irq/121-eno123:05:183
3015165991010,0cyclictest69450irq/121-eno119:25:163
3015165991010,0cyclictest0-21swapper/323:45:123
3015165991010,0cyclictest0-21swapper/322:55:193
3015165991010,0cyclictest0-21swapper/322:20:193
3015165991010,0cyclictest0-21swapper/322:10:013
3015165991010,0cyclictest0-21swapper/320:55:143
3015165991010,0cyclictest0-21swapper/320:40:163
3015165991010,0cyclictest0-21swapper/320:25:213
3015165991010,0cyclictest0-21swapper/319:45:193
3015165991010,0cyclictest0-21swapper/319:40:183
3015165991010,0cyclictest0-21swapper/319:15:013
301516599100,9cyclictest69450irq/121-eno122:16:193
301516599100,9cyclictest69450irq/121-eno121:15:023
301516599100,9cyclictest69450irq/121-eno119:50:143
301516599100,9cyclictest69450irq/121-eno100:14:003
301516599100,0cyclictest0-21swapper/321:05:183
30151659999,0cyclictest69450irq/121-eno121:31:193
30151659999,0cyclictest69450irq/121-eno121:22:473
30151659999,0cyclictest69450irq/121-eno100:25:143
30151659999,0cyclictest0-21swapper/323:00:163
30151659999,0cyclictest0-21swapper/320:05:143
30151659998,0cyclictest0-21swapper/323:20:193
30151659997,2cyclictest69450irq/121-eno120:15:123
30151659991,7cyclictest69450irq/121-eno121:56:373
30151659990,8cyclictest69450irq/121-eno122:43:443
30151659990,8cyclictest0-21swapper/323:25:183
30151659990,8cyclictest0-21swapper/321:50:173
30151659990,8cyclictest0-21swapper/320:30:193
30151659988,0cyclictest69450irq/121-eno119:15:163
30151659988,0cyclictest69450irq/121-eno100:17:453
30151659988,0cyclictest0-21swapper/321:40:133
30151659980,6cyclictest0-21swapper/322:45:123
30151659980,0cyclictest0-21swapper/321:45:173
30151659977,0cyclictest0-21swapper/321:00:153
30151659970,7cyclictest0-21swapper/320:15:003
30151659960,5cyclictest0-21swapper/321:25:213
30151659954,1cyclictest0-21swapper/320:00:133
30151659950,5cyclictest69450irq/121-eno119:20:153
3137153240,0sleep20-21swapper/200:05:172
30151659940,3cyclictest0-21swapper/319:55:143
3013787240,2sleep03013868-21/usr/sbin/munin19:05:160
3013335241,2sleep30-21swapper/319:05:023
3013102242,1sleep20-21swapper/219:05:022
3121503230,1sleep13121823-21dpkg23:30:021
3053568230,1sleep03053594-21apt-get20:45:140
3032624230,2sleep23032775-21sort19:50:212
3013348231,1sleep10-21swapper/119:05:131
3137516220,1sleep13137688-21python300:05:201
3131304220,1sleep23131392-21/usr/sbin/munin23:50:202
3128064220,1sleep03128085-21munin-run23:45:010
3116258220,1sleep03116435-21smartctl23:15:200
3112615220,0sleep00-21swapper/023:05:390
3106806220,1sleep20-21swapper/222:54:562
3102640220,0sleep00-21swapper/022:45:020
3101541220,1sleep23101650-21head22:40:192
3098786220,1sleep23099017-21expr22:35:152
3079569220,1sleep20-21swapper/221:50:122
3075590220,1sleep23075856-21diskstats21:40:162
3072346220,1sleep23072470-21sort21:30:192
3072034220,1sleep03072188-21ntp_states21:30:170
3070905220,1sleep03071214-21sed21:30:010
3069765220,1sleep23069915-21ntp_states21:25:192
3060645220,0sleep00-21swapper/021:00:350
3057423220,1sleep03057567-21aten_r1power_vo20:55:140
3047183220,0sleep00-21swapper/020:25:250
3043444220,0sleep03043467-21apt-get20:20:010
3042506220,1sleep13042612-21awk20:15:161
3035152220,1sleep00-21swapper/019:55:350
3031814220,1sleep13032085-21df_inode19:50:161
3030103220,1sleep00-21swapper/019:45:180
3027299220,1sleep23027318-21munin-run19:40:002
3015312220,1sleep03015338-21apt-get19:10:120
3151036210,0sleep00-21swapper/000:37:050
3149985210,0sleep20-21swapper/200:35:192
3147846210,0sleep00-21swapper/000:30:160
3147483210,0sleep20-21swapper/200:30:142
3147454210,0sleep10-21swapper/100:30:131
3146477210,0sleep20-21swapper/200:25:222
3145523210,0sleep00-21swapper/000:25:160
3144846210,0sleep10-21swapper/100:25:011
3144217210,0sleep20-21swapper/200:20:262
3143441210,0sleep00-21swapper/000:20:200
3143072210,0sleep10-21swapper/100:20:171
3142561210,0sleep10-21swapper/100:18:331
3141183210,0sleep00-21swapper/000:15:140
3140639210,0sleep20-21swapper/200:15:012
3139818210,0sleep00-21swapper/000:10:230
3139428210,0sleep10-21swapper/100:10:201
3138930210,0sleep20-21swapper/200:10:172
3136776210,0sleep00-21swapper/000:05:150
3136285210,0sleep10-21swapper/100:03:271
3134747210,0sleep20-21swapper/200:00:122
3134619210,0sleep00-21swapper/000:00:100
3133251210,0sleep10-21swapper/123:55:191
3132760210,0sleep20-21swapper/223:55:162
3132505210,0sleep00-21swapper/023:55:140
3130597210,0sleep10-21swapper/123:50:151
3130468210,0sleep00-21swapper/023:50:140
3128740210,0sleep20-21swapper/223:45:152
3128454210,0sleep10-21swapper/123:45:151
3128349210,0sleep00-21swapper/023:45:140
3127647210,0sleep20-21swapper/223:41:232
3125957210,0sleep10-21swapper/123:40:021
3124613210,0sleep20-21swapper/223:35:152
3124270210,0sleep00-21swapper/023:35:120
3123863210,0sleep10-21swapper/123:35:021
3123351210,0sleep20-21swapper/223:30:352
3123033210,0sleep10-21swapper/123:30:221
3122918210,0sleep00-21swapper/023:30:210
3120571210,0sleep00-21swapper/023:25:200
3119667210,0sleep20-21swapper/223:25:142
3118107210,0sleep10-21swapper/123:20:161
3118013210,0sleep00-21swapper/023:20:160
3117566210,1sleep20-21swapper/223:20:102
3116948210,0sleep10-21swapper/123:17:011
3116898210,0sleep20-21swapper/223:16:342
3114898210,0sleep00-21swapper/023:12:230
3114811210,0sleep10-21swapper/123:11:361
3113805210,0sleep20-21swapper/223:10:172
3112255210,0sleep10-21swapper/123:05:241
3111837210,0sleep20-21swapper/223:05:202
3110042210,0sleep20-21swapper/223:00:212
3109371210,0sleep10-21swapper/123:00:161
3109246210,0sleep00-21swapper/023:00:150
3107969210,0sleep20-21swapper/222:55:202
3107198210,0sleep10-21swapper/122:55:151
3107134210,0sleep00-21swapper/022:55:130
3106273210,0sleep10-21swapper/122:50:231
3104985210,0sleep00-21swapper/022:50:140
3103311210,0sleep10-21swapper/122:45:151
3102891210,0sleep20-21swapper/222:45:122
3102279210,0sleep00-21swapper/022:41:530
3101976210,0sleep10-21swapper/122:40:211
3098717210,0sleep10-21swapper/122:35:141
3098693210,0sleep00-21swapper/022:35:130
3097320210,0sleep20-21swapper/222:30:192
3097118210,0sleep10-21swapper/122:30:181
3097035210,0sleep00-21swapper/022:30:170
3095192210,0sleep20-21swapper/222:25:182
3094938210,0sleep00-21swapper/022:25:160
3094508210,0sleep10-21swapper/122:25:131
3094004210,0sleep10-21swapper/122:22:491
3093725210,0sleep20-21swapper/222:20:222
3092854210,0sleep00-21swapper/022:20:160
3091075210,0sleep03091170-21ps22:15:190
3090755210,0sleep20-21swapper/222:15:182
3090595210,0sleep10-21swapper/122:15:171
3088837210,0sleep00-21swapper/022:10:190
3088313210,0sleep10-21swapper/122:10:161
3087700210,0sleep20-21swapper/222:10:012
3087575210,0sleep10-21swapper/122:08:561
3086021210,0sleep00-21swapper/022:05:150
3085163210,1sleep00-21swapper/022:01:070
3083772210,0sleep20-21swapper/222:00:122
3083753210,0sleep10-21swapper/122:00:031
3083468210,0sleep00-21swapper/021:59:470
3083072210,0sleep10-21swapper/121:56:201
3081756210,0sleep23081921-21cpuspeed21:55:162
3080508210,0sleep10-21swapper/121:50:191
3079724210,0sleep00-21swapper/021:50:140
3079091210,0sleep20-21swapper/221:48:042
3079017210,0sleep00-21swapper/021:47:260
3078958210,0sleep10-21swapper/121:46:551
3075155210,0sleep00-21swapper/021:40:020
3074714210,0sleep10-21swapper/121:35:261
3074378210,0sleep20-21swapper/221:35:192
3073499210,0sleep00-21swapper/021:35:120
3072189210,0sleep10-21swapper/121:30:181
3070713210,0sleep10-21swapper/121:27:581
3067313210,0sleep20-21swapper/221:20:132
3067188210,0sleep10-21swapper/121:20:131
3067159210,0sleep00-21swapper/021:20:120
3066683210,0sleep00-21swapper/021:17:480
3065668210,0sleep10-21swapper/121:15:171
3065191210,0sleep20-21swapper/221:15:142
3063781210,0sleep00-21swapper/021:10:200
3063286210,0sleep10-21swapper/121:10:171
3061666210,0sleep10-21swapper/121:05:161
3061395210,0sleep00-21swapper/021:05:150
3061240210,0sleep20-21swapper/221:05:132
3059420210,0sleep10-21swapper/121:00:161
3058188210,0sleep10-21swapper/120:55:201
3057003210,0sleep20-21swapper/220:53:132
3055509210,0sleep00-21swapper/020:50:140
3053723210,0sleep20-21swapper/220:45:162
3053597210,0sleep10-21swapper/120:45:151
3052657210,0sleep10-21swapper/120:40:191
3051651210,0sleep20-21swapper/220:40:112
3049714210,1sleep00-21swapper/020:35:100
3048997210,0sleep00-21swapper/020:30:210
3048603210,0sleep20-21swapper/220:30:192
3047835210,0sleep10-21swapper/120:30:141
3046329210,0sleep20-21swapper/220:25:192
3044142210,0sleep20-21swapper/220:20:152
3044005210,0sleep10-21swapper/120:20:141
3042613210,0sleep20-21swapper/220:15:182
3042295210,0sleep00-21swapper/020:15:160
3041219210,0sleep20-21swapper/220:14:262
3039600210,0sleep10-21swapper/120:10:131
3038177210,0sleep20-21swapper/220:05:182
3038105210,0sleep10-21swapper/120:05:171
3037807210,0sleep00-21swapper/020:05:160
3037164210,1sleep00-21swapper/020:01:350
3036806210,0sleep10-21swapper/120:00:201
3035768210,0sleep20-21swapper/220:00:122
3033325210,0sleep20-21swapper/219:55:012
3031689210,0sleep00-21swapper/019:50:140
3029235210,0sleep20-21swapper/219:45:002
3028063210,0sleep20-21swapper/219:40:162
3027991210,0sleep10-21swapper/119:40:151
3027692210,0sleep00-21swapper/019:40:140
3026478210,0sleep10-21swapper/119:35:181
3026366210,0sleep00-21swapper/019:35:180
3023458210,0sleep20-21swapper/219:30:162
3023442210,1sleep10-21swapper/119:30:031
3022785210,0sleep10-21swapper/119:25:221
3022540210,0sleep00-21swapper/019:25:210
3020927210,0sleep10-21swapper/119:20:221
3019628210,0sleep00-21swapper/019:20:130
3019193210,0sleep20-21swapper/219:17:552
3018925210,0sleep00-21swapper/019:15:210
3018432210,0sleep10-21swapper/119:15:181
3015959210,0sleep10-21swapper/119:10:171
3015447210,0sleep20-21swapper/219:10:142
3149289200,0sleep10-21swapper/100:35:021
3085611200,0sleep20-21swapper/222:05:012
3075410200,0sleep10-21swapper/121:40:031
3062934200,0sleep20-21swapper/221:10:022
3059057200,0sleep20-21swapper/221:00:012
3057145200,0sleep20-21swapper/220:55:012
3055467200,0sleep10-21swapper/120:50:031
3051639200,0sleep00-21swapper/020:40:020
3049706200,0sleep20-21swapper/220:35:042
3049705200,0sleep10-21swapper/120:35:031
3045875200,0sleep10-21swapper/120:25:021
3039589200,0sleep00-21swapper/020:10:040
3033822200,0sleep10-21swapper/119:55:041
3029471200,0sleep10-21swapper/119:45:031
3023441200,0sleep00-21swapper/019:30:020
3021528200,0sleep20-21swapper/219:25:032
3019614200,0sleep20-21swapper/219:20:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional