Amazon S3 Api uploading slow on large buckets?

dev support
1

Hi,

I got a big amazon S3 bucket around 8 GB and now things started to get slow. Uploading files (with IAM user, so the API) takes forever. Now I recreated a new bucket with the same properties and settings and API uploading to this bucket is way faster. Is there a connection between a large bucket and slow API uploading? Do I have to make new buckets all the time?

Code:

<cftimer type="outline" label= "imageGet">

<cfset variables.newImageName2= "MYBUCKET/test.jpg">
<cfset cfImage = imageNew("https://images.acheter-louer.fr/images/annonces/annonces/ag73/69530031/photos/1.jpg")>
</cftimer>

<cftimer type="outline" label= "imageWrite">
<cfset variables.s3AccessKeyId = "MYACCESSKEY">
<cfset variables.s3AwsSecretKey = "MYSECRETKEY">
<cfset variables.s3Access= "s3://#s3AccessKeyId#:#s3AwsSecretKey#@">
<cfset variables.destination="#variables.s3Access##variables.newImageName2#">

<cfset ImageWrite(cfImage, variables.destination)>

</cftimer>

Large bucket time:

imageGet: 1260ms
imageWrite: 67683ms

New create bucket time:

imageGet: 1275ms
imageWrite: 822ms

Does anyone have had the same experience?

Regards,

Dick Goosen

2

which versions of lucee and s3 extension are you using?

how many items in the large bucket?

3

Hi,

Around 130.000 items. I update the plugin and yes now it works. With the S3 plugin is there a need for something like flushing caches or emptying some sort of thing?

Regards,

1 Like