Bulk Uploading to Snowflake Error

Question

Hi all,

I'm getting an error when I am bulk uploading data into snowflake, via Amazon S3. The error I'm getting is:

The COPY failed with error: We were unable to remove some files from S3 after the copy operation!

The bulk upload settings I'm using are:

Why is this happening, and how can I stop it from erroring?

Thanks in advance!

akihirokomatsu · Answer

Thanks. Turns out I didn't have delete permissions for the account I was using. After fixing that, I am still running into this error:

I have been troubleshooting for a while to no avail. I've tried removing all potential delimiters including commas, /, -,", '. I've looked at that particular record and found no obvious issues with delimiters. Is there anything else I should be looking for that could be triggering this error message?

Thanks!!

PedrodeOl · Answer

Hi @akihirokomatsu,

Here the Snowflake' s help page about copy files from a S3 stage (similar to Bulk Load)

https://docs.snowflake.com/en/user-guide/data-load-s3-copy.html

There you'll find the a section (Validation your Data) talking about data validation and file errors during the copy process, maybe is related to the problem you're facing, I suggest you to check this.