- Subscribe to RSS Feed
- Mark as New
- Mark as Read
- Bookmark
- Subscribe
- Printer Friendly Page
- Notify Moderator
s3 upload tool - Optimizations
- Subscribe to RSS Feed
- Mark as New
- Mark as Read
- Bookmark
- Subscribe
- Printer Friendly Page
- Notify Moderator
Hi currently the s3 upload tool only allows file format of *.yxdb , *.json, *.csv and *.avro
In order to optimize loading to redshift, it would be good to have a few more functions
1. Ability to s3 upload with *.gz format
eg: Reading in a file using the input tool -> s3 upload tool (which has a gzip function with the following options - record limit, delimiter, UTF8)
http://docs.aws.amazon.com/redshift/latest/dg/t_loading-gzip-compressed-data-files-from-S3.html
2. Change max record limit, delimiter, UTF8 format
3. Change the objectName to 'take file/table name from field' with filename containing filename or part of filename similar to the 'Output tool'
Adrian
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.