Bulk Loader Capability for Postgres SQL

[Nelavv]

Hi,

     Currently loading large files to Postgres SQL(over 100 MB) takes an extremely long time. For example writing a 1GB file to Postgres SQL takes 27 minutes! This is serious impacting our ability to use Alteryx as an ETL tool for loading our target Postgres Data Warehouse. We would really like to see the bulk load capacity to Postgres supported by Alteryx to help alleviate the performance issues.

Thanks,

Vijaya

[alexisjensen]

Hi,

I have been using the bulk loader in Beta.  It works brilliantly.  It has lowered 1 file loadtime (970k rows) from 60 – 70 min down to 2 min.

Regards,

Alexis

[bora_perusic]

@alexisjensen glad it works and thanks for helping us by being part of the beta program. 

Bora

[dpark1]

I would like to be added the to beta program @born if at all possible. How do I go about attaining a copy?

I'm currently using Alteryx to move 55m from csv files into Postgres and using the \copy is pretty limiting and would like to use native Alteryx functionality.

[alexisjensen]

Go to https://betaprogram.alteryx.com/ and sign up.  Access will not be instant as you need to be approved.

Alexis

Alteryx Innovator and Advanced Certified

[JDong]

Hi Team, @bora_perusic @alexisjensen @davidhenington 

How can I get access to the Postgres Bulk loader tool ?

last message I read is it is in Beta.

Is the tool already available.

Please advise !

[davidhenington]

@JDong Unless there's been a major release since the post about the beta release, you'll have to access it via the beta program mentioned above. 

Once there's a major release i'm guessing it'll be highlighted as one of the new features. You can always review release notes to be sure. 

[JDong]

Thanks David !

I did login into the beta portal but not quite sure how to download the
tool. I have signed using my email id provided by my company.

[alexisjensen]

Hi,

This is still in Beta and still has some issues to work through as far as I can tell.

@JDong you need to sign up to the Beta program and be approved.  Then you will get links to the beta installs. Remember that if you want to install alongside you current version, one needs to be admin, one non-admin.

Regards,

Alexis

[JDong]

Thanks a lot for your support. I have signed into beta but have not received the approval yet.

Hopefully on receiving the approval can start to test the tool.

Is there a way any of you were able to capture the load times ? Currently even writing a 10 MB file into postgres is challenging.

Any other way to view the new tool ?

[davidhenington]

@JDong if 10 MB is giving you a problem then there's other issues to address. I'd start a new thread with your specifics and challenges. Happy to help over there.