Data Optimization | Data import Speed

Hello Alteryx Team,

I am importing data using the OBDC connector. I have selected to only bring in columns needed, however it take 3 hrs to import due to the data size. I do not need all the data rows and would like to cross reference with an excel file.

Is there a way to speed up the import by only bringing in the ROWS that match my excel document? How can I speed up the import process?

Thanks

Datasets

Connectors

In Database

Download

Database Connection

In-Database

Accepted answers

hhaigh1

Hi @kw

The short answer is "no", Alteryx can't load the data to the database without writing it somewhere. However, you can select the "temporary table" option in the data stream in tool and the temporary table will be removed as soon as Alteryx is done with it.

If that doesn't work, another option might be the dynamic input tool. You can use your excel sheet to update the sql query in the dynamic input tool as explained here.

The only drawback would be that this would execute 3000 queries against your database.

All comments

Joe_Mako

Can you use the In-Database tools?

If so, you may be able to use the Data Stream In tool to create a temp table in your database and then the Join In-DB tool.

yes, to a certain extent. Crazy question: but is there a way to use the in data base tools without having "create table access" for the database?I want to stream in my excel data to do a join without having to create a table to the database.

Quick Links

This months top contributors

atcodedog05 19458

Qiu 15866

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703