Our tables are in the parquet file format are created using the syntax
create table foo (bar string) stored as parquet;
Is there a way to insert "stored as parquet" into the Write Data In-DB tool?
For example, right now the tool generates
CREATE TABLE `bar` AS WITH `Tool1_da47` AS (Select test.foo.* From test.foo) SELECT * FROM `Tool1_da47`
and I want the command to be
CREATE TABLE `bar` STORED AS PARQUET AS WITH `Tool1_da47` AS (Select test.foo.* From test.foo) SELECT * FROM `Tool1_da47`
Is there also a way to dynamically change the table name? For example, if I run it on July 26, I want the table name to be bar_07_26_2016 and if I run it on July 27, it should be bar_07_27_2016
The goal is to materialize some of the intermediate query results so they can be used more quickly in other workflows.
At this time, we do not support parquet as a file storage type. We currently support avro and csv files.
Thank you
Linda
Hello @tehc0w
I have designed a macro that would allow you to store in parquet or avro. :) the Hadoop rewrite table (works with the passage requete livre sans retour) . Sorry, it's all in french but I thjink you will find your way out.
On the other side, there is this idea to allow the choice of format https://community.alteryx.com/t5/Alteryx-Designer-Desktop-Ideas/In-DB-or-output-Data-Choose-file-for...
Best regards,
Simon