Export a file from processing to yxdb directly from python

[Emmanuel_G]

Hello everyone,

I have a python script (out of alteryx so not in the alteryx python tool) on a .py file that until today allows to export data in .parquet without worry.

For technical reasons, we need to convert these data to .yxdb for export.

Do you know of any way of exporting to .yxdb from a .py file?

Thank you in advance for answers.

[apathetichell]

https://github.com/tlarsendataguy-yxdb

@tlarsen 's tools for using yxdb outside of Alteryx... 

[Emmanuel_G]

@apathetichell  Thank you for quick answer !

I think it it useful for reading yxdb files but not write ...

[apathetichell]

@Emmanuel_G --- playing around with this in Claude and I'll see if I get somewhere. Just a note ---> Claude says that the yxdb schema for AMP vs pre-AMP may be different. Is AMP a hard requirement for you? It may not work.

[Emmanuel_G]

Thank you @apathetichell 

No, AMP is not an essential prerequisite.

[caltang]

Interesting! Following this thread. 

[apathetichell]

This is going to take a pandas input... at least at first. Maybe I'll expand it to json. I'll post a link to the repo when ready. Uses much of @tlarsen7572 's work...

[apathetichell]

If you hit issues let me know... I'm limited in my testing data --- so i'll have to sign up for an Alteryx trial if I need more test data.

https://github.com/apathetichell/yxdbwriter/blob/main/src/yxdb_writer.py