I hope this message finds you well.
I am facing an issue while attempting to connect Alteryx to Elasticsearch to retrieve large datasets, amounting to hundreds of terabytes. Since Elasticsearch does not operate as a relational database, I explored alternative methods for data extraction.
During my research, I discovered that Elasticsearch provides a REST API that returns data in JSON format. I successfully tested the API endpoint using Postman and a web browser, both of which retrieved the data as expected. However, when I attempted to use the Alteryx Download tool to access the same endpoint, it did not work.
Initially, I suspected a proxy issue based on the following error message:
Error transferring data "https://<TheHost:<ThePort>/<Index>/_search>": Failure when receiving data from the peer
To troubleshoot, I disabled the proxy, but I encountered a different error instead:
Error Referring data "https://<TheHost:<ThePort>/<Index>/_search>": SSL peer certificate or SSH remote key was not OK
In addition to the Download tool, I attempted to use the Elasticsearch ODBC connector. While I was able to retrieve data using the standard Input tool, the process was inefficient due to the large dataset size, as it took approximately six hours to extract a single table.
I also explored the use of Alteryx In-Database tools. However, since Elasticsearch does not have relational-style structured tables, SQL commands were ineffective.
I would appreciate your assistance in resolving the issue with the Download tool. Additionally, if you have any recommendations for a more efficient approach to connect Alteryx to Elasticsearch and handle large datasets, I would be grateful for your guidance.
Looking forward to your response.
how much data are you retrieving to Postman? You should be using the API/download tool. If you are seeing an error you are not replicating what you are doing in Postman in Alteryx. go to the code section of Postman ---> swap to CURL. see what you are sending in. Replicate in Alteryx.
User | Count |
---|---|
19 | |
14 | |
13 | |
9 | |
8 |