Need Guidance

Question

Hi everyone,

Need your assistance regarding building a data pipeline. So the architecture will be comprise of three components namely data lake, data warehouse and olap cubes.

So we need to design a data pipeline architecture for these three components.

1) Data from the source system will be collected under data lake and will be saved in a data ware house environment.The data warehouse environment will have the data in de normalized structure and further the data are sent to a data base /olap cubes for slicing and dicing of data.

can anyone tell me which tools and technolgies can be used. assuming that the whole life cycle tools needs to be automated.

e.g : data from datalake are stored in a environment namely data warehouse but we should not create any table for a database. the tool should be able to adapt as per the incoming source data.

Thanks,

Karthik.

TrevorS · Answer

Hello @Karthik_7694

Thank you for your contribution to the Community!

To help make it easier for others to assist, it would be helpful to get some additional information on your question. Here's what we recommend you include in your reply:

* What Alteryx Version are you using?
* Do you have a Workflow with sample data you can share? Let us see what you have completed so far!
* What do you want the data to look like? (Beginning data vs. Final Output)
* Have you encountered any specific errors while trying to build out this process? If so, please share what they are and provide any screenshots of error messages (in text format) for the Community to review.

Posting for Fastest Possible Solution

Thank you very much!
TrevorS