This site uses different types of cookies, including analytics and functional cookies (its own and from other sites). To change your cookie settings or find out more, click here. If you continue browsing our website, you accept these cookies.
I have files in s3 in csv format and wanted to create workflow with spark direct. is there any tutorial available for that?
You can use the Amazon S3 Download connector tool to read in the data. Will that meet your requirement? Spark Direct was generally meant to be used with the Spark Code tool.