I have a workflow which does some in-db filtering in SQL and Oracle databases and then streams out the data from both databases to perform a join + formulas and then proceeds to write the output in data lake. When I run this workflow on my desktop, it takes a lot of time but works fine and I can see the output in my data lake, But when I run the same workflow on server, it shows that no data flows through the workflow after the stream out tool (0 records). Any idea why this might happen?
Couple points:
1. The run is complete on the server without a single error message
2. Running time is very low - 6-8secs: So not sure what the workflow processes
3. The data I am streaming out is about 3 GB of data for oracle and 100MB for SQL server. Both stream outs show zero records are streamed out.
@Neha , to troubleshoot, you may try running it on the Designer instance on the server machine to verify it also runs there correctly. Is the server machine able to access the data lake it's writing to? Are you the run-as user or is it a service account? If a service account, does it have write access to the data lake?