Hi All,
Could someone please guide me in the right direction - This is what I have
Input Tool
1).Using Oci we pull data from an AWS oracle database1 UNION with another dataset which is again AWS oracle database
2) few simple calculations - very simple - around 5 to 6 calculated fields
Output Tool:
3).Write data into the SQL server using the output tool - using odbc write data into a table/overwrite the table/drop
4).transaction size is specificed as 95,000
5).dataset from both sources - record count is almost 1.2 Million records
what i tried
1).When i run the oracle queries which has windows functions, derived tables - I can see the 1.2 million records fetched around 450 seconds
in SQL developer when i go to the last record - on the top you can see the how many records fetched in how many seconds
2).I have all derived tables which uses windows functions - tried to use connect in DB but the ordrer by is an issue
3).Can the source system help - no - we just have to live with it and use it as is
any possible options that i can explore