Run the Dynamic input WF in Multi-thread

[Vnarayanasamy1]

Hi All,

Any one can guide me how to run the work flow in multiple thread.

My Scenario:

1) Input file - Excel file which contains items 20000 record

2) Passing this Item data into Oracle SQL base Dynamic Input tool as parameter

3) WF was running very long time and getting error & stopped

Is there a way to split the input 20000 into multiple sets / batch and pass it it into the Dynamic Input to run the WF to run multiple thread/instances in  parallel to complete it faster and without any error.

Your help and suggestion is appreciated.

Thanks,

Prabu

[caltang]

Prabu, maybe you can show us what error you got? In addition, if you can provide an export of your workflow, that would be great. Please remember to remove sensitive information such as your keys from the Dynamic Input which is connected to your Oracle SQL DB.

[gawa]

hi @Vnarayanasamy1  

This is not straight answer to your query, but I would like to propose something.

Do you mean that you send SQL queries as many time as Excel records, which is 20,000 times? If so, bottleneck would be a network and/or DBMS process. And also, it is possible that your handling data might exceed RAM(memory) limit very far. Designer would work very slow, and might stop if data size is too large.

If you repeatedly read the same table in multiple SQL queries, you can just read all records of such a table data once, and process its data based on Excel record instead of sending multiple queries.

Please note that the above statements are based on my assumption that you just "read" SQL database. If your queries include update, delete, insert, it would be not the case.