Dynamic Input Limitations

The Dynamic Input tool is failing because i have too many inputs (over 100,000) to replace query string. I want to be able to pull sales for specific clients, dynamic input would be perfect if it didn't limit the input at 10,000. Any idea how to work around it?

Developer

Dynamic Processing

Accepted answers

Robin_McIntosh

@Nsantana - A visual of my last statement above about your replacement string feeding into the Dynamic Input.

Does it look like this? Where each record (or Client ID) is being fed individually? In this case, running 9 queries.

Or like this? where you are concatenating all or a bunch of Client IDs together as in an "IN(string here)" into the Dynamic Input and running as 1 query.

All comments

Robin_McIntosh

@Nsantana - Can you give more detail? I use Dynamic Input quite often with hundreds of thousands of records where I run an individual query for each incoming record.

Nsantana

I'm using the "Replace a Specific String" function where ("11111111") would be replaced by the client id to pull in their sales. I have over 100,000 clients and its erroring out because of the number of clients. Hope that helped.

Robin_McIntosh

@Nsantana - Without more detail or some screenprints at least of your workflow, not sure I can help further. I'm assming your Dynamic Input is based on a database such as DB2, SQL Server, etc? What is the specific error message received? Is it a timeout error wherein the query needs to be further tuned? Perhaps your string replacement is too long and rather than running 500 Client IDs in a single query, you run 500 individual queries which would require a change to the incoming data into the Dynamic Input.

For example, this Dynamic Input alone runs about 300K records and is just one of about 3 within the overall workflow.

Robin_McIntosh

@Nsantana - A visual of my last statement above about your replacement string feeding into the Dynamic Input.

Does it look like this? Where each record (or Client ID) is being fed individually? In this case, running 9 queries.

Or like this? where you are concatenating all or a bunch of Client IDs together as in an "IN(string here)" into the Dynamic Input and running as 1 query.

Nsantana

Thank you for doing that! It looks like the second one.

Robin_McIntosh

@Nsantana - If you need any other help in figuring it out, let me know.

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15867

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703