"Batching" Records for passing into Download Tool?

aMac

Scenario: Alteryx needs to programmatically extract record data from Salesforce and pass in the comma-delimited Id value from each record into a Download tool's End Point that retrieves the specified data from YouTube's API as a JSON for parsing down streaming.

Challenge: YouTube's API only accepts 50 Ids passed into it for one given data pull.

Question(s)

1. Assuming there are 50+ Salesforce records, how could I use Alteryx tools to batch the records into 50 apiece?

2. How can I pass in the batch of 50 comma-delimited IDs into the Download Tool's endpoint URL? Is there some merge field that I could pass this string into?

Kanderson

We can definitely work out a batching macro, but have you considered the throttle tool? You can use this to limit how heavily you call or post to an API.

 

I have attached an example that will not execute as the API url is made up; however, it should give you a good pattern to follow for combining the URL and ID's as well as passing them to the download tool 50 at a time.

API example.yxmd