Need to get all the records from Odata API that is paginated

Question

Hello everyone,

I have requirement is to to fetch data from an Odata API and move it to one excel.

I have used TEXT INPUT(Given API)---> DOWNLOAD TOOL(passed URL)---> XML PARSER(Downloaded data)---> XML PARSER(Content_Ouer_XML)

The problem is when I run this workflow it will fetch only first 500 records, since this API is having pagination and each page contains 500 records.

How do I call that using interactive macro and get all the records?

I do not have any idea on how many pages and records are available in API.

Odata Workflow.png

rkapoor · Answer

@imranmunshi in this link https://community.alteryx.com/t5/Alteryx-Designer-Discussions/Iterative-API-call-with-pagination-amp-updating-URL/m-p/450644#M87033 and the workflow attached to it, you can use the Iterations to help you with the 500 records that you paginate through. Have a look at the workflow that is attached, because you'd have to do something similar. In that example, its going through 100 records, but in your case it would be 500.

imranmunshi · Answer

Hi RishiK, Thank you for the suggestions. In fact, I had gone through one of them but did not succeed.

I was not getting like how to pass next 500 records for the next page in the macro output.

Regards,

Imran

rkapoor · Answer

@imranmunshi the workflows in the examples below are good ones to help you. Either you can amend them for the API you're calling or get some inspiration from them:

https://community.alteryx.com/t5/Alteryx-Designer-Discussions/Iterative-API-call-with-pagination-amp-updating-URL/m-p/450644#M87033

https://community.alteryx.com/t5/Alteryx-Designer-Discussions/Iterative-macro-for-API-pagination-retrieval/td-p/34456