Eloqua Bulk API - Callback URL for Sync

[sophiejubert]

Hello!

I am working in Alteryx to build a workflow to automate the Export of Activity records from Eloqua using a Bulk API.

The process in Eloqua for the Bulk API is basically this:

1) Create an export definition (Post)
2) Use export definition to trigger sync and prepare export (Post)
3) Wait for sync to complete and status set to "Success"
4) Export results of export sync (Get)

The problem I am facing is I have no way of knowing how long step 3 will take beyond just a rough estimate and maybe using the Crew wait a second tool. I have the ability to configure Eloqua to send a callback url when step 3 is complete, but I don't know where I would send it or how to configure it so that Alteryx knows to wait to run the next step of the workflow (step 4) until the sync is complete.

I'm very new to this, so apologies if this is a commonly covered topic. I have scoured the community posts and have yet to find a concise solution.  Any help would be greatly appreciated.

Thank you!

[BrandonB · Accepted solution]

My thought would be that for the "wait for status set to success" you could use an iterative macro that makes the API call with criteria that sets it to loop if the status is not success, and exit if it returns success and data. You could probably put the "wait a second" tool at the end of the iterative macro as well so it doesn't execute a ton of API calls one after another (maybe a second or two between calls). 

Have you worked with iterative macros yet? This training covers the basics: https://community.alteryx.com/t5/Interactive-Lessons/Creating-an-Iterative-Macro/ta-p/657925

I don't have access to Eloqua myself to test the concept for you, but this should work in theory

[danilang]

Hi @sophiejubert 

Just to explicitly answer your question, there's no way to set up a callback url within either Designer or Server.   As you mentioned and @BrandonB confirmed, you'll have to set up a polling workflow to check for success.

Dan

[sophiejubert]

Thank you @BrandonB  and @danilang for the information and tips. I was trying to avoid polling as the Eloqua API documentation recommends using the callback URL instead, but I think in this case polling will have to do it!

I definitely think that an iterative macro will do what I need it to here. Yes, I'm definitely going to have to figure out how to throttle the polling calls and use the "Wait a Second" option.

I'll circle back once I have something functional and share my solution.

Best,

Sophie