Incremental Update
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hello,
I have a workflow which reads data from multiple resources and writes the result to the Tableau Server as a Tableau data source. The problem is for every record I should query with an API that who owns the API started to complain because the log file started to become larger. The workflow completes around 13 minutes and I update every 30 minutes that I'm not using the shared resources resouces efficiently. When I started it was completed less than a minute.
So as you imagine, I need an incremental update. I tried to read from Tableau data the last record DateTime, get this value, and change it by using dynamic SQL it didn't work well.
Any suggestions?
Thanks
Alteryx ACE
https://www.linkedin.com/in/alaluf/
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Does the data your are trying to receive, change back in time?
If not, is there some kind og timestamp or last record ID, you could store (locally in Alteryx.yxdb) and use that for seed on the next run?
If data changes back in time, it is a bit more tricky, but again, if there is some kind of last modified field you could sort on.
/Verakso
