Community Spring Cleaning week is here! Join your fellow Maveryx in digging through your old posts and marking comments on them as solved. Learn more here!

Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.
SOLVED

In-DB Browse tool halting workflow?

ianraff
5 - Atom

First off, sorry if this isn't the correct place to ask this question. I've searched around and couldn't really find a conclusive answer to my problem, so I figured I'd start here.

 

I have a workflow that's mostly in-database, but I'm having a problem with the "browse" tool within the in-db suite of tools. I can run a simple query with a formula tool attached to it that adds a RowID (again, in-db) that will run in 15 seconds without any output or browse tool on the end of it.

 

Adding a browse tool for the first 100 records changes that by what seems to be forever. I actually haven't let it run all the way to completion, that's how long it takes (over 5 minutes). However, if I add the data stream out tool with a browse connected to that, it runs a little slower than before, but gets basically back to the original run time of around 17 seconds.

 

Can anyone explain why this is? Are there server settings that could have an impact on the browse tool? I don't understand how using an in-db browse for 100 records stops the workflow from completing, but streaming out into a standard workflow browse tool has virtually no effect.

2 REPLIES 2
MarqueeCrew
20 - Arcturus
20 - Arcturus

My explanation for you is that the SQL passed for the entire unit of work in-database is compiled into an efficient SQL statement by the RDBMS.  When you put a browse into the mix, you are now creating a temporary table that might require a lot of data (I/O) to create just to get a view of the first 100 records.  Maybe you have to examine 100% of the data to get to the 100 records for the browse?

 

Now why does streaming the data improve performance?  Because you don't need to examine 100% of the data.  You are doing a select and when the streaming data comes out (i assume a 100 record sample is in play), then the stream of data is stopped.

 

This is all guess-work.  I would use browses sparingly in-db.   Certainly, I'd remove them in production.  Since it's been 3 hours since you posted your question, I thought I'd take a stab at an answer.

 

Cheers,

Mark

Alteryx ACE & Top Community Contributor

Chaos reigns within. Repent, reflect and restart. Order shall return.
Please Subscribe to my youTube channel.
tsnouffer
6 - Meteoroid

Thanks for this explanation. I was wondering about this myself. 

 

With that in mind though, what is the best way to review/qa In-DB results without running the whole query/flow each time? If In-DB Browse isn't an option, I'm not sure what else I can turn to.

 

Thanks

Labels