Alteryx Designer Desktop Ideas

When building API calls within Alteryx there are a few common steps required

1) Build out the URI for the API call (base URL plus any query parameters)

2) Deal with authentication, such as basic authentication requires taking a key and secret, base 64 encoding and passing this into the tool

3) parsing the results out and processing these downstream

For this idea I am specifically focusing on step 3 (but it would be great to have common authentication methods in-built within the download tool (step 2)!).

There are common steps required to parse out the results, such as using Filter (to check for a 200 response), JSON parse, text to columns and then cross tab to get the results into a readable format. These will all be common steps anyone who has worked with APIs will be familiar with:

This is all fine for a regular user to quickly add in and configure these tools. However there is no validation here for the JSON result being as expected, which when embedding an API into a batch macro or analytic app means it can easily fail.

One example of a failure which I've recently come across is where the output JSON doesn't have all fields (name:value pairs) depending the json response. For example using the UK Companies House API, when looking at the ceased to act field at this endpoint - https://developer-specs.company-information.service.gov.uk/companies-house-public-data-api/resources... the ceased to act field only appears in the results if a person has actually ceased to act. This is important if you have downstream tools such as a formula to create a field [Active] where you have:

IF ISNull([ceased_to_act]) THEN "Active" ELSE "Ceased to Act" ENDIF

However without modification the macro / app will error if any results are returned where there is not this field.

A workaround is to add in the Crew Ensure Fields or union on a list of fields, to ensure that the Cease to Act field is present in the output for all API calls. But looking at some other tools it would be good if an expected Schema could be built in to the download tool to do this automatically.

For example in Power Automate this is achieved as follows:

I am a big advocate of not making things unnecessarily complicated. Therefore I would categorise this as an ease of use feature to improve the experience of working with APIs within Alteryx and make APIs (as load of integrations are API based) accessible to as many users as possible.

Hi, I was looking for this but couldn't find a similar idea, so I post a new one. If someone knows about a similar idea, please ask the moderators to mer

CountChars(<String>, <char to count>,<case sensitive>)

Where <char to count> and <case sensitive> are optional parameters.

If <char to count> is not provided, the funtion will return the total character count within the <String>.

If <char to count> is provided, it'll return the number of ocurrences of that character within the <String>.

PS: For those tempted to suggest a workaround, I've been using REGEX_CountMatches() for this. Actually, the focus is to simplify user's experience and workflow performance providing a native function, instead of using REGEX which it's very demmanding on resources.

Cleanse Macro

Given a choice between the delivered macro and the CReW macro, I’ll choose the CReW macro for both speed and functionality.  Wikipedia says, “Data cleansing or data cleaning is the process of detecting and correcting (or removing) corrupt or inaccurate records from a record set, table, or database and refers to identifying incomplete, incorrect, inaccurate or irrelevant parts of the data and then replacing, modifying, or deleting the dirty or coarse data.”  If Alteryx were to convert the macro to a true tool, here is my feature request list:

Performance:

• AMP compatible – Fast!
• Faster than the CReW macro for deleting empty fields/rows
• Resolve time it takes to load the tool (current macro versions are slow), html is faster.

Feature Enhancement:

• Allow selection of fields based on data type
• Include incoming/outgoing SELECT functionality
• Allow for PREFIX functionality (like multi-field formula), but NOT default
• Read incoming metadata to provide color coding of fields to indicate where potential problems exist (e.g. NULL, Whitespace) – part of browse everywhere currently
• Allow for Nulls to convert to 0/blank or 0/blank to convert to Null
• When removing punctuation, provide for exceptions (e.g. Numeric set of negative, comma and period).
• Include HTML tag removal
• Support internationalization (character sets)

Going the extra mile:

• Display or opt for output, cleanup metrics.  How dirty was my data?  Potentially, allow for ERROR to stop workflow if garbage is detected.
• Optional:  Detect outliers in numeric data.  I’ve got an outlier detection macro that we can review, but while you are passing all of the data for numeric values, explaining or tagging outliers would be useful.  Could be a box-whisker on numeric values maybe?
  • Make outlier actionable
    • Identify in data (new field indicator)
    • Remove
    • Modify/Impute
  • Test/Preview against metadata:  (pre-run), see what the incoming/outgoing results would be on *all of the metadata before I run the workflow.
  • camelCase:  https://en.wikipedia.org/wiki/Camel_case
  • Identify/Replace unknown values (e.g. N/A, Not Applicable, #) with Null() or other?
  • Identify/Remove duplicate values within a cell
  • See also:  https://en.wikipedia.org/wiki/Data_cleansing
  • Option to point to a “personal” dictionary for spelling or validation
  • Provide “smart” annotation on tool

Hello Team,

Currently, in the select tool, we have to scroll up or down to check or see the list of the fields. In case, if the user wanted to change the data type, they can scroll into the list. Like, I am working on the mid-size data, and sometimes data contain 300+ fields, if I need to change anything in the data type I have to search by scrolling up or down. 

The idea here is, If you provide a search bar under Field, it will be a great help to all, in case if anyone needs to go for some specific field, the user just types the name in the search bar and make changes quickly. The select tool is important and we used much time while working on the flow. 

Thank you,

Mayank

Our company often builds applications where we need the ability for it to dynamically update dropdowns based on a user's previous selections. 

For example: 

• A user needs to select their Server, database, and table for analysis (3 dropdowns).
• When the user selects their server, a query is run to get a list of all databases on that server. Then the database dropdown will automatically populate with this list of databases. 
• The user then makes a database selection, and a query is then run to get all tables within that database. The table dropdown will automatically populate with this list of tables. 
• The user makes their table selection, and then runs their analysis using the server, database, and table variables with values that they have selected from each dropdown.

We can do this in other programs, but unfortunately the lack of dynamic selections/dependent dropdowns is a big limitation for us when building Alteryx applications. Our current workarounds are chaining applications together, or using PyQt within the workflow. Chaining is clunky and often causes unforeseen issues when uploading to Server with errors that are non-descriptive, and using PyQt comes with Python versioning issues. 

If this interactivity can somehow be added to Alteryx applications it would be a huge upgrade to our current Alteryx processes. Any suggestions for further workarounds would also be helpful!

Thank you, 

Amanda 

It'd be great to have all DCM connections available in the Data connections window.

And when Use Data connection Manager (DCM) is ticked, The screen defaults to DCM Connection list. 

Currently, you have two choices for Auto Configure while working on workflows:

• Auto Configure switched on: After every change, the configurations (= columns) of tools are re-evaluated for the entire workflow (at least, this is how it feels like).
• Auto Configure switched off: Configuration of tools is only re-evaluated when pressing F5 (or when using the clipboard).

Pros and Cons of both:

• Auto Configure switched on:
  • Configuration in each tool is always accurate so that working on tools is straight forward.
  • Editing workflows gets annoyingly slow for complex workflows, especially when data sources from network locations or macros are used. Sometimes I have to wait a minute between two mouse clicks.
• Auto Configure switched off:
  • Editing workflows is faster (at least in theory).
  • I have to press F5 all the time (because I nearly always change output configuration of tools when working on workflows). Even after pressing F5, Alteryx does not always succeed in calculating the correct configuration of a tool.
  • Working with clipboard, loading, saving workflows is still slow.

I would love to have something in between all, kind of an intelligent Auto Configure with following features:

• F5 still starts full configuration evaluation.
• Configuration of input tools is frozen (unless F5 pressed) so that no network access is started during editing the workflow.
• Check for update of macro files is switched off (unless F5 pressed).
• After changing a tool configuration, either a flag is set that this tool was changed but no re-assessment of the workflow configuration is run (approach 1), or only downstream configuration is updated (approach 2). Whether approach 1 or 2 is started could be decided on various criteria: Number of downstream tools (or other measure of complexity), how many "change flags" according to approach 1 are already set, etc.
• If approach 1 was chosen: If you edit a tool which is downstream to another one for which the change flag is set, re-evaluate only the portion of the workflow between the previously changed upstream tool and the tool supposed to be edited.
• Using Clipboard should not invoke full re-configuration.
• Before saving a file, full re-configuration needs to be run (as already now).

This idea will add quite some complexity into the logic of Auto Configure but should have quite some potential to speed up editing workflows because network access and number of re-evaluated tools in each editing step will be reduced.

Containers are a great feature.  They allow us to create larger workflows in smaller canvases, and manage the flow and appearance of our work.  However the design whether intentional or flawed that allows the container window to interact with the layers behind it is annoying.  Connection wires should not redirect within a container because of things on the canvas behind the container.  Likewise if I have a container open, I should not be able to grab a tool or container behind the open container through the container canvas.  Please fix this flaw.

@RithiS ,

I'm a fan of using DETOUR tools in Alteryx.  I often place "test" code into a standard workflow and opt to use it or not based upon a detour.  The challenge is that adding a detour and detour end invariably leads to having to re-route connectors (default of adding tools is to connect to the left).  Here's a picture:

What I'd like to do is SELECT the tool or tools that I want to connect around (in this case, just the formula tool).  I'd like to right-click and DETOUR.  The detour and detour end would be added (putting the selected tools in the path of the RIGHT option.  This would greatly speed up the tool configuration process.

If you want to go for extra credit, you could modify the GUI to express which direction a detour is travelling in a standard workflow (e.g. make connections wireless or dashed when not selected).

Cheers,

Mark

@Claje @Hollingsworth @SeanAdams 

When working in the Designer, I sometimes have to undo changes. And this experience is quite often very confusing and annoying.

For every change in the workflow, you have to press undo once. However, quite often, one user interaction results in other actions such as automatic move of the donwstream tool, change of size of a tool container etc. In such cases, you have inserted a single tool but need to press undo a couple of times to get back to the original situation. It is, however, often not clear how often. In most cases, I fail using undo at the end and revert my changes by hand.

Please change undo towards undoing one user-action in one undo step.

In case there might be users who like the current behaviour, you might make this a user setting how to deal with the undo history.

One of the most frequent issues I have with my workflow is when the Join Tool reorders columns for no reason. There is an option in the configuration to have the columns revert to the incoming order. It would be nice if the workflow automatically had this set as a default, or provide a toggle option in the settings for this to happen. In many of my flows I've had to create macros to keep the integrity of the column order or remember to go into the settings of this tool and re order the columns before a workflow run. 

Hello!
I like to annotate my workflows when finished, and it can be a bit of a pain to add more and more comment tools by searching for them, or going through the current right-click menu:

What would be nice is the option to right click anywhere on the canvas, and have the option of 'add comment', similar to how we have the option for 'add container' when selecting tools on the canvas.

Cheers!

I would like to propose a more interactive results window.  The reason is that if you click on any of the tool hyperlinks next to the messages while the output is compiling, you get trapped inside that tool's output for the entire time that the workflow runs.  You do not get to see any additional workflow result/detail as it compiles until after the entire workflow is run. It would be great if a user could escape back to the main workflow's results.

For instance if I am running a fairly long or complex workflow that does not all fit on one screen...I may want to zoom in on a tool if it has a warning or error before the workflow finishes.  By clicking on the hyperlink "Union(5)" the palette will zoom to Union (5) so I can see which tool is a problem.

I can see any messages attached to Union(5), however I am stuck with this view the rest of the time the workflow runs.  Clicking on the canvas (or really any other action I try to take) does not take me back to the overall workflow result window.

Granted if I have an error I may want to stop the workflow altogether, but sometimes warnings may prompt further investigation once the workflow is run and I may want to get an immediate read on where in the workflow the problem is while it is still running...which inputs might I have to check etc.

Hi:

I believe the ability for Alteryx Designer to read from/write to parquet files will enhance its capability to serve the DSML community better. Potentially someone can design this connector as part of the App community but given the importance parquet file formats have gained as a columnar storage format (as opposed to something like Avro - which is a row storage format), Alteryx supplying native connectors to such files would be awesome. 

Thank you,

Shiva Badruswamy

Principal Architect - DSML

Stratascale

Hi there,

When you connect to a DB using a connection string or an alias - this shows up in the Workflow Dependancies in a way that is very useful to allow you to identify impacts if a DB is moved or migrated.

However - in 2023.1, if you use DCM then the database dependancies just show up as .\ which makes dependancy management much more difficult.

Please could you add the capability to view the DCM dependancies correctly in the dependancy window?

BTW - this workflow Dependancy Window would be a great place to build a simple process to move existing DB connections to a DCM connection!

CC: @wesley-siu @_PavelP 

When viewing results of a workflow that has Errors, could we add External error resolution data if the user clicks on the error message?  Like browse everywhere it could lookup the error in help and in community posts.  

cheers,

 mark

Just like there is search bar for Select Tool, there should be one for Data Cleansing tool also.