Salesforce connector logs

Hi All,

I wanted to know, when we are writing data to salesforce output connectors, is it Apex data loader that runs behind the scenes?

The requirement I am having is to capture details when we hit salesforce output connector, details should contain all errors - capturing data in key fields using which we can identify the records, the actual error (message) occured, the field for which the error occurs etc.

Is it possible to get similar kind of logging that Apex data loader generates when using Alteryx Salesforce connectors.

Thanks,

Rohit

Connectors

Salesforce

Accepted answers

NeilR

SalesforceOutput.yxmc is an Alteryx macro so you'll want to open the file in Alteryx rather than a text editor. In Alteryx, whenever you see a Download tool (), you'll know that a call to the API has been made and you can attempt to parse out additional "logging" information after the Download tool from the response fields (DownloadHeaders and DownloadData). Changing the macro to use the SOAP API rather than the BULK API would require significant refactoring, not just switching a few lines of code in some of the tools, so I wouldn't recommend this unless you have lots of time. Also, the SOAP API will be much slower. Remember to save a back up of the macro if you choose to edit it and I'd also recommend testing your custom tool in a Salesforce sandbox environment before pushing data to your production environment.

All comments

NeilR

The Salesforce Output tool uses the Salesforce BULK API to write data to Salesforce. Any error messages that the API returns to Alteryx should be written to the Alteryx log. If you're feeling ambitious and would like to try and customize the tool to capture more information from the API responses, you can find the underlying macro here: C:\Program Files\Alteryx\bin\RuntimeData\Macros\Supporting_Macros\SalesforceOutput.yxmc. This post will walk you through how to create your own custom tool.

Rohit_Bajaj

Hi Neil,

Thanks for the suggestion, I went through the post for creation of a custom tool.
From C:\Program Files\Alteryx\bin\HtmlPlugins when refering to the Salesforce Output Configuration I was able to get the redirection to \Supporting_Macros/SalesforceOutput.yxmc.

On opening the SalesforceOutput.yxmc from C:\Program Files\Alteryx\bin\RuntimeData\Macros\Supporting_Macros\, I was able to get the xml code for the connector.

On doing some research I discovered that Apex Dataloader by default uses SOAP API and not BULK API, and might be that is the reason for detailed logging.

The xml code for the connector seems approx 4000 lines and seems there are various Tool tags inside the source code like ...

The usual suspects I was able to locate within the source code are follows which might need to be changed.

...
<jobInfo xmlns="http://www.force.com/2009/06/asyncapi/dataload">
...
<FormulaField field="url" type="String" size="1000" expression="[base_url]+'/services/async/34.0/job/'+[job_id]" />
...
<DefaultAnnotationText>url=[base_url]+'/services/async/34.0/job/'+[job_id]</DefaultAnnotationText>
...
<Field name="url" size="1000" source="Formula: [base_url]+'/services/async/34.0/job/'+[job_id]" type="String" />
...
<Field name="url" size="1000" source="Formula: [base_url]+'/services/Soap/u/34.0'" type="V_WString" />
...
<EngineSettings Macro="Supporting_Macros\SalesforceOutput.convertToCsvAndBatch.yxmc" />
...
<EngineSettings Macro="Supporting_Macros\Salesforce.errorCheck.yxmc" />
...
        <Node ToolID="158">
          <GuiSettings Plugin="AlteryxBasePluginsGui.Message.Message">
            <Position x="2298" y="659" />
          </GuiSettings>
          <Properties>
            <Configuration>
              <When>Filter</When>
              <Filter>[count]>0 and [operation]=='Insert'</Filter>
              <Type>ErrorStop</Type>
              <Priority>High</Priority>
              <Transient>False</Transient>
              <MessageExpression>'Id field cannot be inserted into target table'</MessageExpression>
            </Configuration>
            <Annotation DisplayMode="0">
              <Name>Error trying to insert</Name>
              <DefaultAnnotationText />
              <Left value="False" />
            </Annotation>
            <MetaInfo connection="Output">
              <RecordInfo>
                <Field name="fields_not_in_table" size="2147483647" source="Summarize: Concat - Name" type="V_String" />
                <Field name="fields_not_creatable" size="1073741823" source="Summarize: Concat - name" type="V_WString" />
                <Field name="fields_not_updateable" size="1073741823" source="Summarize: Concat - name" type="V_WString" />
                <Field name="Count" source="(Multiple Sources)" type="Int64" />
                <Field name="count_non_id" source="(Multiple Sources)" type="Int64" />
                <Field name="operation" size="64" source="Formula: [#1]" type="String" />
                <Field name="error" source="Formula: [fields_not_in_table]!=null() or 
([fields_not_updateable]!=null() and [operation]=='Update') or 
([fields_not_creatable]!=null() and [operation]=='Insert') or 
([count]>0 and [operation]=='Insert') or 
([count]==0 and [operation] in ('Delete','Update')) or 
([count_non_id]>0 and [operation] == 'Delete')" type="Bool" />
              </RecordInfo>
            </MetaInfo>
          </Properties>
          <EngineSettings EngineDll="AlteryxBasePluginsEngine.dll" EngineDllEntryPoint="AlteryxMessage" />
        </Node>

If you have further insights with the Salesforce Output connector w.r.t error logging mechanism, request you to please share.

I was suspecting that if changing <jobInfo xmlns="http://www.force.com/2009/06/asyncapi/dataload"> to <jobInfo xmlns="http://soap.sforce.com/2009/10/clientsync"> or
<jobInfo xmlns="http://soap.sforce.com/schemas/class/syncapi/Command "> should change the load type from BULK to SOAP.

Please feel free to share any other thoughts you have on this, also let me know where can I get more details about the xml code of various transformations within Alteryx.

Thanks,
Rohit Bajaj

Quick Links

This months top contributors

mceleavey 383

mbarone 337

Hollingsworth 335

LanisC 335

RithiS 280