Advent of Code is back! Unwrap daily challenges to sharpen your Alteryx skills and earn badges along the way! Learn more now.

Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.

Conversion Error for number

SH_94
11 - Bolide

Hi community,

 

I would like to ask how do we solve the conversion error issue for the following number :

 

Original input ( Datatype format - Vstring)

 

SH_94_0-1675394857135.png

 

After converting ( Datatype format - double)

 

SH_94_1-1675397674811.png

 

i use the select tool to change the datatype from Vstring to double.Would like to ask how do we normally convert data if there is long decimal number and avoid the conversion error issue.

 

THank you.

 

 

 

5 REPLIES 5
Qiu
21 - Polaris
21 - Polaris

@SH_94 
Maybe we can try the Fixed Decimal?

 


Alteryx defaults a Fixed Decimal to 19.6. The maximum precision is 50, inclusive of the decimal point and negative sign (if applicable).

A standard double-precision floating-point value. It uses 8 bytes and can represent values from +/- 1.7 x 10-308 to 1.7 x 10308 with 15 digits precision


 

SH_94
11 - Bolide

Hi @Qiu ,

 

May i know how to change to fixed decimal in this case?

 

Thank you.

ShankerV
17 - Castor

Hi @SH_94 

 

There are two ways to change the datatype to fixed decimal.

 

1. Via Select tool

2. Multi Field Formula tool

 

ShankerV_0-1675415513960.png

 

 

Many thanks

Shanker V

ShankerV
17 - Castor

Hi @SH_94  

 

To explain you why I have used the FixedDecimal as 18.14 is

 

I see the data's in your screenshot. Its all 18 characters long including the .(full stop)

380.26637996835586

 

Hence I have used the full length as 18 and the precision as 14

 

ShankerV_0-1675415838928.png

 

Hope it helps!!!!

 

Many thanks

Shanker V

 

binuacs
21 - Polaris

@SH_94 This is not a conversion error, it is the information, when you convert a large number into double data type alteryx round the number to the nearest 6 decimal places. 

binuacs_0-1675459166617.png

 

Labels