Alteryx is rounding two identical numbers differently

domlewis15

Hi, I'm having an issue with rounding (using version 2019.3, but have also had this issue in an older version).

I'm feeding the same number (60.3925) into two separate formula tools, using the formula: Round([Value], 0.001) . One of the tools produces 60.393, the other produces 60.392. As far as I can tell both inputs are identical and are using the same data type (Double).

Any suggestions on how to overcome this? I've tried using the Ceiling function to always round up but that produced even more errors than this initial problem, so I don't think that can be my solution.

Jonathan-Sherman

Hi,

This is a little odd, are you sure the numbers are identical? Could you attach your workflow or recreate it with dummy data?

An easy solution if you're looking to round to 3dp is to bring in a select tool and convert to fixed decimal with a size of 19.3 allowing 19 digits before the decimal and 3 after. This should always round to to the relevant value.

If this solves your issue please mark the answer as correct, if not let me know!

Thanks,

J

Round to 3dp.yxmd