cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 

Getting different results for the same argument? Why

Highlighted
Participant

Getting different results for the same argument? Why

Hi All,

Could you please have a look at the attached file and let me know why I am getting different answers?

if the number in question is an input you I get the answer I am looking for, if the output is a result form say interpolation I will get wrong answer!!!

Why, this is happening, and how to overcome it?

Regards,

H

4 REPLIES 4

Re: Getting different results for the same argument? Why

This is an effect which you have to take in account when you are working with float numbers. Never compare float numbers for equality.

Its a roundoff effect. While the interpolated value R should be exactly 17.85 its actually slightly smaller - approx. -3.5*10^(-15). Evaluate R-Rd to see it yourself.

WE

Re: Getting different results for the same argument? Why

Hellow,

How can I overcome this issue then? Any advise

Re: Getting different results for the same argument? Why

On the "Calculation" tab, select "Calculation Options" and "Approximate Equality".

Re: Getting different results for the same argument? Why

Thank you