Can anyone explain this?
Hallo,
found something strange in the calculation when i show all decimalpositions
Is there any plausible explanation?
lg
Stefan
Hallo,
found something strange in the calculation when i show all decimalpositions
Is there any plausible explanation?
lg
Stefan
digital math accuracy.
Early on in my class on FORTRAN we covered the fact that each computer math operation introduced the possibility of a small random error, and that these accumulated If you add (or multiply or divide) a sufficiently large quantity of numbers you will get an incorrect answer. This introduced the concept of significant digits; and that's what you're illustrating--the last digit in your response (and based on the two decimal length of your inputs quite a few of the trailing zeros) are not significant.
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.