Skip to main content
10-Marble
June 27, 2024
Solved

how to calculate more accurately with 10 significant figures??

  • June 27, 2024
  • 3 replies
  • 1797 views

I'm a mathcad prime 10 user.

 

I'm writing a worksheet for a study material and design check.

 

In manual, its calculated value is a little bit different from the equation above.

 

I wonder how accurate with what significant figures the mathCAD prime 10 does calculation even in every single term in the equation.

 

Plus, how can I get the more accurate result with very accurate single term in the equation?

Best answer by Werner_E

Numerical calculations in Prime use the usual IEEE format and its accuracy of about 14 to 16 decimals.

Higher precision can be achieved by using the symbolic engine, but whenever you assign a value to a variable you are limited to the IEEE data format and its limitations.

 

But the difference between 0,74 and 0,78 seems not to be an inaccuracy - you should rather check all input values and compare them with the values in your source. Chances are that you may have made a typo when trying to duplicate what you see in your source.

 

3 replies

ttokoro
21-Topaz I
21-Topaz I
June 27, 2024

We need youe Prime 10 worksheet.

Just attach it Drag and drop file area bellow..

t.t.
Werner_E25-Diamond IAnswer
25-Diamond I
June 27, 2024

Numerical calculations in Prime use the usual IEEE format and its accuracy of about 14 to 16 decimals.

Higher precision can be achieved by using the symbolic engine, but whenever you assign a value to a variable you are limited to the IEEE data format and its limitations.

 

But the difference between 0,74 and 0,78 seems not to be an inaccuracy - you should rather check all input values and compare them with the values in your source. Chances are that you may have made a typo when trying to duplicate what you see in your source.

 

10-Marble
June 29, 2024

You're so right. There's a typo!

 

Thanks!

 

 

Y.J. Kim

21-Topaz II
June 27, 2024

Hi,

Try minus B_L on the very bottom line.

Cheers

Terry