cancel
Showing results for
Did you mean:
cancel
Showing results for
Did you mean:

Community Tip - Did you get an answer that solved your problem? Please mark it as an Accepted Solution so others with the same problem can find the answer easily. X

5-Regular Member

## how to calculate more accurately with 10 significant figures??

I'm a mathcad prime 10 user.

I'm writing a worksheet for a study material and design check.

In manual, its calculated value is a little bit different from the equation above.

I wonder how accurate with what significant figures the mathCAD prime 10 does calculation even in every single term in the equation.

Plus, how can I get the more accurate result with very accurate single term in the equation?

1 ACCEPTED SOLUTION

Accepted Solutions

Numerical calculations in Prime use the usual IEEE format and its accuracy of about 14 to 16 decimals.

Higher precision can be achieved by using the symbolic engine, but whenever you assign a value to a variable you are limited to the IEEE data format and its limitations.

But the difference between 0,74 and 0,78 seems not to be an inaccuracy - you should rather check all input values and compare them with the values in your source. Chances are that you may have made a typo when trying to duplicate what you see in your source.

4 REPLIES 4
20-Turquoise
(To:YJ_south_korea)

We need youe Prime 10 worksheet.

Just attach it Drag and drop file area bellow..

Numerical calculations in Prime use the usual IEEE format and its accuracy of about 14 to 16 decimals.

Higher precision can be achieved by using the symbolic engine, but whenever you assign a value to a variable you are limited to the IEEE data format and its limitations.

But the difference between 0,74 and 0,78 seems not to be an inaccuracy - you should rather check all input values and compare them with the values in your source. Chances are that you may have made a typo when trying to duplicate what you see in your source.

5-Regular Member
(To:Werner_E)

You're so right. There's a typo!

Thanks!

Y.J. Kim

21-Topaz I
(To:YJ_south_korea)

Hi,

Try minus B_L on the very bottom line.

Cheers

Terry

Announcements
Top Tags