cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 

Community Tip - Did you know you can set a signature that will be added to all your posts? Set it here! X

Problem with display precision

ptc-4809755
1-Visitor

Problem with display precision

Display precision don't work for "explicit" function? It's shown me to many digits at the right of decimal point.

I have MathCAD Prime 2.0.

Imathcad probl.jpg

4 REPLIES 4

You are accessing the symbolic processor; display precision setting applies to the numeric processor only.

The symbolic processor will shorten the answers for you; the symbolic command is "float, n" where n is the number of displayed digits.

can you give me an example how should be that expresion to show me less digits?

Built in mathcad 14. Should convert.

I keep saying this, but I'll say it again anyway. The float keyword does not just affect the displayed precision, it affects the precision used in the calculations. It should only be used with great care.

In Mathcad 15 you can set the display precision for symbolic results. For some reason that was not implemented in Prime.

Announcements

Top Tags