Floating point error problem in programming

[vvenkatesan]

I have done pressure calculations in normal worksheet format and i got results without any error. but it needs to change a value once for every iterations. So i moved on to programming. I compiled the program using while loop and break conditions. After completing and running the program i got error message showing "encountered a floating point error".Dont know how to fix the bug.. Can anyone help me pls?????????

[StuartBruff · Accepted solution]

Vigneshwar Venkatesan wrote:

I have done pressure calculations in normal worksheet format and i got results without any error. but it needs to change a value once for every iterations. So i moved on to programming. I compiled the program using while loop and break conditions. After completing and running the program i got error message showing "encountered a floating point error".Dont know how to fix the bug.. Can anyone help me pls?????????

Somewhere within your loop the deltaP .dc and .r variables are blowing up to the limits of numeric handling (ie, they're in the order of 10^{307 )}

Stuart