Get Help

Turn on suggestions

Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

- Community
- :
- PTC Mathcad
- :
- PTC Mathcad
- :
- Minerr: Quasi-Newton, Levenberg-Marquardt, Conjuga...

Options

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page

Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Notify Moderator

11-27-2015
08:37 AM

11-27-2015
08:37 AM

Minerr: Quasi-Newton, Levenberg-Marquardt, Conjugate Gradient?

How to choose one of the Minerr Options? How initial values and Objective functions are affected by the selected Method? Are there Mathcad alternative solutions for non-linear regression of parameters?

Labels:

7 REPLIES 7

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Notify Moderator

11-27-2015
01:00 PM

11-27-2015
01:00 PM

Re: Minerr: Quasi-Newton, Levenberg-Marquardt, Conjugate Gradient?

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Notify Moderator

11-27-2015
05:04 PM

11-27-2015
05:04 PM

Re: Minerr: Quasi-Newton, Levenberg-Marquardt, Conjugate Gradient?

For non-linear regression (i.e. fitting a curve to data) you should use the L-M algorithm. The objective function should generate a vector of residuals (do NOT sum and square them!).

Mathcad really offers nothing else for this. The genfit function also uses the L-M algorithm, and is not as flexible as minerr. Simulated annealing was available at one point, with an extension pack, but that's unfortunately long gone. Is there a reason you want something other than the L-M algorithm? It's old, but it's very good.

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Notify Moderator

11-30-2015
04:59 AM

11-30-2015
04:59 AM

Re: Minerr: Quasi-Newton, Levenberg-Marquardt, Conjugate Gradient?

I am using Minerr for the non-linear regression of the parameters of a Volumetric Equation of State. I read that Quasi-Newton could be a good option for time consuming solution.

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Notify Moderator

11-30-2015
08:23 AM

11-30-2015
08:23 AM

Re: Minerr: Quasi-Newton, Levenberg-Marquardt, Conjugate Gradient?

I have a paper (although a very old one) that shows that the LM algorithm significantly out performs other downhill algorithms for fitting of data. The algorithm doesn't know what it's minimizing though, so the only difference between fitting data and any other minimization problem would be the number of residuals (when fitting data there are many: one for each data point). One reason LM is fast is that it adapts the step size as it iterates to the solution. It takes big steps to begin, and avoids overshoot by reducing them as it approaches the minimum.

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Notify Moderator

11-30-2015
08:27 AM

11-30-2015
08:27 AM

Re: Minerr: Quasi-Newton, Levenberg-Marquardt, Conjugate Gradient?

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Notify Moderator

11-30-2015
09:42 AM

11-30-2015
09:42 AM

Re: Minerr: Quasi-Newton, Levenberg-Marquardt, Conjugate Gradient?

Yes, that's another desirable property of the LM algorithm. It inherently re-scales the parameter space to avoid the numerical problems Brent mentions. It seems the Knitro solvers probably don't, and that's why minerr works when minimize doesn't. I added a comment to that effect in the thread.

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Notify Moderator

11-30-2015
09:48 AM

11-30-2015
09:48 AM

Re: Minerr: Quasi-Newton, Levenberg-Marquardt, Conjugate Gradient?

Thank you Richard,

In case of multiple object functions in a solve block, how the Minerr convergence tolerances work ( TOLL and CTOL )? Are the same criteria applied with LM or Quasi-Newton?