Skip to main content
22-Sapphire I
March 25, 2016
Question

modelcheck metrics

  • March 25, 2016
  • 20 replies
  • 10830 views

I've been at Edwards a little over 3 months now. Lots going on - major initiatives to "raise the bar" in many areas, including CAD quality and becoming more model-based.

We're actively establishing / updating standards in various areas, and attempting to automate checking and reporting against those as much as possible. For this reason, I've been immersed in ModelCheck recently and have things configured pretty well.  Over the years there have been many PTC/User presentations / discussions about ModelCheck and I've gone thru them all.  I created some additional "cheat sheets" and a diagram - happy to provide to anyone interested.

This week, I took a close look at the ModelCheck Metrics tool and just had an extensive session w/tech support on it.  Very disappointed that the metrics tool has not been kept up to date and essentially can no longer be used. It has to run using very old Java, Apache and Tomcat versions.  Sad to see that it lagged so far behind.  Whoever is not the PTC product manager for ModelCheck, I'd love to have a discussion w/you.

In any case, we have the metrics files being output by users to a common location.  These can be "mined" fairly easily for some info by just opening in Excel and doing some manipulation using pivot tables.  note: We also have the four MC parameters mapped to Windchill attributes and intend to use these in workflows to prevent release for production if any errors exist. Just takes a little code on a workflow conditional robot to accomplish.

Sorry for all the before the question...

Question: Does anyone have anything in use that they are willing to share for monitoring use of / summarizing results of ModelCheck other that the (essentially obsolete) PTC metrics tool?

thanks in advance

///

Starting next week - I need to get to a similar point using SolidWorks Design Check.

20 replies

1-Visitor
March 29, 2016

Hi Mike,

I would be interested in the cheat sheets and diagram you put together.  I am trying to get back up to speed with MC.

Thanks

Joe

23-Emerald III
March 30, 2016

Mike,

I have a lot of tutorials from Pro/E 2001 timeframe on ModelCheck. We have it implemented here, but the users don't get too concerened with the resukts, from what I have seen. We do have an established limit on errors that will prevent check-in, but I haven't heard of any complaints on those.

I would like to get a copy of your cheat sheets, too.

Thanks,

Ben

1-Visitor
March 30, 2016

Ben,

I take it you are using the "gate keeper" to limit the number of errors allowed to be checked in.  My question can you prioritize what errors can go thru and what errors  will be stopped.

For instance I have in my model check to make sure if there are no suppressed objects.  Can you set up gate keeper to not allow any models/assemblies with suppressed items from getting checked in?

Joe

23-Emerald III
March 30, 2016

I did not setup ModelCheck here, but I did in another company. From what I can remember and tell, the only 'block' is if the number if errors/warnings exceeds the threshold in the gatekeeper. There is no way to have it prevent a check-in of 1 suppressed item, that being the only failure, if your limit is set to 2 failures.

The key is setting the items to error/warn and then setting your gate keeper to an acceptable level.

I do agree that there should almost be a third code for those items that you absolutely do not want in a released model. Lacking more granularity to the failure levels, maybe a defined set of conditions that Windchill can read that must return a 'pass' before check-in will proceed.

1-Visitor
June 10, 2016

Hi Mike Lockwood,

I'm at a meeting with a bunch of like-minded individuals at the moment discussing ModelCheck stuff.

Have you gotten anywhere with your reports? 

1-Visitor
July 1, 2016

Hi Mike,

Metrics Tool has been re-built on ThinkWorx. A prototype is available currently. If you are interested in this new app, I can provide you a trial build.

Any feedback is appreciated.

Thanks,

Russell

23-Emerald IV
July 1, 2016

Russell Hsu‌, you might want to repost this over in ModelCHECK Administration

1-Visitor
August 31, 2016

All folks on this thread -

I have setup a fairly extensive MC configuration for my company, and went through the PAIN of poor documentation, poor PTC support, lots of trial and error, to get it working.

The MC Metrics is really a POS, but it does offer a few useful items. The AccessDB it uses/creates is actually pretty useful. What I do is export the data out to Excel and work with it there to create pivot tables, etc.

NOTE: Keep in mind that the AccessDB is a compilation of all MC runs by engineers. For instance, it a user has a model that has 1 error, and he runs MC 50 times, the AccessDB will count all 50 errors. The reverse is true if you have a clean model (lots of OK's in the AccessDB) What this means to me is that the data gathered needs to be filtered down to individual runs (by last date) to get data that means more than a trend. Something else to keep in mind is that there isn't a good way to tell which models actually got checked in, and if the errors/warning were fixed before check-in.

This is where Creo Distributed Batch comes into play - I have been playing with the tool for about a week now, and the best caveat of the tool is the ability to run MC on "checked-in" models! You can batch check against a workspace, or a context (could be brutal if many objects exist).

BTW - I COMPLETELY agree with Mike Lockwood that ALL data should be allowed to check-in, to keep the data secure. However, if using Gatekeeper, much easier said than done. Mike's way of controlling the quality through the Change process is an interesting one.

If anyone on this thread would like to have an open teleconference to discuss MC more, I'd love to see that.

Perhaps we can even get Rosemary on the call

1-Visitor
July 13, 2017

Hello all,

I'm a little late to the party but, I too am trying to set up ModelCheck at my company. (I've used MC for years OOTB but not configured.) Any help is/will be greatly appreciated. My first task for MC is to clean up 20+ years of legacy garbage. Has anyone attempted a nightmare such as this? (parameters, layers, drawing format/config......) I would also like to add check parameters to the ".dsumm" reports for metrics etc. Has anyone had any luck in this area??

1-Visitor
August 31, 2016

Hi Mike,

Can I get those cheat sheets from you that you mentioned?

Also, at some point, would you be willing to share a bit about how you've incorporated MC quality checks into the EC process?

Thanks,

Gary Spencer