Skip to main content
S
Sandy_Gunner14-Alexandrite
14-Alexandrite
June 19, 2024
Question

"ER" sheet metal part inspection by comparing the CAD edges and real object edges

  • June 19, 2024
  • 1 reply
  • 1044 views

Dear community members,
As we all know, Vuforia currently does not have the capability to display edges within the experience. We are using Vuforia View model tracking experiences, created from Vuforia Studio, for visual inspection purposes.
Most of the time the parts to be inspect differ little bit in shape, and have some specific features such as hole, rib etc. for the sheet metal panel. If Vuforia provide us the functionality to display the real object edges in real-time and compare with the CAD edges and display the difference between aforementioned edges in view, we could inspect the parts easily. I think the ER related to display the edges within the experience is already exist in the community. what about the progress of this enhancement request? Other AR software show the real object edges within the app which make the visual inspection of the parts easier by switching the display of the edges ON/OFF. If Vuforia provides the functionality to show the edges, it will help us greatly in the visual inspection of the parts as well as for the other manufacturer too. Please see the attachment for your reference.

Best regards,
Sandy

1 reply

R
RolandRaytchev21-Topaz I
21-Topaz I
June 24, 2024

Hi @Sandy_Gunner ,

I remember that we discuss in other post in the past that or similar issues. This is related to edge /wireframe display filter what is not possible currently.

There are reported the following issues:

  1. Vuforia Studio/View support the display of curves and points. Ticket reported as VTS-1902 to PTC R&D team
  2. Visible edges of 3D model in view app  ticket reported as VTS-1186 to PTC R&D team
  3. Wireframe shader for the HoloLens 2 device   -> Ticket STUD-3480
  4. points 1-3 are reported as enhancement  VPM-60

Now I added the the informaiton from your post to the Product Managment ticket VPM-60 - so helpfullty the PM team will understand better your applicaiton case

 

So regarding possible workaround - we can take a picture (or possibly 2 pictures - one time without augmentation and one time without augmentation) and sent to server - where we have a picture analyzing system where you check that.

For example you can use some kind of soebel filter 

2024-06-24_13-50-42.jpg

to have only edge display  (grdient x,y) to get something like this:

2024-06-24_13-52-46.jpg

and then you can use some image recognition network which is trained to recongize the hole geometry . Possibly you can compare the 2 pictures (with/wuthout agumentation) both as edge geometry) to find where is a difference.

S
Sandy_Gunner14-AlexandriteAuthor
14-Alexandrite
June 27, 2024

Hi @RolandRaytchev 

Thank you for including the information in the PM ticket and providing the possible workaround.

As per the provided workaround, the two images to be compared should be captured from the same location, which may not always be possible due to minor hand movements.

Additionally, performing image processing on the server to detect edges is time-consuming, as we want to identify faults within the experience promptly.

If the model edges and CAD edges become visible in Vuforia Studio, we can identify defects simply by turning the respective edges on and off simultaneously. We kindly request that you keep us informed about the status of this enhancement request in the future.

Thank you.

Terms & ConditionsCookie settingsAccessibility statement