Skip to main content
X
xinli13-Aquamarine
13-Aquamarine
November 10, 2022
Question

ER - Is it possible to let Chalk learn the environment from more angles before starting session

  • November 10, 2022
  • 1 reply
  • 2255 views

Is it possible to let Chalk learn the environment from more angles such as front, back, top, bottom sides then start the session?

Currenlty Chalk would initialize the session right after it recognize the front view so that when user walks to the backend of the object or other angles, the Live Annotation could not be used properly and user have to let Chalk re-learn the environment from that angle and continue the session which is not convinient and sometimes due to the limitation of the space from different angle, it is not easy the learn the environment from the angle. 

This idea is reported by Korean Customer: SeAH Besteel Corp

Use Case: User would request assistance around an object, E.g: TV or any other physical object.

Then initially Chalk learns the environment in front of user then the session starts.

learn env.png

When user goes to other side of that TV, E.g: up to down view of the backend of the TV, then the live annotation couldn't be used(Chalk would say "Point camera here to resume") and user needs to let Chalk re-learn the environment from that particular angle if he needs assistance from different angles.

updown-view.png

Is it possible to let chalk learns more about the environment. E.g: From different angles of the target assist required object before starting the session so that user would be able to walk around the object and get assistance?

 

 

    1 reply

    D
    danhitomi13-Aquamarine
    13-Aquamarine
    November 11, 2022

    Thanks for the post. 

     

    At its core - I would say this is a tracking problem due to target not having enough "features" (it's dark / black, which might be challenging for visual-based SLAM to pick-up easily and quickly). It probably would track and have a more accurate map if were a lighter color with distinctive features our engine could pick-up from the camera.

     

    There are items on the horizon that might improve the tracking and experience here - so I'd be interested in doing a quick A|B test to see if you see better results using a feature we have not yet released.

     

    Best,

    Dan

    D
    danhitomi13-Aquamarine
    13-Aquamarine
    November 14, 2022

    Hi - additional clarification upon discussing internally.

     

    We should educate the customer that Chalk continues to learn and map as you move or move around objects. Therefore, the initial guidance (SLAM initialization step) is to help us start, but once we've established an anchor - we continue to map. If you move to new areas of your physical space or object - it could be we are still learning and have not mapped the new target well enough to achieve better precision and accuracy of your annotations.

     

    Best,

    X
    xinli13-AquamarineAuthor
    13-Aquamarine
    November 21, 2022

    Thank you for that info. It is good to know that Chalk continues to learn and map as you move or move around objects. I will see if I can find a  target with more features and see if it tracks better when go to the backside of it and update back

    Terms & ConditionsCookie settingsAccessibility statement