The Conference for Machine Learning Innovation

Unsupervised Category-Specific Mesh Reconstruction: A Future ML Opportunity

Session
Join the ML Revolution!
Until June 2
✓ Save up to 226€
✓ Group discount
✓ Special discount for freelancers
Register Now
Join the ML Revolution!
Until June 2
✓ Save up to 226€
✓ Group discount
✓ Special discount for freelancers
Register Now
Thank you for attending!
Register Now
Thank you for attending!
Register Now
Join the ML Revolution!
Register until conference starts:
✓ 2 in 1 conference special
✓ 10 % Team Discount
Register Now
Join the ML Revolution!
Register until conference starts:
✓ 2 in 1 conference special
✓ 10 % Team Discount
Register Now
Infos

One specific question within machine learning that has recently fascinated many is the prospect of predicting 3D forms of objects in 2D images without any given annotations/labels. An unsupervised method for achieving this was presented by Shubhum Goel, et al., in 2020. It proposes a framework called U-CMR (Unsupervised Category-Specific Mesh Reconstruction) to recover the shape, pose, and texture of an object from a single image, without any ground truths (keypoints). In this case, keypoint supervision refers to annotations that give the models clues as to what general 3D shape the object would conform to. The methodology involves training a shape and texture predictor, optimizing a “camera-multiplex” (a set of camera-position hypotheses for each image), and then rendering that predicted shape and texture in the multiplex and computing a per-camera reconstruction loss. The predictor is then updated against expected loss, and each camera is updated based on loss incurred. Then, a feed-forward model is trained to predict the optimal camera position in the multiplex, recovering the 3D form. Performance metrics approached previous supervised models. Liberation from having to obtain keypoint-labeled data for 3D shape and texture modeling is a key advantage and U-CMR will be used in future unforeseen applications.

This Session originates from the archive of Diese Session stammt aus dem Archiv von MunichMunich . Take me to the program of . Hier geht es zum aktuellen Programm von Munich Munich .

This Session originates from the archive of Diese Session stammt aus dem Archiv von MunichMunich . Take me to the program of . Hier geht es zum aktuellen Programm von Singapore Singapore .

This Session originates from the archive of Diese Session stammt aus dem Archiv von MunichMunich . Take me to the program of . Hier geht es zum aktuellen Programm von Berlin Berlin .

This Session Diese Session originates from the archive of stammt aus dem Archiv von MunichMunich . Take me to the current program of . Hier geht es zum aktuellen Programm von Munich Munich , Singapore Singapore or oder Berlin Berlin .

Behind the Tracks