The Conference for Machine Learning Innovation

Unsupervised Category-Specific Mesh Reconstruction: A Future ML Opportunity

Session
Join the ML Revolution!
Register until April15:
✓Save up to 310 €
✓ 2-in-1 conference special
✓10 % Team Discount
Register Now
Join the ML Revolution!
Register until April15:
✓Save up to 310 €
✓ 2-in-1 conference special
✓10 % Team Discount
Register Now
Join the ML Revolution!
Register until December 12:
✓ML Intro Day for free
✓Raspberry Pi or C64 Mini for free
✓Save up to $580
Register Now
Join the ML Revolution!
Register until December 12:
✓ML Intro Day for free
✓Raspberry Pi or C64 Mini for free
✓Save up to $580
Register Now
Join the ML Revolution!
Register until November 7th:
✓Save up to € 210
✓10% Team Discount
Register Now
Join the ML Revolution!
Register until November 7th:
✓Save up to € 210
✓10% Team Discount
Register Now

One specific question within machine learning that has recently fascinated many is the prospect of predicting 3D forms of objects in 2D images without any given annotations/labels. An unsupervised method for achieving this was presented by Shubhum Goel, et al., in 2020. It proposes a framework called U-CMR (Unsupervised Category-Specific Mesh Reconstruction) to recover the shape, pose, and texture of an object from a single image, without any ground truths (keypoints). In this case, keypoint supervision refers to annotations that give the models clues as to what general 3D shape the object would conform to. The methodology involves training a shape and texture predictor, optimizing a “camera-multiplex” (a set of camera-position hypotheses for each image), and then rendering that predicted shape and texture in the multiplex and computing a per-camera reconstruction loss. The predictor is then updated against expected loss, and each camera is updated based on loss incurred. Then, a feed-forward model is trained to predict the optimal camera position in the multiplex, recovering the 3D form. Performance metrics approached previous supervised models. Liberation from having to obtain keypoint-labeled data for 3D shape and texture modeling is a key advantage and U-CMR will be used in future unforeseen applications.

Take me to the full program of Zum vollständigen Programm von Munich Munich .

This Session belongs to the Diese Session gehört zum Programm vom MunichMunich program. Take me to the program of . Hier geht es zum Programm von Singapore Singapore .

This Session belongs to the Diese Session gehört zum Programm vom MunichMunich program. Take me to the program of . Hier geht es zum Programm von Berlin Berlin .

This Session Diese Session belongs to the gehört zum Programm von MunichMunich program. Take me to the current program of . Hier geht es zum aktuellen Programm von Munich Munich , Singapore Singapore or oder Berlin Berlin .

Behind the Tracks