The Conference for Machine Learning Innovation

Unsupervised Category-Specific Mesh Reconstruction: A Future ML Opportunity

Session
Join the ML Revolution!
Register until August 12:
✓ML Intro Day for free
✓Save up to $380
Register Now
Join the ML Revolution!
Register until August 12:
✓ML Intro Day for free
✓Save up to $380
Register Now
Join the ML Revolution!
Register until August 19:
✓ML Intro Day for free
✓Save up to €490
Register Now
Join the ML Revolution!
Register until August 19:
✓ML Intro Day for free
✓Save up to €490
Register Now
Join the ML Revolution!
Register until the conference starts:
✓ 2-in-1 conference special
✓ 10 % Team Discount
Register Now
Join the ML Revolution!
Register until the conference starts:
✓ 2-in-1 conference special
✓ 10 % Team Discount
Register Now
Infos
Tuesday, June 22 2021
17:00 - 17:45

One specific question within machine learning that has recently fascinated many is the prospect of predicting 3D forms of objects in 2D images without any given annotations/labels. An unsupervised method for achieving this was presented by Shubhum Goel, et al., in 2020. It proposes a framework called U-CMR (Unsupervised Category-Specific Mesh Reconstruction) to recover the shape, pose, and texture of an object from a single image, without any ground truths (keypoints). In this case, keypoint supervision refers to annotations that give the models clues as to what general 3D shape the object would conform to. The methodology involves training a shape and texture predictor, optimizing a “camera-multiplex” (a set of camera-position hypotheses for each image), and then rendering that predicted shape and texture in the multiplex and computing a per-camera reconstruction loss. The predictor is then updated against expected loss, and each camera is updated based on loss incurred. Then, a feed-forward model is trained to predict the optimal camera position in the multiplex, recovering the 3D form. Performance metrics approached previous supervised models. Liberation from having to obtain keypoint-labeled data for 3D shape and texture modeling is a key advantage and U-CMR will be used in future unforeseen applications.

This Session belongs to the Diese Session gehört zum Programm vom MunichMunich program. Take me to the program of . Hier geht es zum Programm von Singapore Singapore .

This Session belongs to the Diese Session gehört zum Programm vom MunichMunich program. Take me to the program of . Hier geht es zum Programm von Berlin Berlin .

Take me to the full program of Zum vollständigen Programm von Munich Munich .

This Session Diese Session belongs to the gehört zum Programm von MunichMunich program. Take me to the current program of . Hier geht es zum aktuellen Programm von Singapore Singapore , Berlin Berlin or oder Munich Munich .

Behind the Tracks