Self-Supervised Category-Level 6D Object Pose Estimation with Deep Implicit Shape Representation
Wanli Peng,Jia-Wei Yan,Hongtao Wen,Yi Sun +3 more
TL;DR: A self-supervised framework for category-level 6D pose estimation that leverages DeepSDF as a 3D object representation and design several novel loss functions based onDeepSDF to help the self- supervised model predict unseen object poses without any 6D object pose labels and explicit 3D models in real scenarios.
read more
Abstract: Category-level 6D pose estimation can be better generalized to unseen objects in a category compared with instance-level 6D pose estimation. However, existing category-level 6D pose estimation methods usually require supervised training with a sufficient number of 6D pose annotations of objects which makes them difficult to be applied in real scenarios. To address this problem, we propose a self-supervised framework for category-level 6D pose estimation in this paper. We leverage DeepSDF as a 3D object representation and design several novel loss functions based on DeepSDF to help the self-supervised model predict unseen object poses without any 6D object pose labels and explicit 3D models in real scenarios. Experiments demonstrate that our method achieves comparable performance with the state-of-the-art fully supervised methods on the category-level NOCS benchmark.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wild
Kaifeng Zhang,Yang Fu,Shubhankar Borse,Hong Cai,Fatih Porikli,Xuan Wang +5 more
- 13 Oct 2022
TL;DR: This paper introduces a self-supervised learning approach trained directly on large-scale real-world object videos for category-level 6D pose estimation in the wild, and can achieve on-par or even better performance than previous supervised or semisupervised methods on in thewild images.
14
Self-Supervised Category-Level 6D Object Pose Estimation With Optical Flow Consistency
TL;DR: In this article , the authors propose a self-supervised method that leverages the 2D optical flow as a proxy for supervising the 6D pose estimation by harnessing an off-the-shelf optical flow method.
13
CATRE: Iterative Point Clouds Alignment for Category-Level Object Pose Refinement
TL;DR: CATRE as mentioned in this paper predicts a relative transformation between the initial pose and ground truth by means of aligning the partially observed point cloud and an abstract shape prior, which achieves competitive results on category-level tracking.
Self-Supervised Category-Level 6D Object Pose Estimation With Optical Flow Consistency
01 May 2023
TL;DR: In this article , the authors propose a self-supervised method that leverages the 2D optical flow as a proxy for supervising the 6D pose estimation by harnessing an off-the-shelf optical flow method.
10
TTA-COPE: Test-Time Adaptation for Category-Level Object Pose Estimation
Taeyeop Lee,Jonathan Tremblay,Valts Blukis,Bowen Wen,Byeong-Uk Lee,Inkyu Shin,Stan Birchfield,In So Kweon,Kuk‐Jin Yoon +8 more
- 01 Jun 2023
TL;DR: TTA-COPE is a test-time adaptation method for category-level object pose estimation that improves performance during test time under both semi-supervised and unsupervised settings.
9
References
•Proceedings Article
Adam: A Method for Stochastic Optimization
Diederik P. Kingma,Jimmy Ba +1 more
- 01 Jan 2015
TL;DR: This work introduces Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments, and provides a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework.
138.5K
•Posted Content
Adam: A Method for Stochastic Optimization
Diederik P. Kingma,Jimmy Ba +1 more
TL;DR: In this article, the adaptive estimates of lower-order moments are used for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimate of lowerorder moments.
82.5K
A method for registration of 3-D shapes
Paul J. Besl,H.D. McKay +1 more
TL;DR: In this paper, the authors describe a general-purpose representation-independent method for the accurate and computationally efficient registration of 3D shapes including free-form curves and surfaces, based on the iterative closest point (ICP) algorithm, which requires only a procedure to find the closest point on a geometric entity to a given point.
20.6K
•Proceedings Article
Mask R-CNN
Kaiming He,Georgia Gkioxari,Piotr Dollár,Ross Girshick +3 more
- 20 Mar 2017
TL;DR: This work presents a conceptually simple, flexible, and general framework for object instance segmentation that outperforms all existing, single-model entries on every task, including the COCO 2016 challenge winners.
19.7K
Pyramid Scene Parsing Network
Hengshuang Zhao,Jianping Shi,Xiaojuan Qi,Xiaogang Wang,Jiaya Jia +4 more
- 21 Jul 2017
TL;DR: This paper exploits the capability of global context information by different-region-based context aggregation through the pyramid pooling module together with the proposed pyramid scene parsing network (PSPNet) to produce good quality results on the scene parsing task.
Related Papers (5)
Lei Zhang,Zhiyang Guo,Huilin Chen,Liguo Shuai +3 more
- 01 Aug 2016
Chen Liu,Fengxia Li,Tianyu Huang,Shouyi Zhan +3 more
- 30 Oct 2009