Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Unsupervised 3D Keypoint Discovery with Multi-View Geometry
 
conference paper

Unsupervised 3D Keypoint Discovery with Multi-View Geometry

Honari, Sina
•
Zhao, Chen  
•
Salzmann, Mathieu  
Show more
2024
Proceedings - 2024 International Conference on 3D Vision, 3DV 2024
11th International Conference on 3D Vision

Analyzing and training 3D body posture models depend heavily on the availability of joint labels that are commonly acquired through laborious manual annotation of body joints or via marker-based joint localization using carefully curated markers and capturing systems. However, such annotations are not always available, especially for people performing unusual activities. In this paper, we propose an algorithm that learns to discover 3D keypoints on human bodies from multiple-view images without any supervision or labels other than the constraints multiple-view geometry provides. To ensure that the discovered 3D keypoints are meaningful, they are re-projected to each view to estimate the person's mask that the model itself has initially estimated without supervision. Our approach discovers more interpretable and accurate 3D keypoints compared to other state-of-the-art unsupervised approaches on Human3.6M and MPI-INF-3DHP benchmark datasets.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/3DV62453.2024.00157
Scopus ID

2-s2.0-85196763561

Author(s)
Honari, Sina

Samsung AI Center Toronto

Zhao, Chen  

EPFL

Salzmann, Mathieu  

EPFL

Fua, Pascal  

EPFL

Date Issued

2024

Publisher

Institute of Electrical and Electronics Engineers

Published in
Proceedings - 2024 International Conference on 3D Vision, 3DV 2024
DOI of the book
10.1109/3DV62453.2024
ISBN of the book

9798350362459

Start page

1584

End page

1593

Subjects

3D keypoints

•

keypoint

•

multi-view geometry

•

unsupervised

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
CVLAB  
Event nameEvent acronymEvent placeEvent date
11th International Conference on 3D Vision

Davos, Switzerland

2024-03-18 - 2024-03-21

Available on Infoscience
February 25, 2026
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/260853
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés