Van Nguyen Nguyen

I am a Research Scientist at United Imaging Intelligence (UII America) working on 3D Computer Vision and Robotics for clinical AI products. Before joining UII America, I received my PhD at IMAGINE team, École des Ponts ParisTech, under the supervision of Prof. Vincent Lepetit.

During my PhD, I interned twice at Meta Reality Lab, worked with Tomas Hodan in 2024, and Pierre Moulon in 2022. Prior to that, I graduated from the Master Mathématiques, Vision and Apprentissage (MVA) from École Normale Supérieure Paris-Saclay and Engineering Program in Applied Mathematics at INSA Toulouse. I also had chance to spend time at EPFL, SIEMENS.

Email CV Scholar Linkedin Twitter Github


[PhD thesis] Pose Estimation of Novel Rigid Objects

Supervisor: Prof. Vincent Lepetit
Reviewers: Prof. Markus Vincze, Dr. Benjamin Busam
Examiners: Prof. Josef Sivic, Prof. Dima Damen, Dr. Slobodan Ilic

2025-06-11 BOP Challenge 2024 on Model-free, Model-based Detection, and Pose Estimation of Unseen Rigid Objects

Van Nguyen Nguyen, Stephen Tyree, Andrew Guo, Médéric Fourmy, Anas Gouda, Taeyeop Lee, Sungphill Moon, Hyeontae Son, Lukas Ranftl, Jonathan Tremblay, Eric Brachmann, Bertram Drost, Vincent Lepetit, Carsten Rother, Stan Birchfield, Jiri Matas, Yann Labbé, Martin Sundermeyer, Tomáš Hodaň

CVPRW 2025

We introduce a new model-free variant of all tasks, define a new 6D object detection task, and introduce three new publicly available datasets.

[project page] [arXiv]

2025-06-11 GoTrack: Generic 6DoF Object Pose Refinement and Tracking

Van Nguyen Nguyen, Christian Forster, Sindi Shkodrani, Bugra Tekin, Vincent Lepetit, Cem Keskin, Vincent Lepetit, Tomáš Hodaň

CVPRW 2025

We introduce GoTrack, an efficient and accurate CAD-based method for 6DoF pose refinement and tracking of unseen objects. Given a CAD model of an object, an RGB image with known intrinsics that shows the object in an unknown pose, and an initial object pose, Gotrack refines the object pose such as the 2D projection of the model aligns closely with the object’s appearance in the image.

[arXiv] [code]

2024-06-17 BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objects

Tomas Hodan, Martin Sundermeyer, Yann Labbé, Van Nguyen Nguyen, Gu Wang, Eric Brachmann, Bertram Drost, Vincent Lepetit, Carsten Rother, Jiri Matas

CVPRW 2024

The report of BOP challenge 2023 on state-of-the-art methods for seen and unseen object pose estimation.

[project page] [arXiv]

2024-06-17 GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence

Van Nguyen Nguyen, Thibault Groueix, Mathieu Salzmann, Vincent Lepetit

CVPR 2024

A “hybrid” template-patch correspondence approach that is fast, robust, and more accurate to estimate 6D pose of novel objects in RGB images. GigaPose predicts 6D object pose from a single 2D-to-2D correspondence.

[project page] [arXiv] [code]

2024-06-17 NOPE: Novel Object Pose Estimation from a Single Image

Van Nguyen Nguyen, Thibault Groueix, Georgy Ponimatkin, Yinlin Hu, Renaud Marlet, Mathieu Salzmann, Vincent Lepetit

CVPR 2024

A method that can estimate relative pose of unseen objects given only a single reference image. It also predicts 3D pose distribution which can be used to address pose ambiguities due to symmetries.

[project page] [arXiv] [code]

2024-06-17 OpenStreetView-5M: The Many Roads to Global Visual Geolocation

Guillaume Astruc, Nicolas Dufour, Ioannis Siglidis, Constantin Aronssohn, Nacim Bouia, Stephanie Fu, Romain Loiseau, Van Nguyen Nguyen, Charles Raude, Elliot Vincent, Lintao Xu, Hongyu Zhou, Loic Landrieu

CVPR 2024

A new benchmark for visual geolocation (~Geoguessr).

[project page] [arXiv] [code]

2023-10-01 CNOS: A Strong Baseline for CAD-based Novel Object Segmentation

Van Nguyen Nguyen, Thibault Groueix, Georgy Ponimatkin, Vincent Lepetit, Tomáš Hodaň

ICCVW 2023

A method that can segment novel objects for a given RGB image from only their CAD models. Based on Segmenting Anything, DINOv2, CNOS is a strong baseline for Task 5 and 6 in the BOP challenge 2023.

[project page] [arXiv] [code]

2022-12-01 PIZZA: A Powerful Image-only Zero-Shot Zero-CAD Approach to 6DoF Tracking

Van Nguyen Nguyen+, Yuming Du+, Yang Xiao, Michaël Ramamonjisoa, Vincent Lepetit

3DV Oral

A method for tracking the 6D motion of objects in RGB video sequences when neither training images nor even the 3D geometry of the objects is available.

[arXiv] [code]

2022-06-01 Templates for 3D Object Pose Estimation Revisited: Generalization to New Objects and Robustness to Occlusions

Van Nguyen Nguyen, Yinlin Hu, Yang Xiao, Mathieu Salzmann, Vincent Lepetit

CVPR 2022

A method that can recognize objects and estimate their 3D pose in color images even under partial occlusions. Our method requires neither a training phase on these objects nor real images depicting them, only their CAD models.

[project page] [arXiv] [code]

Service

Reviewing:

Workshop: