Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

THIS WEBPAGE IS DEPRECATED - please visit our new website

Dr. Chun-Hao Paul Huang (黃俊豪)



email paulch DOT huang AT tum DOT de
personal webpage
office tel/fax +49 89 289 19441/17059
room 03.13.039
address Institut für Informatik I-16, Technische Universität München, Boltzmannstr. 3, 85748 Garching, Germany
my CV (01.Jun.18)

Textured model of me reconstructed by Kinovis

About Me

I am a fourth-year Ph.D. student in TUM, under the guidance of PD Dr. Slobodan Ilic and Prof. Nassir Navab. Prior to TUM, I spent six wonderful years at NCKU where I had the chance to work with Jar-Ferr Kevin Yang and completed my BSc in Electrical Engineering and MSc in Computer Engineering. In the past few years, I've also had the pleasure to work with: Dr. Yu-Chiang Frank Wang in team MML, Academia Sinica; Dr. Edmond Boyer in team Morpheo, INRIA; Dr. Federico Tombari in CAMP; MIX team in Microsoft Research Redmond; and Capture and Effects team in Disney Research Zürich.

I'll be available in the job market from Spring 2017. If you have questions or anything to discuss with me, please feel free to drop me an email.


  • [15.08.17] Our paper "Tracking-by-Detection of 3D Human Shapes: from Surfaces to Volumes" got accepted for TPAMI. Check out the pre-print version.
  • [10.05.17] Our CVPR`16 results (associations from random forests) can be downloaded here.
  • [19.12.16] Thesis defended!
  • [04.07.16-07.10.16] Research internship at Disney Research Zurich.
  • [02.03.16] Our paper "Volumetric 3D Tracking By Detection" got accepted as a oral spotlight presentation at CVPR 2016.
  • [12.08.15] Our paper "Repeatable Local Coordinate Frames for 3D Human Motion Tracking: from Rigid to Non-Rigid" got accepted as a poster presentation at 3DV 2015.
  • [22.06.15-11.09.15] Research internship at Microsoft Research Redmond.
  • [27.05.15] Our paper "A Bayesian Approach to Multi-view 4D Modeling" got accepted for International Journal of Computer Vision (IJCV).
  • [02.03.15] Our paper "Toward User-specific Tracking by Detection of Human Shapes in Multi-Cameras" got accepted as a poster presentation at CVPR 2015.
  • [01.02.15] I'm visiting Morpheo team in INRIA (Grenoble, France) from 1st of February til 13th of February.
  • [30.06.14] CVPR`14 sequences released! Besides images, silhouettes and reconstructed visual hulls, we also provide reference surfaces, rigged skeletons, and annotated joint locations (in 5 cameras). Check the following links: WalkChair, and HammerTable & SideSit.
  • [01.03.14] Our paper "Human Shape and Pose Tracking Using Keyframes" got accepted as a poster presentation at CVPR 2014
  • [18.02.14] Previous work at Academia Sinica, "Heterogeneous Domain Adaptation and Classification by Exploiting the Correlation Subspace" got accepted for TIP (demo code).
  • [30.06.13] Our 3DV oral paper "Robust Human Body Shape and Pose Tracking" was awarded as best paper runner up ! (link)
  • [16.05.13] Our paper "Robust Human Body Shape and Pose Tracking" got accepted as a oral presentation at 3DV (former 3DimPVT) 2013 .

Research Projects

Spatio Temporal Modeling of Dynamic Scenes

Spatio Temporal Modeling of Dynamic Scenes

A great part of Computer Vision research has been dedicated to shape recovery, tracking and detection of 3D objects in images and videos. While excellent results have been achieved in these areas, the majority of the methods still assume static scenes and rigid objects, and rarely explore temporal information. However, the world surrounding us is highly dynamic, and in many situations objects deform over time. This temporal information provides a richer and denser source of information and have not yet been extensively exploited. Our objective within this project is to explore spatio-temporal information in order to recover 3D shapes and the motion of the deformable objects. Therefore, we refer to this area as spatio-temporal or four dimensional modeling (4D modeling). With the increased popularity of 3D content in film industry, TV, Internet and games, tools and methods that exploit spatio-temporal information and allow fast and automated 3D content production are going to be indispensable.

Student Projects for Hiwi and Dipl./B.Sc./M.Sc. Thesis

Inferring correspondences via regression forest

User-specific Human Shape Detection in Full 3D data (surface-based)

Inspired by the recent work that applies random forests to estimate human poses with depth data (either via body part classification or dense correspondences), in this project we investigate the possibility to infer the dense correspondences between a surface model and a complete 3D visual hull obtained in multiple camera environments. With frame-wise data-model associations, our method is able to detect human shapes in a clutter scene, which we term tracking-by-detection of 3D human shapes.

Markov Random Field for Regularizing Matches between Meshes

The inferred data-model associations from the forests often look noisy because it does not respect the intrinsic structure, i.e. triangles/edge connectivity. In this project, we mitigate this by proposing a new way to aggregate leaf-node predictions from forests. As the correspondences are highly interdependent among the local neighborhood, we apply random fields (MRF/CRF) to regularize them, yield the optimal configuration w.r.t. the whole shape. The aggregation is therefore mesh-based rather than vertex-based.
volumtriccorrespondences via regression forest

Volumetric Tracking by Detection

Following the above tracking-by-detection concept, in this project we investigate different parameterizations of 3D shapes. We choose centroidal Voronoi tessellation (CVT) as the shape representation and realize discriminative correspondences in a volumetric manner. We further propose a unified volumetric tracking-by-detection pipeline, where the shape representation, deformation model, feature description, and primitive association are all built on a single consistent representation, CVT.
tracking without BS

Human Shape and Pose Tracking without Background Subtraction

In this project, we investigate the possibility to recover human motions directly with images, without doing background subtraction. The 3D surfaces are expected to be textured, or at least contain per-vertex color information. Thus, the problem amounts to maximizing the similarity between the projected texture of surfaces and the image observations.

Publications at CAMP

301 Moved Permanently


Publications of early projects

Y.-R. Yeh, C.-H. Huang, Y.-C. F. Wang, Heterogeneous Domain Adaptation and Classification by Exploiting the Correlation Subspace,
IEEE Transactions on Image Processing (TIP), vol. 23, no. 5, pp. 2009-2018, May. 2014 (pdf)

C.-H. Huang, Y.-R. Yeh, Y.-C. F. Wang, Recognizing Unseen Actions across Cameras by Exploring the Correlated Subspace,
European Conference on Computer Vision (ECCV), The 4th International VECTaR? Workshop, Firenze, Italy, October 12, 2012 (pdf, slides)

H.-M. Wang, C.-H. Huang, J.-F. Yang, Block-Based Depth Maps Interpolation for Efficient Multiview Content Generation,
IEEE Transactions On Circuits And Systems for Video Technology (TCSVT), vol. 21, no. 12, pp. 1847-1858, Dec. 2011

H.-M. Wang, C.-H. Huang, J.-F. Yang, Depth Maps Interpolation from Existing Pairs of Keyframes and Depth Maps for 3D Video Generation,
IEEE International Symposium on Circuits and Systems (ISCAS), Paris, France, May 30 - June 2, 2010

Code, dataset and results

  • 3DV`13 results. Contact me for the accessing password.
  • TIP`14 demo code.
  • CVPR`14 sequences: robust tracking in the presence of static outliers/occlusions.

  • CVPR`15 and CVPR`16 results: surface-based and fully volumetric tracking-by-detection of 3D human shapes


Teaching assistance

Title: Dr.
Circumference of your head (in cm):  
Firstname: Chun-Hao
Middlename: Paul
Lastname: Huang
Picture: head.png
Nationality: Blank
Languages: English, German, Chinese
Groups: Computer Vision
Expertise: Computer Vision, 3D Interaction
Position: Scientific Staff
Status: Alumni
Emailbefore: huangc
Room: MI 00.13.042
Telephone: +49 89 289 19441

Edit | Attach | Refresh | Diffs | More | Revision r1.176 - 01 Nov 2018 - 06:25 - ChunHaoHuang

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif