International Team Wins HANDS Challenge Championship at ECCV 2022
03 Nov 2022
Congratulations to the international team for winning the championship of HANDS Challenge at European Conference on Computer Vision (ECCV) 2022 at “Task 2: Semi/Self-supervised Two-hands 3D Pose Estimation during Hand-object and Hand-hand interactions”.
The task aims to address two-hands 3D pose estimation problems with multi-view captured videos of human-object interaction, which is critical for building AR/VR system.
The absence of 3D pose annotation is the main difficult part for training
as 3D results can only be reconstructed from the multi-view 2D counterparts with a semi/self-supervised learning strategy. To address this, the team proposed a closed-form solution from 2D to 3D, without requiring any training procedure. It has achieved
the leading performance with high running efficiency and would not suffer from any result jittering due to training’s randomness. The team believes the method could essentially facilitate the applications towards metaverse to advance Web 3.0.