Orientation Keypoints for 6D Human Pose Estimation
source link: https://r0nn13.github.io/okps-project/
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Orientation Keypoints for 6D Human Pose Estimation
Marker-Free Motion Capture
Abstract
Most realtime human pose estimation approaches are based on detecting joint positions. Using the detected joint positions, the yaw and pitch of the limbs can be computed. However, the roll along the limb, which is critical for application such as sports analysis and computer animation, cannot be computed as this axis of rotation remains unobserved. In this paper we therefore introduce orientation keypoints, a novel approach for estimating the full position and rotation of skeletal joints, using only single-frame RGB images. Inspired by how motion-capture systems use a set of point markers to estimate full bone rotations, our method uses virtual markers to generate sufficient information to accurately infer rotations with simple post processing. The rotation predictions improve upon the best reported mean error for joint angles by 48% and achieves 93% accuracy across 15 bone rotations. The method also improves the current state-of-the-art results for joint positions by 14% as measured by MPJPE on the principle dataset, and generalizes well to in-the-wild datasets.
TL;DR: We use virtual keypoints to estimate bone position and orientation.
Video
Citation
If you would like to cite our work:
@article{Fisch2021OKPS,
author = {Martin Fisch and Ronald Clark},
journal = {IEEE Transactions on Pattern Analysis & Machine Intelligence},
title = {Orientation Keypoints for 6D Human Pose Estimation},
year = {2021},
month = {dec}
}
Recommend
-
40
In this article, I will show you step by step, how to build your own real time hand keypoints detector with OpenCV, Tensorflow and Fastai (Python 3.7). I will be focusing on the challenges I faced when...
-
55
One of the Machine Learning challenges I’m facing at my new company.
-
16
Human Pose Detection using PyTorch Keypoint RCNN
-
9
Pose estimation and classification on edge devices with MoveNet and TensorFlow Lite — The TensorFlow Blog Pose estimation and classification on edge devices with MoveNet and TensorFlow Lite August 16, 2021 ...
-
6
KAPAO (Keypoints and Poses as Objects) KAPAO is an efficient single-stage multi-person human pose estimation model that models keypoints and poses as o
-
8
February 22, 2022 Utilizing key point and pose estimation for the task of autonomous driving The Waymo Team Imagine: you’re driving a car and you see...
-
6
Distribution-Aware Coordinate Representation for Human Pose Estimation posted on...
-
7
G-RMI-> PersonLab -> PifPaf -- Human Pose Estimation posted on...
-
13
Pose machine：Articulated Pose Estimation via Inference Machines posted on...
-
10
Introduction Finding and tracking the positions of important body joints or keypoints in an image or video sequence is the task of posture detection, commonly referred to as
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK