HUMAN POSE RECOGNITION USING GEODESIC DISTANCE AND COLOR FEATURES WITH DEPTH CAMERA

Đinh Đồng Lưỡng

Abstract


The paper presents an approach to recover a full-body 3D human pose using geodesic and color features captured by a depth camera. The 3D information obtained from the depth images is employed to represent the points belonging to a human body in the form of a graph. The interest points or landmark locations with definite geodesic distances from the human body centroid are extracted to locate areas of the hand, foot, and face based on color images using a skin detection algorithm. Utilizing the anatomical landmark locations, joint angles of the body parts are computed. The estimated joint angles are then mapped to the body parts of a 3D human body model, which consists of a set of connected parts. Finally, the 3D human model reflects the human pose estimate. In our experiments, we assessed the detection of anatomical landmarks by our algorithm and then the 3D pose recovery for simple hand gestures, complex hand gestures, simple full body movements and complex body movements. The qualitative results of pose approximations depict the fact that the presented methodology is efficient enough to get good estimates of various full body movements.

Keywords


3D human body model; 3D human pose recovery; Depth image; Geodesic distance.

References


Chen, L., Wei, H., & Ferryman, J. (2013). A survey of human motion analysis using depth imagery. Pattern Recognition Letters, 34(15), 1995-2006.

Dinh, D. L., Han, H. S., Jeon, H. J., Lee, S., & Kim, T. S. (2013). Principal direction analysis-based real-time 3D human pose reconstruction from a single depth image. Paper presented at The Fourth Symposium on Information and Communication Technology, Vietnam.

Ganapathi, V., Plagemann, C., Koller, D., & Thrun, S. (2010). Real time motion capture using a single time-of-flight camera. Paper presented at The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), USA.

Kim, D., & Kim, D. (2008). A novel fitting algorithm using the ICP and the particle filters for robust 3D human body motion tracking. Paper presented at The ACM Workshop on Vision Networks for Behavior Analysis, Canada.

Moeslund, T.B., Hilton, A., & Kruger, V. (2006). A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding, 104(2), 90-126.

Mundermann, L., Corazza, S., & Andriacchi, T. P. (2007). Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models. Paper presented at the 2007 IEEE Conference on Computer Vision and Pattern Recognition, USA.

Schwarz, L. A., Mkhitaryan, A., Mateus, D., & Navab, N. (2012). Human skeleton tracking from depth data using geodesic distance and optical flow.Image and Vision Computering, 30(3), 217-226.

Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2013). Real-time human pose recognition in parts from single depth images. Communications of the ACM, 56(1), 116-124.

Tam, G. K. L., Cheng, Z. Q., Lai, Y. K., Langbein, F. C., Liu, Y. H., Marshall, D., Martin, R. R., Sun, X. F., & Rosin, P. L. (2013). Registration of 3D point clouds and meshes: A survey from rigid to nonrigid. IEEE Transactions on Visualization and Computer Graphics, 19(7), 1199-1217.

Thang, N. D., Kim, T. S., Lee, Y. K., & Lee, S. (2011). Estimation of 3-D human body posture via co-registration of 3-D human model and sequential stereo information. Applied Intelligence, 35(2), 163-177.




DOI: http://dx.doi.org/10.37569/DalatUniversity.7.2.238(2017)

Refbacks

  • There are currently no refbacks.


Copyright (c) 2017 Đinh Đồng Lưỡng

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Editorial Office of DLU Journal of Science
Room.15, A25 Building, 01 Phu Dong Thien Vuong Street, Dalat, Lamdong
Email: tapchikhoahoc@dlu.edu.vn - Phone: (+84) 263 3 555 131

Creative Commons License
Based on Open Journal Systems
Developed by Information Technology Department