Skip to main content

01.08.2019 | Special Issue Paper

3D point cloud registration denoising method for human motion image using deep learning algorithm

verfasst von: Qidong Du

Erschienen in: Multimedia Systems

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Aiming at the problem of 3D point cloud noise affecting the efficiency and precision of human body 3D reconstruction in complex scenes, a 3D point cloud registration denoising method for human motion image using depth learning algorithm is proposed. First, two Kinect sensors are used to collect the three-dimensional data of the human body in the scene, and the spatial alignment under the Bursa linear model is used to pre-process the background point cloud data. The depth image of the point cloud is calculated, and the depth image pair is extracted by the convolutional neural network. Furthermore, the feature difference of the depth image pair is taken as the input of the fully connected network and the point cloud registration parameter is calculated, and the above operation is performed iteratively until the registration error is less than the acceptable threshold. Then, the improved C-means algorithm is used to remove the outlier, the noise is clustered, and the large-scale outlier noise is removed. Finally, the high-frequency information is processed by the depth data bilateral filtering method. The experimental results show that compared with the traditional bilateral filtering algorithm and fuzzy C-means algorithm, the proposed method can effectively remove noise of different scales and maintain good performance on the basis of maintaining human body features. In the point cloud model of A, B, and C, the average error of the proposed method is lower than that of the traditional bilateral filtering algorithm with 15.7%, 15.9%, and 19.8%, respectively, and it is lower than that of the fuzzy C-means algorithm with 25.8%, 26.9%, and 30.2%, respectively.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Su, T., Wang, W., Lv, Z., et al.: Rapid Delaunay triangulation for randomly distributed point cloud data using adaptive Hilbert curve. Comput. Graph. 54(C), 65–74 (2016)CrossRef Su, T., Wang, W., Lv, Z., et al.: Rapid Delaunay triangulation for randomly distributed point cloud data using adaptive Hilbert curve. Comput. Graph. 54(C), 65–74 (2016)CrossRef
2.
Zurück zum Zitat März, T., Weinmann, A.: Model-based reconstruction for magnetic particle imaging in 2D and 3D. Inverse Prob. Imaging 10(4), 1087–1110 (2017)MathSciNetMATHCrossRef März, T., Weinmann, A.: Model-based reconstruction for magnetic particle imaging in 2D and 3D. Inverse Prob. Imaging 10(4), 1087–1110 (2017)MathSciNetMATHCrossRef
3.
Zurück zum Zitat Clarkson, S., Wheat, J., Heller, B., et al.: Assessment of a Microsoft Kinect-based 3D scanning system for taking body segment girth measurements: a comparison to ISAK and ISO standards. J. Sports Sci. 34(11), 1006–1014 (2016)CrossRef Clarkson, S., Wheat, J., Heller, B., et al.: Assessment of a Microsoft Kinect-based 3D scanning system for taking body segment girth measurements: a comparison to ISAK and ISO standards. J. Sports Sci. 34(11), 1006–1014 (2016)CrossRef
4.
Zurück zum Zitat Qin, C., Song, A., Wu, C., et al.: Scenario interaction system of rehabilitation training robot based on Unity 3D and Kinect. Chin. J. Sci. Instrum. 38(3), 530–536 (2017) Qin, C., Song, A., Wu, C., et al.: Scenario interaction system of rehabilitation training robot based on Unity 3D and Kinect. Chin. J. Sci. Instrum. 38(3), 530–536 (2017)
5.
Zurück zum Zitat Pöhlmann, S.T., Harkness, E.F., Taylor, C.J., et al.: Evaluation of Kinect 3D sensor for healthcare imaging. J. Med. Biol. Eng. 36(6), 857–870 (2016)CrossRef Pöhlmann, S.T., Harkness, E.F., Taylor, C.J., et al.: Evaluation of Kinect 3D sensor for healthcare imaging. J. Med. Biol. Eng. 36(6), 857–870 (2016)CrossRef
6.
Zurück zum Zitat Yu, Y.L., Zhang, H., Liu, G.H., Shi, J.F.: Kinect depth map pre-processing based on uncertainty evaluation. J. Comput. Appl. 36(3), 541–545 (2016) Yu, Y.L., Zhang, H., Liu, G.H., Shi, J.F.: Kinect depth map pre-processing based on uncertainty evaluation. J. Comput. Appl. 36(3), 541–545 (2016)
7.
Zurück zum Zitat Moreno C, Ming L. A progressive transmission technique for the streaming of point cloud data using the Kinect. In: 2018 international conference on computing, networking and communications (ICNC), pp. 593–598. IEEE, Maui, HI, USA (2018) Moreno C, Ming L. A progressive transmission technique for the streaming of point cloud data using the Kinect. In: 2018 international conference on computing, networking and communications (ICNC), pp. 593–598. IEEE, Maui, HI, USA (2018)
8.
Zurück zum Zitat Zhang, Y., Cong, C., Wu, Q., et al.: A Kinect-based approach for 3D pavement surface reconstruction and cracking recognition. IEEE Trans. Intell. Transport. Syst. 19(99), 1–12 (2018)CrossRef Zhang, Y., Cong, C., Wu, Q., et al.: A Kinect-based approach for 3D pavement surface reconstruction and cracking recognition. IEEE Trans. Intell. Transport. Syst. 19(99), 1–12 (2018)CrossRef
9.
Zurück zum Zitat Alexiadis, D.S., Chatzitofis, A., Zioulis, N., et al.: An integrated platform for live 3D human reconstruction and motion capturing. IEEE Trans. Circuits Syst. Video Technol. 27(4), 798–813 (2017)CrossRef Alexiadis, D.S., Chatzitofis, A., Zioulis, N., et al.: An integrated platform for live 3D human reconstruction and motion capturing. IEEE Trans. Circuits Syst. Video Technol. 27(4), 798–813 (2017)CrossRef
10.
Zurück zum Zitat Simo-Serra, E., Torras, C., Moreno-Noguer, F.: 3D human pose tracking priors using geodesic mixture models. Int. J. Comput. Vis. 122(2), 1–21 (2017)MathSciNetCrossRef Simo-Serra, E., Torras, C., Moreno-Noguer, F.: 3D human pose tracking priors using geodesic mixture models. Int. J. Comput. Vis. 122(2), 1–21 (2017)MathSciNetCrossRef
11.
Zurück zum Zitat Chen, H., Ran, L., Lei, W., et al.: Point set surface compression based on shape pattern analysis. Multimed. Tools Appl. 76(20), 20545–20565 (2017)CrossRef Chen, H., Ran, L., Lei, W., et al.: Point set surface compression based on shape pattern analysis. Multimed. Tools Appl. 76(20), 20545–20565 (2017)CrossRef
12.
Zurück zum Zitat Rypl, D., Nerad, J.: Volume preserving smoothing of triangular isotropic three-dimensional surface meshes. Adv. Eng. Softw. 101(C), 3–26 (2016)CrossRef Rypl, D., Nerad, J.: Volume preserving smoothing of triangular isotropic three-dimensional surface meshes. Adv. Eng. Softw. 101(C), 3–26 (2016)CrossRef
13.
Zurück zum Zitat Lu, X., Liu, X., Deng, Z., et al.: An efficient approach for feature-preserving mesh denoising. Opt. Lasers Eng. 90(9), 186–195 (2017)CrossRef Lu, X., Liu, X., Deng, Z., et al.: An efficient approach for feature-preserving mesh denoising. Opt. Lasers Eng. 90(9), 186–195 (2017)CrossRef
14.
Zurück zum Zitat Zhang, X., Wan, W., An, X.: Clustering and DCT based color point cloud compression. J. Sig. Process. Syst. 86(1), 41–49 (2017)CrossRef Zhang, X., Wan, W., An, X.: Clustering and DCT based color point cloud compression. J. Sig. Process. Syst. 86(1), 41–49 (2017)CrossRef
15.
Zurück zum Zitat Zheng, Y., Li, G., Wu, S., et al.: ‘Guided point cloud denoising via sharp feature skeletons. Vis. Comput. 33(1), 1–11 (2017)CrossRef Zheng, Y., Li, G., Wu, S., et al.: ‘Guided point cloud denoising via sharp feature skeletons. Vis. Comput. 33(1), 1–11 (2017)CrossRef
16.
Zurück zum Zitat Xie, Z., Liu, J., Pan, C., et al.: A data reduction and ordering algorithm for scattered and layered point cloud. J. Graph. 37(3), 359–366 (2016) Xie, Z., Liu, J., Pan, C., et al.: A data reduction and ordering algorithm for scattered and layered point cloud. J. Graph. 37(3), 359–366 (2016)
17.
Zurück zum Zitat Tao, Y., Li, Y., Wang, Y.Q., et al.: On-line point cloud data extraction algorithm for spatial scanning measurement of irregular surface in copying manufacture. Int. J. Adv. Manuf. Technol. 87(5), 1–15 (2016)CrossRef Tao, Y., Li, Y., Wang, Y.Q., et al.: On-line point cloud data extraction algorithm for spatial scanning measurement of irregular surface in copying manufacture. Int. J. Adv. Manuf. Technol. 87(5), 1–15 (2016)CrossRef
18.
Zurück zum Zitat Ide H, Kurita T. Improvement of learning for CNN with ReLU activation by sparse regularization. International Joint Conference on Neural Networks (2017) Ide H, Kurita T. Improvement of learning for CNN with ReLU activation by sparse regularization. International Joint Conference on Neural Networks (2017)
19.
Zurück zum Zitat Qin, J., Fu, W., Gao, H., et al.: Distributed k-means algorithm and fuzzy c-means algorithm for sensor networks based on multiagent consensus theory. IEEE Trans. Cybern. 47(3), 772–783 (2017)CrossRef Qin, J., Fu, W., Gao, H., et al.: Distributed k-means algorithm and fuzzy c-means algorithm for sensor networks based on multiagent consensus theory. IEEE Trans. Cybern. 47(3), 772–783 (2017)CrossRef
20.
Zurück zum Zitat Galinsky, K., Bhatia, G., Loh, P.R., et al.: Fast principal-component analysis reveals convergent evolution of ADH1B in Europe and East Asia. Am. J. Hum. Genet. 98(3), 456–472 (2016)CrossRef Galinsky, K., Bhatia, G., Loh, P.R., et al.: Fast principal-component analysis reveals convergent evolution of ADH1B in Europe and East Asia. Am. J. Hum. Genet. 98(3), 456–472 (2016)CrossRef
21.
Zurück zum Zitat Hua, Y., Jiankeng, P., Jianwen, M.O.: Denoising algorithm for bilateral filtered point cloud based on noise classification. J. Comput. Appl. 35(8), 2305–2310 (2015) Hua, Y., Jiankeng, P., Jianwen, M.O.: Denoising algorithm for bilateral filtered point cloud based on noise classification. J. Comput. Appl. 35(8), 2305–2310 (2015)
22.
Zurück zum Zitat Wang, P., Li, W., Ogunbona, P., et al.: RGB-D-based human motion recognition with deep learning: a survey. Comput. Vis. Image Understand. 171(1), 1–22 (2017)CrossRef Wang, P., Li, W., Ogunbona, P., et al.: RGB-D-based human motion recognition with deep learning: a survey. Comput. Vis. Image Understand. 171(1), 1–22 (2017)CrossRef
23.
Zurück zum Zitat Xiao Q, Chu C. Human motion retrieval based on deep learning and dynamic time warping. International Conference on Robotics & Automation Engineering (2018) Xiao Q, Chu C. Human motion retrieval based on deep learning and dynamic time warping. International Conference on Robotics & Automation Engineering (2018)
24.
Zurück zum Zitat Shao Y, Guo S, Lin S, et al. Human motion classification based on range information with deep convolutional neural network. 2017 4th International Conference on Information Science and Control Engineering (ICISCE) (2017) Shao Y, Guo S, Lin S, et al. Human motion classification based on range information with deep convolutional neural network. 2017 4th International Conference on Information Science and Control Engineering (ICISCE) (2017)
25.
Zurück zum Zitat Harguess J, Miclat J, Raheema J. Using image quality metrics to identify adversarial imagery for deep learning networks. Geospatial Informatics, Fusion, & Motion Video Analytics VII (2017) Harguess J, Miclat J, Raheema J. Using image quality metrics to identify adversarial imagery for deep learning networks. Geospatial Informatics, Fusion, & Motion Video Analytics VII (2017)
26.
Zurück zum Zitat Bag, S., Venkatachalapathy, V.: Ptucha RW (2017) Motion estimation using visual odometry and deep learning localization. Electron. Imaging 19, 62–69 (2017)CrossRef Bag, S., Venkatachalapathy, V.: Ptucha RW (2017) Motion estimation using visual odometry and deep learning localization. Electron. Imaging 19, 62–69 (2017)CrossRef
27.
Zurück zum Zitat Min, W., Cui, H., Rao, H., et al.: Detection of human falls on furniture using scene analysis based on deep learning and activity characteristics. IEEE Access 6(99), 9324–9335 (2018)CrossRef Min, W., Cui, H., Rao, H., et al.: Detection of human falls on furniture using scene analysis based on deep learning and activity characteristics. IEEE Access 6(99), 9324–9335 (2018)CrossRef
28.
Zurück zum Zitat Ochi H, Wan W, Yang Y, et al. Deep Learning Scooping Motion using Bilateral Teleoperations. 2018 3rd International Conference on Advanced Robotics and Mechatronics (ICARM) (2018) Ochi H, Wan W, Yang Y, et al. Deep Learning Scooping Motion using Bilateral Teleoperations. 2018 3rd International Conference on Advanced Robotics and Mechatronics (ICARM) (2018)
29.
Zurück zum Zitat Laskey M, Chuck C, Lee J, et al. Comparing human-centric and robot-centric sampling for robot deep learning from demonstrations. IEEE International Conference on Robotics & Automation (2017) Laskey M, Chuck C, Lee J, et al. Comparing human-centric and robot-centric sampling for robot deep learning from demonstrations. IEEE International Conference on Robotics & Automation (2017)
30.
Zurück zum Zitat Wu D, Sharma N, Blumenstein M. Recent advances in video-based human action recognition using deep learning: a review. International Joint Conference on Neural Networks (2017) Wu D, Sharma N, Blumenstein M. Recent advances in video-based human action recognition using deep learning: a review. International Joint Conference on Neural Networks (2017)
Metadaten
Titel
3D point cloud registration denoising method for human motion image using deep learning algorithm
verfasst von
Qidong Du
Publikationsdatum
01.08.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Multimedia Systems
Print ISSN: 0942-4962
Elektronische ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-019-00630-y