End-to-End Multiview Gesture Recognition for Autonomous Car Parking System

论文摘要

The use of hand gestures can be the most intuitive human-machine interaction medium.The early approaches for hand gesture recognition used device-based methods.These methods use mechanical or optical sensors attached to a glove or markers,which hinder the natural human-machine communication.On the other hand,vision-based methods are less restrictive and allow for a more spontaneous communication without the need of an intermediary between human and machine.Therefore,vision gesture recognition has been a popular area of research for the past thirty years.Hand gesture recognition finds its application in many areas,particularly the automotive industry where advanced automotive human-machine interface（HMI） designers are using gesture recognition to improve driver and vehicle safety.However,technology advances go beyond active/passive safety and into convenience and comfort.In this context,one of America’s big three automakers has partnered with the Centre of Pattern Analysis and Machine Intelligence（CPAMI） at the University of Waterloo to investigate expanding their product segment through machine learning to provide an increased driver convenience and comfort with the particular application of hand gesture recognition for autonomous car parking.The present paper leverages the state-of-the-art deep learning and optimization techniques to develop a vision-based multiview dynamic hand gesture recognizer for a self-parking system.We propose a 3D-CNN gesture model architecture that we train on a publicly available hand gesture database.We apply transfer learning methods to fine-tune the pre-trained gesture model on custom-made data,which significantly improves the proposed system performance in a real world environment.We adapt the architecture of end-to-end solution to expand the state-of-the-art video classifier from a single image as input（fed by monocular camera） to a Multiview 360 feed,offered by a six cameras module.Finally,we optimize the proposed solution to work on a limited resource embedded platform（Nvidia Jetson TX2） that is used by automakers for vehicle-based features,without sacrificing the accuracy robustness and real time functionality of the system.

论文目录

文章来源

类型: 期刊论文

作者: Hassene Ben AMARA,Fakhri KARRAY

来源: Instrumentation 2019年03期

年度: 2019

分类: 工程科技Ⅱ辑,信息科技

专业: 汽车工业,计算机软件及计算机应用

单位: Centre for Pattern Analysis and Machine Intelligence(CPAMI),Electrical and Computer Engineering,The University of Waterloo

分类号: U463.6;TP391.41

DOI: 10.15878/j.cnki.instrumentation.2019.03.010

页码: 76-92

总页数: 17

文件大小: 1917K

下载量: 5

相关论文文献

• [1].Moving Human Posture Recognition Based on Joint Quaternion[J]. Journal of Donghua University(English Edition) 2016(05)
• [2].The 10th IEEE International Conference on Automatic Face and Gesture Recognition[J]. 计算机应用 2012(09)
• [3].Object Recognition Algorithm Based on an Improved Convolutional Neural Network[J]. Journal of Beijing Institute of Technology 2020(02)
• [4].Reversal of Social Recognition Deficit in Adult Mice with MECP2 Duplication via Normalization of MeCP2 in the Medial Prefrontal Cortex[J]. Neuroscience Bulletin 2020(06)
• [5].English Speech Recognition System on Chip[J]. Tsinghua Science and Technology 2011(01)
• [6].Exploring Local Regularities for 3D Object Recognition[J]. Chinese Journal of Mechanical Engineering 2016(06)
• [7].Marketing Development and Recognition of DFH-4 Series Bus Satellites[J]. Aerospace China 2017(01)
• [8].Recognition of the Projective Special Linear Group over GF(3)[J]. Acta Mathematica Sinica(English Series) 2010(03)
• [9].Dynamic Hand Gesture Recognition Based on Short-Term Sampling Neural Networks[J]. IEEE/CAA Journal of Automatica Sinica 2021(01)
• [10].Skeleton-Based Human Action Recognition via Screw Matrices[J]. Chinese Journal of Electronics 2017(04)
• [11].第13届文档分析与识别国际会议（英文）[J]. 智能系统学报 2015(01)
• [12].第五届模式识别应用和方法国际会议（英文）[J]. 智能系统学报 2015(05)
• [13].Survey of Pedestrian Action Recognition Techniques for Autonomous Driving[J]. Tsinghua Science and Technology 2020(04)
• [14].Multiple Feature Fusion in Convolutional Neural Networks for Action Recognition[J]. Wuhan University Journal of Natural Sciences 2017(01)
• [15].Sparse Representation for Face Recognition Based on Constraint Sampling and Face Alignment[J]. Tsinghua Science and Technology 2013(01)
• [16].An Introduction to the Chinese Speech Recognition Front-End of the NICT/ATR Multi-Lingual Speech Translation System[J]. Tsinghua Science and Technology 2008(04)
• [17].Unsupervised Domain Adaptation Learning Algorithm for RGB-D Stairway Recognition[J]. Instrumentation 2019(02)
• [18].Action Recognition with Temporal Scale-Invariant Deep Learning Framework[J]. 中国通信 2017(02)
• [19].Activity Recognition with Smartphone Sensors[J]. Tsinghua Science and Technology 2014(03)
• [20].The 10th IEEE International Conference on Automatic Face and Gesture Recognition[J]. 计算机应用 2012(08)
• [21].Event Type Recognition Based on Trigger Expansion[J]. Tsinghua Science and Technology 2010(03)
• [22].Face Image Recognition Based on Convolutional Neural Network[J]. 中国通信 2020(02)
• [23].Recognition of Film Type Using HSV Features on Deep-Learning Neural Networks[J]. Journal of Electronic Science and Technology 2020(01)
• [24].Melt Quality Evaluation of Ductile Iron by Pattern Recognition of Thermal Analysis Cooling Curves[J]. Tsinghua Science and Technology 2008(02)
• [25].Modulation Recognition in Maritime Multipath Channels: A Blind Equalization-Aided Deep Learning Approach[J]. 中国通信 2020(03)
• [26].Recognition System for Leaf Diseases of Ophiopogon japonicus Based on PCA-SVM[J]. Plant Diseases and Pests 2020(02)
• [27].Radar Target Recognition Algorithm Based on RCS Observation Sequence——Set-Valued Identification Method[J]. Journal of Systems Science & Complexity 2016(03)
• [28].Recognition Method for Change Point of Traffic Flow Linear Regressions[J]. Journal of Donghua University(English Edition) 2012(01)
• [29].Improved Face Recognition Method Using Genetic Principal Component Analysis[J]. Journal of Electronic Science and Technology 2010(04)
• [30].Analysis on the Application of Image Processing Technology in Clothing Pattern Recognition[J]. Journal of Donghua University(English Edition) 2020(03)