Nothing Special   »   [go: up one dir, main page]

CN108622176B - Multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition - Google Patents

Multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition Download PDF

Info

Publication number
CN108622176B
CN108622176B CN201810497789.4A CN201810497789A CN108622176B CN 108622176 B CN108622176 B CN 108622176B CN 201810497789 A CN201810497789 A CN 201810497789A CN 108622176 B CN108622176 B CN 108622176B
Authority
CN
China
Prior art keywords
unit
steering wheel
tof
gesture
gesture recognition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810497789.4A
Other languages
Chinese (zh)
Other versions
CN108622176A (en
Inventor
刘正全
邓亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changzhou Xingyu Automotive Lighting Systems Co Ltd
Original Assignee
Changzhou Xingyu Automotive Lighting Systems Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changzhou Xingyu Automotive Lighting Systems Co Ltd filed Critical Changzhou Xingyu Automotive Lighting Systems Co Ltd
Priority to CN201810497789.4A priority Critical patent/CN108622176B/en
Publication of CN108622176A publication Critical patent/CN108622176A/en
Application granted granted Critical
Publication of CN108622176B publication Critical patent/CN108622176B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B62LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62DMOTOR VEHICLES; TRAILERS
    • B62D1/00Steering controls, i.e. means for initiating a change of direction of the vehicle
    • B62D1/02Steering controls, i.e. means for initiating a change of direction of the vehicle vehicle-mounted
    • B62D1/04Hand wheels
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B62LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62DMOTOR VEHICLES; TRAILERS
    • B62D1/00Steering controls, i.e. means for initiating a change of direction of the vehicle
    • B62D1/24Steering controls, i.e. means for initiating a change of direction of the vehicle not vehicle-mounted
    • B62D1/28Steering controls, i.e. means for initiating a change of direction of the vehicle not vehicle-mounted non-mechanical, e.g. following a line or other known markers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Measurement Of Optical Distance (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

本发明公开一种基于TOF手势识别的多功能方向盘人车交互系统,涉及人车交互接口领域。它包括近红外照明光源单元、TOF成像阵列传感器单元、透镜模组单元、TOP控制单元、三维点云图像处理单元和汽车方向盘,近红外照明光源单元对手势识别区域进行照明;TOP控制单元对近红外照明光源单元进行调制,同时控制TOF成像阵列传感器单元测量手势照明和反射之间的相移并转换为手势识别的距离深度信息,经由三维点云图像处理单元完成解析,通过CAN/LIN总线输出对应的方向盘多功能控制信号至车身控制器。本发明有效提高手势操作在车内应用的灵活性,可进行远距离、非接触的控制,使人车交互方式更自然、便捷。

The present invention discloses a multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition, which relates to the field of human-vehicle interaction interface. It includes a near-infrared lighting source unit, a TOF imaging array sensor unit, a lens module unit, a TOP control unit, a three-dimensional point cloud image processing unit and a car steering wheel. The near-infrared lighting source unit illuminates the gesture recognition area; the TOP control unit modulates the near-infrared lighting source unit, and at the same time controls the TOF imaging array sensor unit to measure the phase shift between gesture illumination and reflection and converts it into distance depth information for gesture recognition, completes the analysis via the three-dimensional point cloud image processing unit, and outputs the corresponding steering wheel multifunctional control signal to the vehicle body controller via the CAN/LIN bus. The present invention effectively improves the flexibility of gesture operation in the application of the vehicle, can perform long-distance, non-contact control, and makes the human-vehicle interaction more natural and convenient.

Description

一种基于TOF手势识别的多功能方向盘人车交互系统A multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition

技术领域Technical Field

本发明涉及人车交互接口领域,尤其是一种基于TOF手势识别的多功能方向盘人车交互系统。The present invention relates to the field of human-vehicle interaction interface, and in particular to a multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition.

背景技术Background Art

目前多功能方向盘上的人车交互方式以机械按键、拨杆以及旋钮为主。这些输入设备都存在一定的不足,输入习惯和人本身的自然交流习惯存在差异。At present, the human-vehicle interaction methods on the multi-function steering wheel are mainly mechanical buttons, levers and knobs. These input devices have certain shortcomings, and the input habits are different from people's natural communication habits.

发明内容Summary of the invention

为解决多功能方向盘上传统的机械按键、拨杆以及旋钮存在的不足,本发明提供一种基于TOF手势识别的多功能方向盘人车交互系统,采用非接触手势方式有效提高了手势操作在汽车内部应用的灵活性,可以对车身相关功能进行远距离、非接触的控制,使得人车交互方式更自然更便捷,符合未来智能汽车人车交互的发展趋势。In order to solve the shortcomings of traditional mechanical buttons, levers and knobs on the multi-function steering wheel, the present invention provides a multi-function steering wheel human-vehicle interaction system based on TOF gesture recognition, which adopts non-contact gesture mode to effectively improve the flexibility of gesture operation in the application of automobile interior, and can perform long-distance and non-contact control of vehicle body related functions, making the human-vehicle interaction mode more natural and convenient, which is in line with the development trend of human-vehicle interaction of future smart cars.

为实现上述目的,本发明采用下述技术方案:To achieve the above object, the present invention adopts the following technical solutions:

一种基于TOF手势识别的多功能方向盘人车交互系统,该多功能方向盘人车交互系统包括近红外照明光源单元、TOF成像阵列传感器单元、TOP控制单元、三维点云图像处理单元和汽车方向盘,近红外照明光源单元和TOF成像阵列传感器单元分别设置在汽车方向盘的两侧;近红外照明光源单元对手势识别区域进行照明;TOP控制单元对近红外照明光源单元进行调制,同时控制TOF成像阵列传感器单元测量手势照明和反射之间的相移,并将其转换成为手势识别的距离深度信息,经由三维点云图像处理单元完成解析,通过CAN总线或LIN总线输出对应的方向盘多功能控制信号至车身控制器。A multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition, the multifunctional steering wheel human-vehicle interaction system comprising a near-infrared lighting source unit, a TOF imaging array sensor unit, a TOP control unit, a three-dimensional point cloud image processing unit and a car steering wheel, wherein the near-infrared lighting source unit and the TOF imaging array sensor unit are respectively arranged on both sides of the car steering wheel; the near-infrared lighting source unit illuminates a gesture recognition area; the TOP control unit modulates the near-infrared lighting source unit, and controls the TOF imaging array sensor unit to measure the phase shift between gesture illumination and reflection, and converts it into distance depth information for gesture recognition, completes analysis via the three-dimensional point cloud image processing unit, and outputs a corresponding steering wheel multifunctional control signal to a body controller via a CAN bus or a LIN bus.

进一步地,近红外照明光源单元发出的近红外光经过识别手势反射后,通过TOF成像阵列传感器单元对反射的近红外光进行接收。Furthermore, after the near-infrared light emitted by the near-infrared illumination light source unit is reflected by the recognized gesture, the reflected near-infrared light is received by the TOF imaging array sensor unit.

进一步地,近红外照明光源单元包含多个照明单体;TOF成像阵列传感器单元一次同时测量多个照明单体,每个照明单体之间间隔与照明单体数对应的相位,利用照明和反射之间的相位差异来计算手势识别的距离深度信息。Furthermore, the near-infrared illumination light source unit includes a plurality of illumination monomers; the TOF imaging array sensor unit measures the plurality of illumination monomers at a time, and the phase interval between each illumination monomer corresponds to the number of illumination monomers, and the phase difference between illumination and reflection is used to calculate the distance depth information of gesture recognition.

进一步地,TOP控制单元采用多频技术对近红外照明光源单元进行调制,兼顾了测量精度和测量距离问题,即添加一个或多个调制频率来工作,使得在足够的测量距离条件下获得最佳的检测精度。每个调制频率都将计算得到一个对应的测量距离,实际手势深度位置由这些调制频率所测得多个距离共同决定。Furthermore, the TOP control unit uses multi-frequency technology to modulate the near-infrared illumination light source unit, taking into account both the measurement accuracy and the measurement distance, that is, adding one or more modulation frequencies to work, so as to obtain the best detection accuracy under sufficient measurement distance conditions. Each modulation frequency will calculate a corresponding measurement distance, and the actual gesture depth position is determined by the multiple distances measured by these modulation frequencies.

进一步地,TOP控制单元对近红外照明光源单元进行调制,同时控制TOF成像阵列传感器单元接收反射回来的近红外光,生成三维点云图像,可以提供每个像素点距离深度信息,并以灰度形式进行展现,灰度值越高,手势越接近TOF成像阵列传感器单元。Furthermore, the TOP control unit modulates the near-infrared illumination light source unit, and controls the TOF imaging array sensor unit to receive the reflected near-infrared light to generate a three-dimensional point cloud image, which can provide the distance and depth information of each pixel point and display it in grayscale. The higher the grayscale value, the closer the gesture is to the TOF imaging array sensor unit.

进一步地,三维点云图像处理单元根据TOF成像阵列传感器单元获得的距离深度信息(作为手势识别的一个重要特征),将手势部位与图像的其他背景分割开。Furthermore, the three-dimensional point cloud image processing unit separates the gesture part from other backgrounds of the image based on the distance depth information (as an important feature of gesture recognition) obtained by the TOF imaging array sensor unit.

进一步地,多功能方向盘人车交互系统还包括透镜模组单元,透镜模组单元调节TOF成像阵列传感器单元拾取手势图像的焦距,使得手势识别区域范围符合实际应用场景的需要。Furthermore, the multi-function steering wheel human-vehicle interaction system also includes a lens module unit, which adjusts the focal length of the TOF imaging array sensor unit to pick up the gesture image, so that the gesture recognition area range meets the needs of actual application scenarios.

有益效果:Beneficial effects:

1.本发明通过手势控制方式替代多功能方向盘上传统的机械按键、拨杆以及旋钮,实现灯光功能控制、音频功能控制、影音功能控制、雨刮器功能控制、仪表盘功能控制以及定速巡航和电话功能控制。1. The present invention replaces the traditional mechanical buttons, levers and knobs on the multi-function steering wheel with gesture control to achieve lighting function control, audio function control, video function control, wiper function control, instrument panel function control, cruise control and telephone function control.

2.本发明采用视频输入的形式可以进行远距离和非接触的控制,实现手势控制车身相关功能;与传统方式相比,手势识别在弱光和强光环境下都能实现较高的正确率,使人车之间的交互更加自然便捷。2. The present invention adopts the form of video input to perform long-distance and non-contact control, and realize gesture control of vehicle body related functions; compared with traditional methods, gesture recognition can achieve a higher accuracy rate in both low-light and strong-light environments, making the interaction between people and vehicles more natural and convenient.

3.本发明的TOF手势识别集成度高、结构紧凑,由识别算法所带来的计算强度可以在嵌入式系统中实现,同时在车内环境下兼顾检测距离和测量精度两个要求,响应时间也是视觉系统中最快的,符合未来智能汽车人车交互的发展趋势。3. The TOF gesture recognition of the present invention has high integration and compact structure. The computing intensity brought by the recognition algorithm can be implemented in embedded systems. At the same time, it takes into account both the detection distance and measurement accuracy in the in-vehicle environment. The response time is also the fastest in the visual system, which is in line with the development trend of human-vehicle interaction in the future smart cars.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1是本发明一实施例的基于TOF手势识别的多功能方向盘人车交互系统的正视图;FIG1 is a front view of a multi-function steering wheel human-vehicle interaction system based on TOF gesture recognition according to an embodiment of the present invention;

图2是本发明一实施例的基于TOF手势识别的多功能方向盘人车交互系统的左视图;FIG2 is a left view of a multi-function steering wheel human-vehicle interaction system based on TOF gesture recognition according to an embodiment of the present invention;

图3是本发明一实施例的透镜模组单元的示意图;FIG3 is a schematic diagram of a lens module unit according to an embodiment of the present invention;

图4是本发明一实施例的照明和反射之间的相位差测量波形图;FIG4 is a waveform diagram showing a phase difference measurement between illumination and reflection according to an embodiment of the present invention;

图5是本发明一实施例的三维点云图;FIG5 is a three-dimensional point cloud diagram according to an embodiment of the present invention;

图6是本发明一实施例的手势部位与图像其他背景的分割示意图;FIG6 is a schematic diagram of segmentation of a gesture portion and other image backgrounds according to an embodiment of the present invention;

图中:1-红外照明光源单元,2-TOF成像阵列传感器单元,3-透镜模组单元,4-TOP控制单元,5-三维点云图像处理单元,6-汽车方向盘。In the figure: 1-infrared lighting source unit, 2-TOF imaging array sensor unit, 3-lens module unit, 4-TOP control unit, 5-three-dimensional point cloud image processing unit, 6-car steering wheel.

具体实施方式DETAILED DESCRIPTION

下面结合附图和实施例对本发明进一步说明。The present invention is further described below in conjunction with the accompanying drawings and embodiments.

本实施例提出一种基于TOF手势识别的多功能方向盘人车交互系统,如图1-2所示,它包括近红外照明光源单元1、TOF成像阵列传感器单元2、透镜模组单元3、TOP控制单元4、三维点云图像处理单元5和汽车方向盘6,近红外照明光源单元1和TOF成像阵列传感器单元2分别设置在汽车方向盘6的两侧;近红外照明光源单元1对手势识别区域进行照明;透镜模组单元3(图3)调节TOF成像阵列传感器单元2拾取手势图像的焦距,使得手势识别区域范围符合实际应用场景的需要;TOP控制单元4对近红外照明光源单元1进行调制,同时控制TOF成像阵列传感器单元2测量手势照明和反射之间的相移,并将其转换成为手势识别的距离深度信息,经由三维点云图像处理单元5完成解析,通过CAN总线或LIN总线输出对应的方向盘多功能控制信号至车身控制器。The present embodiment proposes a multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition, as shown in Figure 1-2, it includes a near-infrared lighting source unit 1, a TOF imaging array sensor unit 2, a lens module unit 3, a TOP control unit 4, a three-dimensional point cloud image processing unit 5 and a car steering wheel 6, the near-infrared lighting source unit 1 and the TOF imaging array sensor unit 2 are respectively arranged on both sides of the car steering wheel 6; the near-infrared lighting source unit 1 illuminates the gesture recognition area; the lens module unit 3 (Figure 3) adjusts the focal length of the TOF imaging array sensor unit 2 to pick up the gesture image, so that the gesture recognition area range meets the needs of the actual application scenario; the TOP control unit 4 modulates the near-infrared lighting source unit 1, and at the same time controls the TOF imaging array sensor unit 2 to measure the phase shift between gesture illumination and reflection, and converts it into distance depth information for gesture recognition, completes the analysis through the three-dimensional point cloud image processing unit 5, and outputs the corresponding steering wheel multifunctional control signal to the body controller through the CAN bus or LIN bus.

在本实施例中,近红外照明光源单元1(型号:Lumentum 350mW,854nm TO-56Packaged Laser Diode 22045504)发出的近红外光经过识别手势反射后,通过TOF成像阵列传感器单元2(型号:320×240 Array OPT8241)对反射的近红外光进行接收。In this embodiment, the near-infrared light emitted by the near-infrared illumination light source unit 1 (model: Lumentum 350mW, 854nm TO-56 Packaged Laser Diode 22045504) is reflected by the recognized gesture, and then the reflected near-infrared light is received by the TOF imaging array sensor unit 2 (model: 320×240 Array OPT8241).

在本实施例中,近红外照明光源单元1包含多个照明单体;TOF成像阵列传感器单元2一次同时测量多个照明单体,每个照明单体之间间隔与照明单体数对应的相位,利用照明和反射之间的相位差异来计算手势识别的距离深度信息。具体地:如图4所示,利用照明和反射之间的相位角φ(下式(1))计算手势识别的距离深度d(下式(2))。In this embodiment, the near-infrared illumination light source unit 1 includes a plurality of illumination units; the TOF imaging array sensor unit 2 measures a plurality of illumination units at a time, and the interval between each illumination unit corresponds to the phase of the number of illumination units, and the phase difference between illumination and reflection is used to calculate the distance depth information of gesture recognition. Specifically, as shown in FIG4 , the distance depth d (the following formula (2)) of gesture recognition is calculated using the phase angle φ between illumination and reflection (the following formula (1)).

其中,c为光速;Q1、Q2、Q3和Q4为TOF成像阵列传感器单元2采样得到的电荷量。Wherein, c is the speed of light; Q1, Q2, Q3 and Q4 are the charges sampled by the TOF imaging array sensor unit 2.

在本实施例中,TOP控制单元4采用多频技术对近红外照明光源单元1进行调制,兼顾了测量精度和测量距离问题,即添加一个或多个调制频率来工作,使得在足够的测量距离条件下获得最佳的检测精度。每个调制频率都将计算得到一个对应的测量距离,实际手势深度位置是由这些调制频率所测得多个距离共同决定。具体地:连续方波光源调制检测手势识别的距离测量方差可以表示为下式(3):In this embodiment, the TOP control unit 4 uses multi-frequency technology to modulate the near-infrared illumination light source unit 1, taking into account both the measurement accuracy and the measurement distance, that is, adding one or more modulation frequencies to work, so as to obtain the best detection accuracy under the condition of sufficient measurement distance. Each modulation frequency will calculate a corresponding measurement distance, and the actual gesture depth position is determined by the multiple distances measured by these modulation frequencies. Specifically: the distance measurement variance of gesture recognition detected by continuous square wave light source modulation can be expressed as the following formula (3):

其中,cd为调制对比度,描述了TOF成像阵列传感器单元2分离和收集光电子的能力。Where c d is the modulation contrast, which describes the ability of the TOF imaging array sensor unit 2 to separate and collect photoelectrons.

其中,反射光亮度L是光功率的函数,可以表示为下式(4):The reflected light brightness L is a function of the optical power and can be expressed as the following formula (4):

其中,偏移量S是环境光和系统偏移量的函数,可以表示为下式(5):The offset S is a function of the ambient light and the system offset, and can be expressed as follows (5):

从式(3)中可以推断出反射光亮度,调制频率和调制对比度是影响距离测量精度三大因素。From formula (3), it can be inferred that the reflected light brightness, modulation frequency and modulation contrast are the three major factors affecting the distance measurement accuracy.

在本实施例中,TOP控制单元4(型号:3D ToF Controller OPT9221)对近红外照明光源单元1进行调制,同时控制TOF成像阵列传感器单元2接收反射回来的近红外光,生成三维点云图像,可以提供每个像素点距离深度信息,如图5所示,并以灰度形式进行展现,灰度值越高,手势越接近TOF成像阵列传感器单元2。In this embodiment, the TOP control unit 4 (model: 3D ToF Controller OPT9221) modulates the near-infrared illumination light source unit 1, and controls the TOF imaging array sensor unit 2 to receive the reflected near-infrared light to generate a three-dimensional point cloud image, which can provide the distance depth information of each pixel point, as shown in Figure 5, and is displayed in grayscale. The higher the grayscale value, the closer the gesture is to the TOF imaging array sensor unit 2.

在本实施例中,三维点云图像处理单元5(型号:高性能ARMAM437x)根据TOF成像阵列传感器单元2获得的距离深度信息(作为手势识别的一个重要特征),将手势部位与图像的其他背景分割开,如图6所示。In this embodiment, the three-dimensional point cloud image processing unit 5 (model: high performance ARM AM437x) separates the gesture part from other backgrounds of the image based on the distance depth information (as an important feature for gesture recognition) obtained by the TOF imaging array sensor unit 2, as shown in FIG6 .

对本发明保护范围的限制,所属领域技术人员应该明白,在本发明的技术方案的基础上,本领域技术人员不需要付出创造性劳动即可做出的各种修改或变形仍在本发明的保护范围以内。Regarding the limitation of the protection scope of the present invention, those skilled in the art should understand that, based on the technical solution of the present invention, various modifications or variations that can be made by those skilled in the art without creative work are still within the protection scope of the present invention.

Claims (3)

1.一种基于TOF手势识别的多功能方向盘人车交互系统,其特征在于:所述多功能方向盘人车交互系统包括近红外照明光源单元(1)、TOF成像阵列传感器单元(2)、TOP控制单元(4)、三维点云图像处理单元(5)和汽车方向盘(6),所述近红外照明光源单元(1)和所述TOF成像阵列传感器单元(2)分别设置在所述汽车方向盘(6)的两侧;所述近红外照明光源单元(1)对手势识别区域进行照明;所述TOP控制单元(4)对所述近红外照明光源单元(1)进行调制,同时控制所述TOF成像阵列传感器单元(2)测量手势照明和反射之间的相移,并将其转换成为手势识别的距离深度信息,经由所述三维点云图像处理单元(5)完成解析,通过CAN总线或LIN总线输出对应的方向盘多功能控制信号至车身控制器;1. A multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition, characterized in that: the multifunctional steering wheel human-vehicle interaction system comprises a near-infrared illumination light source unit (1), a TOF imaging array sensor unit (2), a TOF control unit (4), a three-dimensional point cloud image processing unit (5) and a car steering wheel (6), wherein the near-infrared illumination light source unit (1) and the TOF imaging array sensor unit (2) are respectively arranged on both sides of the car steering wheel (6); the near-infrared illumination light source unit (1) illuminates a gesture recognition area; the TOF control unit (4) modulates the near-infrared illumination light source unit (1) and controls the TOF imaging array sensor unit (2) to measure the phase shift between gesture illumination and reflection, and converts it into distance depth information for gesture recognition, completes analysis via the three-dimensional point cloud image processing unit (5), and outputs a corresponding steering wheel multifunctional control signal to a vehicle body controller via a CAN bus or a LIN bus; 所述近红外照明光源单元(1)包含多个照明单体;所述TOF成像阵列传感器单元(2)一次同时测量多个照明单体,每个照明单体之间间隔与照明单体数对应的相位,利用照明和反射之间的相位差异来计算手势识别的距离深度信息;The near-infrared illumination light source unit (1) comprises a plurality of illumination units; the TOF imaging array sensor unit (2) measures the plurality of illumination units simultaneously at one time, with each illumination unit spaced apart by a phase corresponding to the number of illumination units, and uses the phase difference between illumination and reflection to calculate distance depth information for gesture recognition; 所述TOP控制单元(4)采用多频技术对所述近红外照明光源单元(1)进行调制;所述多频技术通过添加一个或多个调制频率来工作,每个调制频率都将计算得到一个对应的测量距离,实际手势深度位置是由这些调制频率所测得多个距离共同决定;The TOP control unit (4) uses a multi-frequency technology to modulate the near-infrared illumination light source unit (1); the multi-frequency technology works by adding one or more modulation frequencies, each modulation frequency will calculate a corresponding measurement distance, and the actual gesture depth position is jointly determined by the multiple distances measured by these modulation frequencies; 所述多功能方向盘人车交互系统还包括透镜模组单元(3),所述透镜模组单元(3)调节所述TOF成像阵列传感器单元(2)拾取手势图像的焦距;The multifunctional steering wheel human-vehicle interaction system further comprises a lens module unit (3), wherein the lens module unit (3) adjusts the focal length of the gesture image picked up by the TOF imaging array sensor unit (2); 所述三维点云图像处理单元(5)根据所述TOF成像阵列传感器单元(2)获得的距离深度信息,将手势部位与图像的其他背景分割开。The three-dimensional point cloud image processing unit (5) separates the gesture part from other backgrounds of the image according to the distance depth information obtained by the TOF imaging array sensor unit (2). 2.根据权利要求1所述的基于TOF手势识别的多功能方向盘人车交互系统,其特征在于:所述近红外照明光源单元(1)发出的近红外光经过识别手势反射后,通过所述TOF成像阵列传感器单元(2)对反射的近红外光进行接收。2. The multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition according to claim 1 is characterized in that the near-infrared light emitted by the near-infrared illumination light source unit (1) is reflected by the recognized gesture, and then the reflected near-infrared light is received by the TOF imaging array sensor unit (2). 3.根据权利要求1所述的基于TOF手势识别的多功能方向盘人车交互系统,其特征在于:所述TOP控制单元(4)对所述近红外照明光源单元(1)进行调制,同时控制所述TOF成像阵列传感器单元(2)接收反射回来的近红外光,生成三维点云图像。3. According to claim 1, the multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition is characterized in that: the TOP control unit (4) modulates the near-infrared illumination light source unit (1), and at the same time controls the TOF imaging array sensor unit (2) to receive the reflected near-infrared light to generate a three-dimensional point cloud image.
CN201810497789.4A 2018-05-23 2018-05-23 Multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition Active CN108622176B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810497789.4A CN108622176B (en) 2018-05-23 2018-05-23 Multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810497789.4A CN108622176B (en) 2018-05-23 2018-05-23 Multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition

Publications (2)

Publication Number Publication Date
CN108622176A CN108622176A (en) 2018-10-09
CN108622176B true CN108622176B (en) 2024-10-29

Family

ID=63694081

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810497789.4A Active CN108622176B (en) 2018-05-23 2018-05-23 Multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition

Country Status (1)

Country Link
CN (1) CN108622176B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110822719A (en) * 2019-10-08 2020-02-21 广东万博电气有限公司 Gesture-controlled electric water heater
CN112748583B (en) * 2020-08-11 2022-05-13 上海鲲游光电科技有限公司 Optical field modulator and modulation method thereof
CN112818857A (en) * 2021-02-02 2021-05-18 深圳市汇春科技股份有限公司 Method, device and equipment for recognizing air gesture and storage medium
CN116009275B (en) * 2022-12-30 2024-07-19 福州大学 Naked eye 3D display device capable of recognizing dynamic gestures

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102016636A (en) * 2009-03-05 2011-04-13 松下电器产业株式会社 Distance measuring device, distance measuring method, program and integrated circuit
KR101328441B1 (en) * 2012-06-07 2013-11-20 자동차부품연구원 Interface device of steering wheeling of vehicles
CN103998949A (en) * 2012-01-10 2014-08-20 索弗特凯耐提克传感器股份有限公司 Improvements in or relating to the processing of time-of-flight signals
CN104755308A (en) * 2013-06-29 2015-07-01 奥迪股份公司 Motor vehicle control interface with gesture recognition
CN105730496A (en) * 2014-12-31 2016-07-06 哈曼国际工业有限公司 Force measuring steering wheel
CN108038453A (en) * 2017-12-15 2018-05-15 罗派智能控制技术(上海)有限公司 A kind of driver's state-detection and identifying system based on RGBD
CN208411849U (en) * 2018-05-23 2019-01-22 常州星宇车灯股份有限公司 A kind of multi-functional steering wheel people-car interaction system based on TOF gesture identification

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8775023B2 (en) * 2009-02-15 2014-07-08 Neanode Inc. Light-based touch controls on a steering wheel and dashboard
DE102013207664A1 (en) * 2013-04-26 2014-10-30 Zumtobel Lighting Gmbh Arrangement and method for recognizing gestures
CN103513491B (en) * 2013-09-25 2016-04-20 南京大学 A kind of method and apparatus producing optical frequency com based on Parabolic Phase modulation
CN104122995A (en) * 2014-05-28 2014-10-29 重庆大学 Method for simulating car race game steering wheel by utilizing visual information
DE102014116292A1 (en) * 2014-11-07 2016-05-12 Visteon Global Technologies, Inc. System for transmitting information in a motor vehicle
DE102015015248A1 (en) * 2015-11-18 2017-05-18 Elmos Semiconductor Aktiengesellschaft Simple gesture recognition device
CN105718065B (en) * 2016-01-27 2018-08-21 北京交通大学 Interactive inspection analogue system under bus or train route cooperative surroundings
CN206921118U (en) * 2017-03-09 2018-01-23 深圳奥比中光科技有限公司 Double-wavelength images acquisition system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102016636A (en) * 2009-03-05 2011-04-13 松下电器产业株式会社 Distance measuring device, distance measuring method, program and integrated circuit
CN103998949A (en) * 2012-01-10 2014-08-20 索弗特凯耐提克传感器股份有限公司 Improvements in or relating to the processing of time-of-flight signals
KR101328441B1 (en) * 2012-06-07 2013-11-20 자동차부품연구원 Interface device of steering wheeling of vehicles
CN104755308A (en) * 2013-06-29 2015-07-01 奥迪股份公司 Motor vehicle control interface with gesture recognition
CN105730496A (en) * 2014-12-31 2016-07-06 哈曼国际工业有限公司 Force measuring steering wheel
CN108038453A (en) * 2017-12-15 2018-05-15 罗派智能控制技术(上海)有限公司 A kind of driver's state-detection and identifying system based on RGBD
CN208411849U (en) * 2018-05-23 2019-01-22 常州星宇车灯股份有限公司 A kind of multi-functional steering wheel people-car interaction system based on TOF gesture identification

Also Published As

Publication number Publication date
CN108622176A (en) 2018-10-09

Similar Documents

Publication Publication Date Title
CN108622176B (en) Multifunctional steering wheel human-vehicle interaction system based on TOF gesture recognition
CN107749194B (en) Lane changing assisting method and mobile terminal
JP2021516401A (en) Data fusion method and related equipment
US20190163268A1 (en) Virtual touch recognition apparatus and method for correcting recognition error thereof
KR102673811B1 (en) Optical scanning device and LIDAR system including the optical scanning device
JP7123163B6 (en) Depth processor and 3D image equipment
US20140168065A1 (en) Motion detection system
CN101639746B (en) Automatic calibration method of touch screen
CN112805663B (en) Electronic device and gesture recognition method thereof
JP3961584B2 (en) Lane marking detector
CN108833888B (en) Depth processor and three-dimensional image device
TW201425968A (en) Optical sensing apparatus and method for detecting object near optical sensing apparatus
CN111538009A (en) Radar point marking method and device
CN208411849U (en) A kind of multi-functional steering wheel people-car interaction system based on TOF gesture identification
KR101488287B1 (en) Display Device for Recognizing Touch Move
EP3637758B1 (en) Image processing device
CN101976156A (en) Optical touch display
CN112771480B (en) Interactive method and electronic device
JPH07333339A (en) Obstacle detection device for automobiles
WO2023077412A1 (en) Object distance measurement method and device
CN116416303A (en) Vehicle-mounted binocular distance measurement and obstacle avoidance system
JP2012022501A (en) Vehicle dimension detection system
JP7286612B2 (en) Operation detection device and operation detection method
US11964563B2 (en) Vehicle display control device, control method of vehicle display control device and storage medium
CN207182343U (en) Optical finger print recognizer component and electronic installation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant