WO2015131857A2 - 集成摄像头模组和光传感器的视觉辅助方法及装置 - Google Patents
集成摄像头模组和光传感器的视觉辅助方法及装置 Download PDFInfo
- Publication number
- WO2015131857A2 WO2015131857A2 PCT/CN2015/082633 CN2015082633W WO2015131857A2 WO 2015131857 A2 WO2015131857 A2 WO 2015131857A2 CN 2015082633 W CN2015082633 W CN 2015082633W WO 2015131857 A2 WO2015131857 A2 WO 2015131857A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- visual
- camera module
- prompt
- light sensor
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000003287 optical effect Effects 0.000 title abstract description 7
- 238000012545 processing Methods 0.000 claims abstract description 58
- 230000000007 visual effect Effects 0.000 claims description 100
- 230000008569 process Effects 0.000 claims description 46
- 230000004927 fusion Effects 0.000 claims description 3
- 230000004397 blinking Effects 0.000 claims description 2
- 230000008859 change Effects 0.000 abstract description 19
- 230000001771 impaired effect Effects 0.000 description 5
- 238000011897 real-time detection Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 244000025254 Cannabis sativa Species 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 201000004569 Blindness Diseases 0.000 description 1
- 241000282414 Homo sapiens Species 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000000875 corresponding effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 208000030533 eye disease Diseases 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000035772 mutation Effects 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F9/00—Methods or devices for treatment of the eyes; Devices for putting-in contact lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
- A61F9/08—Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F4/00—Methods or devices enabling patients or disabled persons to operate an apparatus or a device not forming part of the body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F2250/00—Special features of prostheses classified in groups A61F2/00 - A61F2/26 or A61F2/82 or A61F9/00 or A61F11/00 or subgroups thereof
- A61F2250/0001—Means for transferring electromagnetic energy to implants
- A61F2250/0002—Means for transferring electromagnetic energy to implants for data transfer
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/301—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
Definitions
- the invention belongs to a visual aid device, and in particular relates to a visual aid method and device for integrating a camera module and a light sensor.
- the invention provides a visual aiding method for integrating a camera module and a light sensor, comprising the following steps:
- a detecting the ambient light intensity data in real time by using the light sensor, and giving the user the first kind of visual assistance when the detected ambient light intensity continues to be higher than the first preset value for a set period of time;
- the second visual aid process in the second visual aid process, further detecting that the ambient light intensity continuously changes within a certain period of time, starting the camera module to collect image data of the user's surrounding environment, and according to the image data of the surrounding environment and When the ambient light intensity determines that there is a passing vehicle, the user is given a third type of visual assistance.
- the user opens the camera module to capture image data of the surrounding environment or close the camera module through a manual switch; and according to the surrounding environment
- the image data and ambient light intensity give the user a fourth type of visual aid, which is in the first visual aid process and the second visual aid process.
- a first prompt is accompanied
- a second prompt is accompanied
- a third visual assisting process is accompanied by a third prompt
- the fourth type of prompt is accompanied by four kinds of visual assistance processes, wherein the first prompt, the second prompt, the third prompt, and the fourth prompt use one of a voice prompt, a vibration prompt, and an LED light flashing prompt.
- the first prompt, the second prompt, the third prompt, and the fourth prompt use one of a voice prompt, a vibration prompt, and an LED light flashing prompt.
- the user can be prompted to judge the failure.
- the invention also provides a visual aid device for integrating a camera module and a light sensor, comprising:
- At least one light sensor for detecting ambient light intensity data in real time
- a camera module for capturing video or images of the surrounding environment
- Processing chip for receiving data of the light sensor and the camera module, and after determining that the ambient light intensity continues to be higher than the first preset value for a set period of time, giving the user the first kind of visual assistance;
- the ambient light intensity is given a second visual aid when the ambient light intensity continues to be lower than the second preset value for a set period of time; and in the second visual aid process, the ambient light intensity is further determined to be within a certain time
- the camera module is activated to collect image data of the user's surrounding environment, and when the passing vehicle is determined according to the image data of the surrounding environment and the ambient light intensity, the user is given a third type of visual assistance.
- the device further includes at least one location indicating module, connected to the processing chip, The user location is indicated to the population in the surrounding environment under the control of the processing chip.
- the position indicating module can indicate the user's position to a crowd in the surrounding environment by voice, LED light or vibration.
- the device further includes a second switch for manually turning on and off the camera module, for collecting image data of the surrounding environment at any time during the first visual assisting process and the second visual assisting process, and according to the The image data and ambient light intensity of the surrounding environment are given to the user a fourth type of visual aid, the fourth type of visual aid fusion being in the first visual aid process and the second visual aid process.
- the device further includes a prompting module, connected to the processing chip, for performing a first prompt to the user in the first visual assisting process under the control of the processing chip, and in the second visual aid
- the second prompt is performed in the process
- the third prompt is performed in the third visual assisting process
- the fourth prompt is performed in the fourth visual assisting process, wherein the first prompt, the second prompt,
- the third prompt and the fourth prompt use one or more of a voice prompt, a vibration prompt, and an LED light blinking prompt.
- the light sensor includes a front light sensor and a rear light sensor, which can sense light conditions in front of and behind the user and transmit signals to the processing chip; or the light sensor includes a front light sensor and a rear light.
- the sensor, the left light sensor, and the right light sensor sense the light in the front, rear, left, and right directions of the user and transmit the signal to the processing chip.
- the device further includes a light source module, and the light source includes a front light source module and/or a rear light source module for illuminating the road in a dark environment, and assisting the camera module in photographing work.
- the device further includes a GPS module connected to the processing chip, configured to locate a geographic location of the user, and feed the geographic location to a processing chip, where the processing chip combines the geographic location and the The data captured by the camera module confirms the user's surrounding environment and assists the user in navigation.
- a GPS module connected to the processing chip, configured to locate a geographic location of the user, and feed the geographic location to a processing chip, where the processing chip combines the geographic location and the The data captured by the camera module confirms the user's surrounding environment and assists the user in navigation.
- the common auxiliary prompting methods are: the LED light flashes to alert the passerby around, the oscillator vibrates to prompt the user and prompts the user by voice.
- the voice prompt content may include: in a dark environment, please pay attention to the warning; traffic lights at the front intersection, please pay attention; red light, please do not pass; green light, please pass; front down step, please note; front step, please note; Come to the car, Please turn right; come to the car, please lean to the left; turn left in front, please pay attention; turn right in front, please pay attention; ahead escalator, please pay attention; front tunnel, please note; etc., including but not limited to this.
- the processing chip determines that the dark state is such as a tunnel, an underground passage or a night, and the user is in a dark environment state through the prompting module, and controls the position indicating module to perform LED.
- the light flashes to remind the surrounding passers-by to avoid the dodge avoidance user.
- the position indication module is turned off, and the device will actively open the camera module to the road condition. By shooting, the processing chip can determine that the light intensity is changed to the hardware facility change by comparing the image, and the position indication module is prompted to prompt the user position.
- the vehicle is considered to be the source, the data source and the light intensity change are analyzed, and the vehicle is judged. Position and estimate the approximate distance, and capture the image through the camera module, through the oscillator vibration reminder and voice prompt module to voice the direction of the user to dodge and how to avoid.
- the invention can timely and effectively judge the road condition in front of the road/sidewalk/grass and the like, and can remind the road condition, and can also judge the intersection or the traffic light situation, and can detect the front and rear vehicles through the built-in front and rear light sensing at night or inside the tunnel, and pass the warning.
- the voice prompt module voice prompts to avoid the flash direction, and blinks through the LED light to remind the people in the surrounding environment to pay attention to the visually impaired person, which can not only remind the user in real time, but also can indicate and alert to the surrounding, and provide the user with personal safety. The guarantee.
- FIG. 1 is a flow chart of a visual aiding method for an integrated camera module and a light sensor according to the present invention
- FIG. 2 is a block diagram of a first embodiment of a visual aid device for an integrated camera module and a light sensor according to the present invention
- FIG. 3 is a flowchart of an operation mode of an optical sensor according to an embodiment of the present invention.
- FIG. 4 is a flowchart of a working mode of a camera module according to an embodiment of the present invention.
- FIG. 5 is a block diagram of a second embodiment of a visual aid device for an integrated camera module and a light sensor according to the present invention.
- Reference numerals 11, processing chip, 21, front light sensor, 22, front light source module, 32, voice prompt module, 33, front/rear indicator LED, 34, oscillator, 41, camera module, 42, Two switches, 43, GPRS module, 51, rear light sensor, 52, rear light source module.
- the embodiment provides a visual assist method for integrating a camera module and a light sensor, including the following steps:
- a detecting the ambient light intensity data in real time by using the light sensor, and giving the user the first kind of visual assistance when the detected ambient light intensity continues to be higher than the first preset value for a set period of time;
- the second visual aid process in the second visual aid process, further detecting that the ambient light intensity continuously changes within a certain period of time, starting the camera module to collect image data of the user's surrounding environment, and according to the image data of the surrounding environment and When the ambient light intensity determines that there is a passing vehicle, the user is given a third type of visual assistance.
- the specific principle is as follows: when the current backlight sensor detects that the ambient light is lower than the set value, the processor chip determines that the user is in a dark environment such as a tunnel, an underground road or a black sky, and the processing chip turns the front and rear indicator LEDs to blink.
- the reminder and the voice prompt module are used to inform the user that the user is currently in a dark environment, and the prompt module is turned off after the real-time detection of the light sensor data rises to a preset value for a preset period of time.
- any light sensor detects that the light intensity has changed to a set state within a preset time, The equipment will automatically open the camera module to shoot the road conditions.
- the processing chip can determine whether the light intensity changes to hardware facilities (such as entering tunnels, underground tunnels, foreign objects, etc.) or non-hardware facilities changes (vehicles, etc.). If the hardware facility changes, the location indication module prompts the location, if it is changed for non-hardware facilities, it is considered as the vehicle exchange, analyzes the data source and the intensity change, determines the location of the vehicle and infers the approximate distance, and captures through the camera module. The image, the vibrating reminder plus the voice prompts the user to dodge the direction and how to avoid it. Because there are light sensors in front and back, you can judge the direction of the car.
- hardware facilities such as entering tunnels, underground tunnels, foreign objects, etc.
- non-hardware facilities changes vehicle exchange
- the algorithm of light intensity change per unit time it can avoid the phenomenon that no front placement or angle offset can not be judged, and the light intensity sensor is real-time. Detection, if it is found that the light intensity is lower than a certain value for more than a certain period of time, it is considered to be blocked by foreign objects. At this time, it will also vibrate and voice reminder to prevent failure due to occlusion judgment.
- the camera module switch can be turned on, and the front light sensor tests the ambient light intensity to determine whether it is necessary to turn on the light source module to assist shooting, and then The camera module takes a picture and transmits the photo back to the processing chip.
- the processing chip compares the returned photo with the picture in the image library to determine the road condition in front of the user, for example, judging whether the red light or the green light is for the intersection, judging After the completion, the oscillator vibration prompt is controlled, and the user is prompted to make a voice prompt, and then the voice prompt module is used to guide the user to perform corresponding actions.
- the embodiment provides a visual aid device for integrating a camera module and a light sensor, including:
- a light sensor for detecting ambient light intensity data in real time
- a camera module 41 for capturing a video or image of a surrounding environment
- the processing chip 11 is configured to receive data of the photo sensor and the camera module 41, and after determining that the ambient light intensity continues to be higher than the first preset value for a set period of time, giving the user the first type of visual assistance. Including notifying the user that it is currently a daytime or a bright spot; and when determining that the ambient light intensity continues to be lower than the second preset value for a set period of time, giving the user a second visual aid, including notifying the user that it is currently black In the day or dark environment, or into the tunnel, etc.; and in the second visual aid process, further determining that the ambient light intensity continues to change for a certain period of time, the camera module 41 is activated.
- the light sensor includes a front light sensor 21 and a rear light sensor 51, which can sense light conditions in front of and behind the user and transmit signals to the processing chip 11; or the light sensor includes a front light sensor 21 and a rear
- the light sensor 51, the left light sensor, and the right sensor can sense the light in the front, rear, left, and right directions of the user and transmit the signal to the processing chip 11.
- the device further includes a light source module, and the light source includes a front light source module 22 and a rear light source module 52.
- the light source module uses an LED light to illuminate the road in a dark environment, and the auxiliary camera module 41 is photographed. .
- the device further includes a second switch 42 for manually opening and closing the camera module 41, for collecting image data of the surrounding environment at any time during the first visual assisting process and the second visual assisting process. And giving the user a fourth type of visual assistance based on image data of the surrounding environment and ambient light intensity, the fourth type of visual aid fusion being in the first visual aid process and the second visual aid process.
- the device further includes a prompting module, where the prompting module includes a voice prompting module 32, a front/back indicating LED 33 and an oscillator 34 connected to the processing chip 11 for controlling under the control of the processing chip 11.
- the first prompt is performed by the user in the first visual assisting process, and the oscillator 34 is used to cooperate with the voice prompt module 32 to notify the user that the user is currently in a daytime or bright environment, and can combine the camera module 41 to capture the result.
- the voice prompting module 32 provides voice guidance to the user to assist the user to walk; in the second visual assisting process, the second prompt is triggered by the indicator LED to alert the user around the crowd, thereby causing the passerby to pay attention and use
- the third visual assist process is accompanied by a third prompt, and the front light sensor 21 and/or the rear light source sensor 51 detect the change of the ambient light intensity to determine the vehicle, and the front light source module 22 is activated.
- the rear light source module 52 and the camera module 41 capture the surrounding road conditions, and remind the user through the oscillator 34 and combine the voice prompt mode 32 gives the user guide, which guide how to dodge the escape; fourth visual aid during the fourth accompanied prompts for user guidance by opening the camera module in conjunction with the light source module.
- FIG. 3 is a flow chart showing the operation mode of the optical sensor according to the embodiment of the present invention, showing the working process of the optical sensor, when the front light sensor 21 or the rear light sensor 51 of the device detects the ambient light data in real time. After that, the data is synchronously transmitted to the processing chip 11 of the device, and the processing chip 11 determines the change of the ambient light.
- the device When the ambient light continues to be lower than the preset value, the device turns on the front/rear indication LED 33, and performs a flashing warning around to make the surroundings
- the pedestrian can perform the dodge avoidance on the user; when the processing chip 11 detects the sudden change of the ambient light in the unit time, the processing chip 11 controls the camera module 41 to open, captures the road condition, and the captured road condition data is transmitted back to the processing chip 11, and the processing is performed.
- the chip 11 compares the road condition data returned by the camera module 41 with the image of the image library to determine the road condition.
- the front/rear indication LED 33 is turned on to flash the warning, if it is because of the non-facilities
- the change is determined by the data source and the change of the light intensity per unit time as having a car, then the processing chip 11 controls the oscillator 34 And prompting the car through the voice prompt module and combining the image of the camera module 41 to remind the user to dodge avoidance; if the processing chip 11 fails to compare the picture, the oscillator 34 is controlled to oscillate to remind the judgment to fail.
- FIG. 4 is a flow chart showing the operation mode of the camera module 41 according to the embodiment of the present invention.
- the processing chip 11 receives the signal and reads the light intensity information through the front light sensor 21 when the light intensity signal is used.
- the camera module 41 is opened to take a picture.
- the processing chip 11 controls to turn on the front light source module 22 and/or the rear light source module 52 and then turn on the camera module 41 to shoot.
- the camera module 41 transmits the captured image data to the processing chip 11, and the processing chip 11 makes a judgment by comparing the image returned by the camera module 41 with the image of the image library, and if the determination fails, the processing chip 11 controls.
- the oscillator 34 vibrates to alert the user to the result of the determination. If the determination is successful, the processing chip 11 controls the oscillator 34 to vibrate and communicates with the voice prompting module 32 to inform the user of the road condition.
- the processing chip 11 determines that the dark state is such as a tunnel, an underground passage or a night, and turns on the front indicator LED and/or the rear indicator LED to perform a flashing reminder when real time
- the front/back indicator LED 33 is turned off, and the device actively opens the camera module 41 to shoot the road condition, and the processing chip 11 can judge the light by comparing the image. Strong mutations for hardware facilities change before opening instructions The LED and/or the rear indicator LED prompts the user to position the vehicle.
- the embodiment of the invention can timely and effectively determine the road condition in front of the road/sidewalk/grass and so on, and can also remind the road condition, and can also judge the intersection or traffic light condition, and can detect the vibration of the vehicle before and after the vehicle through the built-in front and rear light sensing at night or inside the tunnel. And through the flashing front indicator LED and / or the rear indicator LED to remind the surrounding visually impaired personnel, not only can the user be reminded in real time, but also can indicate the surrounding warning, which provides a guarantee for the user's personal safety.
- the apparatus of this embodiment may be further divided into two modes: a light sensing mode and an imaging mode;
- the light sensing mode is a normally open state, that is, the light sensor is in a working state in the first type of visual aid, the second type of visual aid, the third type of visual aid, and the fourth type of visual aid, such as the current light sensor 21 and /
- the processing chip 11 can determine that the surrounding environment of the user is a weak state such as a tunnel, an underground road or a black sky state, and the front and rear indicator LEDs are turned on to perform a flashing reminder.
- the indication LED is turned off after a certain time below the set value.
- the processing chip 11 actively opens the camera module 41 to shoot the surrounding environment (for example, road conditions), and compares the images. It can be judged that the change of light intensity is caused by changes in hardware facilities (into tunnels, underpasses, foreign objects occlusion, etc.) or non-hardware facilities (vehicles, etc.), such as changing the indication position of LEDs for hardware facilities changes, such as non-hardware
- the change of the facility is determined as the vehicle travel, the data source and the light intensity change amount are analyzed, the approximate position of the vehicle position is determined, the vibration reminder or the voice prompts the user to dodge, and the image of the camera module 41 is used to remind the user to avoid the direction.
- the camera mode is the trigger mode, and the camera module 41 can be automatically triggered by the processing chip 11 as needed, or can be manually triggered according to the subjective needs of the user, thereby reducing the power consumption of the device.
- the user has a subjective need to determine the road condition (such as the need to determine the traffic signal, whether there is a blind road or whether there is an obstacle step, etc.)
- you can press the manual switch at this time, the front light sensor test environment
- the light intensity determines whether it is necessary to turn on the LED light source to assist the shooting, and then the camera module 41 takes a picture, and the photo is transmitted back to the processing chip 11.
- the processing chip 11 determines the situation of the front image by comparing the image library, for example, at the intersection.
- the red light is still green, and after the judgment is completed, the vibration of the control oscillator 34 prompts the user to make a voice prompt, and then the voice prompt module 32 reports the traffic light condition.
- the difference between this embodiment and the first embodiment is that the processing chip 11 is also connected with a GPS module.
- the present invention can be combined with the camera module 41 to more accurately confirm the real-time road condition and environmental facility change, and can be combined with the voice prompt module 32 to navigate the user, thereby ensuring the user's personal safety on the road and guiding the user to find. Going home, avoiding the situation that you can't get back home because you get lost.
- the apparatus further includes a clock chip, and the processing chip 11 is capable of collecting clock information and giving a voice announcement to the user based on the clock information, and determining whether it is day or night in conjunction with the clock information.
- the apparatus further includes a weather forecasting module that updates the weather forecast through a WIFI, a mobile communication network, etc., and the processing chip 11 can collect weather forecast information and provide the user with the weather forecast information.
- the weather broadcast of the weather combined with weather forecast information to determine whether it is sunny or cloudy.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Veterinary Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Vascular Medicine (AREA)
- Biomedical Technology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Human Computer Interaction (AREA)
- Ophthalmology & Optometry (AREA)
- Traffic Control Systems (AREA)
- Studio Devices (AREA)
- Mechanical Engineering (AREA)
- Indication In Cameras, And Counting Of Exposures (AREA)
- Emergency Alarm Devices (AREA)
Abstract
Description
Claims (10)
- 一种集成摄像头模组和光传感器的视觉辅助方法,其特征在于:包括如下步骤:a:利用光传感器实时侦测环境光强度数据,当侦测到的环境光强度在设定的一段时间内持续高于第一预设值后,给予使用者第一种视觉辅助;b:当侦测到的环境光强度在设定的一段时间内持续低于第二预设值时,给予使用者第二种视觉辅助;c:在第二种视觉辅助过程中,进一步侦测到环境光强度在一定时间内持续变化时,启动摄像头模组采集使用者周边环境的图像数据,并当根据所述周边环境的图像数据和环境光强度判定出有来往车辆时,给予使用者第三种视觉辅助。
- 根据权利要求1所述的集成摄像头模组和光传感器的视觉辅助方法,其特征在于:还包括:在第一种视觉辅助过程中和第二种视觉辅助过程中,使用者随时通过一手动开关开启摄像头模组采集周边环境的图像数据或者关闭摄像头模组;以及根据所述周边环境的图像数据和环境光强度给予使用者第四种视觉辅助,所述第四种视觉辅助融合在第一种视觉辅助过程中和第二种视觉辅助过程中。
- 根据权利要求2所述的集成摄像头模组和光传感器的视觉辅助方法,其特征在于:在所述第一种视觉辅助过程中伴有第一种提示,在第二种视觉辅助过程中伴有第二种提示,第三种视觉辅助过程中伴有第三种提示,第四种视觉辅助过程中伴有第四种提示,其中,所述第一种提示、第二种提示、第三种提示以及第四种提示采用语音提示、震动提示以及LED灯闪烁提示中的一种或几种。
- 一种集成摄像头模组和光传感器的视觉辅助装置,其特征在于:包括:至少一光传感器,用以实时侦测环境光强度数据;摄像头模组,用以拍摄周边环境的视频或图像;处理芯片,用于接收光传感器和摄像头模组的数据,并在判定出环境光强度在设定的一段时间内持续高于第一预设值后,给予使用者第一种视觉辅助;在判断出环境光强度在设定的一段时间内持续低于第二预设值时,给予使用者第二种视觉辅助;以及在第二种视觉辅助过程中,进一步判断出环境光强度在一定时间内持续变化时,启动摄像头模组采集使用者周边环境的图像数据,并当根据所述周边环境的图像数据和环境光强度判定出有来往车辆时,给予使用者第三种视觉辅助。
- 根据权利要求4所述的集成摄像头模组和光传感器的视觉辅助装置,其特征在于:所述装置还包括至少一位置指示模块,连接所述处理芯片,用以在处理芯片的控制下向周边环境中的人群指示使用者位置。
- 根据权利要求4所述的集成摄像头模组和光传感器的视觉辅助装置,其特征在于:所述装置还包括手动开启和关闭所述摄像头模组的第二开关,用于在第一种视觉辅助过程和第二种视觉辅助过程中随时采集周边环境的图像数据,并根据所述周边环境的图像数据和环境光强度给予使用者第四种视觉辅助,所述第四种视觉辅助融合在第一种视觉辅助过程中和第二种视觉辅助过程中。
- 根据权利要求6所述的集成摄像头模组和光传感器的视觉辅助装置,其特征在于:所述装置还包括提示模块,连接所述处理芯片,用以在处理芯片的控制下对使用者在所述第一种视觉辅助过程中进行第一种提示,在第二种视觉辅助过程中进行第二种提示,在第三种视觉辅助过程中进行第三种提示,在第四种视觉辅助过程中进行第四种提示,其中,所述第一种提示、第二种提示、第三种提示以及第四种提示采用语音提示、震动提示以及LED灯闪烁提示中的一种或几种。
- 根据权利要求4所述的集成摄像头模组和光传感器的视觉辅助装置,其特征在于:所述光传感器包括前置光传感器和后置光传感器,能够感应使用者前方及后方的光线情况并将信号传递给处理芯片;或者所述光传感器包括前置光传感器、后置光传感器、左方光传感器和右方光传感器,能够感应使用者前后左右方向的光线情况并将信号传递给处理芯片。
- 根据权利要求4所述的集成摄像头模组和光传感器的视觉辅助装置,其特征在于:所述装置还包括光源模块,所述光源包括前光源模块和/或后光源模块,用以在黑暗环境中照亮道路,辅助摄像头模组拍摄工作。
- 根据权利要求4-9任一项所述的集成摄像头模组和光传感器的视觉辅助装置,其特征在于:所述装置还包括连接所述处理芯片的GPS模组,用于定位使用者的地理位置,并将所述地理位置反馈至处理芯片,所述处理芯片结合所述地理位置以及所述摄像头模组拍摄的数据确认使用者周边环境,对使用者进行导航辅助。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020167017715A KR101708832B1 (ko) | 2014-06-30 | 2015-06-29 | 카메라 모듈 및 광센서를 통합하는 시각 보조방법 및 장치 |
US15/115,111 US20170007459A1 (en) | 2014-06-30 | 2015-06-29 | Vision aiding method and apparatus integrated with a camera module and a light sensor |
JP2016558300A JP6117451B1 (ja) | 2014-06-30 | 2015-06-29 | カメラモジュールと光センサとを一体化した視覚補助方法及び装置 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410304779.6 | 2014-06-30 | ||
CN201410304779.6A CN104065930B (zh) | 2014-06-30 | 2014-06-30 | 集成摄像头模组和光传感器的视觉辅助方法及装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2015131857A2 true WO2015131857A2 (zh) | 2015-09-11 |
WO2015131857A3 WO2015131857A3 (zh) | 2015-11-05 |
Family
ID=51553435
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2015/082633 WO2015131857A2 (zh) | 2014-06-30 | 2015-06-29 | 集成摄像头模组和光传感器的视觉辅助方法及装置 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20170007459A1 (zh) |
JP (1) | JP6117451B1 (zh) |
KR (1) | KR101708832B1 (zh) |
CN (1) | CN104065930B (zh) |
WO (1) | WO2015131857A2 (zh) |
Families Citing this family (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104065930B (zh) * | 2014-06-30 | 2017-07-07 | 青岛歌尔声学科技有限公司 | 集成摄像头模组和光传感器的视觉辅助方法及装置 |
TWI534013B (zh) * | 2015-01-28 | 2016-05-21 | All Ring Tech Co Ltd | Method and apparatus for viewing droplets |
CN104660912A (zh) * | 2015-03-18 | 2015-05-27 | 努比亚技术有限公司 | 拍摄方法及拍摄装置 |
CN105120191A (zh) * | 2015-07-31 | 2015-12-02 | 小米科技有限责任公司 | 视频录制方法和装置 |
DE102015219496A1 (de) * | 2015-10-08 | 2017-04-13 | Robert Bosch Gmbh | Verfahren zum Bestimmen der Funktionsfähigkeit eines Fahrerassistenzsystems eines Fahrzeugs, Vorrichtung, Fahrerassistenzsystem, Kraftfahrzeug |
CN105389880B (zh) * | 2015-12-25 | 2018-08-14 | 成都比善科技开发有限公司 | 多功能智能门禁系统的控制方法 |
CN105611172B (zh) * | 2016-02-25 | 2018-08-07 | 北京小米移动软件有限公司 | 倒计时拍照的提示方法及装置 |
JP6583121B2 (ja) * | 2016-04-21 | 2019-10-02 | 株式会社デンソー | 運転支援装置 |
CN106074095B (zh) * | 2016-05-26 | 2018-07-20 | 英华达(上海)科技有限公司 | 一种低视力者辅助设备及方法 |
CN107049719B (zh) * | 2017-06-12 | 2019-10-18 | 尚良仲毅(沈阳)高新科技有限公司 | 一种基于无人机的智能导盲警示方法及其系统 |
CN107948520A (zh) * | 2017-11-30 | 2018-04-20 | 广东欧珀移动通信有限公司 | 图像处理方法和装置 |
CN108277718B (zh) * | 2018-01-24 | 2019-10-29 | 北京铂阳顶荣光伏科技有限公司 | 一种太阳能盲道提醒系统及盲道 |
CN110901541A (zh) * | 2018-09-14 | 2020-03-24 | 上海擎感智能科技有限公司 | 设有摄像头辅视系统的车机 |
CN109819168B (zh) * | 2019-01-31 | 2020-09-01 | 维沃移动通信有限公司 | 一种摄像头的启动方法以及移动终端 |
CN109938440A (zh) * | 2019-04-26 | 2019-06-28 | 贵州大学 | 一种交通安全警示安全帽 |
CN113628447B (zh) * | 2020-05-06 | 2022-12-23 | 杭州海康威视数字技术股份有限公司 | 远光灯开启检测方法、装置、设备及系统 |
CN112061027B (zh) * | 2020-07-30 | 2022-03-11 | 南京英锐创电子科技有限公司 | 车载报警系统、车载报警方法及计算机设备 |
CN113697004A (zh) * | 2021-08-30 | 2021-11-26 | 郑思志 | 一种基于ai的视听障碍患者出行辅助小车 |
US20230209206A1 (en) * | 2021-12-28 | 2023-06-29 | Rivian Ip Holdings, Llc | Vehicle camera dynamics |
CN115100750B (zh) * | 2022-06-10 | 2024-02-02 | 广西云高智能停车设备有限公司 | 一种基于互联网线上合作的路内停车数据采集方法 |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS61345A (ja) * | 1984-06-13 | 1986-01-06 | 益金 俊夫 | 視障者用方位兼照度センサ |
US6587573B1 (en) * | 2000-03-20 | 2003-07-01 | Gentex Corporation | System for controlling exterior vehicle lights |
JP2001319288A (ja) * | 2000-05-10 | 2001-11-16 | Isamu Miya | 視覚障害者援助システム |
JP2002024985A (ja) * | 2000-07-03 | 2002-01-25 | Teiichiro Watanabe | 盲人誘導装置 |
US6867697B2 (en) * | 2002-04-01 | 2005-03-15 | Pravin L. Nanayakkara | System for guiding the visually handicapped |
US6774788B1 (en) * | 2002-10-07 | 2004-08-10 | Thomas J. Balfe | Navigation device for use by the visually impaired |
JP2005000501A (ja) * | 2003-06-13 | 2005-01-06 | Yaskawa Electric Corp | 視覚障害者用誘導装置 |
US20070085993A1 (en) * | 2005-10-17 | 2007-04-19 | Brown Robert Jr | Audible distance measurer-object discriminator cognition stimulant system device |
CN101227539B (zh) * | 2007-01-18 | 2010-09-29 | 联想移动通信科技有限公司 | 导盲手机及导盲方法 |
JP2009025071A (ja) * | 2007-07-18 | 2009-02-05 | Funai Electric Co Ltd | ナビゲーション装置 |
KR20090047944A (ko) * | 2007-11-09 | 2009-05-13 | (주)엠에스 엔지니어링 | 음성 안내장치 |
US8331628B2 (en) * | 2008-12-08 | 2012-12-11 | Georgios Stylianou | Vision assistance using mobile telephone |
KR101115415B1 (ko) * | 2010-01-11 | 2012-02-15 | 한국표준과학연구원 | 시각장애인용 안내 시스템 및 그를 이용한 안내방법 |
CN101986673A (zh) * | 2010-09-03 | 2011-03-16 | 浙江大学 | 一种智能手机导盲器及导盲方法 |
CN102293709B (zh) * | 2011-06-10 | 2013-02-27 | 深圳典邦科技有限公司 | 一种智能导盲装置 |
CN102231797A (zh) * | 2011-06-22 | 2011-11-02 | 深圳中兴力维技术有限公司 | 日夜摄像装置、用于日夜摄像装置的日夜切换方法 |
CN102389362A (zh) * | 2011-07-28 | 2012-03-28 | 张华昱 | 一种图像超声波导盲系统装置 |
CN102413241A (zh) * | 2011-11-18 | 2012-04-11 | 上海华勤通讯技术有限公司 | 移动终端和环境明暗程度提醒方法 |
WO2013090273A1 (en) * | 2011-12-11 | 2013-06-20 | Technical Vision, Inc. | Illuminated mobility enhancing device |
US9062986B1 (en) * | 2013-05-07 | 2015-06-23 | Christ G. Ellis | Guided movement platforms |
CN203400301U (zh) * | 2013-07-12 | 2014-01-22 | 宁波大红鹰学院 | 一种导盲棒 |
US9140554B2 (en) * | 2014-01-24 | 2015-09-22 | Microsoft Technology Licensing, Llc | Audio navigation assistance |
CN104065930B (zh) * | 2014-06-30 | 2017-07-07 | 青岛歌尔声学科技有限公司 | 集成摄像头模组和光传感器的视觉辅助方法及装置 |
-
2014
- 2014-06-30 CN CN201410304779.6A patent/CN104065930B/zh active Active
-
2015
- 2015-06-29 KR KR1020167017715A patent/KR101708832B1/ko active IP Right Grant
- 2015-06-29 JP JP2016558300A patent/JP6117451B1/ja active Active
- 2015-06-29 US US15/115,111 patent/US20170007459A1/en not_active Abandoned
- 2015-06-29 WO PCT/CN2015/082633 patent/WO2015131857A2/zh active Application Filing
Also Published As
Publication number | Publication date |
---|---|
WO2015131857A3 (zh) | 2015-11-05 |
KR101708832B1 (ko) | 2017-02-21 |
US20170007459A1 (en) | 2017-01-12 |
JP2017513118A (ja) | 2017-05-25 |
CN104065930B (zh) | 2017-07-07 |
CN104065930A (zh) | 2014-09-24 |
KR20160085370A (ko) | 2016-07-15 |
JP6117451B1 (ja) | 2017-04-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2015131857A2 (zh) | 集成摄像头模组和光传感器的视觉辅助方法及装置 | |
JP5171629B2 (ja) | 走行情報提供装置 | |
CN112289003B (zh) | 疲劳驾驶不端驾驶行为监测方法及主动安全驾驶监控系统 | |
US11130502B2 (en) | Method for assisting a driver with regard to traffic-situation-relevant objects and motor vehicle | |
KR20160003715U (ko) | 우회전 교통사고 예방 시스템 | |
CN104627076A (zh) | 一种汽车防撞预警系统及汽车 | |
JP2008013070A (ja) | 車両用表示装置 | |
WO2018150676A1 (ja) | 運転切替支援装置、及び運転切替支援方法 | |
KR20120074820A (ko) | 얼굴 인식 기능을 이용한 차량 제어 시스템 | |
JP4337130B2 (ja) | 運転装置の制御装置 | |
WO2020151560A1 (zh) | 一种车辆盲区检测方法、装置和系统 | |
JP2000351337A (ja) | 移動体制御装置 | |
CN105572869A (zh) | 智能眼镜及智能眼镜控制方法 | |
KR100811499B1 (ko) | 자동차의 차선이탈경보 장치 및 그 방법 | |
KR101475453B1 (ko) | 무단 횡단 감지 시스템 | |
US11807264B2 (en) | Driving assistance apparatus, driving assistance method, and medium | |
WO2023010911A1 (zh) | 一种驾驶员昏迷处理方法、装置及可读存储介质 | |
KR20180063643A (ko) | 스마트 횡단보도 제어 시스템 | |
KR20190030316A (ko) | 이벤트 영상기록이 가능한 횡단보도 조명시스템 | |
KR102072910B1 (ko) | 졸음 인식 장치를 이용한 졸음 인식 방법 | |
KR20180032017A (ko) | 운전자의 위험물체 인지를 위한 조명 제어 장치 및 방법 | |
JP2004172828A (ja) | 車両用暗視装置 | |
JP5182567B2 (ja) | 乗員監視装置 | |
JP6880615B2 (ja) | ドライバ状態判定装置及び運転支援システム | |
CN209785249U (zh) | 一种视障人士过路警示系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 20167017715 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15115111 Country of ref document: US |
|
ENP | Entry into the national phase |
Ref document number: 2016558300 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 15757993 Country of ref document: EP Kind code of ref document: A2 |