KR20200067447A - Monitoring system and operating method thereof - Google Patents

Abstract

The present invention relates to a monitoring system for monitoring the appearance of an object around a vehicle, storing an object when an event occurs, and transmitting it to a user terminal, and a method for operating the same.
The monitoring system according to an embodiment of the present invention includes a first sub-device that detects the appearance of an object around a vehicle and starts an operation by receiving a first wake-up signal from the first sub-device to track the object and track the object. It includes a second sub-device for counting the appearance time of the, and a main device for capturing and storing an object by starting an operation by receiving a second wake-up signal from the second sub-device.

Description

MONITORING SYSTEM AND OPERATING METHOD THEREOF}

The present invention relates to a monitoring system for monitoring the appearance of an object around a vehicle, storing an object when an event occurs, and transmitting it to a user terminal, and a method for operating the same.

In general, a black box is implemented in a way that a video is captured and stored when a shock or movement around the vehicle is detected while parking. The recently developed black box uses a radar or a lidar to detect a specific distance, and when it comes within a certain distance, it uses a method of capturing and storing an image in the black box.

The above-mentioned background art is technical information acquired by the inventor for the derivation of the present invention or acquired in the derivation process of the present invention, and is not necessarily a known technology disclosed to the general public prior to the filing of the present invention.

Domestic Patent Publication No. 2015-0029139

The present invention has been devised to solve the above-mentioned problems and/or limitations, and an object of the present invention according to an aspect is to manage a vehicle using a detection unit such as a radar or a lidar, and detect an external hazard in advance to notify the driver. Is doing.

In addition, the existing radar or lidar detection or motion detection is that the camera is operated frequently when the road is used by a lot of people, so the vehicle battery is quickly exhausted, but the object of the present invention according to another aspect is to operate the camera when suspicious behavior is detected to display an image. The aim is to reduce battery consumption by shooting.

A monitoring system according to an embodiment of the present invention includes a first sub-device for detecting the appearance of an object around a vehicle; A second sub-device that starts an operation by receiving a first wake-up signal from the first sub-device, tracks the object, and counts the appearance time of the object; And a main device that starts an operation by receiving a second wake-up signal from the second sub-device and captures and stores the object.

The first sub-device may generate the first wake-up signal and transmit it to the second sub-device when an object appears around the vehicle.

The second sub-device may generate the second wake-up signal and transmit it to the main device when the tracking result of the object and the result of counting the appearance time of the object satisfy the event generation condition.

The main device may transmit an image of the object photographed by initiating an operation by the second wake-up signal to a user terminal.

A method of operating a monitoring system according to an embodiment of the present invention includes: detecting, by a first sub-device, the appearance of an object around a vehicle; Starting an operation by receiving a first wake-up signal from the first sub-device by the second sub-device, tracking the object, and counting the appearance time of the object; And initiating an operation by receiving a second wake-up signal from the second sub-device, and photographing and storing the object.

The method may further include generating, by the first sub-device, the first wake-up signal when an object appears around the vehicle and transmitting the first wake-up signal to the second sub-device.

The method includes generating, by the second sub-device, the second wake-up signal when the tracking result of the object and the result of counting the appearance time of the object satisfy an event generation condition and transmitting the second wake-up signal to the main device; It may further include.

In the above method, the main device may further include a step of initiating an operation by the second wake-up signal and transmitting the captured image of the object to a user terminal.

In addition to this, other methods for implementing the present invention, other systems, and computer programs for executing the methods may be further provided.

Other aspects, features, and advantages other than those described above will become apparent from the following drawings, claims, and detailed description of the invention.

According to embodiments, the vehicle may be managed using a detection unit such as a radar or a lidar, and an external hazard may be detected in advance to notify the driver.

In addition, if suspicious behavior is detected, the camera can be operated to take images to reduce battery consumption.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a view schematically illustrating a monitoring system according to an embodiment of the present invention.
FIG. 2 is a diagram for schematically explaining an event occurrence condition initiating the operation of the main device in the personal monitoring system of FIG. 1.
FIG. 3 is a diagram schematically illustrating a battery consumption used in each device in the monitoring system of FIG. 1.
4 is a flowchart illustrating a method of operating a monitoring system according to an embodiment of the present invention.

Advantages and features of the present invention, and methods for achieving them will be clarified with reference to embodiments described in detail with reference to the accompanying drawings. However, the present invention is not limited to the embodiments presented below, but may be implemented in various different forms, and should be understood to include all transformations, equivalents, and substitutes included in the spirit and scope of the present invention. . The embodiments presented below are provided to make the disclosure of the present invention complete and to fully inform the scope of the invention to those skilled in the art to which the present invention pertains. In the description of the present invention, when it is determined that detailed descriptions of related known technologies may obscure the subject matter of the present invention, detailed descriptions thereof will be omitted.

Terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, terms such as “include” or “have” are intended to indicate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, one or more other features. It should be understood that the existence or addition possibilities of fields or numbers, steps, operations, components, parts or combinations thereof are not excluded in advance. Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from other components.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings, and in describing with reference to the accompanying drawings, identical or corresponding components are assigned the same reference numbers, and overlapping descriptions thereof are omitted. I will do it.

1 is a view schematically illustrating a monitoring system according to an embodiment of the present invention. Referring to FIG. 1, the monitoring system 1 may include a first sub device 100, a second sub device 200 and a main device 300.

The first sub-device 100 may detect the appearance of an object around the vehicle. As an example, the first sub-device 100 may include a laser sensor (not shown) or a radar sensor (not shown) or a lidar device (not shown). Laser sensors are used in a variety of fields, are often used in security systems, and are also used to measure the position and direction of moving objects on assembly lines. In addition, the laser sensor is also used to measure the distance from the sensor to the object, it is possible to obtain information such as whether or not the object exists, the distance if it exists. The laser sensor is used in various fields such as home/building security, government/cultural property intrusion monitoring, invisible fences in public facilities such as subways, construction surveying, etc., and is recently installed in vehicles to sense the driving environment (roads, other vehicles, etc.) It is used in light detection and ranging (LIDAR) devices. The radar sensor can measure the distance, direction, and altitude of an object by transmitting electromagnetic waves of about a microwave (microwave, 10cm-100cm wavelength) to an object and receiving electromagnetic waves reflected from the object.

The lidar device measures the time (i.e., flight time: time of flight) from the time the laser starts from the light source from the light emitting unit (not shown) to reflecting on the object and entering the receiver (not shown). Distance can be calculated, and the precision of the sensor may vary depending on how accurately the receiver measures the flight time. In addition, when the object is located at a long distance or the reflection coefficient is very small, the intensity of the laser reflected on the object and incident on the receiving part is weak, so an error may occur in the measurement distance between the object and the sensor depending on the difference in the reflection coefficient of the object. These errors must be eliminated in areas that require high reliability, such as lidar devices applied to vehicles.

The second sub-device 200 starts an operation by receiving the first wake-up signal from the first sub-device 100, tracks the object, and counts, for example, an object appearance time. It can contain. Here, the first wake-up signal may include a signal generated by the first sub-device 100 and transmitted to the second sub-device 200 when an object appears. For example, the first sub-device 100 transmits a detection signal to the second sub-device 200 regardless of whether or not an object is present. The detection signal when the object does not appear and when the object appears Since the detection signals (the first wake-up signal) are different from each other, the second sub-device 200 may detect whether an object appears from the detection signal from the first sub-device 100 and start an operation. The second sub-device 200 normally waits for operation in a sleep mode, and when the first wake-up signal is received from the first sub-device 100, the second sub-device 200 is converted into an active mode to track the object, and the appearance time of the object Can count.

The main device 300 initiates an operation by receiving a second wake-up signal from the second sub-device 200, photographs and stores an object, or transmits an object photographed image to a user terminal through a communication network (not shown). The user can recognize the situation around his vehicle. Here, the second wake-up signal may include a signal generated by the second sub-device 200 and transmitted to the main device 300 when the tracking result of the object and the result of counting the occurrence time of the object satisfy the event generation condition. .

In the present embodiment, when the event generation condition is satisfied, it may include a case in which the movement of the object continues for a predetermined time within a predetermined distance around the vehicle, and in such a case, there may be a risk of vehicle theft. In addition, when the event generation condition is satisfied, it may include a case in which an object enters within a predetermined distance around the vehicle and does not move for a predetermined time, and in such a case, there may be a danger that a dangerous object exists around the vehicle. In addition, when the event generation condition is satisfied, it may include a case in which an additional object moves after the object enters very close to the vehicle, and such a case may include a case where the driver descends after a contact accident. . In addition, when the event generation condition is satisfied, it may include a case where an object rapidly approaches the vehicle and suddenly stops, and such a case may include a collision with the vehicle. When the second wake-up signal is received from the second sub-device 200, the main device 300 normally waits for operation in a sleep mode, and then converts to an activation mode to capture and store an object, or to record an object shooting image. It can be transmitted to a user terminal through a communication network.

In the present embodiment, the main device 300 may include a main control unit 310, a camera 320, a memory 330, and a communication unit 340.

The main control unit 310 operates the main device 300 in a sleep mode, and when the second wake-up signal is received from the second sub device 200, operates the main device 300 in an active mode, and the camera 320 , It is possible to control the operation of the memory 330 and the communication unit 340.

The main control unit 310 may provide various functions by driving control software mounted in an internal memory (not shown) as a kind of central processing unit. The main control unit 310 may mean, for example, a data processing device embedded in hardware having physically structured circuits to perform functions represented by codes or instructions included in a program. As an example of such a data processing device embedded in hardware, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, and an application-specific integrated ASIC circuit), a field programmable gate array (FPGA), and the like, but the scope of the present invention is not limited thereto.

The camera 320 may include one or more cameras disposed at the top, bottom, left, and right to operate under the control of the main control unit 310 to capture an image of the vehicle surroundings. Here, the camera 320 may photograph a subject in a photographing area using, for example, a complementary metal-oxide semiconductor (COMS) module (not shown) or a charge coupled device (CCD) module (not shown), and an input image frame It is provided as a COMS module or a CCD module through a silver lens (not shown), and the COMS module or the CCD module converts and outputs an optical signal of an object passing through the lens into an electrical signal. An image signal processing unit (not shown) is provided inside the camera 320 to reduce noise in a captured image frame, gamma correction, color filter array interpolation, and color. Image signal processing for image quality improvement such as color matrix, color correction, and color enhancement may be performed. In addition, the image signal processing unit may perform color processing, blur processing, edge emphasis processing, image analysis processing, image recognition processing, image effect processing, and the like functionally. Face recognition, scene recognition processing, and the like can be performed by the image recognition processing. For example, brightness level adjustment, color correction, contrast adjustment, outline enhancement adjustment, screen division processing, character image generation, and image synthesis processing may be performed.

The memory 330 may operate under the control of the main control unit 310 to store or output an object image captured by the camera 320. The memory 330 may include internal memory and/or external memory, volatile memory such as DRAM, SRAM, or SDRAM, one time programmable ROM (OTPROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, Non-volatile memory, SSD, such as NAND flash memory, or NOR flash memory. It may include a compact flash (CF) card, an SD card, a Micro-SD card, a Mini-SD card, an Xd card, a flash drive such as a memory stick, or a storage device such as an HDD.

The communication unit 340 may provide a communication interface necessary for providing an object image photographed by the main device 300 to a user terminal in cooperation with a communication network. Here, the communication network may mean a communication network that provides a connection path so that the main device 300 can transmit and receive predetermined information after accessing the user terminal. Communication networks include, for example, wired networks such as Local Area Networks (LANs), Wide Area Networks (WANs), Metropolitan Area Networks (MANs), and Integrated Service Digital Networks (ISDNs), and wireless networks such as wireless LANs, CDMA, Bluetooth, and satellite communications. However, the scope of the present invention is not limited thereto. In addition, the communication network 500 may transmit and receive information using short-range communication and/or long-distance communication. Here, the short-range communication may include Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra-wideband (UWB), ZigBee, Wi-Fi (wireless fidelity) technology, and remote Communications include code division multiple access (CDMA), frequency division multiple access (FDMA), time division multiple access (TDMA), orthogonal frequency division multiple access (OFDMA), and single carrier frequency division multiple access (SC-FDMA) technology. Can be.

In addition, the main device 300 initiates an operation at the request of the user terminal through the communication unit 340 to randomly start a vehicle surrounding image taken by the main device 300 or an object captured image stored in the memory 330 of the user terminal You can also send to When receiving the request signal of the user terminal, the first sub-device 100 and the second sub-device 200 may maintain a sleep mode state and only the main device 300 may be in an activation mode state.

In the present embodiment, the user terminal is not illustrated, but a desktop computer, a smart phone, a laptop, a tablet PC, a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a micro server, operated by the user, It may be a global positioning system (GPS) device, an electronic book terminal, a terminal for digital broadcasting, navigation, a kiosk, an MP3 player, a digital camera, a home appliance, and other mobile or non-mobile computing devices, but is not limited thereto. Further, the user terminal may be a wearable terminal such as a watch, glasses, hair band, and ring equipped with a communication function and a data processing function. The user terminal is not limited to the above, and a terminal capable of web browsing can be borrowed without limitation. In this embodiment, the user terminal may be equipped with an application and/or program for controlling the monitoring system 1.

As an optional embodiment, the second sub-device 200 may enter the sleep mode when the first wake-up signal is not received from the first sub-device 100 for a predetermined time, and the main device 300 may include the second sub-device ( If the second wake-up signal from 200) has not been received for a certain time, it may enter the sleep mode.

FIG. 2 is a diagram for schematically explaining an event occurrence condition initiating the operation of the main device in the personal monitoring system of FIG. 1. Referring to FIG. 2A, when an object enters within a predetermined distance around a vehicle as a result of tracking an object of the second sub-device 200 and a movement occurs around the vehicle for a predetermined time or more, the second sub-device 200 is activated at a certain time. The second wake-up signal is generated and transmitted to the main device 300, and the main device 300 starts an operation in response to the second wake-up reception to perform image capture, storage, and/or transmission. Referring to FIG. 2B, as a result of tracking an object of the second sub-device 200, an object may be moved very close to a vehicle, and then a movement of an additional object may occur. In such a case, the driver descends after a contact accident It may include cases. In this case, when the additional object is detected, the second sub-device 200 generates a second wake-up signal and transmits it to the main device 300, and the main device 300 operates in response to the second wake-up reception. Initiation can be performed for image capture, storage and/or transmission.

FIG. 3 is a view schematically illustrating a battery consumption used in each device in the monitoring system of FIG. 1. Referring to FIG. 3, only the first sub-device 100 of the monitoring system 1 may start an operation to monitor the vehicle surroundings (monitoring step). When the first sub-device 100 detects the appearance of an object, the first wake-up signal is transmitted to the second sub-device 200 so that the second sub-device 200 starts operation, tracks the object, and counts the time It can be done (object tracking step). When the event generation condition is satisfied as a result of tracking the object of the second sub-device 200, the second wake-up signal is transmitted to the main device 300, the main device 300 starts an operation, and photographs, stores and/or captures an object image. Or it can be transmitted (image storage step). From FIG. 3, the battery consumption can be known in the order of the monitoring step, the object tracking step, and the image storage step. Since the operation of the main device 300 is started and the image is captured only when the event generation condition is satisfied, battery consumption can be reduced. .

4 is a flowchart illustrating a method of operating a monitoring system according to an embodiment of the present invention. In the following description, portions overlapping with those of FIGS. 1 to 3 will be omitted.

Referring to FIG. 4, in step S410, the first sub-device 100 monitors the appearance of objects around the vehicle. Here, the first sub-device 100 may include a radar sensor or a lidar device. Here, only the first sub device 100 is operating, and the second sub device 200 and the main device 300 are in a sleep mode.

In operation S420, when an object appears around the vehicle, the first sub-device 100 generates a first wake-up signal and transmits it to the second sub-device 200.

In step S430, the second sub-device 200 starts operation when the first wake-up signal is received from the first sub-device 100.

In step S440, the second sub-device 200 tracks the object around the vehicle and counts the time.

In step S450, when the event generation condition is satisfied, the second sub-device 200 generates a first wake-up signal and transmits it to the main device 300. In the present embodiment, when the event generation condition is satisfied, it may include a case in which the movement of the object continues for a predetermined time within a predetermined distance around the vehicle, and in such a case, there may be a risk of vehicle theft. In addition, when the event generation condition is satisfied, it may include a case in which an object enters within a predetermined distance around the vehicle and does not move for a predetermined time, and in such a case, there may be a danger that a dangerous object exists around the vehicle. In addition, when the event generation condition is satisfied, it may include a case in which an additional object moves after the object enters very close to the vehicle, and such a case may include a case where the driver descends after a contact accident. . In addition, when the event generation condition is satisfied, it may include a case where an object rapidly approaches the vehicle and suddenly stops, and such a case may include a collision with the vehicle.

In step S460, the main device 300 starts operation when the second wake-up signal is received from the second sub-device 200.

In step S470, the main device 300 photographs and stores the object image, or transmits the object image to the user terminal.

The embodiment according to the present invention described above may be implemented in the form of a computer program that can be executed through various components on a computer, and such a computer program can be recorded on a computer-readable medium. At this time, the medium is a hard disk, a magnetic medium such as a floppy disk and a magnetic tape, an optical recording medium such as a CD-ROM and DVD, a magneto-optical medium such as a floptical disk, and a ROM , Hardware devices specially configured to store and execute program instructions, such as RAM, flash memory, and the like.

Meanwhile, the computer program may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software field. Examples of computer programs may include not only machine language codes produced by a compiler, but also high-level language codes executable by a computer using an interpreter or the like.

The use of the term "above" in the specification (particularly in the claims) of the present invention and similar indication terms may be in both singular and plural. In addition, in the case of describing a range in the present invention, as including the invention to which the individual values belonging to the range are applied (if there is no contrary description), each individual value constituting the range is described in the detailed description of the invention. Same as

Unless explicitly stated or contrary to the steps constituting the method according to the invention, the steps can be done in a suitable order. The present invention is not necessarily limited to the description order of the above steps. The use of all examples or exemplary terms (eg, etc.) in the present invention is merely for describing the present invention in detail, and the scope of the present invention is limited due to the examples or exemplary terms, unless it is defined by the claims. It does not work. In addition, those skilled in the art can recognize that various modifications, combinations, and changes can be configured according to design conditions and factors within the scope of the appended claims or equivalents thereof.

Accordingly, the spirit of the present invention is not limited to the above-described embodiments, and should not be determined, and the scope of the spirit of the present invention, as well as the claims to be described later, and all ranges that are equivalent to or equivalently changed from the claims Would belong to

1: Monitoring system
100: first sub-device
200: second sub-device
300: main device

Claims (9)

A first sub-device for detecting the appearance of objects around the vehicle;
A second sub-device that starts an operation by receiving a first wake-up signal from the first sub-device, tracks the object, and counts the appearance time of the object; And
And a main device that starts an operation by receiving a second wake-up signal from the second sub-device and captures and stores the object. The method of claim 1, wherein the first sub-device,
When an object appears around the vehicle, the monitoring system generates and transmits the first wake-up signal to the second sub-device. The method of claim 1, wherein the second sub-device,
When the tracking result of the object and the result of counting the appearance time of the object satisfy an event generation condition, the second wake-up signal is generated and transmitted to the main device. The method of claim 1, wherein the main device,
A monitoring system for transmitting an image of the object photographed by initiating an operation by the second wake-up signal to a user terminal. Detecting, by the first sub-device, the appearance of objects around the vehicle;
Starting an operation by receiving a first wake-up signal from the first sub-device by the second sub-device, tracking the object, and counting the appearance time of the object; And
And initiating an operation by receiving a second wake-up signal from the second sub-device, and photographing and storing the object. The method of claim 5,
And generating, by the first sub-device, the first wake-up signal when an object appears around the vehicle and transmitting the first wake-up signal to the second sub-device. The method of claim 5,
And generating, by the second sub-device, the second wake-up signal and transmitting it to the main device when the tracking result of the object and the result of counting the appearance time of the object satisfy the event generation condition. , How the monitoring system works. The method of claim 5,
The main device further comprising the step of initiating an operation by the second wake-up signal and transmitting an image of the object to the user terminal. A computer program stored in a computer-readable recording medium to execute the method of any one of claims 5 to 8 using a computer.

Images