JP6862217B2 - Dangerous goods detection method - Google Patents

Description

Embodiment relates dangerous object detection method.

There is known a technique for detecting dangerous objects such as firearms and cutlery that cannot be seen from the outside by a person putting them in clothes. For example, there is known a technique for detecting a dangerous substance by irradiating the human body and receiving the reflected millimeter wave. In addition, a technique for detecting a dangerous substance by receiving millimeter waves emitted by the human body is known.

Special Table 2007-502415 Japanese Unexamined Patent Publication No. 2003-318649

However, in order to receive the millimeter wave from the entire surface of the human body, it is necessary to scan the millimeter wave on the human body, so that there is a problem that the dangerous substance detection device is complicated by the scanning mechanism.

In order to solve the above-mentioned problems and achieve the object, the dangerous substance detection method of the embodiment is provided around an inclined passage inclined with respect to the vertical direction, arranged in the first direction, and receives millimeter waves. A scanning step of scanning a plurality of first receiving antennas in a direction intersecting the vertical direction, and an image generation step of generating a first image by millimeter waves received by the plurality of first receiving antennas during scanning. In the scanning stage, a plurality of second receiving antennas provided around the inclined passage, arranged in a direction intersecting the first direction, and receiving millimeter waves are provided together with the plurality of first receiving antennas. Scanning is performed in a direction intersecting the vertical direction, and in the image generation stage, the first image by the millimeter wave received by the plurality of first receiving antennas during scanning and the millimeter received by the plurality of second receiving antennas. A composite image is generated by synthesizing the second image by the wave.

FIG. 1 is an overall view of a dangerous goods detection system including the dangerous goods detection device of the first embodiment. FIG. 2 is an overall perspective view of the dangerous substance detection device. FIG. 3 is a block diagram showing an electrical configuration of the dangerous substance detection device. FIG. 4 is a block diagram showing a configuration of a radar signal processing circuit. FIG. 5 is a diagram illustrating the generation of a composite image by the composite processing unit. FIG. 6 is a flowchart of the dangerous substance detection process executed by the control unit of the dangerous substance detection device of the first embodiment. FIG. 7 is a front view of a person explaining a scanning range by machine scanning. FIG. 8 is a block diagram showing an electrical configuration of the dangerous goods detection device of the second embodiment. FIG. 9 is a flowchart of the dangerous substance detection process executed by the control unit of the dangerous substance detection device of the second embodiment. FIG. 10 is an overall configuration diagram of the dangerous goods detection system of the third embodiment. FIG. 11 is an overall configuration diagram of the dangerous goods detection system of the fourth embodiment. FIG. 12 is a block diagram showing an electrical configuration of the dangerous goods detection device according to the fifth embodiment. FIG. 13 is an overall perspective view of the dangerous goods detection device of the sixth embodiment.

Similar components are included in the following exemplary embodiments and modifications. Therefore, in the following, similar components are given a common reference numeral, and duplicate explanations are partially omitted. The portion included in the embodiment or the modification can be configured by replacing the corresponding portion of the other embodiment or the modification. Further, the configuration and position of the portion included in the embodiment and the modified example are the same as those of the other embodiments and the modified example unless otherwise specified.

<First Embodiment>
FIG. 1 is an overall view of the dangerous goods detection system 10 including the dangerous goods detection devices 12A and 12B of the first embodiment.

As shown in FIG. 1, the dangerous goods detection devices 12A and 12B of the dangerous goods detection system 10 are installed around the escalator 90, and the danger of firearms, cutlery, etc. possessed by the person 92 moving on the escalator 90. Detect an object. The escalator 90 is an example of an inclined passage inclined with respect to the vertical direction. The escalator 90 moves the person 92 from below to above.

The dangerous substance detection device 12A is installed, for example, in the traveling direction of the exit of the escalator 90. The location of the dangerous goods detection device 12A may be directed to the front of the person 92 (for example, the person 92a near the exit of the escalator 90) in which the dangerous goods detection device 12A is moving by the escalator 90. Therefore, the dangerous goods detection device 12A may be arranged at a position in the vertical plane including the escalator 90 or in the vicinity of the vertical plane, and may be oriented substantially along the direction opposite to the traveling direction.

The dangerous goods detection device 12B is installed, for example, in the traveling direction of the entrance of the escalator 90. The installation location of the dangerous goods detection device 12B may be directed to the rear surface of the person 92 (for example, the person 92b near the entrance of the escalator 90) in which the dangerous goods detection device 12B is moving by the escalator 90. Therefore, the dangerous goods detection device 12B may be arranged at a position in the vertical plane including the escalator 90 or in the vicinity of the vertical plane, and may be oriented substantially along the traveling direction.

When it is not necessary to distinguish between the dangerous goods detection devices 12A and 12B, it is described as the dangerous goods detection device 12.

FIG. 2 is an overall perspective view of the dangerous substance detection device 12. As shown in FIG. 2, the dangerous goods detection device 12 includes a storage case 20, a first millimeter wave module 22a, a second millimeter wave module 22b, a laser pointer 24, a holding member 26, casters 28, and an adjuster. It includes 30, a drive unit 32, a driver 34, an information processing device 36, a display unit 37, an input unit 38, and a power supply 39.

The storage case 20 is formed in a hollow rectangular parallelepiped shape. The accommodation case 20 accommodates and holds the first millimeter wave module 22a, the second millimeter wave module 22b, and the laser pointer 24. The upper surface of the storage case 20 is preferably at a height of about 1500 mm from the ground.

The first millimeter wave module 22a is an active millimeter wave module that transmits millimeter waves. The first millimeter wave module 22a transmits a millimeter wave to the person 92 to be searched, and receives the millimeter wave reflected from the inside of the clothes of the person 92 or the like. As a result, the first millimeter wave module 22a generates an image for detecting a dangerous object possessed by the person 92 inside the clothes based on the received millimeter wave. The first millimeter wave module 22a has a plurality of (for example, two) transmitting antennas 40a and a plurality of (for example, four) receiving antennas 42a.

The plurality of transmitting antennas 40a transmit millimeter waves. The plurality of transmitting antennas 40a of the dangerous goods detection device 12A are directed to the front surface of the moving person 92a by the escalator 90 to be searched. The plurality of transmitting antennas 40a of the dangerous goods detection device 12B are directed to the rear surface of the moving person 92b by the escalator 90 to be searched.

The plurality of receiving antennas 42a receive millimeter waves transmitted by the plurality of transmitting antennas 40a. The plurality of receiving antennas 42a are arranged in the horizontal direction, which is an example of the first direction, and are directed to the escalator 90. Here, one direction in which the plurality of receiving antennas 42a of the dangerous goods detection device 12A are directed is different from the direction in which the plurality of receiving antennas 42a of the dangerous goods detection device 12B are directed. Specifically, the plurality of receiving antennas 42a of the dangerous goods detection device 12A are directed to the front surface of the moving person 92a by the escalator 90 to be searched. On the other hand, the plurality of receiving antennas 42a of the dangerous goods detection device 12B are directed to the rear surface of the moving person 92b by the escalator 90 to be searched.

The second millimeter wave module 22b is an active millimeter wave module that transmits millimeter waves. The second millimeter wave module 22b transmits a millimeter wave to the person 92 to be searched, and receives the millimeter wave reflected from the inside of the clothes of the person 92 or the like. As a result, the second millimeter wave module 22b generates an image for detecting a dangerous object possessed by the person 92 inside the clothes based on the received millimeter wave. The second millimeter wave module 22b has a plurality of (for example, two) transmitting antennas 40b and a plurality of (for example, four) receiving antennas 42b.

The plurality of transmitting antennas 40b transmit millimeter waves. The plurality of transmitting antennas 40b of the dangerous goods detection device 12A are directed to the front of the moving person 92a by the escalator 90 to be searched. The plurality of transmitting antennas 40b of the dangerous goods detection device 12B are directed to the rear surface of the moving person 92b by the escalator 90 to be searched.

The plurality of receiving antennas 42b receive millimeter waves transmitted by the plurality of transmitting antennas 40b. The plurality of receiving antennas 42b are arranged in the vertical direction, which is an example of the second direction. That is, the plurality of receiving antennas 42b are arranged in a direction intersecting the arrangement direction of the plurality of receiving antennas 42a. The plurality of receiving antennas 42b are directed to the escalator 90 in substantially the same direction as the plurality of receiving antennas 42a of the same dangerous goods detection device 12. Here, the direction in which the plurality of receiving antennas 42b of the dangerous goods detection device 12A are directed is different from the direction in which the plurality of receiving antennas 42b of the dangerous goods detection device 12B are directed. Specifically, the plurality of receiving antennas 42b of the dangerous goods detection device 12A are directed to the front surface of the moving person 92a by the escalator 90 to be searched. The plurality of receiving antennas 42b of the dangerous goods detection device 12B are directed to the rear surface of the moving person 92b by the escalator 90 to be searched.

The laser pointer 24 irradiates the search target with a laser and adjusts the position at which the millimeter wave is transmitted when the millimeter wave modules 22a and 22b are installed. The laser pointer 24 is preferably installed at a height of, for example, about 1000 mm from the ground on which it is installed.

The holding member 26 is formed in a hollow rectangular parallelepiped shape. The depth and width of the holding member 26 are preferably about 1000 mm. The holding member 26 holds the drive unit 32, the driver 34, the information processing device 36, the display unit 37, the input unit 38, and the power supply 39. The upper part of the holding member 26 supports the storage case 20.

The casters 28 are provided below the holding member 26. The casters 28 movably support the holding member 26.

The adjuster 30 is provided below the holding member 26. The adjuster 30 supports the holding member 26 in an adjustable position in the vertical direction. The adjuster 30 fixes the horizontal position of the holding member 26 by separating the caster 28 from the ground.

The drive unit 32, together with the housing case 20, rotates the millimeter wave modules 22a and 22b around a rotation axis RA parallel to the vertical direction. As a result, the drive unit 32 scans the receiving antennas 42a and 42b of the millimeter wave modules 22a and 22b in the horizontal direction, which is the direction intersecting the vertical direction. The drive unit 32 is, for example, a motor.

The driver 34 is a circuit that controls the drive unit 32 according to an instruction from the information processing device 36.

The information processing device 36 controls the millimeter wave modules 22a and 22b, the laser pointer 24, and the driving unit 32, and generates a composite image from the images generated by the millimeter wave modules 22a and 22b from the millimeter waves.

The display unit 37 displays an image based on the image data acquired from the information processing device 36. For example, the display unit 37 displays a composite image generated by the information processing device 36.

The input unit 38 is, for example, a touch panel provided on the display surface of the display unit 37. The input unit 38 outputs the information received from the user of the dangerous goods detection device 12 to the information processing device 36.

The power supply 39 supplies electric power to the millimeter wave modules 22a and 22b, the laser pointer 24, the drive unit 32, the driver 34, the information processing device 36, the display unit 37, and the input unit 38.

FIG. 3 is a block diagram showing an electrical configuration of the dangerous substance detection device 12. As shown in FIG. 3, the first millimeter wave module 22a includes a plurality of transmitting antennas 40a, a plurality of receiving antennas 42a, a transmitter 44a, a plurality of mixers 46a, an RF (Radio Frequency) unit 48a, and A. It includes a / D converter 50a, a radar signal processing circuit 52a, and an image processing circuit 54a.

The transmitter 44a generates a millimeter wave transmission signal, outputs the millimeter wave to the plurality of transmitting antennas 40a and the plurality of mixers 46a, and transmits the millimeter wave to the person 92 on the escalator 90 via the plurality of transmitting antennas 40a. To do.

The plurality of mixers 46a are provided corresponding to each of the plurality of receiving antennas 42a. Each mixer 46a mixes the transmission signal output by the transmitter 44a and the reception signal acquired from the corresponding receiving antenna 42a, and outputs the mixture to the RF unit 48a.

The RF unit 48a receives the received signal, generates a conversion signal in which the received signal is down-converted by frequency conversion, and outputs the converted signal to the A / D conversion unit 50a.

The A / D conversion unit 50a converts the analog reception signal received from the RF unit 48a into a digital signal.

The radar signal processing circuit 52a images the strength of the received signal together with information on the distance in polar coordinates to the search target and the direction in polar coordinates of the search target calculated by distance measurement and angle measurement based on the digitally converted reception signal. Output to the processing circuit 54a.

The image processing circuit 54a generates a first image by converting the distance and direction in polar coordinates acquired from the radar signal processing circuit 52a into two-dimensional Cartesian coordinates.

The second millimeter wave module 22b includes a plurality of transmitting antennas 40b, a plurality of receiving antennas 42b, a transmitter 44b, a plurality of mixers 46b, an RF unit 48b, an A / D conversion unit 50b, and a radar signal processing circuit. It includes 52b and an image processing circuit 54b. Each configuration of the second millimeter wave module 22b has the same function as each configuration of the first millimeter wave module 22a. That is, in the second millimeter wave module 22b, the plurality of receiving antennas 42b receive the millimeter wave transmitted by the transmitter 44b to the person 92 on the escalator 90 via the transmitting antenna 40b. In the second millimeter wave module 22b, the received millimeter wave is processed by the mixer 46b, the RF unit 48b, the A / D conversion unit 50b, and the radar signal processing circuit 52b, and then the image processing circuit 54b processes the signal from the millimeter wave to the second. Generate an image.

The information processing device 36 is, for example, a computer such as a microcomputer. The information processing device 36 has a control unit 56 and a dangerous goods database 58.

The control unit 56 is, for example, a hardware processor including a processor such as a CPU (Central Processing Unit). The control unit 56 includes a synthesis processing unit 60, a determination unit 62, and a machine scanning unit 64. For example, the control unit 56 may realize the functions of the synthesis processing unit 60, the determination unit 62, and the machine scanning unit 64 by reading the dangerous substance detection program. A part or all of the functions of the synthesis processing unit 60, the determination unit 62, and the machine scanning unit 64 are composed of hardware such as a circuit including a PLC (Programmable Logic Controller) or an ASIC (Application Specific Integrated Circuit). You may.

The synthesis processing unit 60 synthesizes the first image by the millimeter wave received by the receiving antenna 42a of the first millimeter wave module 22a and the second image by the millimeter wave received by the receiving antenna 42b of the second millimeter wave module 22b. To generate a composite image. For example, the compositing processing unit 60 generates a compositing image by multiplying the pixel value of the first image and the pixel value of the second image. The pixel value may be, for example, 256 gradations. The compositing processing unit 60 displays the compositing image on the display unit 37 and outputs it to the determination unit 62.

The determination unit 62 refers to the dangerous goods database 58 and determines whether or not the composite image contains dangerous goods. When the determination unit 62 determines that there is a dangerous substance in the composite image, the determination unit 62 outputs the determination result to the composition processing unit 60. The determination unit 62 may update the dangerous goods database 58 by learning the determination of dangerous goods by deep learning or the like. Further, the determination unit 62 receives the user information from the input unit 38. For example, the determination unit 62 receives the determination result of the presence or absence of a dangerous substance by the user who has seen the composite image.

The mechanical scanning unit 64 controls the driving unit 32 via the driver 34 to rotate the millimeter wave modules 22a and 22b around the rotation axis RA parallel to the vertical direction, thereby transmitting millimeter waves on the person 92. Scan.

The hazardous material database 58 is stored in a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), and a ROM (Read Only Memory). The dangerous goods database 58 may be provided on the network. The dangerous goods database 58 stores image data of a plurality of dangerous goods.

FIG. 4 is a block diagram showing the configuration of the radar signal processing circuit 52a. The radar signal processing circuit 52b has the same configuration as the radar signal processing circuit 52a. As shown in FIG. 4, the radar signal processing circuit 52a has a plurality of FFT units 66, a DBF (Digital BeamForming) unit 68, and a ranging angle measuring unit 70.

The plurality of FFT units 66 are associated with any of the plurality of receiving antennas 42a. The FFT unit 66 converts the received signal digitally converted and output by the A / D conversion unit 50a into a signal on the frequency axis and outputs the signal to the DBF unit 68.

The DBF unit 68 generates a Σ beam and a Δ beam for each frequency using the received signal of the frequency axis, and outputs the Σ beam and the Δ beam to the ranging angle measuring unit 70.

The ranging angle measuring unit 70 calculates the intensity of the received signal, the distance to the search target, and the direction of the search target based on the Σ beam and the Δ beam, and outputs them to the image processing circuit 54a.

FIG. 5 is a diagram illustrating the generation of a composite image by the composite processing unit 60. The synthesis processing unit 60 acquires the first image 94a shown in the upper left of FIG. 5 from the first millimeter wave module 22a. Since the first millimeter wave module 22a has the receiving antennas 42a arranged in the horizontal direction, the resolution in the vertical direction of the first image 94a is high and the resolution in the horizontal direction is low. The synthesis processing unit 60 acquires the second image 94b shown in the upper right of FIG. 5 from the second millimeter wave module 22b. Since the second millimeter wave module 22b has the receiving antennas 42b arranged in the vertical direction, the resolution in the horizontal direction of the second image 94b is high and the resolution in the vertical direction is low.

The synthesis processing unit 60 has a predetermined range (thick line in FIG. 5) based on the information (strength of the received signal, distance to the search target, and direction of the search target) acquired from the millimeter wave modules 22a and 22b. The pixel having the maximum reflection intensity (hereinafter referred to as the maximum reflection point) in the indicated square region) is extracted. The composition processing unit 60 calculates the pixel value of each pixel of the composite image 94c shown in the lower part of FIG. 5 by multiplying the pixel values of the first image 94a and the second image 94b at the maximum reflection point. As a result, the resolution of the pixel value at the center of the composite image 94c (see diagonal hatching) is increased. The compositing processing unit 60 generates a composite image 94c having a high resolution by performing the multiplication on each pixel. The composition processing unit 60 may set a pixel value equal to or less than a predetermined pixel threshold value to 0 among the pixel values after multiplication. As a result, the synthesis processing unit 60 can remove noise. Further, the synthesis processing unit 60 may learn and update the pixel threshold value by deep learning or the like.

FIG. 6 is a flowchart of the dangerous substance detection process executed by the control unit 56 of the dangerous substance detection device 12 of the first embodiment. The control unit 56 executes the dangerous substance detection process by reading the dangerous substance detection program.

As shown in FIG. 6, in the dangerous goods detection process of the first embodiment, the machine scanning unit 64 of the control unit 56 starts the machine scanning unit 32 by activating the drive unit 32 via the driver 34, and at the same time, starts the machine scanning. The transmitters 44a and 44b start transmitting millimeter waves (S102). As a result, the transmitters 44a, 44b and the receiving antennas 42a, 42b of the millimeter wave modules 22a, 22b rotate around the rotation axis RA and scan the person 92 to be searched with the millimeter wave along the horizontal direction.

The synthesis processing unit 60 sequentially acquires the data of the images 94a and 94b from the millimeter wave modules 22a and 22b being scanned (S104).

The machine scanning unit 64 determines whether or not the scanning should be completed (S106). For example, the mechanical scanning unit 64 may determine whether or not scanning should be completed based on a predetermined scanning time. When the machine scanning unit 64 determines that the scanning has not been completed yet (S106: No), the scanning unit continues the scanning, and the synthesis processing unit 60 continues to acquire the data of the images 94a and 94b (S104).

When the machine scanning unit 64 determines that the scanning should be completed (S106: Yes), the driving unit 32 is stopped to end the machine scanning (S108).

FIG. 7 is a front view of a person 92 explaining a scanning range by machine scanning. As shown in FIG. 7, the mechanical scanning unit 64 controls the driving unit 32 to cause the receiving antennas 42a and 42b to scan the person 92 to be searched, for example, as shown by the alternate long and short dash line. Become. Specifically, since the mechanical scanning unit 64 scans the millimeter wave modules 22a and 22b by rotating the millimeter wave modules 22a and 22b in the vertical direction with respect to the person 92 rising at a constant speed by the escalator 90, the person 92 The millimeter waves of the millimeter wave modules 22a and 22b are scanned along the direction in which the front surface of the is inclined with respect to the horizontal direction. The scanning time is preferably set so that at least the upper body of the person 92 can be scanned according to the speed of the escalator 90 and the like.

The synthesis processing unit 60 extracts the maximum reflection point based on the images 94a and 94b acquired from the millimeter wave modules 22a and 22b (S110). The synthesis processing unit 60 uses the pixel values of the first image 94a generated from the millimeter waves received by the first millimeter wave module 22a and the pixel values of the second image 94b generated from the millimeter waves received by the second millimeter wave module 22b. Multiply to calculate the pixel value of the maximum reflection point. The compositing processing unit 60 multiplies the other maximum reflection points by the pixel values of the images 94a and 94b generated from the millimeter waves received by the millimeter wave modules 22a and 22b to obtain the pixel values of all the pixels. The calculation is performed to generate a composite image 94c (S112).

The determination unit 62 determines whether or not the image generated by the synthesis processing unit 60 contains dangerous goods based on the dangerous goods database 58 (S114). The determination unit 62 outputs the determination result of the dangerous substance to the synthesis processing unit 60.

The compositing processing unit 60 calculates the pixel values of all the pixels by multiplication, sets the pixel values below the pixel threshold to 0 among the pixel values, and removes the noise. The composite image 94c is combined with the determination result of the determination unit 62. It is displayed on the display unit 37 (S116).

The synthesis processing unit 60 receives a determination from the user of the dangerous goods detection device 12 whether or not the composite image 94c is optimal via the input unit 38 (S118). When the compositing processing unit 60 receives a determination from the user that the composite image 94c is not optimal (S118: No), the compositing processing unit 60 optimizes the composite image 94c (S120). For example, the synthesis processing unit 60 may receive a new pixel threshold value from the user via the input unit 38 to optimize the composite image 94c. The compositing processing unit 60 repeats steps S118 and S120 until it receives a determination from the user that the composite image 94c is optimal via the input unit 38. When the compositing processing unit 60 acquires a determination result indicating that the composite image 94c is optimal from the user (S118: Yes), the determination unit 62 determines whether or not the optimized composite image 94c contains a dangerous substance. Accepts the user's determination (S122). The determination unit 62 outputs the determination result of whether or not the dangerous substance received from the user is included to the display unit 37 and displays it, and stores the image of the dangerous substance in the dangerous substance database 58 based on the determination result. Update (S124) and end the dangerous goods detection process.

As described above, the receiving antennas 42a and 42b of the dangerous goods detection device 12A are directed to the front surface of the person 92 coming up by the escalator 90. Therefore, the receiving antennas 42a and 42b can scan the person 92 along the vertical direction without changing the direction in the vertical direction and scanning. As a result, the dangerous goods detection device 12 can omit the mechanism for scanning the transmitting antennas 40a and 40b and the receiving antennas 42a and 42b in the vertical direction, so that the configuration can be simplified and the size can be reduced. And low price can be realized.

In the hazardous material detection device 12, the synthesis processing unit 60 received the first image 94a generated from the millimeter waves received by the horizontally arranged receiving antennas 42a and the vertically arranged receiving antennas 42b. The composite image 94c is generated by multiplying the pixel values of each pixel of the second image 94b generated from the millimeter wave. As a result, the dangerous goods detection device 12 can generate a high-resolution composite image 94c by a simple configuration in which the receiving antennas 42a and 42b of the millimeter wave modules 22a and 22b are arranged in different directions.

<Second Embodiment>
FIG. 8 is a block diagram showing an electrical configuration of the dangerous goods detection device 112 of the second embodiment. As shown in FIG. 8, the dangerous goods detection device 112 further includes an image pickup unit 72.

The image pickup unit 72 may be installed in the storage case 20 or the holding member 26, or may be installed at another position. The imaging unit 72 is, for example, a digital camera having a CMOS (Complementary Metal-oxide Semiconductor) or CCD (Charge-Coupled Device) sensor or the like. It is preferable that the imaging unit 72 is provided so that the transmitting antennas 40a and 40b can image in substantially the same direction as the direction in which the millimeter wave is irradiated. The imaging unit 72 outputs the captured image to the information processing device 36.

The information processing device 36 further has a face image database 74. The control unit 156 further includes an image processing unit 76 and a recognition unit 78.

The face image database 74 is a database for identifying a person 92 who transmits millimeter waves. The face image database 74 has, for example, data on the face image of a person 92 who is likely to have a dangerous substance. The face image database 74 may be provided on the network.

The captured image processing unit 76 processes the captured image acquired from the imaging unit 72 to identify the outer shape of the person 92, and the portion of the body of the person 92 that is likely to have a dangerous substance. Is specified as a scanning region for transmitting millimeter waves of the transmitting antennas 40a and 40b. The captured image processing unit 76 outputs the captured image to the synthesis processing unit 60 and the recognition unit 78, and outputs the specified part of the person 92 to the machine scanning unit 64.

The recognition unit 78 determines whether or not the person 92 included in the captured image is a person who is likely to possess a dangerous object, based on the face image stored in the face image database 74. The recognition unit 78 outputs the position of the person 92 identified as having a high possibility of possessing a dangerous object to the machine scanning unit 64.

The mechanical scanning unit 64 of the present embodiment controls the driving unit 32 based on the information of the captured image captured by the imaging unit 72. Specifically, the machine scanning unit 64 uses millimeter waves for the portion of the person 92 acquired from the captured image processing unit 76 among the bodies of the person 92 who is likely to possess the dangerous substance acquired from the recognition unit 78. The drive unit 32 is controlled so as to scan with. Therefore, the mechanical scanning unit 64 may stop the transmission of millimeter waves without driving the driving unit 32 when there is no person 92 who is likely to have a dangerous object.

The composition processing unit 60 of the present embodiment is likely to include an image of a dangerous substance in the entire image of the person 92 acquired from the captured image processing unit 76, and is an image of a part of the person 92 generated by scanning with millimeter waves. May be superimposed.

FIG. 9 is a flowchart of the dangerous substance detection process executed by the control unit 156 of the dangerous substance detection device 112 of the second embodiment. The same step numbers are assigned to the same processes as in the first embodiment, and the description thereof will be omitted.

As shown in FIG. 9, in the dangerous goods detection process of the second embodiment, the captured image processing unit 76 controls the image pickup unit 72 to start imaging (S202) and acquire the captured image (S204).

The captured image processing unit 76 identifies a portion of the body of the person 92 included in the acquired captured image that is likely to possess a dangerous substance (S206). The captured image processing unit 76 outputs the captured image to the recognition unit 78 and outputs the position of the portion to the machine scanning unit 64.

Based on the face image database 74, the recognition unit 78 identifies a person 92 who is likely to have a dangerous substance among the people 92 included in the captured image (S208). When the recognition unit 78 cannot identify the person 92 who has a high possibility of possessing a dangerous object (S208: No), the recognition unit 78 repeats steps S204 and subsequent steps to acquire a new captured image and executes the same process. To do.

When the recognition unit 78 identifies a person 92 who is likely to possess a dangerous object (S208: Yes), the recognition unit 78 outputs information regarding the position and the like of the person 92 to the machine scanning unit 64.

The mechanical scanning unit 64 irradiates the body of the person 92 who is likely to have the dangerous substance acquired from the recognition unit 78 with the millimeter wave to the part of the person 92 acquired from the image processing unit 76. , The drive unit 32 is controlled to start machine scanning and millimeter wave transmission (S102).

After that, step S104 and subsequent steps are executed in the same manner as in the first embodiment.

As described above, in the second embodiment, since the receiving antennas 42a and 42b scan only a specific part of the person 92 who is likely to have a dangerous object, only the millimeter wave reflected from the part is scanned. Will be received. As a result, the amount of data to be image-processed is reduced, so that the image processing circuits 54a and 54b and the composition processing unit 60 can reduce the load of image processing.

<Third Embodiment>
Next, the dangerous substance detection system 210 of the third embodiment in which the installation locations of the dangerous substance detection devices 12A and 12B are changed will be described. FIG. 10 is an overall configuration diagram of the dangerous goods detection system 210 according to the third embodiment.

As shown in FIG. 10, in the dangerous goods detection system 210 of the third embodiment, the dangerous goods detection devices 12A and 12B are installed on the ceiling above the ascending escalator 90. The dangerous goods detection device 12A is directed to the front surface of the person 92 who is rising by the escalator 90 from diagonally above. The dangerous goods detection device 12B is directed toward the rear surface of the person 92 ascending by the escalator 90 from diagonally above.

In the third embodiment, since the dangerous goods detection devices 12A and 12B scan the person 92 from diagonally above, the millimeter wave to be received is blocked by the other person 92 in front of and behind the person 92 to be searched. Can be suppressed.

<Fourth Embodiment>
Next, the dangerous goods detection system 310 of the fourth embodiment in which the installation locations of the dangerous goods detection devices 12A and 12B are changed will be described. FIG. 11 is an overall configuration diagram of the dangerous goods detection system 310 according to the fourth embodiment.

As shown in FIG. 11, in the dangerous goods detection system 310 of the fourth embodiment, the dangerous goods detection devices 12A and 12B are installed on the ceiling above the descending escalator 90. The dangerous goods detection device 12A is directed to the front surface of the person 92 descending from diagonally above by the escalator 90. The dangerous goods detection device 12B is directed toward the rear surface of the person 92 descending from diagonally above by the escalator 90.

In the fourth embodiment, since the dangerous goods detection devices 12A and 12B scan the person 92 from diagonally above, the millimeter wave to be received is blocked by the other person 92 in front of and behind the person 92 to be searched. Can be suppressed.

<Fifth Embodiment>
Next, the dangerous goods detection device 412 of the fifth embodiment will be described. FIG. 12 is a block diagram showing an electrical configuration of the dangerous goods detection device 412 according to the fifth embodiment. As shown in FIG. 12, the dangerous goods detection device 412 of the fifth embodiment does not have the millimeter wave module 22b, but has only the millimeter wave module 22a. In this case, the synthesis processing unit 60 generates and outputs an image of millimeter waves received by the plurality of receiving antennas 42a being scanned by the driving unit 32.

<Sixth Embodiment>
Next, the dangerous goods detection device 512 of the fifth embodiment will be described. FIG. 13 is an overall perspective view of the dangerous goods detection device 512 of the sixth embodiment. As shown in FIG. 13, in the dangerous goods detection device 512, the driver 34, the information processing device 36, and the power supply 39 are provided above the holding member 26 and in the vicinity of the millimeter wave modules 22a and 22b. In this case, the storage case 20 may be omitted. Further, the holding member 26 may be miniaturized.

The functions, arrangements, connection relationships, numbers, and the like of the configurations of the above-described embodiments may be appropriately changed. The order of the steps in the above flowchart may be changed as appropriate.

For example, in the above-described embodiment, the escalator 90 is mentioned as an example of the inclined passage, but the inclined passage is not limited to the escalator 90. For example, the ramp may be stairs and slopes.

The image pickup unit 72 and the millimeter wave modules 22a and 22b may be stored in one holding member 26 or may be stored in separate holding members 26. Further, the captured image processing unit 76 and the recognition unit 78 that process the captured image of the imaging unit 72 may be provided separately from the information processing device 36.

In the above-described embodiment, the active type in which the millimeter wave modules 22a and 22b have transmitters 44a and 44b for transmitting millimeter waves has been described as an example, but the passive type millimeter wave module in which the transmitters 44a and 44b are omitted has been described. May be adopted.

The dangerous goods detection device 12 may have an odor sensor, a gas sensor, or the like. As a result, the dangerous substance detection device 12 can detect dangerous substances such as liquids, gases, and explosives.

In the above-mentioned dangerous object detection device 12, one receiving antenna 42a is arranged in the horizontal direction and the other receiving antenna 42b is arranged in the vertical direction, but both arrangement directions are not limited to this. For example, the arrangement direction of one receiving antenna 42a may intersect with the arrangement direction of the other receiving antenna 42b.

In the above-described embodiment, the example in which the pair of dangerous goods detection devices 12 are installed has been described, but the present invention is not limited to this. For example, one or three or more dangerous substance detection devices 12 may be installed.

Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and the equivalent scope thereof.

10, 210, 310: Hazardous material detection system 12, 112, 412, 512: Hazardous material detection device 22a: 1st millimeter wave module 22b: 2nd millimeter wave module 32: Drive unit 40a, 40b: Transmission antenna 42a, 42b: Receiving antennas 44a, 44b: Transmitter 56: Control unit 60: Synthesis processing unit 64: Mechanical scanning unit 72: Imaging unit 90: Escalator (tilted passage)
92: Person 94a: First image 94b: Second image 94c: Composite image

Claims (6)

A scanning step provided around an inclined passage inclined with respect to the vertical direction, arranged in the first direction, and scanning a plurality of first receiving antennas for receiving millimeter waves in a direction intersecting the vertical direction.
And an image generation step of generating a first image by the millimeter waves of the plurality of first receiving antenna in the scan is received,
In the scanning step, a plurality of second receiving antennas provided around the inclined passage, arranged in a direction intersecting the first direction, and receiving millimeter waves, together with the plurality of first receiving antennas, are vertically arranged. Scan in the direction that intersects the direction,
In the image generation stage, the first image by the millimeter wave received by the plurality of first receiving antennas during the scanning and the second image by the millimeter wave received by the plurality of second receiving antennas are combined to form a composite image. Dangerous goods detection method to generate. In the image generation stage, the composite image is generated by multiplying the pixel value of the first image by the pixel value of the second image.
The dangerous substance detection method according to claim 1. In the scanning step, the plurality of first receiving antennas and the plurality of second receiving antennas are scanned based on the captured image captured on the inclined passage.
The dangerous goods detection method according to claim 1 or 2. The inclined passage is an escalator.
The dangerous substance detection method according to any one of claims 1 to 3. In the generation of the composite image, the composite image is generated by multiplying the pixel value of the first image by the pixel value of the second image.
The dangerous substance detection method according to any one of claims 1 to 3. The first receiving antenna and the second receiving antenna of the dangerous goods detection device are directed toward the inclined passage along one direction.
The first receiving antenna and the second receiving antenna of the other dangerous goods detection device are directed to the inclined passage along another direction different from the one direction.
The dangerous substance detection method according to any one of claims 1 to 5.

Images