JP2008016042A - Monitoring system, device, and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a monitoring system capable of reducing a burden of an entering person, and improving certainty of restricting an entrance. <P>SOLUTION: Restricted entry information input via a discrimination display reading part 112 is held by a restricted entry information holding part 111. A receiving part 101 supplies detection output of respective transceivers 20 and a person detection sensor 30 received from an information gathering part 40 to a position holding part 102 and a sensor output holding part 104. A determination part 120 determines the necessity of a warning according to information indicating a position of a radio tag 10 held in the position holding part 102 and carried by the entering person and the restricted entry information held by the restricted entry information holding part 111, and executes warning processing via an output part 130 when necessary. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a monitoring system, apparatus, and method for monitoring using a wireless tag.

  2. Description of the Related Art Conventionally, a security system as a gate is known as a means for restricting entrance into an area such as an event venue. In such a security system, a gate is provided at an entrance / exit of an area where entry is restricted, and a person who is going to enter is authenticated, and only those who are allowed to enter are allowed to enter the area.

  A visual monitoring system (first prior art) using a monitoring camera is known as one used for monitoring a person to be monitored in an area. In such a visual observation system, it is possible to remotely control the direction of the surveillance camera, the zoom, etc., so that the operator can control the imaging by the surveillance camera while viewing the video of the surveillance camera. It has become.

  Further, as disclosed in, for example, Patent Document 1, a wide-area monitoring device (second prior art) that performs personal identification with a wireless card or the like at an entrance and tracks a suspicious person with an automatic tracking function of a monitoring camera is known. ing.

  There are also known position measurement systems that measure the position of a person carrying a receiver, such as a GPS (Global Positioning Satellite), a PHS (Personal Handyphone System), or a simple mobile phone terminal. As a monitoring system using such a position measurement system, for example, as shown in Patent Document 2, the position of each visitor detected by GPS and the intrusion into the restricted access area are monitored using the video of the monitoring camera. An intrusion monitoring system (third prior art) is known.

  In addition, as a method of restricting entry into an area where entry is restricted, a method for checking the person entering and exiting at the entrance of a specific area where entry is restricted by using an IC card, a magnetic card, a password, etc. (No. 4) is known. In this method, the periphery of the area is guarded with a wall or the like so that a specific area cannot be entered from outside the doorway, and a door is provided at the doorway. The door is normally locked, and if it is checked that the door is allowed to enter, the door is unlocked and can enter the area.

  Further, as disclosed in Patent Document 3, for example, there is a system (fifth prior art) that restricts entry by checking a transponder card owned by a resident when a person is detected near a door. It has been.

  As another method of restricting entry, for example, a wireless mobile device disclosed in Patent Document 4 receives a wireless signal including area identification information transmitted from a fixed wireless transmission device, and is registered in advance. There is known a method (sixth prior art) that emits an alarm sound when it coincides with area identification information of an area.

Japanese Patent Laid-Open No. 9-130781 JP-A-8-163652 Japanese Patent No. 26005014 Japanese Patent No. 2901586

  However, in the first prior art, the determination as to whether or not the behavior is suspicious ultimately depends on human visual observation, so it is sufficient when a large number of cameras are installed in a large space or there are a large number of monitoring subjects. Cannot monitor.

  In the second prior art, it is difficult to track a suspicious person present in a crowded place with an image.

  In the third prior art, a position measurement system using GPS, PHS or the like is not suitable for measurement in a narrow closed space such as a building because the position detection accuracy is not so good.

  Further, in the fourth conventional technique and the fifth conventional technique, that is, the security system as a gate, it is impossible to monitor the behavior of a visitor after passing through the gate. Also, there is no known one that performs monitoring based on personal information. Furthermore, in the fourth conventional technique and the fifth conventional technique, it is necessary to partition an area where entry is restricted by a wall or the like, or when it is attempted to set a flexible accessible area for each person, a large number of locks are required. There is a problem that the door must be provided, which is unrealistic in terms of cost and load on the user, and that the load on the user such as taking out a card and entering a personal identification number is heavy. In addition, in the entry restriction by the door lock, if it is intruded while the door is unlocked or once entered, it is impossible to check the position of the resident after that. In addition, even if only a person with entry authority is nearby, it is necessary to always stop in front of the door and wait for the lock to be released.

  In the sixth prior art, fraud can be performed only by cutting the alarm of the mobile radio, and the authority of the person who has performed the fraud cannot be controlled on the server side. It was not possible to change authority flexibly according to the situation. In addition, the sixth prior art has a drawback in that if the mobile radio device is destroyed or discarded, it is difficult to limit thereafter.

  In addition, with any of the above-mentioned conventional techniques, it is possible to predict the person who is likely to perform fraud and use it for controlling the surveillance camera, etc., or to tell the direction to go to the person who entered the entry prohibition area by mistake. There wasn't.

  A system that measures the movement of a person in a room by using a wireless tag is known, but a technique that applies this to security is not known.

  The present invention has been made in view of the above-described problems, and provides a monitoring system, apparatus, and method that can reduce the burden on a visitor and improve the certainty of entry restriction. Objective.

  Another object of the present invention is to provide a monitoring system, apparatus, and method that can easily monitor the behavior of a large number of monitoring subjects.

  In order to solve the above-described problem, a monitoring system according to the present invention includes a detection unit that detects a signal wirelessly output from a wireless tag carried by a person to be monitored, an imaging unit, and an image captured by the imaging unit. Based on the detected video information, the number detection means for detecting the number of persons existing in the predetermined area and the number of the wireless tags existing in the predetermined area are detected based on the detected signal of the wireless tag. The number of tag detection means, the number of people detected by the number of people detection means, and the number of wireless tags detected by the number of tag detection means are compared, and the wireless tag within the predetermined area And a non-portable person determination means for determining whether or not there is a person who does not carry the mobile phone.

  The monitoring device according to the present invention includes a signal receiving unit that receives output information wirelessly output from a wireless tag carried by a monitoring subject, and an imaging unit that receives imaging information obtained by imaging a predetermined area by the imaging unit. Receiving means; number-of-persons detecting means for detecting the number of persons existing in the predetermined area from the received imaging information; and the wireless tag existing in the predetermined area based on the received output information. A tag number detecting means for detecting the number, the number of persons detected by the number of persons detecting means and the number of the wireless tags detected by the tag number detecting means are compared, and And non-portable person determination means for determining whether or not there is a person who does not carry the wireless tag.

Moreover, the monitoring method according to the present invention includes a detection step of detecting a signal wirelessly output from a wireless tag carried by the person to be monitored, an imaging step of imaging a predetermined area with an imaging unit,
The number-of-people detecting step for detecting the number of persons existing in the predetermined area from the video information captured in the photographing step, and the wireless existing in the predetermined area based on the detected signal of the wireless tag A tag number detection step for detecting the number of tags, the number of persons detected by the number of persons detection means, and the number of wireless tags detected by the tag number detection means are compared, and the predetermined number is detected. A non-portable person determination step of determining whether or not there is a person who does not carry the wireless tag in the area.

  In the present invention, it is possible to easily monitor a monitoring target person in a predetermined area.

  Embodiments of a monitoring system, apparatus and method according to the present invention will be described below in detail with reference to the drawings. In addition, this invention is not limited by this Embodiment.

(Embodiment 1)
First, a monitoring system and a monitoring method according to the first embodiment will be described. The first embodiment can be applied to, for example, a monitoring system for monitoring the position of a person (entering person) who enters an area having an area where entry is restricted, such as a business office.

  For example, as shown in FIG. 1, the monitoring system includes a wireless tag 10A carried by a resident, a transceiver 20A and a human detection sensor 30A installed in each predetermined area within the area, each transceiver 20A and a person. An information collecting unit 40A that collects information detected by the detection sensor 30A, a wall 50A provided around a predetermined area, a door 60A provided at an entrance of the area, and a monitoring camera installed in the predetermined area 70A, and a monitoring server 100A that controls the state of the door 60A and the like according to the reception information of the transceiver 20A and the detection output of the human detection sensor 30A.

  The wireless tag 10A includes, for example, a so-called RF-ID (Radio Frequency Identification) configured as shown in FIG. 2 and the like, and an identification information holding unit 11A that holds different identification information (TIDi) for each wireless tag 10A. A transmission unit 12A that generates a transmission signal having a predetermined frequency corresponding to TIDi held in the identification information holding unit 11A, a transmission / reception switching unit 13A that includes a directional coupler and the like, and that switches transmission / reception signals, and an antenna 14A. A receiving unit 15A that receives a signal from the transceiver 20A, a light emitting unit 16A that is driven according to control information in the received signal, a speaker 17A, and a vibrating unit 18A. The light emitting unit 16A includes light emitting elements such as LEDs of a plurality of colors (red, yellow, blue, or green). The speaker 17A is for generating a warning sound or the like. The vibration unit 18A vibrates the wireless tag 10A, for example, by rotating an eccentric rotating body, for example, similarly to a so-called vibrator function used in a mobile phone terminal or the like.

  The wireless tag 10A may be configured integrally, but for example, the identification information holding unit 11A, the transmission unit 12A, the transmission / reception switching unit 13A, the antenna 14A, the reception unit 15A, and the like are integrated as a so-called PC card or the like. The light emitting unit 16A, the speaker 17A, the vibration unit 18A, and the like are configured as a display unit, a speaker, a vibration unit, and the like included in a portable information terminal such as a PDA (personal digital assistant) connected to a PC card or the like. Also good.

  The transmission unit 12A generates a transmission signal corresponding to TIDi held in the identification information holding unit 11A, and transmits the transmission signal via the transmission / reception switching unit 13A and the antenna 14A.

  The interval at which the radio tag 10A transmits a signal corresponding to TIDi is determined according to the moving speed of the resident and the arrangement interval of each transceiver 20A. For example, when moving in a normal building by walking, it takes several seconds. About once. Alternatively, when moving in the event hall by walking, the accuracy of detecting the position of the resident is improved by narrowing the arrangement interval of the transmitter / receiver 20A and shortening the interval for transmitting signals according to TIDi. Can do. The transmission interval can be adjusted by controlling the interval at which the transmission unit 12A transmits a signal corresponding to TIDi. In this way, by adjusting the interval at which signals are transmitted according to TIDi, it is possible to contribute to a reduction in power consumption of the wireless tag 10A compared to the case where signals are transmitted more frequently than necessary.

  In addition, on the surface of the wireless tag 10A, for example, an identification display different for each wireless tag is provided by an optically readable OCR character, a barcode, or the like. For example, the monitoring server 100A is provided with a holding unit that holds a table indicating the correspondence between the identification display and TIDi, an identification display reading unit that reads the identification display, and an input device that inputs the entry restriction information corresponding to the identification information. It has been. If the identification display indicates TIDi, a table indicating the correspondence between the identification display and TIDi may not be provided.

  The transceiver 20A receives the transmission signal transmitted from the wireless tag 10A as described above, extracts the identification information TIDi in the received signal, and transmits it to the information collection unit 40A. For example, as shown in FIG. 3, the transceiver 20 </ b> A is installed at a predetermined interval in a predetermined area such as a building including an area where entry is restricted. Although not shown, a human detection sensor 30A is provided for each area where the transceiver 20A is installed.

  The reception sensitivity of each transceiver 20A is adjusted to such an extent that the wireless tag 10A in the area corresponding to each transceiver 20A can be detected. However, since the individual areas cannot be completely separated, the receivable range of the transmitter / receiver 20A is partially overlapped as shown in FIG. 4, for example. For this reason, a plurality of transceivers 20A may receive signals from the same wireless tag 10A. In such a case, it is assumed that the wireless tag 10A is in an area corresponding to one of the transceivers 20A. However, as will be described later, in the process up to the determination of the state, the wireless tag 10A can be handled as existing in a plurality of areas.

  Note that the monitoring server 100A, which will be described later, may have the same function as the transceiver 20A, and read the TIDi of the wireless tag 10A by itself.

  The human detection sensor 30A is installed for each predetermined area in the area as described above. For example, detection of infrared rays, sound, weight in the area, or radio waves emitted by a device such as a mobile phone carried by a resident To detect if there are people in the area. Alternatively, the presence / absence of a person may be detected by video from a video camera or the like.

  Further, instead of the output of the human detection sensor 30A, detection of a resident who holds the wireless tag 10A even if the above-described transmitter / receiver 20A uses a detection output indicating whether or not the radio wave from the wireless tag 10A has been received. Although it is possible to detect a person who does not carry the wireless tag 10A by providing the human detection sensor 30A separately from the transceiver 20A, the human detection sensor 30A is provided separately from the transceiver 20A. It is desirable.

  The information collection unit 40A collects the identification information from each transceiver 20A and the detection output of each person detection sensor 30A, and transmits the collected information to the monitoring server 100A at predetermined time intervals. For example, as shown in FIG. 5, information transmitted by the information collection unit 40A to the monitoring server 100A includes identification information (RIDj) indicating an area in which each transceiver 20 is installed and a transceiver 20A installed in the area. Table showing correspondence between identification information TIDi of all the wireless tags 10A receiving the signal and information (sensor output, for example, 0: no, 1: yes) indicating the detection output of the human detection sensor 30A installed in the area Consists of. The table shown in FIG. 5 shows a case where the identification information TIDi of the same wireless tag 10A allows a state corresponding to a plurality of RIDj, but the identification information TIDi of the same wireless tag 10A is The information collection unit 40A may select one of the RIDj so as to correspond only to that RIDj.

  The wall 50A is provided around a predetermined area. From the viewpoint of reducing the processing load by separating the individual areas and reducing the situation in which a plurality of transceivers 20A receive signals from the same wireless tag 10A, the wall 50A can block radio waves from the wireless tag 10A. It is desirable to compose with material and thickness. However, since it may be difficult in practice, it is not always necessary to provide the wall 50A for every section like the regions other than the regions r6 to r8 and r16 to r18 in FIG.

  Further, like the wall 50A, the door 60A is preferably configured to be able to block radio waves from the radio tag 10A. However, even when the radio waves cannot be completely blocked, the position of the radio tag 10A is determined by processing as described below. Since it can be determined, the radio wave may not be completely blocked.

  The installation position of the above-described transceiver 20A may be determined according to the radio wave blocking characteristics of the wall 50A and the door 60A. For example, when the radio wave blocking characteristic of the door 60A is poor, if the transceiver 20A is installed on the upper wall surface of the door 60A, it becomes difficult for the transceiver 20A to receive radio waves from the wireless tag 10A from the outside of the door 60A, and the wall 50A. It is easy to receive only radio waves from the wireless tag 10A in the area surrounded by the door 60A.

  In addition, the door 60A that may block the entry of a resident is provided with a receiving unit 61A that receives a control signal from the monitoring server 100A and a lock mechanism 62A that locks opening and closing according to the control signal.

  The monitoring server 100A communicates with an auxiliary storage device such as a processor (MPU), a memory, a hard disk drive (HDD), an input device such as a keyboard, an output device such as a display device and a printer, and an information collection unit 40A. An information processing apparatus such as a personal computer or a workstation provided with a communication interface or the like can be used.

  The monitoring server 100A includes, for example, a receiving unit 101A that receives information from the information collecting unit 40A and a position that holds the position of each wireless tag 10A received by the receiving unit 101A when the MPU executes a predetermined control program. A holding unit 102A, a history holding unit 103A that holds a history of the position of each wireless tag 10A for a predetermined time, a sensor output holding unit 104A that holds the detection output of each person detection sensor 30A received by 101A, and a visitor An entry restriction information input unit 112A including an input device such as a keyboard and a pointing device for inputting information indicating entry restriction for each attribute (entry restriction information), and an entry restriction information holding unit for holding the entered entry restriction information 111A, an identification display reading unit 110A for reading the identification display of the wireless tag 10A, and the position and wear of each wireless tag 10A , A sensor output, a determination unit 120A that determines whether or not a process such as locking the door 60A is necessary, and an output unit 130A that controls the operation of the lock mechanism 62A according to the determination result. Function as. A similar configuration can be configured by hardware.

  The output unit 130A performs operations of the door control unit 131A that controls the lock mechanism 62A, the security instruction unit 132A that displays an instruction to the guard, the instruction transmission unit 133A that transmits an instruction to the wireless tag 10A, and the monitoring camera 70A. And a camera control unit 134A for controlling.

-Access restriction information setting process according to the attributes of the visitor In the monitoring system configured in this way, first, entry restriction information according to the attributes of the visitor is set. This entry restriction information is set, for example, for each visitor attribute by the attribute table shown in FIG.

  This attribute table is initialized to 0 (unset state) when the system is started up, for example. After initialization, whether or not to allow access to each area for each attribute (customer, facility staff, facility senior staff, security manager, part-time worker, visitor, etc.) via the access restriction information input section 112A Enter the information shown. For this input, the values in the attribute table shown in FIG. 6 may be directly input. For example, as shown in FIG. 7, an image 201A showing a section in the area is displayed, and the operator enters the entry restriction information input unit 112A. When the pointer 202A is moved by the operation of the pointing device and a button provided for each area is instructed, for example, as shown in FIG. 8, a state that can be selected (for example, “entry permitted”, “entry prohibited”). Etc.) is displayed, and values corresponding to the state designated by the operator (for example, “1” for “entry permission”, “2” for “no entry”, etc.) are described above. The access restriction information of the area in the attribute table. Such entry restriction information is input for each attribute, and an attribute table as shown in FIG. 6 is configured corresponding to the identification information of each attribute. For the attributes other than the visitor, only the “no entry” area may be input, and the other areas may be automatically set to “entrance permission”.

  If the visitor is a visitor, determine a general restricted area in advance, enter the destination (destination) of the conference room, product delivery location, etc. for each individual visitor, and reach the destination It is also possible to obtain the shortest route that does not pass the restricted area from among the routes and to set the area on the shortest route as the permitted entry area. For this shortest route, the operator may input the shortest route or may input only the destination and automatically obtain the shortest route. When the input route passes through the restricted area, the route input may be requested again.

  Here, the route length is the sum of the weights assigned to the route, and when the weight is a distance, the route length is a distance along the route. Further, in addition to the distance, a risk amount when traveling along the route may be used as a weight. In the present embodiment, the route with the shortest route length determined in this way is called the shortest route.

  In addition to the shortest route, a route that does not pass through the restricted area is also added to the restricted area. You may make it do.

  When the entry restriction information is set as described above, the state of each area for each attribute is classified into entry prohibition “2”, entry permission “1”, and unset “0”.

Attribute association registration process for TIDi of the wireless tag 10A carried by the resident When the resident enters the area, the association between the wireless tag 10A carried by the resident and the attribute is set. Specifically, the identification display reading unit 112A reads the identification display of the wireless tag 10A to be carried by the visitor, and acquires identification information TIDi corresponding to the read identification display. Furthermore, the attribute, name, etc. of the visitor are input via the access restriction information input unit 110A. For example, as shown in FIG. 9, the input attribute, name, and the like are associated with the identification information TIDi of the wireless tag 10A and held in the access restriction information holding unit 111A as a person table.

  When registered in the entry restriction information (attribute table) and the person table in this way, the registered visitor can enter the area.

-Position monitoring process of the resident A signal from the wireless tag 10A carried by the resident who entered the area is received by the nearby transceiver 20A, and the position of the received transceiver 20A is regarded as the position of the resident. The information collection unit 40A receives the identification information TIDi of the wireless tag 10A received by all the transceivers 20A in the area as data as shown in FIG. 5, for example, at a predetermined time interval. To 101A.

  Upon receiving such data, the receiving unit 101A supplies, for example, a combination of RIDj and TIDi to the position holding unit 102A, and supplies a combination of RIDj and sensor output to the sensor output holding unit 104A. When new data is supplied, the position holding unit 102A supplies the data held so far to the history holding unit 103A, and the history holding unit 103A discards the data held so far and positions the holding unit 102A. Holds data supplied from. Thus, the history holding unit 103A holds data in the past predetermined time, that is, a history of past positions of the wireless tags 10A.

  The determination unit 120A confirms the sensor output of each person detection sensor 30A held in the sensor output holding unit 104A at a predetermined time interval, and selects RIDj whose sensor output is “1” (step in FIG. 10). SA1). If there is no RIDj whose sensor output is “1”, after waiting for a predetermined time (step SA5), the processing from step SA1 is executed again.

  In the present embodiment, in step SA1, the sensor output is confirmed and the RIDj corresponding to the corresponding sensor is monitored. However, the present invention is not limited to this, and the sensor output is not confirmed. May be monitored.

  When RIDj is selected, the determination unit 120A determines whether or not the entry restriction information corresponding to all TIDi corresponding to the selected RIDj is “2” indicating “no entry” (step SA2).

  If the entry restriction information is “2”, the entry corresponding to the TIDi is prohibited from entering, so warning processing is executed (step SA3). Here, even when the sensor output is “1”, the warning process is executed even when the TIDi for the RIDj in the area is not registered. This is because it is considered that a person who does not carry the wireless tag 10A is in the area.

  If the entry restriction information is not “2”, no warning is necessary, so it is determined whether or not the processing has been completed for all selected RIDj (step SA4). If not, the next RIDj is checked from step S2. If the process is completed, after waiting for a predetermined time (step SA5), the process from step SA1 is executed again.

  The warning process in step SA3 includes, for example, locking of the door 60A by the lock mechanism 62A, transmission of an instruction to the wireless tag 10A, output of a security instruction to a guard, control of the monitoring camera 70A, and the like.

  The lock of the door 60A by the lock mechanism 62A is, for example, in the vicinity of the current position of the intruder to be warned, and for the receiving unit 61A corresponding to the door 60A that can enter the area where the intruder is prohibited from entering. The door control unit 131A transmits a control instruction, and the reception unit 61A that receives the control instruction locks the door 60A with the corresponding lock mechanism 62A.

  The instruction is transmitted to the wireless tag 10A by transmitting an instruction for generating a warning sound, vibration, or the like from the instruction transmitting unit 133A to the wireless tag 10A carried by a warning target person.

  The guard instruction unit 132A outputs the TIDi (or the name corresponding to this) of the wireless tag 10A carried by the resident to be warned and the RIDj ( This is done by displaying the corresponding area name).

  In addition, for example, when the current position of a resident who is a warning target is in the vicinity of where the monitoring camera 70A is installed, the camera control unit 134A starts the imaging of the monitoring camera 70A or performs monitoring. This is executed by processing such as displaying the imaging output of the camera 70A.

  The above warning processes may be executed in combination, or may be selected according to the situation. For example, when entering the prohibited area, the security instruction unit 132A instructs security and generates a warning sound for the wireless tag 10A. For example, when the user stays in an unset area for 3 minutes or more, the security instruction unit 132A instructs security and generates a warning sound for the wireless tag 10A. This is because there is no problem when passing through an unset area, but a warning may be required when the vehicle stays at the same position.

  Also, in step SA3 described above, the process is executed when the sensor output is “1”, but the TIDi for the RIDj in the area is not registered, that is, when a person who does not carry the wireless tag 10A is detected. In the warning process, since it is considered that the detected person does not carry the wireless tag 10A, the security instruction unit 132A instructs security.

  In this monitoring system, unlike ordinary entrance management using gates, etc., when there is an intruder who is prohibited from entering the area, warning processing such as locking the door 60A is executed. Can be prevented from entering an area where entry is prohibited together with an authorized person.

  By the way, in the conventional apparatus shown in Patent Document 4 above, for example, when a mobile radio enters an area where entry is prohibited, a transmission signal of a fixed radio station installed in the entry prohibited area Because the mobile radio device detects that it is in a restricted area based on the identification information in the mobile station and generates a warning in the mobile wireless device, for example, the mobile wireless device may be left in the restricted access area. In case of destruction, no warning is issued.

  On the other hand, in this monitoring system, the location of the resident is always grasped by the transmission signal from the wireless tag 10A, and it is determined whether or not it is a restricted area on the monitoring server 100A side. Since the human detection sensor 30A is separately provided, a warning process is always executed when the wireless tag 10A is left or destroyed, so that the reliability of on-site monitoring can be improved.

  In addition, according to this system, by analyzing the position history (flow line) of the wireless tag and detecting that the flow line is stagnant at a predetermined position or the flow line is unnaturally interrupted, It is also possible to detect when a tag is left or destroyed. Further, by monitoring the flow line in this way, the place where the wireless tag is left or destroyed is specified, and the detection sensor or monitoring camera installed in the specified place is used, or in the vicinity of the specified place. You may make it confirm the condition by moving the detection sensor and surveillance camera which were made to wait to the place.

  Further, in this monitoring system, since the attributes of individual visitors are managed on the monitoring server 100A side, it is easy to perform processing such as changing the attributes of visitors according to the situation (for example, the number of warnings of visitors, etc.). is there.

  Further, in this monitoring system, since warning processing other than the lock of the door 60A can be selected, it is possible to restrict entry without enclosing the restricted entry area with the wall 50A, the door 60A, or the like. For example, when a warning sound, vibration, or the like is generated in the wireless tag 10A when approaching a restricted area, or security is instructed by the security instruction unit 132A, the wall 50A, the door 60A, etc. are not provided. Access restrictions can be made.

  In the above description, the presence / absence of a warning is determined using the current position of the wireless tag 10A, but a warning history may be managed for each wireless tag 10A. This makes it easy to identify visitors with high warnings (ie, suspicious visitors). In this case, the positions of all the wireless tags 10A are displayed in the image in the region as shown in FIG. 7, and the wireless tag 10A that has executed the warning process a predetermined number of times (for example, three times) or more is displayed. By displaying in a different display mode (for example, changing the color or blinking) from the wireless tag 10A of the resident, the presence and position of the suspicious resident can be easily recognized. Further, for example, the position of the wireless tag 10A that has executed the warning process a predetermined number of times or more may be controlled to be preferentially imaged by the monitoring camera 70A.

  Further, warning processing according to the position history of the wireless tag 10A may be executed. For example, when a visitor who is prohibited from entering a predetermined area approaches the area, warning processing such as locking the door 60A is executed first. Although it may not be enough to execute the warning process after entering the area where entry is prohibited, the warning process can be surely executed by executing the warning process first according to the history of the position of the wireless tag 10A. The process can be executed.

  In the above description, there are three states that indicate the entry restriction of each area, namely, entry permission, entry prohibition, and unset, but more states may be set.

  In addition, as shown in FIG. 4 described above, a part of the receivable area of each transmitter / receiver 20A overlaps, but when a plurality of transmitter / receivers 20 receive signals from the same wireless tag 10A, It may be determined in advance whether it belongs to this area.

  In this case, the intensities of the respective areas are ordered so that no contradiction occurs in the setting of the state indicating the entry restriction. For example, when the strength is set in the order of prohibition of entry> permission of entry> not set, the position of the wireless tag 10A belonging to a plurality of areas simultaneously is determined as follows.

1. 1. Radio tag 10A belonging to an area where no entry is permitted, no entry is permitted, and no entry is permitted. 2. RFID tag 10A belonging to the restricted entry and restricted entry areas ⇒ restricted entry area 3. Radio tag 10A belonging to an area where entry is prohibited and not set ⇒ entry prohibited The access permission and the wireless tag 10A belonging to the unset area ⇒ access permission For example, settings such as access prohibition> access permission, access permission> not set, not set> access prohibition are prohibited because they contradict each other.

  Thus, by setting the priority when the position of the wireless tag 10A belongs to a plurality of areas, even if the receivable areas of the transmitter / receiver 20A overlap, those belonging to any of the areas Can be treated as

  Further, in the monitoring system according to the first embodiment, route guidance (navigation) can be performed to a resident.

  In this case, for example, as shown in FIG. 11, the wireless tag 10A is configured such that the identification information holding unit 11A, the transmission unit 12A, the transmission / reception switching unit 13A, the antenna 14A, the reception unit 15A, and the like are integrally configured as a PC card. The unit 16A, the speaker 17A, the vibration unit 18A, and the like are configured as a display unit (light emitting unit 16A) of a portable information terminal such as a PDA (personal digital assistant) connected to a PC card or the like, a speaker, a vibration unit, and the like.

  Further, the monitoring server 100A is provided with a route instruction unit 140A that transmits route information to the wireless tag 10A. The route instruction unit 140A generates a map in the area and information indicating the position of the wireless tag 10A held in the position holding unit 102A, and transmits the information to the wireless tag 10A via the information collection unit 40A.

  This information is supplied to the receiving unit 15A via the transmission / reception switching unit 13A. The receiving unit 15A controls display by the light emitting unit 16 according to the received information. As a result, as shown in FIG. 11 described above, an image showing the area map 161A, the route 162A, the restricted area 163A, the current position 164A, the direction 165A, and the like is displayed on the display unit 160A.

  In order to display the direction, the wireless tag 10A is provided with means for detecting the direction of, for example, a gyroscope, a geomagnetic direction sensor, and the image data of the direction 165A indicating the direction according to the detection output of the direction detection function. It is necessary to provide a function for generating

  Furthermore, the direction 165A is indicated by blue when it is heading to the destination (outbound) or exit (return), yellow when it is away from this, and red when it is heading to the restricted area. A person can easily recognize the route. In addition, route guidance in such a form can be displayed even if the light emitting unit 16A configured by LEDs or the like is used instead of the PDA.

  Thus, in this monitoring system, a resident can easily recognize the route.

  In the above-described first embodiment, an example in which the present invention is applied to a monitoring system for monitoring the position of a visitor has been described. However, the technical idea of the present invention is not limited to this, and for example, an event or the like The present invention can also be applied to on-site control according to the position of a visitor in an area where there is no partition between the areas.

(Embodiment 2)
Next, a monitoring system and a monitoring method according to the second embodiment will be described. In this description, it is assumed that a person to be monitored such as a visit in a venue such as an event is monitored.

  For example, as shown in FIG. 12, the monitoring system corresponds to the wireless tag 10B carried by each visitor, the identification information (TIDi) of the wireless tag carried by each visitor, and the personal information of the visitor. A visitor information management unit 20B to be managed, a wireless tag position measurement unit 30B that measures the position of each wireless tag 10B, a monitoring camera control unit 50B that controls the operation of the management camera 40B, and the personal information of the visitors , A venue monitoring device 100B that automatically determines the attributes of the visitors according to the position of the wireless tag 10B and displays the position of the behavior suspicious person, the flow line image, and the like.

  The wireless tag 10B is made of, for example, a so-called RF-ID or the like. As shown in FIG. 13, the wireless tag 10B includes an identification information holding unit 11B that holds different identification information (TIDi) for each wireless tag 10B, and an identification information holding unit 11B. A transmission unit 12B that generates a transmission signal of a predetermined frequency corresponding to the held TIDi and a transmission antenna 13B are provided. The transmission unit 12B generates a transmission signal corresponding to TIDi held in the identification information holding unit 11B, and transmits the transmission signal via the transmission antenna 13B.

  The interval at which the wireless tag 10B transmits a signal corresponding to TIDi is determined according to the moving speed of the visitors and the arrangement intervals of the receivers 31B of the wireless tag position measuring unit 30B. For example, walking in a normal building If it moves by, it should be about once every few seconds. Alternatively, when moving in the hall by walking, the arrangement interval of the receiver 31B is narrowed, and the interval for transmitting a signal corresponding to TIDi is shortened to improve the accuracy of detecting the position of the visitor. it can. The transmission interval can be adjusted by controlling the interval at which the transmission unit 12B transmits a signal corresponding to TIDi. In this way, by adjusting the interval for transmitting the signal according to TIDi, it contributes to the reduction of the power consumption of the wireless tag 10B compared to the case where the signal according to TIDi is transmitted more frequently than necessary. Can do.

  In addition, on the surface of the wireless tag 10B, for example, an identification display different for each wireless tag is provided by an optically readable OCR character, a barcode, or the like. In the visitor information management unit 20B, for example, holding means (not shown) that holds a table indicating the correspondence between the identification display and TIDi, a reading unit 22B that can read the identification display, and personal information of the visitor are input. And a visitor data storage unit (visitor DB) 23B that stores the input personal information and the like in association with the TIDi of the wireless tag 10B carried by the attendee. If the identification display indicates TIDi, a table indicating the correspondence between the identification display and TIDi may not be provided. Moreover, you may make it manage a visitor's personal information collectively by the site monitoring apparatus 100B side.

  The wireless tag position measurement unit 30B includes, for example, a receiver 31B that receives radio waves from the wireless tag 10B, a data collection unit 32B that collects identification information (TIDi) of the wireless tag 10B received by each receiver 31B, A transmitter 33B that transmits the collected TIDi to the venue monitoring device 100B.

  For example, as shown in FIG. 14, the receiver 31B is installed in each predetermined area (r0, r1, r2,...) In the venue, and receives a transmission signal transmitted from the wireless tag 10B as described above. Then, the identification information TIDi in the received signal is extracted and transmitted to the data collection unit 32B.

  The reception sensitivity of each receiver 31B is adjusted to such an extent that the wireless tag 10B in the area where each receiver 31B is installed can be detected. However, since it may be difficult to completely match the reception sensitivity of the receiver 31B with each region, for example, as shown in FIG. 15, the receivable ranges of the receiver 31B partially overlap. May end up. For this reason, depending on the position of the wireless tag 10B, a plurality of receivers 31B may receive signals from the same wireless tag 10B. In such a case, the wireless tag 10B can be regarded as being in an area corresponding to any one of the receivers 31B, but can also be handled as the wireless tag 10B being present in a plurality of areas.

  The data collection unit 32B collects TIDi from each receiver 31B. Unique identification information (RIDj) is assigned to each of the areas r0, r1, r2,... Where the receiver 31B is installed. For example, when each receiver 31B can be identified by a communication path, such as when each receiver 31B and the data collection unit 32B are connected by different wirings (communication paths), RIDj of each receiver 31B is TIDi. Can be identified by the communication channel that acquired the. Alternatively, as a communication path between each receiver 31B and the data collection unit 32B, for example, when a communication path that cannot physically identify each receiver 31B such as a common wiring or radio is used, each receiver 31B can transmit a data packet including its own RIDj together with TIDi of the wireless tag 10B, and the data collection unit 32B can identify the receiver 31B as the transmission source by RIDj in the data packet.

  The data collection unit 32B associates the RIDj of each receiver 31B with the TIDi acquired from the receiver 31B and supplies it to the transmission unit 33B. The transmission unit 33B generates information (position measurement output) indicating in which region the wireless tag 10B having which TIDi is detected at a predetermined time interval according to the information from the data collection unit 32B. To the venue monitoring device 100B connected to Note that which receiver 31B is installed in which area is separately managed on the site monitoring apparatus 100B side.

  The surveillance camera 40B is installed corresponding to the areas r0, r1, r2,... Where the receiver 31B is installed, for example. The individual monitoring cameras 40B and the venue monitoring device 100B are connected by, for example, a network, and the imaging output of the individual monitoring cameras 40B can be supplied to the venue monitoring device 100B via the network. This monitoring camera 40B does not have to be installed for every region r0, r1, r2,..., But information indicating which region r0, r1, r2,. For example, management is performed on the venue monitoring apparatus 100B side.

  The surveillance camera control unit 50B is connected to the venue monitoring apparatus 100B via, for example, a network, and controls operations such as zooming and movement of the imaging direction of each surveillance camera 40B in accordance with instructions from the venue monitoring apparatus 100B.

  The venue monitoring apparatus 100B includes, for example, an auxiliary storage device such as a processor (MPU), a memory, a hard disk drive (HDD), an input device such as a keyboard, a display device, a personal computer equipped with an output device such as a printer, an information processing such as a workstation. It can consist of devices. The venue monitoring apparatus 100B includes a venue monitoring data management unit 110B that manages the history of the position of each wireless tag 10B by the MPU executing a predetermined control program, and the attributes of the monitoring target person from the history information. It functions as an attribute determination unit 120B that determines whether or not and a venue monitor control unit 130B that displays a behavior suspicious person or the like according to the determination result.

  The HDD also includes a flow line DB 140B in which the history of the position of each wireless tag 10B is recorded, an image DB 150B in which video images from the individual monitoring cameras 40B are recorded, general human flow lines, behavior, and the like. A flow line pattern DB 160B in which an example of a suspicious person's behavior pattern is recorded is stored.

  As shown in FIG. 16, for example, the venue monitoring data management unit 110B performs the identification information TIDi for each wireless tag 10B according to the information indicating the position of each wireless tag 10B supplied from the transmission unit 33B. The history of the position of the wireless tag 10B is held in time series in association with the RIDj of the area where the TIDi is detected, the entry time, the exit time, and the like.

  The attribute determination unit 120B compares the number of people detected from the video captured by the monitoring camera 40B with the number of people detected from the signal of the wireless tag 10B received by the receiver 31B, for example, every predetermined time, and the wireless tag 10B. The presence / absence of a person who does not carry the phone is detected, and if there is a person who does not carry the phone, the venue monitor control unit 130B is notified (non-carried person detection process).

  In addition, the attribute determination unit 120B determines, for example, every predetermined time whether the history of the position of each wireless tag 10B matches the behavior suspicious pattern held in the behavior suspicious pattern DB 160B, and the behavior suspicious The TIDi of the wireless tag 10B that matches the pattern is notified to the venue monitor control unit 130B (behavior suspicious person detection process).

  The venue monitor control unit 130B includes a monitor 131B having a display screen, a display control unit 132B that generates image data that causes the monitor 131B to display an image showing a suspicious behavior, and image data from the image DB 150B. A video acquisition unit 133B for acquisition.

  The display control unit 132B is provided for the purpose of facilitating the confirmation of the determination of the behavior suspicious person. For example, the display control unit 132B indicates the position of the behavior suspicious person according to the TIDi of the wireless tag 10B notified from the attribute determination unit 120B. Generation of image data, control of display of video from the monitoring camera 40B, and the like are performed. Specifically, the display control unit 132B, for example, image data indicating a layout diagram showing the size, shape, etc. of the venue as shown in FIG. 17 and the wireless tag 10B corresponding to TIDi notified from the attribute determination unit 120B. Image data or the like indicating the position in the layout diagram is generated, and the image acquisition unit 133B generates the image data to be displayed on the display screen of the monitor 131B by combining with the image from the monitoring camera 40B acquired from the image DB 150B. .

  The video acquisition unit 133B acquires, from the image DB 150B, image data of a video corresponding to TIDi notified from the attribute determination unit 120B. In the image DB 150B, the above-described venue monitoring data management unit 110B stores video image data from the monitoring camera 40B. The recording method of the image data is not particularly limited, but it is desirable to record the compressed data on a disk-shaped recording medium having excellent random accessibility such as a magnetic disk or an optical disk. Furthermore, if a recording method that encodes each object such as so-called MPEG-4 is used as the encoding method at the time of recording, it is recorded after being compressed and encoded in units of objects such as background images and persons. Further, it is possible to reduce the processing load of the attribute determination unit 120B for extracting a person in a recorded video, detecting a person's movement, and the like. Further, if such compression encoding is performed on the individual monitoring camera 40B side, the processing load of the venue monitoring apparatus 100B can be reduced.

Prior information registration processing In the monitoring system configured as described above, the venue monitoring data management unit 110B is informed of, for example, the physical size, shape, name, and whether or not it is a restricted area before the system is operated. The venue layout diagram shown, the position of the receiver 31B and each reception range (for example, the correspondence with the areas r0, r1, r2,... In FIG. 14 above), the position where the surveillance camera 40B is arranged, and the respective imaging ranges ( For example, in FIG. 14 described above, information such as the area r0 for the monitoring camera 40B [C1] and r14, r13, r12, r11, r10) for the monitoring camera 40B [C2] is set. These pieces of information are set in the venue monitoring data management unit 110B when the system is installed, and are referred to as necessary.

・ Operating information setting process Also, when the system is in operation, the venue monitoring data management unit 110B has a personal ID for each visitor, personal information such as the visitor's name, address, nationality, criminal record, weight, etc., and the wireless tag 10B. A table indicating the correspondence between the identification information TIDi and the individual ID of the visitor carrying the wireless tag 10B, the history of the position of the wireless tag 10B (FIG. 16 described above), the video of each monitoring camera 40B, and the like are set. These pieces of information are also set in the venue monitoring data management unit 110B and referred to as necessary.

Non-portable person detection process In the above-described non-portable person detection process, for example, the processing shown in FIG. 18 is executed at predetermined time intervals, and the wireless tag 10B in the area detected by the receiver 31B installed in each area from TIDi. And the number of entrances detected from the video captured by the surveillance camera 40B (that is, the number of people in the video) (steps SB1, SB2) are compared, and the wireless tag 10B is not carried. The presence or absence of a person is determined (step SB3). If there is a person who does not carry the wireless tag 10B, the venue monitor control unit 130B is instructed to indicate that (step SB4). In response to this, the display control unit 132B displays a warning display 131a on the display screen of the monitor 131B, for example, as shown in FIG. Further, on the display screen of the monitor 131B, an area 131c for displaying the number of persons 131b detected from the video of the monitoring camera 40B, identification information (TIDi) 131e detected from the signal of the wireless tag 10B received by the receiver 31B, the number of persons 131f, etc. May be provided with a region 131g for displaying.

  Further, when there is a person who does not carry the wireless tag 10B, the attribute determination unit 120B refers to the position history of the wireless tag 10B and identifies a person who does not carry the wireless tag 10B. Also good. Specifically, for example, as shown in FIG. 20, the characteristics of the person in the video are specified by height, clothes, color, etc., the images of each specified person are detected from the video, and the positions are recorded in time series. To do. The position of the person recorded in this way is compared with the history of the position of the wireless tag 10B, and as shown in FIG. 21, for example, a person with a high degree of matching is associated as a person carrying the wireless tag 10B. And the person who does not have the corresponding wireless tag 10B (in this case, the person corresponding to the ID “1” in FIG. 20) remains, and is identified as the person who does not carry the wireless tag 10B. The

  When a person who does not carry the wireless tag 10B is specified in this way, the attribute determination unit 120B displays information for specifying the person (for example, individual identification information [ID] specified from the image) and the like, the display control unit 132B. Notify In response to this, the display control unit 132B displays a display 131h indicating a person who is not carrying the wireless tag 10B, for example, in the image shown in FIG.

-Behavior suspicious person detection processing In the above-described behavior suspicious person detection processing, the attribute determination unit 120B first determines a flow line in the flow line DB 140B according to application conditions such as a region, a time zone, and the number of visitors. Decide whether to search.

  When performing a search, the attribute determination unit 120B executes, for example, the processing shown in FIG. 22 every predetermined time, and is stored in the above-described flow line pattern DB 160B in the history of the position of each wireless tag 10 (flow line). It is determined whether or not the flow line pattern is included (step SB11). If the flow line pattern is included, the TIDi of the wireless tag 10B of the flow line pattern and the position of the wireless tag 10B are determined. RIDj shown is acquired (step SB12), and the acquired TIDi, RIDj, etc. are notified to the venue monitor control unit 130B. The venue monitor control unit 130B instructs the venue monitor control unit 130B to display that a person who takes a specific action such as a suspicious person has been found in accordance with the notified TIDi, RIDj, and the like (step SB13).

  Examples of the flow line pattern stored in the flow line pattern DB 160B include a pattern and a pattern represented by a combination of a pattern and a condition (application condition) for applying the pattern as follows.

(Example 1)
Applicable condition: Prohibited area entry pattern: TIDi in which RIDj of the restricted entry area set as described above is registered in the flow line DB.

  This is the most basic pattern, and it is a pattern for checking whether or not there is a person who has entered the restricted area.

(Example 2)
Applicable conditions: East venue: Morning: Number of visitors> 100 or more Pattern: TIDi in which the same RIDj is registered in the flow line DB for a predetermined time (for example, 30 minutes) or more.

  This is for checking visitors who stay in the same area for a long time, and the above-mentioned application condition is, for example, when the target venue of the system is divided into an east venue and a west venue. This shows that if there are more than 100 visitors in the morning in the east hall only, there is a flow line that stays in the same area for more than 30 minutes.

(Example 3)
Applicable condition:
Pattern: There exists TIDi that reciprocates a predetermined number of times (for example, three times) in a predetermined time (for example, within one hour) in the flow line DB.

  This is a pattern for checking whether or not there is a visitor moving around, and indicates that the application condition is always checked because the application condition is not specified. Furthermore, if the application condition is limited to the vicinity of the restricted area, the detection sensitivity is reduced, but the possibility of erroneous detection is reduced, and only suspicious visitors can be detected.

(Example 4)
Application condition: West venue pattern: TIDi moving in a predetermined number of areas (for example, 4 areas) within a predetermined time (for example, 10 seconds) exists in the flow line DB.

  This is a pattern for detecting a fast moving movement, and in this case, an example of detecting only at the west venue is shown.

(Example 5)
Applicable condition:
Pattern: A plurality of TIDi exists at the same position in the flow line DB for a predetermined time (for example, 1 hour) or more.

  In this case, the wireless tag 10 </ b> B that has been moving the same for a certain period of time is detected. Since there is a possibility that one person holds two tags or is a group with parents and children, a more detailed state can be detected by referring to personal information as described later.

(Example 6)
Applicable condition:
Pattern: TIDi whose position is not registered in the flow line DB exists.

  This is a pattern for detecting whether or not there is a wireless tag 10B that is out of the monitored area or a wireless tag 10B that is broken or intentionally destroyed. When this pattern is detected, the control information of the monitoring camera 40B (such as which monitoring camera 40B is selected) cannot be given, so that the unknown TIDi of the wireless tag 10B is simply displayed on the monitor 131B. Or displayed as being in an area corresponding to RIDj when the TIDi is detected later.

  Such behavior suspicious patterns usually differ depending on the venue to be monitored.

  In addition, instead of simply determining a suspicious behavior only by a flow line, a determination condition according to personal information may be defined as a flow line pattern. For example, refer to the personal information stored in the visitor DB 23B, and determine the criteria for dangerous persons (for example, persons with a criminal record) and those who are not, so that the dangerous persons are in the vicinity of restricted areas. A warning may be instructed if they are gathered together.

  Further, even in the same pattern as in Example 5, it may be necessary to make a determination with reference to personal information. Therefore, when a specific determination pattern is set and a specific flow line pattern is detected, The personal information is referred to, and the state is determined according to the determination condition.

  Furthermore, in addition to the above-described application conditions, personal information may be defined in association with a pattern, and for example, if it is a guard, it may be excluded from a behavior suspicious person.

  In this case, personal information can be defined. In this case, for example, data indicating the correspondence between TIDi, personal information, and patterns of the wireless tag 10B registered in the above-described visitor DB 23B is separately stored.

  Further, if a specific flow line pattern as described above is searched from the flow line DB 140B in real time, there is a possibility that a considerable amount of calculation is required. In particular, when a plurality of flow lines are compared, the number of combinations becomes enormous. In such a case, the venue monitoring device 100B may be configured by a plurality of information processing devices, and for example, the venue may be divided to perform processing in parallel.

Display Control Process The venue monitor control unit 130B executes a process as shown in FIG. 23, for example, and in a normal state (when no suspicious behavior is detected), the monitor 131B has a layout indicating the venue. A figure and a display showing TIDi of each wireless tag 10B indicating the position of each wireless tag 10B are displayed. Further, for example, as shown in FIG. 24, the images of all the monitoring cameras 40B are displayed on the monitor 131B or a video display monitor provided separately. Alternatively, the images from each monitoring camera 40B may be sequentially selected and displayed.

  The venue monitor control unit 130B monitors the notification from the attribute determination unit 120B (step SB21), and if there is an instruction from the attribute determination unit 120B in step SB13 in FIG. The display mode of the display indicating the position is changed (step SB22).

  As a result, the display of the suspicious behavior person displayed on the monitor 131B (for example, “TIDz” in FIG. 17 described above) is different from the non-behavior suspicious person, for example, in different display colors, sizes, flashing states, etc. Is displayed. Alternatively, a warning sound may be generated. With these displays, the operator of the venue monitoring apparatus 100B can easily grasp the presence / absence, position, etc. of a suspicious behavior person, and can give instructions to guards arranged separately, for example.

  In step S22 described above, the display mode is changed, and (1) the flow line of the wireless tag 10B determined to be a suspicious behavior is acquired from the flow line DB 140B and displayed. (2) The monitoring camera 40B that reflects the position of the wireless tag 10B determined to be a suspicious person is searched, and the video of the searched monitoring camera 40B is output to the monitor. (3) Processing such as controlling the movement of the imaging range, zooming, and the like may be performed via the monitoring camera control unit 50B so as to image the position of the wireless tag 10B determined to be suspicious.

  Furthermore, when the position of the wireless tag 10B determined to be a behavior suspicious person is moving, the monitoring camera 40B may be controlled in synchronization with this to be tracked and output to the monitor. In this case, the venue monitor control unit 130B refers to the flow line DB 150B, sequentially acquires the current RIDj corresponding to TIDi of the wireless tag 10B, and instructs the monitoring camera control unit 50B to control according to the acquired RIDj. .

  Further, in the above (2), when a plurality of monitoring cameras 40B are searched, all or some of the images of the monitoring cameras 40B may be displayed.

  Further, a past flow line of the wireless tag 10B determined to be a behavior suspicious person is acquired from the flow line DB 140B, and an image from the monitoring camera 40B that captures a position corresponding to the acquired flow line is acquired from the image DB 150B. The acquired video may be displayed. This makes it easy to visually determine whether or not the user is a suspicious person based on past images.

(Embodiment 3)
Next, a monitoring system and a monitoring method according to the third embodiment will be described. The monitoring system and the monitoring method according to the third embodiment describe a mode in which the first and second embodiments described above are combined and operated as one system.

  FIG. 25 is a block diagram of a schematic configuration of the monitoring system according to the third embodiment. As shown in FIG. 25, this monitoring system includes a wireless tag 10, a tag reader 20 (corresponding to the above-described transmitter / receiver 20A or receiver 31B) installed in each predetermined area, a relay processing device 40, a central processing unit, A monitoring device 100, a door lock mechanism 62, and a monitoring camera 70 are provided.

  The wireless tag 10 has a so-called RF-ID tag configuration and is carried by a resident. As illustrated in FIG. 26, the wireless tag 10 includes an identification information holding unit 11 that holds tag identification information unique to each wireless tag 10, a transmission unit 12 that generates a transmission signal indicating the tag identification information, and an antenna 14. A receiving unit 15 that receives a signal transmitted from the tag reader 20, a transmission / reception switching unit 13 that includes a directional coupler for switching transmission / reception signals, and a warning operation unit 9 that operates according to the received signal. And a power source 19.

  The warning operation unit 9 includes a light emitting unit 16, a speaker 17, and a vibration unit 18. The light emitting unit 16 is a light emitting element such as an LED capable of coloring red, yellow, blue, green and the like. Further, the speaker 17 outputs a sound such as a warning. The vibration unit 18 is an eccentric rotating body that is mounted to realize a vibration function in, for example, a mobile phone terminal, and is a means for vibrating the wireless tag 10.

  The wireless tag 10 transmits the transmission signal generated by the transmission unit 12 via the transmission / reception switching unit 13 and the antenna 14 at a predetermined timing. This timing will be described later.

  Further, a tag identification display unique to each wireless tag is attached to the surface of the wireless tag 10 by an optically readable OCR character, barcode or the like.

  The tag reader 20 is arranged for each predetermined monitoring area, receives a transmission signal transmitted from the wireless tag 10, extracts tag identification information from the received signal, and transmits the tag identification information to the relay processing device 40. In addition, the tag reader 20 receives various instruction signals transmitted from the relay processing device 40 to the wireless tag 10, and transmits the received instruction signals with tag identification information as a destination added thereto. In addition, reader identification information unique to each tag reader 20 is assigned to the tag reader 20.

  The lock mechanism 62 is a unit that is provided for each door that is to be restricted from entering, and that locks and unlocks the door according to a door control signal transmitted from the central monitoring device 100. Also, door identification information DID1, DID2, DID3,... Is assigned to each lock mechanism 62.

  The monitoring camera 70 is a unit that is arranged for each monitoring area where the tag reader 20 is arranged, and photographs the inside of each monitoring area. In addition, the monitoring camera 70 can perform an imaging operation such as zooming or moving in the imaging direction according to the camera control signal transmitted from the central monitoring device 100, and transmits the captured video to the central monitoring device 100. Further, camera identification information CID1, CID2, CID3... Is assigned to each monitoring camera 70.

  FIG. 27 is a diagram illustrating an arrangement example of the tag reader 20, the lock mechanism 62, and the monitoring camera 70. 27, location codes ZID1, ZID2, ZID3,... Are assigned to each monitoring area, and a tag reader 20 and a monitoring camera 70 are arranged for each monitoring area. In FIG. 27, each tag reader 20 is assigned reader identification information RID1, RID2, RID3.

  Here, the reception sensitivity of the tag reader 20 is adjusted to such an extent that the wireless tag 10 in the monitoring area corresponding to each tag reader 20 can be detected. In other words, each monitoring area is determined as a range in which one tag reader 20 can detect the wireless tag 10. However, since the detection range of the tag reader 20 is determined by a circular shape centering on the tag reader 20, the detection range of the tag reader 20 partially overlaps in order to enable detection of the wireless tag 10 over adjacent monitoring areas. Thus, it is necessary to arrange each tag reader 20 so as to define a monitoring area based on the arrangement position.

  FIG. 28 is an explanatory diagram for explaining the relationship between the arrangement position of the tag reader 20 and the detection range. As shown in FIG. 28, it is preferable to adjust the reception sensitivity and the arrangement position of each tag reader 20 so that the detection ranges 21 of each tag reader 20 partially overlap so that there is no region where the wireless tag 10 cannot be detected. In this case, a plurality of tag readers 20 may detect the same wireless tag 10, but the relay processing device 40 described later gives priority to each tag reader 20, so that any one tag reader 20. It is also possible to enable only the detection of. Further, the transmission timing of the transmission signal in the wireless tag 10 can be appropriately set according to the arrangement interval of the tag reader 20. The transmission timing of the transmission signal in the wireless tag 10 can be set to about once every few seconds, for example, when moving in a normal building by walking, regardless of the arrangement interval of the tag reader 20. When the arrangement interval is narrow, the accuracy of detecting the position of the resident can be improved by setting the transmission timing of the transmission signal to a shorter time interval. As described above, by adjusting the transmission timing of the transmission signal in the wireless tag 10, the power consumption of the wireless tag 10 can be reduced as compared with the case where the signal is transmitted more frequently than necessary.

  In FIG. 27, a wall 50 is provided around a predetermined monitoring area. The walls 50 can clearly separate individual monitoring areas, and further reduce the situation in which a plurality of tag readers 20 detect the same wireless tag 10 at the same time. That is, the presence of the wall 50 can reduce the processing load on the tag reader 20. From this viewpoint, it is desirable that the wall 50 be made of a material and a thickness that can block radio waves transmitted from the wireless tag 10. In addition, as shown in FIG. 3, it is not necessary to provide the wall 50 for every monitoring area.

  In addition, in FIG. 27, it is desirable that the door 60 has a material and a structure that can block the radio wave transmitted by the wireless tag 10, as with the wall 50, but even if the radio wave cannot be completely blocked, If the tag reader 20 is installed on the wall surface, the radio waves transmitted from the wireless tag 10 can be substantially blocked.

  In FIG. 25, the relay processing device 40 receives tag identification information from a plurality of tag readers 20 belonging to a predetermined area, and adds the reader identification information of the transmission source tag reader 20 to the received tag identification information. Transmit to the monitoring device 100. This reader identification information is specified by each wiring cable when the relay processing device 40 and each tag reader 20 are connected one by one with a wiring cable. When the relay processing device 40 and each tag reader 20 are connected by a common wiring cable or communicate wirelessly, the tag reader 20 transmits its reader identification information together with the tag identification information to the relay processing device 40. In this case, the relay processing device 40 can acquire a set of reader identification information and tag identification information without performing the reader identification information addition processing as described above.

  In addition, the relay processing device 40 receives various instruction signals transmitted from the central monitoring device 100 to the tag reader 20 and the wireless tag 10 and transmits the received instruction signals to the tag reader 20 serving as a destination.

  In FIG. 25, the central monitoring device 100 includes a data management unit 101, a data input unit 110, a tag identification display reading unit 112, an abnormality determination processing unit 120, a display unit 130, a door control unit 131, and a security instruction. Unit 132, warning instruction unit 133, camera control unit 134, route instruction unit 140, monitoring information storage unit 105, flow line pattern storage unit 160, and image storage unit 150.

  The data management unit 101 receives the signal transmitted from the relay processing device 40, extracts the tag identification information and the reader identification information from the received signal, and stores the information together with the reception time in the monitoring information storage unit 105.

  The data input unit 110 is means for inputting various data to be described later for the operator to register in the monitoring information storage unit 105 and instructions for the central monitoring device 100, and is an input device such as a keyboard and a pointing device. . The tag identification display reading unit 112 is a unit that reads the tag identification display attached to the wireless tag 10.

  The abnormality determination processing unit 120 is based on data stored in the monitoring information storage unit 105, the flow line pattern storage unit 160, and the image storage unit 150 at predetermined time intervals or in accordance with an operator's instruction, respectively. , Tag non-carried person detection processing, suspicious person detection processing and route instruction processing are executed.

  The display unit 130 is a means for displaying a specific image stored in the image storage unit 150 in accordance with an instruction from the abnormality determination processing unit 120, or notifying the detection of an unauthorized person, a tag non-carried person, and a suspicious person. For example, a CRT (Cathode Ray Tube) display device or a liquid crystal display device is used.

  The door control unit 131 instructs the lock mechanism 62 specified by the door identification information to perform locking or unlocking control in accordance with an instruction from the abnormality determination processing unit 120. The security instruction unit 132 gives a security instruction to a mobile terminal or the like carried by a security guard. The warning instruction unit 133 transmits a signal indicating a warning operation instruction for any one of the wireless tags 10 to the relay processing device 40 in accordance with the instruction from the abnormality determination processing unit 120.

  The camera control unit 134 controls the operation of the monitoring camera 70 specified by the above-described camera identification information in accordance with an instruction from the abnormality determination processing unit 120 or an operator's instruction, and stores an image captured by the monitoring camera 70 as an image. Stored in the unit 150. The route instruction unit 140 transmits a signal indicating a route guidance instruction for one of the wireless tags 10 to the relay processing device 40 in accordance with the instruction from the abnormality determination processing unit 120.

  The monitoring information storage unit 105 stores a tag identification information table, a reader table, a person table, an attribute table, a tag-person correspondence table, a camera table, and a door table created by inputting data by the data input unit 110. is doing.

  As shown in FIG. 29, the tag identification information table is a table that associates the tag identification display attached to the wireless tag 10 with the tag identification information held by the identification information storage unit 11 of the wireless tag 10. When the tag identification display of the wireless tag 10 is read by the tag identification display reading unit 112, this tag identification information table is referred to in order to identify the tag identification information associated with the tag identification display.

  As shown in FIG. 30, the reader table is a table in which each of the above-described reader identification information is associated with a location code, a name, and a zone where the tag reader 20 specified by the reader identification information is arranged. is there.

  As shown in FIG. 31, the person table has personal information such as the name, age, destination, and attribute information of the person specified by the person identification information for the person identification information for specifying the person carrying the wireless tag 10. Is an associated table.

  As shown in FIG. 32, the attribute table is a table in which attribute information included in the person table is associated with each location code included in the reader table. Specifically, whether to allow access to the monitoring area specified by the location code for one location code, such as visitor, facility staff, facility senior staff, security administrator, part-time worker, visitor, etc. It is set for each of a plurality of attributes distinguished by. For example, in FIG. 32, the attribute 2 is permitted to enter the monitoring area specified by the location codes ZID1 and ZID2, and is prohibited from entering the monitoring area specified by the location code ZID3.

  Further, in the attribute table, it is preferable that an attribute for temporary visitor in which the wireless tag 10 is frequently distributed and collected is prepared. For example, for this temporary visitor attribute, set values corresponding to all location codes are set in advance in the restricted area, and the destination (destination) of the visitor entered when the person table was created The setting value corresponding to the location code may be automatically changed to the access permission area. Specifically, the central monitoring device 100 is provided with an attribute setting unit (not shown), and the attribute setting unit avoids a monitoring area in which a visitor is originally prohibited from entering the route from the entrance to the destination described above. An attribute table is created so that an optimum route is obtained and a monitoring area on the route is set as a permitted entry area.

  As shown in FIG. 33, the tag-person table is a table in which the person attribute information included in the person table is associated with each tag identification information described above. In particular, this tag-person correspondence table is useful for acquiring personal information of a person carrying the wireless tag 10 specified by the tag identification information from the tag identification information by referring to the person table described above. .

  As shown in FIG. 34, the camera table is a table in which the location codes included in the reader table are associated with the above-described camera identification information.

  As shown in FIG. 35, the door table is a table in which the location codes included in the reader table are associated with the door identification information described above.

  As described above, the tag identification information table, the reader table, the person table, the attribute table, the tag-person correspondence table, the camera table, and the door table are in a normalized relationship with each other, and a relational database is constructed. Thereby, for example, even when the tag reader 20 arranged in a specific monitoring area breaks down and needs to be replaced with the tag reader 20 specified by new reader identification information, the attribute table, camera table, and door table are Since it is associated with a place code that is likely to be unchanged, it is only necessary to change the tag identification information of the failed tag reader 20 in the reader table. That is, registration change work can be minimized and the administrator's labor can be reduced.

  The monitoring information storage unit 105 stores a flow line table managed by the data management unit 101. As shown in FIG. 26, the flow line table includes, for each tag identification information, for the above-mentioned location code, the time when it entered the monitoring area specified by the location code (entry time t0) and the time when it left (output). It is a table in which time t1) is associated with stay time calculated between these times.

  25, the image storage unit 150 includes video data of the surveillance camera 70 obtained via the camera control unit 134, and image data indicating the shape of the venue, the layout of the tag reader 20 and the like as shown in FIG. And store. The storage form of these video data and image data is preferably compression-encoded. In particular, the video data is preferably stored by a method of encoding each object such as so-called MPEG-4. Thereby, it becomes easy to extract an object such as a background image or a person from the video data, and the load of processing for extracting a person in the video, detecting a person's movement, and the like in the abnormality determination processing unit 120 is reduced. Such compression encoding may be executed by each monitoring camera 70.

  In FIG. 25, a flow line pattern storage unit 160 stores a flow line pattern in which suspicious behavior is expressed by a numerical value or a character string according to a predetermined rule. This flow line pattern is referred to in a suspicious person detection process described later.

  The central monitoring device 100 is, for example, an auxiliary storage device such as a processor (MPU), a memory, a hard disk drive (HDD), an input device such as a keyboard, a display device, a personal computer equipped with an output device such as a printer, a workstation, or the like. It can be configured as an information processing apparatus.

  Further, the central monitoring device 100 may have the same function as the tag reader 20 and read the tag identification information of the wireless tag 10 by itself. Hereinafter, the entry prohibition process, the tag non-carried person detection process, the suspicious person detection process, and the route instruction process will be described in order.

-Access prohibition processing First, the access prohibition processing will be described. FIG. 37 is a flowchart showing the entry prohibition process. Here, it is assumed that the tag reader 20 is connected to the relay processing device 40 via a common wiring cable.

  As described above, the wireless tag 10 carried by the visitor periodically transmits tag identification information of the wireless tag 10. Therefore, when the visitor enters the monitoring area, the tag reader 20 belonging to the monitoring area acquires the tag identification information of the wireless tag 10 (step S11). In other words, the tag reader 20 detects that the wireless tag 10 exists in the monitoring area where the tag reader 20 is located. When the tag reader 20 acquires the tag identification information, the tag reader 20 transmits the reader identification information assigned to itself together with the acquired tag identification information to the relay processing device 40 (step S21). When the relay processing device 40 receives a set of tag identification information and reader identification information, the relay processing device 40 transmits the set to the data management unit 101 of the central monitoring device 100 (step S31).

  When the data management unit 101 of the central monitoring apparatus 100 receives a set of tag identification information and reader identification information, it executes a flow line table registration process (step S41). Specifically, the data management unit 101 first checks whether the flow line table of the received tag identification information has already been created by referring to the monitoring information storage unit 105, and if it has not been created Then, a new flow line table of the tag identification information is created. Then, the data management unit 101 identifies a location code based on the received reader identification information and the above-described reader table, and registers the identified location code in the location code column of the flow line table (registration 1). If no value is registered in the entry time column in the line specified by the location code, the time when the information is received is registered in the entry time column (registration 2). On the other hand, when a value is registered in the entry time column in the line specified by the location code, the time when the information is received is registered in the exit time column (registration 3). The data management unit 101 repeats the above registration 3 until the location code changes. When the location code changes, the above registration 1 is performed for the new location code, and the stay time is calculated from the entry time and the exit time of the previous row, and the result of the stay is the same row. Register in the time column. As described above, the flow line table is updated each time the data management unit 101 receives the tag identification information and the reader identification information from the relay processing device 40. This registration example assumes that the tag reader 20 is given a priority order for detecting the wireless tag 10.

  The movement history of each wireless tag 10 can be obtained by this flow line table registration process. In particular, as shown in FIG. 12, since the primary key of the flow line table of each tag identification information is a location code, even if the reader identification number is changed due to a failure of the tag reader 20, the past movement The history can be used continuously.

  The abnormality determination processing unit 120 of the central monitoring apparatus 100 executes the entry prohibition process when the content of the flow line table is changed or periodically as described above. Specifically, the abnormality determination processing unit 120 identifies the person identification information from the tag identification information by referring to the tag-person correspondence table described above, and determines the person identification information from the person identification information by referring to the person table described above. The attribute is specified, and the entry permission information set for the specified attribute is referred to from the attribute table (step S42). In addition, the abnormality determination processing unit 120 acquires a setting value corresponding to the place code specified in the setting 1 among the entry permission information. When this set value indicates “no entry”, the abnormality determination processing unit 120 is permitted to enter the monitoring area identified by the location code of the person carrying the wireless tag 10 indicating the tag identification information. It is determined that it is not present (step S43).

  If it is determined that entry is not permitted, the abnormality determination processing unit 120 identifies tag identification information and reader identification information from the reference flow line table and the reader table described above, and identifies the identified tag identification information and reader identification. A warning instruction signal including a set of information and a warning operation instruction is transmitted to the warning instruction unit 133.

  When receiving the warning instruction signal, the warning instruction unit 133 transmits the warning instruction signal to the relay processing device 40 (step S44). When receiving the warning instruction signal, the relay processing device 40 extracts the reader identification information included in the warning instruction signal, and gives the tag identification information and the warning operation instruction to the tag reader 20 specified by the extracted reader identification information. The included warning instruction signal is transmitted (step S32).

  Upon receiving the warning instruction signal, the tag reader 20 extracts tag identification information included in the warning instruction signal, and sends a warning instruction signal including a warning operation instruction to the wireless tag 10 specified by the extracted tag identification information. A call is made (step S22).

  The wireless tag 10 that has received the warning instruction signal performs a light emission operation by the light emitting unit 16, a sound output by the speaker 17 or a vibration operation by the vibration unit 18 in accordance with the warning operation instruction indicated by the warning instruction signal (step S12).

  Thereby, the resident who carries the wireless tag 10 can know that he / she has entered the restricted entry area. Further, in the warning operation of step S12, if the sound output from the speaker 17 is increased step by step, even if the resident intentionally enters the restricted area, the resident is taking suspicious behavior. Can inform the surroundings.

  In addition, the abnormality determination processing unit 120 transmits a warning instruction signal to the relay processing device 40, and refers to the above-described reader table and door table, so that the monitoring area where the intruder has entered or in the vicinity thereof. It is confirmed whether or not the lock mechanism 62 exists in the monitoring area (step S45). When the lock mechanism 62 exists in the monitoring area, the abnormality determination processing unit 120 further refers to the attribute table to check whether or not the lock mechanism 62 is located in the restricted entry area. When located in the restricted entry area, the abnormality determination processing unit 120 transmits a door control signal including door identification information for specifying the lock mechanism 62 and a lock instruction to the door control unit 131 (step S46). Upon receiving the lock instruction, the lock mechanism locks the corresponding door. Accordingly, it is possible to prevent a resident from entering the restricted entry area surrounded by the wall 50. The abnormality determination processing unit 120 refers to the flow line table, and determines that the lock mechanism 62 that has given the lock instruction to the lock mechanism 62 via the door control unit 131 when it is determined that the resident has left the restricted area. To send an unlock instruction. As a result, the locked door is unlocked and returned to its original state.

  In addition, the abnormality determination processing unit 120 transmits a warning instruction signal to the relay processing device 40, and specifies camera identification information by referring to the above-described reader table and camera table (step S47). And the camera control signal containing the specified camera identification information and camera control instruction | indication is transmitted to the camera control part 134 (step S48).

  Here, the camera control instruction is a shooting start instruction or a zoom operation by the monitoring camera 70 specified by the camera identification information. At this time, the abnormality determination processing unit 120 may cause the display unit 130 to display the video being shot by the monitoring camera 70 in real time. Further, the abnormality determination processing unit 120 refers to the past wireless tag history information recorded in the flow line table and the past surveillance camera video stored in the image storage unit 150 to cause the display unit 130 to be suspicious. A video of the past action of the person may be displayed. Furthermore, the abnormality determination processing unit 120 refers to the flow line table and the camera table, switches the camera that captures the monitoring area where the corresponding wireless tag is detected to the main camera, and tracks and captures the suspicious person. You can also.

  In addition, the abnormality determination processing unit 120 displays on the display unit 130 that a resident who has entered the monitoring area where entry is prohibited is detected (step S49). At this time, by referring to each table described above, information for specifying the monitored area, personal information for specifying a visitor, tag identification information, and the like may be displayed on the display unit 130.

  In addition, the abnormality determination processing unit 120 can transmit a security instruction signal including information specifying the monitoring area, the personal information, the tag identification information, and the like to the security instruction unit 132. For example, the abnormality determination processing unit 120 transmits the security instruction signal to the security instruction unit 132 only when the resident has stayed in the prohibited area for a predetermined time.

  The above warning processing may be executed in combination with one another, or one of them may be selected according to the situation.

  In this monitoring system, since the attributes of individual visitors are managed by the central monitoring apparatus 100, it is easy to perform processing such as changing the attributes of visitors according to the situation (for example, the number of warnings of visitors). .

  Further, in this monitoring system, warning processing other than the lock of the door 60 can be selected, so that the entry can be restricted without enclosing the restricted entry area with the wall 50, the door 60, or the like. For example, when a warning sound, vibration or the like is generated in the wireless tag 10 or when security is instructed by the security instruction unit 132 when approaching a restricted area, the wall 50, the door 60, etc. may not be provided. Access restrictions can be made.

  In the above description, the presence / absence of warning is determined using the current position of the wireless tag 10, but a warning history for each wireless tag 10 may be registered in the flow line table. This makes it easy to identify visitors with high warnings (ie, suspicious visitors).

  In particular, in this case, the abnormality determination processing unit 120 refers to the image storage unit 150 on the display unit 130 to display an image of the monitoring area as shown in FIG. Thus, the positions of all the wireless tags 10 are displayed in the image. Then, the wireless tag 10 that has executed the warning process a predetermined number of times (for example, three times) is displayed in a special display mode (for example, the color is changed or blinked). This makes it possible to easily recognize the presence and position of suspicious visitors. In addition, when there is a wireless tag 10 for which a predetermined number of warning processes have been executed, the abnormality determination processing unit 120 issues a camera control instruction for preferentially photographing a monitoring area where the wireless tag 10 exists. May be sent to.

  Further, the abnormality determination processing unit 120 may execute the warning process described above based on the behavior pattern registered in the flow line table.

  In addition, the entry permission information set in the attribute table described above indicates either entry permission or entry prohibition, but may include other setting values such as “not set”.

  Further, as shown in FIG. 28, the abnormality determination processing unit 120 determines which tag reader 20 is to be used in an area where a part of the tag detection range of each tag reader 20 overlaps. It may be determined on the basis of the entry permission information set in. For example, it is determined that the tag detection by the tag reader 20 in the monitoring area set to “no entry” is valid. That is, which tag reader 20 is effective for detection varies depending on the attributes of the visitor.

Tag non-carried person detection processing Next, tag non-carried person detection processing will be described. FIG. 38 is a flowchart showing the tag non-carried person detection process. Note that the tag non-carrying person detection process is executed by the central monitoring apparatus 100.

  First, the operator designates a monitoring area where the tag non-carrying person is to be detected using the data input unit 110, or the abnormality determination processing unit 120 sequentially designates the monitoring area periodically by referring to the reader table described above. Depending on whether or not, the monitoring area that is the target of the tag non-carried person detection process is specified (step S101).

  Then, the abnormality determination processing unit 120 refers to the flow line table described above, includes a location code indicating the specified monitoring area, and has a line in which the entry time is registered but the exit time is not registered. A flow line table is extracted, and tag identification information corresponding to the extracted flow line table is specified. Further, the number of identified tag identification information, that is, the number (TN) of wireless tags 10 present in the monitoring area to be subjected to tag non-carrier detection processing is calculated (step S102).

  Further, the abnormality determination processing unit 120 specifies camera identification information corresponding to the location code indicating the monitoring area by referring to the camera table described above. Then, the latest video data specified by the camera identification information is acquired by referring to the image storage unit 150 (step S103). Then, the abnormality determination processing unit 120 detects the number (CN) of people shown in the acquired video data (step S104).

  Subsequently, the abnormality determination processing unit 120 determines whether or not the number of wireless tags 10 in the monitoring area (TN) matches the number of people in the video in the monitoring area (CN) (step S105). . If they do not match, specifically, if CN> TN, the abnormality determination processing unit 120 determines that one or more of the people shown in the video are tag non-carriers and displays that fact on the display unit. It is displayed on 130 (step S106). On the other hand, if they match, the abnormality determination processing unit 120 causes the display unit 130 to display no processing or the number of CNs and TNs.

  In addition, in step S104 described above, the abnormality determination processing unit 120 carries not only the detection of CN but also the person who does not carry the wireless tag 10 with reference to the flow line table or the like. You may identify people who are not. Specifically, as shown in FIG. 39, a human image in the video 91 is detected and characterized by features such as height, color, clothes, and the like, and a unique recognition number is assigned to the characterized human image to obtain a predetermined value. Are recorded in the table 93. Further, the abnormality determination processing unit 120 identifies a person who is recognized by the same combination of feature amounts between different videos by the above recognition number, and as shown in FIG. A person recognition table is created in which the location code shown is associated with the recognition time. Then, the abnormality determination processing unit 120 extracts the movement history of the wireless tag 10 represented by the same time sequence as the person recognition table by referring to the flow line table described above. Specifically, the movement history is a tag movement history table in which each tag identification information is associated with a location code at each time. Then, the abnormality determination processing unit 120 compares the movement history table with the person recognition table, excludes the record of the recognition number that matches the transition of the place code from the person recognition table, and uses the remaining recognition number. The person image to be specified is specified as a tag non-carrier.

When a person who does not carry the wireless tag 10 is identified in this way, the abnormality determination processing unit 120, as shown in FIG. 41, together with the video 130c, an image area 130h corresponding to a tag non-carrying person in the video. Is displayed on the display unit 130 in an emphasized manner.
Further, as shown in FIG. 17, the abnormality determination processing unit 120 counts the number of wireless tags 10 calculated in step S102 (TN) and the number of people in the video data detected in step S104 (CN). Further, the tag identification information of the detected wireless tag 10, a message indicating that a tag non-carrier is present, and the like may be displayed on the display unit 130.

-Suspicious person detection process Next, a suspicious person detection process is demonstrated. FIG. 42 is a flowchart showing suspicious person detection processing. This suspicious person detection process is executed by the central monitoring apparatus 100.

  First, the operator uses the data input unit 110 to input a place where a suspicious person is desired to be detected (step S201). For example, the input of the detection location may be realized by designating a plurality of monitoring areas, for example. Subsequently, the operator uses the data input unit 110 to input a time range in which a suspicious person is desired to be detected (step S202). Further, the operator inputs conditions for detecting a suspicious person using the data input unit 110 (step S203). This condition includes, for example, that 100 or more wireless tags have been detected at the detection location input in step S201, and that a visitor having specific personal information is designated.

  Then, the abnormality determination processing unit 120 determines whether or not the detection condition is satisfied by referring to the flow line table described above (step S204), and if satisfied, the flow line table described above. , The data satisfying steps S201 to S203 is specified, and a flow line comparison character string is generated using the specified data (step S205). The following is a description of the flow line comparison character string.

  FIG. 43 is a diagram illustrating an example of a flow line comparison character string. The flow line comparison character string is composed of a character string representing a place code and a staying time for each tag identification information corresponding to the specified data. For example, one character indicates that the wireless tag 10 specified by the tag identification information has stayed at the location code assigned to the character for one minute. In FIG. 43, place codes ZID1, ZID2, ZID3,... Are represented by A, B, and C for easy understanding. Therefore, FIG. 43 stays in the monitoring area specified by the location code ZID1 for 30 minutes, then stays in the monitoring area specified by the location code ZID2, and then stays in the monitoring area specified by the location code ZID3. This represents a flow line comparison character string of the wireless tag 10 that has stayed for 5 minutes and has finally stayed for 1 minute in the monitoring area specified by the location code ZID1.

  The abnormality determination processing unit 120 compares the flow line comparison character string with each flow line pattern stored in the flow line pattern storage unit 160 (step S206). The following is an example of a flow line pattern.

“Example 1 of flow line pattern”: The same wireless tag 10 exists in the same monitoring area for a predetermined time or more.
This is a pattern for detecting a resident who stays in one place longer than necessary or for detecting a wireless tag 10 that has been left unattended.
“Example 2 of flow line pattern”: There is a wireless tag 10 that reciprocates a predetermined number of times within two hours between two monitoring areas.
This is a pattern for detecting a crawl visitor.
“Flow line pattern example 3”: There is a wireless tag 10 moving between a predetermined number or more of monitoring areas within a predetermined time.
This is a pattern for detecting intruders moving faster than necessary between monitored areas.

In order to express the contents as in the above example, the flow line pattern may include a location code and a code “*” representing an arbitrary character or character string. For example, when the predetermined time is 1 hour in “Example of flow line pattern 1”, the flow line pattern (PAT1) is
PAT1 = AAA ... A (A is 60 consecutive)
It is expressed as Here, A is the location code of the monitoring area.

Further, in the above “flow line pattern example 2”, when the predetermined time is 30 minutes and the predetermined number of times is 3, the flow line pattern (PAT2) is:
PAT2 = A * B * A * B * A * B and LEN (PAT2) = 30
It is expressed as Here, A and B are monitoring area location codes. * Represents zero or more arbitrary character strings. Further, in the PAT2, the condition of 30 minutes is a constraint that the length of the PAT2 is 30, so the number of character strings LEN (PAT2) = 30.

The abnormality determination processing unit 120 verifies whether or not such a flow line pattern is included in a plurality of target flow line comparison character strings. For example, if a traffic line comparison string is
FFFFAACCCCBDAEEBFFAEEEBCCCCAEEEEEE
The flow line comparison character string does not include the above-described PAT1, but includes the above-described PAT2. Therefore, it is determined that the visitor of the action pattern indicated by the flow line comparison character string has reciprocated A and B at least three times within 30 minutes.
The flow line pattern storage unit 160 includes a pattern for detecting whether there is a wireless tag 10 that is out of the monitoring area or a wireless tag 10 that is broken or deliberately destroyed, in addition to Examples 1 to 3 above. It may be stored as a flow line pattern.

  In step S206, when the abnormality determination processing unit 120 detects that the flow line comparison character string includes a flow line pattern, in other words, a part of the flow line comparison character string matches the flow line pattern. In this case (step S207: YES), the movement history of the wireless tag 10 corresponding to the flow line comparison character string, that is, the flow line is generated by referring to the flow line table, and the generated flow line is displayed on the display unit 130. (Step S208). Further, the abnormality determination processing unit 120 identifies the tag identification information of the wireless tag 10, the monitoring area where the wireless tag 10 is currently located, personal information, and the like by referring to each of the tables (step S <b> 209), and suspicious the information Is displayed on the display unit 130 as a person detection result (step S210).

  The abnormality determination processing unit 120 may verify not only the flow line comparison character string and the flow line pattern but also the correlation between the two flow line comparison character strings. Specifically, between two flow line comparison character strings, using the similarity comparison method used in genome analysis etc., the similarity of the character string is calculated, and there is a similarity greater than a predetermined degree In addition, it is possible to determine that the resident who carries the wireless tag 10 corresponding to the flow line comparison character string is a suspicious person.

  Further, instead of simply determining a suspicious person only by a flow line, a determination condition according to personal information may be defined as a flow line pattern. For example, the abnormality determination processing unit 120 refers to the personal information in the person table described above, and includes whether or not the person is a cautionary person (for example, a person with a criminal history) or a security guard in the suspicious person determination condition. it can.

Route instruction processing Next, route instruction processing will be described. The route instruction process is executed by the route instruction unit 140 of the central monitoring apparatus 100. In order to receive a route instruction by the route instruction unit 140, the wireless tag 10 includes a wireless transmission / reception including an identification information holding unit 11, a transmission unit 12, a transmission / reception switching unit 13, and a reception unit 15, as shown in FIG. The warning operation unit 9 shown in FIG. 20 is integrally formed as a PC card 170 having a unit 171 and an antenna 14, and is displayed on a portable information terminal 180 such as a PDA (personal digital assistant) connected to the PC card or the like. Part, speaker, vibration part, etc.

  The route instruction unit 140 extracts the image data of the monitoring area from the image storage unit 150, extracts the position information and the restricted area information of the portable information terminal 180 functioning as the wireless tag 10 from the monitoring information storage unit 105, and extracts them. The image data and the position information are transmitted to the portable information terminal 180 via the relay processing device 40.

  The portable information terminal 180 receives the image data and position information via the antenna 14 and the wireless transmission / reception unit 171. Thereby, the portable information terminal 180 displays on the display unit 169 an image showing the monitoring area map 161, the route 162, the off-limits area 163, the current position 164, the direction 165, and the like, as shown in FIG.

  In order to display the direction, the portable information terminal 180 is provided with means for detecting the direction of, for example, a gyroscope, a geomagnetic direction sensor, and the direction of the direction 165 indicating the direction according to the detection output of the direction detection function. It is necessary to provide a function for generating image data.

  Further, the portable information terminal 180 displays the direction 165 in blue when heading to the destination (outbound) or exit (return), yellow when heading outside the area, and red when heading to the restricted area. By displaying with, a visitor can easily recognize the route. In addition, the route guidance in such a form can be displayed even by using a light emitting unit constituted by an LED or the like without using a PDA.

(Embodiment 4)
Next, a monitoring system and a monitoring method according to the fourth embodiment will be described. The monitoring system and the monitoring method according to the fourth embodiment are modifications of the third embodiment described above.

  FIG. 45 is a block diagram of a schematic configuration of the monitoring system according to the fourth embodiment. In FIG. 45, the same reference numerals are given to the portions common to FIG. 45 differs from FIG. 25 in that a relay processing device 240 is provided instead of the relay processing device 40, and a plurality of human detection sensors 30 are connected to the relay processing device 240. The human detection sensor 30 is installed in each monitoring area in the same manner as the tag reader 20. For example, the human detection sensor 30 is detected by detecting infrared rays, sound, weight in the monitoring area, or radio waves emitted by a device such as a mobile phone carried by a resident. Detect if there are people in the monitored area. This embodiment is characterized in that a tag non-carrying person is detected using the detection output of the human detection sensor 30.

  The relay processing device 240 functions in the same manner as the relay processing device 40 shown in FIG. 1, collects the detection output of the human detection sensor 30, and collects the collected information at a predetermined time interval as an abnormality of the central monitoring device 100. It transmits to the determination processing unit 120. The information that the relay processing device 240 transmits to the central monitoring device 100 includes, for example, as shown in FIG. 46, reader identification information of the tag reader 20 and tag identifications of all the wireless tags 10 detected by the tag reader 20 installed in the monitoring area. It is a table which shows a correspondence with information and information (sensor output, for example, 0: none, 1: existence) which shows detection output of human detection sensor 30 installed in the monitoring field.

  FIG. 47 is a flowchart showing the tag non-carried person detection process according to this embodiment. When the abnormality determination processing unit 120 receives the set of the reader identification information, the tag identification information, and the sensor output shown in FIG. 46 from the relay processing device 240 (step S301), it confirms whether the sensor output is 1 or not. (Step S302). When the sensor output is 1, that is, when there is a visitor in the monitoring area, the abnormality determination processing unit 120 calculates the number of the tag identification information, thereby detecting the wireless signal detected in the monitoring area. The number (TN) of tags 10 is calculated (step S303). When the number of the wireless tags 10 is 0 (step S304: YES), the abnormality determination processing unit 120 determines that there is a person who does not carry the wireless tag in the monitoring area, and displays that fact. It is displayed on 130 (step S305). On the other hand, when the sensor output is not 1 in step S302 and when the number of wireless tags 10 is not 0 in step S304 (step S304: NO), the abnormality determination processing unit 120 executes steps S42 to S49 in FIG. Accordingly, the relay processing device 240, the tag reader 20, and the wireless tag 10 execute steps S32, S22, and S12, respectively. That is, the entry prohibition process as described above is executed.

  As described above, in the monitoring system and the monitoring method according to the third and fourth embodiments, the abnormality determination processing unit 120 includes the entry permission information of the visitor held in the attribute table of the monitoring information storage unit 105, and Depending on the current position and history of the visitor held in the flow line table, the entry of the visitor can be restricted.

  Further, in the monitoring system and the monitoring method according to the third and fourth embodiments, even when a resident takes a suspicious action such as leaving or destroying the wireless tag 10 or when the wireless tag is not carried. , Discovering it or identifying where it took action, and making access restrictions more certain.

  Further, in the monitoring system and the monitoring method according to the third and fourth embodiments, the abnormality determination processing unit 120 determines the target person from the history of the positions of the individual wireless tags 10 held in the flow line table of the monitoring information storage unit 105. By analyzing the flow line, it is possible to determine the attributes of the person being monitored, and to find a suspicious person according to the determination result.

  In the monitoring system and the monitoring method according to the third and fourth embodiments, the route instruction unit 140 uses the data held in the monitoring information storage unit 105 and the image storage unit 150 as the wireless tag 10. Since it transmits to 180, the portable information terminal 180 can implement | achieve a navigation function using those data.

  The operation procedure of the monitoring system according to the first to fourth embodiments described above, that is, the monitoring method can be executed by a computer program. Specifically, the entry restriction information setting process, the attribute correspondence registration process, and the position monitoring process described in the first embodiment, the prior information registration process, the operating information setting process, and the non-carried person detection described in the second embodiment. Processing, behavior suspicious person detection processing, and display control processing, entry prohibition processing described in the third embodiment, tag non-portable person detection processing, suspicious person detection processing and route instruction processing, tag non-portability described in the fourth embodiment Person detection processing and the like can be executed as a computer program on the monitoring system according to each embodiment.

  In particular, the computer program can be provided by a recording medium such as a CD-ROM, a memory card, or a hard disk on which the program is recorded.

1 is a block diagram illustrating a configuration example of a monitoring system according to a first embodiment; It is a figure which shows the structural example of the radio | wireless tag which comprises the monitoring system concerning Embodiment 1. FIG. It is a figure which shows the example of arrangement | positioning of the transmitter / receiver which comprises the monitoring system concerning Embodiment 1. FIG. It is a figure which shows the receiving range of the transmitter / receiver of the monitoring system concerning Embodiment 1. FIG. It is a figure which shows the example of the data containing the detection output of each transmitter / receiver and human detection sensor which the information collection part which comprises the monitoring system concerning Embodiment 1 supplies to a monitoring server. It is a figure which shows the example of the attribute table which shows entrance restrictions information. It is a figure which shows the example of the display image for inputting the said entrance restriction information. It is a figure which shows the example of the display image for inputting the said entrance restriction information. It is a figure which shows the example of the person table which shows a response | compatibility with the identification information of each wireless tag, and the resident who carries the said wireless tag. It is a flowchart which shows the judgment process of the necessity of warning in a judgment part. It is a figure which shows the other structural example of the radio | wireless tag which comprises the monitoring system concerning Embodiment 1. FIG. It is a block diagram which shows the structural example of the monitoring system concerning Embodiment 2. FIG. It is a figure which shows the structural example of the radio | wireless tag which comprises the monitoring system concerning Embodiment 2. FIG. It is a figure which shows the example of arrangement | positioning of the transmitter / receiver of the radio | wireless tag position measurement part which comprises the monitoring system concerning Embodiment 2. FIG. It is a figure which shows the receiving range of the transmitter / receiver of the monitoring system concerning Embodiment 2. FIG. It is a figure which shows an example of the information which shows the log | history stored in flow line DB which comprises the monitoring system concerning Embodiment 2. FIG. It is a figure which shows the example of the layout figure which the display control part which comprises the monitoring system concerning Embodiment 2 displays on a monitor. It is a flowchart which shows a non-portable person detection process. It is a figure which shows the example of a display of the image of the person who is not carrying a wireless tag. It is a figure which shows the example of the process which specifies the person in the image | video of the said monitoring camera. It is a figure which shows the example of the comparison of the movement of the person extracted from the image | video of the said monitoring camera, and the log | history of the position of a wireless tag. It is a flowchart which shows a behavior suspicious person detection process. It is a flowchart which shows the process which displays a suspicious behavior person. It is a figure which shows the example of a display in the said behavior suspicious person display process. It is a block diagram which shows schematic structure of the monitoring system concerning Embodiment 3. FIG. It is a block diagram which shows schematic structure of the radio | wireless tag of the monitoring system concerning Embodiment 3. FIG. It is a figure which shows the example of arrangement | positioning of the tag reader in the monitoring system concerning Embodiment 3, a locking mechanism, and a monitoring camera. It is a figure explaining the relationship between arrangement | positioning of a tag reader, and a wireless tag detection range. It is a figure which shows a tag identification information table. It is a figure which shows a reader table. It is a figure which shows a person table. It is a figure which shows an attribute table. It is a figure which shows a tag-person correspondence table. It is a figure which shows a camera table. It is a figure which shows a door table. It is a figure which shows a flow line table. 10 is a flowchart illustrating an entry prohibition process in the monitoring system according to the third embodiment. 10 is a flowchart showing a tag non-carried person detection process in the monitoring system according to the third exemplary embodiment. It is a figure explaining the method of recognizing the person in video data. It is a figure which shows a person recognition table. It is a figure which shows the warning display which notifies that a tag non-carrying person exists. 10 is a flowchart showing suspicious person detection processing in the monitoring system according to the third exemplary embodiment; It is a figure which shows the example of a flow line comparison character string. It is a figure which shows a route instruction | indication display. It is a block diagram which shows schematic structure of the monitoring system concerning Embodiment 4. FIG. 10 is a diagram illustrating a table transmitted from the relay processing device of the monitoring system according to the fourth embodiment to an abnormality determination processing unit. It is a flowchart which shows a tag non-carried person detection process in the monitoring system concerning Embodiment 4.

Explanation of symbols

DESCRIPTION OF SYMBOLS 9 Warning action | operation part 10, 10A, 10B Wireless tag 11 Identification information holding | maintenance part 12 Transmission part 13 Transmission / reception switching part 14 Antenna 15 Reception part 16 Light emission part 17 Speaker 18 Vibration part 19 Power supply 20 Tag reader 20A Transceiver 20B Visitor information management part 23B Visitor DB
30, 30A human detection sensor 30B wireless tag position measurement unit 31B transceiver 32B data collection unit 40 relay processing device 40A information collection unit 40B monitoring camera 50, 50A wall 50B monitoring camera control unit 60, 60A door 62 lock mechanism 70, 70A monitoring Camera 100A Monitoring server 100B Venue monitoring device 101 Data management unit 101A Receiving unit 102A Position holding unit 103A History holding unit 104A Sensor output holding unit 105 Monitoring information storage unit 110 Data input unit 110A Access limit information input unit 110B Venue monitoring data management unit 111A Access restriction information holding unit 112 Tag identification display reading unit 112A Identification display reading unit 120 Abnormality determination processing unit 120A Determination unit 120B Attribute determination unit 130,169 Display unit 130A Output unit 130B Venue monitor system Part 131,131A door control unit 131B monitors 132,132A Security instructing section 132B display control unit 133A instructs the transmission unit 133 warning indication portion 133B video acquisition unit 134,134A camera control unit 140,140A routing unit 140B flow line DB
150 image storage unit 150B image DB,
160 Flow line pattern storage unit 160B Flow line pattern DB
170 PC Card 171 Wireless Transceiver 180 Mobile Information Terminal 240 Relay Processing Device

Claims (6)

A detection means for detecting a signal wirelessly output from a wireless tag carried by the person to be monitored;
Imaging means;
A number of people detecting means for detecting the number of people existing in a predetermined area from the video information imaged by the imaging means;
Tag number detection means for detecting the number of the wireless tags present in the predetermined area based on the detected signal of the wireless tag;
A person who does not carry the wireless tag in the predetermined area by comparing the number of persons detected by the number-of-people detecting means with the number of wireless tags detected by the number-of-tags detecting means. A non-portable person judging means for judging whether or not exists,
A monitoring system comprising:   And a warning output means for outputting a warning to a person who does not carry the wireless tag when it is determined by the non-carried person determination means that there is a person who does not carry the wireless tag. The monitoring system according to claim 1.   The apparatus according to claim 1, further comprising an output unit that outputs a control signal for controlling an entry control unit provided to enter and exit the predetermined area according to a determination result of the non-carried person determination unit. The monitoring system described.   When it is determined by the non-portable person determination means that there is a person who does not carry the wireless tag, it further comprises notification means for notifying information indicating that there is a person who does not carry the wireless tag. The monitoring system according to claim 1. A signal receiving means for receiving output information wirelessly output from a wireless tag carried by the person to be monitored;
Imaging receiving means for receiving imaging information obtained by imaging a predetermined area by the imaging means;
Number of people detection means for detecting the number of people present in the predetermined area from the received imaging information;
Tag number detection means for detecting the number of the wireless tags present in the predetermined area based on the received output information;
A person who does not carry the wireless tag in the predetermined area by comparing the number of persons detected by the number-of-people detecting means with the number of wireless tags detected by the number-of-tags detecting means. A non-portable person judging means for judging whether or not exists,
A monitoring device comprising: A detection step of detecting a signal that is wirelessly output from a wireless tag carried by the person being monitored;
An imaging step of imaging a predetermined area with an imaging means;
A number of people detection step of detecting the number of people existing in the predetermined area from the video information imaged in the shooting step;
A tag number detection step of detecting the number of the wireless tags present in the predetermined area based on the detected signal of the wireless tag;
A person who does not carry the wireless tag in the predetermined area by comparing the number of persons detected by the number-of-people detecting means with the number of wireless tags detected by the number-of-tags detecting means. A non-portable person determination step for determining whether or not there exists,
The monitoring method characterized by having.

Images