JP5345625B2 - Data communication system - Google Patents

Abstract

Monitoring activity in a remote location is realized by using existing communication networks to minimize a capital investment and enabling the communication of diverse commands or data. When a predetermined state around a monitoring device (10) located in a remote location is detected, a telephone communication circuit (34) of the monitoring device originates a call to a portable terminal (20) by using a portable telephone network (14) and opens an audio communication line using the telephone network between the devices (10) and (20). A packet communication circuit (35) of the monitoring device (10) stores image data in a database of a server (22) through a packet network (12). A packet communication circuit (55) of the portable terminal (20) accesses the server (22) through the packet network (12) and transmits a command to the server (22), and the server (22) transmits predetermined image data to the portable terminal (20) through the packet network (12) according to the command in the state in which the audio communication between the monitoring device (10) and the portable terminal (20) through the portable telephone network (14) is carried on.

Description

  The present invention relates to a data communication system between a monitoring device and a terminal device arranged at a remote place.

  For example, Patent Literature 1 discloses a technique in which a monitoring device is arranged in a remote place to be monitored and image data captured by the monitoring device is transmitted to a mobile terminal device. In this system, the monitoring device transmits image data to the control server, and the control server accumulates the image data. The observer can operate the mobile terminal device to access the control server and request transmission of image data. However, in this technique, voice communication cannot be performed between the monitoring device and the fatigue terminal device in real time.

  Further, Non-Patent Document 1 and Non-Patent Document 2 disclose technologies for controlling devices and devices arranged in the home, such as cameras and home appliances, using a mobile phone.

Non-Patent Document 1 and Non-Patent Document 2 propose a system that enables communication between a FOMA (registered trademark) -compliant mobile phone and a household device or device equipped with a card-type terminal. Has been. For example, an image taken by a camera equipped with a card type terminal is transmitted to the mobile phone via the FOMA (registered trademark) mobile phone network, and the image taken by the camera is displayed on the screen of the display device of the mobile phone. Can be displayed. Further, the user of the mobile phone can transmit a control signal to the card type terminal via the mobile phone network by operating a key of the mobile phone. This realizes camera panning and the like.
International Patent Publication WO02 / 03348 “Development of press-related material“ FOMA AV unit ””, [online], July 12, 2005, NTT DoCoMo, Inc. [Search June 20, 2007], Internet <URL: http: //www.nttdocomo.co.jp/info/news_release/page/20050712c.html> “[Wireless Japan 2005 Vol.3] NTT Docomo demonstrates remote operation of vacuum cleaner robot using FOMA AV unit”, [online], July 24, 2005, ASCII24 mobile 24 mobile phone news, ASCII, Inc. [2007 June Search 20th of March], Internet <URL: http: //akiba.ascii24.com/k-tai/news/2005/07/13/656958-000.html>

  The above system uses a mobile phone network that can realize a specific function called FOMA (registered trademark), and data communication cannot be performed in an area where the mobile phone network that can realize the specific function cannot be used. There is a point. In order to enable data communication, capital investment for the specific mobile phone network is required.

  In the above system, voice, image, and control signal are transmitted through a single mobile phone network. Particularly, since the control signal uses a so-called push button sound, the accuracy of the control signal is not always good. Further, the control signal using the push button sound has a problem that various commands and data cannot be transmitted / received between the mobile phone and a device or device in the home.

  It is also conceivable that the techniques disclosed in Non-Patent Documents 1 and 2 are applied to a monitoring device for monitoring an intruder or the like outdoors instead of a home device, and the monitoring device is controlled by a mobile phone. In this case, in particular, the monitoring device is arranged at a place where monitoring by a person is impossible, such as a border. Therefore, it is very difficult to use a mobile phone network that can realize special functions such as Non-Patent Document 1 and Non-Patent Document 2. In addition, since control signals are transmitted over a mobile phone network used for voice communication, there is still a problem that various commands and data cannot be transmitted and received between the mobile phone and devices and devices in the home. To do.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a data communication system that uses existing communication networks to minimize equipment investment, can communicate various commands and data, and realizes monitoring activities in remote locations.

An object of the present invention is to provide telephone communication means for controlling voice communication via a telephone network including a mobile telephone network, and packet communication means for controlling data communication via a packet network not via the telephone network. A portable terminal device in which the telephone communication means and the packet communication means operate in parallel;
A server connected to the packet network, comprising a database capable of storing data in a predetermined area specified by a predetermined URL, and packet communication means for controlling communication via the packet network Server,
A microphone, a speaker and a camera; a telephone communication means for controlling voice communication via a telephone network including a mobile telephone network; a packet communication means for controlling data communication via a packet network not via the telephone network; A database that stores at least image data captured by the camera together with data indicating the shooting date and time, and a telephone communication unit that controls to transmit an audio signal from the microphone via the telephone network, and at least the A data communication system comprising: a monitoring device having control means for controlling image data taken by a camera by means of the packet communication means so as to transmit the image data via the packet network,
When the control unit of the monitoring device detects a predetermined state around the monitoring device, the telephone communication unit of the monitoring device calls the telephone communication unit of the portable terminal device using the telephone network. A voice communication line using a telephone network between the monitoring device and the portable terminal device is opened, and the packet communication means of the monitoring device stores at least the image data stored in the database via the packet network. Is transmitted to the server, and stored in the predetermined area in the database of the server,
In a state where voice communication between the monitoring device and the mobile terminal device via the telephone network is continued, the packet communication means of the mobile terminal device uses the URL via the packet network to Accessing the server, the packet communication means of the mobile terminal device sends a command to the server,
The packet communication means of the server transmits the image data stored in the predetermined area to the portable terminal device via the packet network according to the command,
The packet communication means of the portable terminal device receives image data transmitted via the packet network, and the received image data is displayed on a screen of a display device of the portable terminal device. Achieved by a data communication system.

In a preferred embodiment, the monitoring device has a plurality of output devices,
The control unit of the monitoring device is configured to generate a control signal for controlling the plurality of output devices, and to output a control signal to each of the plurality of output devices,
The packet communication means of the server transfers the command received from the mobile terminal device via the packet network to the monitoring device via the packet network,
The packet communication means of the monitoring device receives the command,
The control unit of the monitoring device generates a control signal for controlling any of the plurality of output devices, the camera, the speaker, and the microphone based on the command.

  Further, in a preferred embodiment, as long as voice communication via the telephone network is continued, the packet communication means of the monitoring device is the server for image data captured by the camera via the packet network. Repeat communication to.

In a more preferred embodiment, as long as the communication of the voice signal through the telephone network is continued, the packet communication means of the mobile terminal device repeatedly transmits a command to the server,
The packet communication means of the server transmits the latest image data among the image data stored in the predetermined area to the portable terminal device via the packet network in accordance with the command.

Another object of the present invention is to provide a mobile phone device having a telephone communication means for controlling voice communication via a telephone network including a mobile phone network,
A terminal device having packet communication means for controlling data communication through a packet network not through the telephone network;
A server connected to the packet network, comprising a database capable of storing data in a predetermined area specified by a predetermined URL, and packet communication means for controlling communication via the packet network Server,
A microphone, a speaker and a camera; a telephone communication means for controlling voice communication via a telephone network including a mobile telephone network; a packet communication means for controlling data communication via a packet network not via the telephone network; A database that stores at least image data captured by the camera together with data indicating the shooting date and time, and a telephone communication unit that controls to transmit an audio signal from the microphone via the telephone network, and at least the A data communication system comprising: a monitoring device having control means for controlling image data taken by a camera by means of the packet communication means so as to transmit the image data via the packet network,
When the control unit of the monitoring device detects a predetermined state around the monitoring device, the telephone communication unit of the monitoring device calls the telephone communication unit of the mobile phone device using the telephone network. A voice communication line using a telephone network between the monitoring device and the mobile phone device is opened, and the packet communication means of the monitoring device transmits at least the image data stored in the database via the packet network. Is transmitted to the server, and stored in the predetermined area in the database of the server,
In a state where voice communication between the monitoring device and the mobile terminal device via the telephone network is continued, the packet communication means of the terminal device uses the URL via the packet network to the server. The packet communication means of the terminal device sends a command to the server,
The packet communication means of the server transmits the image data stored in the predetermined area to the terminal device via the packet network according to the command,
Data in which the packet communication means of the terminal device receives image data transmitted via the packet network, and the received image data is displayed on a screen of a display device of the terminal device Achieved by the communication system.

In a preferred embodiment, the monitoring device has a plurality of output devices,
The control unit of the monitoring device is configured to generate a control signal for controlling the plurality of output devices, and to output a control signal to each of the plurality of output devices,
The packet communication means of the server transfers the command received from the terminal device via the packet network to the monitoring device via the packet network,
The packet communication means of the monitoring device receives the command,
The control unit of the monitoring device generates a control signal for controlling any of the plurality of output devices, the camera, the speaker, and the microphone based on the command.

  In a preferred embodiment, as long as voice communication via the telephone network is continued, the packet communication means of the monitoring device transmits image data taken by the camera via the packet network to the server. Repeat transmission.

In another preferred embodiment, the monitoring device has a driving device for moving in a predetermined range, and drives the driving device to acquire image data while moving in the predetermined range.
When the control unit of the monitoring device detects the predetermined state, the driving device is stopped.

In a more preferred embodiment, the data communication system includes a charging station that supplies power to the storage battery at any position in the predetermined range,
The monitoring device has a power supply circuit including a rechargeable storage battery, and when the control circuit of the monitoring device detects that the remaining battery level of the storage battery is a predetermined value or less, the monitoring device moves to the charging station. The drive circuit is controlled.

In another preferred embodiment, the monitoring device includes position detection means for detecting a current position of the monitoring device and acquiring position data indicating the current position,
The control unit of the monitoring device is configured to determine that a predetermined state is detected when there is a change in the image data at the same position with reference to the position data acquired by the position detection unit,
The packet communication means of the monitoring device is configured to transmit the image data and position data to the server via the packet network.

In another preferred embodiment, the control means of the monitoring device acquires audio data at the time of shooting by the camera,
The packet communication means of the monitoring device is configured to transmit the image data and audio data at the time of shooting by the camera to the server via the packet network.

  According to the present invention, it is possible to provide a data communication system that uses existing communication networks to minimize capital investment, can communicate a wide variety of commands and data, and realizes remote monitoring activities. Become.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. FIG. 1 is a block diagram showing an outline of a data communication system according to a first embodiment of the present invention. In the present embodiment, data communication is possible between the monitoring device 10 located at a remote place and the mobile terminal device 20 via a communication network as will be described later.

  As shown in FIG. 1, the data communication system according to the present embodiment includes a monitoring device 10, a center device 16, and a mobile terminal device 20. The monitoring device 10 can be connected to both the packet network 12 and the mobile phone network 14 at the same time. In the present embodiment, the mobile phone network 14 may be anything that can perform voice communication.

  In addition, the monitoring device 10 can be connected to the packet network 12 without using a mobile phone network or a gateway like a conventional mobile phone. The connection to the packet network 12 here can be realized through a network such as a wireless LAN (not shown) other than the cellular phone network 14. Similarly, the mobile terminal device 20 can be connected to both the packet network 12 and the mobile phone network 14 at the same time, and can be connected to the packet network 12 without going through a mobile phone network or a gateway.

  The center device 16 includes a server 22 and a telephone information server 24. The server 22 has the following functions, for example.

  The server 22 stores data transmitted from the monitoring device 10 via the packet network 12 in a database (not shown), and transmits data to the mobile terminal device 20. At this time, the data format (format) is adjusted according to the model of the monitoring apparatus 10. For image data, image size adjustment is included. Further, the server 22 accepts control information (command) transmitted from the mobile terminal device 20 via the packet network 12 and transfers it to the monitoring device 10.

  The telephone information server 24 controls telephone notification via the mobile phone network 14 between the monitoring device 10 and the mobile terminal device 20. In addition, call records in the monitoring device 10, call records in the mobile terminal device 20, and the like can be stored in a database (not shown).

  Furthermore, the telephone information server 24 can also control reporting to the multiple partners (the monitoring device 10 and the mobile terminal device 20), for example, when it is necessary to make a phone call to multiple partners. For example, the telephone information server 24 can realize broadcast communication from the monitoring device 10 to the plurality of mobile terminal devices 20 via the mobile phone network 14. In addition, broadcast communication from the mobile terminal device 20 to the plurality of monitoring devices 10 can be realized through the mobile phone network 14. The telephone information server 24 can also store the audio signal transmitted from the monitoring device 10 or the mobile terminal device 20 in the database.

  FIG. 2 is a block diagram showing a configuration example of the monitoring apparatus according to the present embodiment. As shown in FIG. 2, the monitoring apparatus 10 according to the present embodiment includes a central processing unit 31, a video control unit 32, an audio control unit 33, a telephone communication circuit 34, a packet communication circuit 35, an input control unit 36, and output control. Unit 37, power supply circuit 38, drive circuit 39, and position detection unit 45. The central processing unit 31 outputs a control signal to the connected control unit and circuit, and causes each of the control unit and the circuit to execute a predetermined operation.

  The video control unit 32 is connected to the camera 40 and can control shooting by the camera 40, the position (direction) of the camera 40, zooming, and the like. Further, the video control unit 32 outputs image data (image data) taken by the camera 40 to the central processing unit 31. The audio processing unit 33 is connected to the microphone 41 and the speaker 42. The voice processing unit 33 accepts the voice input to the microphone 41 and outputs the received voice data (voice data) to the central processing unit 31. In addition, an audio signal is output to the speaker 42 based on the audio data received from the central processing unit 31.

  The telephone communication circuit 34 can transmit radio waves including audio signals to the mobile phone network 14 via the antenna, and can also receive radio waves from the mobile phone network 14. The telephone communication circuit 34 generates an audio signal based on the audio data given from the central processing unit 31, and transmits a radio wave including the signal from the antenna. Also, the audio data is obtained by decoding a signal based on the radio wave received from the antenna.

  The packet communication circuit 35 can transmit a radio wave including a packet of image data or audio data to the packet network 12 via an antenna. Further, the packet control circuit 35 can receive a packet including control information (command) from the packet network 12. The packet communication circuit 35 packetizes the image data and audio data received from the central processing unit 31 and sends the generated packet to the packet network 12 via the antenna. Further, the packet communication circuit 35 extracts control information and the like from the packet received from the packet network 12 via the antenna and outputs the control information to the central processing unit 21. As the telephone communication circuit 34 or the packet communication circuit 35, for example, a mobile card conforming to the communication standard of IEEE 802.15, IEEE 802.16, or IEEE 802.20 can be used.

  The input control unit 36 is connected to the various sensors 43-1, 43-2,..., 43-n and accepts detection signals from the sensors. The sensor includes an infrared sensor, a voice sensor, a temperature sensor, and the like. The output control unit 37 is connected to the various output devices 44-1, 44-2,..., 44-m, and outputs drive signals for operating the output devices. The output device includes, for example, a red rotating light for intimidation against an intruder, a flash LED flashing at a predetermined time interval, a siren for intimidation by voice, an air cannon, and the like.

  The power supply circuit 38 includes a rechargeable storage battery and supplies power to each of a drive circuit 39, a central processing unit 31, a control unit, and a circuit, which will be described later. Further, the power supply circuit 38 gives information indicating the remaining battery level to the central processing unit 31. The drive circuit 39 has a motor (not shown) for moving the monitoring device 10 along the track as will be described later, and power is supplied from the power supply circuit 38 to the motor. The drive circuit 39 operates the motor according to the control signal from the central processing unit 31 to move the monitoring device 10.

  The position detection unit 45 has a so-called GPS receiver, and can acquire the current position of the monitoring device 10 by receiving GPS radio waves. The acquired position data indicating the current position is output to the central processing unit 31.

  FIG. 3 is a block diagram showing a configuration example of the mobile terminal device 20 according to the present embodiment. As shown in FIG. 3, the mobile terminal device 20 according to the present embodiment includes a CPU 51, an input device 52, a display device 53, a telephone communication circuit 54, a packet communication circuit 55, a voice control unit 56, a memory 57, a speaker 58, And it has a microphone 59. The CPU 51, the input device 52, the display device 53, the telephone communication circuit 54, the packet communication circuit 55, the voice control unit 56, and the memory 57 are connected via a bus 60.

  In the present embodiment, the audio signal input via the microphone 59 is transmitted to the mobile phone network 14 via the telephone communication circuit 54 via the antenna. The voice data received from the cellular phone network 14 via the antenna is subjected to a certain process in the telephone communication circuit 54, and the corresponding voice is output from the speaker 58.

  Control information (command) including characters and the like input by operating the input device 52 is packetized and sent to the packet network 12 via the antenna of the packet communication circuit 55. A packet including image data received by the antenna via the packet network 12 is processed by the packet communication circuit 55, and the obtained image data is displayed on the screen of the display device 53. If the packet includes audio data, the packet communication circuit 55 extracts the audio data from the packet. Thereby, the corresponding sound is output from the speaker 58.

  In the present embodiment, the telephone communication circuit 54 and the packet communication circuit 55 can operate simultaneously. As a result, voice communication via the mobile phone network 14 using the telephone communication circuit 55 and communication of control information and image data via the packet network 12 using the packet communication circuit 55 are realized simultaneously in parallel. To do.

  In the present embodiment, the mobile terminal device 20 accesses a predetermined URL, logs in to the server 22, and stores it in a predetermined area in the database of the server 22 in which image data from the monitoring device 10 is stored. A script for requesting transmission of the received image data or the like is stored in the memory 57.

  FIG. 4 is a diagram illustrating a configuration example of a track on which the monitoring device 10 is arranged. FIG. 4A shows an example in which the monitoring device 10 is arranged on the straight track 61. In the example shown in FIG. 4A, the monitoring apparatus 10 reciprocates between the end points 63 and 64 along the track 61 (see arrow 401). A charging station 62 is disposed at a predetermined position along the track. The charging station 62 can be connected to the power supply circuit 38 when the monitoring apparatus 10 is at a predetermined position facing the charging station 62, and can charge the storage battery of the power supply circuit 38.

  FIG. 4B shows an example in which the monitoring device 10 is arranged on the closed track 65. In FIG. 4B, the monitoring device 10 can move in one direction (see arrow 402) on the normally closed track 65. Also in this example, the charging station 62 is disposed at a predetermined position along the track 65, and the storage battery of the power supply circuit of the monitoring device 10 can be charged.

  FIG. 5 is a flowchart showing an outline of processing executed in the monitoring apparatus according to the present embodiment. As shown in FIG. 5, the central processing unit 21 of the monitoring device 10 acquires information on the remaining battery level of the storage battery from the power supply circuit 38, and determines whether or not the remaining battery level is equal to or less than a predetermined value (step 501). ). When it is determined Yes in step 501, the central processing unit 21 instructs the drive circuit 39 to move the monitoring device 10 to the position of the charging station (step 502). When the monitoring device 10 is moved to a position facing the charging station 62 on the track, charging of the storage battery of the power supply circuit 38 is started at that position. The central processing unit 31 determines whether charging is completed (step 503).

  When charging is completed (Yes in step 503). The central processing unit 21 instructs the drive circuit 39 to move at a predetermined speed on the track, and also instructs the video control unit 32 to take an image with the camera 40 (step 504). The central processing unit 21 may instruct the audio control unit 33 to acquire audio data at the time of image shooting. Hereinafter, a case where audio data at the time of photographing is acquired together with image data will be described.

  Note that the video control unit 32 acquires the moving speed of the monitoring device 10 on the track by the drive circuit 39 from the central processing unit 31, and determines the time interval of image capturing based on the moving speed. As a result, as the moving speed increases, the photographing time interval is shortened, and images can be taken at substantially the same distance interval. In step 504, the central processing unit 31 instructs the position detection unit 45 to acquire the current position at the time of image shooting. The central processing unit 31 associates the obtained image data, data indicating the shooting date and time, audio data at the time of shooting, and position data of the current position at the time of shooting, and a database (not shown) in the storage device of the monitoring device 10. To remember. As will be described later, in the present embodiment, an alert process is started when there is a change in an image or a response to a sensor, and the packet network 12 and the mobile phone between the monitoring device 10 and the mobile terminal device 12 are started. Communication using the network 14 is performed. In the present embodiment, a set of data indicating a predetermined number of image data, audio data, data at a position, and shooting date and time is held in the database before the alert process is started. This predetermined number (for example, n) of data is referred to as pre-alert data.

  The central processing unit 31 refers to the position data associated with the image data stored in the database, identifies the image data captured last time at the same position, and the previously captured image data and the current captured image data. Compare with image data. The central processing unit 31 determines whether or not the image data has changed (step 505). When it is determined Yes in step 505, the central processing unit 31 executes alert processing (step 507). In the alert process, as will be described in detail later, communication is performed between the monitoring device 10 and the mobile terminal device 12 via the packet network 12 and the mobile phone network 14.

  When it is determined No in step 505, the central processing unit 31 acquires information on the sensors 43-1 to 43-n from the input control unit 36 and determines whether any of the sensors has reacted. (Step 506). For example, when a certain level of sound is input to the sound sensor, or when an object that emits heat is detected by the infrared sensor or the temperature sensor, it is determined in step 506 that the sensor has reacted. Even when it is determined Yes in step 506, the central processing unit 31 executes alert processing (step 507).

  Next, alert processing in the monitoring device 10 according to the present embodiment and processing executed in the server and the mobile terminal device in association with the alert processing will be described with reference to FIGS. As shown in FIG. 6, in the monitoring device 10, when the alert process is started, the central processing unit 31 instructs the drive circuit 39 to stop the monitoring device 10. The drive circuit 39 stops the monitoring device 10 (step 601). Next, the central processing unit 31 acquires image data, audio data, and position data at the stopped position, and stores them in the database together with the shooting date and time of the image data (step 602).

  The central processing unit 21 extracts pre-alert data stored in the database before the alert processing is started, and outputs the pre-alert data to the packet communication circuit 35 together with the data acquired in step 602. The packet communication circuit 35 packetizes the pre-alert data and the image data, audio data, position data, and data indicating the shooting date and time acquired in step 602, and transmits them to the server 22 via the packet network 12 (step 603). .

  FIG. 9 is a diagram illustrating an example of transmission of image data captured by the monitoring device 10 to the server 22 and transmission from the server 22 to the mobile terminal device 20. Although only image data is shown in FIG. 9, in the present embodiment, the data actually stored in the database and transmitted to the server 22 includes image data, audio data, position data, and shooting date and time. It is the data shown. As shown in FIG. 9, in this embodiment, n pieces of image data Im (t−1) to Im (t−n) are held in the database before the alert process is started. Therefore, in step 603 of FIG. 6, these n pieces of data are transmitted to the server 22 as pre-alert data (pre-alert image data) (see reference numeral 901). Further, the image data Im (t) acquired at the start of the alert process is also transmitted to the server 22 in step 603 of FIG. 6 (see reference numeral 902).

  The server 22 acquires image data, audio data, position data, and data indicating the shooting date and time from the received packet, and stores them in the database of the server 22 (step 604). The server 22 stores the acquired image data, audio data, position data, and data indicating the shooting date and time in a predetermined area of the database. The predetermined area in the database can be specified by a URL. The URL is stored in the database of the server 22 in association with the monitoring device 10 that is the data transmission source. Thereby, the image data transmitted from the monitoring device 10 can be stored in the database area specified by the predetermined URL.

  Next, the telephone communication circuit 34 of the monitoring device 10 refers to the telephone number of the operator stored in advance in the storage device, and dials the mobile terminal device 20 using the mobile phone network 14 (steps 605 and 606). ). As a result, the mobile terminal device 20 is called, and when the operator performs an operation to start a call (step 607), the communication line between the monitoring device 10 and the mobile terminal device 20 via the mobile phone network 14 is established. Is opened (step 608).

  6 to 8, communication using the cellular phone network 14 is indicated by a broken line, while communication using the packet network 12 is indicated by a solid line.

  Communication (voice communication) via the mobile phone network 14 is continued between the monitoring device 10 and the mobile terminal device 20 by the call operation in the mobile terminal device 20 shown in Step 607 (Step 700). For example, the voice input by the operator in the mobile terminal device 20 is accepted by the telephone communication circuit 34 of the monitoring device 10 via the mobile phone network 14 (step 701). Voice corresponding to the voice data accepted by the telephone communication circuit 34 is output from the speaker 42 (step 702).

  The operator can access the server 22 via the packet network 12 by operating the input device 52 of the mobile terminal device 20. The mobile terminal device 20 according to the present embodiment accesses a predetermined URL, logs in to the server 22, and is stored in a predetermined area in the database of the server 22 in which image data from the monitoring device 10 is stored. A script for requesting transmission of image data is stored in the memory 57.

  For example, the operator operates the input device 52 of the mobile terminal device 20 to cause the CPU 51 of the mobile terminal device 20 to read the script stored in the memory 57 and execute the script. Thereby, the packet communication circuit 55 of the mobile terminal device 20 accesses the server 22 via the packet network 12 using a predetermined URL.

  The packet communication circuit 55 of the mobile terminal device 20 reads the operator ID and password stored in the memory 57 according to the script, and the packet communication circuit 55 transmits the operator ID and password to the server 22 (step 703). ). Thereby, the portable terminal device 20 can log in to the server 22 (step 704).

  After the voice communication is started (refer to step 608 in FIG. 6), the image data, the voice data, the position data, and the data indicating the shooting date / time acquired by the monitoring apparatus 10 are periodically acquired and transmitted via the packet network 12. Are transmitted to the server 22 and stored in a predetermined area in the database of the server 22 (steps 705 and 706). Steps 705 and 706 are the same as steps 603 and 604 in FIG.

  Note that when the operator performs an operation to start a call on the mobile terminal device 20 (step 607), the script by the CPU 21 of the mobile terminal device 20 is automatically read and stored in the storage device of the mobile terminal device 20. Based on the information indicating the URL, the packet communication circuit 55 of the mobile terminal device 20 may access the server 22 using the URL.

  According to the script, the packet communication circuit 55 of the mobile terminal device 20 sends image data or the like to the server 22 periodically after login or in response to the operation of the input device 52 of the mobile terminal device 20 by the operator. Is transmitted (step 707). The server 22 refers to the data indicating the photographing time associated with the image data stored in the predetermined area of the database, searches for the latest image data, etc., and searches the searched image data, audio data, and position data. The included packet is transmitted to the mobile terminal device 20 (steps 708 and 709). In FIG. 9, the server 22 stores image data from the monitoring device 10 including pre-alert data. In response to the data transmission request in step 707, the latest image data Im (t + k) is transmitted to the mobile terminal device 20 (see reference numerals 903 and 904).

  The packet communication circuit 55 of the mobile terminal device 20 receives a packet including image data transmitted via the packet communication path 12. An image corresponding to the received image data is displayed on the screen of the display device 53 (step 710). In addition, sound corresponding to the sound data is output from the speaker 58. Note that the transmission request (step 707) of image data or the like to the server 22 by the packet communication circuit 55 is as long as the communication of the audio signal between the monitoring device 10 and the mobile terminal device 20 via the mobile phone network 14 is continued. It is desirable to be repeated.

  As described above, according to the present embodiment, the mobile terminal device 20 can receive image data or the like via the packet network 12 in a state where voice communication using the mobile phone network 14 is continued. Further, image data captured by the camera 40 of the monitoring device 10 is periodically transmitted to the server 22, and the mobile terminal device 20 periodically requests transmission of image data stored in the database of the server 22, By receiving image data and the like, the latest image and sound can be confirmed on the mobile terminal device 20.

  In the present embodiment, control information (command) is transmitted from the mobile terminal device 20 to the monitoring device 10 while voice communication is continued between the monitoring device 10 and the mobile terminal device 20. You can also.

  In FIG. 8, the communication (voice communication) via the mobile phone network 14 is continued between the monitoring device 10 and the mobile terminal device 20 (step 800). For example, in the monitoring device 10, the voice (step 801) input to the microphone 41 is accepted by the telephone communication circuit 54 of the mobile terminal device 20 via the mobile phone network 14 (step 802). Voice corresponding to the voice data received by the telephone communication circuit 54 is output from the speaker 58.

  For example, in steps 701 and 702 of FIG. 7, the voice input by the operator of the mobile terminal device 20 is output from the speaker 42 of the monitoring device 10. For example, intimidation or inquiring voice is issued to a person photographed by the camera 40 of the monitoring device 10. In response to this, in steps 801 and 802 in FIG. 8, a response by the voice of the person photographed by the camera 40 is issued from the speaker 58 of the portable terminal device 20.

  As shown in FIG. 8, in a state where voice communication is continued between the monitoring device 10 and the mobile terminal device 20 via the mobile phone network 14 (step 800), the operator inputs the mobile terminal device 20. A command can be input by operating the device 52 (step 803). For example, a command icon is included in the image data transmitted from the server 22 to the mobile terminal device 20. The command icon is an icon in which a command name or a graphic representing the command displayed in the image is described. The server 22 may store the command icon in advance in the database in association with the operation to be executed when the command icon is designated. The operator of the mobile terminal device 20 can transmit a command to the server 22 by designating a desired command icon displayed on the image of the display device 53.

  For example, the command includes control of the output devices 44-1 to 44-m connected to the output control unit 37 of the monitoring device 10, control of the camera 40 of the monitoring device 10, control of the position of the monitoring device, database of the server 22 Includes instructions for image data and audio data stored in the. More specifically, the control of the output device includes lighting of a red rotating lamp, flashing of a flash LED, sounding by a siren, firing of an empty gun, and the like. The control of the camera 40 includes taking an image, changing the position (direction) of the camera 40, zooming in, and zooming out. Further, in the instruction for the image data and the sound data, the past image data and sound data stored in the database of the server 22 are referred to and reproduced, and the image data and sound data are stored with a separate file name. Etc. are included.

  The command input by the operator is transmitted from the packet communication circuit 55 of the mobile terminal device 20 to the server 22 via the packet network 12 (step 804). When receiving the command, the server 22 transfers the command to the monitoring apparatus 10 via the packet network 12 (steps 805 and 806).

  When the packet communication circuit 35 of the monitoring device 10 receives the command, the central processing unit 31 instructs the output control unit 37, the video control unit 32, or the drive circuit 39 to control the device indicated by the command. The output control unit 37, the video control unit 32, or the drive circuit 39 outputs a control signal to a predetermined device or the like according to an instruction from the central processing unit 31 (step 807). Thereby, a device to be controlled is controlled according to the command.

  Further, if the command relates to image data or audio data stored in the database of the server 22, the server 22 operates in accordance with the command. For example, if the request is for past image data stored in the database (step 811), the server 22 refers to the data indicating the shooting date and time associated with the image data stored in the database and follows the request. The image data is searched, and the searched image data is transmitted to the mobile terminal device 20 (steps 812 and 813). The packet communication circuit 55 of the mobile terminal device 20 receives the image data. An image corresponding to the received image data is displayed on the screen of the display device 53 (step 814).

  In the present embodiment, a predetermined number (n) of image data, sound data, position data, and data indicating the shooting date and time before the alert processing is started are stored in the database of the server 22 as pre-alert data. It is remembered. Therefore, by repeating steps 811 to 814 and acquiring the pre-alert data and the subsequent data, it is possible to confirm a change in the image before and after the start of the alert process in the monitoring device 10.

  According to the present embodiment, the mobile terminal device 20 transmits a command to the monitoring device 10 and the server 22 via the packet network 12 in a state where voice communication using the mobile phone network 14 is continued. It is possible to perform a desired operation. In particular, if a command icon is displayed in the image and the command is transmitted by designating the command icon, the operator can input the command with a minimum operation.

  In the present embodiment, the image data and the commands and commands are not transmitted along with the audio signal via the mobile phone network 14, but are monitored via the packet network 12, the server 22, and the mobile terminal device. 12 are transmitted and received. In addition to voice communication via the mobile phone network 14, voice data can also be transmitted and received using the packet network 12. Therefore, a larger amount of data and various commands can be transmitted and received among the monitoring device 10, the server 22, and the mobile terminal device 12. Furthermore, since image data and commands and commands are transmitted / received via the packet network 12, as described above, a command icon can be displayed on the image and the command can be transmitted by designating the command icon.

  The data communication system according to the present embodiment is assumed to be used as follows. For example, as shown in FIG. 10A, a trajectory 1001 is installed along a border (see reference numeral 1000), and the monitoring device 10 is arranged on the trajectory 1001, as shown in FIG. 10A. The monitoring device 10 is moved on the orbit at a predetermined speed (see arrow 1002). As shown in FIG. 10B, if a suspicious person has entered (see reference numeral 1010), the monitoring apparatus 10 starts alert processing and performs communication using the mobile phone network 14 and the packet network 12 (see reference numeral 1011). . Moreover, as shown to FIG. 10C, an audio | voice can be output from a speaker by audio | voice communication via the mobile telephone network 14 from the portable terminal device 12 (refer code | symbol 1020). Further, as shown in FIG. 10D, when the intruder moves (see reference numeral 1030), the monitoring apparatus 10 can be moved according to the command from the operator's portable terminal device 20 (see reference numeral 1031). .

  Next, a second embodiment of the present invention will be described. In the first embodiment, a mobile terminal device 20 that can simultaneously access the packet network 12 and the mobile phone network 14 in parallel is used, and the packet network between the monitoring device 10 and the mobile terminal device 20 is used. 12 and the cellular phone network 14 are used to realize data communication and voice communication. On the other hand, in the second embodiment, as shown in FIG. 11, a mobile phone device that performs voice communication with the monitoring device 10 via the mobile phone network 14 instead of the mobile terminal device 12. 121 and a terminal device 122 that performs data communication with the monitoring device 10 via the packet network 12 are provided in the data communication system. The mobile phone device 121 is the same as a commonly used mobile phone. The terminal device can also be realized by a personal computer provided with communication means capable of packet communication.

  The processing executed between the monitoring device, the server, and the mobile phone device from the start of the alert process in the monitoring device 10 to the start of voice communication using the mobile phone network is the same as that shown in FIG. . In the second embodiment, the mobile phone device 121 may be used instead of the mobile terminal device 20 shown at the right end of FIG.

  12 and 13 are flowcharts illustrating an example of processing executed between the monitoring device, the server, the mobile phone device, and the terminal device. FIGS. 12 and 13 correspond to FIGS. 7 and 8 according to the first embodiment, respectively.

  Steps 1200 to 1202 in FIG. 12 correspond to steps 700 to 702 in FIG. 7, respectively. In the second embodiment, voice communication via the mobile phone network 14 is performed between the monitoring device 10 and the mobile phone device 121. Between. Steps 1203 to 1210 in FIG. 12 correspond to steps 703 to 710 in FIG. In the second embodiment, data communication via the packet network 12 is performed between the monitoring device 10, the server 22, and the terminal device 122.

  Similarly, steps 1300 to 1302 in FIG. 13 correspond to steps 800 to 802 in FIG. 8, respectively. In the second embodiment, voice communication via the mobile phone network 14 is performed between the monitoring device 10 and the mobile phone. This is performed with the apparatus 121. Further, steps 1303 to 1307 and 1311 to 1314 in FIG. 13 correspond to steps 803 to 807 and 811 to 814 in FIG. 8, respectively. However, in the second embodiment, data communication via the packet network 12 is performed between the monitoring device 10, the server 22, and the terminal device 122.

  Also in the second embodiment, the terminal device 122 accesses a predetermined URL, logs in to the server 22, and stores a predetermined area in the database of the server 22 in which image data from the monitoring device 10 is stored. A script for requesting transmission of image data or the like stored in the memory is stored in a memory (not shown). Therefore, the user of the terminal device 122 causes the CPU (not shown) of the terminal nest removal 122 to read the script stored in the memory and execute the script. Accordingly, a packet communication circuit (not shown) of the terminal device can access the server 22 using the predetermined URL via the packet network 12.

  In the second embodiment, voice communication with the monitoring device 10 via the mobile phone network 14 uses normal mobile phone devices and data via the packet network 12 with the monitoring device 10. The communication uses a terminal device such as an ordinary personal computer. Therefore, similar data communication can be realized without using the portable terminal device 20 having the configuration described in the first embodiment.

  The present invention is not limited to the above embodiments, and various modifications can be made within the scope of the invention described in the claims, and these are also included in the scope of the present invention. Needless to say.

  For example, in the above-described embodiment, the monitoring device 10 is arranged on a track (see FIGS. 4A and 4B) and configured to be able to move on the track. However, the movement of the monitoring device 10 is the above-described embodiment. It is not limited to those described in. The monitoring device 10 may be configured so as to be able to travel within a predetermined range by including three or four wheels as in a normal vehicle and making the front wheels steerable. Or the monitoring apparatus 10 is good also as a structure which is equipped with a main rotor and a tail rotor like a helicopter, and can fly a predetermined range. Even when the monitoring device 10 takes the form of a vehicle or a helicopter, the movement of the monitoring device can be controlled by transmitting a command from the mobile terminal device 20 to the monitoring device 10 via the server 22.

  Moreover, in the said embodiment, although the storage battery which can be charged is mounted in the power supply circuit, the solar generator and the wind power generator are further mounted in the monitoring apparatus 10, and the electric power from these generators can be charged. You may comprise as follows.

FIG. 1 is a block diagram showing an outline of a data communication system according to a first embodiment of the present invention. FIG. 2 is a block diagram showing a configuration example of the monitoring apparatus according to the present embodiment. FIG. 3 is a block diagram showing a configuration example of the mobile terminal device 20 according to the present embodiment. 4A and 4B are diagrams illustrating a configuration example of a track on which the monitoring device 10 is arranged. FIG. 5 is a flowchart showing an outline of processing executed in the monitoring apparatus according to the present embodiment. FIG. 6 is a flowchart illustrating an example of processing executed in the monitoring device, the server, and the mobile terminal device according to the present embodiment. FIG. 7 is a flowchart illustrating an example of processing executed in the monitoring device, the server, and the mobile terminal device according to the present embodiment. FIG. 8 is a flowchart illustrating an example of processing executed in the monitoring device, the server, and the mobile terminal device according to the present embodiment. FIG. 9 is a diagram illustrating an example of transmission of image data captured by the monitoring device 10 to the server 22 and transmission from the server 22 to the mobile terminal device 20. 10A to 10D are diagrams illustrating an example of the operation of the monitoring apparatus according to the present embodiment. FIG. 12 is a block diagram showing an outline of a data communication system according to the second embodiment of the present invention. FIG. 12 is a flowchart illustrating an example of processing executed in the monitoring device, the server, the mobile phone device, and the terminal device according to the second embodiment. FIG. 13 is a flowchart illustrating an example of processing executed in the monitoring device, the server, the mobile phone device, and the terminal device according to the second embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Monitoring apparatus 12 Packet network 14 Mobile telephone network 16 Center apparatus 20 Portable terminal device 22 Server 24 Telephone information server 31 Central processing part 32 Video processing part 33 Voice processing part 34 Telephone communication circuit 35 Packet communication circuit 36 Input processing part 37 Output processing Section 38 Power supply circuit 39 Drive circuit 45 Position detection circuit

Claims (9)

Telephone communication means for controlling voice communication via a telephone network including a mobile telephone network, and packet communication means for controlling data communication via a packet network not via the telephone network, the telephone communication means And a portable terminal device in which the packet communication means operate in parallel,
A server connected to the packet network, comprising a database capable of storing data in a predetermined area specified by a predetermined URL, and packet communication means for controlling communication via the packet network Server,
A microphone, a speaker and a camera; a telephone communication means for controlling voice communication via a telephone network including a mobile telephone network; a packet communication means for controlling data communication via a packet network not via the telephone network; A database that stores at least image data captured by the camera together with data indicating the shooting date and time, and a telephone communication unit that controls to transmit an audio signal from the microphone via the telephone network, and at least the A data communication system comprising: a monitoring device having control means for controlling image data taken by a camera by means of the packet communication means so as to transmit the image data via the packet network,
When the control unit of the monitoring device detects a predetermined state around the monitoring device, the telephone communication unit of the monitoring device calls the telephone communication unit of the portable terminal device using the telephone network. A voice communication line using a telephone network between the monitoring device and the portable terminal device is opened, and the packet communication means of the monitoring device stores at least the image data stored in the database via the packet network. Is transmitted to the server, and stored in the predetermined area in the database of the server,
In a state where voice communication between the monitoring device and the mobile terminal device via the telephone network is continued, the packet communication means of the mobile terminal device uses the URL via the packet network to Accessing the server, the packet communication means of the mobile terminal device sends a command to the server,
The packet communication means of the server transmits the image data stored in the predetermined area to the portable terminal device via the packet network according to the command,
The packet communication means of the portable terminal device receives image data transmitted via the packet network, and the received image data is displayed on the screen of the display device of the portable terminal device ,
As long as the voice communication via the pre-Symbol telephone network is continued, said packet communication means of the monitoring device, repeated transmission to the server of the image data captured by the camera through the packet network A featured data communication system. The monitoring device has a plurality of output devices,
The control unit of the monitoring device is configured to generate a control signal for controlling the plurality of output devices, and to output a control signal to each of the plurality of output devices,
The packet communication means of the server transfers the command received from the mobile terminal device via the packet network to the monitoring device via the packet network,
The packet communication means of the monitoring device receives the command,
The communication system according to claim 1, wherein the control unit of the monitoring device generates a control signal for controlling any of the plurality of output devices, the camera, a speaker, and a microphone based on the command. . As long as the communication of the voice signal through the telephone network is continued, the packet communication means of the mobile terminal device repeatedly transmits a command to the server,
Claims packet communications means of the server, according to the command, the latest image data among the image data stored in the predetermined area, and transmits through the packet network to the mobile terminal device Item 3. The data communication system according to Item 1 or 2 . A mobile phone device having a telephone communication means for controlling voice communication via a telephone network including a mobile phone network;
A terminal device having packet communication means for controlling data communication through a packet network not through the telephone network;
A server connected to the packet network, comprising a database capable of storing data in a predetermined area specified by a predetermined URL, and packet communication means for controlling communication via the packet network Server,
A microphone, a speaker and a camera; a telephone communication means for controlling voice communication via a telephone network including a mobile telephone network; a packet communication means for controlling data communication via a packet network not via the telephone network; A database that stores at least image data captured by the camera together with data indicating the shooting date and time, and a telephone communication unit that controls to transmit an audio signal from the microphone via the telephone network, and at least the A data communication system comprising: a monitoring device having control means for controlling image data taken by a camera by means of the packet communication means so as to transmit the image data via the packet network,
When the control unit of the monitoring device detects a predetermined state around the monitoring device, the telephone communication unit of the monitoring device calls the telephone communication unit of the mobile phone device using the telephone network. A voice communication line using a telephone network between the monitoring device and the mobile phone device is opened, and the packet communication means of the monitoring device transmits at least the image data stored in the database via the packet network. Is transmitted to the server, and stored in the predetermined area in the database of the server,
In a state where voice communication between the monitoring device and the mobile terminal device via the telephone network is continued, the packet communication means of the terminal device uses the URL via the packet network to the server. The packet communication means of the terminal device sends a command to the server,
The packet communication means of the server transmits the image data stored in the predetermined area to the terminal device via the packet network according to the command,
The packet communication means of the terminal device receives image data transmitted through the packet network, and the received image data is displayed on the screen of the display device of the terminal device ,
As long as voice communication via the telephone network is continued, the packet communication means of the monitoring device repeats transmission of image data taken by the camera to the server via the packet network. A data communication system. The monitoring device has a plurality of output devices,
The control unit of the monitoring device is configured to generate a control signal for controlling the plurality of output devices, and to output a control signal to each of the plurality of output devices,
The packet communication means of the server transfers the command received from the terminal device via the packet network to the monitoring device via the packet network,
The packet communication means of the monitoring device receives the command,
The communication system according to claim 4 , wherein the control unit of the monitoring device generates a control signal for controlling any of the plurality of output devices, the camera, a speaker, and a microphone based on the command. . The monitoring device has a driving device for moving within a predetermined range, drives the driving device, acquires image data while moving within the predetermined range,
The data communication system according to any one of claims 1 to 5 , wherein when the control unit of the monitoring device detects the predetermined state, the driving device is stopped. The data communication system includes a charging station that supplies power to the storage battery at any position within the predetermined range;
The monitoring device has a power supply circuit including a rechargeable storage battery, and when the control circuit of the monitoring device detects that the remaining battery level of the storage battery is a predetermined value or less, the monitoring device moves to the charging station. The data communication system according to claim 6, wherein the drive circuit is controlled. The monitoring device includes a position detection unit that detects a current position of the monitoring device and acquires position data indicating the current position;
The control unit of the monitoring device is configured to determine that a predetermined state is detected when there is a change in the image data at the same position with reference to the position data acquired by the position detection unit,
Packet communication means of the monitoring device, via the packet network, the image data and the position data, to any one of claims 1 to 7, characterized in that said configured to transmit to the server The data communication system described . The control means of the monitoring device acquires audio data at the time of shooting by the camera,
9. The packet communication means of the monitoring device is configured to transmit the image data and audio data at the time of photographing by the camera to the server via the packet network . The data communication system according to any one of the above .

Images