JP2000165833A - Substitute image communication system and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow operators to recognize their own work states and to reduce the communication cost by transmitting a substitute image such as a character picture by a computer graphics CG in place of real video images of the operators themselves. SOLUTION: An image memory section 108 of a 1st personal computer stores a substitute image in place of an actual image of an operator, a transmission control section 107 transmits the stored substitute image to a 2nd personal computer of an opposite party, a reception control section 111 receives a substitute image of the opposite party sent from the 2nd personal computer and the image memory section 108 stores of the 1st personal computer and a display control section 112 reads the substitute image of the opposite party that is stored in the image memory section 108 and displays it on a display section 114.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention displays a substitute image such as a character image by CG (Computer Graphics) instead of a real image of an operator on each other's screen when performing communication by a personal computer (personal computer) or the like. The present invention relates to a proxy image communication apparatus and method suitable for applying to a cooperative relationship between remote areas such as telecommuting, satellite working, or project system working.

[0002]

2. Description of the Related Art Conventionally, there has been, for example, a video conference system for realizing cooperation between remote areas by communication. According to this system, even in remote areas, the environment of each conference room and the state of people can be monitored in real time. You can proceed with the conference while projecting on the TV screen.

[0003] However, at present, due to a change in the work system, as described above, cooperative relationships between remote areas such as telecommuting, satellite office working, and project system working are spreading. There is a need to understand the state of each other's work and to communicate with each other.

As a device that meets such needs, there is known a device that includes a surveillance camera in front of a personal computer and projects a partner on a part of each other's personal computer screen.

[0005]

However, in the conventional apparatus, when monitoring with a normal surveillance camera,
Since the surrounding environment including the operator is represented by real images, the privacy of the individual is all seen by the other party, and as a result, the awareness that it is seen works, calm down and concentrate on work In particular, when working from home, there is a problem that the actual appearance and the surrounding environment in the home are often included in the video and directly involved in privacy intervention.

[0006] Further, in order to perform image communication of the surveillance camera, a public telephone line must be constantly connected or a dedicated line contract is required, and there is a problem that communication costs increase.

The present invention has been made in view of such a point, and by transmitting a substitute image such as a character image by CG in place of a real image of the person, each other can recognize the work situation of the other party, It is another object of the present invention to provide a proxy image communication device and method capable of reducing communication costs.

[0008]

According to the present invention, a substitute image which substitutes for a real image of an operator is stored in a storage means of the own apparatus, and the stored substitute image is transmitted to a partner apparatus by transmission control means. Receiving the substitute image of the other party transmitted from the other apparatus by the reception control means and storing it in the storage means of the own apparatus,
The stored proxy image of the other party is read out by the display control means and displayed on the display means.

[0009]

DESCRIPTION OF THE PREFERRED EMBODIMENTS According to a first aspect of the present invention, a storage means for storing a substitute image in place of a real image of an operator of the own apparatus, and transmitting the substitute image stored in the storage means to the other apparatus. Transmission control means, receiving control means for receiving the substitute image of the other party transmitted from the other apparatus and storing it in the storage means, and reading and displaying the substitute image of the other party stored in the storage means to the display means And a display control means for displaying.

[0010] According to this configuration, there is no psychological resistance due to the fact that the image of the user and the surrounding environment are excessively transmitted to the opponent as in the image transmission of the conventional surveillance camera. Can be provided with collaborative information.

According to a second aspect of the present invention, in the first aspect, the presence detecting means for detecting the presence of the operator, the operating means for inputting a command, and the operating means being operated. And operation detection means for detecting the absence image of the operator, the presence image and the operation image in the proxy image,
The transmission control means transmits an absent image control signal to the partner device if the presence is not detected, transmits an absent image control signal if the presence is detected, and if the operation is detected. An operation image control signal is transmitted, and the display control means responds to the absence image control signal, the presence image control signal, or the operation image control signal from the counterpart device received by the reception control means, from the storage means. A configuration is adopted in which an image, a presence image, or an operation image is read out and displayed on the display means.

According to this configuration, the absence, presence, and operation status of the user can be accurately transmitted to the other party by using their substitute images.

According to a third aspect of the present invention, in the first aspect, the presence detecting means for detecting the presence of the operator, the operating means for inputting a command, and the operating means being operated. Operation detection means for detecting the presence image and the operation image in the substitute image, and the transmission control means transmits the presence image control signal to the partner device if the presence is detected. And transmitting an operation image control signal if the operation is detected, and the display control unit responds to the presence image control signal or the operation image control signal from the partner device received by the reception control unit. Reading the presence image or operation image of the other party from the storage means and displaying the read image on the display means, and displaying the absence image stored in the storage means in advance unless the presence image and the operation image are transmitted. Take.

[0014] According to this configuration, the absence, presence, and operation status of the user can be accurately transmitted to the other party using their substitute images.

A fourth aspect of the present invention, in the second or third aspect, employs a configuration in which an absent image control signal, a seated image control signal, or an operation image control signal operation image is transmitted in packets.

According to this configuration, the transmission capacity can be significantly reduced as compared with the conventional image transmission, and the communication cost can be reduced.

According to a fifth aspect of the present invention, in any one of the second to fourth aspects, the operation image is constituted by a predetermined number of images for displaying a moving image, and the display control means comprises:
A configuration is adopted in which a moving image is displayed on the display means by continuously and repeatedly reading the predetermined number of images from the storage means.

According to this configuration, if the operation expression is a hand movement expression, more specific work contents can be transmitted to the other party, and it becomes a powerful communication tool of a cooperative posture. In addition, the present invention can be applied to cues, sign language, and the like using hand motion expressions.

According to a sixth aspect of the present invention, in any one of the first to fifth aspects, the transmission control means stores the data when the line connection with the partner device is established by inputting an ID from the operation means. A configuration is employed in which the substitute image stored in the means is transmitted to the partner device.

According to this configuration, it is possible to identify a person who has been registered personally and to display a proxy image while ensuring privacy, and it is particularly effective when sharing with an unspecified person. it can.

According to a seventh aspect of the present invention, in any one of the first to sixth aspects, the transmission control means transmits a substitute image erasure signal to the partner apparatus in response to a substitute image erasure command from the operation means. The substitute image stored in the storage means of the partner device is deleted by the transmitted substitute image delete signal.

According to this configuration, the proxy image sent to the other party can be erased with its own intention, and privacy can be protected.

According to an eighth aspect of the present invention, there is provided a computer comprising:
A configuration including the substitute image communication device according to any one of the first to seventh aspects is adopted.

According to this configuration, in the computer, it is possible to obtain the same operation and effect as any one of the first to seventh aspects.

According to a ninth aspect of the present invention, a first storage means storing a substitute image in place of a real image of an operator of the apparatus, and transmitting the substitute image stored in the first storage means to a line connection destination First transmission control means for receiving, a first reception control means for receiving a proxy image of a transmission source from the line connection destination and storing the proxy image in the first storage means, and a first transmission control means for storing the transmission source image stored in the first storage means. A plurality of first proxy image communication devices having display control means for reading the proxy image and displaying the read image on the display means; and a second storage device for receiving the proxy image from the first proxy image communication device of the transmission source connected to the line. Second reception control means for storing in the means, and second transmission control means for transmitting the source proxy image stored in the second storage means to the first proxy image communication device connected to the line. And a second proxy image communication device having the same Take.

According to this configuration, in a one-to-N connection system in which a plurality of first substitute image communication devices are connected to one second substitute image communication device, cooperation while watching the image of the other party In the case of performing, it eliminates the psychological resistance caused by transmitting the image of the self and the surrounding environment situation too clearly to the other party like the image transmission of the conventional surveillance camera, ensuring the privacy and cooperating information with the other party Can be provided.

According to a tenth aspect of the present invention, in the ninth aspect, the plurality of first substitute image communication devices detect the presence of the operator and the operation of the command input operation means as a first result. A function of transmitting the operator's absence image, the presence image, and the substitute image including the operation image stored in the storage unit to the second substitute image communication device by the first transmission control unit; and a function of storing the substitute image in the first storage unit. A function of displaying the absence image, the presence image, or the operation image of the transmission source on the display unit according to the absence image control signal, the presence image control signal, or the operation image control signal from the transmission source; In the substitute image communication device, the second transmission control means transmits an absence image control signal from the transmission source to the transmission destination first substitute image communication device if the presence detection is not performed, and the presence detection is performed. If it is, it sends the presence image control signal and detects the operation. If any a configuration having a function of transmitting the operation image control signal.

According to this configuration, the user's absence, presence, and operation status can be accurately transmitted to the other party using their substitute images.

According to an eleventh aspect of the present invention, in the ninth aspect, the plurality of first substitute image communication devices detect the presence of the operator and the operation of the command input operation means to determine the first result. A function of transmitting the substitute image including the presence image and the operation image of the operator stored in the storage means to the second substitute image communication device by the first transmission control means, and a function of the transmission source stored in the first storage means The presence image or the operation image is displayed on the readout display means in response to the presence image control signal or the operation image control signal from the transmission source, and if the presence image and the operation image are not transmitted, the first The second proxy image communication device has a function of displaying the absent image stored in the first storage device. Sends a presence image control signal if a seat is detected And employs a configuration having a function of transmitting the operation image control signal if there is the operation detection.

According to this configuration, the absence, presence, and operation status of the user can be accurately transmitted to the other party through their substitute images.

According to a twelfth aspect of the present invention, in any one of the ninth aspect to the eleventh aspect, the second transmission control means of the second substitute image communication device comprises the first substitute image communication means for inputting an ID from the operation means. When a line connection is made with the communication device, a configuration is employed in which the substitute image of the transmission source stored in the second storage means is transmitted to the destination to which the line connection has been made.

According to this configuration, it is possible to identify a person who has been registered as an individual and to display a proxy image while ensuring privacy. This is particularly effective when sharing with an unspecified person. it can.

According to a thirteenth aspect of the present invention, in any one of the ninth to twelfth aspects, the first transmission control means comprises:
A proxy image erasure signal is transmitted to the second proxy image communication device and the destination first proxy image communication device in response to the proxy image erasure command from the operating means, and the first and second proxy image erasure signals are transmitted. A configuration is employed in which the substitute image stored in the storage means is deleted.

According to this configuration, the substitute image sent by the user can be erased by his / her own intention, and the privacy can be protected.

According to a fourteenth aspect of the present invention, in any one of the ninth to thirteenth aspects, a plurality of second substitute image communication devices are provided, and communication is performed between the plurality of second substitute image communication devices. Take the configuration.

According to this configuration, even in the case of the N-to-N connection in which the plurality of first proxy image communication devices are connected to the plurality of second proxy image communication devices, the ninth to thirteenth embodiments are described.
As in any one-to-N connection, transmission / reception processing of a proxy image can be applied.

According to a fifteenth aspect of the present invention, in any one of the ninth to fourteenth aspects, the first proxy image communication device is provided in the computer, and the second proxy image communication device is provided in the communication server. Adopt a configuration.

According to this configuration, even in a system configuration in which a plurality of computers are connected to a server, or a system configuration in which a plurality of computers are connected to a plurality of servers, any of the ninth to fourteenth embodiments The same operation and effect as the crab can be obtained.

According to a sixteenth aspect of the present invention, a substitute image is transmitted to a partner device in place of a real image of the operator of the own device.
The substitute image of the partner transmitted from the partner device is received and displayed on the screen.

According to this method, there is no psychological resistance due to the fact that the image of the user and the surrounding environment are transmitted too clearly to the other party as in the image transmission of the conventional surveillance camera. Can be provided with collaborative information.

According to a seventeenth aspect of the present invention, a substitute image for a real image of the operator of the own device is temporarily stored in a communication server, and the stored substitute image is transmitted to a partner device when a line is connected to the communication server. In addition, the substitute image of the partner transmitted from the partner device via the communication server is received and displayed on the screen.

According to this method, in a one-to-N connection or an N-to-N connection system, when cooperating while watching the image of the other party, it is necessary to use its own method such as image transmission of a conventional surveillance camera. It is possible to eliminate the psychological resistance caused by the image and the surrounding environment being transmitted to the other party too clearly, to ensure privacy and to provide cooperative information to the other party.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(Embodiment 1) FIG. 1 is a block diagram showing a configuration of a substitute image communication apparatus according to Embodiment 1 of the present invention.

However, the proxy image communication device 100 shown in FIG.
Is built in the first and second personal computers 201 and 202 connected one-to-one by the communication line 200 as shown in FIG. Hereinafter, the substitute image communication device 100
And the second personal computers 201 and 202.

The proxy image communication device 100 shown in FIG. 1 includes a keyboard 101, a mouse 102,
3, the operation detection unit 104, the presence determination unit 105, the operation determination unit 106, the transmission control unit 107, and the image memory unit 1.
08 and the communication control unit 110 connected to the communication line 200
, A reception control unit 111, a display control unit 112, a display drive unit 113, and a display unit 114.

The presence detection device 103 detects whether or not a person is present in front of the substitute image communication device 100. For example, an infrared sensor, an ultrasonic sensor, The presence detection signal 115 indicating the presence of a person by detecting whether or not a person is present by using a device or the like that detects the temperature of the person and the movement of the object.
Is output to the presence determination unit 105.

The operation detecting section 104 outputs an operation detecting signal 116 to the operation determining section 106 when detecting that the keyboard 101 or the mouse 102 has been operated.

The occupancy determination unit 105 outputs the occupancy detection signal 115
Is determined, and the determination result is output to the transmission control unit 107.

The operation judging section 106 outputs an operation detection signal 116
Is determined, and the determination result is output to the transmission control unit 107.

The transmission control unit 107 performs the following five controls.

The first control is that when a line is connected to the second personal computer 202 on the other side by a login operation by inputting an ID (Identifier) from the keyboard 101, the information is stored in the image memory unit 108 and described later. The proxy image data is transmitted to the second personal computer 202 via the communication control unit 110.

The substitute image is a CG image or the like produced by computer graphics technology, instead of the real image of the operator. For example, an image of a person's face, a photograph of the entire body, etc., arranged by himself using computer graphics, a character image, a mangatic image, or a symbol, code, pictogram, pictogram, mark, etc. It is an image that replaces itself. Also, your own face photo,
It may be an image obtained by capturing a photograph of the whole body by a scanner.

Further, the substitute image includes an absence image indicating the absence of the operator, a presence image indicating that the operator is present in front of the personal computer, and a state where the operator is operating the personal computer. And the proxy image data is all transmitted when the line is connected.

As a background using such a substitute image,
There is no need to monitor detailed actions and facial expressions on each other's screen in the proxy image work, and it is possible to communicate with each other just to judge whether the work is currently being performed .

Therefore, it is possible to sufficiently confirm each other's situation with a substitute image in which the minimum necessary information is patterned, even if it is not a real image (actual appearance and surrounding environment state) of the surveillance camera as in the related art. It is.

The second control of the transmission control unit 107 is that when the determination result indicating that there is no presence detection signal 115 is notified from the presence determination unit 105, the absence image transmitted to the second personal computer 202 is transmitted to the second personal computer 202. An absent image control signal for controlling display on the screen is transmitted to the second personal computer 202 via the communication control unit 110.

In the third control, when only the determination result indicating the presence detection signal 115 is notified, the second personal computer 20
Then, a presence image control signal for performing control to display the presence image transmitted to the second computer on the screen of the other party is transmitted to the second personal computer 202 via the communication control unit 110.

The fourth control is based on the determination result of the presence detection signal 115 and the operation detection signal
6 is notified of the operation result, the operation image control signal for controlling the operation image transmitted to the second personal computer 202 to be displayed on the screen of the other party is transmitted to the communication control unit 110.
To the second personal computer 202 via the.

In the fifth control, after the determination result indicating the presence of the presence detection signal 115 and the determination result indicating the presence of the operation detection signal 116 are notified, the determination result indicating the presence of the operation detection signal 116 is notified for a predetermined time. If not, it transmits a presence image control signal to the second personal computer 202 via the communication control unit 110.

The communication control section 110 transmits and receives signals to and from the second personal computer 202 via the communication line 200. However, each of the above-described image control signals can also be performed by packet transmission.

The reception control unit 111 stores the substitute image data from the second personal computer 202 received by the communication control unit 110 at the time of the line connection in the image memory unit 108, and controls the above-mentioned control from the second personal computer 202. A signal is output to the display control unit 112.

The display control unit 112 controls the second personal computer 202
Reads the absence image of the other party stored in the image memory unit 108 in accordance with the absence image control signal transmitted from
The display unit 1 driven by the display driving unit 113 displays the absence image.
14 and reads out and displays the presence image of the other party stored in the image memory unit 108 in response to the transmitted presence image control signal. In response, the operation image of the other party stored in the image memory unit 108 is read and displayed.

The display is performed using a part of the personal computer screen and expressed in a minimum (for example, about 1.5 inches) size that allows the image to be judged.

However, the transmission control unit 107 performs control to transmit its own substitute image data to the second personal computer 202 each time the line connection with the second personal computer 202 is made. Only when the line connection is made with the second personal computer 202,
May be controlled to be transmitted. In the former case,
The second personal computer 202 overwrites and saves the substitute image data each time the substitute image data is transmitted. In the latter case,
The proxy image data once received is continuously stored.

Next, the proxy image transmission / reception processing by the proxy image communication apparatus 100 having such a configuration will be described with reference to the flowcharts shown in FIGS.

First, in step ST301 shown in FIG. 3, the first personal computer 201 executes login by ID. This is because, in fact, anyone can turn on the power at any time, and anyone other than the registrant can use the personal computer.
This is in order to be able to execute the line connection with 2.

By this login, step ST30
2, a connection operation with the second personal computer 202 is performed, and in step ST303, the first personal computer 201 is connected.
And the second personal computer 202 are connected.

After this connection, in step ST 304, the transmission control unit 107 of the first personal computer 201 transmits the substitute image data of the registrant of the first personal computer 201 stored in the image memory unit 108 via the communication control unit 110. It is transmitted to the second personal computer 202 of the other party.

In the second personal computer 202, in step ST401 shown in FIG. 4, the reception control unit 111 stores the substitute image data from the first personal computer 201 received by the communication control unit 110 in the image memory unit 108.

Next, in step ST 305 of FIG. 3, the presence determination section 105 of the first personal computer 201 determines the presence or absence of the presence detection signal 115. That is, it is determined whether or not the presence detection device 103 has detected the operator (registrant) in front of the first personal computer 201.

If the result of this determination is that there is no presence detection signal 115, in step ST 306, transmission control section 107
Transmits the absent image control signal to the second
The data is transmitted to the personal computer 202. After the transmission, the presence determination unit 105 of the first personal computer 201 continues to determine whether or not the presence detection signal 115 is present.

In the second personal computer 202, in step ST 402 shown in FIG. 4, the reception control unit 111 outputs the absence image control signal from the first personal computer 201 received by the communication control unit 110 to the display control unit 112.

Thus, in step ST 403, display control section 112 reads the other party's absent image stored in image memory section 108 in response to the absent image control signal, and displays it in display section 114 driven by display driving section 113. indicate. It is assumed that the displayed image is, for example, a personal computer external image representing the external shape of the personal computer.

By displaying the absent image, the operator of the second personal computer 202 can recognize that the operator of the first personal computer 201 is absent.

On the other hand, if the result of determination in step ST 305 is that there is a presence detection signal 115, in step ST 307, operation determination section 106 of first personal computer 201 determines whether or not operation detection signal 116 is present. That is, the operation detection unit 10
It is determined in step 4 whether the operation of the keyboard 101 or the mouse 102 has been detected.

If the result of this determination is that there is no operation detection signal 116, in step ST 308, the transmission control unit 107
Transmits the presence image control signal via the communication control unit 110 to the second
The data is transmitted to the personal computer 202. After the transmission, the presence determination unit 105 of the first personal computer 201 continues to determine whether or not the presence detection signal 115 is present.

In the second personal computer 202, in step ST404 shown in FIG. 4, the reception control unit 111 outputs the presence image control signal from the first personal computer 201 received by the communication control unit 110 to the display control unit 112.

Thus, in step ST 405, display control section 112 reads the presence image of the other party stored in image memory section 108 in response to the presence image control signal, and display section driven by display drive section 113. Displayed at 114.

By displaying the absent image, the operator of the second personal computer 202 can recognize that the operator of the first personal computer 201 is present.

On the other hand, if the result of determination in step ST 307 is that there is operation detection signal 116, in step ST 309, transmission control section 107 transmits an operation image control signal to second personal computer 202 via communication control section 110.

In the second personal computer 202, the reception control unit 111 outputs the operation image control signal from the first personal computer 201 received by the communication control unit 110 to the display control unit 112 in step ST406 shown in FIG.

Thus, in step ST 407, display control section 112 reads the other party's operation image stored in image memory section 108 in response to the operation image control signal, and displays the read operation image on display section 114 driven by display drive section 113. indicate. The display of the operation image may have a motion by continuously and repeatedly displaying a plurality of frame-by-frame operation images, for example.

By displaying the operation image, the operator of the second personal computer 202 can recognize that the operator of the first personal computer 201 is operating.

After transmitting the operation image control signal in step ST309, in step ST310,
The operation determination unit 106 of the first personal computer 201 determines the presence or absence of the operation detection signal 116.

If the result of this determination is that there is an operation detection signal 116, the flow returns to step ST309 to perform the same transmission processing of the operation image control signal as described above. If there is no operation detection signal 116, the first personal computer 201 is sent in step ST311.
The transmission control unit 107 determines whether a predetermined time has elapsed since the operation detection signal 116 disappeared.

As a result of the determination, if the predetermined time has not elapsed, the process returns to step ST309 to perform the same transmission processing of the operation image control signal as described above. The control signal is transmitted.

In the above description, when the line is connected by the log-in operation, the absence image, the presence image, and the operation image are transmitted as the substitute images and stored in the second personal computer 202, and thereafter, the absence image control signal is transmitted. In such a case, the display control unit 112 of the second personal computer 202 is configured to display the stored absence image, but when the line is connected, the presence image and the operation image are transmitted to the second personal computer 202 and stored as substitute images. At this time, if the presence image control signal or the operation image control signal is not transmitted, the display control unit 112
May display an absent image stored in the image memory unit 108 of the second personal computer 202 in advance.

Further, by transmitting a substitute image erasure signal for erasing the substitute image transmitted to the other party from the transmission control unit 107 to the other party in response to the delete command operation of the keyboard 101, the image memory unit of the other party is transmitted. The own proxy image stored in 108 may be deleted.

Although the operation of transmitting the proxy image from the first personal computer 201 to the second personal computer 202 has been described, the operation in the reverse direction is performed in the same manner.

As described above, according to the substitute image communication device of the first embodiment, the image memory unit 10 of the first personal computer 201
8 stores a substitute image in place of the real image of the operator, transmits the stored substitute image to the second computer 202 of the other party by the transmission control unit 107, and expresses the substitute image of the other party transmitted from the second personal computer 202. The image is received by the reception control unit 111 and stored in the image memory unit 108 of the first personal computer 201, and the stored substitute image of the other party is displayed on the display control unit 112.
And displayed on the display unit 114.

[0092] This eliminates the psychological resistance caused by the fact that the image of one's own and the surrounding environment are transmitted too clearly to the other party, as in the case of image transmission by a conventional surveillance camera.
Privacy can be ensured and collaborative information can be provided to the other party.

The substitute image includes the absence image, the presence image, and the operation image of the operator. The presence detection device 103 of the first personal computer 201 detects the presence of the operator, and the operation detection unit 104. Detects that the keyboard 101 or the mouse 102 has been operated, and the transmission control unit 107 transmits an absent image control signal to the second personal computer 202 if no presence is detected, and the presence of the presence is detected. If the operation is detected, an operation image control signal is transmitted. If the operation is detected, the display control unit 112 controls the absence image control from the second personal computer 202 received by the reception control unit 111. signal,
The absence image, the presence image, or the operation image of the other party is read from the image memory unit 108 in response to the presence image control signal or the operation image control signal, and is displayed on the display unit 114.

As an alternative configuration, when the absence image and the absence image control signal are not transmitted to the second personal computer 202 of the other party, and the presence image control signal and the operation image control signal are not transmitted, the second personal computer 202 An absent image stored in advance in 202 is displayed.

Thus, the absence, presence, and operation status of the user can be accurately transmitted to the other party through their substitute images.

Further, since the absence image control signal, the presence image control signal, or the operation image control signal operation image is transmitted in packets, the transmission capacity can be significantly reduced as compared with the conventional image transmission. Communication costs can be reduced.

The operation image is composed of a predetermined number of images for displaying a moving image, and the display control unit 112 continuously and repeatedly reads out the predetermined number of images from the image memory unit 108, thereby displaying the display unit 114. Since the moving image display is performed in advance, if the operation expression is a hand movement expression, more specific work content can be transmitted to the other party, and it becomes a powerful communication tool of a cooperative posture. In addition, the present invention can be applied to cues, sign language, and the like using hand motion expressions.

The transmission control unit 107 operates the keyboard 1
The other party's second personal computer 202 by inputting the ID from 01
When the line connection is made, the proxy image stored in the image memory unit 108 is transmitted, so that the registered individual can be identified and the proxy image display with privacy secured can be realized. Yes, especially when sharing with unspecified people.

The transmission control unit 107 operates the keyboard 1
In response to the substitute image erasing command from the first personal computer 202, a substitute image erasing signal is transmitted to the other party's second personal computer 202. The transmitted proxy image erasing signal causes the substitute image stored in the image memory unit 108 of the second personal computer 202 to be transmitted. Since the deletion is performed, the proxy image sent to the other party can be deleted by one's own intention, and privacy can be protected.

(Embodiment 2) FIG. 5 is a block diagram showing a configuration of a first substitute image communication device in a substitute image communication system according to Embodiment 2 of the present invention. FIG.
FIG. 9 is a block diagram showing a configuration of a second substitute image communication device in a substitute image communication system according to Embodiment 2 of the present invention.

However, the first substitute image communication device 5 shown in FIG.
00 denotes communication lines 700a, 700 as shown in FIG.
b,..., 700n are incorporated in the first to Nth personal computers 702, 703, 704 connected one-to-N with the server 701, and the second proxy image communication device 600 shown in FIG. It is assumed that

Thereafter, the first substitute image communication device 500 is connected to the first
The Nth personal computers 702, 703, 704 and the second proxy image communication device 600 may be expressed as a server 701 in some cases.
The server 701 corresponds to a host computer on the Internet, a LAN (Local Area Network) server, or the like.

First substitute image communication apparatus 500 shown in FIG.
Are a keyboard 501, a mouse 502, a presence detection device 503, an operation detection unit 504, and a transmission control unit 505.
, An image memory unit 506, and communication lines 700a and 700
b or 700n, a communication control unit 507, a reception control unit 508, a display control unit 509, and a display drive unit 51
0 and a display unit 511.

The presence detection device 503 detects whether or not a person is present in front of the first substitute image communication device 500. For example, an infrared sensor, an ultrasonic The presence detection signal 51 indicating the presence of a person by detecting whether or not a person is present by using a sensor, a device for detecting a person's body temperature and movement of an object, or the like.
2 to the transmission control unit 505.

The operation detection unit 504 outputs an operation detection signal 513 to the transmission control unit 505 when detecting that the keyboard 501 or the mouse 502 has been operated.

The transmission control unit 505 stores the substitute image stored in the image memory unit 506 and described in the first embodiment when the line connection with the server 701 is performed by the login operation by the ID input from the keyboard 501. Is transmitted to the server 701 via the communication control unit 507, and the control for transmitting the presence detection signal 512 and the operation detection signal 513 to the server 701 via the communication control unit 507.

Communication control section 110 has communication lines 700a,
The server 700 transmits and receives signals to and from the server 701 via 700b or 700n. The proxy image data and the presence detection signal 512 and the operation detection signal 513 from the transmission control unit 507 are transmitted to the server 701.
From 01, the proxy image data of the communication partner, the absence image control signal, the presence image control signal, and the operation image control signal are received and output to the reception control unit 508. However, each image control signal can be transmitted by packet transmission.

The reception control unit 508 stores the substitute image data of the other party from the server 701 received by the communication control unit 507 at the time of the line connection in the image memory unit 506, and controls the display of the above-mentioned respective control signals of the other party. The output is to the unit 509.

The display control unit 509 reads the other party's absence image stored in the image memory unit 506 in response to the other party's absence image control signal transmitted from the server 701.
The display unit 5 driven by the display drive unit 510 displays the absence image.
11 and read out and display the other party's presence image stored in the image memory unit 506 in response to the transmitted presence image control signal. In response, the operation image of the other party stored in the image memory unit 506 is read and displayed.

The display is performed using a part of the screen of the personal computer and expressed in a minimum size (for example, about 1.5 inches) of which the image can be judged.

Second proxy image communication device 600 shown in FIG.
Are a communication control unit 601, a reception control unit 602, an image memory unit 603, a presence determination unit 604, an operation determination unit 60
5 and a transmission control unit 606.

The communication control unit 601 includes a communication line 700a,
700b,..., 700n through the first to Nth personal computers 7
02, 703, and 704.

[0113] The reception control section 602 is provided for receiving the first to Nth personal computers 70 received by the communication control section 601 at the time of the line connection.
2, 703, and 704 are stored in the image memory unit 603 so as to be recognizable for each of the personal computers 702, 703, and 704.
It outputs a presence detection signal 512 and an operation detection signal 513 from 02, 703, and 704 to the presence determination unit 604 and the operation determination unit 605.

The presence determination unit 604 outputs the presence detection signal 512.
Is determined, and the result of the determination is output to the transmission control unit 606.

The operation determining unit 605 outputs the operation detection signal 513
Is determined, and the result of the determination is output to the transmission control unit 606.

The transmission control unit 606 performs the following five controls.

The first control is the first to Nth personal computer 70
2, 703, 704 when the image memory unit 6
03 is transmitted to the communication control unit 6
01, the personal computers 702-7 connected to the line
04.

The second control is performed when the determination result indicating that there is no presence detection signal 512 is notified from the presence determination unit 604.
An absent image control signal is transmitted to personal computers 702 to 704 connected via a communication control unit 601.

The third control is to transmit the presence image control signal via the communication control unit 601 to the personal computer 7 when only the determination result of the presence detection signal 512 is notified.
02 to 704.

The fourth control is based on the determination result of the presence detection signal 512 and the operation detection signal 51
When the result of the determination of the presence of the three is notified, the operation image control signal is transmitted to the personal computers 702 to 704 connected to the line via the communication control unit 601.

In the fifth control, after the determination result of the presence detection signal 512 and the determination result of the operation detection signal 513 are notified, the determination result of the presence of the operation detection signal 513 is notified for a predetermined time. If not, the personal computer 702 connected to the line via the communication control unit 601 transmits the presence image control signal.
To 704.

The operation of the proxy image communication system having such a configuration will be described. However, the first personal computer 702 shown in FIG.
And the Nth personal computer 704 perform communication using the proxy image.

First, in the first personal computer 702, the ID
When the login by input is executed, the line connection with the server 701 is established. At the time of this connection, the first personal computer 702
Transmits the proxy image data of the registrant of the first personal computer 702 stored in the image memory unit 506 to the server 701 via the communication control unit 507.

In the server 701, the communication control unit 601
The proxy image data is received from the first personal computer 702, and the received proxy image data is received by the reception control unit 602.
Is stored in the image memory unit 603 under the control of.

Thereafter, at the Nth personal computer 704, I
When the login by the D input is executed, the line connection with the server 701 is performed. At this time, the substitute image data of the operator of the first personal computer 702 stored in the image memory unit 603 of the server 701 is transmitted to the transmission control unit 606. Of the Nth personal computer 704 via the communication control unit 601.
Sent to

In the Nth personal computer 704, the transmitted proxy image data of the other party (the operator of the first personal computer 702) is received by the communication control unit 507, and stored in the image memory unit 506 under the control of the reception control unit 508. I do.

At this point, the presence determination unit 6 of the server 701
04 determines the presence or absence of the presence detection signal 512. That is,
It is determined whether the presence detector 503 of the first personal computer 702 has detected the operator (registrant) in front of the personal computer.

As a result, if there is no presence detection signal 512, the transmission control unit 606 of the server 701 transmits the absence image control signal to the Nth personal computer 704 via the communication control unit 601. After this transmission, the presence determination unit 604 continues to determine the presence or absence of the presence detection signal 512.

In the Nth personal computer 704, the communication control unit 50
7, the reception control unit 508 outputs the other party's absence image control signal from the server 701 to the display control unit 509.

Thus, display control section 509 reads the absence image of the other party (operator of first personal computer 702) stored in image memory section 506 in response to the absence image control signal, and is driven by display drive section 510. Is displayed on the display unit 511. It is assumed that the displayed image is, for example, a personal computer external image representing the external shape of the personal computer.

By displaying the absent image, the operator of the Nth personal computer 704 can recognize that the operator of the first personal computer 702 is absent.

On the other hand, when the presence determination signal 512 is present as a result of the determination by the presence determination unit 604 of the server 701, the operation determination unit 605 determines the presence or absence of the operation detection signal 513. That is, it is determined whether or not the operation of the keyboard 501 or the mouse 502 is detected by the operation detection unit 504 of the first personal computer 702.

As a result, if there is no operation detection signal 513, the transmission control unit 606 of the server 701 transmits the presence image control signal to the Nth personal computer 704 via the communication control unit 601. After this transmission, the presence determination unit 604 continues to determine the presence or absence of the presence detection signal 512.

In the Nth personal computer 704, the communication control unit 50
7, the reception control unit 508 outputs the other party's presence image control signal from the server 701 to the display control unit 509.

Thus, the display control unit 509 reads the presence image of the other party stored in the image memory unit 506 according to the presence image control signal, and displays the read image on the display unit 511 driven by the display drive unit 510. .

By displaying the absent image, the operator of the Nth personal computer 704 can recognize that the operator of the first personal computer 702 is present.

On the other hand, if the operation determination unit 605 of the server 701 determines that the operation detection signal 513 is present, the transmission control unit 606 transmits the operation image control signal to the Nth personal computer 704 via the communication control unit 601. I do.

In the Nth personal computer 704, the communication control unit 50
7, the reception control unit 508 outputs the other party's operation image control signal from the server 701 to the display control unit 509.

As a result, the display control unit 509 reads the other party's operation image stored in the image memory unit 506 in accordance with the operation image control signal, and displays it on the display unit 511 driven by the display drive unit 510. The display of this operation image is
For example, a motion may be given by displaying a plurality of frame-by-frame operation images continuously and repeatedly.

By the display of the operation image, the operator of the Nth personal computer 704 can recognize that the operator of the first personal computer 702 is operating.

After transmitting the operation image control signal,
The operation determination unit 605 of the server 701 outputs the operation detection signal 51
3 is determined.

If the result of this determination is that there is an operation detection signal 513, the same transmission processing of the operation image control signal as described above is performed. If there is no operation detection signal 513, the transmission control unit 606 determines that the operation detection signal 513 has been lost. It is determined whether or not a predetermined time has elapsed from.

As a result of the determination, if the predetermined time has not elapsed, the same transmission processing of the operation image control signal as described above is performed, and if the predetermined time has elapsed, the same transmission processing of the presence image control signal as described above is performed.

In the above description, when the line is connected to the server 701, the absence image, the presence image, and the operation image are transmitted as substitute images and stored in the Nth personal computer 704.
When the absence image control signal is transmitted, the display control unit 509 of the Nth personal computer 704 is configured to display the stored absence image, but when the line is connected, the presence image and the operation image are displayed as substitute images. The display control unit 509 is stored in the image memory unit 506 of the Nth personal computer 704 in advance, unless the presence image control signal or the operation image control signal is transmitted. May be configured to display the absence image.

By transmitting a substitute image erasure signal for erasing the substitute image transmitted to the other party from the transmission control unit 505 to the other party via the server 701 in response to an erase command operation of the keyboard 501, Alternatively, the user's own proxy image stored in the side image memory unit 506 may be deleted.

Although the operation of transmitting the substitute image from the first personal computer 702 to the Nth personal computer 704 has been described, the operation in the reverse direction is performed in the same manner.

Further, the proxy image communication system is provided with a plurality of first to N-th personal computers 70 for one server 701.
2, 703, 704 are connected to each other, but as shown in FIG. 8, a plurality of first to Nth personal computers 803 are connected to a plurality of servers 801 and 802 as shown in FIG. , 804, 805 and the first to Nth personal computers 80
The same applies to the case of N-to-N connection in which 6,807,808 are connected. In this N-to-N connection,
Communication between the proxy image data and each image control signal is performed once between the servers 801 and 802, and thereafter, communication is performed between personal computers connected to the line.

As described above, according to the proxy image communication system of the second embodiment, the first to Nth personal computers 702 and 70
3, 704, a proxy image in place of the real image of each operator is stored in the image memory unit 506, and the stored proxy image is transmitted to the server 701 by the transmission control unit 507. Receiving control unit 508
The display control unit 509 reads the stored proxy image and displays it on the display unit 511, and stores the proxy image stored in the image memory unit 506.
1 is, for example, the first personal computer 70 of the transmission source connected to the line.
2 is received by the reception control unit 602 and stored in the image memory unit 603, and the stored proxy image of the transmission source is transmitted to the transmission control unit 606, for example, the Nth personal computer of the transmission destination connected to the line. 704.

As a result, in a one-to-N connection system in which a plurality of first to Nth personal computers 702, 703, and 704 are connected to one server 701, cooperation is performed while viewing the image of the other party. In this case, it eliminates the psychological resistance caused by the fact that the image of the user and the surrounding environment are transmitted too clearly to the other party, such as the transmission of images from conventional surveillance cameras, ensuring privacy and providing cooperative information to the other party can do.

The first to Nth personal computers 702 and 70
3704, the result of the detection of the presence of the operator and the detection of the operation of the command input operation means is displayed together with the absence image of the operator, the substitute image including the presence image and the operation image stored in the image memory unit 506. The transmission control unit 507 transmits the function of transmitting to the server 701 and the absence image, presence image, or operation image of the transmission source stored in the image memory unit 506 to the display control unit 509.
And has a function of reading out and displaying on the display unit 511 in response to an absence image control signal, a presence image control signal, or an operation image control signal from the transmission source.
06 is transmitted from the first personal computer 702 of the transmission source to the Nth
A function of transmitting an absent image control signal to the personal computer 704 if no presence detection is performed, transmitting a presence image control signal if presence detection is performed, and transmitting an operation image control signal if operation detection is performed. It was comprised having.

As an alternative configuration, if the absent image and the absent image control signal are not transmitted to the Nth personal computer 704 of the other party, and the presence image control signal and the operation image control signal are not sent, the Nth personal computer 704 is configured to display an absent image stored in advance.

Thus, the absence, presence, and operation status of the user can be accurately transmitted to the other party through their substitute images.

The transmission control unit 606 of the server 701
When, for example, a line is connected to the Nth personal computer 704 by inputting an ID from the keyboard 501, the proxy image of the first personal computer 702 of the transmission source stored in the image memory unit 603 is connected to the line. Is transmitted to the N-th personal computer 704, which is the destination, so that the registered individual can be identified and a proxy image display with privacy secured can be realized, especially when shared by unspecified persons. Can be effective.

The transmission control unit 5 of the first personal computer 702
05 sends a proxy image deletion signal to the server 701 and the N-th destination
The proxy image is transmitted to the personal computer 704, and the proxy image stored in the image memory unit 603 of the server 701 and the image memory unit 506 of the Nth personal computer 704 is deleted by the transmitted proxy image deletion signal. You can delete the proxy image sent to your own intention and protect your privacy.

Since a plurality of servers 701 are provided and communication is performed between the plurality of servers 701, a plurality of first to N-th personal computers 803, 804, 805 are communicated with a plurality of servers 801 and 802. Also, in the case of the N-to-N connection in which the first to N-th personal computers 806, 807, and 808 are connected, the transmission / reception processing of the proxy image can be applied similarly to the above-mentioned one-to-N connection.

[0156]

As described above, according to the present invention,
By transmitting a substitute image such as a character image by CG in place of the actual video of the person, each other can recognize the work situation of the other party, and communication costs can be reduced.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a proxy image communication device according to a first embodiment of the present invention.

FIG. 2 is a one-to-one relationship between the proxy image communication device according to the first embodiment.
Connection diagram

FIG. 3 is a flowchart for explaining a substitute image transmission process of the substitute image communication device according to the first embodiment;

FIG. 4 is a flowchart for explaining a substitute image receiving process of the substitute image communication apparatus according to the first embodiment;

FIG. 5 is a block diagram showing a configuration of a first substitute image communication device in a substitute image communication system according to Embodiment 2 of the present invention;

FIG. 6 is a block diagram showing a configuration of a second substitute image communication device in the substitute image communication system according to Embodiment 2 of the present invention.

FIG. 7 is a 1-to-N connection configuration diagram in a proxy image communication system according to a second embodiment.

FIG. 8 is an N-to-N connection configuration diagram in the proxy image communication system according to the second embodiment.

[Explanation of symbols]

100 Proxy image communication device 101, 501 Keyboard 102, 502 Mouse 103, 503 Presence detection device 104, 504 Operation detection unit 105, 604 Presence determination unit 106, 605 Operation determination unit 107, 505, 606 Transmission control unit 108, 506 , 603 Image memory unit 111, 508, 602 Reception control unit 112, 509 Display control unit 114, 511 Display unit 201, 202, 702, 703, 704, 803, 8
04, 805, 806, 807, 808 Personal computer 500 First substitute image communication device 600 Second substitute image communication device 701,801,802 Server

Claims (17)

[Claims] 1. A storage unit in which a substitute image instead of a real image of an operator of the own device is stored, a transmission control unit for transmitting the substitute image stored in the storage unit to the partner device, and a transmission from the partner device. Receiving control means for receiving the proxy image of the other party stored in the storage means, and display control means for reading the proxy image of the other party stored in the storage means and displaying the read proxy image on the display means. A substitute image communication device characterized by the above-mentioned. 2. An image processing apparatus comprising: a presence detection means for detecting the presence of an operator; an operation means for inputting a command; an operation detection means for detecting that the operation means is operated; The transmission control means transmits an absence image control signal to the partner device if the presence is not detected, and the presence control is performed. If the presence image control signal is transmitted, if the operation is detected, the operation image control signal is transmitted, the display control means,
In response to the absence image control signal, the presence image control signal, or the operation image control signal from the partner device received by the reception control means, the absence means, presence image, or operation image of the other party is read from the storage means and displayed. 2. The substitute image communication device according to claim 1, wherein the image is displayed on the display. 3. An image processing apparatus comprising: a presence detecting means for detecting the presence of an operator; an operating means for inputting a command; an operation detecting means for detecting that the operating means is operated; The transmission control means transmits a presence image control signal to the partner device when the presence is detected, and operates when the operation is detected. An image control signal is transmitted, and the display control unit transmits the presence image or the operation image of the other party from the storage unit in accordance with the presence image control signal or the operation image control signal from the partner device received by the reception control unit. 2. The substitute image communication apparatus according to claim 1, wherein the readout image is displayed on the display means, and if the presence image and the operation image are not transmitted, the absence image stored in the storage means is displayed in advance. . 4. The substitute image communication apparatus according to claim 2, wherein the absence image control signal, the presence image control signal, or the operation image control signal operation image is transmitted in packets. 5. The operation image is composed of a predetermined number of images for displaying a moving image, and the display control means continuously and repeatedly reads the predetermined number of images from the storage means to display the moving image on the display means. The substitute image communication device according to claim 2, wherein display is performed. 6. The transmission control unit transmits a proxy image stored in a storage unit to the partner device when a line connection with the partner device is established by inputting an ID from an operation unit. The substitute image communication device according to claim 1. 7. The transmission control means transmits a substitute image erasure signal to a partner apparatus in response to a substitute image erasure command from the operation means, and stores the substitute image erasure signal in the storage means of the partner apparatus by the transmitted substitute image erasure signal. 7. The substitute image communication device according to claim 1, wherein the substitute image is deleted. 8. A computer comprising the substitute image communication device according to claim 1. 9. A first storage unit in which a substitute image instead of a real image of an operator of the own device is stored, and a first transmission control unit that transmits the substitute image stored in the first storage unit to a line connection destination. A first reception control unit that receives a source proxy image from the line connection destination and stores the source proxy image in the first storage unit, and reads and displays a source proxy image stored in the first storage unit A plurality of first proxy image communication apparatuses each having a display control unit for displaying the first and second image data;
A second reception control unit that receives the proxy image from the proxy image communication device and stores the proxy image in the second storage unit, and a source proxy image that is stored in the second storage unit, A second proxy image communication device having a second transmission control unit for transmitting to one proxy image communication device. 10. A plurality of first substitute image communication devices, based on the result of detection of presence of an operator and detection of operation of a command input operation unit, an absence image of an operator stored in a first storage unit;
A function of transmitting the substitute image including the presence image and the operation image to the second substitute image communication device by the first transmission control means, and an absence image, presence image, or operation image of the transmission source stored in the first storage means Has the function of reading out and displaying on the display means in response to the absence image control signal, the presence image control signal, or the operation image control signal from the transmission source. Transmitting an absence image control signal from the transmission source to the transmission destination first proxy image communication device if the presence detection is not performed, and transmitting a presence image control signal if the presence detection is detected, 10. The substitute image communication system according to claim 9, further comprising a function of transmitting an operation image control signal when the detection is performed. 11. A plurality of first substitute image communication devices, based on the presence of the operator and the detection of the operation of the command input operation means, the presence image of the operator stored in the first storage means and A function of transmitting the substitute image including the operation image to the second substitute image communication device by the first transmission control means, and transmitting the presence image or the operation image of the transmission source stored in the first storage means to the location information from the transmission source. A function of displaying on the read-out display means in response to a seat image control signal or an operation image control signal, and displaying an absent image stored in the first storage means in advance unless the presence image and the operation image are transmitted; And the second
In the substitute image communication device, the second transmission control means transmits the presence image control signal if the presence detection is performed from the transmission source to the transmission destination first substitute image communication device, and the operation detection is performed. 10. The substitute image communication system according to claim 9, further comprising a function of transmitting an operation image control signal. 12. The second transmission control means of the second substitute image communication device stores the data in the second storage means when a line connection with the first substitute image communication device is established by inputting an ID from the operation means. 2. The image forming apparatus according to claim 1, wherein the proxy image of the transmission source is transmitted to the transmission destination to which the line connection is made.
2. The substitute image communication system according to claim 1. 13. A first transmission control means for transmitting a substitute image erasure signal to the second substitute image communication device and the first substitute image communication device as a transmission destination in response to a substitute image erasure command from the operation means. 13. The substitute image communication system according to claim 9, wherein the substitute image stored in the first and second storages is deleted by the substitute image delete signal. 14. The substitute image communication according to claim 9, wherein a plurality of second substitute image communication devices are provided, and communication is performed between the plurality of second substitute image communication devices. system. 15. The substitute image according to claim 9, wherein the first substitute image communication device is provided in a computer, and the second substitute image communication device is provided in a communication server. Communications system. 16. A surrogate characterized by transmitting a substitute image instead of a real image of an operator of the own device to a partner device, receiving a substitute image of the partner transmitted from the partner device, and displaying the substitute image on a screen. Image communication method. 17. A communication server for temporarily storing a substitute image in place of a real image of an operator of the own device, transmitting the held substitute image to a partner device when a line is connected to the communication server, and Receiving a substitute image of the other party transmitted from the other apparatus via the other apparatus and displaying the received substitute image on a screen.