JPH06261317A - Video system constituting remote shared space - Google Patents

Abstract

PURPOSE:To execute cooperative work as if workers in remote places are happened to be present at that place by surrounding one work space by synthesizing a substantial object with a display object by video, which is transmitted from the other place, so as to display a shared space in workshops in respective remote places. CONSTITUTION:When the object is placed on the desk of a space A, a camera 1 for space video, and the video is displayed on the display part 8' of a space B through a communication interface 2. An image input part 3' extracts the work space and the characteristic form of the object for comparing scales. A display size comparison part 4' calculates a display scale factor and a display angle based on the initialization of the screen size of the display part 8'. A scale correction signal transmission part 5' executes feedback control so that an image pickup size and a display size are approximated through the communication interface 2. An image processing part 6' micro-adjusts a rotation and a scale conversion so as to synthesize the display object with the substantial object.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video system using a combination of video image pickup / display system and video communication, and more particularly to a remote shared space for space sharing for performing cooperative work between remote places. The present invention relates to a video system to be configured.

When performing collaborative work in geographically distant places such as extreme work and remote collaborative work, image pickup / shooting can be performed to obtain a sense of direction and distance similar to those existing in the place.
Display and video communication technology is required.

[0003]

2. Description of the Related Art In the technical field as described above, there is one that displays a reflected image on a naked-eye image that is seen through a half mirror and displays the object in the work space on the spot. There was a problem in that we could not see with the same sense of direction and distance as those existing in. In addition, the one using a head mounted display has a problem that the body is restrained by mounting it on the head, and the one using a large half mirror in the space physically restricts the work space. There was a problem.

On the other hand, there is a method of modeling and inputting a topical product into a shared space that is virtually generated separately from the real space, and outputting the product to the real space. In this case, there is a method of modeling the topical product or the real product. The generation method for the body becomes a problem.

Objects that exist in both spaces are designed so that people who are geographically distant from each other can surround one work space (for example, a desk) and collaborate with each other as if they were there. It must be possible for both workers to see with the same sense of direction and distance as if they were present at the same time. Then, when performing work such as arrangement and assembly of objects, it is necessary that the positional relationship between both objects existing at distant points be accurately mapped.

[0006]

DISCLOSURE OF THE INVENTION The present invention solves the above-mentioned problems and allows people who are geographically distant from each other to enclose a single work space and cooperate with each other as if they were there. The purpose is to be able to do.

[0007]

A video system forming a remote shared space according to the present invention displays an object in a remote work space with a display area and display surface position similar to those of a remote entity. Each unit has a means, a means for capturing an image of a substantive object that coexists with an object in the displayed work space in a space-divisionally or time-division manner, and a means for communicating processed images captured by each other, and is located at each remote location. The shared space is exposed by synthesizing the real object and the display object by the image sent from another place in the workplace.

As a result, objects in both spaces can be viewed with the same sense of direction and distance as if they were present on the spot.

[0009]

When a displayed object in the work space and a coexisting real object are spatially separated and imaged, for example, a set of two polarization plates attached to the imaging system lens side and the display surface side of the display unit. The plate optically separates the real object and the display object for imaging. In the case of time-divisionally separated imaging, for example, a liquid crystal light control panel capable of controlling switching between a light transmission state and a light non-transmission state by an electric signal is used, and the liquid crystal light control panel is used for the image pickup system. In synchronization with the shutter timing of the camera, control is performed so that the light is not transmitted during image capturing and the light is transmitted when image capturing is interrupted. In the light non-transmissive state, the real object is imaged separately from the display unit, and in the light transmissive state, the display object and the real object are combined and viewed.

By capturing the physical objects that actually exist in one's own space, transmitting them to another space, and generating a display object from the received video, objects in geographically distant locations perform one work. By enclosing a space (for example, a desk), it is possible to realize a collaborative work form as if one were present there.

[0011]

Embodiments of the present invention will be described in detail below with reference to the drawings. FIG. 1 shows an example of a system configuration using a space division type (optical) imaging system of the present invention.

In FIG. 1, reference numerals 1 and 1'denotes a space imaging camera for imaging a work space in a remote place. In this embodiment, the work desk (display screen on which a transparent plate is placed) is imaged from above. Reference numeral 2 denotes a communication interface, which has a function of communicating images from the spatial imaging cameras 1 and 1 '.
Reference numerals 3 and 3'are image input units, which receive the image communicated via the communication interface 2 and extract the characteristic shapes of the work space and objects for comparing the scales. Reference numerals 4 and 4'are display size comparison units, which are based on the screen sizes of the display units 8 and 8'which are initially set.
It has a function of calculating the display magnification and the display angle from the work space of the image received at 3'and the shape area of the object.
Reference numerals 5 and 5 ′ are scale correction signal transmission units, which are used to calculate the communication interface 2 from the calculation results of the display size comparison units 4 and 4 ′.
The optical zoom up / down control of the spatial imaging cameras 1 and 1'is performed via the. Reference numerals 6 and 6 ′ are image processing units for correcting the distortion of the image which has been optically corrected.
Performs processing such as rotation and scale conversion (enlargement / reduction).
Reference numerals 7 and 7 ′ are space division type image pickup separators, which separate the real object and the display object by a pair of polarizing plates attached to the lens side of the image pickup system and the display surface side of the display section for image pickup. In addition, the phenomenon of tunnel-like reflection that occurs when the optical axes match in a system that images / displays the same object is eliminated. Reference numerals 8 and 8'denotes display units, which display the processing results of the image processing units 6 and 6'on a display device (CRT, projector).

Next, the outline of the operation will be described. When an object is placed on the desk in the A space, the space imaging camera 1 takes an image, and the image is sent via the communication interface 2 and displayed on the display unit 8 '.

The image input unit 3'extracts the characteristic shape of the work space or object to be compared. The display size comparison unit 4'calculates the display magnification and the display angle from the work space and the shape area (image component) of the object based on the initial setting of the screen size of the display unit 8 '. Based on the calculation result, the scale correction signal transmission unit 5 ′ optically zooms up and down the spatial imaging camera 1 through the communication interface 2 to determine the imaging size and the display size (relative value to the screen size). Feedback control is performed so as to approximate. An image having a similar display size is rotated and scale-converted (enlarged / reduced) in the image processing unit 6 ', and finely adjusted. In addition, peripheral image distortion (three-dimensional component) with respect to the center of the display portion where the imaging system (lens) and the display system (CRT distortion) are superimposed is also corrected. And
The work space and the objects are displayed with the same display area and display surface position as the work space and the object in the remote place.

The object placed on the desk in the B space is also imaged and displayed. It should be noted that using a space-division type (optical) image pickup system as in this embodiment has an advantage that an entity object and a display object can be easily separated and imaged.

FIG. 2 shows an example of a system configuration using the time division type image pickup system of the present invention. In FIG. 2, 1,
Reference numeral 1'denotes a space imaging camera for imaging a work space in a remote place. In this embodiment, the work desk (display screen on which a light transmission / light non-transmission control plate is placed) is imaged from above.
2 is a communication interface, which is a camera for spatial imaging 1,
It has a function of communicating the image 1 '. Reference numerals 3 and 3'are image input units, which receive the image communicated via the communication interface 2 and extract the characteristic shapes of the work space and objects for comparing the scales. Numerals 4 and 4 ′ are display size comparison units, which are based on the screen sizes of the display units 8 and 8 ′ of the initial setting, and the display magnification from the work space of the images received by the image input units 3 and 3 ′ and the shape area of the object, It has a function to calculate the display angle. Numerals 5 and 5'denotes scale correction signal transmitters which perform optical zoom-up / down control of the spatial imaging camera 1 via the communication interface 2 based on the calculation results of the display size comparators 4, 4 '. 6,
An image processing unit 6'performs processing such as distortion correction, rotation, and scale conversion (enlargement / reduction) on the image that has been optically corrected. Reference numerals 8 and 8'denotes display units, which display the processing results of the image processing units 6 and 6'on a display device (CRT, projector). Reference numerals 10 and 10 'are time-division type image pickup / separation devices, and a light transmission / light non-transmission control plate (liquid crystal dimming panel) and a transmission / non-transmission control circuit 11, 11'.
12 'synchronizing circuit.

Next, the outline of the operation will be described. The image pickup / display control is the same as the method using the space division type (optical) image pickup system described above.

Regarding the means for separating the image of the physical object and the display object, which is the structural feature of this embodiment, a liquid crystal dimming panel whose light transmission state and light non-transmission state are alternately controlled by an electric signal is used. It is configured by means for controlling in synchronization with the shutter timing of the image pickup system camera so that the light is not transmitted during image pickup and the light is transmitted during image pickup interruption.

In the image pickup system in the A space, the synchronizing circuit 12
Receives a shutter signal output from the camera 1 for spatial imaging and generates a synchronizing signal, and the transmission / non-transmission control circuit 11 generates a drive signal in synchronization with the synchronization signal to transmit a light transmission / non-transmission control plate. To operate. The light transmission / light non-transmission control plate repeats the transmission / non-transmission state at a constant cycle. Further, in the image pickup system of the B space, the synchronizing circuit 12 'synchronizes so that the light transmission / light non-transmission control plate (liquid crystal light control panel) is in the non-transmission state when the spatial image pickup camera 1'is stopped. Circuit 12
The sync signal having a delay with respect to the sync signal is generated, and the transmission / non-transmission control circuit 11 'generates a drive signal synchronized with the synchronization signal to operate the light transmission / non-transmission control plate.

When the method of forming the remote shared space by using the time-division type image pickup system as in the present embodiment is used, the light transmittance is not decreased and the image quality is not impaired, so that the real object and the display object are not deteriorated. Has the merit of being able to separate and image / display.

FIG. 3 shows an example of a system configuration when the method of constructing the remote shared space of the present invention is extended to multipoint communication, and FIG. 4 shows the A space, B space and C space in FIG. An example of the configuration will be shown.

In FIGS. 3 and 4, 1a, 1b, 1
Reference numeral c denotes a space imaging camera, which images a work space in a remote place. Reference numerals 2a, 2b and 2c are communication interfaces, and have a function of communicating the images of the spatial imaging cameras 1a, 1b and 1c. 8a, 8b and 8c are display parts,
The received video is displayed on the display device (CRT, projector). Reference numeral 21 is a selector, which collects images transmitted from multiple points, and an image processing unit 22 and a field multiplexing unit 23.
Then, the processed image is distributed to each of the dispersed points after being transmitted to the specified processing. An image processing unit 22 performs image pickup / display control for full-scale display and image synthesis for creating a multipoint cooperative work space. A field multiplex unit 23 has a function of generating a multiplex image for stereoscopic display. Reference numeral 24 denotes a bidirectional switching control unit for switching between an operation mode request signal and an exercise output signal for performing exercise communication between multiple points. Allows manipulation of existing real objects.

Next, the outline of the operation will be described. The working space images of the points captured by the spatial imaging cameras 1a, 1b, 1c are concentrated on the selector 21 via the communication interfaces 2a, 2b, 2c. Space imaging camera 1a,
Reference numerals 1b and 1c are stereoscopic vision systems and are each composed of a set of two imaging systems. The selector 21 is linked to the image processing unit 22 and the field multiplexing unit 23 and sets a path for performing processing for full-scale display and stereoscopic display. Then, a path is set on the display units 8a, 8b, and 8c of the own space so as to display an image obtained by combining the work space objects of the other space, and the processed image is distributed to each point via the network.

The image processing unit 22 performs image pickup / display control for full-scale display and image synthesis for creating a multipoint cooperative work space. The actual size imaging / display control is the same as the method of forming the remote shared space using the space division type (optical) imaging system described above. Field multiplexing unit 23
Then, the video sources of the two sets of spatial imaging cameras 1a, 1b, 1c are alternately multiplexed on the left and right images every 1/60 sec. The image distributed from the selector 21 to each point via the network is displayed with the objects in the other space being combined and the display sizes being matched. When using the time-division shutter glasses that switch in synchronization with the display image on the display side, the display image can be viewed stereoscopically.

If the video system according to the present invention is used, it can be extended to multipoint communication, for example, Japanese Patent Application No. 4-1956.
There is an advantage that a remote operation system as shown in No. 14 can be combined to provide an environment in which a real object can be operated between remote places. In addition, for example, Japanese Patent Application No. 4-1163
By applying the bidirectional master-slave motion control method as shown in No. 92, motion communication can be performed in time division between multiple points, and real objects existing in dispersed points can be operated from any point + motion A communication network can be configured.

As described in the above embodiments, by using the video system forming the remote shared space of the present invention,
There is an advantage that people who are geographically distant from each other can work together as if they were surrounded by a single work space (for example, a desk).

It should be noted that each mechanism has a function of virtually generating an object in a computer, and a function of combining an object virtually generated with an object extracted from a real image according to a work purpose. It can also be provided.

Further, although the actual size (display area, display surface position) display is used in the present embodiment, the present invention is not limited to this, and may be appropriately used depending on the purpose of use, work environment, work demand. It is also possible to use a means for intentionally changing the scale, such as a variable scale (enlargement / reduction) control function of the display object. In addition, various modifications can be made without departing from the scope of the present invention.

[0029]

As described above, according to the present invention, both objects at a remote place are automatically displayed on both display units in actual size (display area, display surface position) or display with intentionally changed scale. There is a practical effect that it is possible to realize a function of performing a combination with an entity by instantly creating a collaborative work space that surrounds one work space (for example, a desk) as if it were present at that place between remote places.

By combining known remote control systems and the like, it becomes possible to provide an environment in which real objects can be operated between remote locations.

[Brief description of drawings]

FIG. 1 is a configuration diagram showing an embodiment using a space division type imaging system of the present invention.

FIG. 2 is a configuration diagram showing an embodiment using a time division type imaging system of the present invention.

FIG. 3 is a configuration diagram showing an embodiment in which the present invention is extended to multipoint communication and combined with a remote control system.

FIG. 4 is a configuration diagram in an A space, a B space, and a C space in FIG.

[Explanation of symbols]

 1 Spatial Imaging Camera 2 Communication Interface 3 Image Input Section 4 Display Size Comparison Section 5 Scale Correction Signal Transmission Section 6 Image Processing Section 7 Space Division Imaging Separator 8 Display Section 10 Time Division Imaging Separation Apparatus 11 Transparent / Opaque Control Circuit 12 Synchronous circuit

Claims (1)

[Claims] 1. A video system for supporting collaborative work in a geographically distant place, displaying an object in a distant work space with a display area and display surface position similar to those of a distant place. Means, means for capturing an image of a displayed workspace object and a real object coexisting with the object by space-divisionally or time-divisionally separated, and means for communicating processed images captured by each other , A video system that constitutes a remote shared space characterized by displaying a shared space by synthesizing a real object and a display object by a video sent from another place in a work place at each remote place.