JP2004064639A - Picture communication system and information processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To stably obtain video in a desired direction by easily controlling photographing using a photographing means such as a portable camera from a remote site. <P>SOLUTION: In the picture communication system having a camera server device and an image client device, the camera server device has a video input means, an attitude detecting means for detecting the attitude of the video input means, a control means for controlling photographing conditions from video direction control request information from the image client and information on the attitude detected by the attitude detecting means, and a transmission means for transmitting video photographed in accordance with the photographing conditions to the image client device, and the image client device has a transmission means for transmitting the video direction control request information to the camera server device, a receiving means for receiving image information transmitted from the camera server device, and a display means. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an apparatus for controlling shooting conditions of a shooting unit such as a portable camera from a remote place.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, cameras that can be controlled (pan, tilt, zoom, and the like) by connecting to a computer, so-called comb cameras, have appeared. By controlling the operation of the com camera from a client terminal at a remote location of the com camera and receiving a still image or a moving image taken by the com camera via the Internet or the like, a system capable of displaying a monitor on the client terminal side is provided. Is being developed. In addition, there is a known program that arranges such a comb camera on a network and distributes images to users on the network. In such a system, images can be transmitted almost in real time, and it is possible to easily see landscapes and the like in remote places.
[0003]
Further, a system has been developed in which a wide-angle camera is connected to a computer, and a still image and a moving image captured by the camera are received via the Internet or the like, so that a client terminal can monitor and display an arbitrary direction. Further, in a system in which such a camera is arranged on a network and an image is distributed to a user on the network, it is possible to easily view a landscape in a remote place.
[0004]
However, the individual camera positions of these systems are fixed and cannot move freely.
[0005]
Japanese Patent Application Laid-Open No. 2001-189927 proposes a simulated experience system in which a mobile station for acquiring video / audio information is provided, and at a point separated from the information collection point, the user can virtually experience as if they were at the information collection point. I have. However, since the movement of the mobile station is operated remotely, it is difficult to control and the place where the mobile station can be moved is limited.
[0006]
From a portable camera that can be carried to an arbitrary place, it is also possible to allow a client terminal to view a captured image via a network or the like. However, such control of the portable camera is left to only the person carrying the camera, and there is a problem that the client terminal cannot look around in any direction.
[0007]
JP-A-2000-209613 solves the above problem by creating a panoramic image in real time from a captured image of a portable camera and providing the panoramic image to a client. However, a portable camera photographer at the site is forced to take a photograph so that a panoramic image can be created.
[0008]
[Problems to be solved by the invention]
With a portable camera that can freely move around the site and shoot, the person who carries the camera at the site cannot see the image freely on the client terminal side unless the image requested by the client side is properly imaged. In other words, both the remote person and the person at the site could not freely experience the site.
[0009]
SUMMARY OF THE INVENTION An object of the present invention is to make it possible to easily control photographing using photographing means such as a portable camera from a remote place, and to stably obtain an image in a desired direction.
[0010]
In addition, by measuring and using the posture information of the portable camera and performing image processing on the image captured by the portable camera connected to a network or the like, the client terminal is not affected by the change in the posture of the portable camera, and the client terminal can perform the requested processing. It is an object of the present invention to be able to display an arbitrary scene image that can be observed from a position of a portable camera suitable for the camera.
[0011]
In addition, a portable camera connected to a network or the like and having a mechanism for reducing a change in the posture of the portable camera allows the client terminal to receive the position of the portable camera that meets the request without being affected by the change in the posture of the portable camera. It is an object of the present invention to be able to display an arbitrary scene image which can be observed from a user.
[0012]
[Means for Solving the Problems]
In order to achieve the above object, the present invention has the following configuration.
[0013]
The invention according to claim 1 of the present application is an image communication system having a camera server device and an image client device, wherein the camera server device is transmitted from the image client device with image input means for photographing an image. Video direction control request information input means for receiving video direction control request information, attitude detection means for detecting the attitude of the video input means, and the video direction control request information and the attitude information detected by the attitude detection means. The image client, comprising: a control unit that controls a shooting condition of the video input unit; and a sending unit that transmits image information about a video shot by the video input unit to the image client device according to the shooting condition. The apparatus comprises: a command input unit for inputting a command related to control of the video input unit; and a video direction corresponding to the command. Transmitting means for transmitting a control request information to the camera server, and receiving means for receiving image information transmitted from the camera server apparatus, and having a display means for displaying the image information data.
[0014]
The invention according to claim 5 of the present application is an image communication system including a camera server device and an image client device, wherein the camera server device is instructed by the instruction unit so that the posture is stably supported. Video input means, video direction control request information input means for receiving video direction control request information transmitted from the image client device, and control for controlling shooting conditions of the video input means according to the video direction control request information Means, and transmission means for transmitting image information relating to a video image captured by the video input means to the image client device according to the imaging conditions, wherein the image client device has a command related to control of the video input device. Command input means for inputting a command, and transmitting image direction control request information corresponding to the command to the camera server device. That the transmitting means, receiving means for receiving image information transmitted from the camera server apparatus, and having a display means for displaying the image information data.
[0015]
The invention according to claim 6 of the present application is an information processing method for controlling a photographing unit in accordance with image direction control request information, wherein image direction control request information specified by a user is input, and posture information of the image pickup unit is changed. The photographing condition of the photographing unit is obtained based on the input image direction control request information and the posture information, and the photographing unit is controlled using the photographing condition.
[0016]
BEST MODE FOR CARRYING OUT THE INVENTION
(Embodiment 1)
Hereinafter, an exemplary embodiment of the present invention will be described with reference to FIG.
[0017]
In the present embodiment, in order to obtain an arbitrary image from the camera server device (com camera 101, camera attitude measuring unit 106, and server control device 102), a remote image client device (client control device 107 and command input) An example of remotely controlling the comb camera 101 while referring to the unit 110 and the display device 111) will be described.
[0018]
In particular, in the present embodiment, a person carries the comb camera 101 and photographs a city landscape.
[0019]
Reference numeral 101 denotes a camera (referred to as a comb camera) capable of controlling a camera angle, an imaging condition, and the like based on a control signal from the connection line 101-a. The comb camera 101 can output data of a captured video in real time via the connection line 101-b.
[0020]
Reference numeral 106 denotes a camera posture measuring unit 106 for measuring a camera posture, and here, a gyro sensor is used. The camera attitude refers to the attitude of the camera itself (camera head), and is distinguished from the view direction and camera control parameters (pan angle, tilt angle, etc .: the direction of the camera lens with respect to the camera head). When the user carries the camera, the camera posture changes (FIG. 7), and the operability (particularly, pan and tilt) of the camera remote operation may be deteriorated on the image client device side. It is necessary to improve the operability of remote operation of the camera by measuring and using the camera posture information.
[0021]
On the other hand, by adopting a mechanism that does not significantly change the attitude of the portable camera, the camera attitude measuring unit 106 can be omitted. Since the natural movement of the camera carrier itself (change in posture due to mere walking) does not significantly affect remote operation, FIG. FIG. 9 shows a portable method that does not use such a method. FIG. 8 shows a mechanism in which the posture of the portable camera is always kept parallel, and the head of the camera is kept forward with respect to the portable rod. For example, a mechanism of a delivery machine can be used. Also, in FIG. 9, the camera is held perpendicular to the spine, so that the posture of the camera is kept constant. In the present embodiment, since the camera is configured as shown in FIG. 7, the camera attitude measuring unit 106 is adopted assuming that the camera attitude greatly changes.
[0022]
The camera posture information measured by the portable camera posture measurement unit 106 is sent to a camera control unit 103 described later.
[0023]
Reference numeral 102 denotes a server control device for controlling the comb camera based on a control signal transmitted from a client control device to be described later via a network line and a signal from the comb camera posture measuring unit 106. As the server control device 102, a so-called personal computer or the like is used.
[0024]
The specific configuration of the server control device 102 will be described below.
[0025]
A camera control unit 103 controls the comb camera 101 via a connection line 101-a (such as an RS232C interface). The camera control unit 103 acquires camera control request information transmitted from a client control device 107 described later and input via the network line and the communication interface 105, and converts camera posture information output from the camera posture measurement unit 106. get. Further, the camera 103 generates camera control information from the camera control request information and the camera attitude information, and controls the comb camera 101. Note that the camera control information referred to in the present embodiment generally refers to information that needs to be exchanged between devices in order to control the comb camera 101, and includes, for example, pan, tilt, and zoom of the camera. .
[0026]
Reference numeral 104 denotes a video input unit, such as an image capture device, for inputting video captured by the comb camera 101 via the connection line 101-b.
[0027]
Reference numeral 105 denotes a network adapter capable of communicating image information, audio information, and various types of control information with an external device (such as the client control device 107) connected via a network line, and is referred to as a communication interface.
[0028]
Further, the server control device 102 has a storage device such as a CPU, a ROM, and a RAM for controlling the operation of each unit in the device and performing necessary calculations, and stores programs and various parameters.
[0029]
Next, the image client device (the client control device 107, the command input unit 110, and the display device 111) will be specifically described.
[0030]
Reference numeral 107 denotes a client control device that acquires appropriate information from the server control device 102 in response to an operation input from a user. As the client control device 107, a personal computer is mainly used like the server control device 102.
[0031]
Reference numeral 108 denotes a network adapter having the same function as the communication interface 105, and is called a communication interface.
[0032]
Reference numeral 110 denotes a command input unit 110 for inputting camera control command information of the user, and outputs the input command information to a camera control information measuring unit 109 described later.
[0033]
Reference numeral 109 denotes a camera control information measurement unit that interprets command information input from the command input unit 110 as camera control information. In the present embodiment, the inclination information of the GPS mounted on the user's head is interpreted in association with a view control request to the camera 101. Of course, various input devices can be used as the command input unit 110, such as using a joystick or a mouse as the command input unit 110 and interpreting the input information as view control information in the camera control information measuring unit 109. . The camera control information measured by the camera control information measuring means 109 is transmitted to the communication interface 108.
[0034]
An information display unit 112 displays information input from the communication interface 108. In the present embodiment, image information is displayed on the head mounted display 111 mounted on the client. Thereby, the client user can visually recognize the video shot by the camera 101.
[0035]
The operation of the server control device according to the present embodiment will be described with reference to the flowchart shown in FIG.
[0036]
The process starts in step S40a.
[0037]
In step S41a, camera control request information transmitted from the client control device 107 is obtained.
[0038]
In step S42a, the camera posture information transmitted from the camera posture measurement device 106 is obtained.
[0039]
In step S43a, camera control parameters are obtained based on the camera control request information obtained in S41a and the camera attitude information obtained in S42a. As described above, this step is necessary to satisfy the camera control request without being affected by the movement of the camera 101 itself.
[0040]
In the present embodiment, the camera control parameters of the camera control information include pan (θ), tilt (φ), and zoom (z). θ indicates a pan angle, φ indicates a tilt angle, and z indicates a zoom magnification.
Assuming that camera control request parameters are (θc, φc, zc) and camera attitude information is (θi, φi, zi) with respect to camera control parameters (θ, φ, z),
(Θ, φ, z) = (θc, φc, zc) − (θi, φi, 0)
Can be used to determine camera control parameters. However, since the range of the pan angle is -90 degrees to 90 degrees in the present embodiment, if the calculated angle exceeds this range, the upper or lower limit value, that is, the value of 90 degrees or -90 degrees is set. You. With this calculation, the operability of remote operation caused by carrying the camera is improved.
[0041]
In step S44a, the camera is actually operated according to the camera control parameters calculated in S43a.
[0042]
In step S45a, the image captured by the camera 101 is input to the image input unit 104.
[0043]
In step S46a, the video information input in S45a is transmitted to the client control device 107 through the communication interface 105. Audio information and the like may be transmitted together with the video information.
[0044]
The operation of the client control device according to the present embodiment will be described with reference to the flowchart shown in FIG.
[0045]
The connection is started in step S40b.
[0046]
In step S41b, a command from the client user is received.
[0047]
In step S42b, the command input in S41b is interpreted as camera control request information.
[0048]
In step S43b, the camera control request information interpreted in S41b is transmitted to the server control device 102 through the communication interface 108.
[0049]
In step S44b, information returned from the server control device 102 based on the camera control request information transmitted in step S43b is received.
[0050]
In step S45b, the information input from the server control device 102 in S44b is displayed to the user.
[0051]
According to the present embodiment, in a portable camera connected to a network or the like, by using a mechanism for reducing the posture change of the portable camera or the posture information of the portable camera, the posture change due to carrying the camera on the client side is reduced. The present invention relates to a device that enables an arbitrary scene image that can be observed from a position of a portable camera that meets an input request that is not affected by the monitor to be displayed on a monitor.
[0052]
(Embodiment 2)
As a second embodiment of the present invention, an embodiment in which a wide-angle camera (fisheye lens) is used instead of the comb camera used in the first embodiment will be described with reference to FIG.
[0053]
In the present embodiment, a wide-angle image captured by a wide-angle camera of a camera server device (the wide-angle camera 101, the camera attitude measuring unit 106, and the server control device 102) is used, and an image client device (client control The image (view) in an arbitrary direction is referred to by the device 207, the command input unit 110, and the display device 111).
[0054]
In particular, in the present embodiment, a person carries the wide-angle camera 201 and photographs a city scenery.
[0055]
Reference numeral 201 denotes a wide-angle camera that can capture almost the entire periphery, such as a fish-eye lens camera. The wide-angle camera 201 can output the data of the captured video in real time via the connection line 201-b.
[0056]
Reference numeral 206 denotes a camera posture measuring unit 206 for measuring the posture of the camera, and here, a gyro sensor is used. In the present embodiment, the posture of the camera is changed by carrying the camera. The camera posture information measured here is used to control the view direction on the camera server device side or the image client device side. In the present embodiment, view control is performed on the camera server device side.
[0057]
The camera posture information measured by the camera posture measurement unit 206 is sent to an image control unit 203 described later.
[0058]
Here, as in the first embodiment, the camera posture measuring device 206 can be omitted by incorporating a mechanism that does not greatly change the posture of the portable camera. FIG. 10 shows a mechanism that does not significantly change the attitude of the portable camera.
[0059]
Reference numeral 202 denotes a server control device for controlling an output image based on a control signal transmitted from a client control device described later via a network line and a signal from the camera posture measuring unit 206. As the server control device 202, a so-called personal computer or the like is used.
[0060]
The specific configuration of the server control device 202 will be described below.
[0061]
Reference numeral 204 denotes an image input unit, such as an image capture device, for inputting an image captured by the wide-angle camera 201 via the connection line 201-b. The image input here is sent to the image processing means 203 described later.
[0062]
The image processing unit 203 is an image processing unit that controls a captured image of the wide-angle camera 201 input from the image input unit 204. The image processing unit 203 acquires view control request information (information such as a view direction requested from a client) transmitted from the client control device 207 in the first embodiment and input via the network line and the communication interface 205. Further, when there is a camera posture measuring unit 206, the camera posture information output from the camera posture measuring unit 206 is obtained. Further, the image processing unit 203 generates an appropriate view image from the image input from the video input unit 204 based on the view control request information and, in some cases, the camera attitude information. At this time, the image distortion caused by imaging with the wide-angle camera is also corrected.
[0063]
Reference numeral 205 denotes a network adapter capable of communicating image information, audio information, and various types of control information with an external device (such as the client control device 207) connected via a network line, and is referred to as a communication interface.
[0064]
Further, the server control device 202 has a storage device such as a CPU, a ROM, and a RAM for performing necessary calculations in the device, and stores programs and various parameters.
[0065]
Next, the image client device (the client control device 207, the command input unit 210, and the display device 211) will be specifically described.
[0066]
Reference numeral 207 denotes a client control device that acquires appropriate information from the server control device 102 in response to an operation input from a user. As the client control device 207, a personal computer is mainly used like the server control device 202.
[0067]
A network adapter 208 has the same function as the communication interface 205, and is called a communication interface.
[0068]
Reference numeral 210 denotes a command input unit 210 for inputting the user's view control command information, and outputs the input command information to the view control information measuring unit 209.
[0069]
Reference numeral 209 denotes a view control information measuring unit that interprets command information input from the command input unit 210 as view control information. In the present embodiment, the inclination information of the GPS mounted on the user's head is interpreted in association with the view control request to the camera 201. Of course, various input devices can be used as the command input unit 210, such as using a joystick or a mouse as the command input unit 210 and interpreting the input information as view control information in the view control information measuring unit 209. . The view control information measured by the view control information measuring unit 209 is transmitted to the communication interface 208.
[0070]
Reference numeral 212 denotes an information display unit that displays information input from the communication interface 208. In the present embodiment, the video information is displayed on the head mounted display 211 mounted on the client. Thereby, the client user can visually recognize an arbitrary view image captured by the camera 201.
[0071]
The operation of the server control device according to the present embodiment will be described with reference to the flowchart shown in FIG.
[0072]
The process starts in step S50a.
[0073]
In step S51a, view control request information transmitted from the client control device 207 is obtained.
[0074]
In step S52a, the camera posture information transmitted from the camera posture measurement device 206 is obtained.
[0075]
In step S53a, the image captured by the wide-angle camera 201 is input to the image input unit 204.
[0076]
In step S54a, a view image is generated from the video input in S53a, based on the view control request information acquired in S51a and the camera attitude information acquired in S52a.
[0077]
In the present embodiment, the parameters of the view control information include pan (θ) and tilt (φ). θ indicates a pan angle and φ indicates a tilt angle.
[0078]
Assuming that the view control request parameter is (θc, φc) and the camera attitude information is (θi, φi) with respect to the view control parameter (θ, φ),
(Θ, φ) = (θc, φc) − (θi, φi)
Can be used to determine the view control parameters. Here, the image input in S53a is an image captured by a wide-angle camera, and has distortion. A view image corresponding to the view control parameters (θ, φ) is generated in consideration of the image distortion.
[0079]
In step S5, the view image generated in S4 is transmitted to the client control device 207 through the image information communication interface 205. Sound information and the like may be transmitted together with the image information.
[0080]
The operation of the client control device according to the present embodiment will be described with reference to the flowchart shown in FIG.
[0081]
Connection is started in step S50b.
[0082]
In step S51b, a command from the client user is received.
[0083]
In step S52b, the command input in S51b is interpreted as view control request information.
[0084]
In step S53b, the view control request information interpreted in S51b is transmitted to the server control device 202 through the communication interface 208.
[0085]
In step S54b, information returned from the server control device 202 based on the view control request information transmitted in step S53b is received.
[0086]
In step S55b, the information input from the server control device 202 in S54b is displayed to the user.
[0087]
(Embodiment 3)
A third embodiment will be described with reference to FIG.
[0088]
In the present embodiment, similarly to the second embodiment, a client terminal (client) at a remote location is used by using a wide-angle image from a camera server device (wide-angle camera 301, camera attitude measuring unit 306, and server control device 302). The control device 307, the command input unit 310, and the display device 311) refer to an image (view) in an arbitrary direction.
[0089]
In the second embodiment, the view image requested by the client is generated on the camera server device side. In the present embodiment, only the image correction is performed on the camera server device side, and the generation of the view image is performed on the image client device side.
[0090]
In particular, in the present embodiment, a person carries the wide-angle camera 301 and photographs a city scenery.
[0091]
Reference numeral 301 denotes a wide-angle camera that can capture almost the entire periphery. The wide-angle camera 301 can output the data of the captured video in real time via the connection line 301-b.
[0092]
Reference numeral 306 denotes a camera posture measuring device 306 for measuring the posture of the camera, which uses a gyro sensor here. The camera posture information measured by the camera posture measurement device 306 is sent to an image processing unit 304 described later.
[0093]
Reference numeral 302 denotes a server control device for controlling an image output based on a signal from the wide-angle camera posture measurement unit 306. As the server control device 302, a so-called personal computer or the like is used. Further, the server control device 302 can transmit image information, camera posture information, and the like generated by the image processing unit 303 to a plurality of client control devices via a wireless network line.
[0094]
The specific configuration of the server control device 302 will be described below.
[0095]
Reference numeral 304 denotes a video input unit such as an image capture device for inputting via the connection line 301-b. The image input here is sent to the image processing means 303 described later.
[0096]
The image processing unit 303 corrects the distortion of the image captured by the wide-angle camera 301, and further converts the image into a fixed camera posture image using the camera posture information output from the camera posture measurement unit 306.
[0097]
Reference numeral 305 denotes a network adapter capable of communicating image information, audio information, and various types of control information with an external device (such as the client control device 307) connected via a network line, and is referred to as a communication interface.
[0098]
Further, the server control device 302 has a storage device such as a CPU, a ROM, and a RAM for performing necessary calculations in the device, and stores programs and various parameters.
[0099]
Next, the image client device (the client control device 307, the command input unit 310, and the display device 311) will be specifically described.
[0100]
Reference numeral 307 denotes a client control device that acquires image information from the server control device 302 and generates appropriate information according to an operation input from a user. As the client control device 307, a personal computer is mainly used like the server control device 302.
[0101]
A network adapter 308 has the same function as the communication interface 305, and is called a communication interface.
[0102]
Reference numeral 310 denotes a command input unit 310 for inputting user's view control command information, and outputs the input command information to the view control information measuring unit 309.
[0103]
Reference numeral 309 denotes a view control information measuring unit that interprets command information input from the command input unit 310 as view control information. In the present embodiment, the inclination information of the GPS mounted on the user's head is interpreted in association with the view control request to the camera 301. Of course, the command input unit 310 can be substituted with various input devices, such as using a joystick or a mouse as the command input unit 310 and interpreting the input information as view control information in the view control information measuring unit 309. . The view control information measured by the view control information measuring unit 309 is transmitted to an image processing unit 312 described later.
[0104]
Reference numeral 312 denotes an image processing unit. The image processing unit 312 generates a view image from the image information input from the communication interface 308 and the view control information input from the view control information measurement unit 309. The view image generated by the image processing unit 312 is displayed on the display device 311.
[0105]
The operation of the server control device according to the present embodiment will be described with reference to the flowchart shown in FIG.
[0106]
The process starts in step S60a.
[0107]
In step S61a, the image captured by the wide-angle camera 301 is input to the image input unit 304.
[0108]
In step S62a, the camera posture information transmitted from the camera posture measurement device 306 is obtained.
[0109]
In step S63a, the image input in S61a is corrected based on the wide-angle lens information and the camera posture information acquired in S62a. At this time, the distortion of the captured image itself is also corrected.
[0110]
In step S64a, the image generated in S63a is transmitted to the client control device 207 via the communication interface 305.
[0111]
The operation of the client control device according to the present embodiment will be described with reference to the flowchart shown in FIG.
[0112]
The connection is started in step S60b.
[0113]
In step S61b, a command from the client user is received.
[0114]
In step S62b, the command input in S61b is interpreted as view control request information.
[0115]
In step S63b, information transmitted from server control device 302 is accepted.
[0116]
In step S64b, view information is generated from the image information input in S63b based on the view control request information interpreted in S61b.
[0117]
In step S65b, the view image created in S64b is displayed.
[0118]
In the present embodiment, the server performs “lens distortion correction” and “correction to unify the direction of the captured image based on the camera posture information”. From the client server to the client server.
[0119]
(Embodiment 4)
A fourth embodiment will be described with reference to FIG.
[0120]
In the present embodiment, similarly to the third embodiment, a client device (client) located at a remote place is used by using a wide-angle image from a camera server device (wide-angle camera 401, camera attitude measuring unit 406, and server control device 402). The control device 407, the command input unit 410, and the display device 411) refer to an image (view) in an arbitrary direction. The user on the client device side wears the HMD while sitting on a rotating chair that rotates in synchronization with the camera posture (FIG. 12).
[0121]
In the present embodiment, a person carries the wide-angle camera 401 and takes a picture of a city.
[0122]
Reference numeral 401 denotes a wide-angle camera that can capture almost the entire periphery. The wide-angle camera 401 can output the data of the captured video in real time via the connection line 401-b.
[0123]
Reference numeral 406 denotes a camera posture measuring device 406 for measuring the posture of the camera, and here a gyro sensor is used. The camera posture information measured by the camera posture measurement device 406 is sent to an image processing unit 404 described later, and further sent to an image client device via a network line.
[0124]
A control unit 402 controls information to be sent to the image client device based on a captured image of the wide-angle camera 401 and a signal from the attitude measurement unit 406, and can transmit the information to a plurality of image client control devices via a wireless network line. It is.
[0125]
The specific configuration of the server control device 402 will be described below.
[0126]
Reference numeral 404 denotes a video input unit such as an image capture device for inputting via the connection line 401-b. The image input here is sent to the image processing means 403 described later.
[0127]
The image processing unit 403 corrects a distortion of an image captured by the wide-angle camera 301.
[0128]
A network adapter 405 enables communication of image information, camera attitude information, audio information, and various types of control information with an external device (such as a client control device 407) connected via a network line. Call.
[0129]
Further, the server control device 402 has a storage device such as a CPU, a ROM, and a RAM for performing necessary calculations in the device, and stores programs and various parameters.
[0130]
Next, the client device (the client control device 407, the command input unit 410, the display device 411, and the rotating sheet 414) will be specifically described.
[0131]
Reference numeral 407 denotes a client control device that controls the rotating sheet based on information transmitted from the server control device 402 via a network line, and generates an appropriate image according to an operation input from a user. As the client control device 407, a personal computer is mainly used like the server control device 402.
[0132]
Reference numeral 408 denotes a network adapter having the same function as the communication interface 405, and is called a communication interface.
[0133]
Reference numeral 410 denotes a command input unit 410 for inputting the user's view control command information, and outputs the input command information to the view control information measuring unit 409.
[0134]
Reference numeral 413 denotes a sheet control unit 413 that acquires camera posture information transmitted from the server control device 402 via a network line and controls a rotating sheet 414 described below.
[0135]
The rotating sheet 414 rotates based on a signal from the sheet control unit 413. Seat 414 allows the user to experience the same posture as a remote camera carrier.
[0136]
Reference numeral 409 denotes a view control information measuring unit that interprets command information input from the command input unit 410 as view control information. In the present embodiment, the tilt information of the user's head with respect to the rotating sheet is interpreted in association with a view control request to the camera 401. The command input unit 410 can be replaced with various input devices. The view control information measured by the view control information measuring unit 409 is transmitted to an image processing unit 412 described later.
[0137]
412 is an image processing unit. The image processing unit 412 generates a view image from the image information input from the communication interface 408 and the view control information input from the view control information measurement unit 409. The view image generated by the image processing unit 412 is displayed on the display device 411. This allows the user to look around in any direction.
[0138]
The operation of the server control device according to the present embodiment will be described with reference to the flowchart shown in FIG.
[0139]
The process starts in step S130a.
[0140]
In step S131a, the image captured by the wide-angle camera 401 is input to the image input unit 404.
[0141]
In step S132a, the camera posture information transmitted from the camera posture measurement device 406 is obtained.
[0142]
In step S133a, distortion correction of the image input in S131a is performed based on the wide-angle lens information.
[0143]
In step S134a, the image generated in S133a and the camera posture information acquired in S132a are transmitted to the client control device 207 via the communication interface 405.
[0144]
The operation of the client control device according to the present embodiment will be described with reference to the flowchart shown in FIG.
[0145]
The connection is started in step S130b.
[0146]
In step S131b, information transmitted from server control device 402 is received.
[0147]
In step S132b, the rotating sheet is controlled based on the camera posture information acquired in S131b.
[0148]
In step S133b, a command from the client user is received.
[0149]
In step S134b, a view image is generated from the command input in S131b.
[0150]
In step S135b, the view image created in S134b is displayed.
[0151]
As described above, according to the above embodiments, a portable camera server device is provided with a function of correcting blurring of a captured image caused by carrying a camera, so that a remote image client device is provided. Side can refer to any view image. If this is used, one person can carry a portable camera and visit a sightseeing spot, so that even a remote person can experience the experience of traveling together while carrying his / her back.
[0152]
In particular, in the third and fourth embodiments, the camera server device side provides a wide-angle image in which the deviation in the direction originally caused by carrying the camera is provided, and the client device side extracts an image in an arbitrary direction. A plurality of image client devices can be assigned to one camera server device. If this is used, it becomes possible for one person to carry a portable camera and visit a sightseeing spot, so that the experience of traveling by a plurality of people becomes possible. In addition, if this is used by a travel agency and the tour conductor of each tour carries a portable camera, it is possible to virtually participate in any tour currently being performed.
[0153]
【The invention's effect】
ADVANTAGE OF THE INVENTION According to this invention, imaging | photography using imaging | photography means, such as a portable camera, can be easily controlled from a remote place, and the image of a desired direction can be obtained stably.
[0154]
According to the invention of claim 1 of the present application, an image captured by a mobile camera connected to a network or the like is processed by measuring and using the attitude information of the mobile camera. It is possible to display an arbitrary scene image that can be observed from the position of the portable camera that meets the request without being affected by the change.
[0155]
According to the invention of claim 5 of the present application, a portable camera connected to a network or the like and having a mechanism for reducing a change in posture of the portable camera, the client terminal is not affected by the change in posture of the portable camera. An arbitrary scene image that can be observed from the position of the portable camera that meets the request can be displayed.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a schematic configuration of a first embodiment.
FIG. 2 is a block diagram illustrating a schematic configuration of a second embodiment.
FIG. 3 is a block diagram illustrating a schematic configuration of a third embodiment.
FIG. 4 is a flowchart illustrating a processing procedure according to the first embodiment.
FIG. 5 is a flowchart illustrating a processing procedure according to a second embodiment.
FIG. 6 is a flowchart illustrating a processing procedure according to a third embodiment.
FIG. 7 is a schematic diagram of a server device according to the first embodiment.
FIG. 8 is an example of a mechanism in the first embodiment in which the attitude of the portable camera does not change significantly.
FIG. 9 is an example of a portable method according to the first embodiment in which the posture of the portable camera does not significantly change.
FIG. 10 is a schematic diagram of a server device according to the second embodiment.
FIG. 11 is an example of a mechanism in the first embodiment in which the attitude of the portable wide-angle camera does not change significantly.
FIG. 12 is a block diagram showing a schematic configuration of a fourth embodiment.
FIG. 13 is a flowchart illustrating a processing procedure according to a fourth embodiment.

Claims (8)

An image communication system having a camera server device and an image client device,
The camera server device,
Video input means for capturing video,
Image direction control request information input means for receiving image direction control request information transmitted from the image client device,
Attitude detection means for detecting the attitude of the video input means,
A control unit that controls a shooting condition of the video input unit from the video direction control request information and the posture information detected by the posture detection unit,
Transmitting means for transmitting to the image client device image information about the video taken by the video input means according to the shooting conditions,
The image client device includes:
Command input means for inputting a command related to control of the video input means,
Transmission means for transmitting video direction control request information according to the command to the camera server device,
Receiving means for receiving image information transmitted from the camera server device;
Display means for displaying the image information information. 2. The image communication system according to claim 1, further comprising an instruction unit for stably supporting the attitude of the video input unit. The image communication system according to claim 1, wherein the image direction control request information is information for operating the image input unit. The image input means inputs a wide-angle image,
2. The image communication system according to claim 1, wherein the image direction control request information is information indicating a view direction of a video indicated by image information transmitted to the client device. An image communication system having a camera server device and an image client device,
The camera server device,
A video input unit instructed by the instruction unit so that the posture is stably supported,
Image direction control request information input means for receiving image direction control request information transmitted from the image client device,
Control means for controlling shooting conditions of the video input means according to the video direction control request information,
Transmitting means for transmitting to the image client device image information about the video taken by the video input means according to the shooting conditions,
The image client device includes:
Command input means for inputting a command related to control of the video input means,
Transmission means for transmitting video direction control request information according to the command to the camera server device,
Receiving means for receiving image information transmitted from the camera server device;
Display means for displaying the image information information. An information processing method for controlling a photographing unit according to video direction control request information,
Input the video direction control request information specified by the user,
Input the posture information of the imaging unit,
Based on the image direction control request information and the attitude information, determine the imaging conditions of the imaging unit,
An information processing method comprising controlling the photographing unit using the photographing conditions. 7. The information processing method according to claim 6, wherein the photographing unit is held by a photographer, and is instructed by an instruction unit that is instructed to reduce the influence of the operation of the photographer. A program for realizing the information processing method according to claim 6.

Images