JP6630654B2 - Program, method, information processing device and video display system - Google Patents

Description

  The present invention relates to a program, a method, an information processing device, and a video display system.

  2. Description of the Related Art Shooting and displaying wide-field images such as panoramic images (images having a wide field of view in the horizontal direction) and omnidirectional images (images having a field of view in all directions) are becoming widespread (for example, see Patent Document 1). ).

  When such a wide-field image is displayed on a screen, it is difficult to display an image in all directions in one display area from the viewpoint of visibility. Therefore, partial images having different directions are displayed in a plurality of display areas. May be displayed.

  When displaying partial images having different directions in a plurality of display areas as described above, an image in a predetermined direction is often fixed in each display area. In this case, operations such as moving or enlarging / reducing the image with respect to the display area are not performed.

  Although it is conceivable that operations such as movement and enlargement / reduction can be performed on the display area, it is fundamental to perform movement / enlargement / reduction operation independently for each display area.

  As described above, when a wide-field image is displayed in a plurality of display areas, there is no user interface for an operation suitable for the characteristics of the wide-field image, and the user cannot perform an operation on the image as desired. There was a problem.

  The present invention has been proposed in view of the above-described conventional problems, and an object of the present invention is to provide a user interface that can perform a flexible operation when displaying an image on a plurality of display areas. .

In order to solve the above problem, in the present invention, a first predetermined area which is a part of a spherical image and is specified at least by a horizontal angle is displayed in a first area of a screen, and wherein a part of the celestial sphere image from the first predetermined region Ri Do different horizontal angle, the vertical angle to display the second predetermined region to be the same as in the second region of the screen, the The first operation, which is an operation in the first area, causes the first predetermined area to be displayed in the first area and the second predetermined area to be displayed in the second area to change in cooperation with each other. A first process to be performed, and a second operation that is a continuous operation from the first area to the second area, the first predetermined area to be displayed in the first area, and the second area to be displayed in the second area. And a second process of cooperatively changing the second predetermined area to be displayed. It was performed on location, the first region and the second region, that are arranged in the vertical direction in the screen.

  According to the present invention, it is possible to provide a user interface capable of performing a flexible operation when displaying an image in a plurality of display areas.

It is a figure showing the example of composition of the picture display system concerning one embodiment of the present invention. FIG. 2 is a diagram illustrating an example of an external configuration of a photographing device. FIG. 3 is a diagram illustrating an example of a hardware configuration of an imaging device. FIG. 3 is a diagram illustrating a hardware configuration example of an information processing apparatus. It is a figure showing the example of software composition of a picture display system. It is a figure showing an example of a display area pattern table. FIG. 3 is a diagram (part 1) illustrating an example of a display area. FIG. 10 is a diagram (part 2) illustrating an example of a display area. FIG. 11 is a diagram (part 3) illustrating an example of a display area. FIG. 14 is a diagram (part 4) illustrating an example of a display area. FIG. 14 is a diagram (part 5) illustrating an example of a display area. FIG. 14 is a diagram (part 6) illustrating an example of a display area. FIG. 14 is a diagram (part 7) illustrating an example of a display area. FIG. 9 is a diagram illustrating an example of an area transition pattern table. FIG. 4 is a diagram illustrating an example of current data. It is a figure showing an example of photography by a photography device. It is a figure showing the example of the picture picturized by the photography device. FIG. 4 is a diagram illustrating an example of generation of a spherical image. It is a figure (the 1) which shows the example of cutout of a display picture. FIG. 11 is a diagram (part 2) illustrating an example of cutting out a display image. 5 is a flowchart illustrating a processing example of the embodiment. FIG. 9 is a diagram (part 1) illustrating an example of an operation and a display change. FIG. 11 is a diagram (part 2) illustrating an example of an operation and a display change. FIG. 11 is a diagram (part 3) illustrating an example of an operation and a display change. FIG. 14 is a diagram (part 4) illustrating an example of an operation and a display change. FIG. 14 is a diagram (part 5) illustrating an example of an operation and a display change. FIG. 11 is a diagram (part 6) illustrating an example of an operation and a display change. It is a figure (the 7) showing the example of operation and display change. FIG. 14 is a diagram (part 8) illustrating an example of an operation and a display change. FIG. 14 is a diagram (part 9) illustrating an example of an operation and a display change. FIG. 14 is a diagram (part 10) illustrating an example of an operation and a display change.

  Hereinafter, preferred embodiments of the present invention will be described.

<Configuration>
FIG. 1 is a diagram illustrating a configuration example of a video display system 10 according to an embodiment of the present invention. In FIG. 1, a video display system 10 includes a photographing device 1, an information processing device 2, and a Web server 3. The connection between the imaging device 1 and the information processing device 2 and the connection between the Web server 3 and the information processing device 2 are wireless or wired.

  The image capturing device 1 has a function of capturing a spherical image and providing the captured image to the information processing device 2. It should be noted that the image to be photographed is not limited to a spherical image, but may be a panoramic image or another image. The information processing device 2 is a device such as a smartphone, a tablet, a mobile phone, and a PC (Personal Computer), and has a function of acquiring a video from the imaging device 1 or the Web server 3 and displaying the video to a user. ing. The Web server 3 has a function of acquiring and storing a video in advance, and providing the video to the information processing apparatus 2.

  FIG. 2 is a diagram illustrating an example of an external configuration of the photographing apparatus 1. FIG. 2A shows a state in which the user holds the imaging device 1 in his hand. FIG. 2B is a diagram of the photographing apparatus 1 viewed from the right side of FIG. FIG. 2C is a view of the photographing apparatus 1 viewed from above FIG.

  The photographing apparatus 1 has a front photographing element 1H1 provided on an upper portion on one side of a housing, and a rear photographing element 1H2 provided on an opposite side. A switch 1H3 is provided at the center of the housing. The switch 1H3 is used to instruct shooting.

  FIG. 3 is a diagram illustrating an example of a hardware configuration of the photographing apparatus 1. In FIG. 3, the photographing apparatus 1 includes a photographing unit 1H4, a video processing unit 1H7, and a photographing control unit 1H8. The photographing unit 1H4 includes a front photographing element 1H1, a rear photographing element 1H2, and lenses 1H5 and 1H6. The image processing unit 1H7 has a function of generating a spherical image from the images captured by the front imaging element 1H1 and the rear imaging element 1H2. The photographing control unit 1H8 has a function of controlling photographing of the front photographing element 1H1 and the rear photographing element 1H2.

  The image capturing apparatus 1 includes a CPU (Central Processing Unit) 1H9, a ROM (Read-Only Memory) 1H10, an SRAM (Static Random Access Memory) 1H11, and a DRAM (Dynamic Random Access Memory) interconnected via a bus 1H17. 1H12, an operation I / F (Interface) 1H13, a network I / F 1H14, a wireless I / F 1H15, and an antenna 1H16. These are used to control the image processing unit 1H7 and the imaging control unit 1H8, and to perform processing for providing the captured omnidirectional image to the outside.

  FIG. 4 is a diagram illustrating an example of a hardware configuration of the information processing apparatus 2. In FIG. 4, the information processing device 2 includes an auxiliary storage device 2H1, a main storage device 2H2, an input / output device 2H3, a state sensor 2H4, a CPU 2H5, and a network I / F 2H6 interconnected via a bus 2H7. I have. The state sensor 2H4 includes an angle sensor and an acceleration sensor for detecting whether the information processing device 2 is held vertically or horizontally. The input / output device 2H3 is a display, a touch panel, and the like for displaying a screen and receiving a user operation. The CPU 2H5 is used to control acquisition of a video from the imaging device 1 or the Web server 3, display of a video screen, and the like.

  FIG. 5 is a diagram illustrating an example of a software configuration of the video display system 10. In FIG. 5, the photographing apparatus 1 includes a first photographing unit 11, a second photographing unit 12, and a spherical image generating unit 13. The first imaging unit 11 corresponds to the front imaging device 1H1 (FIG. 3), and the second imaging unit 12 corresponds to the rear imaging device 1H2 (FIG. 3). The spherical image generator 13 corresponds to the image processing unit 1H7 (FIG. 3).

  The information processing device 2 includes a video acquisition unit 21, an area control unit 22, an input / output unit 23, and a storage unit 24. The area control unit 22 includes an image selection unit 221, an area setting unit 222, an image allocation unit 223, an operation determination unit 224, and an image operation unit 225. The storage unit 24 includes a video data storage unit 241, a display area pattern storage unit 242, an area transition pattern storage unit 243, and a current data storage unit 244.

  The video acquisition unit 21 has a function of acquiring a video from the imaging device 1 or the Web server 3 and storing the video in the video data storage unit 241.

  The area control unit 22 manages a display area on the screen, displays an image in the display area, and performs a process of receiving an operation (movement, enlargement / reduction, etc.) from the user to the image and reflecting the operation on the display. have.

  The video selection unit 221 has a function of allowing the user to select a video to be displayed from the videos stored in the video data storage unit 241. The video selection unit 221 stores the video ID for identifying the selected video in the current data storage unit 244 as current data.

  The area setting unit 222 has a function of receiving a user's selection from the display area patterns stored in the display area pattern storage unit 242 and setting the display area. The region setting unit 222 stores the data of the selected display region pattern and the data of the corresponding region transition pattern (which describes the processing when the operation extends over a plurality of display regions and is stored in the region transition pattern storage unit 243). The data is stored in the current data storage unit 244 as data.

  The video allocating unit 223 has a function of acquiring and allocating a video from the video data storage unit 241 to each display area set by the area setting unit 222. The video assigned to each display area is a video in a different area of the acquired video, but may include a partly common area.

  The operation determining unit 224 has a function of determining a user's operation on an image. At this time, the coordinate information of the operation input from the input / output unit 23 and the current data storage unit 244 are stored in order to determine which display area the operation corresponds to, and to determine an operation over a plurality of display areas. Refer to the current data. Note that the user's operation on the video may be an operation using a finger that touches the screen, or an operation using an electronic pen, a mouse, or the like.

  The video operation unit 225 has a function of reflecting the operation on the video data stored in the video data storage unit 241 according to the operation determined by the operation determination unit 224. The video operation unit 225 reflects the direction and the viewing angle of the video changed by the operation in the current data of the current data storage unit 244.

  The input / output unit 23 has a function of accepting a user's operation and providing coordinate information on the screen where the operation has been performed to the region control unit 22 and inputting an output video from the region control unit 22 to display the screen. I have.

  FIG. 6 is a diagram illustrating an example of the display area pattern table held in the display area pattern storage unit 242. The contents of the display area pattern table are stored when installing the application programs constituting the video acquisition unit 21, the area control unit 22, the input / output unit 23, and the like. And updated.

  In FIG. 6, the display area pattern table has items such as “display area pattern”, “number of areas”, “image range (initial value)”, “arrangement pattern”, “reference”, and “direction of cooperative display”.

  “Display area pattern” is information for identifying the pattern of the display area. “Number of areas” is the number of display areas in the display area pattern. The “image range (initial value)” is the initial value of the range of the image displayed in each display area in the display area pattern. In the case of a spherical image, the image is specified by the angle θ in the horizontal direction, the angle φ in the vertical direction, and the viewing angle α. Note that the range of the video changes when the user moves or enlarges / reduces the size by an operation of the user, but these are reflected in the current data.

  The “arrangement pattern” indicates how to arrange a plurality of display areas in the screen, and a plurality of options are prepared so that the user can select. The selected arrangement pattern is reflected on the current data.

  A specific example of the arrangement pattern will be described. FIG. 7 shows an example in which two display areas are equally divided vertically into two display areas when the camera is held vertically. FIG. 8 shows a case where the display area is vertically divided into two display areas when held vertically, and an example in which the lower display area is enlarged and the upper display area is reduced. FIG. 9 shows a case where two display areas are divided into two when the camera is held vertically, and a small display area is provided at the upper right corner of the display area on the entire screen. FIG. 10 shows an example in which three display areas are equally divided in the vertical direction when the camera is held vertically. FIG. 11 shows an example in which four display areas are equally divided into four parts in a grid pattern when the apparatus is held vertically. FIG. 12 shows an example in which a large display area is provided at the center and two small display areas are provided at the top and bottom, and five display areas are provided. FIG. 13 shows an example in which a tablet or the like is horizontally held, and a large display area is provided at the center, two small display areas are provided on the left and right sides, and five display areas are provided.

  Returning to FIG. 6, the arrangement pattern includes a pattern in which the size of all display areas or a part of the display area is scaled. In this case, the size of the display area can be changed by a user operation. The operation of changing the size of the display area depends on an operation interface (such as dragging an end of the display area) provided by an OS (Operating System) of the information processing apparatus 2. The changed size is reflected in the current data. Further, the positions of all the display areas or a part of the display areas may be movable by a user operation.

  Further, the display area may be made duplicatable (copied) or deleted. The duplicated display area inherits the characteristics of the original display area and is reflected in the current data. At the same time, this may be newly registered in the table area pattern table. The copy can be placed on an empty place in the screen or on a display area that already exists. The arrangement can also be designated so as to be displayed so as not to overlap with the already displayed and arranged display area. In this case, the position is adjusted between the original display area and the display area.

  The “reference” indicates a display area that serves as a reference when determining a cooperative relationship between display areas. The “direction of cooperative display” indicates the direction of cooperation of the display area that cooperates with the reference display area, and the same direction and the opposite direction can be selected for movement and enlargement / reduction. The “direction of linked display” may be selectable for each of the linked display areas.

  The display area pattern table may be substantially realized in a program by code implementation instead of the table format.

  FIG. 14 is a diagram illustrating an example of the area transition pattern table held in the area transition pattern storage unit 243. The contents of the area transition pattern table are stored when installing the application programs constituting the video acquisition unit 21, the area control unit 22, the input / output unit 23, and the like. And updated.

  The area transition pattern table has items such as “area transition pattern”, “number of areas”, “transition direction”, “master-slave transition of operation”, and “cooperation target”.

  “Area transition pattern” is information for identifying an area transition pattern. “Number of regions” is the number of display regions to which the region transition pattern is applied. The “transition direction” indicates the relationship between the display areas that the operation straddles. “Left ⇔ right” indicates an operation that straddles the display area adjacent to the left and right. “Upper ⇔ Lower” indicates an operation that straddles the vertically adjacent display areas. “Diagonally” indicates an operation that straddles the display area adjacent to the left and right of the display area adjacent vertically.

  The "operation master-slave transition" is treated as an operation of the display area to which the origin of the touch operation is changed by changing the relationship between the reference and the cooperation when the operation specified by the "transition direction" is performed. Information. The “cooperation target” indicates the content of the cooperation, in which the movement (moving direction and moving amount) and the scaling (the scaling amount) are set.

  The area transition pattern table may be substantially realized in a program by code implementation instead of the table format.

  FIG. 15 is a diagram showing an example of current data held in the current data storage unit 244. The video ID of the video selected by the user and the display selected by the user from the display area pattern table (FIG. 6). The area pattern data and the area transition pattern data corresponding to the display area pattern in the area transition pattern (FIG. 14) are stored.

<Operation>
FIG. 16 is a diagram illustrating an example of photographing by the photographing apparatus 1. The user holds the photographing apparatus 1 by hand and performs photographing by pressing the switch 1H3 (FIG. 2). The photographing apparatus 1 can photograph in all directions of the photographing apparatus 1 by the front photographing element 1H1 (FIG. 2) and the rear photographing element 1H2 (FIG. 2).

  FIG. 17 is a diagram illustrating an example of an image captured by the image capturing device 1. FIG. 17A shows an image captured by the front image capturing element 1H1 of the image capturing apparatus 1, and FIG. 17B shows an image captured by the rear image capturing element 1H2. In FIG. 17B, the top and bottom of the image are reversed, but this simplifies the optical system and reflects the light rays incident from the lenses arranged in front and back of the housing up and down on the front and back of one mirror. However, this is because the front imaging element 1H1 and the rear imaging element 1H2 are arranged on the optical axis of the reflected light. Then, the images of FIGS. 17A and 17B are combined to form a spherical image by the Mercator projection (Equidistant cylindrical projection) of FIG. 17C.

  FIG. 18 is a diagram illustrating an example of generation of a spherical image by the spherical image generation unit 13 (FIG. 5) of the photographing apparatus 1. In FIG. 18, the upper part shows the correspondence between the horizontal angle θ and the vertical angle φ with respect to the pixel position of the image obtained from the front imaging element 1H1 and the rear imaging element 1H2. On the left and right of the upper row, the sign of the angle φ is reversed, corresponding to the upside down of one image.

  For each pixel included in the upper image, the image is converted into the image shown in the middle based on a look-up table that converts the angle θ and the angle φ into orthogonal coordinates. Next, the two images in the middle are combined to form an image in which the lower angle θ is 0 ° to 360 °. Then, this is decomposed into triangular polygons, and is made 3D data in association with the angles θ and φ. This is a spherical image.

  FIG. 19 is a diagram showing an example of clipping a display video. FIG. 19A shows the relationship among the X axis, the Y axis, and the Z axis. The three-dimensional sphere CS is a spherical surface on which a spherical image is virtually attached. FIG. 19B shows an example of an arrangement of virtual cameras CAM for cutting out a display image. The virtual camera CAM is arranged inside the three-dimensional sphere CS, and a predetermined area T captured by the virtual camera CAM is a display image. FIG. 19C shows the field of view of the virtual camera CAM, and the angle between both ends of the diagonal line of the predetermined area T is the viewing angle α.

  FIG. 20 shows the relationship between the position of the virtual camera CAM and the origin of the three-dimensional sphere CS. When the three-dimensional sphere CS is viewed from a position retracted by a distance d from the origin, the viewing angle α is obtained. When the position of the distance d is inside the three-dimensional sphere CS, the position that intersects the three-dimensional sphere CS at the angle of view ω from the origin and the position that intersects the three-dimensional sphere CS at the viewing angle α are the same, and the position of the distance d is When it is outside the three-dimensional sphere CS, the viewing angle α circumscribes the three-dimensional sphere CS. When the distance d is 0, the angle of view ω from the origin and the viewing angle α match. By controlling the angle of view ω, the angle of view α, and the distance d in accordance with the magnification of the enlargement / reduction, the contour of the displayed image becomes circular as the image is reduced.

  FIG. 21 is a flowchart showing a processing example of the above embodiment, and shows processing in the information processing device 2.

  In FIG. 21, when the process is started, the video selection unit 221 of the information processing device 2 presents a list of videos stored in the video data storage unit 241 to the user and accepts the selection (Step S101). The video data storage unit 241 stores the video ID of the video selected by the user as current data in the current data storage unit 244.

  Next, the area setting unit 222 presents the area display pattern candidates to the user from the display area pattern table of the display area pattern storage unit 242, and accepts the selection (step S102). When the region display pattern is determined by the user (Yes in step S103), the video selection unit 221 stores the data of the region display pattern and the region transition pattern in the current data storage unit 244 as current data.

  Although the region display pattern is selected by the user, the region display pattern may be appropriately determined according to the characteristics and characteristics of the video to be displayed. For example, the region display pattern may be determined based on the result of analysis of the color tone of the video, the change over time, and the like, the added characteristic information, and the identification information such as the tag. In this case, an image with a small change is an area display pattern with a small number of display areas for easy viewing, and an image with a change in various directions is an area with a large number of display areas because it is necessary to check without omission. For example, a display pattern may be used.

  Next, the video allocating unit 223 allocates a display area based on the video range (initial value) of the determined display area pattern (Step S104), and displays the target video (Step S105). Note that the video allocating unit 223 determines whether the information processing apparatus 2 is vertically held or horizontally held from the signal of the state sensor 2H4 (FIG. 4), and displays the video by matching the top and bottom of the video to be displayed. .

  Thereafter, the operation determining unit 224 confirms the user's operation on the screen (step S106), and when it is determined that the operation has been performed (Yes in step S107), one of the starting points of the touch for the operation belongs from the coordinate information. The display area is specified (step S108), and other display areas are specified (step S109).

  Next, the operation determining unit 224 determines the operation of the specified one display area based on the number of touch points, a change in coordinate information, and the like (step S110). Specifically, it is determined whether it is a slide (swipe), a pinch out, or a pinch in. At this time, the operation amount is also acquired.

  If the operation determining unit 224 determines that the operation is a valid operation (Yes in step S111), the operation determining unit 224 determines, based on the determined operation and the acquired operation amount, a change (movement, enlargement / reduction) to be added to the image of one display area. It is determined (step S112). The operation determination unit 224 determines a change (movement, enlargement / reduction) to be applied to the other display areas from the direction of the cooperative display of the data of the display area pattern of the current data (step S113).

  At this time, if the sizes of all the display areas are equal, the amount of change (movement, enlargement / reduction) applied to the image of one display area is equal to the amount of change applied to the image of the other display area. . When the sizes are different, the amount of change is changed in accordance with the ratio of the representative length (diagonal length in the case of a rectangle, diameter in the case of a circle, etc.) of each display area. For example, if the ratio of the typical length of one display area to the typical length of the other display area is 1: 0.5, half of the amount of change in one display area is the other display area. The amount of change.

  Further, in determining a change to be applied to one display area and the other display areas (steps S112 and S113), if the operation spans two display areas, the operation on the display area that is first touched is continuously performed. Treat as That is, when the current data corresponds to the transition direction of the data of the area fiber pattern of the current data, the operation determination unit 224 determines the change by exchanging the reference or transition relationship between the two display areas based on the master-slave transition of the operation.

  Next, the video operation unit 225 applies the change of the operation to the one display area and the other display area based on the determined change to be applied to the video of the one display area and the change to be applied to the other display area, and performs the linked display. Is performed (step S114).

  Hereinafter, examples of operations and display changes will be described.

  FIG. 22 shows a case where the cooperation of the movement of the upper display area with respect to the lower display area is set in the opposite direction in the case where the display area is vertically divided into two equal parts vertically. In this case, when a rightward slide operation is performed on the lower display area as shown in (a), as shown in (b), the video in the lower display area moves rightward and The image in the display area moves leftward.

  FIG. 23 shows a case where the cooperation of the movement of the upper display area with respect to the lower display area is set to the opposite direction in the case where the display area is vertically divided into two equal parts vertically. In this case, when an upward sliding operation is performed on the lower display area as shown in (a), as shown in (b), the image of the lower display area moves upward and The image in the display area moves downward.

  FIG. 24 shows a case where the cooperation of the movement of the upper display area with respect to the lower display area is set in the opposite direction in the case where the display area is vertically divided into two equal parts vertically. In this case, when a slide operation in the upper right direction is performed on the lower display area as shown in (a), as shown in (b), the image in the lower display area is displayed in the upper right diagonal direction. As it moves, the image in the upper display area moves diagonally downward and to the left.

  FIG. 25 shows a case where the cooperation of the movement of the right display area is set in the opposite direction with respect to the left display area in the case where the display area is horizontally divided into two parts evenly. In this case, when a rightward slide operation is performed on the left display area as shown in (a), as shown in (b), the image in the left display area moves rightward and The image in the display area moves leftward.

  FIG. 26 illustrates a case where the cooperation of the movement of the right display area is set in the opposite direction with respect to the left display area in the case where the display is divided horizontally and equally divided into two. In this case, when an upward sliding operation is performed on the left display area as shown in (a), as shown in (b), the video in the left display area moves upward and The image in the display area moves downward.

  FIG. 27 shows a case where the cooperation of the movement of the right display area with respect to the left display area is set in the opposite direction in the case where the display area is divided horizontally and equally divided into two parts. In this case, when a slide operation in the upper right direction is performed on the left display area as shown in (a), the video in the left display area moves in the upper right direction as shown in (b). At the same time, the image in the right display area moves diagonally downward to the left.

  FIG. 28 shows a case where the cooperation of the movement of the upper display area with respect to the lower display area is set in the opposite direction in the case where the display area is vertically divided into two equal parts vertically. In this case, when the slide operation in the upper right diagonal direction is performed from the lower display area to the upper display area as shown in (a), as shown in (b), the image in the lower display area becomes , The image in the upper display area moves diagonally in the lower left direction.

  FIG. 29 shows a case where, when the display area is divided into a display area extending vertically and extending over the entire surface and a small display area at the upper right, the movement of the movement of the small display area is set in the same direction with respect to the large display area. Is shown. In this case, when a rightward slide operation is performed on a large display area as shown in (a), as shown in (b), an image in the large display area moves rightward and a small display area is moved. Also moves to the right.

  FIG. 30 shows a case in which the upper and lower display areas are cooperatively set in the same direction with respect to the lower display area in the case where the display area is equally divided vertically into two vertically. In this case, when the pinch-out operation is performed on the lower display area as shown in (a), the image in the lower display area is enlarged and the image in the upper display area is enlarged as shown in (b). Also expand.

  FIG. 31 shows that when the display area is vertically divided into two and the upper display area is set to be small and right-aligned, the cooperation of enlargement / reduction of the upper display area is set in the same direction with respect to the lower display area. Is shown. In this case, when the pinch-out operation is performed on the lower display area as shown in (a), the image in the lower display area is enlarged and the image in the upper display area is enlarged as shown in (b). Also expand.

<Summary>
As described above, according to the present embodiment, it is possible to provide a user interface capable of performing a flexible operation when displaying an image in a plurality of display areas.

  The present invention has been described with reference to the preferred embodiments of the present invention. Although the invention has been described with reference to specific embodiments, various modifications and changes may be made in these embodiments without departing from the broader spirit and scope of the invention as defined in the appended claims. Obviously you can do that. In other words, the present invention should not be interpreted as being limited by the details of the specific examples and the accompanying drawings.

<Correspondence of Terms in Embodiments and Terms in Claims>
The video obtaining unit 21 is an example of a “video obtaining unit”. The area setting unit 222 is an example of an “area setting unit”. The video allocating unit 223 is an example of a “video allocating unit”. The operation determining unit 224 is an example of an “operation determining unit”. The video operation unit 225 is an example of a “display control unit”. The area control unit 22 is an example of a “display unit”. The area control unit 22 is an example of “means for changing the area”.

REFERENCE SIGNS LIST 1 imaging device 11 first imaging unit 12 second imaging unit 13 omnidirectional image generation unit 2 information processing device 21 image acquisition unit 22 area control unit 221 image selection unit 222 area setting unit 223 image allocation unit 224 operation determination unit 225 image Operation unit 23 Input / output unit 24 Storage unit 241 Video data storage unit 242 Display area pattern storage unit 243 Area transition pattern storage unit 244 Current data storage unit 3 Web server 10 Video display system

JP 2011-76249 A

Claims (9)

A first predetermined area which is a part of the spherical image and is specified by at least a horizontal angle is displayed in a first area of the screen,
The omnidirectional a part of the image from said first predetermined region Ri Do different horizontal angle, the vertical angle to display the second predetermined region to be the same as in the second region of the screen ,
By the first operation that is an operation into the first area, the first predetermined area to be displayed in the first area and the second predetermined area to be displayed in the second area are coordinated. A first process for changing;
By a second operation which is a continuous operation from the first area to the second area, the first predetermined area to be displayed in the first area and the second predetermined area to be displayed in the second area. Causing the information processing apparatus to execute a second process of changing the area in cooperation with the area ,
The first region and the second region, the program characterized that you have been aligned in the vertical direction in the screen.   2. The program according to claim 1, wherein the first area and the second area are equal in size.   The program according to claim 1, wherein the omnidirectional video is a video captured by an imaging device including a first imaging unit and a second imaging unit.   The program according to claim 1, wherein the image displayed in the first area and the image displayed in the second area partially include a common area. A first predetermined area which is a part of the spherical image and is specified by at least a horizontal angle is displayed in a first area of the screen,
The omnidirectional a part of the image from said first predetermined region Ri Do different horizontal angle, the vertical angle to display the second predetermined region to be the same as in the second region of the screen ,
By the first operation that is an operation into the first area, the first predetermined area to be displayed in the first area and the second predetermined area to be displayed in the second area are coordinated. A first process for changing;
By a second operation which is a continuous operation from the first area to the second area, the first predetermined area to be displayed in the first area and the second predetermined area to be displayed in the second area. The information processing apparatus executes a second process of cooperatively changing the area and
The first region and the second region, wherein that you have been aligned in the vertical direction in the screen. A first predetermined area which is a part of the spherical image and is specified by at least a horizontal angle is displayed in a first area of the screen,
The omnidirectional a part of the image from said first predetermined region Ri Do different horizontal angle, the vertical angle to display the second predetermined region to be the same as in the second region of the screen ,
By the first operation that is an operation into the first area, the first predetermined area to be displayed in the first area and the second predetermined area to be displayed in the second area are coordinated. First control means for changing;
By a second operation which is a continuous operation from the first area to the second area, the first predetermined area to be displayed in the first area and the second predetermined area to be displayed in the second area. and second control means for changing in conjunction with the region, and were perforated,
The first region and the second region, the information processing apparatus characterized that you have been aligned in the vertical direction in the screen. A first predetermined area which is a part of the spherical image and is specified by at least a horizontal angle is displayed in a first area of the screen,
The omnidirectional a part of the image from said first predetermined region Ri Do different horizontal angle, the vertical angle to display the second predetermined region to be the same as in the second region of the screen ,
By the first operation that is an operation into the first area, the first predetermined area to be displayed in the first area and the second predetermined area to be displayed in the second area are coordinated. First control means for changing;
By a second operation which is a continuous operation from the first area to the second area, the first predetermined area to be displayed in the first area and the second predetermined area to be displayed in the second area. and second control means for changing in conjunction with the region, and were perforated,
The first region and the second region, the image display system characterized that you have been aligned in the vertical direction in the screen. The first operation includes an operation of enlarging or reducing, and when the operation of enlarging or reducing is performed, the first predetermined region displayed on the first region and the second predetermined region are displayed on the second region. The second predetermined area is cooperatively enlarged or reduced,
The second operation includes a moving operation, and when the moving operation is performed, the first predetermined region displayed in the first region and the second predetermined region displayed in the second region. The program according to any one of claims 1 to 4, wherein the program is moved in cooperation with a predetermined area. 9. The outline of at least one of the first predetermined area and the second predetermined area displayed as the image is reduced by the first operation becomes circular. program.