JP7316429B1 - Program and information processing system - Google Patents

Abstract

An object of the present invention is to prevent a copyrighted work of another person from being clearly reflected in a virtual space image. A program (151) executed by a computer comprises means for generating a virtual space (501), means for arranging a virtual camera (503), a user object (502) and a specific object in the virtual space (501), and Based on this, it functions as means for generating a virtual space image, which is an image of the virtual space 501 . In addition, the program 151 uses the computer as a means for generating a virtual space image, and when a predetermined condition is satisfied, the virtual space image includes a first-person viewpoint image of the user object 502 and at least part of the user object 502. When the image of the first person viewpoint is generated as the virtual space image by switching between the image of the third person viewpoint and the virtual space image includes the specific object, the specific object is displayed in a predetermined display mode. [Selection drawing] Fig. 17

Description

The present disclosure relates to programs and information processing systems.

A technique is known that moves a user object in a virtual space based on a user's operation input and generates a virtual space image based on a virtual camera that moves according to the movement of the user object. Non-Patent Document 1 discloses a game that generates such a virtual space image from a first-person viewpoint, which is the viewpoint of a user object. Non-Patent Document 2 discloses a game that generates a virtual space image from a third-person viewpoint including a user object.

“Explanation of the points you want to know for those who are starting “Apex Legends”. The road to becoming a champion is not too late!”, [online], [Searched on May 19, 2021], Internet < https://www.famitsu.com/news/202101/09212564.html> "Fortnite Chapter 2 - Season 6 Battle Pass Trailer", [online], [Searched May 19, 2021], Internet https://www.epicgames.com/fortnite/ja/battle-pass/zero-point

By the way, in the case where the virtual space image can be switched between the third-person viewpoint image and the first-person viewpoint image, if the virtual space image is switched from the third-person viewpoint image to the first-person viewpoint image, the entire virtual space image will be changed. Enlarged. When the entire virtual space image is enlarged in this way, another person's work may be clearly reflected in the virtual space image. A technology that can

An object of the present disclosure is to prevent another person's work from being clearly reflected in a virtual space image.

According to one embodiment shown in the present disclosure,
A program executed by a computer,
The program causes the computer to:
means for generating a virtual space;
means for arranging a virtual camera, a user object and a specific object in the virtual space;
functioning as means for generating a virtual space image, which is an image of the virtual space, based on the virtual camera;
As means for generating the virtual space image,
switching the virtual space image between a first-person view image of the user object and a third-person view image including at least a portion of the user object when a predetermined condition is satisfied;
displaying the specific object in a predetermined display mode when the specific object is included in the virtual space image when the first-person viewpoint image is generated as the virtual space image;
program is provided.

According to another embodiment shown in the present disclosure,
An information processing system comprising one or more information processing devices,
a process of generating a virtual space;
a process of arranging a virtual camera, a user object and a specific object in the virtual space;
performing a process of generating a virtual space image, which is an image of the virtual space, based on the virtual camera;
In the process of generating the virtual space image,
switching the virtual space image between a first-person view image of the user object and a third-person view image including at least a portion of the user object when a predetermined condition is satisfied;
displaying the specific object in a predetermined display mode when the specific object is included in the virtual space image when the first-person viewpoint image is generated as the virtual space image;
An information processing system is provided.

According to an embodiment shown in the present disclosure, it is possible to prevent another person's work from being clearly reflected in a virtual space image.

FIG. 1 is a diagram showing a configuration example of a system according to the first embodiment of the present disclosure. FIG. 2 is a block diagram showing a functional configuration of the user terminal shown in FIG. 1; FIG. 3 is a block diagram showing a functional configuration of the server shown in FIG. 1; FIG. 4 is a flowchart showing an example of processing related to provision of virtual space according to the first embodiment of the present disclosure. FIG. 5 is a schematic diagram showing an example of virtual space according to the first embodiment of the present disclosure. FIG. 6 is a schematic diagram showing an example of a display screen according to the first embodiment of the present disclosure. FIG. 7 is a flow chart showing an example of processing for changing to the third-person viewpoint in step S460 of FIG. FIG. 8 is a schematic diagram showing the positional relationship between a user object and a virtual camera according to the first embodiment of the present disclosure; FIG. 9 is a schematic diagram showing the positional relationship between a user object and a virtual camera according to the first embodiment of the present disclosure; FIG. 10 is a flow chart showing an example of processing for changing to the first-person viewpoint in step S490 of FIG. FIG. 11 is a schematic diagram showing an example of a display screen according to the first embodiment of the present disclosure. FIG. 12 is a flowchart illustrating an example of processing related to moving image reproduction according to the first embodiment of the present disclosure. FIG. 13 is a schematic diagram showing an example of a virtual space according to the first embodiment of the present disclosure; FIG. 14 is a schematic diagram showing an example of a display screen according to the first embodiment of the present disclosure. FIG. 15 is a schematic diagram showing an example of a display screen when a moving image is displayed in full screen according to the first embodiment of the present disclosure. FIG. 16 is a schematic diagram showing an example of a display screen according to a comparative example of the second embodiment of the present disclosure; FIG. 17 is a schematic diagram showing an example of a display screen according to the second embodiment of the present disclosure. FIG. 18 is a flow chart showing an example of a program operation flow according to the second embodiment of the present disclosure. FIG. 19 is a schematic diagram showing an example of a display screen according to the third embodiment of the present disclosure. FIG. 20 is a flow chart showing an example of a program operation flow according to the third embodiment of the present disclosure.

Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same reference numerals are given to the same parts. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated. In one or more of the embodiments presented in this disclosure, elements of each embodiment may be combined with each other and the combined result shall also form part of the embodiments presented in this disclosure.

[First embodiment]
(System configuration)
Hereinafter, as a first embodiment according to the present disclosure, a user object is moved in a virtual space based on a user's operation input, and a virtual space is generated based on a virtual camera that moves according to the movement of the user object. A system for providing images to users will be described as an example.

The virtual space may be common to multiple users, or may be different for each user. That is, a plurality of user objects may exist in one virtual space, or one user object may exist in one virtual space. Also, the virtual space may be generated using XR technology such as VR (Virtual Reality).

FIG. 1 is a diagram showing a configuration example of a system (information processing system) 1 according to the first embodiment of the present disclosure. As shown in FIG. 1, the system 1 includes user terminals 10A, 10B, and 10C used by a plurality of users, and a server 20. These devices are connected to each other via a network 30 so as to be able to communicate with each other.

The user terminals 10A and 10B are connected to the network 30 by communicating with the radio base station 31 . The user terminal 10C connects to the network 30 by communicating with a wireless router 32 installed in a facility such as a house. User terminals such as the user terminals 10A, 10B, and 10C are hereinafter collectively referred to as "user terminals 10".

The user terminal 10 is a computer (information processing device) used by a user. The user terminal 10 may be a portable information terminal, or a stationary information terminal such as a PC (Personal Computer) or a game machine. The user terminal 10 may or may not have a touch screen. Also, the user terminal 10 may be an HMD (Head-Mounted Device) including AR goggles and AR glasses, or a contact-type device that can be worn on the eye like a contact lens. In the following description, it is assumed that the user terminal 10 is a portable terminal with a touch screen, specifically a smart phone, a phablet, a tablet, or the like.

The user terminal 10 executes, for example, an application program installed via a platform that distributes applications or the like, or a program including preinstalled website browsing software. Note that the user terminal 10 may execute website browsing software, that is, a program acquired via a web browser, instead of executing an application program.

The user terminal 10 can generate a virtual space image by executing a program such as an application program and output the virtual space image to the display unit. In generating the virtual space image, the user terminal 10 can transmit and receive various data to and from the server 20 as necessary.

The server 20 appropriately transmits data necessary for generating a virtual space image to the user terminal 10 . The server 20 manages various data regarding users. The server 20 receives, for example, information about the user's operation input from the user terminal 10, and executes processing according to the received information.

The server 20 includes a communication IF (Interface) 22, an input/output IF 23, a memory 25, a storage 26, and a processor 29 as a hardware configuration, which are interconnected via a communication bus.

The communication IF 22 is compatible with various communication standards such as the LAN (Local Area Network) standard, and functions as an interface for transmitting and receiving data to and from an external communication device such as the user terminal 10 .

The input/output IF 23 functions as an interface for receiving input of information to the server 20 and outputting information to the outside of the server 20 . The input/output IF 23 includes an input receiving section that receives connection of information input devices such as a mouse and keyboard, and an output section that receives connection of information output devices such as a display for displaying images and the like.

The memory 25 is a storage device for storing data and the like used for processing in the server 20 . The memory 25 provides the processor 29 with a work area for temporary use when the processor 29 performs processing, for example. The memory 25 includes storage devices such as ROM (Read Only Memory) and RAM (Random Access Memory).

The storage 26 is a storage device for storing various programs and data for the processor 29 to read and execute. The storage 26 includes storage devices such as HDDs (Hard Disk Drives) and flash memories.

The processor 29 controls the operation of the server 20 by reading and executing programs stored in the storage 26 . The processor 29 includes, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), and the like.

(Configuration of user terminal)
FIG. 2 is a block diagram showing a functional configuration of the user terminal 10 shown in FIG. 1. As shown in FIG. As shown in FIG. 2, the user terminal 10 includes an antenna 110, a wireless communication IF 120, a touch screen 130, an input/output IF 140, a storage unit 150, an audio processing unit 160, a microphone 170, a speaker 180, and a control unit 190 .

The antenna 110 radiates the signal emitted by the user terminal 10 into space as radio waves. Antenna 110 also receives radio waves from space and provides a received signal to wireless communication IF 120 .

The wireless communication IF 120 performs modulation/demodulation processing and the like for transmitting and receiving signals via the antenna 110 and the like in order for the user terminal 10 to communicate with other communication devices. The wireless communication IF 120 is a communication module for wireless communication including a tuner, a high-frequency circuit, and the like.

Touch screen 130 receives input from a user and outputs information for the user to display 132 . The touch screen 130 includes a touch panel 131 for accepting user input operations, and a display 132 for displaying menu screens, virtual space images, and the like on the screen. The touch panel 131 can detect that a user's finger or the like approaches by using, for example, a capacitive touch panel. The display 132 is implemented by, for example, an LCD (Liquid Crystal Display), an organic EL (Electroluminescence), or other display device.

The input/output IF 140 receives input of information to the user terminal 10 and functions as an interface for outputting information to the outside of the user terminal 10 .

The storage unit 150 is configured by flash memory, RAM, or the like. The storage unit 150 can store various data that the user terminal 10 receives from the server 20 . The storage unit 150 stores a program 151 capable of providing a user with virtual space images, virtual space information 152 and user information 153 .

The virtual space information 152 includes, for example, information for generating virtual space. The virtual space information 152 also includes, for example, information for generating various virtual objects such as a virtual camera and user objects placed in the virtual space. The virtual space information 152 also includes, for example, layout information for arranging various virtual objects in the virtual space. The user information 153 includes, for example, a terminal ID (Identification) for identifying the user terminal 10, user ID information for identifying the user, and the like.

The audio processing unit 160 modulates and demodulates an audio signal. Audio processing section 160 modulates the signal supplied from microphone 170 and supplies the modulated signal to control section 190 . Also, the audio processing unit 160 provides an audio signal to the speaker 180 . The audio processing unit 160 is implemented by, for example, a processor for audio processing. Microphone 170 functions as an audio input unit for receiving input of an audio signal and outputting it to control unit 190 . The speaker 180 functions as an audio output unit for outputting audio signals to the outside of the user terminal 10 .

The control unit 190 controls the operation of the user terminal 10 by reading and executing programs stored in the storage unit 150 . The control unit 190 is realized by a processor such as an application processor, for example.

By reading and executing the program 151, the control unit 190 controls an input operation reception unit 191, a transmission/reception unit 192, a space generation unit 193, an arrangement unit 194, a movement control unit 195, an image generation unit 196, Each function of the reproduction unit 197 is exhibited. In one aspect, the control unit 190 generates a virtual space image while transmitting and receiving various information to and from the server 20 .

Input operation reception unit 191 receives a user's input operation based on the output of touch screen 130 . Specifically, the input operation receiving unit 191 detects that a user's finger or the like approaches the touch panel 131 as coordinates of a coordinate system including a horizontal axis and a vertical axis of the surface forming the touch screen 130 .

Input operation reception unit 191 determines a user's operation on touch screen 130 . Specifically, the input operation receiving unit 191 performs so-called “approach operation”, “release operation”, “tap operation”, “double-tap operation”, “long press operation (long touch operation)”, “drag operation (swipe operation)”. operation)”, “move operation”, and “flick operation”. The user's operation determined by the input operation receiving unit 191 is not limited to the above. For example, if the touch panel 131 has a mechanism that can detect the amount of pressure applied by the user to the touch panel 131, the input operation receiving unit 191 determines the amount of pressure applied by the user.

The transmitter/receiver 192 receives various types of information from the server 20 and transmits various types of information to the server 20 . The transmitter/receiver 192 receives at least part of the virtual space information 252 from the server 20, for example. As an example, the transmission/reception unit 192 receives from the server 20 other-user object information about other-user objects operated by other users. The transmitting/receiving unit 192 transmits, for example, information regarding movement of the user object and other actions to the server 20 .

The space generator 193 refers to the virtual space information 152 and generates a virtual space. Also, the space generation unit 193 generates virtual objects such as a virtual camera and a user object to be placed in the virtual space. The virtual objects generated by the space generation unit 193 may include other user objects operated by other users and screen objects as moving image reproduction areas for displaying moving images.

The placement unit 194 refers to the placement information included in the virtual space information 152 and places various virtual objects such as a virtual camera and a user object in the virtual space. The placement unit 194 places the other user object in the virtual space based on the other user object information, for example. Also, when the placement unit 194 places the screen object in the virtual space, a trigger area for starting playback of the moving image on the screen object can be set in the virtual space. Also, the placement unit 194 moves other user objects and other virtual objects based on information and the like transmitted from the server 20 .

The movement control unit 195 moves the user object within the virtual space based on a movement operation for moving the user object (hereinafter also simply referred to as “movement operation”). The movement control unit 195 interprets the contents of the user's instruction based on, for example, the coordinates of the input position of the input operation received by the input operation receiving unit 191 and the type of operation, and moves the user object based on the interpretation.

Based on the virtual camera, the image generation unit 196 generates a virtual space image, which is an image of the inside of the virtual space captured by the virtual camera. The virtual space image generated by the image generator 196 is output to the touch screen 130 and displayed on the display 132 .

When no move operation is performed, the position of the virtual camera is controlled so that the virtual space image becomes the first-person viewpoint image of the user object. Therefore, when no movement operation is performed, the virtual space image generated by the image generation unit 196 is the first-person viewpoint image of the user object. Here, the “first-person viewpoint” is a viewpoint for the user to be in the position of the user object, and is, for example, a viewpoint from the position of the viewpoint of the user object or the vicinity of the position. The first-person viewpoint image may include, for example, a part of the user object's body excluding the head (for example, arms and legs), belongings of the user object, and the like.

On the other hand, when a movement operation is performed, the position of the virtual camera is controlled so that the virtual space image is a third-person viewpoint image including at least part of the user object. Therefore, when the movement operation is performed, the virtual space image generated by the image generation unit 196 is the third-person viewpoint image of the user object. Here, the “third-person viewpoint” is a viewpoint that is distant from the user object. The third-person viewpoint is preferably a viewpoint that includes at least the head of the user object in the field of view. When the user object is riding in another virtual object such as a car, the third-person viewpoint image may not include the head of the user object.

The image generator 196 preferably generates the virtual space image with at least part of the user object hidden when no move operation is performed. That is, when no movement operation is performed, it is preferable to generate a virtual space image after performing transparency processing to make part or all of the user object transparent or translucent. If part of the user object is made transparent or translucent, the remaining part may be opaque. Also, the degree of transparency may differ depending on the part of the user object. Note that the user object may be opaque without transparency processing.

As described above, the virtual space image generated by the image generation unit 196 is changed from the first-person viewpoint image to the third-person viewpoint image when the movement operation is started, and is changed to the third-person viewpoint image when the movement operation ends. The image is changed to a first-person view image. It is preferable that the image generation unit 196 performs processing for reducing the sense of discomfort so that the user is less likely to feel discomfort when changing the viewpoint.

As a process for reducing the sense of discomfort, the image generation unit 196 performs, for example, when a movement operation for moving the user object in the direction in which the virtual camera is facing is started, the distance between the user object and the virtual camera is set to a predetermined first distance. Until the distance is reached, the user object is moved and the virtual space image is generated without moving the virtual camera, and after the distance between the user object and the virtual camera reaches the first distance, the user object is moved. A virtual space image may be generated by moving the virtual camera so as to be linked to the movement.

Here, "the direction in which the virtual camera faces" is, for example, the depth side direction toward the depth side of the virtual space with the virtual space image displayed on the display 132 as a reference. Also, the "first distance" is not particularly limited, but is preferably, for example, the distance between the position of the virtual camera in the case of the first-person viewpoint and the position of the virtual camera in the case of the third-person viewpoint.

Further, as a process for reducing discomfort, the image generation unit 196 performs, for example, when a movement operation of moving the user object in a direction opposite to the direction in which the virtual camera is facing is started, the user object and the virtual camera until the distance reaches a predetermined second distance, the user object is moved and the virtual camera is moved in the opposite direction at a faster moving speed than the moving speed of the user object to generate a virtual space image. After the distance between the user object and the virtual camera reaches the second distance, the user object is moved based on the movement operation, and the moving speed is set to be the same as the moving speed of the user object so as to be linked to the movement of the user object. A virtual space image may be generated by moving the virtual camera at the moving speed.

Here, "the direction opposite to the direction in which the virtual camera faces" is, for example, the near side direction toward the near side of the virtual space with reference to the virtual space image displayed on the display 132 . Also, the "second distance" is not particularly limited, but is preferably, for example, the distance between the position of the virtual camera in the case of the first-person viewpoint and the position of the virtual camera in the case of the third-person viewpoint. The second distance may be the same as or different from the first distance.

Note that when a movement operation for moving the user object in the horizontal direction is started, basically the same processing as in the case where the movement operation is in the front side direction may be performed. Specifically, the virtual camera follows the movement of the user object in the lateral direction while moving forward, and after the distance between the virtual camera and the user object reaches a predetermined second distance, based on the movement operation. and moving the virtual camera in the same direction as the user object and at the same moving speed as the user object so as to be interlocked with the movement of the user object to generate a virtual space image. may be processed.

In addition, as a process for reducing discomfort, the image generating unit 196 fades the user object from transparent to opaque until a predetermined time (for example, about 1 second) elapses from the start of movement of the user object. It may be processed to generate a virtual space image. That is, when changing from the first-person viewpoint to the third-person viewpoint, processing may be performed such that the user object gradually appears while decreasing the transparency from the transparent state. Note that the fade-in process may be a process of changing from transparent to translucent or from translucent to opaque.

Further, as processing for reducing discomfort, the image generation unit 196 fades out the user object from an opaque state to a transparent state until a predetermined time (for example, about 1 second) has elapsed after the end of movement of the user object. may be used to generate a virtual space image. That is, when changing from the third-person viewpoint to the first-person viewpoint, processing may be performed such that the user object gradually becomes invisible while continuously increasing the transparency from the opaque state. Note that the fade-out process may be a process of changing from opaque to translucent, or from translucent to transparent.

Further, as a process for reducing discomfort, the image generation unit 196 may execute a process of reducing the visibility of the virtual space image until a predetermined time has elapsed from the start of the movement operation. The processing for reducing the visibility is not particularly limited, but examples thereof include darkening processing and blur processing. The image generation unit 196 may perform the same processing as described above until a predetermined time has passed since the end of the movement operation.

The reproducing unit 197 reproduces the moving image in the moving image reproducing area, for example, when the user object is positioned in the trigger area arranged in the virtual space. Further, for example, when an operation to select a moving image reproduction area is performed, the reproducing unit 197 reproduces the moving image in full-screen display. It should be noted that the reproducing unit 197 may be configured so as to be able to reproduce a moving image according to an input operation for reproducing the moving image, regardless of the trigger area.

(Server configuration)
FIG. 3 is a block diagram showing the functional configuration of the server 20 shown in FIG. 1. As shown in FIG. A detailed configuration of the server 20 will be described with reference to FIG. The server 20 functions as a communication section 220 , a storage section 250 and a control section 290 by operating according to the program 251 .

The communication unit 220 functions as an interface for the server 20 to communicate with an external communication device such as the user terminal 10 via the network 30 .

The storage unit 250 stores various programs and data for operating the server 20 . In one aspect, storage unit 250 stores program 251 , virtual space information 252 , and user information 253 .

The program 251 is a program for providing virtual space images to the user via the user terminal 10 . The program 251, for example, refers to the virtual space information 252, the user information 253, etc., and executes various processes on the server 20 side for providing the virtual space image to the user.

The virtual space information 252 includes, for example, information for generating a virtual space and information for generating various virtual objects arranged in the virtual space. At least part of the virtual space information 252 is information that is the source of the virtual space information 152 . The virtual space information 252 can include information on the position and behavior of each user object in the virtual space. In addition, the virtual space information 252 may include information regarding moving images.

The user information 253 is information about each user of each user terminal 10 . The user information 253 includes, for example, information identifying the user terminal 10 or the user of the user terminal 10, and other information.

The control unit 290 functions as a transmission/reception unit 291 , a server processing unit 292 , a data management unit 293 and a clock unit 294 by executing the program 251 stored in the storage unit 250 .

The transmission/reception unit 291 receives various information from the user terminal 10 and transmits various information to the user terminal 10 . For example, the user terminal 10 and the server 20 transmit and receive information regarding generation of virtual space and virtual objects, information regarding movement and other actions of user objects, information regarding reproduction of moving images, and the like.

The server processing unit 292 performs various processes necessary for the server 20 to provide the user with a virtual space via the user terminal 10 . The server processing unit 292 instructs the transmission/reception unit 291 to transmit various data in response to various requests from the user terminal 10 received by the transmission/reception unit 291 . The server processing unit 292 also instructs the data management unit 293 to update various data based on various calculation results by the server processing unit 292 .

The data management unit 293 adds, deletes, or updates various data stored in the storage unit 250 based on instructions from the server processing unit 292 . The clock unit 294 performs processing for measuring time. In addition, the timer unit 294 executes, for example, a process of synchronizing various types of time-related information in a plurality of user terminals 10 .

(Example of program operation)
Next, an operation example of the program according to the first embodiment of the present disclosure will be described with reference to FIGS. 4 to 15. FIG. Each process described below is realized by the control unit 190 executing the program 151 and the control unit 290 executing the program 251, respectively. It should be noted that the order of each process constituting each flowchart described in this specification may be random as long as there is no contradiction or inconsistency in the contents of the process, and the processes may be executed in parallel. Also, part of the processing that constitutes each flowchart described in this specification may be omitted.

FIG. 4 is a flowchart showing an example of processing related to provision of virtual space according to the first embodiment of the present disclosure. First, in step S410, the control unit 190 refers to the virtual space information 152 to generate a virtual space. Similarly, the control unit 190 generates virtual objects including a virtual camera and user objects. In generating the virtual space and the virtual object, the control unit 190 may receive various information such as the virtual space information 252 from the server 20 as necessary.

In step S420, the control unit 190 refers to the placement information included in the virtual space information 152 and places the virtual object in the virtual space. The initial position of the virtual camera is, for example, the viewpoint position of the user object.

In step S430, the control unit 190 performs processing to hide at least part of the user object. In step S430, for example, transparency processing is performed to increase the transparency of part or all of the user object to make it transparent.

In step S440, the control unit 190 generates a virtual space image from the first-person viewpoint. The control unit 190 displays a virtual space image on the display 132, for example. A virtual space image is an image based on a virtual camera, and is an image of the inside of the virtual space captured by the virtual camera. The orientation of the virtual camera can be changed based on the user's input operation for changing the orientation of the virtual camera. Also, the position of the virtual camera can be changed according to the movement of the user object.

If the control unit 190 does not detect a movement operation by the user ("No" in step S450), the first-person viewpoint is maintained, and the series of processes is terminated in response to receiving an input operation for ending the program 151. do.

On the other hand, if control unit 190 detects a movement operation by the user ("Yes" in step S450), control unit 190 performs processing to change to the third-person viewpoint in step S460. The processing of step S460 will be detailed in a later paragraph. Note that when the control unit 190 detects a movement operation by the user, information for specifying the position of the user object after movement can be transmitted to the server 20 as necessary.

In step S470, the control unit 190 moves the user object. Also, in step S470, the control unit 190 moves the virtual camera at the same moving speed as the user object so as to interlock with the movement of the user object. That is, in step S470, the user object and the virtual camera move while maintaining their relative positional relationship.

If the control unit 190 does not detect the end of the movement operation ("No" in step S480), the process returns to step S470 to continue the process of moving the user object and the virtual camera.

On the other hand, if the control unit 190 detects that the user has finished the movement operation ("Yes" in step S480), in step S490 the control unit 190 changes the viewpoint to the first-person viewpoint and ends the program 151. A series of processes is terminated in response to acceptance of the input operation of . The processing of step S490 will be detailed in a later paragraph.

The virtual space and the virtual space image generated in the series of processes shown in FIG. 4 will be described below with reference to FIGS. FIG. 5 is a schematic diagram showing an example of virtual space 501 according to the first embodiment of the present disclosure. 5A and 5B, a virtual space 501 is provided with a user object 502, a virtual camera 503, a pillar object 504, and link areas 505a to 505c.

A user object 502 is a user-operable object, for example, the user's avatar. A virtual camera 503 is a virtual object that captures an image of the virtual space 501 . A pillar object 504 is a virtual object fixedly arranged in the virtual space 501 . Link areas 505a to 505c are areas linked to other virtual spaces. The user can move the user object 502 to another virtual space by moving the user object 502 to the link areas 505a to 505c.

FIG. 5(a) shows a case where a virtual space image is generated from a first-person viewpoint. That is, (a) of FIG. 5 is an example in which no movement operation is performed. In (a) of FIG. 5 , the virtual camera 503 is at the viewpoint position of the user object 502 . Also, the user object 502 is shown with a dashed line, which indicates that the user object 502 is transparent.

FIG. 5(b) shows the case where the virtual space image is generated from the third-person viewpoint. That is, FIG. 5(b) is an example in which a movement operation is performed. In (b) of FIG. 5 , the virtual camera 503 is positioned away from the user object 502 . Also, the user object 502 is shown in solid lines, which means that the user object 502 is opaque.

FIG. 6 is a schematic diagram showing an example of a display screen according to the first embodiment of the present disclosure. Specifically, FIG. 6(a) shows a display screen when the virtual space 501 is in the state of FIG. 5(a). (b) of FIG. 6 shows the display screen when the virtual space 501 is in the state of (b) of FIG.

In (a) of FIG. 6, a virtual space image is displayed on the display 132 when the virtual space 501 is viewed from the first-person viewpoint. In (a) of FIG. 6, the user object 502 is transparent and therefore not displayed.

In addition, in (a) of FIG. 6, the operator 601 is indicated by a dashed line. The manipulator 601 is a virtual controller that is displayed to receive input of a movement operation for moving the user object 502 . For example, the user can move the user object 502 in the dragged direction by dragging the circular portion in the center of the manipulator 601 . The manipulator 601 is an example, and other shapes and input modes may be adopted. From the viewpoint of enhancing the visibility of the virtual space 501, it is preferable that the manipulator 601 be in a completely transparent state or in a highly transparent state although it can be visually recognized until the user's movement operation is accepted.

In the following description, "the direction in which the virtual camera faces" or "the far side direction" refers to the direction indicated by the arrow A in FIG. 6(a). Further, the movement operation in the “direction in which the virtual camera faces” or “inward direction” refers to a circular movement to an area located above (in the direction of the arrow A) the line segment l that divides the manipulator 601 into two parts vertically. means that the part is being dragged. In addition, "the direction opposite to the direction in which the virtual camera faces" or "the near side direction" refers to the direction indicated by arrow B in FIG. 6(a). In addition, the operation to move "in the direction opposite to the direction in which the virtual camera faces" or "toward the near side" means that the operator is positioned below (in the direction of arrow B) the line segment l that divides the manipulator 601 into two parts vertically. It means that the circular part is dragged to the area where the

In FIG. 6B, a virtual space image is displayed on the display 132 when the virtual space 501 is viewed from the third-person viewpoint. In (b) of FIG. 6, substantially the whole body of the user object 502 is displayed in an opaque state. In some aspects, user object 502 may be displayed in a translucent state or at least partially transparent.

In (b) of FIG. 6, the user object 502 is moving in the depth direction because the movement operation in the depth direction has been performed. In addition, the circular portion of the manipulator 601 is positioned in the depth direction in order to indicate that an operation to move it in the depth direction is being performed. Further, in accordance with the movement operation, the manipulator 601 is made less transparent than in the case of FIG. 6(a). During the movement operation, the manipulator 601 may be opaque, but from the viewpoint of enhancing the visibility of the virtual space 501, it is preferably translucent or transparent.

The processing for changing to the third-person viewpoint in step S460 of FIG. 4 will be described in detail below with reference to FIG. In step S<b>461 , the control unit 190 starts fade-in processing for the user object 502 . The fade-in process reduces the transparency of the user object 502 continuously or in stages. The fade-in process is completed within, for example, about one second after the moving operation is started. The fade-in process is preferably executed in parallel with, for example, a series of processes of steps S463 to S465 or steps S466 to S468, which will be described later, and started and ended at the same timing as the series of processes. Note that the fade-in process may be omitted, and the viewpoint may be instantaneously switched from the first-person viewpoint to the third-person viewpoint.

If the movement operation detected in step S450 of FIG. 4 is a movement operation in the depth direction ("Yes" in step S462), the process proceeds to step S463. In step S<b>463 , the control unit 190 moves the user object 502 without moving the virtual camera 503 . The direction in which the user object 502 moves is the far side direction specified by the movement operation.

If the distance between the user object 502 and the virtual camera 503 is less than the predetermined first distance ("No" in step S464), the process of step S463 continues.

Then, if the distance between the user object 502 and the virtual camera 503 is greater than or equal to the predetermined first distance ("Yes" in step S464), the control unit 190 moves the virtual camera 503 together with the user object 502 in step S465. . In step S<b>465 , for example, the virtual camera 503 is moved so as to interlock (follow) the movement of the user object 502 .

Here, the processing of steps S463 to S465 shown in FIG. 7 will be described in detail using FIG. FIG. 8 is a schematic diagram showing the positional relationship between user object 502 and virtual camera 503 according to the first embodiment of the present disclosure. Specifically, FIG. 8 shows changes in the positional relationship between the user object 502 and the virtual camera 503 when an operation to move in the depth direction is performed.

(a) of FIG. 8 shows the state immediately before the movement operation is performed. In (a) of FIG. 8, a user object 502 and a virtual camera 503 are present at a point P1. User object 502 is also shown in dashed lines because it is in a transparent state. As in FIG. 6, the direction of arrow A in FIG. 8(a) is the back side direction, and the direction of arrow B in FIG. 8(a) is the front side direction.

FIG. 8B shows a state after the process of step S463 and the distance d1 between the user object 502 and the virtual camera 503 is less than the first distance. In (b) of FIG. 8, the user object 502 is moving in the depth direction based on the movement operation. On the other hand, virtual camera 503 does not move and is still at point P1.

Note that the fade-in process has started, and the user object 502 is in a state with lower transparency than in the state of (a) in FIG. 8 . Therefore, in FIG. 8B, the user object 502 is indicated by a solid line.

(c) of FIG. 8 shows a state where the distance d2 between the user object 502 and the virtual camera 503 has reached the first distance. In (c) of FIG. 8, the user object 502 has reached the point P2. On the other hand, virtual camera 503 does not move and is still at point P1. It is preferable that the fade-in process is completed at this point.

(d) of FIG. 8 shows a state in which the distance d2 between the user object 502 and the virtual camera 503 has reached the first distance, and the processing of step S465 has been performed. In (d) of FIG. 8, the user object 502 is moving toward the far side of the point P2. Also, the virtual camera 503 is moving in the depth direction of the point P1. As long as the movement operation continues, the virtual camera 503 moves in conjunction with the movement of the user object 502 while maintaining the distance d2.

Note that the content described with reference to FIG. 8 may be applied when the movement operation is not in the back direction. That is, the processing of steps S463 to S465 may be executed regardless of the direction of the movement operation. In such a configuration, it is preferable to move the virtual camera 503 and not move the user object 502 in step S463 when the movement operation is not in the depth direction.

Returning to the description of FIG. If the movement operation detected in step S450 of FIG. 4 is not a movement operation in the depth direction ("No" in step S462), the process proceeds to step S466. If "No" is determined in step S462, it means that an operation to move in the front side direction is performed, and if an operation to move completely in the left-right direction (in the direction above the line segment l shown in FIG. 6) is performed. may include

In step S<b>466 , the control unit 190 moves both the user object 502 and the virtual camera 503 . In step S<b>466 , the moving speed of the virtual camera 503 is faster than the moving speed of the user object 502 . Also, the direction in which the user object 502 moves is the direction specified by the movement operation. The direction in which the virtual camera 503 moves is, for example, a direction obtained by synthesizing the direction specified by the movement operation with the downward direction (the direction orthogonal to the line segment l shown in FIG. 6).

If the distance between the user object 502 and the virtual camera 503 is less than the predetermined second distance ("No" in step S467), the process of step S466 is continued.

Then, if the distance between the user object 502 and the virtual camera 503 is equal to or greater than the predetermined second distance ("Yes" in step S467), the control unit 190 moves the user object 502 and the virtual camera 503 to the same distance in step S468. Move in the same movement direction at the movement speed. In step S<b>468 , for example, the virtual camera 503 is moved so as to interlock (follow) the movement of the user object 502 . With the process of step S465 or step S468, the process of changing to the third-person viewpoint ends, and the process proceeds to step S470 in FIG.

Here, the processing of steps S466 to S468 will be described in detail using FIG. FIG. 9 is a schematic diagram showing the positional relationship between user object 502 and virtual camera 503 according to the first embodiment of the present disclosure. Specifically, FIG. 9 shows changes in the positional relationship between the user object 502 and the virtual camera 503 when a movement operation is performed in a direction other than the depth direction.

(a) of FIG. 9 shows the state immediately before the movement operation is performed. In (a) of FIG. 9, the user object 502 and the virtual camera 503 exist at the point P3. As in FIG. 6, the direction of arrow A in FIG. 9A is the back side direction, and the direction of arrow B in FIG. 9A is the front side direction. Also, the fade-in process is omitted because the contents described with reference to FIG. 8 can be used.

FIG. 9B shows a state after the process of step S466 and the distance d4 between the user object 502 and the virtual camera 503 is less than the second distance. In (b) of FIG. 9, the user object 502 and the virtual camera 503 are moving forward based on the movement operation. In addition, in the example of FIG. 9, the direction of the movement operation is directly downward.

In the state of FIG. 9B, the moving speed of the virtual camera 503 is faster than the moving speed of the user object 502 . Therefore, the moving distance d4 of the virtual camera 503 is longer than the moving distance d3 of the user object 502. FIG.

(c) of FIG. 9 shows a state where the distance d8 between the user object 502 and the virtual camera 503 has reached the second distance. In (c) of FIG. 9, the virtual camera 503 has reached the point P4, and the user object 502 has not reached the point P4. That is, even at this stage, the moving distance d7 of the virtual camera 503 is longer than the moving distance d6 of the user object 502. FIG.

(d) of FIG. 9 shows a state in which the distance d8 between the user object 502 and the virtual camera 503 has reached the second distance, and step S468 has been processed. In (d) of FIG. 9, since the direction of the movement operation has been changed to the right, the user object 502 and the virtual camera 503 are moving to the right of the point P4.

In this way, even if the direction of the movement operation changes, as long as the movement operation continues, the virtual camera 503 moves at the same moving speed to interlock with the movement of the user object 502 while maintaining the distance d8. This also applies to step S465.

Note that the content described with reference to FIG. 9 may be applied when the movement operation is in the depth direction. That is, the processing of steps S466 to S468 may be executed regardless of the direction of the movement operation. In such a configuration, it is preferable to set the moving speed of the virtual camera 503 lower than the moving speed of the user object 502 in step S466 when the moving operation is in the depth direction.

The processing for changing to the first-person viewpoint in step S490 of FIG. 4 will be described in detail below with reference to FIG. In step S<b>491 , the control unit 190 ends the movement of the user object 502 . Also, in step S492, the control unit 190 starts fade-out processing of the user object 502. FIG.

The fade-out process increases the transparency of the user object 502 continuously or step by step. The fade-out process is completed within, for example, about one second after the movement operation is completed. The fade-out process is executed in parallel with, for example, the processes of steps S491, S493, and S494 described later, and is preferably started and ended at the same timing as at least part of these processes. Note that the fade-out process may be omitted, and the viewpoint may be instantaneously switched from the third-person viewpoint to the first-person viewpoint.

In step S493, the control unit 190 executes, for example, a darkening process or a blur process as the process of reducing the user's visibility. Note that processing similar to that of step S493 may be executed in the processing for changing to the third-person viewpoint in step S460.

In step S<b>494 , the control unit 190 moves the virtual camera 503 to the viewpoint position of the user object 502 . From the viewpoint of reducing the discomfort that the user feels, it is preferable that the virtual camera 503 is moved at the same moving speed as the user object 502 immediately before the moving operation ends.

Here, a case where another user's object operated by another user exists in the virtual space 501 will be described with reference to FIG. 11 . FIG. 11 is a schematic diagram showing an example of a display screen according to the first embodiment of the present disclosure. In the example of FIG. 11, the virtual space 501 is a space imitating a concert venue. FIG. 11 is, for example, a virtual space image when the audience seats are viewed from the direction of the stage of the concert venue.

A virtual space image displayed on the display 132 includes an arena area 1101 , an audience object 1102 , and other user objects 1103 and 1104 . An arena area 1101 is an area where a plurality of user objects can interact with each other. The audience seat object 1102 is a virtual object fixedly arranged in the virtual space 501 .

Other-user objects 1103 and 1104 operated by other users are displayed on the display 132 of the user who operates the user object 502 regardless of whether or not there is a move operation by another user. For example, the other user object 1103 is still and not moving, but is displayed on the display 132 . Note that the other user object 1103 is not displayed on the display of the user who operates the other user object 1103 .

Here, in FIG. 11, a virtual space image generated from a first-person viewpoint is displayed. That is, no movement operation is input to the manipulator 601 displayed on the display 132, and the user object 502 is in a transparent state. However, on the other user's display, the user object 502 becomes visible rather than transparent.

Other user object 1104 is a moving object. When the user of the other user object 1104 performs an operation to move or perform another action on the other user object 1104, information for specifying the position of the other user object 1104 after movement and other actions is It is sent to the user terminal 10 of the user of the user object 502 via the server 20 . Based on the information, the control unit 190 controls movement and behavior of the other user object 1104 in the virtual space 501 .

Processing related to moving image reproduction when a moving image reproduction area for reproducing moving images is provided in the virtual space 501 will be described below. FIG. 12 is a flowchart illustrating an example of processing related to moving image reproduction according to the first embodiment of the present disclosure.

First, in step S<b>1210 , control unit 190 arranges a video playback area (for example, screen object) in virtual space 501 . Further, in step S1220, control unit 190 sets a trigger area in virtual space 501. FIG. The trigger area is preferably set near the moving image playback area.

If the user object 502 does not enter the trigger area ("No" in step S1230), the series of processing ends in response to receiving an input operation for ending the program 151, or the like.

If user object 502 has entered the trigger area by performing a move operation (“Yes” in step S1230), control unit 190 starts playing a moving image in the moving image playing area in step S1240. The video playback format may be a streaming format in which video information is acquired from the server 20 each time, or a download format in which video information is downloaded to the storage unit 150 in advance. It is preferable that the moving image is played back with audio output.

It is preferable that the reproduction of the moving image in the moving image reproduction area in which the trigger area is set is not synchronized with that of other users. That is, when the user object 502 has not entered the trigger area, even if another user's other user object enters the trigger area, it is preferable not to start playing the movie in the movie playback area corresponding to the trigger area. . It should be noted that in this case, the moving image is reproduced on the display 132 of the other user.

Note that some moving images may be played back in synchronization with other users. Some moving images are not particularly limited, but are, for example, contents that are performed, broadcast, or distributed in real time (eg, sports games, etc.). With such a configuration, it is possible to enjoy moving images with a sense of unity with other users.

If a selection operation (for example, a tap operation or a double-tap operation) for selecting a video playback area has been performed ("Yes" in step S1250), in step S1260, control unit 190 causes playback in the selected video playback area. Display the video that was being played in full screen. The processing in step S1250 continues until a termination condition such as an operation to terminate the full-screen display is satisfied. If the end condition is satisfied, the process returns to playing in the moving picture playing area.

If the selection operation for selecting the moving image reproduction area is not performed (No in step S1250), the reproduction in the moving image reproduction area is continued. Also, in a state where user object 502 has not moved outside the trigger area ("No" in step S1270), playback in the moving image playback area is continued.

If user object 502 has moved outside the trigger area (“Yes” in step S1270), control unit 190 stops playing the video in the video playback region in step S1280. Also, in step S1290, control unit 190 stores the stop position where the reproduction of the moving image was stopped. When the user object 502 re-enters the trigger area, the stored stop position can be referred to and playback of the video can be resumed from where it left off.

Processing related to moving image reproduction will be described in detail below with reference to FIGS. 13 to 15 . FIG. 13 is a schematic diagram showing an example of virtual space 501 according to the first embodiment of the present disclosure. In the example of FIG. 13, a user object 502 and screen objects 1301a and 1301b are arranged in a virtual space 501, and trigger areas 1302a and 1302b are set.

The screen objects 1301a and 1301b are examples of moving image playback areas, and are virtual objects that imitate the shape of a screen, for example. The animations played on the screen objects 1301a and 1301b are different from each other.

A trigger area 1302a is an area corresponding to the screen object 1301a, and a trigger area 1302b is an area corresponding to the screen object 1301b. For example, when the user object 502 enters the trigger area 1302a, playback of the moving image is started in the screen object 1301a.

FIG. 14 is a schematic diagram showing an example of a display screen according to the first embodiment of the present disclosure. FIG. 14(a) is a diagram showing a state in which the user object 502 is moving within the trigger area 1302a. Based on the position of the user object 502 within the trigger area 1302a, the moving image is being reproduced on the screen object 1301a. In FIG. 14(a), since the movement operation is being performed, the virtual space image displayed on the display 132 is based on the third-person viewpoint.

(b) of FIG. 14 is a diagram showing a state in which the user object 502 is stopped within the trigger area 1302a. Based on the position of the user object 502 within the trigger area 1302a, the screen object 1301a continues playing the moving image. Further, in FIG. 14B, since no movement operation has been performed, the virtual space image displayed on the display 132 is changed to that based on the first-person viewpoint, and the user object 502 is hidden. ing.

In the state of (a) of FIG. 14, part of the screen object 1301a is hidden by the user object 502 and cannot be viewed. It becomes possible to visually recognize all of the screen objects 1301a.

FIG. 15 is a schematic diagram showing an example of a display screen when a moving image is displayed in full screen according to the first embodiment of the present disclosure. FIG. 15 shows an example in which a tap operation is performed on the screen object 1301a in the state shown in FIG. 14(b).

In the example of FIG. 15, on the display 132, the moving image reproduced by the screen object 1301a in the state of (b) of FIG. 14 is displayed in full screen. A pause button 1501 , a fast forward button 1502 , a rewind button 1503 and a seek bar 1504 are displayed at the bottom of the display 132 . These buttons are an example of a moving image operation UI (User Interface). These operation UIs preferably become transparent after a certain period of time. In the example of FIG. 15, the orientation of the display 132 is changed from vertical to horizontal for full-screen display, but full-screen display may be performed while maintaining the vertical orientation. In the state of FIG. 15, when the conditions for ending the full-screen display are satisfied, the state returns to, for example, the state shown in FIG. 14(b).

Note that the image generation unit 196 is not limited to the configuration in which the virtual space image is switched between the image of the first-person viewpoint and the image of the third-person viewpoint according to whether or not the user object 502 is moved. is satisfied, the switching may be performed.

For example, assume that the user object 502 is superimposed on another object in the virtual space image. In this case, the image generation unit 196 may determine that the predetermined condition is satisfied regardless of whether the user object 502 is moved or not, and switch the virtual space image from the third-person viewpoint image to the first-person viewpoint image.

Also, for example, assume that the user object 502 has moved to a specific area in the virtual space image. In this case, the image generation unit 196 may determine that the predetermined condition is satisfied regardless of whether the user object 502 is moved or not, and switch the virtual space image from the first-person viewpoint image to the third-person viewpoint image.

The contents of the first embodiment of the present disclosure are listed below.

(Item 1-1)
A program executed by a first computer comprising a processor and memory,
The program causes the processor to:
generating a virtual space;
placing a virtual camera and a user object in the virtual space;
generating a virtual space image, which is an image of the virtual space captured by the virtual camera, based on the virtual camera;
executing a step of moving the user object in the virtual space based on a movement operation for moving the user object;
In the step of generating the virtual space image,
when the movement operation is not performed, the position of the virtual camera is controlled so that the virtual space image becomes a first-person viewpoint image of the user object;
When the movement operation is performed, the position of the virtual camera is controlled so that the virtual space image is a third-person viewpoint image including at least part of the user object.
program.
As a result, motion sickness is less likely to occur, and a decrease in immersion in the virtual space and visibility in the virtual space can be suppressed. Specifically, when the user object is moved, the user object is displayed in the third-person viewpoint, so motion sickness is less likely to occur than in the case of the first-person viewpoint. Also, when the user object is not moving, the first-person viewpoint is used, so that the feeling of immersion in the virtual space is improved and the visibility in the virtual space is improved as compared with the case of the third-person viewpoint. In addition, the user's convenience is improved by automatically switching between the first-person viewpoint and the third-person viewpoint based on the presence or absence of a movement operation.

(Item 1-2)
In the step of generating the virtual space image, when the movement operation has not been performed, the virtual space image is generated with at least part of the user object hidden.
A program according to item 1-1.
Thereby, the user's visibility in the first-person viewpoint can be improved. In addition, by making the entire user object transparent, it is possible to prevent the inside of the user object from being displayed by the virtual camera, which is impossible in reality.

(Item 1-3)
When a movement operation for moving the user object in the direction toward which the virtual camera is directed is started, in the step of generating the virtual space image,
generating the virtual space image by moving the user object and without moving the virtual camera until the distance between the user object and the virtual camera reaches a predetermined first distance;
After the distance between the user object and the virtual camera reaches a predetermined first distance, the virtual space image is generated by moving the virtual camera in conjunction with the movement of the user object.
The program according to item 1-1 or item 1-2.
As a result, when changing from the first-person viewpoint to the third-person viewpoint, it is possible to prevent the user from feeling uncomfortable.

(Item 1-4)
In the step of generating the virtual space image when a movement operation for moving the user object in a direction opposite to the direction in which the virtual camera is directed is started,
Until the distance between the user object and the virtual camera reaches a predetermined second distance, the user object is moved and the virtual camera is moved in the opposite direction at a moving speed faster than the moving speed of the user object. moving to the side to generate the virtual space image,
After the distance between the user object and the virtual camera reaches a predetermined second distance, the user object is moved based on the movement operation, and the user object is moved in conjunction with the movement of the user object. generating the virtual space image by moving the virtual camera at the same moving speed as the moving speed of
The program according to any one of items 1-1 to 1-3.
As a result, when changing from the first-person viewpoint to the third-person viewpoint, it is possible to prevent the user from feeling uncomfortable.

(Item 1-5)
In the step of generating the virtual space image,
generating the virtual space image by fading the user object from transparent to opaque until a predetermined time elapses from the start of movement of the user object;
generating the virtual space image by fading out the user object from an opaque state to a transparent state until a predetermined time elapses after the end of movement of the user object;
The program according to any one of items 1-1 to 1-4.
As a result, it is possible to prevent the user from feeling uncomfortable before and after the viewpoint change.

(Item 1-6)
In the step of generating the virtual space image, a process of reducing the visibility of the virtual space image is performed until a predetermined time elapses from at least one of the start and end of the movement operation.
The program according to any one of items 1-1 to 1-5.
As a result, it is possible to prevent the user from feeling uncomfortable before and after the viewpoint change. In addition, motion sickness can be further suppressed.

(Item 1-7)
The placing step further includes placing a video playback area in the virtual space,
A trigger area is set in the virtual space for starting playback of a video in the video playback area,
The program further causes the processor to:
causing a step of playing back the video in the video playback area when the user object is positioned in the trigger area;
The program according to any one of items 1-1 to 1-6.
As a result, it is possible to automatically play the moving image when the user object is positioned within the trigger area, and automatically stop the moving image when the user object moves out of the trigger area. can be improved. In addition, it makes it easier to recognize that the moving image can be viewed in the virtual space and to easily determine whether or not the moving image is of interest. For example, in a case where a 360-degree space is developed, it is difficult to notice a moving image if there is no moving image reproduction area at the viewpoint in the traveling direction. Therefore, it is possible to make the viewer recognize that the video can be watched more effectively by automatically playing the video, especially when accompanied by sound. Also, the program of item 1-7 is premised on the first-person viewpoint when no movement operation is performed. Therefore, the visibility of moving images can be improved.

(Item 1-8)
When an operation to select the video playback area is performed, in the step of playing, the video is played back in full screen display;
A program according to items 1-7.
Thereby, the visibility of moving images can be further improved. In addition, it is possible to improve the operability when viewing moving images. Even if the operation UI is placed in the video playback area, it will be difficult to select the operation UI depending on the angle at which the virtual camera is facing and the distance from the video playback area. can solve these problems and improve operability when watching videos.

(Item 1-9)
The first computer is capable of communication connection with a second computer,
The program further causes the processor to:
executing a step of receiving from the second computer other-user object information about another-user object operated by another user different from the user of the first computer;
The arranging step further includes arranging the other user object in the virtual space based on the other user object information,
The program according to any one of items 1-1 to 1-8.
This makes it possible to interact with other users. In addition, since the program of item 1-9 assumes the first-person viewpoint when no movement operation is performed, it is possible to improve the sense of immersion when interacting with other users and the visibility of other user's objects. . In addition, the program of item 1-9 is based on the premise that when a movement operation is performed, the third-person viewpoint is used. It becomes easier to move the user object to a desired position.

(Item 1-10)
A computer-implemented method comprising a processor and memory, comprising:
The method comprises:
generating a virtual space;
placing a virtual camera and a user object in the virtual space;
generating a virtual space image, which is an image of the virtual space captured by the virtual camera, based on the virtual camera;
and moving the user object in the virtual space based on a movement operation for moving the user object,
In the step of generating the virtual space image,
when the movement operation is not performed, the position of the virtual camera is controlled so that the virtual space image becomes a first-person viewpoint image of the user object;
When the movement operation is performed, the position of the virtual camera is controlled so that the virtual space image is a third-person viewpoint image including at least part of the user object.
Method.
As a result, motion sickness is less likely to occur, and a decrease in immersion in the virtual space and visibility in the virtual space can be suppressed.

(Item 1-11)
An information processing device comprising a processor and a memory,
The processor
generate a virtual space,
arranging a virtual camera and a user object in the virtual space;
generating a virtual space image, which is an image of the virtual space captured by the virtual camera, based on the virtual camera;
moving the user object in the virtual space based on a movement operation for moving the user object;
Generating the virtual space image includes:
controlling the position of the virtual camera so that the virtual space image is a first-person viewpoint image of the user object when the movement operation is not performed;
When the movement operation is performed, the position of the virtual camera is controlled so that the virtual space image is a third-person viewpoint image including at least part of the user object.
Information processing equipment.
As a result, motion sickness is less likely to occur, and a decrease in immersion in the virtual space and visibility in the virtual space can be suppressed.

[Second embodiment]
(Description of Comparative Example)
FIG. 16 is a schematic diagram showing an example of a display screen according to a comparative example of the second embodiment of the present disclosure; Here, as in the first embodiment, the user terminal according to the comparative example converts the virtual space image between the first-person viewpoint image and the third-person viewpoint image according to whether or not the user object 502 is moved. Suppose that it is a switching configuration.

For example, assume that the user object 502 has moved in front of the signboard object 1302 . In this case, in the user terminal according to the comparative example, as shown in FIG. 16A, a third-person viewpoint image including at least part of the user object 502 is displayed on the display 132 as a virtual space image. At this time, the virtual camera 503 in the virtual space 501 is positioned at a position a predetermined distance behind the user object 502 from the viewpoint position of the user object 502 .

Assume that the user terminates the movement operation of the user object 502 while the display screen shown in FIG. 16A is displayed on the display 132 . In this case, in the user terminal according to the comparative example, as shown in FIG. 16B, the first-person viewpoint image of the user object 502 is displayed on the display 132 as a virtual space image. The position of the virtual camera 503 in the virtual space 501 at this time is the line-of-sight position of the user object 502 .

In this way, when the virtual space image is switched from the third-person viewpoint image to the first-person viewpoint image, the virtual camera 503 in the virtual space 501 moves in the line-of-sight direction of the virtual camera 503 . Therefore, the entire virtual space image is enlarged, and objects other than the user object 502, such as the signboard object 1302, appear clearly. However, when the other object is a copyrighted work of another person, it is possible to easily reproduce an image clearly showing the copyrighted work of another person.

On the other hand, the control unit 190 in the user terminal 10 according to the second embodiment solves the above problem with a configuration described later.

(Configuration of user terminal)
FIG. 17 is a schematic diagram showing an example of a display screen according to the second embodiment of the present disclosure. FIG. 17(a) shows a virtual space image generated when the user object 502 moves in front of the signboard object 1302, similar to FIG. 16(a). (b) of FIG. 17 shows a virtual space image generated when the user object 502 stops in front of the signboard object 1302 .

Referring to FIG. 17, similarly to control unit 190 according to the first embodiment, control unit 190 according to the second embodiment displays a virtual space image from the first-person viewpoint when a predetermined condition is satisfied. Toggles between the image of the 3D and the image of the 3rd person view.

Here, as an example, when the user object 502 is being moved, the image generation unit 196 in the control unit 190 generates a third-person viewpoint image as a virtual space image as shown in FIG. do. Further, when the user object 502 is not moved, the image generator 196 generates a first-person viewpoint image as a virtual space image as shown in FIG. 17(b).

When generating a first-person viewpoint image, the image generator 196 determines whether or not the image (hereinafter referred to as “image to be generated”) includes a specific object.

More specifically, for example, one or more specific objects are registered in advance in the virtual space information 152 shown in FIG. Specifically, static objects are registered as specific objects.

Static objects include posters, banners, banners, billboards, and objects for display that are represented by characters, patterns, characters, symbols, or a combination thereof. In other words, static objects basically do not move independently except when external stress is applied. It is placed on the road.

Specific objects also include static objects attached to dynamic objects. For example, static objects attached to floating objects, such as balloons, and robot-type or vehicle-type moving objects that are controlled to move on a cyclical or predetermined route are also subject to certain contained in the object. Specific objects also include, for example, static objects possessed or equipped by so-called NPCs (non-player characters). It is assumed that the signboard object 1302 shown in FIG. 17 is registered in the virtual space information 152 as a specific object.

Also, the user object 502 may include a player object operated by one player and another player object operated by another player or computer different from the one player. In this case, other player objects may be registered as specific objects.

For example, the image generation unit 196 performs image processing on the third-person viewpoint image immediately before switching to the first-person viewpoint image, and further refers to the virtual space information 152 to determine whether the third-person viewpoint image includes a specific object. or not. When the image generation unit 196 determines that the specific object is included in the third-person viewpoint image, the image generation unit 196 determines that the image to be generated also includes the specific object.

In addition, in a state in which the third-person viewpoint image is not generated, the image generation unit 196 refers to the location information included in the virtual space information 152 and the position information of the user object 502 to determine whether the specific object is included in the image to be generated. You may decide whether it is included or not.

Further, when determining that a specific object is included in the image to be generated, the image generation unit 196 causes the specific object to display a predetermined display mode in the image to be generated. process.

For example, the image generation unit 196 performs processing that reduces the visibility of a specific object. Specifically, mosaic processing, blurring processing, processing to change image quality, processing to change the number of pixels, processing to change color, processing to change brightness, or processing to change saturation are performed as predetermined processing. be done. When the image to be generated includes a plurality of specific objects, the image generator 196 performs predetermined processing on each specific object.

Note that the image generator 196 performs, as the predetermined process, a process of replacing at least part of the specific object with another predetermined object, or a process of replacing at least part of the specific object with another predetermined object. may be superimposed and displayed. Other predetermined objects are, for example, stamp images and mask images.

In FIG. 17B, as an example, a first-person viewpoint image obtained by subjecting the signboard object 1302 to mosaic processing is displayed on the display 132 as a virtual space image.

Assume that a movement operation of the user object 502 is started in a situation where the first-person viewpoint image shown in FIG. 17B is displayed. In this case, the image generator 196 returns the signboard object 1302 to the normal display mode to generate a third-person viewpoint image, as shown in FIG. 17(a).

(Example of program operation)
Next, the operation flow of the program according to the second embodiment will be described. FIG. 18 is a flow chart showing an example of a program operation flow according to the second embodiment of the present disclosure. As shown in FIG. 18, first, the control unit 190 refers to the virtual space information 152 to generate a virtual space 501, a virtual camera 503, and a virtual object (step S510).

Next, the control unit 190 refers to the placement information included in the virtual space information 152 and places the virtual object and the virtual camera 503 in the virtual space 501 (step S520). The initial position of the virtual camera 503 is, for example, a position a predetermined distance behind the user object 502 from the viewpoint position of the user object 502 .

Next, when user object 502 is being moved ("YES" in step S530), control unit 190 generates a virtual space image from a third-person viewpoint, and displays the generated virtual space image on display 132. (step S540).

On the other hand, if an operation to move user object 502 has not been performed ("NO" in step S530), control unit 190 determines whether or not a specific object is included in the image to be generated, which is the first-person viewpoint image. (Step S550).

Then, when the control unit 190 determines that the image to be generated includes a specific object (“YES” in step S550), the control unit 190 displays the first-person viewpoint image obtained by performing predetermined processing on the specific object in the virtual space. Generate as an image. Then, control unit 190 displays the generated virtual space image on display 132 (step S560).

On the other hand, when control unit 190 determines that the image to be generated does not include a specific object (“NO” in step S550), it generates a normal first-person viewpoint image without predetermined processing as a virtual space image. . Then, control unit 190 displays the generated virtual space image on display 132 (step S570).

Note that the control unit 190 is not limited to the configuration in which predetermined processing is performed when generating a first-person viewpoint image, and after generating a first-person viewpoint image that has not been subjected to predetermined processing, the control unit 190 may generate a specific object included in the image. Predetermined processing may be performed on this.

The contents of the second embodiment of the present disclosure are listed below.
(Item 2-1)
A program executed by a computer,
The program causes the computer to:
means for generating a virtual space;
means for arranging a virtual camera, a user object and a specific object in the virtual space;
functioning as means for generating a virtual space image, which is an image of the virtual space, based on the virtual camera;
As means for generating the virtual space image,
switching the virtual space image between a first-person view image of the user object and a third-person view image including at least a portion of the user object when a predetermined condition is satisfied;
displaying the specific object in a predetermined display mode when the specific object is included in the virtual space image when the first-person viewpoint image is generated as the virtual space image;
program.
With such a configuration, even if the virtual space image contains a specific object that is a copyrighted work of another person, the virtual space image is generated in a display mode that avoids the clear image of the copyrighted work. can be done. As a result, it is possible to prevent another person's work from being clearly reflected in the virtual space image.

(Item 2-2)
A program according to item 2-1, wherein the specific object is a static object.
With such a configuration, it is possible to prevent a static object, which is highly likely to be someone else's copyrighted work, from appearing clearly in the virtual space image.

(Item 2-3)
The user object includes a player object operated by one player and another player object operated by another player different from the one player or the computer,
The program according to item 2-1 or 2-2, wherein the specific object is the other player object.
With such a configuration, it is possible to prevent another player object, which is highly likely to be someone else's copyrighted work, from being clearly reflected in the virtual space image.

The program according to any one of items 2-1 to 2-3, wherein the display in the predetermined display mode reduces the visibility of the specific object.
With such a configuration, even if a specific object that is a copyrighted work of another person is included in the virtual space image, the copyrighted work can be clearly reflected in the virtual space image without performing complicated processing. can be prevented.

An information processing system comprising one or more information processing devices,
a process of generating a virtual space;
a process of arranging a virtual camera, a user object and a specific object in the virtual space;
performing a process of generating a virtual space image, which is an image of the virtual space, based on the virtual camera;
In the process of generating the virtual space image,
switching the virtual space image between a first-person view image of the user object and a third-person view image including at least a portion of the user object when a predetermined condition is satisfied;
displaying the specific object in a predetermined display mode when the specific object is included in the virtual space image when the first-person viewpoint image is generated as the virtual space image;
Information processing system.
With such a configuration, even if the virtual space image contains a specific object that is a copyrighted work of another person, the virtual space image is generated in a display mode that avoids the clear image of the copyrighted work. can be done. As a result, it is possible to prevent another person's work from being clearly reflected in the virtual space image.

[Third embodiment]
In the second embodiment described above, when a first-person viewpoint image is generated as a virtual space image, a specific object included in the virtual space image is displayed in a predetermined display mode. In contrast, in the third embodiment, the specific object is displayed in a predetermined display mode according to the display size of the specific object in the virtual space image.

FIG. 19 is a schematic diagram showing an example of a display screen according to the third embodiment of the present disclosure. FIG. 19(a) shows a virtual space image generated when the user object 502 moves in front of the signboard object 1302, similar to FIG. 17(a). (b) of FIG. 19 shows a virtual space image generated when the user object 502 moves further in front of the signboard object 1302 .

2 and 19, image generator 196 according to the third embodiment generates a virtual space image in the same way as image generator 196 according to the second embodiment. It is determined whether or not the image to be generated, which is an image, contains a specific object.

Then, when determining that a specific object is included in the image to be generated, the image generator 196 determines whether the display size of the specific object in the image to be generated is larger than a predetermined size. An example of determining whether the display size is larger than a predetermined size will be described in detail below.

(a) Determination example 1 of whether or not the display size is larger than a predetermined size
For example, one or more specific objects are registered in the virtual space information 152 shown in FIG. 2, as in the second embodiment. A static object is registered as a specific object, as in the second embodiment. It is assumed that the signboard object 1302 shown in FIG. 19 is registered in the virtual space information 152 as a specific object. As in the second embodiment, another player object may be registered as a specific object.

Furthermore, size information of each specific object is registered in the virtual space information 152 . Specifically, for each specific object, the height and width of the specific object in the virtual space 501 are registered as size information.

The image generator 196 refers to the size information, for example, calculates the display magnification of a specific object in the image to be generated, and determines whether the calculated display magnification is equal to or greater than the second threshold. Then, when the calculated display magnification is equal to or greater than the second threshold, the image generator 196 determines that the display size of the specific object is larger than the predetermined size.

In this case, the image generating unit 196 performs predetermined processing on the specific object so that the specific object is displayed in a predetermined display mode in the image to be generated. That is, the image generation unit 196 performs processing that reduces the visibility of a specific object, specifically, mosaic processing, blurring processing, processing for changing image quality, processing for changing the number of pixels, and processing for changing color. , processing to change the brightness, or processing to change the saturation.

Assume that the display magnification of the signboard object 1302 in the virtual space image shown in FIG. 19A is smaller than the second threshold. In this case, the image generation unit 196 generates a normal virtual space image without performing predetermined processing on the signboard object 1302 .

On the other hand, as shown in FIG. 19B, it is assumed that the user object 502 and the virtual camera 503 move closer to the signboard object 1302 so that the display magnification of the signboard object 1302 becomes equal to or greater than the second threshold. In this case, the image generator 196 generates a virtual space image by performing predetermined processing on the signboard object 1302 .

Note that when generating a virtual space image including a specific object, the control unit 190 is not limited to generating a virtual space image that has undergone predetermined processing, and has generated a virtual space image that has not undergone predetermined processing. A specific object included in the virtual space image may be subjected to predetermined processing later.

(b) Determination example 2 of whether or not the display size is larger than the predetermined size
The image generation unit 196 determines whether the display size of the specific object is larger than a predetermined size by determining whether the occupation rate of the specific object in the image to be generated is equal to or greater than the first threshold. You may The first threshold is, for example, 30%.

More specifically, when the image generation unit 196 determines that a specific object is included in the virtual space image, for example, it generates a virtual space image that has not been subjected to predetermined processing. Then, the image generation unit 196 performs image analysis processing on the generated virtual space image, and calculates the occupancy rate of the specific object with respect to the virtual space image.

Then, when determining that the calculated occupancy rate is equal to or greater than the first threshold, the image generation unit 196 determines that the display size of the specific object is larger than the predetermined size. In this case, the image generator 196 performs predetermined processing on the specific object in the virtual space image. As a result, a virtual space image as shown in FIG. 19B is displayed on the display 132 .

Note that the image generation unit 196 may be configured to perform both determination example 1 and determination example 2, or may be configured to perform either one.

In Determination Example 1, the closer the distance to the user object 502 is to a specific object, the more likely it is that the display magnification will be greater than or equal to the second threshold, and that the display size will be greater than the predetermined size. On the other hand, in Determination Example 2, the larger the size of the specific object in the virtual space 501, the more likely it is that the occupancy rate of the virtual space image will be greater than or equal to the first threshold, and the greater the display size will be determined to be larger than the predetermined size.

In addition, since the distance between the user object 502 and the specific object is close, the display magnification of the specific object is equal to or higher than the second threshold, and the occupancy rate of the specific object in the virtual space image is equal to or higher than the first threshold. Sometimes there is. In such a case, it is determined that the display size of the specific object is larger than the predetermined size in determination example 1 or determination example 2. FIG.

(Example of program operation)
Next, the operation flow of the program according to the third embodiment will be described. FIG. 20 is a flow chart showing an example of a program operation flow according to the third embodiment of the present disclosure. The operations of steps S610 and S620 shown in FIG. 20 are the same as the operations of steps S510 and S520 shown in FIG. 18, so detailed description thereof will not be repeated here.

Next, the control unit 190 determines whether or not a specific object is included in the image to be generated, which is the virtual space image (step S630).

When control unit 190 determines that the image to be generated includes a specific object ("YES" in step S630), control unit 190 determines whether the display size of the specific object in the image to be generated is larger than a predetermined size. is determined (step S640).

If control unit 190 determines that the display size of the specific object in the image to be generated is larger than the predetermined size ("YES" in step S640), control unit 190 performs predetermined processing on the specific object. Generate a virtual space image. Then, the control unit 190 displays the generated virtual space image on the display 132 (step S650).

On the other hand, when control unit 190 determines that the image to be generated does not include a specific object ("NO" in step S630), it generates a normal virtual space image without performing the predetermined processing. Then, control unit 190 displays the generated virtual space image on display 132 (step S660).

Further, assume that control unit 190 determines that the image to be generated includes a specific object and that the display size of the specific object in the image to be generated is equal to or less than a predetermined size ("NO" in step S640). . In this case, similarly, control unit 190 generates a normal virtual space image without performing predetermined processing, and displays the generated virtual space image on display 132 (step S660).

As described above, the first to third embodiments according to the present disclosure have been described in detail. The control unit 290 may be in charge of the unit, and the control unit 190 may be in charge of at least part of the processing that the control unit 290 has been executing.

For example, the program may be a program that realizes a so-called cloud-type system in which the control unit 290 generates the virtual space 501, virtual objects, and virtual space images. Alternatively, a so-called stand-alone program may be used without the server 20 . Also, without providing the server 20 , it may be configured such that a plurality of user objects can exist in the same virtual space 501 by performing P2P communication between user terminals.

Also, two or more of the first to third embodiments of the present disclosure may be combined. For example, by combining the second embodiment and the third embodiment, the control unit 190 can be configured such that a specific object is included in the first-person viewpoint image and the display size of the specific object in the image is specified. A predetermined process may be performed on a specific object when it is larger than the size of .

The contents of the third embodiment of the present disclosure are listed below.
(Item 3-1)
A program executed by a computer,
The program causes the computer to:
means for generating a virtual space;
means for arranging a virtual camera, a user object and a specific object in the virtual space;
functioning as means for generating a virtual space image, which is an image of the virtual space, based on the virtual camera;
As means for generating the virtual space image,
displaying the specific object in a predetermined display mode when the display size of the specific object in the virtual space image is larger than a predetermined size;
program.
With such a configuration, even if a specific object that is another person's copyrighted work appears larger than a predetermined size in the virtual space image, the virtual space is displayed in such a manner as to avoid the image of the copyrighted work being clearly seen. Images can be generated. As a result, it is possible to prevent another person's work from being clearly reflected in the virtual space image.

(Item 3-2)
As means for generating the virtual space image,
When the occupancy rate of the specific object in the virtual space image is equal to or greater than a first threshold, the specific object is displayed in the predetermined display mode on the assumption that the display size of the specific object is larger than the predetermined size. The program according to item 3-1.
With such a configuration, for example, even if another person's large-sized copyrighted work exists in the virtual space, it is possible to generate a virtual space image in a display mode that avoids the clear appearance of the copyrighted work. can.

(Item 3-3)
As means for generating the virtual space image,
When the display magnification of the specific object in the virtual space image is equal to or greater than a second threshold, the specific object is displayed in the predetermined display mode on the assumption that the display size of the specific object is larger than the predetermined size. The program according to item 3-1 or item 3-2, which causes
With such a configuration, for example, when the user object approaches another person's copyrighted work, even if the copyrighted work appears larger than a predetermined size in the virtual space image, the copyrighted work can be seen clearly. A virtual space image can be generated in a display mode that avoids this.

(Item 3-4)
The program according to any one of items 3-1 to 3-3, wherein said specific object is a static object.
With such a configuration, it is possible to prevent a static object, which is highly likely to be someone else's copyrighted work, from appearing clearly in the virtual space image.

(Item 3-5)
The user object includes a player object operated by one player and another player object operated by another player different from the one player or the computer,
The program according to any one of items 3-1 to 3-4, wherein the specific object is the other player object.
With such a configuration, it is possible to prevent another player object, which is highly likely to be someone else's copyrighted work, from being clearly reflected in the virtual space image.

(Item 3-6)
The program according to any one of items 3-1 to 3-5, wherein the display in the predetermined display mode reduces the visibility of the specific object.
With such a configuration, even if a specific object that is a copyrighted work of another person is included in the virtual space image, the copyrighted work can be clearly reflected in the virtual space image without performing complicated processing. can be prevented.

An information processing system comprising one or more information processing devices,
a process of generating a virtual space;
a process of arranging a virtual camera, a user object and a specific object in the virtual space;
performing a process of generating a virtual space image, which is an image of the virtual space, based on the virtual camera;
In the process of generating the virtual space image,
displaying the specific object in a predetermined display mode when the display size of the specific object in the virtual space image is larger than a predetermined size;
Information processing system.
With such a configuration, even if a specific object that is another person's copyrighted work appears larger than a predetermined size in the virtual space image, the virtual space is displayed in such a manner as to avoid the image of the copyrighted work being clearly seen. Images can be generated. As a result, it is possible to prevent another person's work from being clearly reflected in the virtual space image.

1: System, 10: User Terminal, 20: Server, 30: Network, 130: Touch Screen, 150: Storage Unit (of User Terminal), 190: Control Unit (of User Terminal), 250: Storage Unit (of Server) , 290: control unit (of the server), 501: virtual space, 502: user object, 503: virtual camera

Claims (4)

A program executed by a computer,
The program causes the computer to:
means for generating a virtual space;
means for arranging a virtual camera, a user object and a specific object in the virtual space;
functioning as means for generating a virtual space image, which is an image of the virtual space, based on the virtual camera;
As means for generating the virtual space image,
switching the virtual space image between a first-person view image of the user object and a third-person view image including at least a portion of the user object when a predetermined condition is satisfied;
reducing the visibility of the specific object when the specific object is included in the virtual space image when the first-person viewpoint image is generated as the virtual space image;
program. 2. The program according to claim 1, wherein said specific object is a static object. The user object includes a player object operated by one player and another player object operated by another player different from the one player or the computer,
2. The program according to claim 1, wherein said specific object is said other player object. An information processing system comprising one or more information processing devices,
a process of generating a virtual space;
a process of arranging a virtual camera, a user object and a specific object in the virtual space;
performing a process of generating a virtual space image, which is an image of the virtual space, based on the virtual camera;
In the process of generating the virtual space image,
switching the virtual space image between a first-person view image of the user object and a third-person view image including at least a portion of the user object when a predetermined condition is satisfied;
reducing the visibility of the specific object when the specific object is included in the virtual space image when the first-person viewpoint image is generated as the virtual space image;
Information processing system.

Images