JP3880221B2 - GAME DEVICE AND GAME SYSTEM - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a game device and a game system.
[0002]
[Background Art and Problems to be Solved by the Invention]
When the image generation means and the image display means are operated by different clock generation sources, the operation timings of both may be different even when using clock generation sources that operate at the same frequency.
[0003]
In particular, when the image generation unit and the image display unit are connected via a network, the usage environments of the two are different, and thus there is often a slight deviation between the two during actual operation.
[0004]
In such a case, the timing of image generation and the timing of image display are gradually shifted, so it is necessary to adjust somewhere.
[0005]
For example, when an image generated by the host image display means via the network is displayed by the display means of the terminal, the operation clock between the image generation means and the image display means slightly deviates, and the image generation timing and image The display timing gradually shifts, and the timing difference between the two increases.
[0006]
Even when there are a plurality of terminals using the same image display means, the exact operation clock is often different for each image display means depending on the installation environment of each terminal, and as a result, the timing of image display is May vary on each terminal.
[0007]
In such a situation, in order to synchronize between the plurality of processing devices, the processing device on the data receiving side thins out or compensates the data in the buffer and synchronizes with other processing devices.
[0008]
Conventionally, when data is transmitted and at a critical point just before overflow or underflow occurs in the buffer on the receiving side, data is thinned out, that is, part of the data is deleted, data is compensated, that is, part of the data Replenishment was taking place.
[0009]
However, with this method, the continuity of the data in the buffer is impaired before and after thinning and compensation. For this reason, when these processes are performed on moving image data or continuous audio data, the viewer may feel uncomfortable, for example, the screen may appear to be tight or noise may be mixed.
[0010]
In particular, in a network-type game system, it is necessary to synchronize game devices. In such a case, if the game player knows the timing of synchronization adjustment, the game player can concentrate on the game. It will disappear.
[0012]
An object of the present invention is to provide a game device and a game in which continuous data such as game image data and game sound data is transmitted and played back in synchronization with the transmission side on the reception side, so that the timing of thinning and compensation is not easily recognized by the game player. To provide a system.
[0013]
[Means for Solving the Problems]
In order to solve these problems, the game system according to claim 1 is:
A game device that receives game player operation data and transmits distribution request data generated based on the operation data;
A game data distribution device that generates and compresses game data including at least one of game image data and game sound data based on distribution request data from the game device transmitted via a network, and distributes the game data to the game device;
A game system including:
The game data distribution device includes:
Means for receiving distribution request data from the game device;
Means for generating game data based on the received distribution request data;
Means for compressing the generated game data and transmitting it to the game device;
Including
The game device includes:
Means for generating the distribution request data based on operation data input by a game player, transmitting the data to the game data distribution device, and receiving the game data from the game data distribution device;
Means for decompressing and playing the received game data;
Means for monitoring changes in the amount of received game data in a compressed state;
Computing means for computing the received game data amount in a compressed state;
Adjusting means for thinning out or compensating the received game data based on the monitored result and the calculated result;
It is characterized by including.
[0014]
In the conventional method, thinning and compensation are performed at a stage when adjustment of game data is required, for example, at a critical point of the buffer. For this reason, the game player may know the timing of decimation or compensation, and may not be able to concentrate on the game due to changes in the game data.
[0015]
According to the present invention, it is possible to perform thinning and compensation in a state that does not stand out even if game data is adjusted based on the monitoring result and calculation result of the data amount. Thereby, the game player can concentrate and play a game.
[0016]
Here, thinning refers to processing data subsequent to the data instead of data to be processed next, and compensation refers to processing the previously processed data again.
[0017]
Further, according to the present invention, the game device and the game data distribution device can be synchronized without being noticed by the game player.
[0018]
The invention according to claim 2 is the invention according to claim 1,
The adjusting means thins out or compensates for the game data when a change in the game data amount is larger than a predetermined value as a result of the monitoring.
[0019]
According to the present invention, when the change in the amount of game data is larger than a predetermined value, the game data can be adjusted without being noticed by the game player by thinning out or compensating the game data.
[0020]
Here, when the change in the amount of game data is larger than a predetermined value, for example, when the luminance change is intense such as a flash scene, a moving image is a still image, a still image is a moving image, an entire image is a partial up image, etc. In the case of switching images, the case of switching sound such as noise sound is applicable.
[0021]
Further, the invention according to claim 3 is any one of claims 1 and 2,
The adjusting means thins out or compensates the game data when there is almost no change in the game data amount as a result of the monitoring.
[0022]
According to the present invention, the game data can be adjusted without being noticed by the game player by thinning or supplementing the game data when there is almost no change in the game data amount.
[0023]
Here, as a case where there is almost no change in the amount of game data, for example, a state where still images are continuous, a silent state, and the like are applicable.
[0024]
Moreover, invention of Claim 4 is set in any one of Claims 1-3,
Storage means having a predetermined storage area for storing the received game data;
The calculating means calculates a ratio of the game data amount occupying the storage area, and the adjusting means determines the stored game when a difference between the calculated ratio and a desired ratio is larger than a predetermined value. It is characterized by thinning out or compensating data.
[0025]
According to the present invention, when the difference between the calculated ratio and the desired ratio is larger than a predetermined value, the game data can be adjusted without being noticed by the game player by thinning out or supplementing the game data.
[0026]
In addition, here, when the difference between the calculated ratio and the desired ratio is larger than a predetermined value, the calculated ratio exceeds the desired ratio, and the calculated ratio is less than the desired ratio. Both are applicable.
[0027]
According to a fifth aspect of the present invention, there is provided the game device, wherein the game player inputs the distribution request data;
Means for transmitting the input distribution request data to a game data distribution apparatus via a network and receiving game data including at least one of game image data and game sound data;
Means for decompressing and playing the received game data;
Monitoring means for monitoring changes in the amount of received game data in a compressed state;
Computing means for computing the received game data amount in a compressed state;
Adjusting means for thinning out or compensating the received game data based on the monitored result and the calculated result;
It is characterized by including.
[0028]
According to the present invention, it is possible to perform thinning and compensation in a state that does not stand out even if game data is adjusted based on the monitoring result and calculation result of the data amount. Thereby, the game player can concentrate and play a game.
[0029]
Here, thinning refers to processing data subsequent to the data instead of data to be processed next, and compensation refers to processing the previously processed data again.
[0030]
Further, according to the present invention, the game device and the game data distribution device can be synchronized without being noticed by the game player.
[0031]
Further, the invention according to claim 6 is the invention according to claim 5,
The adjusting means thins out or compensates the received game data when the change in the game data amount is larger than a predetermined value or the game data amount hardly changes as a result of the monitoring. To do.
[0032]
According to the present invention, when the change in the amount of game data is greater than a predetermined value or when there is almost no change in the amount of game data, the game data is adjusted without being noticed by the game player by thinning or supplementing the game data. It can be performed.
[0033]
Here, when the change in the amount of game data is larger than a predetermined value, for example, when the luminance change is intense such as a flash scene, a moving image is a still image, a still image is a moving image, an entire image is a partial up image, etc. In the case of switching images, the case of switching sounds such as noise sounds is applicable.
[0034]
Moreover, as a case where there is almost no change in the amount of game data, for example, a state where still images are continuous, a silent state, and the like are applicable.
[0035]
Further, the invention according to claim 7 is the invention according to any one of claims 5 and 6,
Storage means having a predetermined storage area for storing the received game data;
The calculating means calculates a ratio of the game data amount occupying the storage area, and the adjusting means determines the stored game when a difference between the calculated ratio and a desired ratio is larger than a predetermined value. It is characterized by thinning out or compensating data.
[0036]
According to the present invention, when the difference between the calculated ratio and the desired ratio is larger than a predetermined value, the game data can be adjusted without being noticed by the game player by thinning out or supplementing the game data.
[0037]
In addition, here, when the difference between the calculated ratio and the desired ratio is larger than a predetermined value, the calculated ratio exceeds the desired ratio, and the calculated ratio is less than the desired ratio. Both are applicable.
[0038]
The invention according to claim 8 is the invention according to claim 7,
The storage means includes a frame buffer,
The monitoring means monitors a change in the amount of game data per frame in the frame buffer;
The adjustment means thins out or compensates the stored game data when the change in the amount of game data per frame is larger than a predetermined value or almost no change as a result of the monitoring. .
[0039]
According to the present invention, the change in the amount of data between each frame is monitored, and when the change is large or almost no change, the game data is thinned out or compensated so that the game data is not noticed by the game player. Can be adjusted.
[0040]
In particular, since image processing or the like is usually performed in units of frames, the changes can be clearly grasped by monitoring the changes in units of frames.
[0041]
The network system according to claim 9 includes a plurality of client devices that request acquisition of reproduction data;
A server device that generates and compresses reproduction data based on request data from the client device and is transmitted via the network, and distributes the data to the client device;
A network system including:
The server device
Means for receiving request data from the client device;
Means for identifying the client device based on the request data;
Means for generating reproduction data for each predetermined unit based on the request data;
Means for compressing the generated reproduction data and transmitting it to the identified client device;
Including
The client device is
Means for transmitting the request data to the server device and receiving the reproduction data;
Storage means for storing received reproduction data;
Means for monitoring changes in the amount of playback data stored for each of the predetermined units stored;
Means for calculating the amount of game data stored in the storage means at predetermined intervals;
An adjusting means for deleting or supplementing the stored reproduction data in the predetermined unit based on the monitoring result when a difference between the calculated data amount and a desired data amount is larger than a predetermined value;
Means for decompressing the reproduction data;
Playback means for playing back the expanded playback data;
Means for deleting reproduction data that has been reproduced from the storage means;
It is characterized by including.
[0042]
According to the present invention, when the difference between the calculated data amount and the desired data amount is larger than a predetermined value, the reproduction data is deleted or supplemented in the predetermined unit, thereby allowing the viewer of the reproduction data to be viewed. The reproduction data can be adjusted without being noticed.
[0043]
This makes it possible to synchronize a plurality of client devices without being noticed by an observer of the reproduction data.
[0044]
The invention of claim 10 is the invention of claim 9,
The adjusting means deletes the stored reproduction data in the predetermined unit when the change in the reproduction data amount is larger than a predetermined value or the reproduction data amount hardly changes as a result of the monitoring. Or it is characterized by replenishing.
[0045]
According to the present invention, the reproduction data can be thinned out or compensated when the change in the reproduction data amount is larger than the predetermined value or when there is almost no change in the reproduction data amount. The reproduction data can be adjusted without being noticed.
[0046]
Here, when the change in the amount of data for reproduction is larger than a predetermined value, for example, when the luminance change is intense such as a flash scene, a moving image is a still image, a still image is a moving image, and an entire image is a partial up image. In the case of switching the image to, for example, the case of switching the sound such as noise sound.
[0047]
Moreover, as a case where there is almost no change in the amount of data for reproduction, for example, a state where still images are continuous, a silent state, and the like are applicable.
[0048]
Further, the invention according to claim 11 is any one of claims 9 and 10,
The reproduction data includes at least one of moving image data and audio data, and the reproducing means includes at least one of means for displaying the moving image data and means for reproducing the audio data.
[0049]
In particular, if data is thinned out or compensated during reproduction of moving image data or audio data, an observer of the data is easily noticed and the observer is suspicious of what has happened.
[0050]
According to the present invention, it is possible to perform data adjustment in a state where it is difficult for an observer to notice even moving image data and audio data. Thereby, the observer can reproduce the reproduction data comfortably without feeling uncomfortable.
[0051]
An information recording medium according to claim 12 is a computer-readable information recording medium in which information for receiving and displaying the image data from a processing device on the transmission side is recorded in a network for transmitting and receiving compressed image data. Because
The information is
Information for receiving the image data;
Information for temporarily storing the received image data in the storage means;
Information for decompressing and displaying the image data stored in the storage means;
Information for erasing display data of the image data from the storage means;
Information for calculating the storage rate of the image data in the storage means;
Information for thinning out or supplementing part of the image data stored in the storage means when the accumulation rate is outside a predetermined range and the image data is still image data;
It is characterized by including.
[0052]
According to the present invention, the computer that has read the information can determine that the image data needs to be adjusted by determining that the storage rate of the image data is outside the predetermined range.
[0053]
Further, by thinning out or supplementing a part of the image data in the still image state, the image data can be adjusted without being noticed by a person viewing the image.
[0054]
Here, thinning refers to processing data subsequent to the data instead of data to be processed next, and compensation refers to processing the previously processed data again.
[0055]
Further, according to the present invention, it is possible to synchronize the processing device on the transmission side with the computer that reads the information.
[0056]
The invention according to claim 13 is a computer-readable information recording medium in which information for displaying compressed image data is recorded.
The information is
Information for sequentially writing the image data in a storage area;
Information for reading out, decompressing and displaying the image data in the storage area;
Information for supplementing image data for expansion and display using the written image data when the amount of image data occupying the capacity of the storage area is smaller than a desired value;
Information for deleting a part of continuous image data in the storage area for decompression and display when the amount of image data occupying the capacity of the storage area is larger than a desired value;
Information for performing the replenishment or the deletion when the change in the image data amount is larger than a predetermined value or when there is almost no change in the image data amount;
It is characterized by including.
[0057]
According to the present invention, the computer that has read the information needs to adjust the image data by determining that the accumulation rate obtained by comparing the image data amount with the desired value is outside the predetermined range. It turns out that it is.
[0058]
In addition, according to the present invention, by monitoring the change in the amount of image data, and replenishing or deleting the image data in an inconspicuous state, the image data can be adjusted without being noticed by the person viewing the image data. .
[0059]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below with reference to the drawings.
[0060]
(First embodiment)
First, a game data distribution device that functions as a server device and a plurality of game devices that function as client devices that display game images are connected via a network including a transmission path, and images are synchronized between the processing devices. An example in which the present invention is applied to a game system in which a game is played will be described.
[0061]
FIG. 1 is a diagram illustrating an example of a game system according to the present embodiment.
[0062]
This game system includes a communication line 300 in which a C site where the game data distribution device 100 exists, an A site where the game devices 200-1 and 200-2 exist, and a B site where the game devices 200-3 and 4 exist are transmission paths. Are connected to each other via a so-called ATM network.
[0063]
By transmitting game image data from the game data distribution device 100 to each game device 200, a network-type multiplayer game is played.
[0064]
In such a network-type multiplayer game system, it may be necessary for each game device 200 to simultaneously display a game image, match the game start timing, or change the screen resolution.
[0065]
In such a case, each game device 200 may need to adjust its own image display timing to synchronize with the image generation timing of the game data distribution device 100 or the image display timing of other game devices 200. is there.
[0066]
Since the operation clock of the game data distribution device 100 and the operation clock of the game device 200 are actually slightly different depending on the installation status of each device, a difference between the image generation timing and the image display timing is likely to occur and is corrected appropriately. There is a need.
[0067]
In such a case, if an image synchronization adjustment is simply performed on the game apparatus 200, the image displayed on the game apparatus 200 may be disturbed for a moment, which causes discomfort to those who are playing the game.
[0068]
In this embodiment, at the time of switching images, the timing of image display or the like is adjusted particularly in a flash scene or the like where the image changes rapidly.
[0069]
As a result, the timing of image display and the like can be adjusted so as not to be noticed by the person watching the game image, so that the image display timing is adjusted in accordance with the image display timing without causing discomfort to the person playing the game. Or change the screen resolution.
[0070]
Here, the adjustment specifically refers to adjustment such as resetting the phase of the image synchronization signal, decimation / compensation of images, and timing of image display or the like.
[0071]
Here, thinning refers to processing data subsequent to the data instead of data to be processed next, and compensation refers to processing the previously processed data again.
[0072]
Specifically, taking the case of image processing as an example, as the former, for example, after displaying the image of the second frame, the image of the fourth frame is displayed without displaying the image of the third frame. Applicable. In addition, the latter case corresponds to, for example, displaying the displayed second frame image again when the third frame image is not expanded in the situation where the third frame image should be displayed. To do.
[0073]
Here, the time of image switching is, for example, switching from the character face up to the entire character display, changing the display resolution, displaying images with intense brightness changes such as flash scenes, moving images to still images, still images, etc. To a state in which different types of images such as video to video are switched.
[0074]
FIG. 2 is a functional block diagram of a game system according to an example of the present embodiment.
[0075]
This game system generates distribution request data generated based on an operation of a game player, and transmits the generated distribution request data to a game apparatus 200, and a game apparatus transmitted via an ATM network including a communication line 300. And a game data distribution device 100 that generates and compresses game data based on the distribution request data from 200 and distributes the game data to the game device.
[0076]
The game data distribution device 100 includes a transmission / reception unit 116 that receives distribution request data from the game device 200, a generation unit 112 that generates game data based on the received distribution request data, and a compression unit that compresses the generated game data. 114, the transmission / reception unit 116 transmits the compressed game data to the game apparatus 200.
[0077]
Here, as game data, game image data, game sound data, etc. correspond, for example. That is, the generation unit 112 includes a game image data generation unit that generates game image data, and a game sound data generation unit that generates game sound data.
[0078]
Since the game sound data has a smaller data amount than the game image data, the game sound data can be transmitted without being compressed.
[0079]
On the other hand, the game apparatus 200 includes an operation data input unit 235 through which the game player inputs operation data, a distribution request data generation unit 234 that generates distribution request data based on the input operation data, and the generated distribution request data as a game. A transmission / reception unit 236 that transmits the data to the data distribution device 100 and receives the game data generated by the game data distribution device 100.
[0080]
In addition, the game apparatus 200 includes a frame buffer 246 that functions as a storage unit that stores received game data, a buffer control unit 248 that controls data transmission in the frame buffer 246, and a data synchronization unit that adjusts synchronization of game data. 238.
[0081]
The data synchronization unit 238 in the game apparatus 200 includes a data amount monitoring unit 242 that monitors changes in the amount of game data stored in the frame buffer 246, and a data amount calculation unit that calculates the proportion of the game data amount in the frame buffer 246. 241 and a data adjustment unit 239 that thins out or compensates the stored game data based on the monitoring result when the difference between the calculated ratio and the desired ratio is larger than a predetermined value.
[0082]
Further, the game device 200 includes an expansion unit 244 that expands the compressed game data, and an image display unit 220 and an audio reproduction unit 222 as reproduction means for reproducing the expanded game data.
[0083]
As described above, when the audio data is not compressed, the audio data can be directly sent from the frame buffer 246 to the audio reproduction unit 222 without using the decompression unit 244.
[0084]
As for the hardware configuration, for example, the operation data input unit 235 includes buttons and levers, the audio reproduction unit 222 includes speakers, the distribution request data generation unit 234, the data synchronization unit 238, and the buffer control unit 248 include CPUs and the like. Can be applied.
[0085]
As the generation unit 112 and the compression unit 114, for example, a game board having a clock generator, a VRAM, a compression chip, or the like that generates an image in response to a command from the CPU can be applied. For example, a communication device such as an ATM switch can be applied.
[0086]
Further, as the decompression unit 244 and the image display unit 220, for example, a video card and a display having a clock generator, a VRAM, a decompression chip, a DA converter, and the like that display an image in response to a command from the CPU can be applied.
[0087]
As the communication line 300, for example, an optical fiber can be applied. The communication line 300 may be a wired line such as an optical fiber or a wireless line such as a satellite communication path.
[0088]
FIG. 3 is a diagram showing a schematic flowchart of synchronization adjustment of game data by comparing data in the buffer.
[0089]
First, the operation of the game data distribution apparatus 100 will be described.
[0090]
The game data distribution device 100 that has received the distribution request data from the game device 200 by the transmission / reception unit generates game data by the generation unit 10 (step 22).
[0091]
The generated game data is compressed by the compression unit (step 24), and the game data in the compressed state is transmitted to the game device 200 via the communication line 300 by the transmission / reception unit of the game data distribution device 100 (step 26). ). Next, the operation of the game apparatus 200 will be described.
[0092]
The game data transmitted from the game data distribution device 100 is received by the transmission / reception unit 236 (step 28). The buffer control unit 248 transmits the received game data to the frame buffer 246 (step 30).
[0093]
A data amount monitoring unit 242 in the data synchronization unit 238 monitors a change in the amount of compressed game data per frame in the frame buffer 246. Specifically, the data amount calculation unit 241 calculates the proportion of the game data amount in the frame buffer 246.
[0094]
If the difference between the calculated ratio and the desired ratio is larger than a predetermined value, the synchronization between the generated data and the reproduction data is out of sync, so that it is necessary to adjust the synchronization of the game data (step 32). .
[0095]
In this case, based on the monitoring result, the data adjustment unit 239 thins out or compensates the game data stored in a state that is not conspicuous even if the synchronous adjustment is made (step 38) (step 40).
[0096]
Note that a series of processing (step 50) from determination of necessity of the synchronization adjustment to adjustment such as thinning will be described in detail later.
[0097]
When synchronization adjustment is not necessary (step 32), the compressed game data is expanded by the expansion unit 44 (step 34), and the game data is reproduced by the image display unit 220 and the audio reproduction unit 222 functioning as reproduction means (step 36). ).
[0098]
Next, a series of processing (step 50) from the determination of whether or not the synchronization adjustment is necessary to the adjustment such as thinning will be described in detail by taking game image data processing as an example.
[0099]
FIG. 4 is a conceptual diagram showing the relationship between the frame buffer 246 and the positions indicated by various pointers. FIG. 5 shows a series of processing (step 50) from determination of necessity of synchronization adjustment to adjustment such as thinning. It is a flowchart.
[0100]
As shown in FIG. 4, the frame buffer 246 includes six frame buffers 246-1 to 246-1 and has a predetermined storage area. Each frame buffer 246-1 to 6 stores the compressed game image data for one screen for each frame buffer 246-1 to 246-1.
[0101]
Note that the frame buffer 246 has a function as a so-called ring buffer that stores data from the frame buffer 246-1 again when the storage up to the frame buffer 246-6 is completed.
[0102]
Here, in order to expand and display the compressed game image data, a reception completion pointer indicating the position where the received game image data has been stored in the frame buffer 246 and a game image data to be displayed are stored. Assume that there is a display schedule pointer indicating the position of the frame buffer 246.
[0103]
Further, as the above-mentioned predetermined range, the difference between the address indicated by the reception completion pointer and the address indicated by the display schedule pointer is equivalent to one frame buffer. That is, in a state where the reception completion pointer is at P3, the display schedule pointer is within a predetermined range if it is at the positions P2 to P3. For convenience of explanation, it is assumed that the address of each pointer is updated in units of one frame buffer.
[0104]
Also, for convenience, the head addresses of the frame buffers 246-1 to 246 to 6 are P1 to P6, respectively, and the reception completion pointer is P3, that is, the head of the third frame buffer 246-3 and up to 246-3. Assume that the reception and storage of image data has been completed.
[0105]
Next, processing when such a frame buffer 246 is used will be described with reference to FIG.
[0106]
First, in determining whether the above-described adjustment is necessary (step 32), specifically, the reception completion pointer and the display schedule pointer are compared (step 60), and it is determined whether the difference between the two is within a predetermined range. (Step 62).
[0107]
Further, the determination of whether or not the above-described inconspicuous state is performed when it is not within the predetermined range (step 38) is specifically performed as follows.
[0108]
First, the data amount monitoring unit 241 in the data synchronization unit 238 monitors the change in the compressed game data amount per frame in the frame buffer 246. More specifically, the data amount calculation unit 242 stores the change in the frame buffer 246. The ratio of the amount of game data occupied is calculated.
[0109]
The data amount monitoring unit 241 compares the calculated ratio in the previously displayed image with the calculated ratio scheduled to be displayed (step 64).
[0110]
When this ratio changes drastically, it is inconspicuous even when performing synchronization adjustment when switching from video to still image, from still image to video, switching from whole image to some up image, or switching from flash scene etc. (Step 66).
[0111]
Also, if these ratios are very small and there is no change in these ratios, it is an image that has a high data compression rate and little change in the preceding and following images, that is, still images that are conspicuous even when synchronous adjustment is performed. It can be determined that there is no state (step 66).
[0112]
It is also possible to make a determination based on a change in the data amount itself instead of a change in the data amount ratio.
[0113]
When it is determined that the state is not conspicuous in this way, the data adjustment unit 239 determines whether the display schedule pointer is ahead of the reception completion pointer or whether the display schedule pointer is significantly behind the reception completion pointer. (Step 70).
[0114]
If the display schedule pointer is ahead of the reception completion pointer, the data adjustment unit 239 returns the display schedule pointer to the previously displayed point (step 74). That is, this process corresponds to an image compensation process.
[0115]
If the display schedule pointer is significantly behind the reception completion pointer, the display schedule pointer is advanced by one image (step 72). That is, this process corresponds to an image thinning process.
[0116]
In this way, by changing the next data to be displayed in the frame buffer 246 in an inconspicuous state, the data can be thinned out or compensated to adjust the synchronization.
[0117]
If not inconspicuous (step 66), it is determined whether reception and storage of the display-scheduled image has been completed (step 68). If not, the data adjustment unit 239 sets the display-scheduled pointer to the previous time. The display image is restored (step 74). That is, this process corresponds to an image compensation process. If completed, the game image data is expanded and displayed.
[0118]
If the address difference between the reception completion pointer and the display schedule pointer is within a predetermined range (step 62), the game image data is expanded and displayed, and the pointer is adjusted after waiting for the next inconspicuous state. I do.
[0119]
Although the game image data processing has been described above, in the same way as for the game sound data processing, it is possible to determine the inconspicuous state of noise sound or the like, and it is possible to perform thinning out or compensation of the game sound data in a conspicuous state.
[0120]
It is most preferable to adjust a playback schedule pointer such as a display schedule pointer when the game image data is a still image or when switching images and the game sound data is silent. By adjusting in this state, it is possible to adjust synchronization without being noticed by the player of the game not only in image display but also in audio reproduction.
[0121]
In the example described above, the case where the frame buffer 246 has six layers has been described. However, it is preferable that the number of multiplexed frame buffers 246 is larger. This is because if the number of buffers is large, it is possible to secure a time for waiting for an inconspicuous state.
[0122]
Even in the case of a single frame buffer that is not multiplexed, adjustment is possible by moving the pointer in units smaller than one frame buffer.
[0123]
By adopting the above processing means and processing method, the following effects can be obtained.
[0124]
In the conventional method, thinning and compensation are performed at a stage when adjustment of game data is required, for example, at a critical point of the buffer. For this reason, the game player may know the timing of decimation or compensation, and may not be able to concentrate on the game due to changes in the game data.
[0125]
According to the present embodiment, thinning and compensation can be performed in a state that does not stand out even if game data is adjusted based on the data amount monitoring result and the calculation result. Thereby, the game player can concentrate and play a game.
[0126]
Further, according to this, the game device and the game data distribution device can be synchronized without being noticed by the game player.
[0127]
In addition, since image processing is usually performed in units of frames, by monitoring changes in units of frames, changes can be clearly understood, and synchronization of game data can be adjusted at an appropriate timing. it can.
[0128]
In the present embodiment, the synchronization method for mainly synchronizing the data reproduction timing of the game apparatus 200 with the data generation timing of the game data distribution apparatus 100 has been described. However, the data generation timing of the game data distribution apparatus 100 and the game By synchronizing the data playback timing of the device 200, the data playback timing between the game devices 200 on the network can also be synchronized.
[0129]
(Second embodiment)
In the first embodiment, the application example to the game system has been mainly described. However, the present invention is not limited to the game system and the game apparatus, but can be applied to a general image processing apparatus such as an image display apparatus. . In the present embodiment, an example in which the above-described function is realized using an information recording medium will be described.
[0130]
FIG. 6 is a diagram illustrating an example of functional blocks of the information recording medium 600 according to the present embodiment and the image display apparatus 500 that reads the information recording medium 600.
[0131]
The information recording medium 600 is a computer-readable information record in which information for receiving and displaying the image data from the processing device 502 on the transmission side via the communication line 570 is recorded in a network that transmits and receives compressed image data. It is a medium.
[0132]
Here, the information includes the reception storage information 610 for receiving the image data and temporarily storing the received image data in the frame buffer 542 as a storage unit, and the image data stored in the frame buffer 542. And decompression display information 620 for decompression and display.
[0133]
The information includes calculation information 630 for calculating the accumulation rate of the image data in the frame buffer 542, and erased display data of the image data from the frame buffer 542, and the accumulation rate is predetermined. And adjustment information 640 for thinning out or supplementing a part of the image data stored in the storage means when the image data is out of the range and the image data is still image data.
[0134]
On the other hand, the image display apparatus 500 having a computer that reads the information 610 to 640 includes an information reading unit 590 that reads the information 610 to 640, a receiving unit 580 that receives the image data, and a frame buffer 542 that stores the received data. A buffer control unit 548 for controlling data transmission of the frame buffer 542, an image synchronization unit 538 for adjusting image synchronization, a decompression unit 560 for decompressing compressed image data, and displaying the decompressed image. And an image display unit 520 to perform.
[0135]
When the information reading unit 590 reads the information 610 to 640, the image display apparatus 500 functions as follows.
[0136]
First, the reception storage information 610 is read, whereby the reception unit 580 receives the compressed image data via the network, and the compressed image data received by the buffer control unit 548 is temporarily stored in the frame buffer 542. The
[0137]
Further, by reading the calculation information 630, the data amount calculation unit 541 in the image synchronization unit 538 calculates the accumulation rate of the compressed image data in the frame buffer 542.
[0138]
Similarly, when the adjustment information 640 is read, the data adjustment unit 539 in the image synchronization unit 538 deletes the display data of the image data from the frame buffer 542, and the accumulation rate is out of the predetermined range. If the image data is still image data, a part of the image data stored in the storage means is thinned out or compensated.
[0139]
That is, when the accumulation rate is extremely small and the accumulation rate is extremely large, it can be determined that the image data is insufficient or is in a surplus state, and that it is necessary to perform image synchronization adjustment.
[0140]
When synchronization adjustment is necessary, if image data is thinned out or compensated while still image data is displayed, image synchronization adjustment can be performed without being noticed by a person viewing the image.
[0141]
Further, for the image data whose synchronization is adjusted, the decompressed display information 620 is read, so that the compressed image data in the frame buffer 542 is decompressed by the decompressing unit 560, and the decompressed image data is the image display unit 520. Is displayed.
[0142]
Further, according to the present embodiment, the synchronization of the processing device 502 on the transmission side of the compressed image data and the image display device 500 is synchronized by adjusting the synchronization of the image display device 500 that has read the above information. You can also.
[0143]
As the processing device 502, for example, an image data generation and compression device, an image data compression device, and the like can be applied.
[0144]
(Third embodiment)
FIG. 7 is a diagram illustrating an example of functional blocks of an information recording medium 800 according to another embodiment of the present invention and an image display device 700 that reads the information recording medium 800.
[0145]
The information recording medium 800 is an information recording medium that can be read by an image display device 700 having a computer that records information for displaying compressed image data.
[0146]
Here, the information includes write information 810 for sequentially writing the image data in a storage area, and expanded display information 820 for reading out, expanding, and displaying the image data in the storage area.
[0147]
In addition, the information supplements image data to be expanded and displayed using the written image data when the amount of the image data occupying the capacity of the storage area is smaller than a desired value, and the storage When the amount of image data occupying the capacity of the area is larger than a desired value, a part of the continuous image data in the storage area for expansion and display is deleted, and the change in the amount of image data exceeds a predetermined value It includes replenishment deletion information 830 for performing the replenishment or the deletion when it is large or when there is almost no change in the amount of image data.
[0148]
On the other hand, an image display device 700 having a computer that reads the information 810 to 830 includes an information reading unit 790 that reads the information 810 to 830, a storage unit 710 that stores compressed image data 712, and compressed image data 712. A frame buffer 741 that temporarily stores data, a buffer control unit 748 that controls data transmission of the frame buffer 741, an image synchronization unit 738 that performs image synchronization adjustment, and a decompression unit 714 that decompresses compressed image data An image display unit 720 that displays the expanded image.
[0149]
By reading the information 810 to 830 by the information reading unit 790, the image display device 700 functions as follows.
[0150]
First, when the write information 810 is read, the buffer control unit 748 sequentially writes the compressed image data 712 stored in the storage unit 710 into the frame buffer 741 that is a storage area.
[0151]
Further, when the supplement deletion information 830 is read, the image synchronization unit 738 uses the image data already written in the frame buffer 741 when the amount of compressed image data occupying the capacity of the frame buffer 741 is smaller than a desired value. One of the continuous image data in the frame buffer 741 for decompression and display is replenished when the image data to be expanded and displayed is supplemented, and the amount of the image data occupying the capacity of the frame buffer 741 is larger than a desired value Works to delete parts.
[0152]
According to this, in a state where the computer that has read the information needs to adjust the image data by determining that the accumulation rate obtained by comparing the image data amount with the desired value is outside the predetermined range. I understand that there is.
[0153]
Further, by reading the supplement deletion information 830, the image synchronization unit 738 performs the supplement or the deletion when the change in the image data amount is larger than a predetermined value or the change in the image data amount hardly occurs. Function.
[0154]
According to this, by monitoring the change in the amount of image data and performing replenishment or deletion of the image data in an inconspicuous state, the image data can be adjusted without being noticed by a person viewing the image data.
[0155]
Further, for the image data whose synchronization is adjusted, the decompression display information 790 is read, so that the decompression unit 714 reads and decompresses the image data in the frame buffer 741, and the image display unit 720 decompresses the image data. Display data.
[0156]
(Other examples)
Note that the present embodiment is not limited to implementation in games such as the above-described game device, game data distribution device, and game system, and implementation in the form of an information recording medium. The present invention can be applied to the synchronous adjustment of image processing and audio processing.
[0157]
For example, the following can be applied as a network system including a server device having an image generation function and a client device having an image display function.
[0158]
First, a plurality of client devices that request acquisition of reproduction data, and a server device that generates and compresses reproduction data based on the request data from the client device, which is transmitted via a network, and distributes the data to the client device In the network system including the server device and the client device, it can be configured as follows.
[0159]
The server device generates reception data for each predetermined unit based on the reception unit that receives the request data from the client device, the identification unit that identifies the client device based on the request data, and the request data A generating unit; and a transmitting unit that compresses the generated reproduction data and transmits the compressed data to the identified client device.
[0160]
Further, the client device transmits the request data to the server device, receives the reproduction data, a storage unit that stores the received reproduction data, and the reproduction unit for each of the stored predetermined units A monitoring unit for monitoring a change in data amount, a calculation unit for calculating the game data amount stored in the storage means at predetermined intervals, and a difference between the calculated data amount and a desired data amount is a predetermined value. Is larger, the adjustment unit for deleting or supplementing the stored reproduction data in the predetermined unit, the expansion unit for expanding the reproduction data, and reproducing the expanded reproduction data based on the monitoring result And a deleting unit that deletes the reproduction data that has been reproduced from the storage unit.
[0161]
By adopting such a configuration, when the difference between the calculated data amount and the desired data amount is larger than a predetermined value, the reproduction data is deleted or supplemented in the predetermined unit. The reproduction data can be adjusted without being noticed by the observer.
[0162]
In addition, this makes it possible to synchronize a plurality of client devices without being noticed by an observer of the reproduction data. In particular, by providing the identification unit, even when there are a plurality of client devices, it is possible to appropriately identify them, and it is possible to distribute the reproduction data only to the client devices that have requested the reproduction data. Thereby, unnecessary traffic on the network can be eliminated.
[0163]
Further, the adjustment unit may store the reproduction data stored in the predetermined unit when the change in the reproduction data amount is larger than a predetermined value or the reproduction data amount hardly changes as a result of the monitoring. It can be configured to be deleted or replenished.
[0164]
With this configuration, it is possible to perform thinning or compensation of the reproduction data when the change in the reproduction data amount is larger than a predetermined value or when there is almost no change in the reproduction data amount. The reproduction data can be adjusted without being noticed by the observer.
[0165]
Here, when the change in the amount of data for reproduction is larger than a predetermined value, for example, when the luminance change is intense such as a flash scene, a moving image is a still image, a still image is a moving image, and an entire image is a partial up image. In the case of switching the image to, for example, the case of switching the sound such as noise sound. By adjusting the synchronization in such a case, the reproduction data can be appropriately adjusted without being noticed by the observer.
[0166]
Moreover, as a case where there is almost no change in the amount of data for reproduction, for example, a state where still images are continuous, a silent state, and the like are applicable. In such a case and when adjusting by thinning or compensation, the reproduction data can be adjusted without making the observer aware of the thinning or compensation.
[0167]
Furthermore, the reproduction data includes at least one of moving image data and audio data, and the reproduction unit includes at least one of an image display unit that displays the moving image data and an audio reproduction unit that reproduces the audio data.
[0168]
In particular, if data is thinned out or compensated during reproduction of moving image data or audio data, an observer of the data is easily noticed and the observer is suspicious of what has happened.
[0169]
According to this, even with moving image data or audio data, data adjustment can be performed in a state where it is difficult for the observer to notice. Thereby, the observer can reproduce the reproduction data comfortably without feeling uncomfortable.
[0170]
Note that these synchronization adjustment methods are the same as those described in detail in the first embodiment.
[0171]
[Brief description of the drawings]
FIG. 1 is a diagram showing an example of a game data distribution device and a network system using a game device according to the present embodiment.
FIG. 2 is a diagram showing an example of functional blocks of the game system according to the present embodiment.
FIG. 3 is a diagram showing an example of a flowchart of image synchronization adjustment by data comparison according to the present embodiment.
FIG. 4 is a conceptual diagram showing a relationship between a frame buffer and positions indicated by various pointers according to the present embodiment.
FIG. 5 is a flowchart showing a series of processing from determination of necessity of synchronization adjustment to adjustment such as thinning.
FIG. 6 is a diagram illustrating an example of functional blocks of an information recording medium according to the present embodiment and an image display apparatus that reads the information recording medium.
FIG. 7 is a diagram illustrating an example of functional blocks of an information recording medium according to another embodiment of the present invention and an image display device that reads the information recording medium.
[Explanation of symbols]
100 Game data distribution device
112 generator
114 Compression unit
116, 236 transceiver unit
200 game devices
220, 520, 720 Image display unit
222 Sound playback unit
234 Distribution Request Data Generation Unit
235 Operation data input part
238, 538, 738 Image synchronization unit
239, 539 Data adjustment unit
241, 541 Data amount calculation unit
242 Data volume monitoring unit
244, 560, 714 Extension part
246, 542, 741 Frame buffer
248, 548, 748 Buffer control unit
300,570 Communication line
500, 700 Image display device
502 processing apparatus
580 receiver
590 Information reading unit
600, 800 information recording medium
610 Received and stored information
620, 820 Extended display information
630 Calculation information
640 Adjustment information
710 storage unit
712 Compressed image data
810 Write information
830 Replenishment deletion information

Claims (4)

A game device that receives game player operation data and transmits distribution request data generated based on the operation data;
A game data distribution device that generates and compresses game data including at least one of game image data and game sound data based on distribution request data from the game device transmitted via a network, and distributes the game data to the game device;
A game system including:
The game data distribution device includes:
Means for receiving distribution request data from the game device;
Means for generating the game data based on the received distribution request data;
Means for compressing the generated game data and transmitting it to the game device;
Including
The game device includes:
Means for generating the distribution request data based on operation data input by a game player, transmitting the data to the game data distribution device, and receiving the game data from the game data distribution device;
Storage means having a predetermined storage area for storing a plurality of received game data;
Computing means for computing the received game data amount in a compressed state;
The reception completion pointer indicating the position in the storage area of the game image data that has been received is compared with the display schedule pointer indicating the position in the previous storage area of the game image data to be displayed. It is determined whether the difference is outside the predetermined range. If the difference is outside the predetermined range, the game data amount in n (n is an integer of 2 or more) -1 frame is compared with the game data amount in n frame. Data amount monitoring means to perform,
When the difference between the game data amount in the n-1 frame and the game data in the n frame is larger than a predetermined value or when there is almost no difference, the display schedule pointer is ahead of the reception completion pointer. Data adjusting means for determining whether the display schedule pointer is delayed by one frame or more compared to the reception completion pointer;
Means for expanding and reproducing the game image data indicated by the display schedule pointer;
Including
The data adjustment means returns the display schedule pointer to the previously displayed point when it is determined that the display schedule pointer is ahead of the reception completion pointer, and the display schedule pointer is 1 compared to the reception completion pointer. A game system characterized by setting the display-scheduled pointer to a point advanced by one frame when it is determined that it is delayed by a frame or more. A game device that receives game player operation data and transmits distribution request data generated based on the operation data;
A game data distribution device that generates and compresses game data including at least one of game image data and game sound data based on distribution request data from the game device transmitted via a network, and distributes the game data to the game device;
A game system including:
The game data distribution device includes:
Means for receiving distribution request data from the game device;
Means for generating the game data based on the received distribution request data;
Means for compressing the generated game data and transmitting it to the game device;
Including
The game device includes:
Means for generating the distribution request data based on operation data input by a game player, transmitting the data to the game data distribution device, and receiving the game data from the game data distribution device;
Storage means having a predetermined storage area for storing a plurality of received game data;
A calculation means for calculating a ratio of the game data amount in the storage area;
The reception completion pointer indicating the position in the storage area of the game image data that has been received is compared with the display schedule pointer indicating the position in the previous storage area of the game image data to be displayed. Data amount monitoring that determines whether or not the difference is outside the predetermined range and compares the ratio in n (n is an integer of 2 or more) -1 frame and the ratio in n frame when the difference is outside the predetermined range Means,
Whether the display schedule pointer is ahead of the reception completion pointer when the difference between the ratio in the n-1 frame and the ratio in the n frame is greater than a predetermined value or when there is almost no difference Data adjustment means for determining whether the display schedule pointer is delayed by one frame or more compared to the reception completion pointer;
Means for expanding and reproducing the game image data indicated by the display schedule pointer;
Including
The data adjustment means returns the display schedule pointer to the previously displayed point when it is determined that the display schedule pointer is ahead of the reception completion pointer, and the display schedule pointer is 1 compared to the reception completion pointer. A game system characterized by setting the display-scheduled pointer to a point advanced by one frame when it is determined that it is delayed by a frame or more. Means for the game player to input the distribution request data;
Means for transmitting the input distribution request data to a game data distribution apparatus via a network and receiving game data including at least one of game image data and game sound data;
Storage means having a predetermined storage area for storing a plurality of received game data;
Computing means for computing the received game data amount in a compressed state;
The reception completion pointer indicating the position in the storage area of the game image data that has been received is compared with the display schedule pointer indicating the position in the previous storage area of the game image data to be displayed. It is determined whether the difference is outside the predetermined range. If the difference is outside the predetermined range, the game data amount in n (n is an integer of 2 or more) -1 frame is compared with the game data amount in n frame. Data amount monitoring means to perform,
When the difference between the game data amount in the n-1 frame and the game data in the n frame is larger than a predetermined value or when there is almost no difference, the display schedule pointer is ahead of the reception completion pointer. Data adjusting means for determining whether the display schedule pointer is delayed by one frame or more compared to the reception completion pointer;
Means for expanding and reproducing the game image data indicated by the display schedule pointer;
Including
The data adjustment means returns the display schedule pointer to the previously displayed point when it is determined that the display schedule pointer is ahead of the reception completion pointer, and the display schedule pointer is 1 compared to the reception completion pointer. A game device characterized in that when it is determined that the frame is delayed by more than a frame, the display schedule pointer is set to a point advanced by one frame. Means for the game player to input the distribution request data;
Means for transmitting the input distribution request data to a game data distribution apparatus via a network and receiving game data including at least one of game image data and game sound data;
Storage means having a predetermined storage area for storing a plurality of received game data;
Means for generating the distribution request data based on operation data input by a game player, transmitting the data to the game data distribution device, and receiving the game data from the game data distribution device;
A calculation means for calculating a ratio of the game data amount in the storage area;
The reception completion pointer indicating the position in the storage area of the game image data that has been received is compared with the display schedule pointer indicating the position in the previous storage area of the game image data to be displayed. Data amount monitoring that determines whether or not the difference is outside the predetermined range and compares the ratio in n (n is an integer of 2 or more) -1 frame and the ratio in n frame when the difference is outside the predetermined range Means,
Whether the display schedule pointer is ahead of the reception completion pointer when the difference between the ratio in the n-1 frame and the ratio in the n frame is greater than a predetermined value or when there is almost no difference Data adjustment means for determining whether the display schedule pointer is delayed by one frame or more compared to the reception completion pointer;
Means for expanding and reproducing the game image data indicated by the display schedule pointer;
Including
The data adjustment means returns the display schedule pointer to the previously displayed point when it is determined that the display schedule pointer is ahead of the reception completion pointer, and the display schedule pointer is 1 compared to the reception completion pointer. A game device characterized in that when it is determined that the frame is delayed by more than a frame, the display schedule pointer is set to a point advanced by one frame.

Images