JPH11282866A - Electronic book display and recording medium readable by computer - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize an electric book display to easily output multimedia read effect data suited to a psychological condition at reading, reading environment, purpose, etc., of a user and to promote presence which is not experienced by an ordinary book, not only the reading effect but psychological and educational effects. SOLUTION: The electronic book display is provided with a record means 1 in which book data is recorded, a display means 2 to display the recorded book data, a page turn means 3 to turn over a page of the book data displayed on the display means 2, an environment managing means 4 to manage read environment information of the user, a second recording means 5 to record different viewpoint screen data in which the book data of the displayed page is expressed in another viewpoint or mental image data to emphasize the image of the different viewpoint screen data, a mental image output means 6 to output the mental image data and a read effect control means 7 to output the read effect data generated by using the different viewpoint screen data and the mental image data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an electronic book display device for reading and displaying the contents of electronic book data written on a recording medium.

[0002]

2. Description of the Related Art As a conventional example of an electronic book display device, Japanese Patent Application Laid-Open No. 63-15796 discloses an external recording medium on which data obtained by converting characters, numerals, symbols, etc. into code signals is recorded. A flat display device, a keyboard unit for inputting from outside, a character memory area, and a thin portable book having a microcomputer (the electronic book display device of the present invention). Reproduced by the reproducing device, the microcomputer displays characters, numbers, symbols, etc. for one screen of the flat display device, and the user displays the characters displayed on the display screen,
2. Description of the Related Art A technology relating to a thin portable book has been disclosed in which the contents of a book can be grasped by reading numbers and symbols. Further, the above publication discloses that when reproducing data on a reproducing apparatus, data for a plurality of screens is reproduced, the data is stored in a temporary memory area, and a screen designated by an external input key by a user as necessary is displayed. A technology relating to a thin portable book characterized in that a user can read a display screen by displaying and understand the contents thereof has also been disclosed, and by integrating the above technologies, the user can press a button or the like every time. By displaying the next page, it was possible to read the document as if reading a normal book.

Japanese Patent Application Laid-Open No. 8-249344 discloses a storage means for recording book data, a display means for displaying the book data read from the storage means, and a page of the book data displayed on the display means. An electronic book comprising: a transmitting unit that hapticly transmits a position, wherein the transmitting unit is a vibration generating unit that vibrates at a frequency corresponding to each page position, and a frequency that gradually increases as the number of pages increases. Vibration at the frequency, or at a frequency that gradually decreases as the number of pages increases, or at a specific page position, a technology related to an electronic book device that vibrates at a specific frequency is released, and the vibration or frequency is linked to the tactile sensation of the reader This makes it possible to support reading, especially the approximate position of the current page as a whole, and search by trial and error. Which was.

Japanese Patent Application Laid-Open No. H5-222482 discloses a display device for displaying a continuous video without audio, a video recording, and a video / audio storage device for inputting individual audio recordings required for the video. An audio selection device for selecting individual audio suitable for a video displayed on the display device from the audio recording device, and an audio incorporation device for incorporating the selected audio into the video; A technology relating to a drama reproducing apparatus characterized in that a sound is individually selected and incorporated into a video so that a drama with sound can be reproduced has been disclosed. According to the official gazette, the drama is appropriately selected according to the user's age, degree of intelligence, and purpose of use. For example, when the user is an infant, simple conversations in daily life, sounds of daily life, sounds of animals and the like are heard. In the case of recorded drama, school children of older age,
It can be seen as a drama about human dramas and theoretically ongoing discussions. By providing a drama in which audio and video are selected as described above, a great sense of satisfaction can be given to the user.

Further, the Internet WWW (Wor
As seen on the homepage of ld Wide Web, there are a wide variety of techniques for accessing the homepage, changing the message or background depending on the accessor, and outputting a specific page, and automatically switching to another page after a certain period of time. Are known.

[0006]

However, in the above-mentioned conventional electronic book display device, the data output to the display means or audio output means is limited to book data, video data and audio data for explaining the data. Therefore, there is a problem that the multimedia information including the vibration increases the atmosphere and the sense of reality, and the reading effect cannot be improved.

Further, the above-mentioned conventional electronic book display device is
There is no function of grasping the mental state of the user, and there is a problem in that it is not possible to output a higher reading effect in accordance with the mental state of the user.

[0008] In addition, the above-mentioned conventional electronic book display device includes:
Selects a video that matches the viewpoint of the editor from multiple video data, adds audio data to the selected video, and creates an audio drama, and supports multiple video for a specific scene of video data However, it does not have a function of generating audio data suitable for each video. For this reason, there is a problem that the work of selecting a video along the viewpoint and the work of attaching sound to the selected video are heavy.

[0009] Further, the above-mentioned conventional electronic book display device includes:
There is no function of grasping reading environment information such as a user's reading history, and the content of output book data cannot be changed depending on the number of times of reading, for example, and it is impossible to support fresh reading. was there.

Further, the above-mentioned conventional electronic book display device is
There is no function of controlling the reading speed in accordance with the user's reading environment information or book contents, and thus there has been a problem that, for example, functions such as fast reading and slow reading of reading cannot be provided.

[0011] In addition, the above-mentioned conventional electronic book display device includes:
The purpose is to improve the understanding of book data (drama). For example, subliminal video, audio, and sound information that is displayed for a very short time compared to book data are mixed to improve the reading effect and draw out the potential. And it cannot provide functions for improving psychological therapy, educational effects, and the like.

Further, the above-mentioned conventional electronic book display device has
The vibration and sound data associated with the book data are repeated even if the book data is redisplayed, and there is a problem that the interest and understanding of reading by the user cannot be promoted.

Further, the above-mentioned conventional electronic book display device is
The output level of vibration and audio data associated with book data is limited to one, and there is a problem that the reading effect cannot be emphasized by gradually changing the output level such as fade-in and ford-out. .

Further, the above-mentioned conventional electronic book display device is
There is no function to relate the output time and the position of the vibration or audio data associated with the book data on the display means, and there is a problem that the output cannot be changed according to the user's movement or the amount of exercise to enhance the reading effect. Was.

Further, the above-mentioned conventional electronic book display device is
There is no output control function when there are vibrations and audio data associated with a plurality of book data in the same display page or in the same window. For example, by combining a plurality of audio data, an output that enhances the reading effect is output. There was a problem that it was not possible.

The present invention has means for grasping and managing reading environment information such as a user's psychological state and reading state, and when book data associated with reading effect data is displayed on the display means, the user is provided with the information. An object of the present invention is to realize an electronic book display device which easily outputs multimedia reading effect data adapted to reading environment information and promotes not only reading effect but also psychological and educational effect.

[0017]

[MEANS FOR SOLVING THE PROBLEMS] Claims 1 to 11
The electronic book display device described above, a recording unit that records book data, a display unit that displays the recorded book data,
An electronic book display device having a page turning means for turning pages of book data displayed on a display means, wherein the environment management means manages reading environment information of a user, and the book data of the displayed page is expressed from another viewpoint. Second recording means for recording the image data of the different viewpoint screen data or the image of the different viewpoint screen data, mental output means for outputting the mental data, and reading generated using the different viewpoint screen data and the mental data. A reading effect control means for outputting effect data is provided.

The reading effect control means may output the reading effect data by referring to the user's reading environment information stored in the environment management means before outputting the reading effect data to the display means or the image output means. Is controlled. The reading effect control means outputs the reading effect data after all or a part of the book data area associated with the mental data is displayed on the display means. Further, the reading effect control means outputs the reading effect data after a time specified in the time switching mode in the book data.

Further, the reading effect control means controls the output time or the output method of the reading effect data using the value of the display mode set for each area in the book data divided into areas by contents or format. It is characterized by doing. Also, the reading effect control means outputs reading effect data using a reading effect table or a relation graph that associates reading environment data to be output with reading environment information composed of user information, psychological information, or reading information. It is characterized by doing. Further, the reading effect control means changes the output level of the mental image data from 0 to the maximum value in proportion to the psychological value obtained by integrating the environmental information of the user's mental state. Further, the reading effect control means outputs mental data proportional to the amount of exercise related to the page turning operation.

Further, the reading effect control means outputs, when a plurality of book data areas associated with the image data exist on the same display page, the reading effect data corresponding to each image data in a superimposed manner. Features. Also,
The reading effect control means can stop the output of part or all of the reading effect data. The reading effect control means is characterized in that a user can change a control method of the reading effect control means.

[0021] The computer-readable recording medium in which the program according to the twelfth aspect is recorded has a recording function of recording book data on a computer, a display function of displaying the recorded book data, and a display means. A page turning function for turning pages of book data, an environment management function for managing reading environment information of the user, a second recording function for recording different-view screen data or mental data, and a mental output function for outputting mental data. , Generating reading effect data that enhances the reading effect of the displayed book data by synthesizing the different viewpoint screen data and the mental image data,
It is characterized by realizing a function of outputting.

With the above configuration, the present invention can output reading effect data corresponding to the user's reading environment information, and thus provide the user with a reading effect that cannot be felt when reading a normal book. It can contribute to promoting reading comprehension, strengthening psychology, and improving educational effects.

[0023]

FIG. 1 is a block diagram showing the structure of one embodiment of the electronic book display device of the present invention. In the figure, 1 is a magnetic medium such as FD, MO, CD, etc.
L for LSI memory, IC card, smart media, etc.
It is a recording unit composed of SI media or the like, and stores book data, a processing program for controlling the apparatus, various data, and the like. 2 is a liquid crystal display, CRT,
It is a display unit composed of a plasma display or the like, and displays book data and other information recorded in the recording unit. Reference numeral 3 denotes a page turning unit constituted by a button, a cursor key, and the like. By operating the page turning unit, a screen page of the book data displayed on the display unit can be turned forward or backward. It has become. The page turning means includes, for example, a line scrolling function, a function of turning a page by a cursor key, and a function of switching data to a different viewpoint screen.

Reference numeral 4 denotes an environment management means for sensing and managing information related to reading such as a user's mental state and reading environment, which will be described later in detail. Reference numeral 5 denotes second recording means for storing different-view screen data or image data, which will be described in detail later, and is constituted by the same means as the recording means 1. Further, the second recording means can be shared with the storage means 1, and in the present invention, the second recording means is used unless otherwise specified.
The description will be made with a structure in which the recording means is integrated with the recording means 1. 6
Is a means for outputting the image data accumulated in the second recording means, and performs sound output means such as a speaker, vibration output such as a vibrator, image deformation output, and the like.

The reference numeral 7 generates user-desired reading effect data in the book data displayed on the display means based on the user-specific environment management information stored in the environment management means, and outputs the data to the display means or the mental output means. Means to control the This means may be replaced by a CPU.

FIG. 2 is a diagram showing the appearance of an electronic book display device which is a typical embodiment of the present invention. In FIG. 2, 2
Is a display means described with reference to FIG. 1, 21 (a) or 21 (b) is a page turning instruction means for instructing a user to turn a page, and 22 is different viewpoint screen data comprising a plurality of screens on one page. Is a switch button for the user to give an instruction to switch the screen when "" is given. Reference numeral 23 denotes a cursor key for moving a cursor displayed on the display means.
(B), 22 and 23 together constitute the page turning means in FIG.

24 (a) or 24 (b) is an example of audio output means which is a kind of image output means, and is constituted by a small speaker. In FIG. 2, two speakers are arranged. However, even one speaker has three or more speakers and does not affect the embodiment of the present invention. However, it is preferable to increase the number of speakers in order to further enhance the reading effect, for example, two speakers can output stereo sound, and three speakers can output deep sound. FIG. 2 shows an example in which sound and sound are output to a speaker attached to the electronic book device. However, the sound output means may be an external speaker, an earphone, a headset, or the like. Even when the terminal port is provided, there is no effect on the implementation of the present invention.

Reference numeral 25 denotes a temperature sensor for measuring the temperature of the reader's hand, and reference numeral 26 denotes a humidity sensor for examining the state of sweat at the reader's fingertip. The temperature sensor and the humidity sensor can be integrated, and FIG. 2 shows a case where the temperature sensor and the humidity sensor are integrated. 27
Is a heart rate monitor for checking the heart rate. Reference numeral 28 denotes a recording unit insertion port for inserting a recording unit on which book data is recorded.

The vibration means 29 is built in the main body. Mental image data is constituted by book data output to the display means or book data obtained by applying image processing to the book data, voice / sound output to the audio output means, and vibration output by the vibration means alone or in combination.

The arrangement of the above-mentioned page turning means, audio output means, heart rate monitor and temperature / humidity sensor is not limited to that shown in FIG. However, the temperature sensor or the humidity sensor is provided at a position where the reader touches the electronic book display device, such as both sides and the back surface of the electronic book display device. Further, instead of the 23 cursor keys, the display means 2 may be a liquid crystal display device with a tablet function, for example, and the position of the cursor on the display screen may be designated by a pen or the like.

FIGS. 3A and 3B schematically show the format of book data recorded in the recording means. FIG.
(A) is a storage device having a structure of book data in a general electronic book display device (left diagram) and a second storage device (right diagram) which is a feature of the present invention has different structures. FIG. Reference numeral 30 denotes book data, and one book data exists on each page. Each page is provided with a pointer 31 to the second storage device. At the end of the pointer, different viewpoint screen data expressing book data of each page from different viewpoints or mental data 32 of each page are stored. The different viewpoint screen data or the image data in the second storage device can be different depending on each page as shown in FIG.

FIG. 3B is a diagram showing the data structure of the storage device in which the storage device and the second storage device are combined.
, The pointer is omitted, and the book data, the different viewpoint screen data, and the image data of each page are sequentially arranged.

FIG. 4 shows an example of a data format for one page of book data. Since the book data and the different-view screen data become screens that can be replaced, they are also treated as screen data in FIG. Usually, the screen 1 is the book data shown in FIG. 3, and the screen data after the screen 2 is different viewpoint screen data.

Each page has a screen number field 40 in which the number of different viewpoint screen data is added to the book data screen, and a field 41 in which the number of areas obtained by dividing each page by data format or semantic content is stored. A field for setting what processing is to be performed on each area follows. Hereinafter, taking the case of the screen 1 as an example, the detailed structure of each area will be described.

Reference numeral 42 denotes a field for storing information of a screen switching identifier of the area 1. The identifiers are classified by codes as indicated by the arrowheads in FIG.
In the case of, the screen is switched by time, and in the case of 0x01, the screen is switched by a button operation of the user.

If the screen identifier is 0x00, a time switching mode setting field 43 for determining how to set the time follows. In the time switching mode, for example, a time proportional to the distance from the start point of the screen displayed on the display means to this area, or the viewing time of the book data from the start point of the book data displayed on the display means to this area There is a timer mode in proportion to the time or the timer mode, and after the time described in the field, the screen is switched to the screen specified by the reading environment information.

Further, by selecting infinity as the switching time, it is possible to prevent the screen switching, or to set the switching time to 0 so that the screen before the switching is not displayed.

Reference numeral 44 denotes a field for storing the screen number of the area 1, which is used in exchanging information. 45
Is the coordinates of the area 1, and one-dimensional, two-dimensional, and three-dimensional coordinate data are stored in correspondence with the screen data of the area 1. Reference numeral 46 denotes a field in which an identifier of the format of the area 1 is stored. The format identifier is classified by a code as indicated by the arrow of the corresponding field in FIG. 4. If the value is 0x00, it can be understood that the area 1 is described by a character string. . The format is not limited to the format described here.

Reference numeral 47 denotes a field in which the screen data of the area 1 is described, and reference numeral 48 denotes a field in which the display mode of the area 1 is described. In the display mode, a display method such as progressive display, blinking, normal display, or a display time can be set. Although the screen data 47 is inserted as it is, it may be a pointer indicating a file name or an area where the screen data exists.

Reference numeral 49 denotes a field for storing a screen switching identifier for the area 2 of the screen 1;
The values of the area 2 corresponding to .about.48 are stored, and are accumulated by the number of areas set in 41. Reference numeral 4a denotes a field for storing the number of book data areas after the screen 2, and the values described in the screen 1 are accumulated by the number of screens set in the field 40.

FIG. 5 shows an example of the data format of the image data for one page. As shown in FIG. 5, after the number field 50 of the number of the image data areas indicating the number of the image data areas (reading effect marks) given to the page, the parameters relating to the image data are changed by the number of the image data areas. , 5n to be stored are repeated.

The image data 51,..., 5n of each area include:
, 5na for storing the image data area number for specifying the image data area in the page, and the area coordinate field 51 for storing the position information of the image data area.
, 5nb, and an image data number field 51c,..., 5nc indicating the number of image data to be assigned to the area.

Further, the identifiers for classifying the types of the image data are stored in 51d, 51g,... As many as the number of the image data, and the image output identifiers 51e, 51h,. Are stored by the number of image data, and 51f, 51i,... Store the image data itself or the processing method for generating the image data by the number of image data.

.. Are described by numerical values as shown in FIG.
In the case of x00, the image data is image processing data, and the type of image processing involving deformation of the specified book data or the image data of the specified area of the different viewpoint screen data and the image processing are performed. Is used to set the necessary parameters.

If the value of the image data identifier 51d is 0x
In the case of 01, the image data included in the image data field 51f is data relating to vibration, and the vibration frequency, vibration time, and vibration magnitude necessary for driving a vibrator or the like that generates vibration in the image output means. Vibration parameters such as height are stored. Similarly, the image data identifier 51d
Is 0x02, the image data field 51f
Is effect data, and parameters relating to sound characteristics such as a male sound, a female sound, a loudness of a voice, and a vocal sound can be set.

In the above description, the image data is stored directly in the method of storing the data. However, the present invention is not limited to this. For example, a pointer to an area storing the data or a file name is stored here. May be. It is also possible to use a table that associates the image data with the point indicated by the pointer.

The image output identifiers 51e, 51h,...
The area of the book data associated with the image data (hereafter,
(When a reading effect mark or an image data area is displayed) is displayed on the display means, the image data is automatically output or the cursor key 23 is used to output the image data manually, for example, by pointing the user to the area. The flag to be determined is stored.

FIG. 6 is a diagram showing an example of the data structure of reading environment information managed by the environment management means. The reading environment information is roughly divided into three pieces of information related to a mental state (psychological information), information related to a reading state (reading information), and user information.

A field 60 stores a heart rate, a field 61 stores a body temperature (fingertip temperature), and a field 62 stores a humidity (fingertip sweat rate). As the heart rate, body temperature, and humidity, output values of the current time of the temperature sensor 25, the humidity sensor 26, and the heart rate meter 27 described in FIG. 2 are stored. 60
-62 constitute user's psychological information. It is clear that the psychological information is not limited to the three types described above as long as there is a sensor.

When the above three pieces of psychological information have high values, they indicate an excited state. Therefore, for example, values of the heart rate, body temperature, and fingertip humidity in the steady state are S0 and T, respectively.
0, Y0, and the respective values at time t are St, T
Assuming that t and Yt, the psychological degree Kt representing the mental state of the user at time t is Kt = a1 (St−S0) + a2 (T
The value can be approximated by (t-T0) + a3 (Yt-Y0) (a1, a2, and a3 are proportional constants). The relation function is
It is not limited to the above linear equation, but the heart rate,
What is necessary is just to show the relationship between the fingertip body temperature and the fingertip humidity.

Numeral 63 denotes a field for storing the date of reading, 64 denotes a field for storing the time of starting reading, 65 denotes a field for storing the room temperature at the start of reading, and 66 denotes a field at the time of starting reading. A field for storing the humidity of the room is a field for storing reading history information. The values of 66 and 65 indicate that the temperature of the temperature sensor 25,
Data is acquired by taking in the value of the humidity sensor 26.

The user's reading history information stores the number of times the user has viewed the book data of the target portion and the number of times that the user has read the book data. Can be managed. Reference numeral 68 denotes a field for storing an average speed of page turning. The speed is determined from a time interval at which the user turns the page by a timer built in the CPU or the reading effect control means, and stored in this field. In the field 67, a pointer to the area where these data are stored may be stored. 63 to 68 are information fields relating to the reading information described above.

Reference numeral 69 denotes a field for storing the name of the user, 6a a field for storing the age of the user, 6b a field for storing the gender of the user, and 6c a field for storing the purpose of the user. And
6d is a field for storing user's preference. When the user's name is input, the reading history 67 is managed for each name. The user's purpose 6c can be set in the user interface, and is associated with the operation mode of the electronic book display device. For example, the speed reading mode, the learning mode, the potential improvement mode, the relaxation mode,
You can choose the emotion mode. The user's preference 6d is, for example, classical music, pop music,
The user's daily preference information, such as a light-colored screen, a violently-colored screen, a deposition preference for suppressing the degree of excitement, and a preference for improving the degree of excitement, is stored.

FIG. 7 is a diagram showing an example of a processing flow of the reading effect control means of the present invention. In the figure, S10 is a processing module for reading initialization data, book data, different viewpoint screen data, mental data, and the like necessary for this processing into the reading effect control means, and S11 is a processing module among the data read by the reading effect control means. Is a processing module for reading the display data of the page into the display buffer and displaying it.
As the initialization data, for example, the values of the temperature sensor 25 and the humidity sensor 26 are read and stored in the room temperature 65 and the room humidity 66 of the reading environment information in FIG. 6, or are incorporated in the CPU or the reading effect control means. An operation of using a calendar or a timer function to capture the reading environment information at the date 63 and the time 64 is also included. The display page of the electronic book display device is set by default unless otherwise specified. For example, the first page or the last opened page is displayed.

Step S12 is a processing module for determining whether or not there is a reading effect mark in the displayed page. If there is no reading effect mark, there is no process for enhancing the reading effect, so the process proceeds to the processing module for determining whether to display the next page or to end the process. If there is one or more reading effect marks, the process proceeds to subsequent steps.

S13 is a processing module for reading reading environment information into reading effect control means. The psychological information in the environmental management information is, for example, after the time when the state is stabilized from the date and time when reading is started, for example, every five minutes, and every regular time, for example, every minute, or when turning pages. Update the data every time. Reading history information 6 in FIG.
7 stores the access history of each area of the book data of each page or the different viewpoint screen data, and the user information in FIG. 6 contains a value set using the user interface.

Step S14 is a processing module for generating reading effect data using the reading environment information read as described above. The meaning of enhancing the reading effect in the present invention is to provide the user with an optimal screen, voice / sound, vibration, etc. according to the user's reading mood, excitement, preference, purpose or reading history. Realized by selecting psychological information, reading information and user information stored in the environmental management means of No. 6 using the effect data table or relational graph to select suitable image data and different viewpoint screen data and synthesizing them. I do. Details will be described later.

S15 is a processing module for outputting the reading effect data generated as described above. First, the reading effect control means refers to the screen switching identifier 42 of the book data, and if it is 0x00, the time switching mode field 4
With reference to FIG. 3, it is determined at what time the screen data 47 of the area and the image data added to this area are output. Next, control is performed to output the determined reading effect data to the display means or the image output means. The mental data is output at a timing synchronized with the different viewpoint screen data. This part will be described in detail later.

Step S16 is a processing module for judging whether or not there is a request for displaying the next page. When there is a request for displaying the next page, preparations are made for displaying the next page (S16).
18) If there is no such request, a series of processing ends (S
17).

In the above description, the embodiment of claim 1 or claim 2 is self-evident. First, an embodiment according to claim 3 will be described. FIG. 8 is a diagram showing a display example of a specific page displayed on the display means, and includes a region 1 (80) and a region 2 (8
1) and 3 (82). The area 3 is an illustration area, and it is assumed that a picture of Nara Park is displayed, for example. In addition, the entire area of the area 3 is a reading effect mark, and is distinguished (for example, in the figure, a frame is surrounded) so that the associated area can be recognized. In FIG. 8, a frame indicating the area is displayed to explain the area, but this frame is not normally displayed, and the reading effect mark is distinguished from the others (in the display example). In this case, the frame of the area 3 is visible).

The screen shown in FIG.
It is displayed by pressing (a) and 21 (b) and moving from the previous or next page. In this case, since the screen changes in page units, the entire area is displayed when the area 3 is almost the same. Also, by using the 23 cursor keys, it is possible to continuously turn pages by scrolling in units of lines. For example, when turning pages in reverse, from the state where the upper end of the area 3 comes to the position of the upper end of the entire screen, Line scrolling can be sequentially performed until the upper end of the area 3 reaches the position of the lower end of the entire screen. Therefore, when the screen data is displayed (S11), the reading effect control unit determines the existence of the mental image data by checking whether any one of the frame lines of the reading effect mark exists on the display unit (S11). S1
2).

FIG. 9 is a diagram for explaining an embodiment of the time switching mode for determining the output timing of the reading effect data in the step S15. Description will be made using the same screen and the same reference numerals as those in FIG. Reference numeral 90 denotes a distance r from the starting point of the screen to the starting point of the area associated with the image data. Assuming that the distance between the diagonal lines of the screen is s, the user starts reading the displayed screen from the start point of the normal screen, and ends reading at the end point at the lower right of the screen. Therefore, the time required to finish reading the screen data from the start point to the end point is Tf.
Assuming that there is no difference between the reading times of the respective areas, the reading of the data of the area 3 starts at the time represented by Tr = Tf × r / s. One of the time switching modes in claim 4 is:
Tr time after a part or all of the book data associated with the image data is displayed, for example, by performing a process of switching a photograph of Nara Park in the area 3 to a photograph of a deer playing at Mt. When reading the area of the book data to which the different viewpoint screen data is added, it is possible to switch from one different viewpoint screen data to another screen data. At this time, if the image data is added to the switched different viewpoint screen data, the image data is output in accordance with the switching of the screen data. This output mode is called a distance mode.

Another example of the time switching mode takes into account the viewing time of each area. For example, region 1 is a character string, and it takes about Tc time per character to read normally, and region 2 is also a character string. For example, if it takes Tc2 time per character, Tm = Tc1 × At the time represented by m1 + Tc2 × m2 (m1 and m2 are the number of characters in the area 1 and the area 2), the reading of the area 3 is started. As in the case of the above mode, a process of switching, for example, a photograph of Nara Park in the area 3 to a photograph of a deer playing at Mt. Wakakusa Tm after Tm time since a part or all of the book data associated with the mental data is displayed. I do. This output mode will be referred to as a visual mode.

In the case of the timer mode, a time that is not directly related to the time at which reading of the target area starts can be set. For example, by setting the switching time to 0, a photograph of a deer playing on Mt. Wakakusa can be displayed before the photograph of Nara Park can be visually confirmed. In this case, it appears to the user that a photograph of a deer playing directly at Mt. Wakakusa is displayed.

Therefore, in S15, the reading effect control means refers to the time switching mode field from each area of the displayed book data (screen data) to determine whether the mode is the distance mode or the visual mode. It is determined whether the mode is the timer mode, the display waiting time determined in each mode is determined, and the reading effect data is output after the determined display waiting time after the reading effect data is generated.

Next, an embodiment according to claim 5 will be supplementarily described. This part relates to the display mode referred to before performing the display in the time switching mode described in claim 4, and relates to the processing module of S15. When part or all of the image data area is displayed on the display means, the reading effect control means refers to the value of the display mode in the displayed book data. FIG. 10 is a diagram illustrating an example of a data structure in the display mode. Reference numeral 100 denotes a field for storing a display method. When the value is 0x00, the selected different viewpoint screen data is displayed gradually so as to increase the accuracy (progressive). In the case of 0x01, normal display is performed. In addition, blinking, inversion, flash, and the like are coded. Note that 100
Note that is easy to be confused with the image processing data in the image data identifier 51d in FIG. In the data for image processing, the displayed image is deformed.
In the case of 00, no deformation processing is applied to the image itself. 101
Is a field for storing the time for displaying the different viewpoint screen data, and the different viewpoint screen data is displayed for the time set here. Reference numeral 102 denotes a field for defining a processing method when the display time set in the above 101 is exceeded,
When the value is 0x00, the display returns to the original screen after the display time. In the case of 0x01, the screen number 44 in FIG. 4 is designated, and the designated screen data is displayed. In the case of 0x02, the different viewpoint screen data having a value one larger than the currently displayed screen number is displayed.

Next, an embodiment according to claim 6 will be supplementarily described. This processing relates to S14 of the processing flow. S13
The reading effect control means that referred to the reading environment information refers to a reading effect table described below. FIG. 11 is a diagram showing an example of a reading effect table for associating reading environment information with reading effect data to be output. In FIG. 11, the value of the heart rate 60 in FIG.
…, 6an. The vertical axis indicates the amount of perspiration at the fingertip 62
, Are divided into the ranges 6b1,..., 6bm.
The effect data 6d11,..., 6dmn to be output to the cell where the heart rate and the amount of sweating intersect are designated. For example, the reading effect control means reads the reading effect table stored in the second recording means, then refers to the reading environment information, and sets the value of the heart rate stored in the environment management means 4 to the range 6a2. If the value of the sweat amount is in the range 6b1, it indicates that the reading effect data 6d12 corresponding to the corresponding heart rate and sweat amount is selected from the reading effect table and output to the mental output means or the display means.

Although FIG. 11 shows a two-dimensional table format relating to the heart rate and the amount of perspiration, the description is usually extended to an n-dimensional table. FIG. 6 shows the reading environment information stored in the environment management means 4, and the item dimension table described here is managed. In addition, reading effect data 6d
11,..., 6dmn are not actual data, but may be file names or pointers indicating actual data locations.

Therefore, first, the reading effect control means sets the value of each field of the reading environment information to n of the reading effect table.
Compare the value with the dimension axis. Next, the type and output level of the image data or the different viewpoint data are determined by referring to the value of the cell at the intersection of the corresponding cell, and this is generated as reading effect data.

FIGS. 12A, 12B and 12
(C) is a diagram for explaining an embodiment according to claim 7. In claim 6, the reading effect data is associated with, for example, a range of values of the psychological information. Claim 7
Corresponds to another embodiment of claim 6, and determines the type and output level of mental image data from the relation graph between the psychological degree obtained by integrating the psychological information and the mental data to be output, and reads other different viewpoint screen data. Determined by the effect table.

In FIGS. 12 (a), 12 (b) and 12 (c), the horizontal axis represents the psychological degree Kt defined above, and the vertical axis represents the voice intensity, the vibration intensity, and the number of blinks, respectively.
Numerals 1 and 122 are graphs respectively showing the relationship between the voice intensity and the psychological level, the vibration intensity and the psychological level, and the number of blinks and the psychological level. As shown in the figure, the value of each parameter takes a value between 0 and the maximum value.

In step S13, the reading effect control means outputs the psychological information at time t to the temperature sensor, the humidity sensor,
Obtain from a heart rate monitor. The obtained value is stored in the psychological information field in the reading environment information. Subsequently, the process proceeds to S14, where the reading effect control unit calculates the psychological degree Kt defined above with reference to the value of the psychological information field. Next, the reading effect control means obtains the voice intensity, the vibration intensity, and the number of blinks that match the current psychological level from the relationship graph of FIG. Next, the reading effect control means, among the parameters of the reading environment information,
A reading effect table in which correspondences between parameters other than the parameters used for the output control of the mental image data and the reading effect data are referred to. Based on the method described in claim 6, the output method and the screen number of the different viewpoint screen data are determined and combined with the previously determined mental data to generate reading effect data. Although FIGS. 12A, 12B and 12C show only the sound intensity, the vibration intensity and the number of blinks, other parameters can be similarly graphed.

Next, an embodiment according to claim 8 will be described. FIG. 13 is a processing flow for explaining this. S11, S12, and S16 are the same as those described in FIG. S20 is a processing module that refers to the data of the field of the mental output identifier. The module that branches the processing depending on whether the referenced value is automatic or not is S21. If the value is automatic, the function of the page turning means is locked. This processing module is S22. After that, S13, S14, and S15 are executed (S23). When the output of the reading effect data is completed, the function of the page turning means locked above is unlocked (S2).
4). After that, it moves to S16.

If S21 is not automatic, the process branches depending on whether the value is an output of a motion proportional type with reference to the segmented data of the image identifier (S25). If it is not the exercise proportional type, it waits for the user to click the reading effect mark (S26). When the reading effect mark is clicked, the processing of S23 is executed.

If S25 is of the motion proportional type, tracking of the page turning motion (cursor moving operation) is started (S27). The momentum is calculated below (S28).

In FIG. 7, the equation defined above was used for the psychological degree Kt. In claim 8, the psychological degree Km is defined by the following equation. Km = βU (β is a proportionality constant, U is a momentum) U is, for example, a state in which FIG. 8 is displayed, the cursor is at the start point of the screen, and the cursor is drawn straight to the start point of the area to which the image data is associated. Assuming the case of moving with, it can be approximated by a value proportional to the distance r between both starting points. Therefore, for example, the psychological degree is represented by Km = γr (γ is a proportional constant), and the output level of the mental image output means can be determined by the amount of exercise by using the relationship diagram of FIG.

The above output is continued until the cursor reaches the reading effect mark (S29). After arriving at the reading effect mark, the output level at the time of arrival of the reading effect mark is continued while the cursor is at the reading mark, and output is continued until the cursor leaves the reading effect mark (S30). With the above, in the case of the movement of the user's arm or finger, for example,
Since the output level of the image output means can be increased, a more realistic reading effect can be obtained.

FIGS. 14A and 14B are diagrams for explaining the embodiment according to the ninth aspect, wherein each of the reading effect data when there are two reading effect marks on the display screen. 3 shows a timing chart of the output of FIG.
FIG. 14A shows an example in which the output of the reading effect data does not have a temporal overlap, and FIG. 14B shows an example in which the output of the reading effect data partially overlaps. Ts1 and Ts2 in FIGS. 14A and 14B are times determined in the time switching mode, and are expressed as (Te1-Ts
1) or (Te2-Ts2) is determined by the time set in the display mode. When the output of the reading effect data overlaps as in Ts2 to Te1 in FIG. 14B, the respective output levels are superimposed and an averaged value is output.

Claim 10 is self-evident because the output of each reading effect data can be set to 0 or the output time can be made infinite when generating reading effect data or reading psychological data information.

FIG. 15 is a diagram showing an example of a menu setting screen for supplementary explanation of claim 11. The menu setting screen is called by providing a new button or by simultaneously pressing two or more direction keys of a cursor key, for example. Each menu item is selected using the cursor keys. Hereinafter, application examples using the present invention will be described for each purpose. In addition, an independent selection button may be provided on the electronic book display device for the “purpose” of the selection item at the top of this screen.

[Embodiment 1] The present embodiment relates to a case where the present invention is used as an apparatus for speed reading. When creating book data for quick reading, how many areas in the book data do you want to easily convey the contents of the displayed book data in a short period of time, or to briefly represent the outline of the displayed contents? And take them out as one area. The display waiting time in the time switching mode is adjusted in consideration of the display order of the extracted areas, and the display time in the display mode is set to a time that the user can understand and read. Then, the area taken out for fast reading is sequentially displayed according to the set display waiting time and display time, thereby realizing the fast reading assist function. Various levels of speed reading devices can be realized by combining the display waiting time, the display time, and the area taken out for speed reading. Various levels of speed reading devices can be realized by combining the display waiting time, the display time, and the different viewpoint screen data.

[Embodiment 2] The present embodiment relates to a case where the present invention is used as a learning and quiz device. For example, a question (question) and a quiz page are displayed as book data. Set the time during which the question can be answered as the waiting time in the time switching mode. The answer page is displayed as different viewpoint screen data. This is shown in FIG.
It is. By switching the screen, it is possible to produce a thrill or a sense of tension due to the time limit.

[Embodiment 3] This embodiment relates to a case where the present invention is applied to a simple animation display device.
First, the area to which the different viewpoint screen data is added is set to be the same as the page size of the book data, and the reading effect mark is set to the entire screen. The different viewpoint screen data included in the book data of each page is all one screen. The display time 101 of the different viewpoint screen data determined in the display mode 48 is set to a value at which the displayed content can be read. Time post-processing field 1 of different viewpoint screen data determined in display mode 48
02, 0x01 is selected, and the value is set as the book data of the next page. By setting the same different viewpoint screen data for all pages, the pages are automatically turned over, and it is possible to function as a simple animation based on the principle of the comic. Further, an automatic page turning device can be realized by the same principle.

[Embodiment 4] The present embodiment relates to a case where the present invention is applied as a device for improving potential or as a mental health care. Before explaining how to implement this, some subliminals will be mentioned. The screens that we usually watch in movies and TVs are continuous images of about 30 frames per second. It is known that even if frames of shorter time are mixed in these images, they are not noticeable, but repeated viewing has a mental effect. The video mixed in this short time is called a subliminal video. In the present apparatus, for example, the waiting time in the time switching mode is set to be somewhat longer, and the time for displaying the different viewpoint screen data in the display mode is set to 3 times.
It is set to 0 ms or less so that the display after displaying the different viewpoint screen data returns to the original screen. Here, the effect of the subliminal by making the content of the different viewpoint screen data into a message such as "Your ability will be developed", "Passing the target school", "You are saved" will be linked to the improvement of potential ability Pull out.

[Fifth Embodiment] The present embodiment relates to a case where the present invention is applied as an emotional training device or a relaxation device. This can be realized by selecting different viewpoint screen data or mental data suitable for emotional education or relaxation. The effect is higher if the display time in the display mode is set to about 5 minutes or more for a relatively long time.

[Embodiment 6] This embodiment relates to a case where the present invention is always applied as a new book. To achieve this, the reading history information is used, and for example, each time the number of readings increases, the screen number of the different viewpoint screen data is incremented.

[Embodiment 7] This embodiment relates to a case where the present invention is applied to an automatic comic reading apparatus or a presentation apparatus, and corresponds to another embodiment of the embodiment 3. In addition to comics, the present invention can be applied to a book in which one page is divided into a plurality of areas (frames) and the reading order of the frames is determined. 17 (a), (b),
(C), (d) is a diagram for explaining this.

FIG. 17A shows a specific screen. The screen has three areas, area 1 (frame 1) and area 2
(Frame 2) and area 3 (frame 3) are read in the order of frame 1, frame 2 and frame 3. The next page is the fourth frame in area 1, the fifth frame in area 2 and the area This indicates that the screen of the sixth frame follows 3.

FIG. 17 (b) is a diagram showing the structure of book data. For the book data of page 1, n-screen (n is the number of screens) different-view screen data or image data is prepared for each area. The subsequent page 2 book data and thereafter have a structure in which only book data continues, and it is assumed that reading effect marks are attached to the entire area of each area.

FIG. 17C shows a timing chart of the display screen displayed on the display means. For example, at time p0, the book data of area 1, area 2, and area 3 of page 1 are displayed, and at time p1, p2, and p3, the screen data of area 1, area 2, and area 3 are switched to different viewpoint screen data, respectively. Furthermore, those different viewpoint screen data are p
4, p5 and p6 show a state where the screen is switched to another different viewpoint screen data.

FIG. 17D is a diagram showing the contents of the reading effect table. The horizontal axis stores the area number, and the vertical axis stores the number of times of screen switching in each area. The intersecting cell stores the screen number of the different viewpoint screen data for switching the screen (the page number and area number are the same as the page and area of the book data unless otherwise specified).

Next, the processing flow of the reading effect control means will be described. For the sake of simplicity, in this embodiment, processing relating to mental data is omitted, and the focus is on how the screen changes. I will explain.

First, the user uses the page turning means to display the book data of page 1. The reading effect control means recognizes that there are three reading effect marks on the screen displayed from the page 1 area 1 image data 1, the page 1 area 2 image data 1, and the page 1 area 3 image data 1. Next, the reading effect control unit reads the reading environment information and confirms that the target value of the reading environment information is the automatic manga reading.

Next, the reading effect control means refers to the reading effect table shown in FIG. 17D for automatic manga reading. As a result, the screen is switched for the first time, and since the reading effect mark is attached to the area 1, the different viewpoint screen data 1 is selected. Referring to the book data format described with reference to FIG. 4, a preparation is made to switch the screen to the different viewpoint screen data 1 (page 1 area 1) specified in the reading effect table (p1-p0) time after the value of the time switching mode. I do.

At the same time, the display mode information is referred to from the book data format described with reference to FIG. 4, and the display is continued for (p4-p1) hours from time p1, and (p4-p1)
Prepare to continue the display as it is after the lapse of time. Next, the reading effect control means synthesizes the image data obtained from the page area 1 image data 1 with the page 1 area 1 different viewpoint screen data 1. However, since the processing of the image data is omitted, the page 1 book data is omitted. Is switched to the area 1 different viewpoint screen data 1 at the timing specified by the display switching time, and the display for the time specified by the display time is continued (the display is continued as it is after the specified time). Do). Subsequently, the value of the buffer for managing the number of screen switching is incremented (the initial setting is 1, which is incremented to 2). The same processing is executed for the areas 2 and 3.

Next, the processing of the screen of the fourth frame displayed in the area 1 will be described. Therefore, page 1 area 1
The reading effect mark obtained from the image data 2 is the same area as the page 1 area 1 and the image data 1 (ie, the entire area of the frame 1 in FIG. 17A), and the time obtained from the page 1 area 1 and the different viewpoint screen data 1 Assuming that the values of the switching mode and the display mode are set to the same values as the book data, the screen of the area 1 is the page 1 area 1 the different viewpoint screen data 2 is p1
Switches after (p4-p1) hours from (p7-p
The time display of 4) is continued. By repeating the same processing for the other areas, an automatic manga reading device having an output as shown in FIG. 17C can be realized.

In FIG. 17B, the reason why the book data subsequent to page 2 book data follows the page 1 area 3 image data n in FIG. This is for reading as a book, and the screen data itself of the book data has a structure common to that of the different viewpoint screen data.

[Embodiment 8] This embodiment relates to a case where the present invention is used as a normal electronic book device, and can be realized by omitting all inputs and outputs for the reading effect.

[0099]

As is clear from the above, according to the present invention, multimedia information including different viewpoint screen data, voice / sound data, and vibration data can be output as the reading effect data, so that the atmosphere and the sense of presence can be obtained. To improve the reading effect.

Further, since the electronic book display device of the present invention has the reading management means for grasping the mental state of the user, it is possible to output more enhanced reading effect according to the mental state of the user. Became.

Further, the electronic book display device of the present invention can automatically select optimal different viewpoint screen data and mental image data according to the purpose, personality, mental state, and reading history of the reader based on the reading management information. As a result, the burden of creating reading effect data can be greatly reduced.

Further, since the electronic book display device of the present invention has a function of grasping reading environment information such as a user's reading history, the content of book data to be output is changed according to the number of readings using this information. It is possible to support reading with freshness.

Further, the electronic book display device of the present invention has a function of controlling the reading speed according to the reading environment information of the user and the contents of the book. Can now be provided.

Further, the electronic book display device of the present invention, by selecting display switching time, reading display mode information, and different-view screen data, can display subliminal video, audio, and sound that are displayed for a shorter time than book data. You can mix information to improve your reading effectiveness and draw out your potential,
Functions to improve psychological therapy, educational effects, etc. can now be provided.

Further, in the electronic book display device of the present invention, the book data of the same page can be changed depending on the date and time based on the reading environment information, so that the user's understanding of reading can be promoted. It became so.

In the electronic book display device of the present invention, the output level of the vibration and audio data associated with the book data can be variously changed by the display mode information.
For example, the output level can be gradually changed, such as fade-in and ford-out, to emphasize the reading effect.

Further, the electronic book display device of the present invention can change the output of the mental image data depending on the amount of exercise of the page turning operation, and can further enhance the sense of reality and the reading effect.

Further, the electronic book display device of the present invention has an output control function in the case where vibration and voice data associated with a plurality of book data exist in the same display page or the same window. It is now possible to merge data to produce output that enhances the reading effect.

In summary, according to the present invention, there is provided a means for grasping and managing reading environment information such as a user's mental state and reading state, and displaying book data associated with reading effect data on the display means. In this case, it is possible to easily output multimedia reading effect data adapted to the reading environment information of the user, and realize an electronic book display device that promotes not only the reading effect but also the psychological and educational effects.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a structure of one embodiment of an electronic book display device of the present invention.

FIG. 2 is a diagram showing an appearance of an electronic book display device which is a typical embodiment of the present invention.

FIGS. 3A and 3B are diagrams schematically showing the format of book data recorded in a recording unit. FIGS.

FIG. 4 is a diagram showing an example of a data format for one page of book data.

FIG. 5 is a diagram showing an example of a format structure of mental data output according to the contents of book data among book data recorded on a recording medium.

FIG. 6 is a diagram showing an example of a data structure of reading environment information managed by environment management means.

FIG. 7 is a diagram showing an example of a processing flow of a reading effect control unit of the present invention.

FIG. 8 is a diagram illustrating a display example of a specific page displayed on a display unit.

FIG. 9 is a diagram for explaining an embodiment of a time switching mode for determining the output timing of the reading effect data in S15 according to claim 4;

FIG. 10 is a diagram illustrating an example of a data structure in a display mode.

FIG. 11 is a diagram illustrating an example of a reading effect table for associating reading environment information with reading effect data to be output.

FIGS. 12A, 12B and 12C are diagrams for explaining an embodiment according to claim 7; FIGS.

FIG. 13 is a processing flow for explaining an embodiment according to claim 8;

14 (a) and 14 (b) are diagrams for explaining an embodiment according to claim 9, wherein each reading effect is obtained when there are two reading effect marks on the display screen. 5 shows a timing chart of data output.

FIG. 15 is a diagram showing an example of a menu setting screen for supplementary explanation of claim 11;

FIG. 16 is a diagram of an embodiment when the present invention is used as a learning and quiz device.

FIGS. 17 (a), (b), (c) and (d) are views for explaining an embodiment in which the present invention is used as an automatic manga reading device and a presentation device.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Recording means 2 Display means 3 Page turning means 4 Environmental management means 5 Second recording means 6 Image output means 7 Reading effect control means

Claims (12)

[Claims] 1. An electronic book display device comprising: a recording unit for recording book data; a display unit for displaying the recorded book data; and a page turning unit for turning a page of the book data displayed on the display unit. Environment management means for managing reading environment information of a user, and second recording for recording different viewpoint screen data expressing book data of a displayed page from another viewpoint or mental data for enhancing an image of different viewpoint screen data. An electronic book display device comprising: means, image output means for outputting image data, and reading effect control means for outputting reading effect data generated using the different viewpoint screen data and the image data. 2. The reading effect control means outputs the reading effect data by referring to the reading environment information of the user stored in the environment management means before outputting the reading effect data to the display means or the image output means. The electronic book display device according to claim 1, wherein the electronic book display device is controlled. 3. The reading effect control unit outputs the reading effect data after all or a part of the book data area associated with the image data is displayed on the display unit. Or the electronic book display device according to claim 2. 4. The reading effect control means according to claim 1, wherein said reading effect control means outputs the reading effect data after a time designated in the time switching mode in the book data. Electronic book display device according to the above. 5. The reading effect control means controls an output time or an output method of reading effect data by using a display mode value which is divided into regions according to contents or formats and set for each region in book data. The electronic book display device according to claim 1, wherein: 6. The reading effect control means includes: user information;
The reading effect data is output using a reading effect table or a relation graph that associates reading environment information to be output with reading environment information composed of psychological information or reading information. 5. The electronic book display device according to 5. 7. The reading effect control means according to claim 1, wherein the output level of the mental image data is changed from 0 to a maximum value in proportion to the integrated psychological value of the environmental information of the user's psychological state. The electronic book display device according to claim 6. 8. The electronic book display device according to claim 1, wherein said reading effect control means outputs image data proportional to the amount of exercise related to a page turning operation. 9. The reading effect control means, when a plurality of book data areas associated with the image data are present on the same display page, superimposes and outputs the reading effect data corresponding to each image data. 9. The electronic book display device according to claim 1, wherein: 10. The electronic book display device according to claim 1, wherein the reading effect control means can stop output of part or all of the reading effect data. 11. The electronic book display device according to claim 1, wherein a user can change a control method of the reading effect control means. 12. A recording function for recording book data on a computer, a display function for displaying the recorded book data, a page turning function for turning pages of the book data displayed on the display means, and a reading environment for the user. An environment management function for managing information, a second recording function for recording different viewpoint screen data or mental data, a mental output function for outputting mental data, and a display by combining different viewpoint screen data and mental data. And a computer-readable recording medium storing a program for realizing a function of generating and outputting reading effect data for enhancing reading effect of book data.