JP2003304486A - Memory system and service vending method using the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To realize a wearable apparatus for helping the memory and the recall of a human being. <P>SOLUTION: An information collector 3 including cameras, microphones, etc., always takes in information, even while a user is unconscious; a recognition dictionary 6 recognizes the contents or change of the information and sets a degree of importance on input information, utilizing its recognition result; and a record controller 12 stores the input information combined with its degree of importance and an input time in an information recorder 13 in a recording system conformed with its degree of importance. In recalling, a read-display controller 16 reads and displays stored information to support the recall of a human being. A record information controller 18 periodically evaluates the degree of importance of the information according to the number of display times of the stored information, changes the recording system of the related information according to the change of the importance degree and deletes long stored information of less degree of importance to ensure a capacity of the information recorder 13. It reduces the quantity of information taken in from less changing information. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a storage system for assisting human memory and a service sales method using the system, and more particularly to a storage system using a magnetic disk device having both storage and recall functions. The present invention relates to a method of selling an information processing service using the system.

[0002]

2. Description of the Related Art Cameras, tape recorders, projectors, video recorders, voice recorders, and personal computers (PCs) as systems for recording and reproducing various documents have been conventionally used as devices for assisting human memory. Terminals (PDAs, etc.) have been used. These devices can reproduce the information obtained at the beginning as it is by recording what the user sees or hears in a recording medium and reproducing it when necessary. All of these devices are "recorded" with the user's awareness.
Recording is started by performing the operation for.

According to Michael I. Posner, human memory is "episode memory," which is memory of events localized by the context of past scenes, and "semantic memory", which is general knowledge of events and vocabulary. , Shows that there are various hierarchies of memory, such as "short-term memory," which is a reminder of what actually happens on a daily basis (Michael I. Posner, Foundat
ions of Congnitive Science, 1989). And, whether or not the person is conscious, in most cases, the sight seen and the sound heard by the ear are memorized in the brain of the person in the short term or in the long term. It is not clear yet in the fields of cognitive science and cerebral physiology what kind of processing is performed on the stored contents to classify them. However, it is known that there are slightly different processes and memory locations for each memory.

In order to assist the human memory operation with a machine, a wearable (wearable) device having an audiovisual function and a memory function is indispensable. Prior art related to this "assistance of human memory ability" is considered below.

First, as an example of a wearable device, there is a technique disclosed in USP 5,305,244. This prior art discloses a wearable device including a computer body that can be worn on the waist and a small display that is worn on the head, assuming that a worker works while viewing an electronic manual. The main purpose of this example is hands-free (use of no hands), and it is described that the input is by voice. Therefore, in this example, it is more of a device for improving work efficiency rather than "assisting human memory."

Secondly, when performing some processing on input data from a sensor such as a camera or a microphone from the outside, it is necessary to recognize the content of the input data and convert it into a processable format. For example, Japanese Patent Laid-Open No. 2001-92838 discloses a method of recognizing human conversation voice input from a microphone and creating a database, and a method of matching a voice pattern with a pattern registered in advance.
No. 00-236494, respectively. Also,
A method of cutting out an image captured by a camera or the like, recognizing characters, symbol information, shape, etc., and matching with a predetermined pattern is disclosed in Japanese Patent Laid-Open No. Hei 7-32218.
4, JP-A 2000-152145 and the like.
Further, there is a method of recognizing and indexing an image pattern different from a steady state such as a dynamic pattern occurring in a still image, which is disclosed in Japanese Patent Laid-Open No. 10-845.
25. In addition, JP-A-2001-92838
Shows a device that temporarily stores the collected multimedia information in a storage device, retrieves it when necessary, performs character recognition, voice recognition, face recognition, speaker recognition, and performs operations such as individual identification. .

Thirdly, looking at the form of the "memory" operation itself, as described above, the conventional recording, recording, and data recording devices only "record" the input data itself. Then, considering the recognition result to some extent, the above-mentioned recognition result is evolved into one that is recorded on a recording medium in association with the input data.
The shape is as shown in 45. By utilizing this method, desired information may be easily accessible even when there is a large amount of input data. However, as the amount of data increases, so does the search keyword,
It is assumed that access will take longer.

Fourth, let us look at the process of recalling stored information. In recalling by the human brain, desired information is extracted from some clue information such as date and time, place, name of conversation partner, keyword of conversation, and sight that caught the eye. And the memory of the information recalled many times becomes stronger, and the speed of recall becomes faster. It can be said that this is because the storage state of information changes according to the number of times of recall-information reproduction. Similar processing is performed by Windows, which is an operation system (OS) of a personal computer (PC). In other words, a reproduction status monitoring program called a task monitor is run to monitor the reproduction of data, rank the number of times of reproduction, and for application programs with a large number of times, relocation of information on the magnetic disk is handled. Has become.

[0009]

As discussed above, the external situation is detected and captured in the form of video or audio, and some recognition processing is added to the external situation, and the recognition processing information is stored in the storage device and necessary. Sometimes, it is possible to search and reproduce the recognition processing information by combining individual functions. However, this alone is far from being a "helper of human memory." The issues are listed below.

First, there is a problem of unconsciousness when taking in external information. If it is a device such as a video camera that is supposed to record consciously, it can surely capture the necessary information. However, as mentioned above, as you can see from the fact that the human brain also temporarily holds unconscious memory, it can be said that what we want to remember is unconscious information that we unconsciously remember. And the unconscious information is the target that can fully demonstrate the ability of "assisting human memory ability".
In order to capture unconscious information, the information capture sensor and the storage device must be in operation at all times. And
To always record information requires preparing a storage device with an enormous storage capacity or some other measure. Here, the above-mentioned conventional example USP 5,30
While it may be convenient for the hands-free wearable device disclosed in US Pat. No. 5,244, to be worn at all times to assist human abilities, in accordance with the gist of the present invention, if it is not always in operation, then has no meaning. Furthermore, it may be difficult for the human brain's processing power to remember another thing while remembering something, but as a device that assists in memory, it remembers previous events. I want to continue the current memory processing without interruption during the process.

Regarding recognition, when a language for recognition is prepared for a recognition target such as a voice pattern for a voice and a specific shape pattern for an image as in the conventional example, A dictionary for each recognition target is required. This means that when searching for information, the user has to narrow down the search target in advance such as "sound search" or "shape search". This is inconvenient when it is desired to bring out the memory of some event regardless of the type of stored information, and a common language that enables collective management of various sensor information is desired.

Further, it relates to the handling of the recognition information for the input data. Although it has been described that it is convenient to perform recognition processing on input data and add recognition information to it when searching and reproducing it later, if the amount of information itself becomes enormous, it will be enormous even for recognition information alone. Becomes The problems that arise here are that it takes time to search, and the search results may become huge in some cases, making it difficult to retrieve the desired information.

Finally, it relates to protection and security of information. When analog or digital recording is performed on various memory media, basically, data to be recorded is sequentially recorded from an empty portion of the memory medium regardless of the contents. Some of the recorded information is very important and, conversely, it is not important at all, and since such information is recorded evenly under prescribed conditions, it is possible to prevent problems such as security and data destruction. There is an equal risk.

The present invention has been made in view of the above points, and is provided with a sensor, a memory, and a display device as a device for assisting human memory, and information is always displayed even if the user is unconscious. Captured, captured information is stored (stored) after recognition processing of video, audio, etc., and can be easily searched and played back (remembered) when necessary, and it does not put pressure on the storage device capacity, and is important. An object of the present invention is to provide a storage system in which data protection is perfect and a method of selling services related to the storage system.

[0015]

According to the present invention, there is provided a magnetic disk device, a sensor section including at least a camera for collecting image information and a microphone for collecting sound information, and input information input from the sensor section. Unitizing means that divides each into a unit by dividing it by a predetermined time length for each information correspondence, and detects and detects an event corresponding to that state or state change for each of the unit information divided by this unitizing means Event detection means for outputting a text sentence indicating the content of the event, and video / sound recognition means for performing recognition processing for each unit information of the video information and sound information from the camera and the microphone and outputting the recognition result as a text sentence. And a text sentence output from the event detecting means and the video / sound recognizing means and the event detecting means. Importance setting means for setting the importance to the unit information in accordance with the generated event, importance set by the importance setting means, event information indicating the presence or absence of an event detected by the event detecting means, and A synthesizing unit for generating a record information unit by adding a header including a recording time indicating the time when the unit information is input from the sensor unit, and a record information unit generated by this synthesizing unit in the header. A recording control means for storing the magnetic disk device in a recording method according to the degree of importance included therein, and a read / display control means for reading the record information stored in the magnetic disk device and displaying it on the display means are provided. A storage system is disclosed.

Further, the present invention is, in the above-mentioned storage system, a recording control information table in which a header of a recording information unit stored in the magnetic disk device is stored as recording control information, and the reading / display control section means reads it. A counter that counts the number of times that the information is displayed and displayed for each recording information unit, a timer, and an elapsed time from the recording time for each recording information unit that is activated by an interrupt from this timer and is stored in the magnetic disk device. And the importance of the counter is re-evaluated from the display count of the counter, and the importance of the recording control information table is rewritten for the recording information unit whose importance is changed by this re-evaluation and the recording control means is controlled to Re-evaluation means for recording the recorded information unit with a recording method that corresponds to the importance after change It is activated by an interrupt from the timer and checks the free space of the magnetic disk device. When the free space becomes a predetermined value or less, the importance of the recording information unit is minimum and the elapsed time from the recording time is long. A storage system is provided, in which the recording and erasing means erases data from the magnetic disk device until the free space becomes equal to or more than the predetermined value, in order from the first one.

Further, in the above storage system according to the present invention, a timer and an interrupt from the timer are activated, and the event detecting means activates the information stored in the magnetic disk device within a predetermined time up to that point. An input information control means is provided for determining whether or not an event has been detected, and for information for which an event has not been detected within the predetermined time, controlling so as to reduce the amount of input information from the sensor unit. A storage system characterized by the above is disclosed.

Further, in the above storage system according to the present invention, the importance level setting means has an importance level table in which a keyword and its importance degree are stored as a pair, and the event detecting means or the video / sound recognizing means. A storage system characterized in that, when the text sentence output from the device includes a keyword in the importance table, the importance corresponding to the keyword is set in the unit information.

Further, according to the present invention, in the above storage system, the recording control unit stores a recording information unit whose importance is higher than a first predetermined value in a magnetic disk device by a multiplex recording method, and stores it from a second predetermined value. Disclosed is a storage system characterized in that a recording information unit having a low storage capacity is stored in a magnetic disk device with a reduced amount of information.

Further, in the above storage system according to the present invention, a GPS sensor is provided in the sensor section and a memory for storing map information or means for reading map information from the outside is provided, and the read / display control means is provided for the GPS.
Disclosed is a storage system having a function of dropping position information acquired by a sensor on a map and displaying a moving route on a display unit.

Further, according to the present invention, in the above storage system, a Bluetooth sensor is provided in the sensor section, and display information displayed on the Bluetooth device when the device is capable of communicating with the Bluetooth device having the Bluetooth function is input by the Bluetooth function. Disclosed is a storage system characterized in that it can be directly fetched as information.

Further, the present invention discloses the above storage system, wherein the magnetic disk device comprises a plurality of RAID-configured magnetic disk devices.

Further, according to the present invention, in the above storage system, a host device including the unitizing means, the event detecting means, and the video / sound recognizing means, and 1 or a case housed separately from the host apparatus. Disclosed is a storage system characterized by being divided into a plurality of external units.

Further, according to the present invention, the information stored in the storage system is accumulated or edited at the request of the user of the storage system via a network, and an advertisement from an advertising agency is sent to the user via the network. Disclosed is a method of selling a service, which is sent and displayed on a display unit, and the advertisement fee is received as a consideration for storing or editing the information.

The present invention further relates to the sale of the information stored in the above storage system to a third party via a network.
A method of selling a service is disclosed, which is performed by a request of a user of the storage system via a network and receives a part of the purchase price paid by the third party as a consideration for the sales service agency.

[0026]

BEST MODE FOR CARRYING OUT THE INVENTION The storage system of the present invention is constructed based on the following concept. The memory processing of the human brain is said to proceed as follows. External information taken from the eyes and ears is temporarily stored in a defined place with the brain. The operation is performed consciously or unconsciously. And, of course, not only the information that you want to remember consciously but also the information that is found to be necessary after a certain amount of time has been taken in is re-stored in a deeper place as more important information. Further, even if the content is temporarily stored, information that is determined to be unnecessary thereafter is discarded.

Since the memory capacity of the human brain cannot be said to be infinite, it can be seen that the unnecessary capacity is secured by discarding unnecessary information while ranking the importance as described above. Similarly, in the case of causing the machine to perform a memory operation, after the recognition processing is performed on the input information, the importance ranking processing is performed using some means, and the information judged to be unnecessary is thinned out, It suffices to extract only the characteristic information and discard unnecessary portions. It should be noted here that the purpose is "to assist human memory", so information should not be discarded as much as human brain memory processing. As much as possible, the machine must remember what the user wants to remember without discarding it.

FIG. 1 is a functional block diagram showing a configuration example of a storage process and a recall process of a storage system of the present invention for realizing the above concept. First, in the storage process 1, when a recording command 4 is given to the information collecting unit 3 including a sensor (camera, microphone, thermometer, etc.) for collecting external information, a series of storage operations are started. .
Normally, the storage device of the present invention is always in a storage state, so the recording command 4 is always transmitted during use. The input information A from the information collecting unit 3 is sent to the synthesizing unit 5 as it is, and is recognized by the recognizing unit 6 including the sound / voice recognizing unit 7, the shape / color recognizing unit 8 and the event recognizing unit 9, respectively. The results of these recognition processes are all output as text information a. Of these, in the sound / speech recognition unit 7,
In addition to voice recognition of human conversation and text conversion, it also converts various sounds and music into text. The shape / color recognition unit 8 extracts one still image from the input image information at regular time intervals, for example, every 1/4 second, recognizes the shape, face, and color of each still image, and names the still image. Output as text. These recognition processes are performed using the recognition dictionary 10 built in advance. The event recognition unit 9 detects changes in the states of all the input information A. Further, the recognizing unit 6 sets the importance R of all the input information that has been input, by referring to the importance table 11 when necessary, and according to the result of the event recognizing unit 9 when necessary. The synthesizing unit 5 generates a recorded information unit in which the raw text of the input information is added with the text sentence a of the recognition result, the set importance R, and the information e indicating whether the event is an event as a header. The recording control unit 12
The recording information unit generated by the synthesizing unit 5 is stored in the information recording unit 13 by the recording method according to its importance, and the information of the header portion is stored in the recording control information table 14 as the recording control information. As for the recording method for the information recording unit 13, those having a high degree of importance perform multiplex recording, and those having a low degree of importance record the raw information by significantly compressing it, which will be described in detail later.

Next, in the recall process 2, when the reproduction command 15 is issued by the user's intention, the reproduction information is read from the information recording unit 13 by the control of the read / display control unit 16 and the reproduction information display unit is displayed. It is displayed at 17 and supports the memory recall of the user. The recording information management unit 18 counts the number of times of reproduction / display of each of the information units stored in the information recording unit 13 and receives a periodic interrupt from the timer 19 to receive the number of times of reproduction / display and the recording control. Based on the contents of the information table 14, instructions for changing the importance of the information unit, changing the recording method, erasing, etc. are issued to the recording control unit 12 to manage the recorded information. In this case, it is desirable to manage the information recording unit 13 in consideration of the size of the empty space.

The hardware configuration and detailed operation for realizing the functional blocks shown in FIG. 1 will be described below. Figure 2
2 is a block diagram showing a hardware configuration example of the storage system of FIG.
1, a sensor unit 203, a display device 204, and an operating device 2
05 and a magnetic disk device 202 removable via the slot 206.

The host device 201 is a host CPU 210.
, Bus controller 211, RAM 212, ROM
213 and the HD interface 2 between the magnetic disc device
14, an input interface 215 that takes in information of the sensor unit and the operating device, and an output interface 216 that includes a graphics controller that performs display control. In addition to this, there may be an input / output device that includes a network controller that exchanges information with other information processing devices and that reads and records the information. The host CPU 210 executes an instruction according to a preset program. Bus controller 211
Is a host CPU 210, a RAM 212, a ROM 21
3. Control data transfer between the HD interface 214. The HD interface 214 is an interface with an external storage device (in this example, the magnetic disk device 202) side and R
Controls data transfer to and from the AM 212.

On the other hand, the magnetic disk device 202, as shown in FIG. 3, has an interface 301, a disk controller 302, a disk CPU 303, and a RAM 3.
04, the signal processing unit 305, and the servo controller 30.
6 and HDA (head disk acceleration) 307
It consists of The disk CPU 303 controls data processing of the entire magnetic disk device 202. The disk controller 302 is an interface 301 and RA
Between M304, signal processing unit 305 and RAM 30
Controls data transfer to and from. The HDA unit 307
A magnetic recording medium that stores data, a spindle motor that rotationally drives the recording medium, a magnetic head for recording / reproducing, an actuator that supports the magnetic head, and the like. The servo controller 306 controls the spindle motor and the voice coil motor.

FIG. 4 is a perspective view showing the hardware configuration of the magnetic disk device 202. This magnetic disk device has a structure that can be attached to and detached from a host device, and includes a magnetic disk 401, a magnetic head 402 in which a recording / reproducing head is integrated, a spindle 403 that is a means for fixing and rotating the magnetic disk 401, and a magnetic disk. Head 402
An actuator 404 that is a means for moving the disk in the radial direction on the magnetic disk 401, a base 405 and a cover 406 for mounting them, recording / reproducing information, moving a head through the actuator, rotating a spindle motor, and externally. CP for inputting / outputting data from / to
It is composed of a circuit 407 including U303 and the like, and a connector 408 serving as an entrance and exit of data to and from the outside. Since this device can be carried and used, the diameter of the magnetic disk is preferably 2.5 inches or less, more preferably 1.0.
Inches or less is good.

FIG. 5A shows a name tag type camera / microphone device which is one form of the sensor unit 203 of FIG. This sensor is designed as a name tag that can be worn in the office without any discomfort, assuming that the storage system is used in the office. Other variations are desirable, such as armband-type, hat-type, and pendant-type, which are normally worn by humans and do not feel uncomfortable. Sensor body 501
Is an LED 502 indicating that it is in an operating state,
It is composed of a camera 503, a microphone 504, a name tag display unit 505, and the like. Although omitted in FIG. 5 (a),
The sensor unit may be provided with sensors such as temperature / humidity, illuminance, and pressure.

The sensor unit 203 also has an operation function, the name tag display unit 505 is constituted by a pressure sensitive panel, and the command button display 506 and the like are arranged by software. A stylus pen 507 or the like stored in the sensor body 501 can be touched to input a command. Further hardware-like command button 508
There may be. These command buttons 506, 50
Reference numeral 8 is used when starting / stopping recording, or when the user manually inputs new importance information. Also in FIG.
As shown in (b), a simple scheduler can be input and displayed. Further, this name tag type sensor may have a function for electronic settlement and entrance / exit management. Although the power switch is not shown,
For example, the power may be turned on when the name tag is attached to the chest of the user. Sensor unit 50 exemplified above
1, the display device 204 and the operation device 205 are connected to the host device 201 of FIG. 2 by using a cable and a connector. Although not shown, a battery for driving the storage system of FIG. 2 or a generator is used as a host device 201, a sensor unit 203, and a display device 20.
It shall be mounted on any or all of No. 4. In the following description, this power supply is omitted, but it is the same.

The operation of the storage system having the above configuration will be described in detail below. FIG. 6 is a flowchart showing the processing contents in the storage device shown in FIG. 1, and the procedure is stored as a program in the ROM 213 of the host device 201 and executed by the host CPU 210. First, when the user instructs recording by operating the sensor 501, the recording command 4 is input via the input interface 215, and the storage operation starts. Then, the information such as the sound / voice and the image from the sensor unit 203 is digitized and taken in by the input interface 215 (step 601), and the information is unitized for all the input information such as the sound / voice and the image information. The recognition process is performed as follows (steps 602-604).

First, at step 602, various input information that has been input is divided into units by dividing into appropriate time widths in order to make a recording unit. Sound / voice information is, for example, 1
Sound units are divided by the time every 0 seconds. The image information is divided into, for example, every second to form an image unit. If there is temperature data, the temperature units are divided, for example, every 1 minute. Specifically, these unitization processes generate a trigger for each time width separated from the system clock,
That is, the trigger is given to the recognition unit 6 and the synthesis unit 5.

In the next recognition process (step 603), a sound
A recognition process is performed on information such as voice and images. For this purpose, the recognition dictionary 10 is stored in the ROM 213, and data necessary for the recognition process is prepared. That is, for voice, data of voice patterns and feature quantities corresponding to the recognition processing method is prepared. With these, the conventional known technique can be used to perform the processing in real time, and the text a is generated. The same applies to sounds other than voice. A chime sound indicating time, door opening / closing sound, and other things that the user should pay particular attention to are prepared as "words." In the case of these sounds / voices, each sound unit is processed and converted into text. To be done. For images, that is, shape / color recognition, the faces of members of the work group, images of characteristic objects in the conference room that are often used, etc. are prepared in advance as “words” of the image pattern. Give it a name (text). Then, one still image is taken out for each image unit, image recognition processing is performed by a conventional technique such as comparison with the "word" of the image, and if there is a pattern that is considered to match, this name is applied. The text output a corresponds to the image unit. For a unit that cannot be recognized for both sound and image, a character string indicating that is output as text a, for example, "NONE" is output.

Next event recognition process (step 604)
Detects a large change in the state of input information as an event, and such an event is often useful for remembering. Therefore, for sound / voice, a threshold is set for the sound pressure level from the microphone, and when there is an input exceeding this threshold level in one sound unit, there is an event in that sound unit (e = 1, e: event information), otherwise, no event (e = 0) is set. For image information, a threshold for pixel value is set,
Pixel values at one or more pixel positions on the screen are compared between two screens in the image unit, for example between the first and last screens in the image unit, and when this exceeds the threshold value, an event is sent to the image unit. Yes (e = 1), otherwise no event (e = 0) is set. If there is other input information, such as temperature data, the change amount of the data in the temperature unit is obtained as the difference between the first and last values of the unit,
The presence or absence of an event is set by comparing it with a preset threshold value. For events, the presence or absence (e = 0
Or not only 1), but multi-steps according to the degree of information change,
For example, no change (e = 0), moderate change (e = 1),
You may make it detect like a big change (e = 2).

In the event recognition process, for example, some thresholds are set for temperature data, and the thresholds are compared with the average temperature in the temperature unit to display the text a such as "high", "normal", "low". Try to add it to the unit. Further, for example, the sensor / operation unit 50 as shown in FIG.
1 is provided with a button for inputting text such as "meeting", "deskwork", "email check", etc. By operating this button by the user, "meeting""deskwork"
The text such as "mail check" can be added to the input image unit.

When the recognition process and the event detection are completed, next, the importance for recording management of information is set in each unit of the input information (step 605). The event information and the importance table 11 are used to set the importance. This importance table is used for terms that users often use in their own work, names and abbreviations of names and places (meeting rooms, etc.) of people who often hold meetings, names of patterns used for shape / color recognition, high and low temperatures, etc. This table 11 is a table created by giving higher importance to the character strings (keywords) of
3 is stored. Then, the recognition process (step 603)
Or a text a generated by event recognition is compared with a keyword in the importance table, and if the text a contains a keyword registered in the importance table, the importance R set for the keyword is used as the information. The importance of the unit. However, when the character string registered in the importance table is not found in the text a, the importance of the unit is set to a small value, for example, the minimum importance.

On the other hand, the importance setting using the event information e is performed for all input information, and is large when e = 1, for example, the maximum importance is small and when e = 0 is small. , For example, set the minimum importance. As a result, two importance levels are set for the sound unit and the image unit, one using the importance table and the other using the event information. Ultimately, the larger one is selected and the importance level of the unit is selected. And In addition to this, if the user is, for example, FIG.
When the command button 508 is operated, a large importance level or a low importance level may be set as the highest priority for all input information at that time.

When the importance is set, the recording information unit is then generated (step 606). This is a function of the synthesizing unit 5 in FIG. 1 and synthesizes each unitized input information itself (raw information) and the recording control information obtained by each process. The recording control information is the text a, the importance R, and the event information e obtained by the recognition processing, and the time when the information unit is input. Here, regarding the image unit, the moving image information itself during the unit acquisition period may be used as raw information, or one still image information used in the recognition processing may be used as raw information. When the latter raw information is used, the amount of information recorded can be greatly reduced.

When the recording information unit is generated, the recording control information is stored in the recording control information table 14 and the recording information unit is stored in the information recording unit 13.
Done by That is, the recording control unit 12 first adds an ID to each generated recording information unit, and stores the ID and the recording control information added to the recording information unit in the recording control information table 14 (step 607).
Further, the importance of the recording information unit is determined, and the recording information unit is stored in the information recording unit 13 by the recording method according to the importance (steps 608 to 611). If the operation of stopping the storage operation is not performed (No in step 612), step 601 and subsequent steps are repeated. The recording control information table 14 may be created on the ROM 213 in FIG. 2 or may be created in the management area on the magnetic disk. This table is used to manage the record information, and its specific method will be described later. On the other hand, the recording method according to the degree of importance will be described below. Here, the degree of importance given to the recording information unit is “non-important” (R = 0), “normal” (R = 1), important (R = It will be described as three steps of 2).

For recording, the importance of the recorded information unit is first checked (step 608) and it is "non-important" (R =
When it is 0), thinning-out recording of raw information of the recording information unit is performed (step 609). This thinning-out recording is particularly effective in the case of image information, for example, R, G, B,
Only the I plane of the I plane is recorded. Alternatively, when the raw information is a moving image, frames in the unit are thinned out. Information other than images does not need to be processed because the raw information itself has a small amount of information. If the importance R = 0, the recorded information unit itself may be discarded. When the importance of the record information unit is "normal" (R = 1), the raw information of the record information unit is recorded as it is (step 610). The importance is "important"
When (R = 2), protection such as multiple recording of the recording information unit is performed at a plurality of locations in the information recording unit 13.

Here, a specific example of the protected recording method will be described in detail. FIG. 7 shows an example of multiplex recording, in which the same information is synchronously recorded on three adjacent tracks on the magnetic disk. In order to perform such recording, first, clocks synchronized with the three tracks are recorded. That is, the clock pattern 7 is recorded by the recording head 701 on one track #N by the first-stage processing S1 in FIG.
Write 03 (“111 …… 1” pattern). Next, as in the second processing S2 in FIG.
About half of p, the position shifts to the next track # N + 1, and while the read head 702 reads the clock pattern 703 previously written, the clock pattern at this position is written first in synchronization with the read signal. Write the clock pattern so that it matches When this clock write with a shift of Tp / 2 is repeated four times, three tracks #N and #N are obtained as in step S3 of FIG.
A clock pattern synchronized with +1 and # N + 2 is written. After doing this, tracks #N, # N + 1,
Write the same data to # N + 2. At the time of this data write, the reproducing head 702 reads the clock pattern, and controls so that the data is written instead of the clock in synchronization with the clock pattern. This allows the same data to be stored in three adjacent tracks in a completely synchronized state.

When such multiple recording is performed, the operation resistance against vibration is improved. That is, track #N of FIG. 7 now
It is assumed that there is a reproducing head 702 at +1 and information is read. At this time, when a mechanical shock is applied from the outside of the storage system, the reproducing head 702 vibrates in the direction of the adjacent track while moving so as to follow the track # N + 1 by the servo system. When this vibration becomes large, the reproducing head 702 will read the data of the adjacent tracks #N and # N + 2 instead of the information of the track # N + 1. For this reason, if different data is recorded for each track as usual, the read operation will be erroneous. The allowable limit of head vibration that causes the error is the track pitch Tp.
The range is a little wider than Rdth1. However, when multiple recording is performed as shown in Fig. 7, the permissible limit of head vibration is around the range Rdth2 in the figure, and even if the head moves within this range, information will not be interrupted or overlapped along the time axis. Will be played correctly.

FIG. 8 shows an example of protected recording in which nothing is recorded on both tracks adjacent to the track #N on which important information is recorded, though not multiplex recording. According to such a recording method, even if the reproducing head 802 fluctuates due to external vibration like the locus 801, the adjacent tracks # N + 1 and # N− are changed.
Since the data of No. 1 is not read, the probability that the data can be reproduced becomes high from the viewpoint of S / N, which is useful as a protection recording method. Also in this case, recording is allocated for three tracks.

FIG. 9 is an explanatory view of another multiplex recording method, in which the same data is recorded on two tracks separated in the radial direction of the magnetic disk. That is, if the radius of the re-outer peripheral track of the recording disk 901 is r,
When certain recording data 902 is recorded at the position of radius r1, the same data 902 is also recorded at the position of radius r2.
The relationship between the radii is 2 for w that is sufficiently smaller than the radius r.
The two recording positions are separated by w or more. For example

[Equation 1] When

[Equation 2] If r2 is determined so that, and (Equation 1) does not hold,
I.e.

[Equation 3] When

[Equation 4] R2 is determined so as to satisfy. If you decide r2 like this,

[Equation 5] Holds, and the two tracks do not come closer than w. Here, w has a value sufficiently smaller than r, but has a value at least larger than the width dimension of the magnetic head slider on which the magnetic head is mounted. If the disk is damaged, the data at the same radial position is likely to be destroyed at once, so multiple recording of data is performed at the positions of two track radii r1 and r2 that satisfy (Equation 5) as described above. If so, one of the data is likely to remain when the disc is damaged, and the data is protected.

Next, the recall process will be described. FIG. 10 is a flowchart showing this processing, and this procedure is also stored as a program in the ROM 213 of the host device 201 and is executed by the host CPU 210. First, when the user instructs reproduction by operating the operation unit 205, the reproduction command 15 is input via the input interface 215, and the reproduction operation is started. Then, first, a guide screen is displayed on the display device 204 (step 100).
1). FIG. 11 shows a display example of this guide screen, in which the horizontal axis shows the daily division of the week and the vertical axis shows the time of the day. On each day, the keyword column 1101 and the event column 11 are shown.
02 is displayed. In the keyword column 1101, the text a generated by the recognition process for each information, which matches the keyword in the recognition dictionary, and the keyword input by the user are displayed at the input time, and in the event column, a mark 1103 ( A circle) is displayed. In FIG. 11, on the 7th (Monday), the keyword “deskwork” entered by the user at 9:00, and the keywords “sales promotion meeting” “CP by recognition processing after 13:00”
“U” and “app” are displayed on the 8th (Tuesday) at 9:00, “mail check” by user input, and at 16:00, “liquid crystal monitor” by recognition processing.

On the guide screen shown in FIG. 11, a search window 1104 is provided in addition to the daily table. When the user inputs a keyword to the window from the operation unit 205 and performs a search, a list of information units having the keyword as recording control information is displayed in a time sequence in a balloon or another window as shown in FIG. In the flow of FIG. 10, this screen is also a guide screen.

When the user clicks one item on the guide screen of FIG. 11 or 12 with a mouse or the like, a record corresponding to the item (one of the keyword or event in FIG. 11 and one of the date and time in FIG. 12) is recorded. Information unit is H
The magnetic disk device 20 via the D interface 214
It is read out from No. 2 and displayed on the display device 204 (step 1102). FIG. 13A shows an example of this display screen. On the left side, the date of the display information and the timetable of the day (timetable of the corresponding day on the guide screen) and the corresponding keywords are displayed, and on the right side thereof, the image information, Text information is displayed. Here, the image information is a thumbnail image of the image unit starting from the corresponding time. When the raw information of the image unit is a still image, the thumbnail of the still image, and when the raw information of the image unit is a moving image, one or more still images selected from the moving image. This thumbnail can be easily created by the technology of conventional image management software. On the other hand, the text information is a thumbnail, that is, text information generated by the recognition process corresponding to each image unit, and may be displayed in a reduced size or only the head on the screen of FIG. 13, and the whole may not be readable.

When the user sees the screen as shown in FIG. 13 (a) and wants to see the details of the thumbnail he or she wants to recall and the text such as the voice input at the same time, the user can click on the thumbnail portion. A still image or moving image corresponding to the thumbnail as the raw information at that time is displayed as shown in FIG. 13B, and at the same time, the corresponding voice is also output as raw information from the speaker or the like, and the text obtained by the recognition process is displayed. . This process is also included in step 1002 in FIG. 10, and these displays support the user's recollection.

Next, in the process of step 1002, the display count is incremented by 1 for the information unit designated and displayed by the user by clicking. This display count is initialized for each information unit stored in the recording control information table 14 when the information is taken in and recorded in the storage process (0.
A display frequency area is created, and the value is incremented by 1 each time a display instruction is given during the recall process (step 1003). This display count is used in the record management described below. When the display count is over, the user is asked whether to display another scene or the like, and if the response continues, the process returns to step 1001 (step 100).
4).

Next, a management process of information recorded in the magnetic disk device will be described. This process relates to both the storage process and the recall process of FIG. 1, and is the function of the record information management unit 18 in FIG. FIG. 14 is a flow chart showing the procedure of this recorded information management.
It is stored in the OM 213 and executed by the CPU 210. First, this process is activated by an interrupt from the timer 19 (step 1401), and the display count and recording period (from the initial recording or the last update time) to all the information units recorded in the information recording unit are displayed. The importance is re-evaluated according to the elapsed time up to the time (step 1402). For example, this is set as a week or a month as the threshold of the recording period, and when the information unit that exceeds this is displayed for recall only less than twice, the importance is lowered by 1 or lowered to the minimum. This is an evaluation, and conversely, it is an evaluation that the importance is raised to one or the highest if it is displayed five times or more within one week. It is also possible to provide a plurality of thresholds for changing the degree of importance and change the change width accordingly.

The above-mentioned importance re-evaluation can be performed by referring to the recording control information table 14. However, when there is an information unit to be changed, the re-evaluation result is re-evaluated and the recording control information table 14 and the magnetic disk device 202 ( It is reflected in the record of the information recording section) (step 1403). That is, for the unit whose importance is changed, the recording control information table 14
And the importance of the corresponding unit of the magnetic disk device 202 is re-evaluated, and the recording time is the present time. In addition, when the importance is increased and the importance corresponds to multiple recording, for example, when the importance is set to "highest" in three stages,
Information is rewritten as a protection recording method such as multiplex recording as a recording method on a magnetic disk. Similarly, when the importance is lowered, thinning-out recording is performed.

Next, it is checked whether the free space of the magnetic disk is less than or equal to the threshold value S% with respect to the total capacity (step 1404).
If it is S% or less, the one having the smallest importance and the largest recording period among all the recording information units is erased (step 1405). If these steps 1404 and 1405 are repeated, the empty space will always become S% or more sometime, so that the subsequent input information storage space is secured. The threshold value S is a value such as 30%. Further, in step 1405, a plurality of information units may be erased at the same time.

When the free space of the magnetic disk is secured at the threshold value S% or more, the storage information amount of each input information in the storage process is controlled next. For this reason, referring to the recording information unit table 14, the time elapse for each input information is checked, and no event occurs during a predetermined period up to the current time, for example, the last 30 minutes, and e = 0 remains. It is checked whether or not (step 1406). If e = 0 remains (No in step 1406), the information collecting unit 3 is controlled to reduce the information amount of the record information unit of the input information thereafter (step 1407). For example, for an image unit, the time width of the unit break is changed from 1 second to 10 seconds, for example. If a moving image is used as the raw information to be recorded, it is converted into a still image. For the data such as temperature, the amount of information is reduced, for example, by lowering the sampling rate of capturing, and for sound, for example, raw information is not recorded. On the other hand, when the event occurs within the predetermined period, the step 1 is performed on the input information.
If the information amount of the recording information unit is reduced in 407,
The information collecting unit 3 is controlled to restore it (step 14).
08). When the processing of step 1407 or 1408 ends, the processing returns to step 1401 and waits for the next timer interrupt. Note that step 14 is performed for each individual recording information unit.
Since the determination result of 06 is generally different, one of steps 1407 and 1408 is performed for each recording information unit, but it is simplified in FIG.

The above-described processing of FIG. 14 is performed for each timer interrupt, and the interrupt period is the expected recording information amount and the magnetic disk free space threshold S% at the time of erasing.
Determined in consideration of the relationship with. Generally, if the threshold value S% is set small, it is necessary to shorten the interrupt cycle, which increases the load on the CPU but increases the utilization rate of the magnetic disk. On the other hand, if the threshold value S% is set to be large, the interrupt period can be lengthened and the load on the CPU is reduced, but the utilization rate of the magnetic disk is reduced. The interrupt period and the threshold value S% may be determined by a trade-off considering these. Although the timer is activated in FIG. 14, the process may be activated by a user operation.

The above is the configuration and operation of the storage system of the present invention shown in FIG. Various modifications and other embodiments will be described below. First, in the description of FIG. 2, the host device 20
1, a sensor unit 203, an operation device 205,
Although the display device 204 is connected to the host 201 by a cable, part or all of them may be connected by a wireless interface such as Bluetooth. In this case, the interface (input interface 215 or output interface 216) corresponding to the corresponding external device is provided with a wireless interface function.
Further, part or all of the sensor unit 203, the display device 204, and the operation device 205, which are external devices of the host device 201 in FIG. 2, may be included in the host device 201 main body. In this case, the interface with the outside is unnecessary, and only the interface with the internal bus is required.

In FIG. 2, the magnetic disk device 202 is inserted into the slot 206 and connected to the host device by a connector. However, the magnetic disk device 202 is an external device and the interface 3 in the magnetic disk device is used.
01 (FIG. 3) and the HD interface 214 in the host device 201 may be provided with a wireless interface function for connection. Further, in this case, since the magnetic disk device 202 is a separate casing, there is also a configuration method in which the external device of FIG. 2 is housed together. FIG. 15 shows a configuration example of the host device and the external device when the magnetic disk device and the sensor unit are housed as one external device. The host device 1501 has a display device 1503 built therein and an operation device 1502. The external device 1510 is installed outside. In the host device 1501, the input interface 1
An interface 504 is an interface between the operation unit 1502 and the internal bus, and an image interface 1505 is a display device 150.
3 and the internal bus. The external interface 1506 has a wireless interface function such as Bluetooth and is connected to the external device 1510. Other parts such as the host CPU of the host device 1501 are the same as the configuration of FIG. On the other hand, the external device 1510 is provided with an external interface 1511 having a wireless interface function, a slot 1512 into which the magnetic disk device 1513 is inserted, a sensor unit 1515 and its input interface 1514. The inside of the magnetic disk device 1513 is shown in FIG.
It has the same structure as. The configuration of FIG. 15 is different from that of FIG. 2 only in the arrangement of each unit and the connection method, and the operation of the storage system is the same.

According to the configuration shown in FIG. 15 above, the external unit 1510 is always carried by the user, but the host device 1501 does not necessarily have to be carried by the user, and an area where wireless communication is possible. Even if it is installed in a fixed position inside, there is no problem in executing the memory process.

FIG. 15B shows the wearable storage system of the present invention shown in FIG. 2 with a communication function added, and a base device capable of communicating with a plurality of such storage systems is provided to store the storage information of each storage system. It is an example of the configuration of a system for centralized management. In this configuration example, the base device 1
520 is fixedly installed.
Storage systems used by three users for 0 (herein referred to as external devices) 1530, 1540, 15
The external device 1530 is provided with a wireless communication interface 1531 in addition to the configuration of FIG. In addition, the sensor portion 1532 and the display device 1533.
Are contained within an external device 1530. The same applies to the other external devices 1540 and 1550.

On the other hand, the base device 1520 has a base C.
The PU 1521, the RAM 1522, the ROM 1523, the communication interface 1524, and the magnetic disk device 1525 are connected via a bus, and the operation unit 1526 and the display device 1527 are connected via each interface. Here, the magnetic disk device 1525 need not be removable, but a built-in type having a large capacity is suitable.

In the configuration of FIG. 15B described above, each external device 1530, etc. processes various information acquired from the sensor of its own device to generate text data, importance, etc., and sends it to the magnetic disk device of its own device. Store. In addition, it has functions to recall stored information and manage / update stored information. These are the functions of the system of FIG. On the other hand, the base device 1520 communicates with each external device to fetch the information (raw information or corresponding recording control information) stored in each external device and store it in the magnetic disk device 1525. By the recording management processing in the external device, even when the degree of importance or the recording method accompanying it is changed, the information is received and the contents of the magnetic disk device 1525 are changed, so that the recording information always matches the external device. I will let you. Here, all of the information stored in each external device may be the storage information of the base device, or only the information having a predetermined importance or higher may be the storage information of the base device.

The installation of the base device as described above has various advantages. For example, when using a network service described later, information of a plurality of users can be managed collectively. Further, as a wearable device, since it is desired to reduce the load on the CPU as much as possible to save power consumption, it is possible to disperse the heavy-load recognition processing in the base devices. In addition, since the recording is duplicated, there is an advantage that even if the magnetic disk device of the external device cannot be used, it can be backed up by the base device. In addition, even if there is information that is erased by the recording management process in the external device, this information is retained in the base device without being immediately erased and used for recalling using the external device or the base device. It is also possible to enable it.

Next, the system function when the sensor is equipped with GPS will be described. In this case, the map information is built in the host device, or the host device is added with the function of an internet client so that the map information can be acquired from a server prepared on the net. In this system, the position of the user is always measured by GPS and the latitude and longitude information is stored. At the time of reproduction, the travel route is displayed by mapping the latitude and longitude information stored in the map information. further,
The image information received from the camera and stored is displayed in association with the above route. 16A is a display example of a route, and FIG. 16B is a display example of image information. Image information at positions P1 to P3 on the route (thick line in the drawing) is thumbnails as images 1 to 3 with time. It is displayed. In FIG. 16B, the recognition text corresponding to the image information and the sound information at the corresponding time may be output. In this way, the user can easily remember what is on the travel route.

Next, the system function when using Bluetooth as a sensor will be described. FIG. 17 is an explanatory diagram of that,
The user is at the position 1701, and the PC 1702, the digital TV 1703, and the PC 1704 having the Bluetooth function are within the distance rc that allows the user to communicate with the Bluetooth.
Is present. In such a case, a list of communicable devices is displayed on the display device, and when the user selects one device from the list, the screen information of the selected Bluetooth device is captured as image information instead of the input image from the camera. To This allows, for example, when the user of the storage system is sitting in front of or near a PC,
It is possible to capture the image information itself displayed on the PC screen instead of the captured image of the PC screen taken by the camera. By storing this in the magnetic disk device, the image for clearer recall can be obtained. You can get information. The image information may be automatically switched when only one Bluetooth device is available for communication.

Next, the structure in which the magnetic disk devices are multiplexed will be described. As described at the beginning, this storage system is used by the user in a wearable manner, and always remembers the surrounding situation while recollecting when necessary. Moreover, the user's desire for recollection is unforgiving, and even the waiting time is unacceptable. At the same time, the storage operation must be interrupted during the recall process and necessary information must be missed. Under such a situation, the memory device is required to repeat the recording and reproducing operations in a very short period, and the semiconductor memory is not suitable for the operation. Even in the magnetic disk device, a single drive having a high access speed is suitable, but even if recording and reproduction are simultaneously performed, the processing may not catch up and a frame drop may occur. Dropped frames lead to missing necessary information.

As a configuration method for solving this problem,
An embodiment in which the magnetic disk device has a RAID configuration will be described. RAID (Redundand Arrays of Independent Di
sks) is a system for storing data in a distributed manner in a plurality of magnetic disk devices and is well known as a technique for speeding up access and improving reliability. FIG. 18 shows a configuration example of a storage system using this RAID configuration, and magnetic disk devices 1804 to 1806 can be mounted in the three slots 1801 to 1803, respectively. Each of the magnetic disk devices 1804 to 1806 is connected to the internal bus of the host device via a RAID controller 1807, and data input / output is controlled via this RAID controller. The configuration of the other parts of the host device is the same as in FIG. The internal structure of each of the magnetic disk devices 1804 to 1806 is also shown in FIG.

FIG. 19 shows a configuration example in which the external unit 1510 in the configuration shown in FIG. 15 is replaced by an external unit 1900 having a RAID configuration of a magnetic disk device. Also, the magnetic disks are provided in the three slots 1901-1903. The devices 1904 to 1906 can be mounted, and the input / output of each magnetic disk device is controlled by the RAID controller 1907. The connection between the external unit and the host device may be a cable or a wireless interface. In FIGS. 18 and 19 described above, three magnetic disk devices are assigned RAID 0 (no fault tolerance), RA
If it is configured at the RAID level such as ID1 (mirroring) or RAID5 (distributed data guarding),
The magnetic disk system can sufficiently follow even if reading and writing frequently occur.

Further, as a method of constructing three RAID systems, the magnetic disk devices may be distributed and arranged in a plurality of casings. FIG. 20 shows an example of the configuration. One magnetic disk device 2005 is mounted on the external unit 2002 having the sensor unit mounted thereon, and two magnetic disk devices 2003, 2004 are mounted on the host device 2001. The input / output of the magnetic disk devices 2003 and 2004 is controlled by the RAID controller 2006, and the input / output of the magnetic disk device 2005 is also controlled by the RAID controller 2006 via the external interface. FIG. 21 shows another configuration example of distributed arrangement of magnetic disk devices.
An external unit 2102 including a display device, an external unit 2103 including a sensor unit, and a host device 210
One of the magnetic disk devices 2105, 21
06 and 2104 are mounted respectively. The input / output of each magnetic disk device is controlled by the RAID controller 2107. The connection between the external units 2102 and 2103 and the host device 2101 may be a cable or a wireless interface. Also in the configurations of FIGS.
A single magnetic disk device can be configured as a RAID 0, 1, 5 or the like to form a magnetic disk device system capable of high-speed operation, and in the structures of FIGS. By arranging the magnetic disks in a distributed manner, it is possible to reduce the probability that all the magnetic disk devices will fail at once due to an external shock. Especially when RAID 1 and 5 are configured, even if one magnetic disk device fails, the data can be reproduced without any trouble, and the reliability can be improved.

FIG. 22 compares the operation of a RAID configuration using three magnetic disk devices (RAID levels 1, 5, etc.) and one magnetic disk device.
FIG. 22A shows benchmark data when recalling (reading) certain video data, and FIG. 22B shows benchmark data when storing (writing), where the horizontal axis represents the information capacity and the vertical axis. Is the transfer rate. When one unit is configured (marked with Δ), the transfer rate is approximately 15 MB for both read and write when the access information amount exceeds approximately 10 MB.
/ Sec or more, but dropped frames of the image occurred, but 3
With the platform RAID configuration (marked with black circles), a large transfer rate is realized for both reading and writing, and even if memory and recall are operated at the same time, frame dropping of images does not occur. As described above, according to the application of the RAID configuration, the performance is not deteriorated even if the storage and the recall are performed at the same time, and the distributed data of the magnetic disk devices causes the storage data to be stored even if a part of the storage system is damaged by a shock or the like. There is an advantage that it can be retained with a high probability.

Next, an explanation will be given of a commercialization model for backing up information and making information available to many people and businesses by connecting the storage system described above to a network. FIG. 23 is a block diagram showing a configuration example of an apparatus for sucking stored information in the storage system of the present invention to the outside. In this configuration, the storage system 23
01 and the contact 2303 of the connector 2304 connect the storage system 2301 to the connector 2304.
When it is placed on the upper side, the connection is established, whereby the stored information of the storage system 2301 is taken into the PC (personal computer) 2305 via the connector 2304. PC2
305 is connected to the network 2306, and thus the storage information of the storage system 2301 can be used on the network. Further, it becomes possible to back up the storage information of the storage system by using the storage of the PC or the network. As a result, even if there is a limit to the storage capacity of the storage system, backing up to a PC or the like can alleviate the use time limit. In addition, if the connector 2304 is provided with a charging function for a battery with a built-in storage system, it is convenient to simultaneously suck up information and charge the built-in battery. Although the storage system 2301 is described as being placed on the connector 2304 in FIG. 23, FIG.
As described with reference to FIGS. 15 and 18 to 21, the storage system may be composed of a plurality of units (host device and external unit). In this case, one of the plurality of units, for example, the host device when the magnetic disk device is in the host device, or the external unit when it is in the external unit, may be placed on the connector 2304. . Further, as described in FIG. 15B, in the configuration in which a plurality of systems are wirelessly connected to the base device, the base device may be placed on the connector 2304. Although the connection method is via contacts, this may be a cable and connector, or a wireless system.

FIG. 24 shows an example of a commercialization model using the storage system according to the present invention. The system includes an operating company that provides a website, a service company that provides network storage, and an advertising agency that provides advertisements. When a user wants to back up the data in his / her storage system 2401 to a network storage, first the data is transferred to the user's PC 2402, then the backup website 2403 is accessed from the PC 2402 and is set for himself / herself. Backup to the network storage 2405. At this time, the website management company 2403
Service company 240 that manages network storage
5, the usage fee is paid to the advertising agency 2404
Receive more as an advertising fee. The advertising agency 2404 sends an advertisement through the website 2403 to the user's PC 2402.
Or to the storage system 2401. This advertisement is displayed in the form of a banner advertisement or the like on the user's PC or a recall screen of the storage system, and is in the eyes of the user. Note that the timing of sending this advertisement is when the user is connected to the website 2403 for backup.

FIG. 25 shows another commercialization model. This system includes a website management company, an information editing company that provides information editing services, and an advertising agency. When the user wants to request the editing of the meeting record or the like stored in the storage system 2501, first, the data is transferred to the user PC 2502, the editing requesting website 2503 is accessed from this PC, and the information editing company 2505 is edited. Request. The website management company 2503 pays a management fee to the information editing company 2505, and the fund is received from the advertising agency 2504 as an advertising fee. Advertising agency 2504 advertises website 25
03 through the user's PC 2502 or storage system 2
Send to 501. This advertisement is displayed in the form of a banner advertisement or the like on the user's PC or a recall screen of the storage system, and is in the eyes of the user. The timing of sending this advertisement is when the user is connected to the website 2503 to request editing.

FIG. 26 shows an example of yet another commercialization model. When the user of the storage system 2601 wants to sell his / her stored data, the information is first sent to the PC2.
Move to 602, then access the information sales website 2603 from the PC 2602, and the information sales company 2605.
Sell your information to. Website management company 26
In 03, only information is displayed. The general consumer 2604 purchases the information he / she wants on the website, and the purchase price is sent to the information sales company 2605. Information sales company 26
05 sends the amount of the information sale price obtained by subtracting the profit amount to the PC 2602 of the storage system. This commercialization model makes it easy for users to sell valuable information that they share with others, such as images of landscapes and historical heritage that they remember while traveling.

[0078]

According to the present invention, a wearable device for assisting human memory is provided with a sensor, a memory, and a display device, and information is always captured even when the user is unconscious, and the captured information is a video, It stores (stores) voice and other data after recognition processing, and can be easily searched and played back (remembered) when needed. It also does not put pressure on the storage capacity and protects important data. It is possible to provide a simple storage system and a method of selling services related to the storage system. Further, according to the present invention, it is possible to provide a device in which performance is not deteriorated even if storage and recall are performed at the same time, and stored data can be held with a high probability even if a part of the storage system is damaged due to shock or the like. Furthermore, according to the present invention, it is possible to construct a commercialization model by utilizing the storage system of the present invention. From the above, the storage system of the present invention can provide a device for assisting human memory and can also share the memory of various people, and thus play a major role in the development of the information society.

[Brief description of drawings]

FIG. 1 is a functional block diagram showing a configuration example of a storage system according to the present invention.

FIG. 2 is a block diagram showing a hardware configuration example of the storage system shown in FIG.

FIG. 3 is a block diagram showing an internal configuration of a magnetic disk device.

FIG. 4 is a perspective view of a magnetic disk device.

FIG. 5 is an explanatory diagram of a configuration of a sensor unit.

FIG. 6 is a flowchart showing a storage process.

FIG. 7 is an explanatory diagram of a multiplex recording method.

FIG. 8 is an explanatory diagram of a protected recording method.

FIG. 9 is an explanatory diagram of another multiplex recording method.

FIG. 10 is a flowchart showing a recall process.

FIG. 11 is an example of a guide screen in recall processing.

FIG. 12 is an example of a guide screen when a data search is performed on the recall process guide screen.

FIG. 13 is a display screen example of a recall process.

FIG. 14 is a flowchart showing information management processing of the magnetic disk device.

FIG. 15 is a block diagram showing another configuration example of the hardware of the storage system.

FIG. 15B is a configuration example of a system that integrates and operates a plurality of storage systems.

FIG. 16 is a display example of a travel route and landscape using GPS.

FIG. 17 is an explanatory diagram of a method of importing information from a Bluetooth device.

FIG. 18 is a hardware configuration example of a storage system provided with a magnetic disk device having a RAID configuration.

FIG. 19 is another example of the hardware configuration of the storage system provided with the magnetic disk device having the RAID configuration.

FIG. 20 is another example of the hardware configuration of the storage system provided with the magnetic disk device having the RAID configuration.

FIG. 21 is another example of hardware configuration of a storage system provided with a magnetic disk device having a RAID configuration.

FIG. 22 is an example of operation characteristics of a storage system provided with a magnetic disk device having a RAID configuration.

FIG. 23 is a diagram showing a configuration example of a device for sucking stored information of a magnetic disk device to the outside.

FIG. 24 is a diagram showing an example of a commercialization model using the storage system according to the present invention.

FIG. 25 is another example of a commercialization model using the storage system according to the present invention.

FIG. 26 is still another example of the commercialization model using the storage system according to the present invention.

[Explanation of symbols]

1 Storage Process 2 Recall Process 3 Information Collection Unit 4 Recording Command 5 Synthesis Unit 6 Recognition Unit 7 Sound / Voice Recognition Unit 8 Shape / Color Recognition Unit 9 Event Recognition Unit 10 Recognition Dictionary 11 Importance Level Table 12 Recording Control Unit 13 Information Recording Unit 14 recording control information table 15 reproduction command 14 reproduction information display unit 16 read / display control unit 17 reproduction information display unit 18 recording information management unit 19 timer 201 host device 202 magnetic disk device 203 sensor 204 display device 205 operating device 1510, 1900, 2002, 2102, 2103
External unit 2401, 2501, 2601 Storage system 2403, 2503, 2603 Website 2404, 2504 Advertising agency 2406 General consumer 2405 Network storage 2505 Information editing company 2605 Information sales company

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G10L 15/28 G10L 3/00 551P H04N 5/76 561C 5/765 571Q 5/781 // G06T 7/00 300 (72) Inventor Yoichi Horii 1-280 Higashi Koigakubo, Kokubunji City, Tokyo Inside Hitachi Central Research Laboratory (72) Inventor Yukinobu Maruyama 1-280 Higashi Koigakubo, Kokubunji City, Tokyo Inside Hitachi Design Laboratory (72) Inventor Takeshi Hoshino 1-280, Higashi Koigakubo, Kokubunji, Tokyo Metropolitan Government Design Research Laboratory, Hitachi Ltd. (72) Inventor Kouki Funafune 2880, Kozu, Odawara-shi, Kanagawa Stock Company Hitachi Ltd. Storage Division (72) Arai Toshifumi 7-1, Omika-cho, Hitachi-shi, Ibaraki Prefecture Stock company Hitachi, Ltd., Hitachi Research Laboratory (72) Inventor, Masaki Odaii, Kamidate-cho, Tsuchiura City, Ibaraki Prefecture, 502 F-Term, Institute of Mechanical Research, Hitachi, Ltd. (reference) 5B075 MM11 ND20 ND23 NR02 NR20 PP10 PP30 PQ02 UU40 5C052 AA01 AC08 DD04 5C053 FA14 FA23 HA29 HA30 LA01 LA20 5D015 KK02 LL05 LL12 5L096 AA02 FA00 HA07 JA11

Claims (11)

[Claims] 1. A magnetic disk device, a sensor unit including at least a camera for collecting image information and a microphone for collecting sound information, and input information input from the sensor unit is determined corresponding to each information. Unitizing means for dividing into units by different time lengths, and for each of the unit information separated by this unitizing means, the event corresponding to the state or state change is detected, and a text sentence indicating the content of the detected event is displayed. Event detection means for outputting, video / sound recognition means for performing recognition processing for each of the unit information of video information and sound information from the camera and microphone, and outputting the recognition result as a text sentence, the event detection means, and video・ The text sentence output from the sound recognition means and the event detected by the event detection means Importance setting means for setting importance to the unit information, importance set by the importance setting means, event information indicating the presence or absence of an event detected by the event detecting means, and the unit information indicating a sensor unit. According to the degree of importance included in the header, the synthesizing unit that adds the header including the recording time indicating the time input from the unit information to the unit information to generate the recording information unit, Recording control means for storing in a magnetic disk device by a different recording method,
A storage system, comprising: read / display control means for reading the record information stored in the magnetic disk device and displaying it on the display means. 2. The storage system according to claim 1, wherein
A recording control information table in which the header of the recording information unit stored in the magnetic disk device is stored as recording control information, and the number of times of display read and displayed by the read / display control unit is counted for each recording information unit. A counter, a timer, and an interrupt from this timer are activated, and the importance of each of the recording information units stored in the magnetic disk device is re-evaluated from the elapsed time from the recording time and the display count of the counter. A recording method in which the importance of the recording information unit whose importance has been changed by this reevaluation is rewritten, and the recording control unit is controlled to control the recording information unit to correspond to the importance after the change. And a re-evaluation means for recording by the When the free space becomes less than or equal to a predetermined value, the free space is determined to be greater than or equal to the predetermined value in descending order of importance of the recording information units and longest elapsed time from the recording time. A storage system comprising: a recording and erasing means for erasing the data from the magnetic disk device. 3. The storage system according to claim 1, wherein
A timer and an interrupt from this timer are activated, and for each of the information stored in the magnetic disk device, it is checked whether or not an event is detected by the event detection means within a predetermined time until that point, and the predetermined time is determined. A storage system characterized by comprising input information control means for controlling, for information in which no event is detected, to reduce the amount of information input from the sensor unit. 4. The storage system according to any one of claims 1 to 3, wherein the importance level setting means has an importance level table in which keywords and their importance levels are stored as a pair, and the event detection is performed. A storage system, wherein when the text sentence output from the means or the video / sound recognition means includes a keyword in the importance table, the importance corresponding to the keyword is set in the unit information. 5. The storage system according to claim 1, wherein the recording control unit has a first importance level.
A storage system characterized in that a recording information unit higher than a predetermined value is stored in a magnetic disk device by a multiplex recording method, and a recording information unit lower than a second predetermined value is stored in the magnetic disk device with a reduced amount of information. . 6. The storage system according to claim 1, wherein the sensor unit is provided with a GPS sensor, and a memory storing map information or a unit for reading the map information from outside is provided, and the reading is performed. The display control means has a function of dropping the position information acquired by the GPS sensor on the map and displaying the movement route on the display means. 7. The storage system according to claim 1, wherein a Bluetooth sensor is provided in the sensor unit, and the Bluetooth device has a Bluetooth function and is displayed on the Bluetooth device when communication is possible. A storage system characterized in that display information can be directly fetched as input information by the Bluetooth function. 8. The storage system according to any one of claims 1 to 3, wherein the magnetic disk device is RAI.
A storage system comprising a plurality of magnetic disk devices of D configuration. 9. The storage system according to claim 1, wherein a host device including the unitizing means, the event detecting means, and the video / sound recognizing means is different from the host device. A storage system characterized by being configured by being divided into one or a plurality of external units housed in a housing. 10. The storage system according to claim 1 stores or edits information stored in the storage system according to a request from a user of the storage system via a network, A method of selling a service in which an advertisement is sent to the user via a network and displayed on a display unit, and the advertisement fee is received as a consideration for storing or editing the information. 11. A request, via a network, of a user of the storage system to sell information stored in the storage system according to claim 1 to a third party via the network. The method of selling a service, wherein part of the purchase price paid by the third party is received as consideration for the sales service agency.