WO2005032829A2 - 再生装置及びブックマークシステム - Google Patents
再生装置及びブックマークシステム Download PDFInfo
- Publication number
- WO2005032829A2 WO2005032829A2 PCT/JP2004/014294 JP2004014294W WO2005032829A2 WO 2005032829 A2 WO2005032829 A2 WO 2005032829A2 JP 2004014294 W JP2004014294 W JP 2004014294W WO 2005032829 A2 WO2005032829 A2 WO 2005032829A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- content
- bookmark
- unit
- playback device
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
- G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/11—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information not detectable on the record carrier
Definitions
- the present invention relates to a technique for acquiring partial content desired by a user from content.
- the user When the user is viewing the content, if the user wants to refer to the information on the content that he / she wants to view at a later date, the user can specify the information as the content to be referenced, and then refer to the information on the specified content at a later date. There is technology to do.
- a search system that can perform a necessary search without searching for an accurate keyword when searching for information on broadcasted content.
- This search system is composed of a book marker that specifies the program content to be referred to, a search engine, and a gateway device that communicates with the search engine.
- the search engine is the content of the content broadcasted by each broadcasting station. It has a database in which playlists in which names and broadcast times of the contents are associated are stored, and a database in which the contents names of broadcast contents and information related to the contents are stored in association with each other. .
- the user obtains the time information indicating the time using the book marker and stores it in the book marker.
- the book marker is connected to the gateway device, and transmits the stored time information to the search engine by a predetermined operation of the user.
- the search engine acquires the name (song name) of the music content broadcast at the time indicated in the received time information from the playlist, and acquires the related information (eg, artist name) associated with the acquired song name. Then, the obtained song name and related information are transmitted to the gateway device.
- the gateway device receives and displays the song title and related information. This allows the user to easily refer to the song title and related information of the broadcasted content at a later date.
- the above search system only obtains the content name of the broadcasted content and the related information using a search engine, and displays the obtained content name and the related information using a gateway device. And the content broadcasted in a certain program For the user who wants to know the contents of the search again, the above search system is not a satisfactory system.
- the present invention provides a playback device, a bookmark system, a terminal device, an acquisition method, an acquisition program, an acquisition program recording medium, a bookmark, a method, a bookmark program, and a program that can acquire a partial content desired by a user from the content. It aims to provide a bookmark program recording medium.
- the present invention provides a reproducing apparatus, comprising: an information receiving means for receiving type information indicating a type of an object; and a reproducing position of the content being reproduced at the time of receiving the type information.
- Position acquisition means for acquiring the position information indicated by the type information; and an object corresponding to the type indicated by the type information;
- a partial content acquisition unit for acquiring from the content.
- the playback device can acquire the partial content that includes the corresponding object of the type indicated by the type information and starts at or near the playback position indicated by the position information.
- the playback device can acquire the partial content including the object that the user liked, and thus the user can view the object that he or she liked from the acquired partial content again.
- the partial content obtaining means obtains the partial content at the time when the position obtaining means obtains the position information, and the reproducing device further stores a bookmark storing means and the partial content in the bookmark. It is assumed that there is no writing means for writing to the storage means.
- the playback device can acquire the partial content and write the acquired partial content when the type information is received.
- the playback device can manage the acquired partial content in the bookmark storage unit.
- the content includes a moving image composed of a plurality of still images
- the partial content is composed of still image characters included in the content
- the partial content obtaining unit performs the partial content acquisition based on the position information.
- the playback device can detect a still image in which an object appears, and acquire the detected still image as partial content.
- the partial content obtaining means may obtain a still image as the partial content.
- the playback device when the type information indicates the type to which the outside of the object related to the image belongs, the playback device can acquire a still image.
- the type information indicates that the object is a person image or a character constituting a part of the image of the object, or indicates that it is a capture constituting an entire image.
- the type indicated by the type information indicates a person image, a character, or a capture
- a still image may be acquired as the partial content.
- the type of the object related to the image can be a person image, a character, or a capture.
- the content includes a moving image composed of a plurality of still images and a voice corresponding to the moving image
- the partial content includes a partial moving image included in the content and a portion corresponding to the partial moving image.
- the partial content acquisition means detects a still image in which an object corresponding to the type indicated by the type information appears in a forward direction from the reproduction position indicated by the position information, and detects the detected still image.
- a partial moving image opened from an image and a partial sound corresponding to the partial moving image may be acquired as the partial content.
- the playback device can detect a still image in which an object appears, and can acquire a partial moving image and a partial sound started from the detected still image as partial content.
- the partial content obtaining unit obtains a partial moving image and a partial voice corresponding to the partial moving image as the partial content. You can do it.
- the playback device can acquire a partial moving image and a partial sound.
- the type information indicates that the type of the object is music. If the type indicated by the type information is music, the partial content obtaining unit determines whether the type of the object is music. A partial sound corresponding to a moving image may be obtained as the partial content.
- the type of the object related to the sound can be music.
- the content includes one or more corner contents, each corner content includes one or more images, and a specific image indicating a boundary of the corner content exists before and after each corner content, and
- the content acquisition means detects a specific image closest to the reproduction position in a forward direction from the reproduction position indicated by the position information, and sets a corner content started immediately after the detected specific image as the partial content. Even if you get it.
- the playback device can acquire the corner content including the object corresponding to the type indicated by the type information as the partial content.
- the playback device may further include a request receiving unit that receives the output request for the partial content, and a reading unit that reads the partial content from the bookmark storage unit when the request receiving unit receives the output request. And output means for outputting the read partial content.
- the playback device upon receiving the output request, the playback device can read out and output the partial content from the bookmark storage unit. Accordingly, when outputting the partial content, the playback device does not need to acquire the content power of the partial content, so that it is possible to shorten the time required from the user's request to the output.
- the playback device further includes a receiving unit that receives the output request for the partial content from an external terminal via a network, and the receiving unit receives the output request.
- the apparatus may further include a reading unit that reads from the storage unit, and a content transmitting unit that transmits the read partial content to the external terminal via a network.
- the playback device can receive an output request from the external terminal via the network, and transmit the read partial content to the external terminal via the network. Wear.
- the playback device further includes a request receiving unit that receives a request to output the partial content acquired by the partial content acquiring unit, and an output unit that outputs the acquired partial content.
- the acquisition unit may acquire the partial content using the position information and the type information when the request receiving unit receives the output request.
- the playback device upon receiving the output request, the playback device can acquire the partial content using the position information and the type information, and can output the acquired partial content.
- the partial content acquisition means may delete other parts from the content except for the specific partial content including the partial content.
- the playback device when the content is deleted, the playback device can leave the specific partial content including the partial content.
- the content includes a moving image composed of a plurality of still images and a sound corresponding to the moving image
- the reproducing apparatus further includes a content storage unit that records and records the content in advance.
- the partial content acquisition unit includes a bookmark storage unit, a writing unit that associates the position information with the type information, writes the bookmark information into the bookmark storage unit, and receives a deletion information indicating deletion of the content.
- the deletion receiving unit receives the deletion information, a still image in which an object corresponding to the type indicated by the type information appears in the forward direction of the reproduction position force indicated by the position information from the content.
- Detecting and detecting the detected still image force including a specific partial moving image to be started, and a specific partial sound corresponding to the specific partial moving image;
- a first acquisition unit that acquires a specific part content that is a part of content, a recording unit that records the specific part content acquired by the first acquisition unit in the content storage unit, and a content storage unit that stores the content.
- a deletion unit that deletes from the means, and a second acquisition unit that acquires the partial content from the specific partial content recorded in the content storage unit using the type information and the position information. It may be provided.
- the playback device uses the position information and the type information to specify the identification unit including the object corresponding to the type indicated by the type information.
- the minute content is acquired, the acquired specific part content is recorded in the content storage means, and the partial content can be obtained from the specific part content.
- the specific partial content is recorded in the content storage unit, so that the specific partial content can be recorded and obtained.
- the playback device further includes request receiving means for receiving the output request for the partial content, and output means for outputting the obtained partial content
- the second acquisition 13 includes the request receiving means. May receive a partial content by using the position information and the type information at the time of receiving the output request.
- the playback device can acquire the specific partial content and the partial content at the time of receiving the output request.
- the partial content acquisition unit acquires the partial content when the position acquisition unit acquires the position information
- the playback device further stores the content in advance and stores the content.
- Means a puck mark storage means, a writing means for writing the partial content into the bookmark storage means, a deletion receiving means for receiving deletion information indicating deletion of the content, and a means for receiving the deletion information.
- a deletion unit that leaves the partial content stored in the bookmark storage unit and deletes the content from the content storage unit.
- the playback device stores the sound content in the bookmark storage unit. Therefore, even after deleting the content, the user can view the object that he or she likes from the partial content again.
- the information receiving unit receives the type information from an external terminal, further receives a terminal identifier for identifying the external terminal, and the playback device further includes a bookmark storage unit and the terminal. Writing means for writing an identifier into the bookmark storage means in association with the position information and the type information may be provided.
- the playback device can write the terminal identifier in the bookmark storage means in association with the position information. This allows the playback device to manage the position information for each external terminal.
- the playback device may further include an external terminal, and Receiving means for receiving an output request for the acquired partial content and a terminal identifier, and content transmitting means for transmitting the partial content to an external terminal that has transmitted the output request, wherein the partial content acquiring means comprises: The received terminal identifier is compared with the terminal identifier stored in the bookmark storage means, and the position information and type information corresponding to the matched terminal identifier are read out from the bookmark storage means, and the read position information is read. And the type information may be used to obtain the partial content.
- the playback device when the playback device receives the output request and the terminal identifier from the external terminal, the playback device compares the received terminal identifier with the terminal identifier stored in the bookmark storage unit, and determines that the terminal identifier matches the terminal identifier.
- the partial content obtained using the corresponding position information and type information can be output to an external terminal.
- the content includes an image group including a plurality of images
- the partial content includes at least one or more images included in the image group
- the partial content obtaining unit includes:
- the image quality of each included image may be thinned out so as to be lower than the image quality of the image forming the image group included in the content.
- the playback device can lower the image quality of one or more images to be acquired from the image quality of the images forming the image group included in the content.
- the content includes audio
- the partial content includes a partial audio that is a part of the audio
- the partial content acquisition unit determines a sound quality of the partial audio included in the partial content. It may be thinned out so that the sound quality is lower than the sound quality of the audio included in the content.
- the playback device can lower the sound quality of the acquired partial sound from the sound quality included in the content.
- the content includes an image group composed of a plurality of images
- the partial content is obtained by adding a predetermined character to at least one or more images included in the image group.
- the means may add a predetermined character to the image acquired from the image group.
- the image acquired by the playback device can be an image obtained by adding a predetermined character to the image acquired from the image group.
- the bookmark storage device ⁇ further includes the position information and the type information.
- the different position information and the different type information are stored in association with another terminal identifier for identifying another external terminal different from the external terminal, and the different position information and the different The type information corresponds to the content, and the playback device further writes an expiration date of the partial content transmitted by the transmitting unit in the bookmark storage unit in association with the position information.
- a writing unit wherein the partial content obtaining unit obtains the partial content when the receiving unit receives the output request and the terminal identifier from the external terminal within the expiration date.
- a receiving unit that receives, from the another external terminal, an output request for the partial content corresponding to the different location information and the different type information, and the different terminal identifier. If the is not good even to suppress the acquisition of partial contents said another position information with respect to the said another type information.
- the information receiving means further receives an area identifier indicating an area related to the object
- the reproducing apparatus further stores the bookmark storage means and the area identifier in correspondence with the position information and the type information. Writing means for writing to the bookmark storage means.
- the playback device can write the region identifier in the bookmark storage unit in association with the location information.
- the playback device may further include, from the external terminal, an output request for a partial content obtained by the partial content obtaining unit and a terminal area identifier indicating an area where the external terminal is located.
- Receiving means, and content transmitting means for transmitting the partial content to the external terminal wherein the partial content obtaining means stores location information and type information corresponding to an area identifier matching the terminal area identifier,
- the partial content may be read out from the puck mark storage means and the partial content may be obtained using the read out position information and type information.
- the playback device receives the terminal area identifier from the external terminal, and uses the position information and the type information corresponding to the area identifier that matches the received terminal area identifier.
- the acquired partial content can be transmitted to an external terminal.
- the user can use the external terminal to receive the partial content related to the destination while playing.
- the position obtaining means obtains, as the position information, an elapsed time from the start of reproduction of the content to a point in time when the type information is received, and the partial content obtaining means starts from within the elapsed time. May be obtained.
- the playback device can acquire, as the position information, the elapsed time from the start of the content playback to the time when the type information is received, and use the acquired elapsed time to acquire the partial content. .
- the present invention is a bookmark system comprising a playback device and a terminal device for sending an instruction to add a bookmark to the content being played back to the playback device, wherein the terminal device sends a bookmark instruction to an object to a user.
- the terminal device of the bookmark system transmits the type information to the reproducing device when receiving the instruction of the bookmark, and the reproducing device acquires the position information when the terminal device receives the type information.
- the reproducing device acquires the position information when the terminal device receives the type information.
- the partial content obtaining means obtains the partial content when the information receiving means receives the type information, and the playback device further stores the bookmark storage means and the partial content in the bookmark. It is not necessary to have writing means for writing to the storage means.
- the playback device when the playback device receives the type information, the playback device The content can be obtained and the obtained partial content can be written to the bookmark storage means. As a result, the playback apparatus can manage the acquired partial content in the bookmark storage unit.
- the terminal device further includes an identifier storage unit that stores a terminal identifier for identifying the terminal device in advance, and the information transmitting unit further associates the terminal identifier with the type information. Transmitting, the information receiving means further receives the terminal identifier, and the writing means further writes the received terminal identifier in the bookmark storage means in association with the partial content. Is also good.
- the playback device can write the terminal identifier in the partial content storage unit in association with the acquired partial content. This allows the playback device to manage the partial content for each terminal device.
- the accepting unit further accepts an output request for the partial content stored in the bookmark storage unit
- the playback device further identifies the output request and the terminal device that has issued the output request.
- Receiving means for receiving a terminal identifier to be received from the terminal device, and receiving the terminal request when the receiving means receives the output request and the terminal identifier, and a terminal stored in the bookmark storage means.
- the terminal device further includes, when the receiving unit receives the output request, the received output request and the terminal identification.
- Request transmitting means for transmitting the partial content read by the reading means from the reproducing apparatus, and a content output means for outputting the received partial content. It may be provided with.
- the playback device upon receiving the output request and the terminal identifier from the terminal terminal, compares the received terminal identifier with the terminal identifier stored in the bookmark storage means, The partial content corresponding to the identifier can be transmitted to the terminal.
- the terminal device can receive the partial content of the playback device and can output the received partial content.
- the playback device responds to the terminal identifier that identifies the terminal device that made the output request.
- the personal content may be read from the bookmark storage means, and the read partial content may be transmitted to the terminal device. Therefore, it takes more time to receive the output request and transmit the partial content than to acquire the partial content from the content every time there is a request to output the partial content from the terminal device, and to transmit the acquired partial content. Can be shortened.
- the playback device and the terminal device are connected by a home network
- the playback device is a server device in the home network
- the terminal device is a client device in the home network. There may be.
- the playback device can be a server device in the home network, and the terminal device can be a client device in the home network.
- a puck mark system can be formed on the home network.
- the terminal device may be a portable terminal device.
- the terminal device of the bookmark system can be a portable terminal device.
- the playback device further includes a position transmitting unit that transmits the position information to the terminal device, and the terminal device further includes a position receiving unit that receives the position information, a bookmark storage unit, And an information writing unit that writes the received position information in the bookmark storage unit in association with the type information transmitted to the playback device.
- the playback device transmits the acquired position information to the terminal device, and the terminal device can associate the position information with the type information and write the information in the bookmark storage unit.
- the receiving unit further receives a request for outputting partial content for the position information and the type information
- the terminal device further receives the received output when the receiving unit receives the output request.
- a request transmitting means for transmitting the request and the position information and the type information stored in the bookmark storage means to the playback device; and a partial content acquired based on the transmitted position information and the type information.
- Content receiving means for receiving the partial information from the playback device, and content output means for outputting the received partial content
- the playback device further comprises: A receiving unit that receives the type information and the output request from the terminal device; and a content transmitting unit that transmits the partial content acquired by the partial content acquiring unit to the terminal device,
- the partial content acquisition unit acquires the partial content by using the received position information and the type information when the reception unit receives the position information and the type information and the output request. It may be.
- the terminal device transmits the output request, the position information and the type information to the playback device, and the playback device acquires the partial content using the received position information and type information,
- the acquired partial content is transmitted to the terminal device, and the terminal device can output the received partial content.
- the present invention is a terminal device that sends an instruction to add a bookmark to the content being played back to the playback device, wherein the receiving unit accepts an instruction of a puck mark for the object by the user, and when the instruction of the bookmark is accepted,
- An information transmitting unit that transmits type information indicating the type of the object to the playback device, and position information indicating a playback position of the content being played at the time of transmitting the type information is received from the playback device.
- a position receiving unit, a bookmark storage unit, and an information writing unit that associates the received position information with the type information transmitted to the playback device and writes the type information to the bookmark storage unit.
- the terminal device when the terminal device receives the instruction of the user's bookmark, the terminal device transmits the type information to the reproducing device, receives the position information from the reproducing device, associates the position information with the type information, and stores the bookmark. You can write to the means.
- the bookmark storage unit may have an area corresponding to the type indicated by the type information, and the information writing unit may store the type information and the position information in the corresponding area. Good.
- the terminal device can store the position information and the type information in the area corresponding to the type indicated by the type information.
- position information and type information can be managed for each type of object.
- the accepting unit further accepts an output request for the partial content corresponding to the position information and the type information and acquired by the playback device in the content capability
- the terminal device further includes: The output request and the bookmark request stored in the bookmark storage unit.
- Request transmitting means for transmitting the location information and the type information to the playback device
- content receiving means for receiving partial content corresponding to the location information and the type information from the playback device
- a content output unit that outputs the received partial content.
- the terminal device transmits the output request, the position information and the type information to the playback device, receives the partial content corresponding to the position information and the type information transmitted from the playback device card, and receives the received content.
- Content can be output. This allows the user to view the partial content even when away from home by using the terminal device.
- the terminal device is a portable terminal device that communicates with another terminal device, and the information transmitting unit further includes the position information and the type information stored in the bookmark storage unit. May be transmitted to the other terminal device.
- the portable terminal device can transmit the position information and the type information stored in the bookmark storage unit to another terminal device.
- the position receiving means further receives, from the other terminal device, position information and type information stored in the other terminal device
- the information writing device further comprises: The position information and type information received from another terminal device may be written in the bookmark storage means.
- the terminal device receives another location information and another type information from another terminal device, and writes the received another location information and another type information into the bookmark storage unit. Can be.
- the terminal device may be a client device connected to a network via a home network in which the playback device is a server device.
- the terminal device can be a client device in a home network in which the playback device is a server device.
- the receiving unit further receives a region identifier indicating a region related to the object
- the information writing unit further associates the region identifier with the position information and sends the region identifier to the bookmark storage unit. Even if you write.
- the terminal device can write the area identifier in the puck mark storage means in association with the location information.
- the receiving means further receives an output request for partial content corresponding to the location information and the type information corresponding to a region identifier and obtained from the content by the playback device
- the apparatus further receives, when receiving the output request, an identifier acquiring means for acquiring a terminal area identifier for identifying an area where the terminal apparatus is currently located, and a terminal identifier corresponding to the acquired terminal area identifier.
- a request transmitting unit that transmits the position information and the type information and the output request to the playback device, and an information obtaining unit that obtains the position information and the type information from the bookmark storage unit.
- Content receiving means for receiving the partial content obtained by the position information and the type information It may comprise a content output means for outputting a partial content.
- the terminal device transmits position information and type information corresponding to an area identifier matching the terminal area identifier indicating the area where the terminal device is currently located to the playback device, and transmits the position information transmitted from the playback device.
- the partial content corresponding to the type information can be received, and the received partial content can be output.
- the user possessing the terminal device can now view the partial content related to the area where the user is located.
- FIG. 1 is a diagram showing a usage form of the bookmark system 1.
- FIG. 2 is a block diagram showing a configuration of the mobile phone 100.
- FIG. 3 is a block diagram showing a configuration of the bookmark storage unit 101.
- FIG. 4 shows the data structure of the music information table T100 of the music folder 120.
- FIG. 5 shows the data structure of the person information table T101 of the person folder 121.
- FIG. 6 shows the data structure of the character information table T102 of the character folder 122.
- FIG. 7 shows the data structure of the capture information table T103 of the capture folder 123.
- FIG. 8 shows a data structure of a regional information table T110 included in the regional information storage unit 102.
- FIG. 9 shows an example of information displayed on the display unit 109 when bookmark information is selected.
- FIG. 10 is a block diagram showing the configuration of the playback device 200.
- FIG. 11 is a block diagram showing the configuration of the program content storage unit 201.
- FIG. 12 shows a data structure of a search information table T200 included in the search information storage unit 202.
- FIG. 13 is a diagram showing the contents stored in the program content storage unit 201 after deleting the program content “FFF”.
- FIG. 14 is a flowchart showing an outline of the operation at the time of bookmark registration.
- FIG. 15 is a flowchart showing an outline of the operation when the designated display is performed.
- FIG. 16 is a flowchart showing an outline of the operation when displaying a region.
- FIG. 17 is a flowchart showing the operation of the bookmark information storing process.
- FIG. 18 is a flowchart showing the operation of the image data acquisition process.
- FIG. 19 is a flowchart showing the operation of the program content acquisition processing.
- FIG. 20 is a flowchart showing the operation of the deletion process. Continue to Figure 21.
- FIG. 21 is a flowchart showing the operation of the deletion process. Continued from Figure 20.
- FIG. 22 is a block diagram showing a configuration of the playback device 1000.
- FIG. 23 shows a data structure of a music information table T1000 included in the music folder of the bookmark storage unit 1002.
- FIG. 24 is a block diagram showing a configuration of the mobile phone 1100.
- FIG. 25 is a flowchart showing an outline of the operation at the time of bookmark registration.
- FIG. 26 is a flowchart showing an outline of the operation when the designated display is performed.
- FIG. 27 is a flowchart showing an outline of the operation when performing the area display.
- FIG. 28 is a block diagram showing a configuration of the playback device 200A.
- FIG. 29 is a flowchart showing the operation of the image data acquisition process. Continue to Figure 24.
- FIG. 30 is a flowchart showing the operation of the image data acquisition process. Continued from Figure 23.
- FIG. 31 is a diagram showing a usage form of the bookmark system 2.
- FIG. 32 is a block diagram showing a configuration of the playback device 2000.
- FIG. 33 is a block diagram showing a configuration of the program content storage unit 2001.
- FIG. 34 is a block diagram showing a configuration of the bookmark storage unit 2002.
- FIG. 35 shows a data structure of a music information table T2000 included in the music folder 2020.
- FIG. 36 shows the data structure of the person information table T2001 of the person folder 2021.
- FIG. 37 shows the data structure of the character information table T2002 of the character folder 2022.
- FIG. 38 shows the data structure of the capture information table T2003 of the capture folder 2023.
- FIG. 39 shows an example of a screen displaying the screen data and the program content being reproduced.
- FIG. 40 shows an example of information displayed on the monitor 11 via the output unit 2007 when bookmark information is selected.
- FIG. 41 shows the configuration of remote controller 2300.
- FIG. 42 is a block diagram showing a configuration of mobile phone 2100.
- FIG. 43 shows a data structure of a regional information table T2100 included in the regional information storage unit 2102.
- FIG. 44 is a flowchart showing the operation of BM registration processing for registering bookmark information.
- FIG. 45 is a flowchart showing the operation of the image data acquisition process.
- FIG. 46 is a flowchart showing the operation of the information storage process.
- FIG. 47 is a flowchart showing the operation of the first display process.
- FIG. 48 is a flowchart showing the operation of the second display process.
- FIG. 49 is a block diagram showing a configuration of the playback device 3000.
- FIG. 50 shows an example of a music information table T3000 included in the music folder of the bookmark storage unit 3002.
- FIG. 51 is a flowchart showing the operation of the image data acquisition process.
- FIG. 52 is a flowchart showing the operation of the program content acquisition process.
- FIG. 53 is a flowchart showing the operation of the deletion process. Continue to Figure 54.
- FIG. 54 is a flowchart showing the operation of the deletion process. Continued from Figure 53.
- FIG. 1 is a diagram showing a usage pattern of the bookmark system 1, and the bookmark system 1 It comprises a mobile phone 100 and a playback device 200 connected to the television 10.
- the playback device 200 is a DVD recorder.
- the playback device 200 records broadcast program content and plays back the recorded program content.
- the program content includes a channel number on which the program content was broadcast (hereinafter referred to as a “CH number”), a program ID for identifying the program content, and a recording start at which the recording of the program content was started. It is associated with time.
- the mobile phone 100 and the playback device 200 can perform two-way communication by infrared communication and communication by the Internet.
- the mobile phone 100 By performing infrared communication with the playback device 200, the mobile phone 100 registers information relating to image data to be referenced later while the program content recorded by the playback device 200 is being played back on the television 10. Is transmitted, and information related to the image data is received from the playback device 200 and stored.
- a bookmark designating image data to be referred to later is called a bookmark (BookMark).
- the mobile phone 100 transmits the information relating to the image data that has been stored and marked with a mark to the playback device 200 via the public wireless communication network and the Internet, and the playback device 200 performs the bookmarking. Receives and displays still images or moving images related to image data.
- the mobile phone 100 is a portable communication terminal device, and as shown in FIG. 2, a bookmark storage unit 101, a ⁇ area information storage unit 102, a radio unit 103, a baseband signal processing unit 104, a speaker It comprises a force 105, a microphone 106, a control unit 107, an input unit 108, a display unit 109, and a transmission / reception unit 110.
- the mobile phone 100 is a computer system including a microprocessor, a ROM, a RAM, a display unit, and the like.
- the ROM stores a computer program.
- the mobile phone 100 achieves its functions by the microprocessor operating according to the computer program.
- the puck mark storage unit 101 stores a music folder 120, a person folder 121, It has a character folder 122 and a capture folder 123.
- the music folder 120 has a music information table T100 as shown as an example in FIG.
- the music information table T100 has an area for storing one or more sets of identification names, BM (BookMark) display times, BM CH numbers, BM program IDs, area codes, and additional information.
- BM BookMark
- BM CH numbers BM program IDs
- area codes BM program IDs
- additional information referred to as bookmark information.
- the identification name is a name for identifying the bookmark information to be stored and stored.
- the BM display time is a broadcast time at which the bookmarked image data was broadcast, and is indicated by a date and time.
- the BM CH number is a CH number corresponding to the bookmarked program content
- the BM program ID is a program ID corresponding to the bookmarked program content.
- a region code is information for identifying a region, and corresponds to an area code of a telephone number in the region.
- the additional information is information indicating a bookmark target.
- the area code is not necessarily recorded information but is recorded as needed.
- the additional information in the music information table T100 is always “music”.
- the BM program ID is the same as the program ID stored and reproduced by the playback device 200 described later.
- the target of the bookmark is an object recognized by human perception, and the information indicating the target of the bookmark indicates the type of object recognized by human perception. If the additional information is "music", the bookmark is a sound output as a target force, and the sound is an object recognized by human hearing.
- the person folder 121 has a person information table T101 as shown as an example in FIG.
- the data structure of the person information table T101 is the same as that of the music information table T100, and will not be described.
- the additional information in the person information table T101 is always “person”. If the additional information S is “person”, the bookmark target is a person image that constitutes a part of the displayed image, and the person image is an object that is recognized by human vision. ⁇ Character folder 122>
- the character folder 122 has a character information table T102 as shown as an example in FIG.
- the additional information in the character information table T102 is always “character”.
- the bookmark target is a character constituting a part of the displayed image, and the character is an object recognized by human vision.
- the capture information server 123 has a capture information tape information T103.
- the data structure of the capture information table T103 is the same as that of the music information table T100, and will not be described.
- the additional information in the capture information table T103 is always “capture”.
- the target power of the bookmark is an image displayed, and the image is an object recognized by human vision.
- the regional information storage unit 102 has a regional information table T110 as shown as an example in FIG.
- the area information table T110 has an area for storing one or more sets of location and area codes.
- the position is information indicating a region name, such as Osaka City and Kobe City.
- the ⁇ ya area code is the same as the area code in the music information table T100, and therefore, the description is omitted.
- Radio section 103 includes antenna 300 and transmits and receives radio signals.
- Baseband signal processing unit 104 Baseband signal processing unit 104
- Baseband signal processing section 104 performs signal processing for outputting a signal received from wireless section 103 to speaker 105 and signal processing for outputting audio received from microphone 106 to wireless section 103. Further, when receiving the information received via the Internet and the public wireless communication network via the wireless unit 103, the baseband signal processing unit 104 outputs the received information to the control unit 107. Further, when receiving the audio data from the control unit 107, the baseband signal processing unit 104 also performs signal processing for outputting the received audio data to the speaker 105.
- Speaker 105 outputs the signal processed by baseband signal processing section 104 as sound.
- Microphone 106 receives a user's voice and outputs the received voice to baseband signal processing section 104.
- Control unit 107 Control unit 107
- the control unit 107 has a GPS (Global Positioning System) function for measuring a position in advance, and controls the entire mobile phone 100.
- GPS Global Positioning System
- the control unit 107 receives from the input unit 108 bookmark instruction information indicating that bookmark information is to be registered.
- the bookmark instruction information includes correspondence information
- the correspondence information is information indicating a target of the bookmark, and indicates one of “person”, “music”, “character”, and “capture”. .
- the bookmark target is a person
- the corresponding information indicates "person”
- the bookmark is music
- the corresponding information indicates "music”
- the corresponding information is "music”.
- the corresponding information is "music”.
- the corresponding information indicates “capture”.
- control section 107 transmits the received bookmark instruction information to playback apparatus 200 via transmission / reception section 110 by infrared communication. Further, control section 107 temporarily stores the transmitted puck mark instruction information. By this, the target of the puck mark An information transmitting unit for transmitting information (corresponding information) indicating the type of the information is configured.
- the control unit 107 receives program information including the BM display time, the BM CH number, and the BM program ID from the playback device 200 via the transmission / reception unit 110, and further receives an identification name from the input unit 108. Is received. As a result, a time receiving unit that receives the program information including the BM display time is configured.
- the control unit 107 generates bookmark information using the identifier name information, the received program information, the area code information, and the corresponding information included in the temporarily stored bookmark instruction information.
- the area code included in the bookmark information is recorded only when the area code information is received from the input unit 108 together with the bookmark instruction information.
- the control unit 107 stores the generated bookmark information in one of the music information table T100, the person information table # 101, the character information table T102, and the capture information table T103 in accordance with the additional information included in the generated bookmark information. Record.
- the generated bookmark information is recorded in the music information table T100, and when it is determined that the additional information is a person, the generated bookmark information is stored.
- the information is recorded in the person information table T101, and when it is determined that the information is a character, the generated bookmark information is recorded in the character information table T102.
- the generated bookmark information is captured. Record this in information table T103.
- an information writing unit that writes the bookmark information into the bookmark storage unit 101 is configured.
- the control unit 107 When receiving the display start information indicating that the display of the bookmarked image data is to be started from the input unit 108, the control unit 107 outputs selection instruction information for prompting the user to select a storage destination of the bookmark information to the display unit 109, and performs selection.
- the input storage unit 108 receives the stored storage destination information.
- the information on the selected storage destination is information indicating any one of the music folder 120, the person folder 121, the character folder 122, and the capture folder 123.
- control unit 107 obtains an identification name included in the bookmark information recorded in the folder indicated by the selected storage destination information. For example, when the information of the selected storage destination indicates a person folder, the control unit 107 determines the identification name “person ⁇ ” from all the puck mark information recorded in the person folder 121 of the bookmark storage unit 101. "And" People Get BJ.
- the control unit 107 generates list information including all the acquired identification names, and outputs the generated list information to the display unit 109. For example, when the acquired identification names are “person A” and “person B”, list information “person Aj and“ person B ”is generated.
- control unit 107 Upon receiving the information on the selected identifier from the input unit 108, the control unit 107 acquires bookmark information corresponding to the received information on the alias from the bookmark storage unit 101. For example, when the information of the selected identification name indicates “person BJ”, control unit 107 acquires bookmark information including identification name “person BJ” from person folder 121 of bookmark storage unit 101.
- the control unit 107 transmits the obtained bookmark information and the received display start information to the playback device 200 via the wireless unit 103 using the public wireless communication network and the Internet.
- the instruction transmitting unit that transmits the bookmark information and the information indicating the display instruction is configured.
- the control unit 107 receives the still image data or the moving image data related to the transmitted bookmark information from the playback device 200 via the wireless unit 103 using the Internet and a public wireless communication network.
- receives image data of a moving image it also receives audio data of a moving image.
- a content receiving unit configured to receive the partial content including the still image or the partial content including the moving image and the audio is configured.
- the control unit 107 displays, via the display unit 109, a still image or a moving image based on the received still image data or moving image image data. Further, when audio data relating to a moving image is also received, the received audio data is output to the speaker 105 via the baseband signal processing unit 104. As a result, the control unit 107 can reproduce the received moving image.
- the content output unit that outputs the partial content including the still image or the partial content including the moving image and the audio is configured.
- the control section 107 When receiving the area display information indicating the display of the bookmarked image data relating to the current location from the input section 108, the control section 107 measures the current location using the GPS function. To do. The control unit 107 acquires the area code corresponding to the area obtained from the measurement result from the area information storage unit 102. As a result, an identifier acquiring unit for acquiring the area code is configured.
- the control unit 107 acquires all the bookmark information that matches the area code acquired from the bookmark storage unit 101, that is, includes the acquired area code. For example, when the current position is Osaka City, all the bookmark information including the area code “06” is acquired. In this case, from the character folder 122, the book information having the identification names of “character A”, “character B” and “character D” is obtained. As a result, an information acquisition unit that acquires the bookmark information is configured.
- the control unit 107 transmits all the acquired bookmark information and display start information indicating that display of the bookmarked image data is to be started to the playback device 200 via the wireless unit 103 using the public wireless communication network and the Internet. And send.
- the instruction transmitting unit is configured as described above. That is, the instruction transmitting unit is a component that transmits the bookmark information and the display start information.
- the control unit 107 receives the still image data or the moving image data related to the transmitted bookmark information from the playback device 200 via the wireless unit 103 using the Internet and a public wireless communication network.
- receives image data of a moving image it also receives audio data of a moving image.
- the content receiving unit is configured in the same manner as described above. '
- a still image or a moving image based on the received image data of the still image or the image data of the moving image is displayed via the display unit 109.
- the received audio data is output to speaker 105 via baseband signal processing section 104.
- the content output unit is configured as described above.
- the control unit 107 when transmitting a plurality of bookmark information to the playback device 200, the control unit 107 receives a still image or a moving image and a sound related to each transmitted bookmark information. At this time, the input unit 108 receives the previous image information for switching to the previous still image or the previous moving image, or the post-image information for switching to the subsequent still image or the subsequent moving image. By controlling the display, a still image or a moving image displayed on the display unit 109 is controlled.
- the input unit 108 is configured by a keyboard or the like having an input function such as a numeric input key, and receives a user power input instruction.
- Input unit 108 receives the bookmark instruction information, and outputs the received bookmark instruction information to control unit 107. Further, input section 108 receives the area code information, and outputs the received area code information to control section 107. The area code information is received when the bookmark instruction information is received, and when the area code information is output to the control unit 107, the area code information is output together with the bookmark instruction information.
- input section 108 upon receiving the identification name information, input section 108 outputs the received identification name information to control section 107.
- the input unit 108 Upon receiving the display start information, the input unit 108 outputs the received display start information to the control unit 107 and receives a selection of a storage location of the bookmark information. Next, the input unit 108 outputs the information of the selected storage destination to the control unit 107, accepts the selection of the bookmark identifier, and outputs the information of the selected identifier to the control unit 107.
- the input unit 108 when receiving the region display information, the input unit 108 outputs the received region display information to the control unit 107. Further, input section 108 receives the previous image information, and outputs the received previous image information to control section 107. Further, input section 108 receives the post-image information, and outputs the received post-image information to control section 107.
- the reception unit is configured.
- the display unit 109 Upon receiving the selection instruction information from the control unit 107, the display unit 109 assigns different numbers to the folder names of the folders included in the bookmark storage unit 101, as shown as an example in FIG. The displayed numbers and folder names are displayed as a set.
- the mobile phone 100 can prompt the user to select a storage destination of the bookmarked information, and the user inputs the number displayed on the display unit 109 from the input unit 108, and the bookmark is input.
- the storage destination of the obtained information can be selected.
- FIG. 9B shows all the identifiers included in the list information when the person folder is selected as the storage destination in FIG. 9A.
- the mobile phone 100 can prompt the user to select the bookmark information, and the user selects the bookmark information by inputting the number displayed on the display unit 109 from the input unit 108. be able to.
- the display unit 109 displays a still image or a moving image based on the image data of the still image or the image data of the moving image received from the control unit 107.
- the transmission / reception unit 110 transmits the information received from the control unit 107 to the playback device 200 by infrared communication.
- transmitting / receiving section 110 receives information from reproducing apparatus 200 by infrared communication, and outputs the received information to control section 107.
- the playback device 200 includes a program content storage unit 201, a search information storage unit 202, a playback unit 203, a registration unit 204, a data acquisition unit 205, a deletion unit 206, a first transmission / reception unit 207, and a It is composed of two transmitting / receiving units 208.
- the playback device 200 is, specifically, a computer system including a microprocessor, a ROM, a RAM, a hard disk unit, and the like.
- a computer program is stored in the ROM or the hard disk unit.
- the microprocessor operates according to the computer program, so that the playback device 200 achieves its function.
- Program content storage unit 201 (1) Program content storage unit 201
- the program content storage unit 201 has one or more areas for storing recorded program content in association with a CH number, a program ID, and a recording start time.
- the program content recorded in the program content storage unit 201 is composed of image data composed of a plurality of frames (still images) continuous along a time axis, and audio data indicating audio in each frame.
- the program ID is recorded by the playback device 200 when recording the program content. Shall be granted.
- the program content "AAA” is, CH number "2”, turn set 10 "020003", a recording start time "2003 / 08/01 19:00: 00" and associated And is remembered.
- the content storage unit in which the program content is recorded in advance is configured.
- the search information storage unit 202 has a search information table T200 as shown as an example in FIG.
- the search information table T200 includes an area for storing one or more sets of a display time for search, a CH number for search, a program ID for search, and additional information for search.
- the display time for search, CH number for search, program ID for search, and additional information for search are referred to as search information.
- the search display time is the broadcast time at which the bookmarked image data was broadcast, and is indicated by date and time.
- the search CH number is the CH number corresponding to the bookmarked program content
- the search program ID is the program ID corresponding to the bookmarked program content.
- the additional information for search is information indicating a bookmark target, and any one of “music”, “person”, “character”, and “capture” is recorded.
- the reproduction unit 203 has a reproduction information storage area for storing a CH number, a program ID, and a recording start time corresponding to a program content to be reproduced.
- the reproduction unit 203 reproduces the program content stored in the program content storage unit 201.
- the playback unit 203 stores the CH number, the program ID, and the recording start time corresponding to the program content to be played back in the playback information storage area, and at the end of the playback of the program content. Delete the channel number, program ID and recording start time.
- the registration unit 204 counts and re-counts the number of frames reproduced from the start of the reproduction.
- the registration unit 204 is connected to the mobile phone via the first transmission / reception unit 207 during the reproduction of the program content. From 100, the puck mark instruction information is received using infrared communication. As a result, an information receiving unit that receives information (corresponding information) indicating the type of the bookmark target is configured.
- the registration unit 204 uses the number of frames counted up to the point in time when the bookmark instruction information is received, and reproduces the image data card located at the head of the program content by the playback unit 203 when the bookmark instruction information is received. Calculate the elapsed time in the section up to the existing image data.
- the registration unit 204 obtains the recording start time stored in the reproduction unit 203, and adds the calculated elapsed time to the obtained recording start time to obtain the broadcast time of the image data at the time when the bookmark instruction information is received. To get. Further, the registration unit 204 acquires a CH number and a program ID corresponding to the program content being reproduced from the reproduction unit 203.
- program content broadcasted in the NTSC (National Television System Committee) format contains 30 frames (still images) of image data per second.
- the elapsed time can be specified in units of about 33 ms, but in the present embodiment, the elapsed time is calculated in minutes and seconds and added to the recording start time to avoid complicating the description. Also, from the relationship between the obtained broadcast time and the number of frames reproduced per second, the frame at the time when the bookmark instruction information is received can be specified from the obtained broadcast time.
- the position acquisition unit configured to acquire information (in this case, broadcast time) for specifying the position in the program content at the time of receiving the bookmark information is configured.
- the registration unit 204 generates program information using the obtained broadcast time, CH number, and program ID, and uses the generated program information to the mobile phone 100 via the first transmission / reception unit 207 using infrared communication. And send. As a result, the time transmitting unit that transmits the program information including the broadcast time is completed.
- the registration unit 204 also generates and generates search information using the obtained broadcast time, the corresponding information included in the received bookmark instruction information, and the CH number and program ID obtained from the playback unit 203. Write the retrieved search information to the search information table T200.
- the display time for search, the CH number for search, the program ID for search, and the additional information for search, which are included in the search information are the bookmarks generated by the mobile phone 100 using the transmitted program information.
- the data acquisition unit 205 includes a number of still images for generating moving images to be transmitted to the mobile phone 100 (for example, 300), a program for performing music recognition processing (hereinafter, referred to as “music recognition processing”), and a person.
- music recognition processing a program for performing music recognition processing
- person recognition processing a program that performs recognition processing
- character recognition processing a program that performs character recognition processing
- program a program that performs capture recognition processing
- the music recognition process is a process of searching for a music head frame located at the head of a music section, which is a section where characteristic sounds are periodically repeated, in audio data of program content by a predetermined algorithm.
- the person recognition process is a process of searching for a head frame of a person in which the person indicated by the image data corresponding to the BM display time included in the bookmark information appears in the image data of the program content using a predetermined algorithm. is there.
- the character recognition process is a process of searching a character head frame in which a telop appears in image data of program content by a predetermined algorithm.
- the capture recognition process is a process in which, in the image data in the program content, a scene power, which is a group of frames photographed consecutively in time, is used as a start frame that has been switched from another scene. This is the process of searching by algorithm.
- a program for performing music recognition processing a program for performing person recognition processing, a program for performing character recognition processing, and a program for performing capture recognition processing are referred to as music recognition processing, person recognition processing, character recognition processing, and capture processing, respectively. This is called recognition processing.
- the data acquisition unit 205 When receiving the mark information and the display start information from the mobile phone 100 via the second transmission / reception unit 208, the data acquisition unit 205 corresponds to the BM CH number and the BM program ID included in the received bookmark information. Obtain program content from program content storage unit 201 To do. At this time, since there may be a plurality of program contents corresponding to the BM CH number and the BM program ID due to the deletion of the program content described later, the program content corresponding to the BM CH number and the BM program ID may be deleted. If a plurality of program contents have been acquired, the program content of which the recording start time matches the time indicated by the BM display time included in the bookmark information is acquired. As a result, even when there are a plurality of program contents corresponding to the BM CH number and the BM program ID, one program content can be obtained.
- the data acquisition unit 205 acquires a still image or a moving image from the acquired program content by an acquisition method described below.
- a partial content acquisition unit for acquiring a bookmarked still image or moving image from the program content is configured.
- the data acquisition unit 205 transmits the acquired still image or moving image as image data to the mobile phone 100 via the second transmission / reception unit 208. Note that when transmitting a moving image, audio data relating to the moving image is also transmitted.
- the data acquisition unit 205 judges whether or not the additional information included in the bookmark information is “music”. If it is determined that the content is “music”, music recognition processing is performed using the display time for BM included in the puck mark information and the program content obtained from the program content storage unit 201, and the , The nearest music head frame located before the frame indicated by the BM display time is detected, and 300 consecutive frames from the detected music head frame are acquired by copying, and each acquired frame is copied. The corresponding audio data is also obtained by copying. In other words, the data acquisition unit 205 can acquire a total of 300 frames and audio data including the music head frame by copying. As a result, the data acquisition unit 205 acquires the moving image and its sound by copying.
- the additional information included in the bookmark information is not “music”, it is determined whether or not it is a “person”, and when it is determined that the additional information is “person”, the additional information is included in the bookmark information.
- the BM display time and the program content obtained from the program content storage unit 201 to perform the person recognition process the BM display time in the program content is obtained.
- the closest person leading frame located before the frame indicated by is detected, and the detected person leading frame is obtained by copying.
- the additional information included in the bookmark information is not a “person”, it is determined whether or not the additional information is a “character”. When it is determined that the additional information is a “character”, the additional information is included in the bookmark information.
- the program content can be used for the most recent frame located before the frame indicated by the BM display time. Detects the character top frame and obtains the detected character top frame by copying.
- the display time for BM and the program content stored in the bookmark information are stored.
- the capture recognition process By executing the capture recognition process using the program content obtained from the unit 201, the latest capture start frame located before the frame indicated by the BM display time is detected and detected in the program content. Acquire the captured capture start frame by copying.
- the position before the frame means that the position is between the start position of the program content and the position indicated by the BM display time.
- the deletion unit 206 stores music recognition processing, person recognition processing, character recognition processing, and capture recognition processing in advance.
- the deletion unit 206 receives deletion instruction information from the user indicating that the program content recorded in the program content storage unit 201 is to be deleted.
- the deletion instruction information is information including a program ID.
- the deletion unit 206 acquires the program content corresponding to the program ID included in the received deletion instruction information from the program content storage unit 201, and further retrieves a search program ID matching the program ID from the search information storage unit 202. Get all search information including.
- the deletion unit 206 repeats a deletion method described below for the number of obtained search information.
- the deletion unit 206 determines whether the additional information for search included in the search information is “music”. I refuse. If it is determined to be “music”, music recognition processing is executed using the search display time included in the search information and the acquired program content, and the latest position is located before the search display time. Of the music head frame of the music, and further obtains and obtains the music audio image data composed of the continuous frames and the sound data for a predetermined time (for example, three minutes) by the detected music head frame. The music audio image data is temporarily stored in association with the program ID, CH number, and search display time.
- the additional information for search included in the search information is not “music”
- a human recognition process is performed to detect the latest person first frame located before the search display time, and The detected person's head frame power is obtained by copying the person's sound image data consisting of continuous frames and sound data for a preset time (for example, 3 minutes) and copying the obtained person's sound image data to the program ID, It is temporarily stored in association with the CH number and the display time for search.
- the additional information for search included in the search information is not a “person”
- it is determined whether or not the character is a “character”.
- Character recognition processing is performed using the search time included in the search and the program content obtained from the program content storage unit 201, and the most recent character head frame located before the display time for the search is detected.
- character audio image data consisting of consecutive frames and audio data for a preset time (for example, 3 minutes) from the detected character head frame is obtained by copying, and the obtained character audio image data is used as a program ID, It is temporarily stored in association with the CH number and the display time for search.
- the display time for search included in the search information and the program Using the program content acquired from the content storage unit 201, a capture recognition process is executed to detect the most recent capture first frame located before the search display time, and furthermore, the detected capture first frame power is set in advance. Acquisition audio / video data consisting of consecutive frames and audio data for the specified time (for example, 3 minutes) is acquired by copying, and the acquired audio / video data for capture is associated with the program ID, CH number, and display time for search. And store it temporarily.
- audio image data Call when it is not necessary to distinguish audio image data for music, audio image data for people, audio image data for characters, and audio image data for capture, audio image data Call.
- the deletion unit 206 deletes the program content and stores the temporarily stored audio / video data in the program content storage. It is stored in the unit 201.
- the recording start time is the date and time indicated by the search display time.
- the deletion unit 206 acquires the search information 400 and 401 from the search information storage unit 202.
- search display time included in the obtained search information 400 capture voice image data (hereinafter, referred to as “FFF_1J”) near the time indicated in the search display time is obtained, and the obtained FFF- 1 is temporarily stored in association with the program ID, the CH number, and the search display time, and the search display time included in the obtained search information 401 is used to temporarily store the time near the time indicated in the search display time.
- Acquisition audio and video data for capture hereinafter referred to as “FFF-2” is obtained, and the obtained FFF-2 is temporarily stored in association with the program ID, CH number, and display time for search.
- the deletion unit 206 deletes the “FFF” stored in the program content storage unit 201 and the corresponding program ID, CH number, and recording start time, and temporarily deletes the stored key.
- FIG. 13 shows the contents stored in the program content storage unit 201 at this time. As described above, the program content “FFF” is deleted, and “FFF-1” and “FFF-2” are stored. (7) First transceiver 207
- First transmitting / receiving section 207 outputs information received from mobile phone 100 by infrared communication to registration section 204.
- first transmitting / receiving section 207 transmits the information received from registration section 204 to mobile phone 100 by infrared communication.
- the second transmission / reception unit 208 outputs information received from the mobile phone 100 via the Internet to the data acquisition unit 205.
- the second transmission / reception unit 208 transmits the information received from the data acquisition unit 205 to the mobile phone 100 via the Internet.
- mobile phone 100 Upon receiving the bookmark instruction information from the user, mobile phone 100 transmits the received bookmark instruction information to playback device 200 (step S10).
- the playback device 200 Upon receiving the bookmark instruction information from the mobile phone 100, the playback device 200 obtains the CH number, the program ID, and the broadcast time of the bookmarked image data (step S15), and obtains the obtained broadcast time and CH number. Then, program information is generated using the program ID and the program ID, and the generated program information is transmitted to the mobile phone 100 (step S20). Note that the broadcast time IJ in step S15 must be calculated by calculating the elapsed time up to the point at which the puck mark instruction information is received, and adding the recording start time of the program content being played back to the calculated elapsed time. Can be.
- the mobile phone 100 receives the program information from the playback device 200 and further inputs an identification name 1
- the bookmark information is generated using the bookmark instruction information received in step S10, the received identifier, and the received program information (step S25).
- the mobile phone 100 stores the generated bookmark information in the bookmark information according to the content of the additional information included in the generated bookmark information by the bookmark information storing process. It is stored in the unit 101 (step S30).
- step S10 only when the local code information is received from the user, the local code indicated by the received local code information is recorded in the local code included in the generated bookmark information.
- the playback device 200 generates search information using the bookmark instruction information received in step S15 and the broadcast time, CH number, and program ID obtained in step S15, and stores the generated search information in the search information storage unit 202. (Step S35).
- the mobile phone 100 receives the selection of the identifier from the user, and transmits the bookmark information and the display start information corresponding to the received identifier to the playback device 200 (step S50).
- the playback device 200 Upon receiving the bookmark information and the display start information from the mobile phone 100, the playback device 200 performs an image data obtaining process to obtain the received bookmark information and the image data corresponding to the received bookmark information.
- Send to 100 step S55.
- the mobile phone 100 displays an image based on the received image data (step S60).
- the mobile phone 100 measures the position using the GPS function, and acquires the area code of the area where the current position is located from the measurement result (step S100). Next, the mobile phone 100 acquires the bookmark information including the acquired area code from the bookmark storage unit 101, and transmits the acquired bookmark information and display start information to the playback device 200 (step S105).
- the playback device 200 Upon receiving the bookmark information from the mobile phone 100, the playback device 200 performs an image data obtaining process, obtains the image data corresponding to the received bookmark information, and transmits the obtained image data to the mobile phone 100 (step S110).
- the mobile phone 100 Upon receiving the image data from the playback device 200, the mobile phone 100 displays an image based on the received image data (step S115).
- step S105 When a plurality of pieces of bookmark information are obtained in step S105, all the obtained bookmark information is transmitted to the playback device 200, and in step S110, the received bookmark information is received. It acquires the image data corresponding to each piece of the mark information and transmits all the acquired image data. Furthermore, mobile phone 100, in step S11 5, by pre-accepting image information or rear image information, and controls the image data to be displayed.
- the control unit 107 determines whether or not the additional information included in the bookmark information is “music” (Step S200).
- the bookmark information is written into the music folder 120 (step S205). If it is determined that the information is not "music”, whether or not the additional information is "person” is determined. Is determined (step S210).
- Step S220 If it is determined to be "person”, the bookmark information is written to the person folder 121 (step S215). If it is determined that it is not "person”, it is determined whether the additional information is "character”. (Step S220).
- the bookmark information is written to the character folder 122 (step S225), and if it is determined that it is not “character”, that is, if it is determined that the additional information is "capture”, Then, the bookmark information is written to the capture folder 123 (step S230).
- the data acquisition unit 205 receives the bookmark information from the mobile phone 100 (step S30).
- program content acquisition processing is performed using the received bookmark information, thereby acquiring program content corresponding to the received bookmark information from the program content storage unit 201 (step S305).
- step S310 it is determined whether or not the additional information included in the received bookmark information is “music” (step S310).
- the data acquisition unit 205 executes music recognition processing to detect and acquire the music head frame from the acquired program content card (step S315), and furthermore, Next, a continuous frame from the acquired music top frame color is acquired by copying for a preset number of minutes, and audio data is also acquired by copying (step S320).
- the data acquisition unit 205 transmits, as image data, a frame that is continuous from the acquired music head frame, that is, a moving image from the music head frame, to the mobile phone 100 together with audio data relating to the moving image (step S325).
- the audio data of the acquired music head frame is acquired by copying.
- step S310 If it is determined in step S310 that it is not "music”, it is determined whether the additional information is "person” (step S330).
- the data acquisition unit 205 executes a person recognition process to detect and acquire a person head frame from the acquired program content (step S335), and obtains the acquired person head.
- the still image including the frame is transmitted as image data to the mobile phone 100 (step S340).
- step S330 If it is determined in step S330 that the additional information is not “person”, it is determined whether the additional information is “character” (step S345).
- the data acquisition unit 205 executes a character recognition process to detect and acquire a character leading frame from the acquired program content (step S350), and acquires the acquired character leading frame.
- the still image including the frame is transmitted as image data to the mobile phone 100 (step S355).
- step S345 If it is determined in step S345 that it is not a “character”, that is, if it is determined that the additional information is “capture”, the data acquisition unit 205 executes a capture recognition process to acquire the acquired program content. , The capture first frame is detected and acquired (step S360), and the obtained capture first frame power and a still image are transmitted to the mobile phone 100 as image data (step S365).
- step S300 When a plurality of pieces of bookmark information are received in step S300, the operations from step S305 to step S365 are repeated for the number of the received bookmark information.
- detecting and acquiring a frame means detecting a frame and acquiring the detected frame by copying.
- step S305 of the image data acquisition process shown in FIG. The tenth acquisition process will be described with reference to the flowchart shown in FIG.
- the data acquisition unit 205 acquires at least one or more of the BM CH number of the received bookmark information and the number and content corresponding to the BM program ID from the program content storage unit 201 (step S370). Next, it is determined whether or not the acquired program content is one (step S375).
- step S380 If it is determined that the number of acquired program contents is one, the process is terminated. If it is determined that the number of acquired program contents is not one! /, Recording of multiple acquired program contents is performed. The program content whose start time matches the time indicated by the BM display time included in the bookmark information is acquired (step S380).
- the deletion unit 206 Upon receiving the deletion instruction information (step S400), the deletion unit 206 obtains the program content corresponding to the program ID included in the received deletion instruction information from the program content storage unit 201, and further retrieves the program ID corresponding to the program ID. All information is obtained from the search information storage unit 202 (step S405).
- the deletion unit 206 executes music recognition processing to detect a music head frame (step S415), and further uses the detected music head frame to perform music sound.
- the image data is acquired by copying, and the acquired audio image data for music is temporarily stored in association with the program ID, the CH number, and the display time for search (step S420).
- step S410 When it is determined in step S410 that the additional information is not “music”, it is determined whether the additional information for search is “person” (step S425).
- the deletion unit 206 performs a person recognition process to detect a person's first frame (step S430), and uses the detected person's first frame to generate a person audio image.
- the data is obtained by copying, and the obtained voice image data for a person is temporarily stored in association with the program ID, the CH number, and the display time for search. (Step S435).
- step S425 If it is determined in step S425 that the character is not “person”, the additional information for search is “character”. Is determined (step S440).
- the deletion unit 206 performs a character recognition process to detect a character head frame (step S445), and uses the detected character head frame to generate a character voice image data. Is acquired by copying, and the acquired audio / video data for text is temporarily stored in association with the program ID, CH number, and display time for search (step S450).
- step S440 If it is determined in step S440 that the character is not a “character”, that is, if the additional information for search is “capture”, the deletion unit 206 executes a capture recognition process to execute a key recognition process.
- the first frame of the capture is detected (step S455), the captured audio image data is obtained by copying using the detected first frame of the capture, and the obtained audio image data for the capture is acquired by the program ID, the CH number, and the display time for search. And temporarily store them (step S460).
- the deletion unit 206 determines whether there is search information that has not been processed from step S410 to step S460 among the search information acquired in step S405 (step S465), and the search information exists. If it is determined, search information that has not been processed is obtained (step S470), and the process returns to step S410, and the operation from step S410 is performed on the obtained search information.
- step S465 there is no search information that has not been processed S from step S410 to step S460. That is, step S410 is performed on all search information acquired in step S405. If it is determined that the processing from step S460 to step S460 has been performed, the program content is deleted (step S475), and the temporarily stored audio / video data is deleted from the program ID, CH number, display time for search, and the like. The information is stored in the program content storage unit 201 in association with it (step S480).
- a bookmark system performs bookmarking using a mobile phone while playing back content on a playback device, generates bookmark information, and stores the generated bookmark information. Then, at a later date, the bookmark information can be stored and used, and the image data bookmarked by the mobile phone can be displayed.
- the playback device can acquire image data at high speed by using the bookmark information received from the mobile phone.
- the image data that the user wants to bookmark and the image data that is actually bookmarked may be different from the image data due to the influence of the time required to receive the bookmark indication information transmission power.
- the illustrated reproducing apparatus executes the recognition processing corresponding to the information indicated by the additional information among the music recognition processing, the person recognition processing, the character recognition processing, and the capture recognition processing at the time of acquiring the image data. Can acquire the desired image data more accurately than before, and transmit the acquired image data to the mobile phone.
- the mobile phone can receive information such as the broadcast time and the program ID of the image data marked with the playback device bookmark by bidirectional communication.
- the mobile phone automatically sorts the generated bookmark information into folders according to the contents, so that the bookmark information can be easily organized.
- the bookmark information is stored in the mobile phone.
- a modified example in which the bookmark information is stored only in the playback device will be described.
- the playback device 1000 includes a program content storage unit 1001, a bookmark storage unit 1002, a playback unit 1003, a registration unit 1004, a data acquisition unit 1005, a deletion unit 1006, a reception unit 1007, and a transmission / reception unit 1008. It is configured.
- the playback device 1000 is, specifically, a computer system including a microprocessor, a ROM, a RAM, a hard disk unit, and the like.
- a computer program is stored in the ROM or the hard disk unit. By operating the microprocessor according to the computer program, the playback device 1000 achieves its function.
- the program content storage unit 1001 is the same as the program content storage unit 201 described above, and a description thereof will not be repeated.
- the bookmark storage unit 1002 has the same format as the bookmark storage unit 101 described above. It has a damper configuration. The difference from the above embodiment is that the bookmark information further includes a telephone ID for identifying the mobile telephone in addition to the data described in the above embodiment.
- FIG. 23 shows an example of the music information table T1000 stored in the music folder.
- the music information table T1000 includes an identification name, BM display time, BM CH number, BM program ID, area code, terminal identifier, and additional information.
- the terminal identifier is a telephone ID for identifying a mobile telephone.
- the remaining items are the same as in the above-described embodiment, and a description thereof will not be repeated.
- each table stored in the other folders is the same as the configuration of the music information table T1 000, and thus the description is omitted.
- the playback unit 1003 is the same as the playback unit 203 described above, and a description thereof will be omitted.
- the registration unit 1004 counts the number of reproduced frames from the start of reproduction.
- the registration unit 1004 receives the bookmark instruction information and the telephone ID for identifying the mobile phone 1100 from the mobile phone 1100 via the reception unit 1007 during the reproduction of the program content.
- the registration unit 1004 obtains the broadcast time of the bookmarked image data by the same operation as the registration unit 204 described above, and further obtains the CH number and the CH number corresponding to the program content being reproduced from the reproduction unit 1003. ⁇ Get the program ID.
- the frame at the time point when the bookmark instruction information is received can be specified from the obtained broadcast time based on the relationship between the obtained broadcast time and the number of frames reproduced per second.
- the position acquisition unit configured to acquire the information (here, the broadcast time) for specifying the position in the program content at the time of receiving the bookmark information is configured.
- registration section 1004 receives the identification name from mobile phone 1100 via reception section 1007.
- the registration unit 1004 stores the obtained broadcast time, the corresponding information included in the received puck mark instruction information, the received telephone ID and identification name, and the CH number and number obtained from the playback unit 1003. Using the group ID, bookmark information is generated, and the generated bookmark information is written to a folder in the bookmark storage unit 1002 according to the additional information included in the bookmark information. After receiving the puck mark instruction information and further receiving the area code, the registration unit 1004 receives the broadcast time, the corresponding information included in the received bookmark instruction information, the received phone ID, the area code and the identification code. Using the name, the CH number and the program ID obtained from the playback unit 1003, generate bookmark information and store the generated bookmark information in a folder in the puck mark storage unit 1002 corresponding to the tag information included in the puck mark information. Write to
- a writing unit for writing the puck mark information is configured.
- the registration unit 1004 also has an information receiving unit that receives information (corresponding information) indicating the type of the target of the mark, the telephone ID, the identification name, and the area code.
- the data acquisition unit 1005 stores the number of still images that generate moving images to be transmitted to the mobile phone 1100 (for example, 300), and further includes “music recognition processing”, “person recognition processing”, Programs corresponding to “character recognition processing” and “capture recognition processing” are stored in advance. In addition, it has an ID storage area for temporarily storing a telephone ID received from the mobile telephone 1100.
- the data acquisition unit 1005 Upon receiving display start information indicating that display of bookmarked image data is to be started and a telephone ID from the mobile phone 1100 via the transmission / reception unit 1008, the data acquisition unit 1005 selects a storage destination of the bookmark information. In order to prompt the user, a different number is assigned to the folder name of each folder in the bookmark storage unit 1002, a storage destination list in which the allocated number and the folder name are paired is generated, and the generated storage destination list is generated. The data is transmitted to the mobile phone 1100 via the transmission / reception unit 1008. Also, the received telephone ID is stored in the ID storage area. Note that the screen image of the storage destination list is the same as that in FIG. The data acquisition unit 1005 stores the selected folder information indicating the selected storage destination in the mobile phone.
- the data is received from 1100 via the transmission / reception unit 1008.
- the selected folder information is information including a number assigned to the selected folder.
- the data acquisition unit 1005 stores the bookmark information stored in the folder indicated by the selected folder information in the ID storage area, and retrieves the bookmark information including the telephone ID. All the bookmark information is obtained, and the identification name included in each of the obtained bookmark information is obtained. De
- the data acquisition unit 1005 generates a list list including all the acquired identification names, and transmits the generated list to the mobile phone 1100 via the transmission / reception unit 1008.
- the list is a list in which different numbers are assigned to the respective identification names. Note that the screen image of the storage destination list is the same as that in FIG.
- the data acquisition unit 1005 receives selected identifier information indicating the selected identifier from the mobile phone 1100 via the transmission / reception unit 1008.
- the receiving unit configured to receive the information indicating the display instruction is configured.
- the data acquisition unit 1005 acquires, from the bookmark storage unit 1002, bookmark information corresponding to the identification name indicated by the received selected identification name information.
- the selected identifier information is information composed of a number assigned to the selected identifier.
- the data acquisition unit 1005 stores the BM CH number and B included in the acquired bookmark information.
- the program content corresponding to the M program ID is obtained from the program content storage unit 1001. At this time, when a plurality of program contents corresponding to the BM CH number and the BM program ID are acquired, the recording start time of the acquired plurality of program contents is determined by the BM display time included in the bookmark information. The program content that matches the indicated time is acquired.
- the data acquisition unit 1005 acquires a still image or a moving image from the acquired program content by copying in the same manner as the acquisition method described above.
- a moving image When a moving image is acquired, its sound is also acquired by copying.
- the data acquisition unit 1005 thins (degrades) the acquired still image or moving image, and lowers the image quality of the image transmitted to the mobile phone 1100. Decimation is possible, for example, by converting 16-bit data to 8-bit data.
- a partial content acquisition unit for acquiring a bookmarked still image or moving image from the program content is configured.
- the data acquisition unit 1005 transmits a still image or a moving image whose image quality has been reduced to the mobile phone 1100 via the transmission / reception unit 1008 as image data. Note that when transmitting a moving image, audio data relating to the moving image is also transmitted. As a result, a content transmitting unit that transmits partial content composed of still images or partial content composed of moving images and audio is configured.
- the data acquisition unit 1005 needs the image data with the mark marked for the current location.
- the image data request information, the area code, and the telephone ID to be requested are received from the mobile telephone 1100 via the transmission / reception unit 1008.
- an identifier receiving unit that receives the image data request information and the area code is configured.
- the data acquisition unit 1005 acquires from the bookmark storage unit 1002 all the bookmark information that matches both the received area code and telephone ID.
- the data acquisition unit 1005 acquires a still image or a moving image corresponding to the additional information included in each piece of bookmark information by the same acquisition method as described above for all the acquired bookmark information.
- the data acquisition unit 1005 thins out and transmits each image with reduced image quality to the mobile phone 1100 via the transmission / reception unit 1008 in the same manner as described above.
- audio data relating to the moving image is also transmitted to the mobile phone 1100 via the transmitting / receiving unit 1008.
- the content transmission unit is configured as described above.
- the deletion unit 1006 is the same as the deletion unit 206 described above, and a description thereof will be omitted. (7) Receiver 1007
- Receiving section 1007 outputs information received from mobile phone 1100 via infrared communication to registration section 1004.
- the transmission / reception unit 1008 outputs information received from the mobile phone 1100 via the Internet to the data acquisition unit 1005.
- the transmitting / receiving unit 1008 transmits the information received from the data acquiring unit 1005 to the mobile phone 1100 via the Internet.
- the mobile phone 1100 includes a local information storage unit 1102, a radio unit 1103, a base signal processing unit 1104, a speaker 1105, a microphone 1106, a control unit 1107, and an input unit 1
- a display unit 1109 a display unit 1109, a transmission unit 1110, and an identifier storage unit 1111.
- the mobile phone 1100 is a computer system including a microprocessor, a ROM, a RAM, a display unit, and the like.
- the ROM stores a computer program.
- the microprocessor may include the computer program Therefore, by operating, the mobile phone 1100 achieves its function.
- the local information storage unit 1102 is the same as the above-described local information storage unit 102, and a description thereof will not be repeated.
- the identifier storage unit 1111 stores a telephone ID for identifying the mobile telephone 1100!
- the wireless unit 1103 includes an antenna 1300 and transmits and receives wireless signals.
- Baseband signal processing section 1104 performs signal processing for outputting a signal received from wireless section 1103 to speaker 1105 and signal processing for outputting audio received from microphone 1106 to wireless section 1103.
- the baseband signal processing unit 1104 when receiving the information received via the Internet and the public wireless communication network via the wireless unit 1103, the baseband signal processing unit 1104 outputs the received information to the control unit 1107.
- the baseband signal processing unit 1104 Upon receiving the display start information, the selected folder information, the selected identification name information, and the image data request information from the control unit 1107, the baseband signal processing unit 1104 receives the display start information, the selected folder information, the selected identification name information, and the image. The data request information is transmitted to the playback device 1000 via the wireless unit 1103, the public wireless communication network, and the Internet. Upon receiving the image data request information from the control unit 1107, the baseband signal processing unit 1104 further receives a region code, and transmits the received region code together with the image data request information to the public wireless communication network and the Internet. To the playback device 1000 via the When receiving the audio data from the control unit 1107, the baseband signal processing unit 1104 also performs signal processing for outputting the received audio data to the speakers 1105.
- the speaker 1105 is the same as the speaker 105 described above, the description is omitted.
- the microphone 1106 is the same as the microphone 106 described above, and a description thereof will be omitted. (7) Control unit 1107
- the control unit 1107 is provided with a GPS (Global Positioning System) function for measuring a position, and controls the entire mobile phone 1100.
- GPS Global Positioning System
- bookmark information registration designated display, and regional display.
- the control unit 1107 receives the bookmark instruction information from the input unit 1108.
- the control unit 1107 also receives the area code information from the input unit 1108 together with the bookmark instruction information.
- control unit 1107 transmits the received bookmark instruction information and the telephone ID stored in identifier storage unit 1111 to playback device 1000 via transmission unit 1110 by infrared communication.
- the control unit 1107 transmits the area code together with the area code to the playback device 1000 via the transmission unit 1110.
- the controller 1107 transmits the received identifier to the playback device 1000 via the transmitter 1110 by infrared communication.
- the information transmitting unit configured to transmit the information (corresponding information) indicating the type of the bookmark target, the telephone ID, the area code, and the identifier is configured.
- control unit 1107 When receiving the display start information from the input unit 1108, the control unit 1107 acquires the telephone ID, and transmits the received display start information and the acquired telephone ID to the playback device 10 via the wireless unit 1103.
- the data is transmitted using the Internet and a public wireless communication network.
- control unit 1107 Upon receiving the storage destination list from playback device 1000 via the Internet and a public wireless communication network, control unit 1107 outputs the received storage destination list to display unit 1109.
- control unit 1107 Upon receiving the selected folder information from the input unit 1108 by a key operation by the user, the control unit 1107 outputs the received selected folder information to the baseband signal processing unit 1104. The control unit 1107 transmits the list to a playback device via the Internet and a public wireless communication network.
- the received list is output to the display unit 1109.
- control unit 1107 Upon receiving the selected identification name information from input unit 1108 by a key operation by the user, control unit 1107 outputs the received selected identification name information to baseband signal processing unit 1104. As described above, the instruction transmitting unit is configured.
- the control unit 1107 receives image data of a still image or image data of a moving image corresponding to the bookmark information including the selected identification name from the playback device 1000 via the Internet and a public wireless communication network. Also, when receiving a moving image, it also receives audio data related to the moving image. As a result, a content receiving unit that receives a partial content composed of a still image or a partial content composed of a moving image and audio is configured.
- the control unit 1107 displays, via the display unit 1109, a still image or a moving image based on the received still image data or moving image image data. If audio data is also received, the received audio data is output to the speaker 1105 via the baseband signal processing unit 1104. As a result, the control unit 1107 can reproduce the received moving image.
- a content output unit is configured.
- control unit 1107 When receiving the region display information from the input unit 1108, the control unit 1107 measures the current position using the GPS function. Control unit 1107 obtains a region code corresponding to the region obtained from the measurement result from region information storage unit 1102, and further obtains a telephone ID from identifier storage unit 1111.
- the control unit 1107 outputs the obtained area code, telephone ID, and image data request information to the baseband signal processing unit 1104.
- the control unit 1107 receives the still image data or the moving image image data corresponding to each of the pack mark information related to the transmitted area code from the reproducing apparatus 1000 via the Internet and a public wireless communication network. A still image or a moving image based on the image data or the moving image is displayed via the display unit 1109. In addition, when receiving a moving image, it also receives audio data relating to the moving image and outputs the received audio data to the speaker 1105 via the baseband signal processing unit 1104. As a result, the control unit 1107 can reproduce the received moving image.
- control unit 1107 receives the previous image information or the rear image information from the input unit 1108, and thereby displays the still image or the moving image displayed on the display unit 1109. Control the image.
- the input unit 1108 is configured by a keyboard or the like having an input function such as a numeric input key, and receives an input instruction from a user.
- Input unit 1108 receives the bookmark instruction information and outputs the received bookmark instruction information to control unit 1107. Also, input section 1108 receives the area code information, and outputs the received area code information to control section 1107. The area code information is received when the bookmark instruction information is received, and is output together with the bookmark instruction information when the area code information is output to the control unit 1107.
- input section 1108 outputs the received identification name information to control section 1107.
- input unit 1108 Upon receiving the display start information, input unit 1108 outputs the received display start information to control unit 1107. Further, input unit 1108 receives the selected folder information and the selected identification name information, and outputs the received selected folder information and the selected identification name information to control unit 1107.
- input section 1108 upon receiving the area display information, input section 1108 outputs the received area display information to control section 1107. Further, input section 1108 accepts previous image information and rear screen information, and outputs received front image information and rear screen information to control section 1107.
- the reception unit is configured.
- the display unit 1109 When receiving the storage destination list from the control unit 1107, the display unit 1109 displays the received storage destination list.
- the display unit 1109 Upon receiving the list from the control unit 1107, the display unit 1109 displays the received list.
- the display unit 1109 displays the still image or the moving image received from the control unit 1107. Note that the image displayed on the display unit 1109 is an image whose image quality has been reduced by the thinning-out performed in the playback device 1000.
- the transmitting unit 1110 transmits the information received from the control unit 1107 to the playback device 10 by infrared communication.
- the identifier storage unit 1111 When the mobile phone 1100 receives the bookmark instruction information from the user (step S1000), the identifier storage unit 1111 also acquires the phone ID (step S1005). The mobile phone 1100 transmits the bookmark instruction information and the phone ID to the playback device 1000 (step S1 010). Note that, in step S1000, if the bookmark instruction information is added and the area code is also received, the received area code is also transmitted in step S1010. Upon receiving the puck mark instruction information and the telephone ID from the mobile phone 1100 (step S1015), the playback device 1000 acquires the CH number, the program ID, and the broadcast time of the bookmarked image data (step S1020). ).
- the mobile phone 1100 further receives the identifier, and transmits the received identifier to the playback device 1000 (step S1025).
- the playback device 1000 receives the identification name from the mobile phone 1100 (step S1030), and uses the received identification name, correspondence information and telephone ID, and the obtained broadcast time, CH number, and program ID to store the bookmark information.
- a bookmark information is stored (step S1035), and the generated bookmark information is stored in a folder corresponding to the additional information included in the generated bookmark information (step S1040).
- the playback device 1000 transmits the corresponding information included in the received bookmark instruction information and the received phone ID, area code, and identification name.
- Bookmark information is generated using the obtained broadcast time, the CH number and the program ID obtained from the playback unit 1003, and the generated bookmark information is stored in a folder corresponding to the corresponding information included in the bookmark information. I do.
- bookmark information storage processing The details of the bookmark information storage processing are the same as the operations shown in FIG. 17, and thus description thereof will be omitted.
- the mobile phone 1100 Upon receiving the display start information (step S1100), the mobile phone 1100 obtains the telephone ID (step S1105), and transmits the received display start information and the obtained telephone ID to the playback device 1000 (step S1110). ).
- the playback device 1000 Upon receiving the display start information and the phone ID from the mobile phone 1100 (step S1115), the playback device 1000 generates a storage destination list, transmits the generated storage destination list to the mobile phone 1100, and stores the received phone ID. It is stored in the ID storage area (step S1120).
- the mobile phone 1100 Upon receiving the storage destination list from the playback device 1000 via the Internet and a public wireless communication network, the mobile phone 1100 displays the received storage destination list (step S1125). Upon receiving the selected folder information by a key operation by the user, the mobile phone 1100 transmits the received selected folder information to the playback device 1000 (step S1130).
- the playback device 1000 receives the selected folder information from the mobile phone 1100 (step S1135).
- the playback device 1000 further obtains all the bookmark information including the telephone ID stored in the ID storage area from among the bookmark information recorded in the folder indicated by the selected folder information.
- the mobile terminal 1100 obtains the identification name included in the bookmark information, generates a list, and transmits the generated list to the mobile phone 1100 (step S1140).
- the mobile phone 1100 Upon receiving the list from the playback device 1000 via the Internet and the public wireless communication network, the mobile phone 1100 displays the received list (step S1145).
- mobile phone 1100 Upon receiving the selected identification name information by a key operation by the user, mobile phone 1100 transmits the received selected identification name information to playback device 1000 (step S1150).
- the playback device 1000 Upon receiving the selected identifier information from the mobile phone 1100 (step S1155), the playback device 1000 acquires bookmark information corresponding to the identifier indicated by the received selected identifier information from the bookmark storage unit 1002 (step S1160). ).
- the playback apparatus 1000 performs image data acquisition processing for acquiring a bookmarked still image or moving image using the BM CH number and the BM program ID included in the acquired bookmark information (step S1165).
- the mobile phone 1100 When the mobile phone 1100 receives a still image or a moving image corresponding to the bookmark information including the selected identification name from the playback device 1000 via the Internet and a public wireless communication network, the mobile phone 1100 displays the received still image and the moving image. (Step S1170).
- the mobile phone 1100 when receiving a moving image, the mobile phone 1100 also receives audio data related to the moving image and outputs the received audio data.
- the mobile phone 1100 Upon receiving the area display information, the mobile phone 1100 measures the current position using the GPS function, and acquires the area code corresponding to the area obtained from the measurement result from the area information storage unit 1102 (step S1200). ), And obtains the telephone ID from the identifier storage unit 1111 (step S1205).
- the mobile phone 1100 transmits the acquired area code, phone ID, and image data request information to the playback device 1000 (step S1210).
- the playback apparatus 1000 Upon receiving the image data request information, the area code, and the phone ID from the mobile phone 1100 (step S1215), the playback apparatus 1000 matches both the received area code and the phone ID from the bookmark storage unit 1002. All the bookmark information to be acquired is obtained (step S1220).
- the playback device 1000 performs an image data acquisition process (step S1225).
- the mobile phone 1100 When the mobile phone 1100 receives a still image or a moving image corresponding to each piece of bookmark information related to the transmitted area code from the playback device 1000 via the Internet and a public wireless communication network, the mobile phone 1100 displays the received still image and moving image. Yes (step S1230).
- the mobile phone 1100 When receiving a moving image, the mobile phone 1100 also receives audio data related to the moving image and outputs the received audio data.
- mobile phone 1100 receives still images or moving images related to all the acquired bookmark information from playback device 1000. At this time, the image data to be displayed is controlled by receiving the previous image information or the rear image information.
- step S300 in FIG. 18 is deleted, and step S305 is executed using the bookmark information acquired in step S1160 shown in FIG.
- One or more frames obtained in steps S315, S320, S335, S350, and S360 are thinned out to reduce the image quality, and in steps S325, S340, S355, and S365, the image data with the reduced image quality is Is sent.
- the same change as described above is made in the image data acquisition process in step S1225 shown in FIG.
- the operation after step S305 is executed using all the bookmark information acquired in step S1220 shown in FIG.
- a predetermined character for example, “sample” may be added to the obtained still image or moving image, and the resulting still image or moving image may be transmitted to the mobile phone 1100.
- the mobile phone 1100 displays a still image or a moving image to which the character “sample” is added.
- the reproducing apparatus 1000 may perform a bowing between sound data in order to further lower the sound quality (or, when transmitting a moving image, Only the thinning may be performed.
- the playback device 1000 may give an expiration date to a still image or a moving image to be transmitted.
- the data acquisition unit 1005 of the playback device 1000 sets the expiration date for the transmitted image to the bookmark information corresponding to the transmitted image, the telephone ID, and the program content including the transmitted image. It is stored in the bookmark storage unit 1002 in association with the program ID.
- a term writing unit for writing the expiration date into the bookmark storage unit 1002 is configured.
- the playback device 1000 transmits an image for the same stored bookmark information to the mobile phone corresponding to the stored phone ID only within the expiration date. Further, the playback device does not transmit an image corresponding to the puck mark information corresponding to the stored program ID to another mobile phone within the stored expiration date. Note that the playback apparatus 1000 stores and plays back an image corresponding to bookmark information that is different from the stored bookmark information and that corresponds to the stored and played program ID within the validity period. Alternatively, the message may not be transmitted to the mobile phone corresponding to the telephone ID, or may be transmitted.
- the system is composed of a playback device 1000 and a mobile phone 1100.
- the present invention is not limited to this.
- the system may be realized on a home network.
- the playback device 1000 is used as a home server, and a client device (for example, a digital television or a DVD recorder) is used instead of the mobile phone 1100.
- a client device for example, a digital television or a DVD recorder
- the client device plays back the program content stored in the playback device 1000, and receives the bookmark instruction information during playback by a user operation using a remote control provided for the client device.
- the bookmark instruction information and the device identifier are transmitted to the playback device 1000.
- the registration of the bookmark information is the same as that in the above-described modification, and thus the description is omitted.
- the client device Upon receiving the display start information by a user operation, the client device transmits the received display start information and the device identifier to the playback device 1000. Subsequent operations are the same as those of the above-described modified example, and a description thereof will be omitted.
- the difference from the above modification is that a home network is used instead of using the Internet and a public wireless communication network.
- a user ID assigned to each user may be used.
- the mobile phone 1100 When transmitting the bookmark instruction information to the playback device 1000, the mobile phone 1100 also transmits the user ID.
- the registration of the bookmark information is the same as in the above-described modified example, and thus the description is omitted.
- the mobile phone 1100 When transmitting the display start information to the playback device 1000, the mobile phone 1100 also transmits the user ID. Subsequent operations are the same as those of the above-described modified example, and thus description thereof is omitted.
- the BM information can be collectively managed by the playback device 1000. Further, by adding a telephone ID to the bookmark information, playback device 1000 can respond to a puck mark instruction from a plurality of mobile telephones.
- the playback device 1.000 can limit copyright protection by reducing the image quality by interlacing images related to bookmark information.
- the bookmarked image data is received from the playback device 200 and the received image data is displayed.
- a storage unit for storing the received image data may be provided in the mobile phone 100 and stored in the storage unit.
- the storage unit is a memory in the mobile phone 100 or a recording medium (for example, an SD card) that is removable from the mobile phone.
- the portable communication terminal is a mobile phone, but the present invention is not limited to this. Other portable communication terminals may be used.
- it is a dedicated terminal used only for a PDA (Personal Digital Assistant) or a bookmark system.
- PDA Personal Digital Assistant
- bookmark system a bookmark system
- Bookmark information may be transmitted and received between a plurality of mobile phones.
- transmission and reception of the bookmark information are performed by, for example, infrared communication.
- the information transmitting unit configured in the control unit 107 transmits the bookmark information stored in the bookmark storage unit 101 to another mobile phone via the transmission / reception unit 110.
- the time receiving unit configured in control unit 107 receives the bookmark information from another mobile phone via transmission / reception unit 110.
- it writes the bookmark information received from another mobile phone into the information storage unit 101 and the bookmark storage unit 101 configured in the control unit 107.
- the playback device 200 Upon receiving the bookmark information from the mobile phone 100, the playback device 200 determines whether or not the program content that matches the BM program ID included in the received bookmark information exists in the program content storage unit 201. If it is determined that the bookmark information exists, the image data corresponding to the received bookmark information is acquired, and the acquired image data is transmitted to the mobile phone 100. When transmitting a moving image, audio data is also transmitted.
- the target S of the bookmark in the corresponding information is not limited to this. You do not have to specify the bookmark target.
- the corresponding information is blank, and the additional information included in the bookmark information generated by the mobile phone 100 is also blank.
- the playback device 200 Upon receiving the bookmark information in which the additional information is blank, the playback device 200 detects a corner including the image data corresponding to the bookmark information. Obtain the detected corner by copying. Alternatively, a search for a start position of a program content which is not a corner may be performed.
- the corner is a video section having specific contents.
- this is the section from when a program is switched to a CM.
- the section power corresponding to a corner in one program is one.
- a specific frame for example, a silent frame
- a specific frame is usually broadcast immediately before the start and immediately after the end of a corner.
- the playback device 200 executes a recognition process corresponding to the additional information included in the received bookmark information to acquire the first frame, but is not limited to this.
- the bookmark instruction information After receiving the bookmark instruction information, it executes recognition processing corresponding to the corresponding information included in the bookmark instruction information, acquires the broadcast time of the first frame, and uses the acquired broadcast time and the bookmark instruction information to retrieve the search information. May be generated and the generated search information may be stored.
- the correspondence information is "music”
- the music recognition processing corresponds.
- the person recognition processing corresponds.
- the correspondence information is "character”
- the character recognition processing corresponds to “capture”.
- the program ID is not limited to the force given by the playback device 200 when recording the program content.
- the playback device 200 receives a data broadcast such as an electronic program guide (hereinafter, EPG) including information such as a program genre name, a program name, and a broadcast time from a broadcast station, and identifies a program identifier in the received EPG by a program ID. You can do it.
- EPG electronic program guide
- the communication between the mobile phone 100 and the playback device 200 is set to infrared communication.
- infrared communication any method may be used as long as it performs wireless communication.
- Bluetooth For example, Bluetooth.
- the playback device 200 obtains the first frame of the image data according to the additional information included in the bookmark information by using the BM display time included in the received bookmark information when obtaining the image data. Not done.
- the frame corresponding to the display time for BM may be set as the first frame.
- a frame corresponding to the search display time included in the deletion information may be set as the first frame.
- the power of displaying a still image or a moving image is not limited to this.
- Information consisting of character data may be displayed.
- the information of character data is information of telop included in image data, and the reproducing device 200 transmits the character data indicated by the telop to the mobile phone 100, and the mobile phone 100 Display the character data.
- the playback device 200 acquires only the audio data related to the moving image as the information related to the bookmarked portion, transmits the acquired audio data to the mobile phone 100, and
- the speaker 100 may output the received audio data through the speaker 105.
- the search information and the bookmark information may be associated only with the broadcast time of the bookmarked image data.
- the bookmark information includes an identification name, a BM display time, a region code, and additional information
- the search information includes a search display time, a search CH number, a search program ID, and search additional information.
- the playback device 200 acquires the search information including the display time for search that matches the display time for BM included in the received bookmark information, and retrieves the acquired search information. To obtain image data.
- Music, people, characters, and captures are used as the type of information indicating the bookmark target, but are not limited thereto.
- Information other than the above may be used as information indicating the target of the bookmark. For example, it is information indicating a CM (Commercial Message) program.
- the mobile phone 100 has a folder corresponding to the information indicating the CM program in the bookmark storage unit 101, and is included in the bookmark information received at the time of bookmark registration. If the corresponding information is information indicating a CM program, the bookmark information is stored in a folder corresponding to the information.
- the playback device 200 stores a program for performing CM program recognition processing in advance, and if the attached caro information included in the bookmark information received from the mobile phone 100 is information indicating a CM program, the BM included in the bookmark information is included.
- the program display time and the program content obtained from the program content storage unit 201 to execute the CM program recognition process and executing the program, the latest CM first frame located before the BM display time in the program content , And further, obtains the CM first frame power, and obtains a break between the CM programs, that is, obtains image data of one CM program. Further, audio data relating to the acquired image data is also acquired.
- the CM program recognition process is a process of searching for a CM leading frame located at the beginning of a section in which a silent section is repeated at predetermined time intervals (for example, 15 seconds) by using a predetermined algorithm.
- CM head frame power When the program content is deleted, if the information indicates the additional information power SCM program included in the search information, a program for performing CM program recognition processing is executed to acquire a CM first frame, The acquired CM head frame power also acquires continuous image data and audio data for a preset time (for example, 3 minutes).
- Information indicating the target of the bookmark may be further classified. For example, captures are further classified as restaurants and resorts. At this time, the mobile phone 100 has folders corresponding to the restaurant and the resort, respectively, in the bookmark storage unit 101. If the corresponding information included in the bookmark instruction information received at the time of bookmark registration is a restaurant, Stores the bookmark information in the folder corresponding to the restaurant, and stores the bookmark information in the folder corresponding to the vacation spot if the correspondence information is a vacation spot. In addition, in the reproducing device 200, when the additional information included in the received bookmark information is a restaurant or a holiday resort, the operation is the same as that in the case where the additional information is a capture, and thus the description is omitted.
- program content is deleted, if the additional information for search included in the search information is a restaurant or a holiday resort, the operation is the same as when the additional information for search is CAPTCHA, so the description is omitted. .
- the moving image is displayed only when the additional information is music, but the present invention is not limited to this. Even with other additional information, the moving image is displayed. Alternatively, if the additional information is music, a still image may be displayed.
- the mobile phone 100 may receive a selection as to whether the image data to be displayed is a still image or a moving image. Further, when receiving the region display information, similarly, a selection may be received as to whether the image data to be displayed is a still image or a moving image.
- the mobile phone 100 may receive a specification of a folder to be searched. At this time, the mobile phone 100 acquires the bookmark information including the area code corresponding to the area measured by the GPS function from the specified folder.
- the music recognition process, the person recognition process, the character recognition process, and the capture recognition process are stored only in the data acquisition unit 205, and the deletion unit 206 can use each recognition process stored in the data acquisition unit 205. Good.
- the playback device 200 includes a music recognition process, a person recognition process, a character recognition process, and a capture recognition process.
- each recognition process stored in the recognition process storage unit may be used.
- the music recognition process, the person recognition process, the character recognition process, and the capture recognition process are each programs, but are not limited thereto.
- a circuit that performs each recognition process instead of a program may be used.
- the program information includes a BM program ID and a BM display time
- the bookmark information includes an identification name, a BM display time, a BM program ID, a region code, and additional information. Is composed of a search display time, a search program ID, and search additional information.
- the reproduction unit 203 stores the program ID and the recording start time corresponding to the program content to be reproduced when reproducing the program content, and stores and records the program ID and the recording start time at the end of the reproduction of the program content. To delete.
- the registration unit 204 when the registration unit 204 receives the bookmark instruction information from the mobile phone 100, the registration unit 204 acquires the program ID and the recording start time corresponding to the program content being reproduced from the reproduction unit 203, and Further, the broadcast time of the image data reproduced at the time of receiving the bookmark instruction information is obtained, the program information is generated using the obtained broadcast time and the program ID, and transmitted to the mobile phone 100.
- the data acquisition unit 205 acquires the program content corresponding to the BM program ID included in the received bookmark information from the program content storage unit 201, and retrieves the received bookmark content from the acquired program content.
- the image data corresponding to the information is acquired, and the acquired image data is transmitted to the mobile phone 100. If there are a plurality of program contents corresponding to the program ID, the program contents including the recording start time that matches the BM display time included in the received bookmark information among the plurality of program contents Get content.
- the image data related to the location marked with a mark may be stored in advance.
- the reproducing device 200A in this case will be described below.
- the playback device 200A includes a program content storage unit 201A, a search information storage unit 202A, a playback unit 203A, a registration unit 204A, a data read unit 205A, a deletion unit 206A, a first transmission / reception unit 207A, and a second It consists of a transmission / reception unit 208A.
- the playback device 200A is, specifically, a computer system including a microprocessor, ROM, RAM, and a hard disk unit.
- a computer program is stored in the ROM or the hard disk unit. By operating the microprocessor according to the computer program, the playback device 200A achieves its function.
- the program content storage unit 201A, the reproduction unit 203A, the first transmission / reception unit 207A, and the second transmission / reception unit 208A include the program content storage unit 201, the reproduction unit 203, the first transmission / reception unit 207, and the second transmission / reception unit of the reproduction device 200.
- the description is omitted because it is the same as the unit 208.
- the search information storage unit 202A includes an area for storing image data related to a bookmarked location in association with search information. As a result, a bookmark storage unit that stores the bookmarked image data is configured. '
- the registration unit 204A roughly stores music recognition processing, person recognition processing, character recognition processing, and capture recognition processing.
- the registration unit 204A counts the number of reproduced frames from the start of the reproduction and checks the number.
- the registration unit 204A receives the bookmark instruction information from the mobile phone 100 during the reproduction of the program content
- the elapsed time in the section up to the image data being reproduced by the reproducing unit 203A is calculated.
- the registration unit 204A acquires the recording start time stored in the playback unit 203A and obtains the broadcast time of the bookmarked image data by setting the acquired recording start time to the calculated elapsed time. Further, the registration unit 204A acquires a CH number and a program ID corresponding to the program content being reproduced from the reproduction unit 203A.
- the registration unit 204A generates program information using the obtained broadcast time, CH number, and program ID, and transmits the generated program information to the mobile phone 100.
- search information is generated using the obtained broadcast time, CH number, and program ID, and the corresponding information included in the received bookmark instruction information.
- the registration unit 204A performs recognition processing corresponding to the correspondence information using the correspondence information included in the received bookmark instruction information and the obtained broadcast time, and detects the first frame corresponding to the correspondence information.
- the registration unit 204A obtains a predetermined number of consecutive frames from the detected music head frame by copying them, and further copies audio data by copying.
- the acquired frames and audio data are stored as image data in the search information storage unit 202A in association with the generated search information.
- the correspondence information is a person
- the detected person's first frame is obtained by copying
- the obtained person's first frame is stored as image data in the search information storage unit 202A in association with the generated search information.
- the correspondence information is a character
- the detected character head frame is obtained by copying
- the obtained character head frame is stored as image data in the search information storage unit 202A in association with the generated search information.
- the captured information is a capture
- the detected capture head frame is obtained by copying, and the obtained capture head frame is stored as image data in the search information storage unit 202A in association with the generated search information.
- a writing unit for writing an image with a puck mark is formed.
- the data reading unit 205A Upon receiving the bookmark information from the mobile phone 100, the data reading unit 205A acquires search information corresponding to the received bookmark information, reads image data corresponding to the obtained search information, and reads the read image data into the mobile phone 100. Send to
- the deletion unit 206A receives deletion instruction information from the user to delete the program content recorded in the program content storage unit 201A.
- the deletion instruction information is
- the deletion unit 206A deletes the program content corresponding to the program ID included in the received deletion instruction information from the program content storage unit 201A.
- step S Upon receiving the bookmark instruction information from mobile phone 100, registration section 204A (step S
- Step S605 the program information is generated by using the obtained broadcast time, CH number, and program ID, and the generated program information is transmitted to the mobile phone 100 (step S6).
- search information is generated using the bookmark instruction information received in step S600 and the broadcast time, CH number, and program ID obtained in step S605 (step S615).
- program content corresponding to the CH number and the program ID is stored in the program content storage unit.
- step S625 it is determined whether or not the corresponding information included in the received bookmark instruction information is “music” (step S625).
- the registration unit 204A executes music recognition processing to detect and acquire the acquired program content power music head frame (step S630), and further acquires the acquired music.
- First frame power Continuous frames are obtained by copying for a preset number of minutes, and audio data is also obtained by copying (step S635).
- the registration unit 204A uses the frame that is continuous from the acquired music head frame, that is, the moving image from the music head frame as image data, together with the audio data related to the moving image and the search information generated in step S615.
- the information is stored in the search information storage unit 202A (step S640).
- step S630 audio data corresponding to the acquired music head frame is also copied. Acquire by P.
- step S625 If it is determined in step S625 that it is not "music”, it is determined whether the corresponding information is "person” (step S645).
- the registration unit 204A performs a person recognition process to detect and acquire a person first frame from the acquired program content (step S650), and acquires the acquired person first frame. Is stored in the search information storage unit 202A as image data in association with the search information generated in step S615 (step S655).
- step S645 If it is determined in step S645 that the corresponding information is not “person”, it is determined whether the corresponding information is “character” (step S660).
- the registration unit 204A performs a character recognition process to detect and acquire a character leading frame from the acquired program content (step S665), and acquires the acquired character leading frame. Is stored in the search information storage unit 202A as image data in association with the search information generated in step S615 (step S670).
- step S660 If it is determined in step S660 that it is not a “character”, that is, if the corresponding information is determined to be “capture”, the registration unit 204A executes the capture recognition process and executes The first frame of the capture is detected and acquired (step S675), and the still image composed of the acquired first frame of the capture is stored as image data in the search information storage unit 202A in association with the search information generated in step S615 ( Step S680).
- the playback device 200A receives the bookmark information from the mobile phone 100, the playback device 200A does not need to search for the image data from the thread and the content. Therefore, the playback device 200A can shorten the time required from the reception of the bookmark information to the transmission of the image data. Can be.
- the operation of acquiring the image data by copying and storing the acquired image data in the search information storage unit 202A in association with the search information may be performed after the reproduction of the program content ends.
- the generated search information is temporarily stored in the registration unit 204A until the reproduction of the program content ends.
- detecting and acquiring a frame means detecting a frame and acquiring the detected frame by copying.
- the bookmark information is transmitted from the mobile phone 100 to the playback device 200, but is not limited thereto.
- Other devices that manage program content e.g., The transmitting station transmits the puck mark information to the server device that manages the program content, and the other device that manages the program content acquires the image data. May be sent to
- the mobile phone 100 may store only the reception time at which the bookmark instruction information was received, and transmit the bookmark instruction information and the reception time to the playback device 200.
- the playback device 200 upon receiving the bookmark instruction information and the reception time, the playback device 200 generates search information, and stores the generated search information in the search information storage unit 202 in association with the received reception time.
- the mobile phone 100 transmits the stored reception time to the playback device 200, and the playback device 200 obtains the image data using the received reception time and the search information corresponding to the reception time, and transfers the obtained image data to the mobile device. Send to phone 100.
- the received area code information is transmitted together with the bookmark instruction information and the reception time.
- the playback device 200 generates search information, stores the generated search information in the search information storage unit 202 in association with the reception time at which the search information was received and the region code information.
- the mobile phone 100 transmits the stored reception time and the area code information indicating the area code corresponding to the area measured by the GPS function to the playback device 200.
- the playback device 200 acquires the image data using the received reception time and the search information corresponding to both the area code information and transmits the acquired image data to the mobile phone 100.
- the mobile phone 100 may store only the search information identifier for identifying the search information stored in the playback device 200.
- mobile phone 100 transmits the bookmark instruction information to playback device 200.
- the playback device 200 Upon receiving the bookmark instruction information, the playback device 200 generates search information, and further obtains a search information identifier that identifies the generated search information.
- the generated search information is stored in the search information storage unit 202 in association with the obtained search information identifier, and the obtained search information identifier is transmitted to the mobile phone 100.
- the mobile phone 100 stores the received search information identifier.
- the mobile phone 100 transmits the stored search information identifier to the playback device 200, and the playback device 200 retrieves the image data using the search information corresponding to the received search information identifier.
- the obtained image data is transmitted to the mobile phone 100.
- the received area code information is transmitted together with the bookmark information.
- the playback device 200 generates search information, and further obtains a search information identifier for identifying the generated search information.
- the generated search information is stored in the search information storage unit 202 in association with the obtained search information identifier and the received area code information, and the obtained search information identifier is transmitted to the mobile phone 100.
- the mobile phone 100 stores the received search information identifier.
- the mobile phone 100 transmits the stored search information identifier and the area code information indicating the area code corresponding to the area measured by the GPS function to the playback device 200.
- the playback device 200 acquires image data using the search information corresponding to both the received search information identifier and the area code information, and transmits the obtained image data to the mobile phone 100.
- the bookmark information is stored in the mobile phone.
- a method of storing a bookmark instruction and bookmark information using only the playback device will be described.
- FIG. 31 is a diagram showing a usage form of the bookmark system 2.
- the bookmark system 2 includes a playback device 2000 connected to the monitor 11 and a mobile phone 2100.
- the playback device 2000 records program content broadcasted from a broadcast station and plays back the recorded program content.
- the recorded program content includes a channel number on which the program content was broadcast (hereinafter referred to as a “CH number”), a program ID for identifying the program content, and a recording start at which the recording of the program content was started. It is associated with time.
- the mobile phone 2100 and the playback device 2000 can communicate via the Internet and a public wireless communication network.
- the playback device 2000 is provided with a remote controller 2300 S.
- image data to be referenced later while the program content recorded by the playback device 2000 is being played back on the monitor 11 is displayed.
- designating the image data to be referred to later is called a bookmark (BookMark).
- the playback device 2000 displays, via the monitor 11, a still image or a moving image related to the bookmarked image data.
- the playback device 2000 can display a still image or a moving image related to the bookmarked image data.
- the mobile phone 2100 transmits the received still image or moving image to the mobile phone 2100 via the Internet and a public wireless communication network.
- the playback device 2000 includes a program content storage unit 2001, a bookmark storage unit 2002, a playback unit 2003, a registration unit 2004, a data reading unit 2005, a deletion unit 2006, an output unit 2007, a reception unit 2008, and a transmission / reception unit. It is composed of part 2009.
- the playback device 2000 is, specifically, a computer system including a microprocessor, a ROM, a RAM, a hard disk unit, and the like.
- a computer program is stored in the ROM or the hard disk unit. By operating the microprocessor according to the computer program, the playback device 2000 achieves its function.
- the program content storage unit 2001 has an area for storing one or more recorded program contents in association with a CH number, a program ID, and a recording start time.
- the program content recorded in the program content storage unit 2001 includes image data composed of a plurality of frames (still images) continuous along a time axis, and audio data indicating audio in each frame.
- the program ID is given by the playback device 200 when recording the program content.
- a content storage unit for prerecording and recording the program content is configured.
- the puck mark storage unit 2002 has a music folder 2020, a person folder 2021, a character folder 2022, and a cap folder 2023.
- Each folder has an area for storing a bookmarked still image or moving image.
- audio data corresponding to a moving image is also stored.
- the music phonoreda 2020 has a music information table T2000 as shown as an example in FIG.
- the music information table T2000 has an area for storing one or more sets of identification names, BM display times, CH numbers, program IDs, regional codes, and additional information.
- information consisting of the identification name, BM display time, BM CH number, BM program ID, area code, and additional information is referred to as bookmark information.
- the identification name is a name for identifying the bookmark information to be stored.
- the BM display time is the broadcast time at which the bookmarked image data was broadcast, and is indicated by date and time.
- the CH number is the number of the channel on which the bookmarked program content was broadcast, and the program ID is an identifier for identifying the bookmarked program content.
- the area code is information for identifying the area, and corresponds to the area code of the telephone number in the area.
- the additional information is information indicating the target of the puck mark.
- the area code is not necessarily recorded information but is recorded as needed.
- the person phonoreda 2021 has a person information table T2001 as shown as an example in FIG.
- the data structure of the person information table T2001 is the same as that of the music information table T2000, and will not be described.
- Character folder 2022 has a character information table T2002 as shown as an example in FIG.
- the data structure of the character information table T2002 is the same as that of the music information table T2000, and will not be described.
- the additional information in the character information table T2002 is always "character”.
- the capture folder 2023 is shown in FIG. 38 ; [as shown as a row, the capture information tape No. T2003 is displayed.
- the data structure of the capture information table T2003 is the same as that of the music information table T2000, and a description thereof will be omitted.
- the attached information in the capture information tape table T2003 is always “capture”.
- the reproduction unit 2003 has a reproduction information storage area for storing a CH number, a program ID, and a recording start time corresponding to a program content to be reproduced.
- the reproduction unit 2003 reproduces the program content stored in the program content storage unit 2001.
- the reproduction unit 2003 reproduces the program content by outputting it to the monitor 11 via the output unit 2007.
- the reproducing unit 2003 when receiving the still image or the moving image corresponding to the bookmark information from the data reading unit 2005, the reproducing unit 2003 outputs the received still image or the moving image to the monitor 11 via the output unit 2007.
- the corresponding audio data is also output. Thereby, reproduction of a still image or a moving image corresponding to the puck mark information becomes possible.
- the reproduction unit 2003 When receiving the BM screen data for designating the bookmark from the registration unit 2004 during the reproduction of the program content, the reproduction unit 2003 combines the received BM screen data with the program content to be reproduced via the output unit 2007. To monitor 11 for display.
- the BM image M2000 shown in FIG. 39 is an image displayed based on the BM screen data, and includes four items: music, person, character, and capture. Also, each item Of the items, items surrounded by a bold frame indicate a bookmark target. Immediately after the BM image is displayed, music items are surrounded by a bold frame, and the user can operate the remote controller 2300 to change the bookmark target.
- the playback unit 2003 When playing back the program content, the playback unit 2003 stores the CH number, the program ID, and the recording start time corresponding to the program content to be played back in the playback information storage area, and at the end of the playback of the program content. Delete the channel number, program ID and recording start time.
- the registration unit 2004 includes an information generation unit 2030, a data acquisition unit 2031, and a writing unit 2032.
- the information generation unit 2030, the data acquisition unit 2031, and the writing unit 2032 will be described.
- the information generation unit 2030 stores BM screen data in advance, and has a target storage area for storing information of a bookmark target.
- the information generation unit 2030 counts the number of reproduced frames from the start of reproduction.
- the information generation unit 2030 When the information generation unit 2030 receives BM start information indicating that a bookmark is to be started from the remote controller 2300 via the reception unit 2008 during reproduction of the program content, the information generation unit 2030 reproduces the BM screen data stored in advance in the reproduction unit 2003. And information indicating "music" is stored in the target storage area as an initial state.
- the information generation unit 2030 When the information generation unit 2030 receives the right movement information and the left movement information from the remote controller 2300 via the reception unit 2008, the information generation unit 2030 changes the item enclosed by the thick frame according to the received information, and stores it in the target storage area.
- the stored information is updated to information corresponding to the changed item. For example, if the item surrounded by the thick frame is “music” (at this time, information indicating “music” is stored in the target storage area), and when the right movement information is received, The item enclosed by the thick frame is changed to “person”, and the information stored in the target storage area is updated to information indicating “person”.
- the information generation unit 2030 controls the remote control 2 via the reception unit 2008.
- bookmark instruction information including the first registration instruction instruction, bookmark information including the second registration instruction instruction, bookmark instruction information including the second registration instruction information and the area code, and 1 Receive any one of the bookmark instruction information including the registration instruction information and the area code.
- an information receiving unit that receives the information (corresponding information) indicating the type of the puckmark target and the area code is configured.
- the information generation unit 2030 uses the number of frames counted up to the point when the bookmark instruction information is received, and reproduces the image data at the head of the program content by the playback unit 2003 when the bookmark instruction information is received. Calculate the elapsed time in the section up to the specified image data.
- the information generation unit 2030 obtains the recording start time stored in the playback unit 2003, and adds the calculated elapsed time to the obtained recording start time, thereby obtaining the BM display time of the bookmarked image data. get. Further, the information generation unit 2030 obtains a CH number and a program ID corresponding to the program content being reproduced from the reproduction unit 2003.
- the frame at the time point when the bookmark instruction information is received can be specified from the obtained broadcast time based on the relationship between the obtained broadcast time and the number of frames reproduced per second.
- the position acquisition unit configured to acquire information (in this case, broadcast time) for specifying the position in the program content at the time of receiving the bookmark information is configured.
- information generation section 2030 receives the identification name from remote controller 2300 via reception section 2008.
- the information generation unit 2030 transmits the received identification name and the acquired BM
- the bookmark information is generated using the display time, the CH number and the program ID, and the information stored in the target storage area. At this time, nothing is recorded in the area code.
- the information generation unit 2030 when receiving the bookmark instruction information including the first registration instruction instruction and the area code, and when receiving the bookmark instruction information including the second registration instruction instruction and the area code, identifies the received identification information.
- the bookmark information is generated using the name, the obtained BM display time, the CH number and the program ID, the received area code, and the information stored in the target storage area.
- the data acquisition unit 2031 includes a number of still images for generating moving images (for example, 300), a program for performing music recognition processing (hereinafter, referred to as “music recognition processing”), and a program for performing person recognition processing.
- Program hereinafter, referred to as "person recognition processing”
- character recognition processing a program for performing character recognition processing
- capture recognition processing a program for performing capture recognition processing
- a program for performing a corner recognition process is stored in advance.
- the music recognition process is a process of searching for a music head frame located at the head of a music section, which is a section where characteristic sounds are periodically repeated, in audio data of program content by a predetermined algorithm.
- the person recognition process is a process of searching, using a predetermined algorithm, a person's first frame in which image data corresponding to the BM display time included in the bookmark information appears in the image data of the program content. It is.
- the character recognition process is a process of searching for a character head frame in which a telop appears in image data of program content using a predetermined algorithm.
- the capture recognition processing means that in the image data of the program content, the scene power s, which is a group of frames shot continuously in time, and the capture first frame which is the first frame switched from another scene, This is a search process using a predetermined algorithm.
- the corner recognition process is a process of searching for a video section having a specific content by a predetermined algorithm.
- a corner is a section from the time of switching to a commercial program to the time of switching from a program to CM.
- a specific frame for example, a silence frame
- the corner recognition process can specify a corner by detecting a specific frame.
- a position in the program content corresponding to the BM display information is specified, and a corner is detected by detecting a specific frame before and after the specified position.
- the data acquisition unit 2031 acquires, from the program content storage unit 2001, the program content corresponding to the CH number and the program ID included in the bookmark information generated by the information generation unit 2030.
- the data acquisition unit 2031 When the information generation unit 2030 receives the first registration instruction command, the data acquisition unit 2031 performs a recognition process according to the BM display time and the information indicated by the additional information from the acquired program content. To obtain a still image or a moving image. Note that the acquisition method Will be described later.
- the program content corresponding to the CH number and the program ID included in the bookmark information is referred to as BM target content.
- the data acquisition unit 2031 uses the BM display time and the corner recognition process to obtain the information of the information generation unit 2030 from the acquired BM target content.
- a corner including image data corresponding to the information stored in the target storage area is detected, and all the image data included in the detected corner is obtained by copying, that is, a moving image is obtained.
- a partial content acquisition unit that acquires a bookmarked still image or moving image from the program content is configured.
- the data acquisition unit 2031 determines whether the additional information included in the bookmark information generated by the information generation unit 2030 is “music”. If it is determined to be “music”, the music recognition processing is executed using the BM display time and the BM target content included in the bookmark information, and the BM target content is used for the BM display time. The most recent music head frame located before the indicated frame is detected, and the detected music head frame power is also obtained by copying 300 consecutive frames, and the audio data corresponding to each obtained frame is obtained. Are also obtained by copying. That is, the data acquiring unit 2031 can acquire a total of 300 frames and audio data including the music head frame by copying. As a result, the data acquisition unit 2031 acquires the moving image and its sound by copying.
- the additional information included in the bookmark information is not “music”, it is determined whether or not it is a “person”, and when it is determined that the additional information is “person”, the additional information is included in the bookmark information.
- the person recognition process using the BM display time and the BM target content, the most recent person first frame located before the frame indicated by the BM display time is detected in the BM target content. Then, the first frame of the detected person is obtained by copying.
- the additional information included in the bookmark information is not “person”, it is determined whether or not it is “character” . If it is determined that the additional information is “character”, the additional information is included in the bookmark information.
- the BM target content is positioned before the frame indicated by the BM display time. The character first frame that is closest to the character, and obtains the detected character first frame by copying.
- the BM display time and the BM target content included in the bookmark information are used. Then, by executing the capture recognition process, in the BM target content, the latest capture first frame positioned before the frame indicated by the BM display time is detected, and the detected capture first frame is obtained by copying.
- the position before the frame means that the position is between the positions indicated by the start position force BM display time of the program content.
- the writing unit 2032 performs any of the music information table T2000, the person information table ⁇ 2001, the character information table ⁇ 2002, and the capture information table ⁇ 2003 according to the additional information included in the bookmark information generated by the information generation unit 2030. Then, the bookmark information and the still image or the moving image acquired by the data acquiring unit 2031 are recorded in association with each other. When a moving image is stored, audio data related to the moving image is also stored.
- the association between the bookmark information and the still image is, for example, the association between the bookmark information and the address of the storage destination of the still image, and the association between the bookmark information and the moving image is, for example, the bookmark information and the moving image. Correspond to the storage address of the image located at the beginning of the image.
- a writing unit for writing the bookmarked image is configured.
- the data reading unit 2005 When the data reading unit 2005 receives display start information indicating that display of bookmarked image data is to be started from the remote controller 2300 via the receiving unit 2008, the data reading unit 2005 prompts the user to select a storage destination of the bookmark information, as shown in FIG. As shown as an example in (a), different numbers are assigned to the folder names of the folders included in the bookmark storage unit 2002, and a storage destination list in which the assigned numbers and the folder names are paired is generated.
- the data reading unit 2005 receives the selected folder information indicating the selected storage destination from the remote controller 2300 via the receiving unit 2008.
- the selected folder information is information including a number assigned to the selected folder.
- the data reading unit 2005 acquires an identification name included in the bookmark information recorded in the folder indicated by the selected folder information. For example, when the selected folder information indicates a person folder, the data reading unit 2005 determines the identification names “person A” and “person” from all the bookmark information recorded in the person folder 2021 of the bookmark storage unit 2002. B ".
- the data reading unit 2005 generates a list including all the acquired identification names, and displays the generated list on the monitor 11 via the output unit 2007.
- a list is shown in FIG. 40 (b).
- the list is a list in which different numbers are assigned to each identifier.
- Data reading unit 2005 receives selected identification name information indicating the selected identification name from remote controller 2300 via reception unit 2008.
- the request receiving unit that receives the output request of the image marked with the mark is configured.
- the data reading unit 2005 acquires the bookmark information corresponding to the identification name indicated by the received selected identification name information from the bookmark storage unit 2002.
- the selected identifier information is information composed of a number assigned to the selected identifier.
- the data reading unit 2005 reads a still image or a moving image corresponding to the acquired bookmark information from the bookmark storage unit 2002.
- a reading unit that reads out a still image or a moving image and sound stored in the bookmark storage unit 2002 is configured.
- the data reading unit 2005 displays the read still image or moving image on the monitor 11 via the reproducing unit 2003 and the output unit 2007.
- audio data relating to a moving image is also acquired from the bookmark storage unit 2002, and the acquired audio data is output from the monitor 11 via the reproduction unit 2003 and the output unit 2007.
- the monitor 11 When receiving the audio data, the monitor 11 outputs an audio based on the audio data.
- an output unit that outputs a partial content composed of a still image read from the bookmark storage unit 2002 or a partial content composed of a moving image and audio is configured.
- the data reading unit 2005 When receiving the display start information from the mobile phone 2100 via the transmission / reception unit 2009, the data reading unit 2005 generates a storage destination list, and stores the generated storage destination list in the transmission / reception unit 20. Send to mobile phone 2100 via 09.
- the data reading unit 2005 receives the selected folder information from the mobile phone 2100 via the transmitting / receiving unit 2009, the data reading unit 2005 acquires an identification name recorded in the folder indicated by the selected folder information and included in the bookmark information.
- the data reading unit 2005 generates a list of all the acquired identification names, and transmits the generated list to the mobile phone 2100 via the transmission / reception unit 2009.
- Data reading unit 2005 receives the selected identifier information from mobile phone 2100 via transmitting / receiving unit 2009.
- the receiving unit configured to receive the information indicating the display instruction is configured.
- the data reading unit 2005 acquires the bookmark information corresponding to the identification name indicated by the received selected identification name information from the bookmark storage unit 2002.
- the data reading unit 2005 reads a still image or a moving image corresponding to the acquired bookmark information from the bookmark storage unit 2002.
- a reading unit similar to the above-described reading unit is configured.
- the data reading unit 2005 transmits the read still image or moving image to the mobile phone 2100 via the transmitting / receiving unit 2009. Further, when transmitting a moving image, audio data relating to the moving image is also transmitted to the mobile phone 2100 via the transmission / reception unit 2009. As a result, a content transmitting unit configured to transmit the partial content including the still image read from the bookmark storage unit 2002 or the partial content including the moving image and the audio is configured.
- the data reading unit 2005 receives the image data request information for requesting the bookmarked image data related to the current location area and the area code from the mobile phone 2100 via the transmission / reception unit 2009, and receives the bookmark storage unit 2002. Then, all the bookmark information including the area code that matches the received area code is obtained. For example, when the current position is Osaka City, all the bookmark information including the area code “06” is acquired. In this case, the distinguishing name from the character folder 2022 ⁇ The bookmark information of the characters AJ, “B” and “D”, and the U name of “Caption B” Get some bookmark information.
- the data reading unit 2005 reads out a still image or a moving image corresponding to each piece of bookmark information using all the acquired bookmark information.
- Data reading unit 2005 reads
- the transmitted images are transmitted to the mobile phone 2100 via the transmission / reception unit 2009.
- audio data relating to the moving image is also transmitted to the mobile phone 2100 via the transmission / reception unit 2009.
- the deletion unit 2006 receives, from the remote controller 2300 via the reception unit 2008, deletion instruction information indicating that the program content recorded in the thread and content storage unit 201 is to be deleted.
- the deletion instruction information is information including a program ID.
- a deletion receiving unit that receives a deletion instruction is configured.
- the deletion unit 2006 deletes the program content corresponding to the program ID included in the received deletion instruction information from the program content storage unit 2001. Therefore, the X U removal unit 2006 can delete the program content stored in the program content storage unit 2001 while leaving the image stored in the bookmark storage unit 2002. As a result, a deletion unit for deleting the program content is configured.
- the output unit 2007 receives the data of the string and the content reproduced from the reproduction unit 2003 and outputs the received data to the monitor 11. As a result, the reproduced program content is displayed on the monitor 11.
- the output unit 2007 outputs the received data to the monitor 11 from the data reading unit 2005 via the reproducing unit 2003.
- a still image or a moving image corresponding to the bookmark information can be displayed.
- Receiving section 2008 receives BM start information, right movement information, left movement information, bookmark instruction information and identification name from remote controller 2300, and receives the received BM start information, right movement information, left movement information, bookmark instruction information, The identification name is output to the registration unit 2004.
- Receiving section 2008 receives display start information, selected folder information and selected alias information from remote controller 2300, and outputs the received display start information, selected folder information and selected identification name information to data reading section 2005.
- Receiving section 2008 upon receiving the deletion instruction information from remote controller 2300, outputs the received deletion instruction information to deletion section 2006. (9) Transceiver unit 2009
- the transmission / reception unit 2009 outputs information received from the mobile phone 2100 via the Internet to the data reading unit 2005.
- the transmitting / receiving unit 2009 transmits the information received from the data reading unit 2005 to the mobile phone 2100 via the Internet.
- Fig. 41 is a diagram showing the appearance of the remote controller 2300.
- the remote controller 2300 is composed of a BM operation unit 2301 consisting of a group of buttons for operating the mark, and a button group for inputting numbers, alphabets, Japanese characters, and other operations.
- remote control 2300 transmits BM start information to playback device 2000 via irradiation unit 2303.
- Remote controller 2300 transmits left movement information when left button 2313 is pressed and right movement information when right button 2314 is pressed, to playback device 2000 via irradiation unit 2303.
- the remote controller 2300 transmits bookmark instruction information including the first registration instruction information to the playback device 2000 via the irradiation unit 2303.
- the remote controller 2300 transmits bookmark instruction information including the first registration instruction information and the area code via the irradiation unit 2303. Transmit to playback device 2000.
- the remote controller 2300 transmits book mark instruction information including the second registration instruction information to the playback device 2000 via the irradiation unit 2303.
- the remote controller 2300 transmits bookmark instruction information including the second registration instruction information and the area code via the irradiating section 2303. To the playback device 2000.
- the remote controller 2300 receives the identification name by pressing the input button 2321 and then pressing the button of the character operation unit 2302, and presses the determination button 2322 to input the received identification name to the irradiation unit 2303. To the playback device 2000 via.
- the remote controller 2300 transmits display start information to the playback device 2000 via the irradiation unit 2303.
- the remote controller 2300 uses the number of the pressed button as the selected folder information via the irradiation unit 2303 via the irradiation unit 2303. To the playback device 2000.
- the remote controller 2'300 irradiates the pressed button number as the selected identification name information. It is transmitted to the playback device 2000 via the unit 2303.
- the remote controller 2300 transmits deletion instruction information to the playback device 2000 via the irradiation unit 2303.
- the mobile phone 2100 is a portable communication terminal device, and as shown in FIG. 42, a local information storage unit 2102, a radio unit 2103, a baseband signal processing unit 2104, a speaker 2105, a microphone 2106, and a control unit 2107. , An input unit 2108 and a display unit 2109.
- the mobile phone 2100 is a computer system including a microprocessor, a ROM, a RAM, a display unit, and the like.
- the ROM stores a computer program.
- the mobile phone 2100 achieves its functions by the microprocessor operating according to the computer program.
- the regional information storage unit 2102 has a regional information table T2100 as shown as an example in FIG.
- the area information table T2100 has an area for storing one or more sets of location and area codes.
- the position is information indicating a region name, such as Osaka City and Kobe City.
- the area code is the same as the area code in the music information table T2000, and thus the description is omitted.
- the wireless unit 2103 includes an antenna 2400 and transmits and receives wireless signals.
- the baseband signal processor 2104 converts the signal received from the radio
- Signal processing for output to 05 and audio received from microphone 2106 to wireless section 2103 Performs signal processing for output.
- the baseband signal processing unit 2104 Upon receiving information received via the Internet and a public wireless communication network from the wireless unit 2103, the baseband signal processing unit 2104 outputs the received information to the control unit 2107.
- the baseband signal processing unit 2104 Upon receiving the display start information, the selected folder information, the selected identification name information, and the image data request information from the control unit 2107, the baseband signal processing unit 2104 receives the display start information, the selected folder information, the selected identification name information, and the image.
- the data request information is transmitted to the playback device 2000 via the wireless unit 2103, the public wireless communication network, and the Internet.
- the baseband signal processing unit 2104 Upon receiving the image data request information from the control unit 2107, the baseband signal processing unit 2104 further receives a region code, and the received region code is also transmitted together with the image data request information to the public wireless communication network.
- the data is transmitted to the playback device 2000 via the Internet.
- the baseband signal processing unit 2104 When receiving the audio data from the control unit 2107, the baseband signal processing unit 2104 also performs signal processing for outputting the received audio data to the speakers 2105.
- Speaker 2105 outputs the signal processed by baseband signal processing section 2104 as sound.
- Microphone 2106 receives the voice of the user and outputs the received voice to baseband signal processing section 2104.
- the control unit 2107 has a GPS (Global Positioning System) function for measuring a position in advance, and controls the entire mobile phone 2100.
- GPS Global Positioning System
- designated display the display of bookmarked image data specified by the user
- region display the display of bookmarked image data relating to the area where the user is currently located
- control unit 2107 When receiving the display start information from input unit 2108, control unit 2107 outputs the received display start information to baseband signal processing unit 2104.
- the control unit 2107 reproduces the storage destination list via the Internet and a public wireless communication network.
- the received storage destination list is output to the display unit 2109.
- control unit 2107 Upon receiving the selected folder information from input unit 2108 by a key operation by the user, control unit 2107 outputs the received selected folder information to baseband signal processing unit 2104. Upon receiving the list from the playback device 2000 via the Internet and the public wireless communication network, the control unit 2107 outputs the received list to the display unit 2109.
- control unit 2107 Upon receiving the selected identification name information from input unit 2108 by a key operation by the user, control unit 2107 outputs the received selected identification name information to base band signal processing unit 2104.
- the control unit 2107 receives a still image or a moving image corresponding to the bookmark information including the selected identifier from the playback device 2000 via the Internet and a public wireless communication network, the control unit 2107 receives the received still image and the moving image.
- the moving image is output to the display unit 2109.
- the control unit 2107 when receiving a moving image, it also receives audio data related to the moving image and outputs the received audio data to the speaker 2105 via the baseband signal processing unit 2104. As a result, the control unit 2107 can reproduce the received moving image.
- the control unit 2107 Upon receiving, from the input unit 2108, the area display information indicating the display of the bookmarked image data relating to the area where the current position is located, the control unit 2107 measures the current position using the GPS function. The control unit 2107 obtains the area code corresponding to the area obtained from the measurement result from the area information storage unit 2102.
- Control unit 2107 outputs the acquired area code and image data request information to base band signal processing unit 2104.
- the control unit 2107 displays the received still image and moving image when the still image or the moving image corresponding to each bookmark information related to the transmitted area code is received from the playback device 2000 via the Internet and a public wireless communication network. Output to section 2109.
- the control unit 2107 when receiving a moving image, it also receives audio data related to the moving image and outputs the received audio data to the speaker 2105 via the baseband signal processing unit 2104. As a result, the control unit 2107 can reproduce the received moving image.
- control unit 2107 when receiving a plurality of still images or moving images, the control unit 2107 receives, from the input unit 2108, the previous image information for switching to the previous still image or the previous moving image, or the By receiving the image information after switching to the moving image of A still image or a moving image to be output to the display unit 2109 is controlled.
- the input unit 2108 is configured by a keyboard or the like having an input function such as a numeric input key, and receives an input instruction from a user.
- the input unit 2108 Upon receiving the display start information, the selected folder information, the selected identification name information, and the image data request information, the input unit 2108 controls the received display start information, the selected folder information, the selected alias information, and the image data request information to the control unit. 210 Output to 7 Upon receiving the image data request information, input unit 2108 further receives a region code, and outputs the received region code to control unit 2107 together with the image data request information.
- input section 2108 receives the previous image information and outputs the received previous image information to control section 2107. Also, the input unit 2108 receives the post-image information and outputs the received post-image information to the control unit 2107.
- the display unit 2109 When receiving the storage destination list from the control unit 2107, the display unit 2109 displays the received storage destination list.
- the display unit 2109 Upon receiving the list from the control unit 2107, the display unit 2109 displays the received list.
- the display unit 2109 displays the still image or the moving image received from the control unit 2107.
- the information generation unit 2030 of the playback device 2000 When receiving the BM start information from the user via the remote controller 2300, the information generation unit 2030 of the playback device 2000 outputs the previously stored BM screen data to the playback unit 2003, and stores the BM screen data in the target storage area as an initial state. Information indicating "music" is stored (step S2000). Playback section
- the 2003 displays the BM image on the monitor 11 via the output unit 2007 based on the BM screen data received from the information generation unit 2030 (Step S2005).
- the information generation unit 2030 determines whether or not the received information is the information bookmark instruction information received from the user via the remote controller 2300 (step S2010).
- the reproduction unit 2003 reproduces the bookmark information when receiving the mark instruction information from the image data located at the beginning of the program content.
- the elapsed time in the section up to the image data is calculated (step S2015).
- the information generation unit 2030 obtains the recording start time stored in the reproduction unit 2003, and adds the calculated elapsed time to the obtained recording start time, thereby obtaining the BM display time of the bookmarked image data. Acquire (Step S 2020). Further, the information generation unit 2030 obtains a CH number and a program ID corresponding to the program content being reproduced from the reproduction unit 2003 (step S2025).
- information generating section 2030 receives the identification name from remote controller 2300 via receiving section 2008 (step S2030).
- the information generation unit 2030 transmits the received identification name and the acquired BM
- the bookmark information is generated by using the display time, the CH number, the program ID, and the information stored in the target storage area (step S2035). At this time, nothing is recorded in the area code.
- the received The bookmark information is generated using the identification name, the obtained BM display time, the CH number and the program ID, the received area code, and the information stored in the target storage area.
- the playback device 2000 After the generation of the bookmark information, the playback device 2000 obtains a still image or a moving image corresponding to the generated bookmark information, and performs an image data obtaining process for recording (step S2040).
- the information generating unit 2030 determines whether the received information is the right movement information (Step S2045).
- the bookmark target item is changed from the current target item to the right item (step S2050), and when it is determined that the information is not the right movement information (“NO” in step S2045). ), In the currently displayed BM image, the target item of the mark is also changed to the left target item force (step S2055).
- the information generation unit 2030 updates the information stored in the target storage area to information corresponding to the changed item (Step S2060), and returns to Step S2005.
- the data acquisition unit 2031 of the playback device 2000 acquires the BM target content corresponding to the CH number and the program ID included in the bookmark information generated by the information generation unit 2030 from the program content storage unit 2001 (step S 2100).
- the data acquisition unit 2031 determines whether or not the command included in the bookmark instruction information received by the information generation unit 2030 is the first registration instruction command (step S2105).
- Step S2110 it is determined whether the additional information included in the bookmark information generated by the information generating unit 2030 is “music”. (Step S2110). If it is determined to be “music” (“YES” in step S2110), music recognition processing is executed using the BM display time and the BM target content included in the bookmark information, and from the acquired program content, The music head frame is detected and obtained (step S2115), and a continuous frame from the obtained music head frame is obtained by copying for a preset number of minutes, and the audio data is also obtained by copying (step S2120). . In step S2115, the audio data corresponding to the acquired music head frame is also acquired by copying.
- the writing unit 2032 of the playback device 2000 associates a frame continuous from the acquired music head frame, that is, a moving image from the music head frame with the bookmark information generated by the information generation unit 2030.
- a frame continuous from the acquired music head frame that is, a moving image from the music head frame
- the bookmark information generated by the information generation unit 2030.
- an information storage destination process for recording in one of the music information table T2000, the person information table # 2001, the character information table # 2002, and the capture information table # 2003 is performed (step S2125).
- audio data relating to the moving image is also stored. To do.
- step S2130 If it is determined that the additional information included in the bookmark information is not “music” (“NO” in step S2110), it is determined whether or not it is a “person” (step S2130).
- step S2130 If it is determined to be a "person” ("YES" in step S2130), a person recognition process is executed using the BM display time and the BM target content included in the bookmark information, and the obtained program content is obtained.
- the first person frame is detected and acquired (step S2135), and step S2125 is performed.
- step S2140 If it is determined that the character is not a “person” (“NO” in step S2130), it is determined whether the character is a “character” (step S2140).
- step S2140 If it is determined to be “characters” (“YES” in step S2140), character recognition processing is performed using the BM display time and BM target content included in the bookmark information, and the acquired program content capability is obtained. The character leading frame is detected and acquired (step S2145), and step S2125 is performed.
- step S2140 If it is determined that it is not a “character” (“N ⁇ J” in step S2140), that is, if it is determined that it is a “capture”, a capture recognition process is executed and the The capture start frame is detected and acquired (step S2150), and step S2125 is performed.
- step S22005 If the data acquisition unit 2031 determines that the received instruction is not the first registration instruction command ("NO" in step S22005), the BM display time and the "" Is used to detect corners containing image data corresponding to the information stored in the target storage area of the information generation unit 2030, and acquire all image data included in the detected corners, that is, a moving image Is obtained (step S2155), and step S2125 is performed.
- detecting and acquiring a frame means detecting a frame and acquiring the detected frame by copying.
- the writing unit 2032 determines whether or not the additional information included in the bookmark information generated by the information generating unit 2030 is “music” (step S2300). If it is determined to be “music” (“YES” in step S2300), the still image or moving image acquired by the bookmark information and data acquisition unit 2031 is written to the music folder 2020 (step S2305), and “music” is written. If it is determined that the additional information is not (“NO” in step S2300), it is determined whether or not the additional information is a “person” (step S2310).
- step S2315 writes the still image or moving image acquired by the bookmark information and data acquisition unit 2031 in the person folder 2021 (step S2315), and when it is determined that the image is not a "person"("NO” in step S2310) , To judge whether the additional information is “character” or not (step S2320)
- step S2320 If it is determined to be “character” (“YES” in step S2320), the still image or moving image acquired by bookmark information and data acquisition unit 2031 is written to character folder 2022 (step S2325), and “character” (“NOj” in step S2320), that is, if it is determined that the additional information is “capture”, the still image or the still image acquired by the bookmark information and data acquisition unit 2031 Write the moving image to the capture folder 2023 (step S2330)
- the writing unit 2032 when writing a moving image to the corresponding folder, the writing unit 2032 also writes audio data.
- the data reading unit 2005 Upon receiving the display start information from the remote controller 2300 via the receiving unit 2008 (step S2400), the data reading unit 2005 generates a storage destination list to prompt the user to select a storage destination of the bookmark information, and generates the list.
- the storage destination list is displayed on the monitor 11 via the output unit 2007 (step S2405).
- the data reading unit 2005 receives the selected folder information from the remote controller 2300 via the receiving unit 2008 (Step S2410)
- the data reading unit 2005 acquires all the identifiers included in the bookmark information recorded in the folder indicated by the selected folder information, and generates a list of all the acquired identifiers, The generated list is displayed on the monitor 11 via the output unit 2007 (step S2415).
- the data reading unit 2005 Upon receiving the selected identifier information from the remote controller 2300 via the receiving unit 2008 (step S2420), the data reading unit 2005 stores the bookmark information corresponding to the identifier indicated by the received selected identifier information in the bookmark storage unit 2002. Is obtained (step S2425).
- the data reading unit 2005 reads a still image or a moving image corresponding to the acquired bookmark information from the bookmark storage unit 2002 (step S2430), and reads the read still image or moving image via the reproducing unit 2003 and the output unit 2007.
- To display on monitor 11 step S2435). When displaying a moving image, audio data relating to the moving image is output from the monitor 11 via the output unit 2007.
- the above-described display processing is the same as the operation described above for the operation between the playback device 2000 and the mobile phone 2100 described for the operation between the playback device 2000 and the remote controller 2300. Only the path of the information is different.
- Various information received by the data reading unit 2005 from the remote controller 2300 is received by the data reading unit 2005 from the mobile phone 2100 via the public wireless communication network, the Internet, and the transmission / reception unit 2009, and is reproduced by the data reading unit 2005. parts 2003 and Les displayed on the monitor 11 via the output unit 2007, Ru information 0 sent Internet, to the portable phone 2100 via the public wireless communication network ⁇ Pi transceiver 2009
- step S2500 When the data reading unit 2005 receives the image data request information and the area code from the mobile phone 2100 via the transmission / reception unit 2009 (step S2500), the area code matching the received area code is received from the bookmark storage unit 2002. All the bookmark information including is obtained (step S2505).
- the data reading unit 2005 reads out a still image or a moving image corresponding to each piece of bookmark information by using all the acquired bookmark information (step S2510).
- Data reading unit 2005 transmits the read images to mobile phone 2100 via transmitting / receiving unit 2009.
- audio data relating to the moving image is also transmitted to the mobile phone 2100 via the transmission / reception unit 2009 (step S2515).
- the playback device when receiving a bookmark instruction from a remote controller during content playback, the playback device generates bookmark information and generates a still image or a moving image corresponding to the generated bookmark information.
- the playback device can store and A still image or a moving image corresponding to the puck mark information can be displayed.
- the image data may be different from the actually marked image data due to the influence of the time required for receiving the transmission power of the mark information, but the above-described reproducing apparatus uses the image data acquisition function. Occasionally, by executing a recognition process corresponding to the information indicated by the additional information among the music recognition process, the person recognition process, the character recognition process, and the capture recognition process, the image data desired by the user is accurately obtained. Then, the acquired image data can be stored.
- the playback device automatically sorts the generated bookmark information into folders according to the content, so that the bookmark information can be easily organized.
- the bookmark information when the bookmark information is created, the corresponding still image or moving image is acquired and stored in association with the bookmark information. A modification in the case where an image is obtained for the image will be described.
- the remote controller and the mobile phone are the same as the remote controller 2300 and the mobile phone 210 shown above.
- the playback device 3000 includes a program content storage unit 3001, a bookmark storage unit 3002, a playback unit 3003, a registration unit 3004, an acquisition unit 3005, an Xi ij removal unit 3006, an output unit 3007, a reception unit 3008, and the like. ⁇ Composed of a transmission / reception unit 3009.
- the playback device 3000 is, specifically, a microprocessor, ROM, RAM, hard disk It is a computer system composed of units and other components. A computer program is stored in the ROM or the hard disk unit. By operating the microprocessor according to the computer program, the playback device 3000 achieves its function.
- Program content storage unit 3 001 is the same as the program content storage unit 2001 shown in the above, a description thereof will be omitted.
- the bookmark storage unit 3002 has the same folder configuration as the bookmark storage unit 2002 described above.
- the difference from the second embodiment is that the bookmark information further includes a flag indicating whether or not corner detection is to be performed, in addition to the data described in the second embodiment.
- FIG. 50 shows an example of the music information table T3000 stored in the music folder.
- the music information table T3000 includes identification names, BM display times, CH numbers, program IDs, regional codes, corner detections, and additional information.
- the corner detection is a flag indicating whether or not corner detection is to be performed.A value of "1" indicates that corner detection is to be performed, and a value of "0" indicates that corner detection is not to be performed and the addition corresponding to the additional information is obtained. Is performed. The remaining items are the same as in the above-described second embodiment, and a description thereof will not be repeated.
- each table stored in the other folders is the same as the configuration of the music information table T3000, and thus the description is omitted.
- the reproducing unit 3003 is the same as the reproducing unit 2003 described above, and thus the description is omitted. In the following, description will be made using the BM image M2000.
- the registration unit 3004 includes an information generation unit 3030 and a writing unit 3032. And have you below, the information generating unit 3 0 3 0 ⁇ Pi writing unit 3032 will be described.
- the information generation unit 3030 stores BM screen data in advance, and has a target storage area for storing information of a target of a bookmark.
- the information generation unit 3030 counts and reproduces the number of reproduced frames from the start of reproduction.
- the information generation unit 3030 When the BM start information is received from the remote controller 2300 via the reception unit 3008 during the reproduction of the program content, the information generation unit 3030 outputs the BM screen data stored in advance, and outputs the BM screen data to the reproduction unit 3003. Information indicating “music” is stored in the storage area as an initial state.
- the information generation unit 3030 When receiving the right movement information and the left movement information from the remote controller 2300 via the reception unit 3008, the information generation unit 3030 changes the item enclosed by the thick frame according to the received information, and stores it in the target storage area. Then, the information is updated to the information corresponding to the changed item.
- the information generation unit 3030 receives, from the remote controller 2300 via the reception unit 3008, bookmark instruction information including the first registration instruction instruction, bookmark information including the second registration instruction instruction, and second registration information.
- bookmark instruction information including the instruction information and the area code and the bookmark instruction information including the first registration instruction information and the area code are received.
- an information receiving unit that receives the information (corresponding information) indicating the type of the bookmark target and the area code is configured.
- the information generation unit 3030 uses the number of frames counted up to the point in time when the bookmark instruction information is received, and uses the number of frames counted up to the point in time at which the image data card mark instruction information located at the beginning of the program content is received. The elapsed time in the section up to the image data being reproduced is calculated. The information generation unit 3030 acquires the recording start time stored in the playback unit 3003 and adds the calculated elapsed time to the acquired recording start time to acquire the BM display time of the bookmarked image data. . Further, the information generation unit 3030 obtains a CH number and a program ID corresponding to the program content being reproduced from the reproduction unit 3003.
- the position acquisition unit configured to acquire information (in this case, broadcast time) for specifying the position in the program content at the time of receiving the bookmark information is configured.
- information generating section 3030 receives the identification name from remote controller 2300 via receiving section 3008.
- the information generation unit 3030 stores the received identification name, the acquired BM display time, the CH number, and the program ID, in the target storage area. Then, bookmark information is generated using the information and the corner detection flag “0”. At this time, nothing is recorded in the ⁇ ya area code.
- the information generating unit 3030 When receiving the bookmark instruction information including the second registration instruction information, the information generating unit 3030 stores the received identification name, the acquired BM display time, the CH number, and the program ID in the target storage area. The bookmark information is generated using the current information and the corner detection flag “1”. At this time, nothing is recorded in the area code.
- bookmark information is generated using the information stored in the target storage area and the corner detection flag “0”.
- the information generation unit 3030 receives the bookmark instruction information including the first registration instruction instruction and the area code, and receives the bookmark instruction information including the second registration instruction instruction and the area code. Using the identification name, the acquired BM display time, CH number and program ID, the received area code, the information stored in the target storage area, and the corner detection flag “1”, the bookmark information is used. Generate.
- the writing unit 3032 writes to a folder in the bookmark storage unit 3002 according to the attached caro information included in the bookmark information generated by the information generation unit 3030.
- the acquisition unit 3005 includes an information acquisition unit 3040 and a data acquisition unit 3041.
- the information acquisition unit 3040 and the data acquisition unit 3041 will be described.
- the information acquisition unit 3040 Upon receiving the display start information from the remote controller 2300 via the receiving unit 3008, the information acquisition unit 3040 generates a storage destination list to prompt the user to select a storage destination of the bookmark information, and generates the storage destination list. Displayed on monitor 11 via output unit 3007. The information obtaining unit 3040 receives the selected folder information from the remote controller 2300 via the receiving unit 3008.
- the information acquisition unit 3040 stores the information recorded in the folder indicated by the selected folder information. retrieve the identifier included in the bookmark information.
- the information acquisition unit 3040 generates a list including all the acquired identification names, and displays the generated list on the monitor 11 via the output unit 3007.
- Information acquiring section 3040 receives selected identifier information indicating the selected identifier from remote controller 2300 via receiving section 3008.
- the request receiving unit that receives the output request of the bookmarked image is configured.
- the information acquisition unit 3040 acquires bookmark information corresponding to the identifier indicated by the received selected identifier information from the bookmark storage unit 3002.
- the information acquisition unit 3040 when receiving the display start information from the mobile phone 2100 via the transmission / reception unit 3009, the information acquisition unit 3040 generates a storage destination list, and transmits the generated storage destination list to the mobile phone via the transmission / reception unit 3009. Send to 2100.
- the information obtaining unit 3040 Upon receiving the selected folder information from the mobile phone 2100 via the transmission / reception unit 3009, the information obtaining unit 3040 obtains an identification name included in the bookmark information recorded in the folder indicated by the selected folder information. .
- Information acquisition unit 3040 generates a list including all the acquired identification names, and transmits the generated list to mobile phone 2100 via transmission / reception unit 3009.
- the information acquiring unit 3040 Upon receiving the selected identifier information from the mobile phone 2100 via the transmission / reception unit 3009, the information acquiring unit 3040 acquires the bookmark information corresponding to the identifier indicated by the received selected identifier information from the bookmark storage unit 2002. I do.
- the bookmark storage unit 2002 reads the area code that matches the received area code. Get all bookmark information including.
- the data acquisition unit 3041 stores the number of still images for generating moving images (for example, 300), and further includes “music recognition processing”, “person recognition processing”, “character recognition processing”, Programs corresponding to each of “capture recognition processing” and “corner recognition processing” are stored in advance.
- the data acquisition unit 3041 acquires from the program content storage unit 3001 the program content corresponding to the CH number and the program ID included in the bookmark information acquired by the information acquisition unit 3040. Get. At this time, there may be a plurality of program contents corresponding to the CH number and the program ID due to the deletion of the program contents described later. The program content of which the recording start time coincides with the time indicated by the display time included in the bookmark information is obtained.
- the data acquiring unit 3041 determines whether or not the value of the corner detection flag included in the acquired puck mark information is “0”.
- a still image or a moving image is copied from the acquired program content using the BM display time and the recognition process corresponding to the information indicated by the additional information. get.
- a moving image is obtained, its sound is also obtained by copying. Note that the acquisition method is the same as in the second embodiment, and a description thereof will not be repeated.
- the BM display time and the corner recognition process are used to obtain the information indicated by the additional information from the acquired program content. A corner including the corresponding image data is detected, and all the image data included in the detected corner is obtained by copying, that is, a moving image is obtained.
- the data acquisition unit 3041 When receiving the display start information from the remote controller 2300, the data acquisition unit 3041 displays the acquired image on the monitor 11 via the reproduction unit 3003 and the output unit 3007. When displaying a moving image, audio data related to the moving image is reproduced by the reproducing unit 3003 and the output unit 3.
- an output unit that outputs partial content composed of still images or partial content composed of moving images and audio is configured.
- the data obtaining unit 3041 transmits the obtained image to the mobile phone 2100 via the transmission / reception unit 3009. Further, when transmitting a moving image, audio data relating to the moving image is also transmitted to portable telephone 2100 via transmitting / receiving section 3009.
- a content transmitting unit configured to transmit the partial content including the still image read from the bookmark storage unit 3002 or the partial content including the moving image and the audio is configured.
- the data acquisition unit 3041 receives the image data request information from the mobile phone 2100 In this case, each acquired image is transmitted to the mobile phone 2100 via the transmission / reception unit 3009.
- audio data relating to the moving image is also transmitted to mobile phone 2100 via transmitting / receiving section 3009.
- the deletion unit 3006 stores programs corresponding to music recognition processing, person recognition processing, character recognition processing, and capture recognition processing in advance, similarly to the data acquisition unit 3041.
- the deletion unit 3006 receives deletion instruction information for deleting program content recorded in the program content storage unit 3011, from the remote controller 2300 via the reception unit 3008.
- the deletion instruction information is information including a program ID.
- the deletion unit 3006 obtains the program content corresponding to the program ID included in the received deletion instruction information from the program content storage unit 3001, and further obtains the bookmark information including the program ID matching the program ID from the bookmark storage unit 3002. To get all.
- the deleting unit 3006 repeats the deletion method described below for the number of the acquired bookmark information.
- the deletion unit 3006 determines whether the additional information included in the bookmark information is “music”. If it is determined to be “music”, music recognition processing is performed using the BM display time included in the bookmark information and the acquired program content, and the most recent music head frame located before the BM display time Music audio image data consisting of continuous frames and audio data for a preset time (for example, 3 minutes), and the acquired music audio image data
- BM display time and the program content obtained from the program content storage unit 3001 are used to perform a person recognition process, to detect the latest person first frame located before the BM display time, and further, to detect the detected person. Continuous frames and audio data for a preset period of time (for example, 3 minutes) from the first frame. Acquire and temporarily store the acquired voice image data for a person in association with the program ID, CH number, and BM display time.
- the additional information included in the puck mark information is not a “person”, it is determined whether or not it is a “character”. When it is determined that the additional information is a “character”, the additional information is included in the puck mark information. Character recognition processing is performed using the bookmark display time and the program content obtained from the program content storage unit 3001 to detect the latest character head frame located before the BM display time, and furthermore, to detect the detected character head.
- a continuous frame for a preset time (for example, 3 minutes) and audio data for character data, which is a character data, are acquired from a frame by copying, and the acquired audio image data for character is acquired by a program ID, a CH number, and the like.
- ⁇ ⁇ ⁇ ⁇ Temporarily stores the BM in association with the display time.
- the bookmark display time included in the bookmark information and the information obtained from the program content storage unit 3001 are obtained. Performing capture recognition processing using the detected program content, detecting the most recent capture first frame positioned before the BM display time, and further detecting the captured capture first frame power for a preset time (for example, 3 minutes) continuous frames and audio data Capturing audio / video data is acquired by copying, and the acquired audio / video data for capturing is temporarily associated with the program ID, CH number, and BM display.
- a preset time for example, 3 minutes
- the audio image data is collectively referred to as audio image data. Call.
- the deletion unit 3006 deletes the program content after performing the above operation on all the bookmark information acquired from the bookmark storage unit 3002.
- the deletion unit 3006 stores the temporarily stored audio / video data in the program content storage unit 3001. At this time, the recording start time is the date and time indicated by the BM display time.
- the deletion unit 3006 constitutes a partial content acquisition unit that acquires a still image or a moving image marked with a bookmark.
- the writing unit 3032 forms a writing unit for writing the puck mark information.
- the operation of receiving deletion instruction information in the deletion unit 3006 constitutes a deletion reception unit, and the operation of acquiring audio / video data after receiving the deletion instruction information constitutes a first acquisition unit, and the audio / video data is stored in a program content storage unit.
- the operation of storing in the 3001 constitutes the recording unit, and after acquiring the audiovisual data for all the bookmark information acquired from the bookmark storage unit 3002, the operation of deleting the program content from the program content storage unit 3001 Constitutes a deletion unit. Further, the operation of the data acquisition unit 3041 for acquiring a still image or acquiring moving images and sounds constitutes a second acquisition unit.
- the output unit 3007 is the same as the output unit 2007 described above, and a description thereof will be omitted.
- the receiving unit 3008 is the same as the receiving unit 2008 described above, and a description thereof will not be repeated.
- the transmission / reception unit 3009 is the same as the transmission / reception unit 3009 described above, and a description thereof will not be repeated.
- the changed part is step S2040, and the image data acquisition processing is changed to the information storage processing shown in FIG. However, only the generated bookmark information is stored in each folder.
- bookmark information is generated by the following operation.
- the information generation unit 3030 When receiving the bookmark instruction information including the first registration instruction command, the information generation unit 3030 stores the received identification name, the acquired BM display time, the CH number, and the program ID in the target storage area. Then, the mark information is generated by using the information and the corner detection flag “0”. At this time, nothing is recorded in the ⁇ ya area code.
- the information generation unit 3030 When receiving the bookmark instruction information including the second registration instruction information, the information generation unit 3030 stores the received identification name, the acquired BM display time, the CH number, the program ID, and the target storage. The bookmark information is generated using the information stored in the area and the corner detection flag “1”. At this time, nothing is recorded in the area code.
- the information generating unit 3030 determines whether the received identification name, the acquired BM display time, the CH number and the program ID, and the received area The bookmark information is generated using the code, the information stored in the target storage area, and the corner detection flag “0”.
- the information generation unit 2030 when receiving the bookmark instruction information including the first registration instruction instruction and the area code, and when receiving the bookmark instruction information including the second registration instruction instruction and the area code, identifies the received identification information. Generates bookmark information using the name, acquired BM display time, CH number and program ID, received area code, information stored in the target storage area, and corner detection flag "1" I do.
- step S2430 which is changed to image data processing described later.
- step S2510 which is changed to image data processing described later.
- step S2505 if there is more than one bookmark information acquired in step S2505, the image data acquisition process is repeated for the number of acquired bookmark information.
- the data acquisition unit 3041 of the playback device 3000 acquires the BM target content corresponding to the CH number and the program ID included in the bookmark information generated by the information acquisition unit 3040 from the program content storage unit 3001. An acquisition process is performed (step S3000). The data acquisition unit 3041 determines whether the corner detection flag included in the bookmark information acquired by the information acquisition unit 3040 is “0” (step S3005).
- Step S3010 it is determined whether or not the additional information included in the bookmark information acquired by the information acquiring unit 3040 is “music” (Step S3010). If it is determined to be “music” (“YE S” in step S3010), music recognition processing is performed using the BM display time and the BM target content included in the bookmark information, and the acquired program content is obtained.
- the first frame of the music is detected and acquired (step S3015), and the acquired first frame of the music is acquired by copying a predetermined number of consecutive frames, and the audio data is also acquired by copying. (Step S3020). In step S3015, the audio data corresponding to the acquired music head frame is also acquired by copying.
- step S3025 If it is determined that the additional information included in the bookmark information is not “music” (“NO” in step S3010), it is determined whether it is “person” (step S3025).
- the BM display time and the BM target content included in the bookmark information are used to perform a person recognition process to obtain the acquired program content.
- the power head frame is detected and acquired (step S3030).
- step S3035 If it is determined that it is not a “person” (“NO” in step S3025), it is determined whether it is a “character” (step S3035).
- step S3035 If it is determined to be “character” (“YES” in step S3035), character recognition processing is executed using the BM display time and BM target content included in the bookmark information, and the acquired program content The first character frame is detected and acquired (step S3040).
- step S3045 When it is determined that the character is not “character” (“NO” in step S3035), that is, when it is determined that the character is “capture”, a capture recognition process is executed to acquire the acquired program content capture first frame. Detect and acquire (step S3045).
- step S3005 from the acquired BM target content, using the BM display time and the co-recognition process, the additional information included in the puck mark information acquired by the information acquisition unit 3040 Detecting corners containing image data corresponding to the indicated information, All the image data included in the detected corner is obtained by copying, that is, a moving image is obtained (step S3050). .
- detecting and acquiring a frame means detecting a frame and acquiring the detected frame by copying.
- step S3000 of the image data obtaining process shown in FIG. 51 will be described with reference to the flowchart shown in FIG. 52.
- the data acquisition unit 3041 acquires at least one or more program contents corresponding to the CH number and the program ID of the bookmark information acquired by the information acquisition unit 3040 from the program content storage unit 2001 (step S3100). Next, it is determined whether or not the acquired program content is one (step S3105).
- step S3105 If it is determined that the number of acquired program contents is one (“YES” in step S3105), the process ends, and if it is determined that the number of acquired program contents is not one (“YES” in step S3105). NO)), among the plurality of acquired program contents, the program content whose recording start time matches the time indicated by the BM display time included in the bookmark information is acquired (step S3110).
- the deletion unit 3006 Upon receiving the deletion instruction information (step S3200), the deletion unit 3006 obtains the program content corresponding to the program ID included in the received deletion instruction information from the program content storage unit 3001, and further obtains the bookmark corresponding to the program ID. All information is obtained from the bookmark storage unit 3002 (step S3205).
- step S3210 it is determined whether the additional information included in the bookmark information is music or not.
- the deletion unit 3006 executes music recognition processing to detect a music head frame (step S3215), and further detects the detected music head.
- the music audio / video data is obtained by copying using frames, and the obtained music audio / video data is associated with the program ID, CH number, and BM display time. It is stored temporarily (step S3220).
- step S3210 If it is determined that it is not “music” (“NO” in step S3210), it is determined whether the additional information is “person” (step S3225).
- the deleting unit 3006 performs a person recognition process to detect a person head frame (step S3230), and detects the detected person head frame. Then, the voice image data for a person is obtained by copying using the method, and the obtained voice image data for a person is temporarily stored in association with the program ID, the CH number, and the BM display time (step S3235).
- step S3225 If it is determined that the character is not “person” (“NO” in step S3225), it is determined whether the additional information is “character” or not (step S3240).
- the deletion unit 3006 performs a character recognition process to detect a character head frame (step S3245), and detects the detected character head frame. Then, the character voice image data is acquired by copying, and the obtained character voice image data is temporarily stored in association with the program ID, the CH number, and the BM display time (step S3250).
- step S3240 If it is determined that the character is not “character” (“NO” in step S3240), that is, if it is determined that the additional information 5 is “capture”, the deletion unit 3006 executes the capture recognition process and performs the capture.
- the first frame is detected (step S3255), the captured audio image data is acquired by copying using the detected first frame of the capture, and the acquired audio image data for capture is associated with the program ID, CH number, and BM display time. And temporarily store it (step S3270).
- the deletion unit 3006 determines whether there is any bookmark information that has not been processed from step S3210 to step S3260 among the bookmark information acquired in step S3205 (step S3265).
- step S3265 If it is determined that the bookmark information exists ("YES" in step S3265), the bookmark information that has not been processed is obtained (step S3270), and the process returns to step S3210. The operation is performed.
- the deletion unit 3006 determines that there is no bookmark information that has not been processed from step S3210 to step S3260, that is, all the bookmarks acquired in step S3205. If it is determined that the processing from step S3210 to step S3260 has been performed on the information ("NO" in step S3265), the program content is deleted (step S3275), and the temporarily stored audio is stored.
- the image data is associated with the program ID, the CH number, and the BM display time and stored in the content storage unit 3001 (step S3280).
- the playback device 2000 receives the bookmark instruction during the playback of the program content, and is not limited to this.
- the playback device 2000 may receive a bookmark instruction during playback of the moving image corresponding to the bookmark information.
- a bookmark instruction including a second registration instruction command may be used to accept a bookmark instruction while reproducing a detected moving image, that is, a moving image for one corner.
- the playback device 2000 records, as the BM display time, the broadcast time for the first frame acquired in the recognition process (for example, the corner recognition process).
- the playback device 2000 calculates the bookmarked broadcast time from the BM display time corresponding to the moving image being played, and further supports the moving image being played. Get the CH number and program ID from the mark information.
- the playback device 2000 receives the identification name, bookmarks using the calculated broadcast time, the acquired CH number and program ID, the received identification name, and the information stored in the target storage area. Generate information.
- the playback device 2000 obtains a still image or a moving image corresponding to the bookmark information using the calculated broadcast time and a recognition process corresponding to the information stored in the target storage area.
- the playback device 2000 stores the acquired still image or moving image in association with the generated bookmark information. If the bookmark instruction information includes the area code, the playback device 2000 includes the calculated broadcast time, the acquired CH number and program ID, the received identification name, and the bookmark information.
- the bookmark information is generated using the area code and the information stored in the target storage area.
- the playback device 2000 can perform a bookmark during playback of a moving image.
- the operation in (1) above may be applied to the playback device 3000.
- the reproducing device 3000 calculates the broadcast time of the first frame acquired in the recognition process and temporarily stores the broadcast time.
- the playback device 3000 calculates the broadcast time at the time of receiving the bookmark instruction information using the stored broadcast time, and further calculates the bookmark information corresponding to the moving image being reproduced. Get the CH number and program ID.
- the playback device 2000 receives the identification name, and uses the calculated broadcast time, the obtained CH number and the program ID, the received identification name, and the information stored in the target storage area to form the bookmark information. Is generated and stored.
- the playback device 3000 includes the calculated broadcast time, the acquired CH number and the program ID, the received identification name, and the bookmark information.
- the area code to be used and the information stored in the target storage area are used to generate the puck mark information.
- the force S whose bookmark target has been changed using the left button 2313 and the right button 2314 is not limited to this.
- the remote control 2300 uses the left button 23
- a button indicating a bookmark target for example, a music button, a person button, a character button, and a capture button may be provided.
- the remote controller 2300 sends the bookmark instruction information including the first registration instruction information and the correspondence information to the irradiation unit 2303. To the playback device 2000 via.
- the correspondence information is the same as the correspondence information described in the first embodiment, and a description thereof will not be repeated.
- the remote controller 2300 displays first registration instruction information and corresponding information.
- the bookmark instruction information including the area code is transmitted to the playback device 2000 via the irradiation unit 2303.
- information generating section 2030 of playback device 2000 Upon receiving the bookmark instruction information, information generating section 2030 of playback device 2000 generates bookmark information using the corresponding information included in the received bookmark instruction information. Note that other elements included in the bookmark information are obtained by the operation described in the above embodiment.
- the bookmark system is configured by the playback device 2000 and the mobile phone 2100.
- the present invention is not limited to this.
- the bookmark system may consist only of the playback device. In this case, when the playback device receives any one of the bookmark instruction information including the first registration instruction instruction and the bookmark information including the second registration instruction instruction from the remote controller, and displays an image related to the bookmark information, Receives display start information only from the remote control. '
- the playback device 2000 performs a recognition process when acquiring a bookmarked still image or moving image, and detects the first frame positioned before the BM display time S.
- the force S is not limited to this. ,.
- a frame corresponding to the BM display time may be set as the first frame.
- the program content to be reproduced is stored in the reproduction device.
- the program content to be reproduced may be distributed by server-type broadcasting. At this time, registration of a bookmark and transmission / reception of an image related to the bookmark information may be performed between the server that distributes the program content and the playback device.
- the power of performing the corner recognition processing or the recognition processing corresponding to the additional information to obtain the image. It is not limited to.
- the playback device has a function of storing the played back images in a buffer of a predetermined capacity.
- a bookmark When a bookmark is instructed, one or more images stored in the buffer correspond to the bookmark information.
- the still image or the moving image to be stored may be stored in association with the bookmark information.
- the mobile phone when an image corresponding to bookmark information is transmitted to a mobile phone, the mobile phone stores the image in a memory or a removable recording medium (for example, an SD card) in the mobile phone. You can record the received image.
- a removable recording medium for example, an SD card
- part or all of the functional blocks surrounded by broken lines shown in FIGS. 2, 10, 22, 24, 28, 32, 42 and 49 may be integrated circuits. Even if it is realized by LSI Little. These functional blocks may be individually integrated into one chip, or may be integrated into one chip so as to include some or all of them.
- the integrated circuit that controls the recording / reproducing device is an LSI, but may be called an IC, a system LSI, a super LSI, or an ultra LSI depending on the degree of integration.
- the technique of the integrated circuit is not limited to the LSI, and may be realized by a dedicated circuit or a general-purpose processor.
- an FPGA Field Programmable Gate Array
- a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used.
- the information corresponding to the bookmark information is not limited to the force of acquiring a still image or a moving image. Only audio data may be obtained as information corresponding to the bookmark information. In this case, for example, in the above embodiment, if the additional information power “music” included in the bookmark information, only the voice is acquired as the information to be acquired.
- a timer may be used to measure the elapsed time from the start of reproduction of the program content.
- the playback device when the playback device receives the puck mark instruction information, it is timed at the time of receiving it. / Pull time is acquired as elapsed time.
- the present invention may be the method described above. Further, the method may be a computer program that realizes these methods by a computer, or may be a digital signal that also serves as the computer programmer.
- the present invention provides a computer-readable recording medium for the computer program or the digital signal, for example, a flexible disk, a hard disk, a CD-ROM,
- the computer program or the digital signal may be transmitted via an electric communication line, a wireless or wired communication line, a network represented by the Internet, or the like.
- the present invention may be a computer system including a microprocessor and a memory, wherein the memory stores the computer program, and the microprocessor operates according to the computer program.
- the program or the digital signal is recorded on the recording medium and transferred, or the program or the digital signal is transferred via the network or the like, so that the other computer system becomes independent. It may be implemented.
- the bookmark system described above can be used business-wise, that is, iteratively and continuously, in the industry that manufactures and sells playback devices and portable terminals.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Television Signal Processing For Recording (AREA)
- Information Transfer Between Computers (AREA)
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005514442A JPWO2005032829A1 (ja) | 2003-09-25 | 2004-09-22 | 再生装置及びブックマークシステム |
US10/571,678 US20070110397A1 (en) | 2003-09-25 | 2004-09-22 | Playback apparatus and bookmark system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2003334184 | 2003-09-25 | ||
JP2003-334184 | 2003-09-25 |
Publications (4)
Publication Number | Publication Date |
---|---|
WO2005032829A2 true WO2005032829A2 (ja) | 2005-04-14 |
WO2005032829A1 WO2005032829A1 (ja) | 2005-04-14 |
WO2005032829A3 WO2005032829A3 (ja) | 2005-05-19 |
WO2005032829A8 WO2005032829A8 (ja) | 2005-07-07 |
Family
ID=
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008146493A (ja) * | 2006-12-12 | 2008-06-26 | Yahoo Japan Corp | 情報提供装置、情報提供方法、及びコンピュータプログラム |
WO2010098096A1 (ja) * | 2009-02-25 | 2010-09-02 | シャープ株式会社 | 携帯端末装置、コンテンツ再生装置、ブックマーク管理サーバ、ブックマーク管理システム、ブックマーク管理方法、コンテンツ再生方法、ブックマーク管理サーバの制御方法、制御プログラムおよび記録媒体 |
JP2011023867A (ja) * | 2009-07-14 | 2011-02-03 | Panasonic Corp | 動画像再生装置および動画像再生方法 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002021831A2 (en) * | 2000-09-08 | 2002-03-14 | Kargo, Inc. | Video interaction |
JP2002209204A (ja) * | 2000-04-14 | 2002-07-26 | Nippon Telegr & Teleph Corp <Ntt> | 放送情報に関連した情報の取得方法及びシステム並びに装置 |
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002209204A (ja) * | 2000-04-14 | 2002-07-26 | Nippon Telegr & Teleph Corp <Ntt> | 放送情報に関連した情報の取得方法及びシステム並びに装置 |
WO2002021831A2 (en) * | 2000-09-08 | 2002-03-14 | Kargo, Inc. | Video interaction |
Non-Patent Citations (1)
Title |
---|
MIYAOKU K. ET AL.: 'TV hoso to internet no kyocho ni muketa media renkei hoshiki-visionMark' NTT R&D vol. 51, no. 10, 10 October 2002, pages 812 - 820, XP002986844 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008146493A (ja) * | 2006-12-12 | 2008-06-26 | Yahoo Japan Corp | 情報提供装置、情報提供方法、及びコンピュータプログラム |
WO2010098096A1 (ja) * | 2009-02-25 | 2010-09-02 | シャープ株式会社 | 携帯端末装置、コンテンツ再生装置、ブックマーク管理サーバ、ブックマーク管理システム、ブックマーク管理方法、コンテンツ再生方法、ブックマーク管理サーバの制御方法、制御プログラムおよび記録媒体 |
JP2011023867A (ja) * | 2009-07-14 | 2011-02-03 | Panasonic Corp | 動画像再生装置および動画像再生方法 |
Also Published As
Publication number | Publication date |
---|---|
JPWO2005032829A1 (ja) | 2006-12-14 |
WO2005032829A8 (ja) | 2005-07-07 |
US20070110397A1 (en) | 2007-05-17 |
WO2005032829A3 (ja) | 2005-05-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4045330B2 (ja) | テキスト表示およびタイトルの遠隔データベースとの通信機能を有する再生装置 | |
JP4317127B2 (ja) | 音楽ビデオを索引化して要約するシステム及び方法 | |
US20070265720A1 (en) | Content marking method, content playback apparatus, content playback method, and storage medium | |
KR20070109950A (ko) | 정보 처리 시스템, 단말 장치, 정보 처리 방법, 프로그램 | |
US7587136B2 (en) | Image capturing apparatus, image capturing method, output apparatus, output method and program | |
JP4035993B2 (ja) | データ処理装置及び方法 | |
JPWO2005032829A1 (ja) | 再生装置及びブックマークシステム | |
JP3131208B2 (ja) | ビデオ番組検索装置 | |
JP2005274992A (ja) | 楽曲識別用情報検索システム、楽曲購入システム、楽曲識別用情報取得方法、楽曲購入方法、オーディオ信号処理装置およびサーバ装置 | |
JP6153170B2 (ja) | サーバ装置及びプログラム | |
JP3592255B2 (ja) | 総合放送データベース作成システム及び放送局放送データベース作成システム | |
US20040001154A1 (en) | System and method of manual indexing of image data | |
JPH0745050A (ja) | 自動分類記録装置 | |
JP2006012257A (ja) | 楽曲選択装置、楽曲選択システム、及び楽曲選択方法 | |
KR20020006620A (ko) | 휴대용 시디재생장치 및 자막표시 오디오시디 및 이를이용한 학습시스템 | |
US20050158018A1 (en) | Information reproduction apparatus | |
JP5094168B2 (ja) | コンテンツ再生装置および映像表示システム | |
US7873637B2 (en) | Automatically imparting an index by using various kinds of control signals | |
JP2008027345A (ja) | オーディオ装置 | |
JP4364850B2 (ja) | オーディオ再生装置 | |
JP2853258B2 (ja) | カラオケ装置 | |
JP4175430B2 (ja) | データ処理装置及びデータ処理方法 | |
JPH11109981A (ja) | カラオケ装置 | |
JP2007087449A (ja) | 記録メディア管理システム及び記録再生装置並びにメディア検索装置 | |
JP3797941B2 (ja) | 情報収集装置及び情報収集方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
CFP | Corrected version of a pamphlet front page |
Free format text: FIGURE ADDED |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2005514442 Country of ref document: JP |
|
122 | Ep: pct application non-entry in european phase | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2007110397 Country of ref document: US Ref document number: 10571678 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 10571678 Country of ref document: US |