KR101337228B1

KR101337228B1 - System and method for providing reading background effect music/video using mobile communication terminal

Info

Publication number: KR101337228B1
Application number: KR1020070026165A
Authority: KR
Inventors: 김진식
Original assignee: 에스케이플래닛 주식회사
Priority date: 2007-03-16
Filing date: 2007-03-16
Publication date: 2013-12-05
Also published as: KR20080084439A

Abstract

Disclosed is a system and method for providing a background effect sound or a background effect image corresponding to the contents of a page of a book being read by recognizing the operation of turning a bookshelf of a reader to a mobile communication terminal. The present invention is attached to a portion of the book, and stores the identification tag for storing the ID information of the book, and the background effect sound or background effect image corresponding to the contents of each page of the book corresponding to the ID information of the identification tag, reading The reading background effect server for outputting the background effect sound or the background effect image corresponding to the page, and the reading background effect server connected to the wireless data communication by transmitting the ID information and the reading start page of the identification tag, the reading operation of the reader And a mobile communication terminal which downloads a motion image or a motion image read result message, and downloads and outputs a background effect sound or a background effect image transmitted from the reading background effect server. Therefore, when reading a book such as a paper book, comic book, etc., the background effect sound or the background effect image related to the page being read is transmitted from the reading background effect server to the mobile communication terminal so that music flows out or the image is projected. Alternatively, there is an effect that it is possible to increase the immersion degree by being interested in reading by heightening the visual mood.

Description

System and method for reading background sound effect / video using mobile communication terminal {SYSTEM AND METHOD FOR PROVIDING READING BACKGROUND EFFECT MUSIC / VIDEO USING MOBILE COMMUNICATION TERMINAL}

1 is a block diagram showing a reading background sound effect / image providing system using a mobile communication terminal according to an embodiment of the present invention.

2 is a flowchart illustrating an operation process of a reading background effect sound / image providing system (when a motion recognition program is mounted on a mobile communication terminal) using a mobile communication terminal according to an embodiment of the present invention.

3 is a flowchart illustrating an operation process of a reading background effect sound / image providing system (when a motion recognition program is mounted on a reading background effect server) using a mobile communication terminal according to an embodiment of the present invention.

Description of the Related Art [0002]

10: identification tag 20: reading background effect server

30: mobile communication terminal

The present invention is a system and method for providing a reading background sound effect / image using a mobile communication terminal, specifically, a sound effect (background music) or an effect image suitable for a page content of a book being read by recognizing a bookshelf turning operation of the reader to the mobile communication terminal. A system and method for providing a (background image).

With the rapid development of mobile communication technology, a technology is developed to receive data such as games, movies, traffic information, video, music, etc. by using the mobile internet as well as voice calls. Recently, a video call technology has been developed and supplied.

As described above, the highly developed mobile communication terminal has various functions, but when reading a book or comic book made of paper, the reader's mobile communication terminal is usually in a standby state. I was able to read while listening to stored music by manipulating it. In other words, while reading a paper book or comic book, the various functions of the mobile communication terminal are not utilized at all.

However, if you are reading music or video related to the content of the page you are reading, you can see the effect of watching a movie, watching a drama, animation, etc., can lead to interest in reading and increase immersion.

Therefore, there is an urgent need for a mobile communication terminal system that can provide background music, effect music, or background or effect images related to book contents when reading.

According to the present invention, when reading, a mobile communication terminal photographs the reader's motion and recognizes the motion of turning the bookshelf to receive the background effect sound or the background effect image corresponding to the page content of the book being read from the reading background effect server and the music on the mobile communication terminal. The present invention provides a system and method for providing a reading background sound effect / image using a mobile communication terminal to increase the immersion degree by increasing the hearing or visual mood of the reader since the flowing out or the image is projected. There is this.

The reading background effect sound / image providing system of the present invention for achieving the above object is attached to a portion of the book, the identification tag for storing the ID information of the book; A reading background effect server for storing a background effect sound or a background effect image corresponding to the contents of each page of a book corresponding to ID information of the identification tag, and outputting a background effect sound or a background effect image corresponding to a reading page; After transmitting the ID information of the identification tag and the reading start page by accessing the reading background effect server through wireless data communication, photographing the reading operation of the reader and transmitting the operation image or the operation image reading result message, and the reading background effect And a mobile communication terminal for downloading and outputting a background effect sound or a background effect image transmitted from a server.

In addition, the object is connected to the reading background effect server through the wireless data communication of the mobile terminal to transmit the ID information of the identification tag attached to the book and the reading start page; Photographing a reading operation of a reader with a camera of the mobile communication terminal; Reading a picture taken by the mobile communication terminal and transmitting a message indicating that the reader has turned the bookshelf; Selecting and transmitting a background effect sound or a background effect image corresponding to the message received from the reading background effect server; And reading and outputting a background effect sound or a background effect image in the mobile communication terminal.

Furthermore, the reading background effect sound / image providing method of the present invention for achieving the above object is connected to the reading background effect server through the wireless data communication of the mobile communication terminal to transmit the ID information of the identification tag attached to the book and the reading start page Making; Photographing a reading operation of a reader with a camera of the mobile communication terminal; Transmitting a reading operation image photographed by the mobile communication terminal; Reading a reading operation image received from the reading background effect server and selecting and transmitting a background effect sound or a background effect image corresponding to the corresponding page when it is determined that the reader turns the bookshelf; And downloading and outputting a background effect sound or a background effect image in the mobile communication terminal.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention will be described in detail.

Referring to FIG. 1, a reading background effect sound / image providing system according to an exemplary embodiment of the present invention is attached to a part of a book and stores an ID tag 10 for storing ID information of the book and an ID of the identification tag 10. A reading background effect server 20 and a reading background effect server for storing a background effect sound or a background effect image corresponding to the contents of each page of a book corresponding to information, and outputting a background effect sound or a background effect image corresponding to a reading page. 20) transmits the ID information and the reading start page of the identification tag 10 by wireless data communication, photographs the reading operation of the reader, transmits the operation image or the operation image reading result message, and reads the background effect of the reading. And a mobile communication terminal 30 for downloading and outputting a background effect sound or a background effect image transmitted from the server 20. Each component will be described in detail.

The identification tag 10 is attached to a part of the book, and is a medium that stores ID information of the book, and includes at least one of a code, a barcode, and an RFID tag composed of letters, numbers, or a combination thereof. Therefore, when the identification tag 10 is a code composed of letters, numbers, or a combination thereof, the reader directly inputs the code to the mobile communication terminal 30 and transmits the code. Meanwhile, when the identification tag 10 is a barcode or an RFID tag, the mobile terminal 100 should be equipped with a barcode reader or an RFID reader as an internal or external device, and the identification tag 10 through the barcode reader or the RFID reader. Read it and send it.

The reading background effect server 20 stores a background effect sound or a background effect image for each page content of the book corresponding to the ID information of the identification tag 10. In addition, the reading background effect server 20 may have a built-in motion recognition program that receives the image of the reader transmitted from the mobile communication terminal 30 to determine whether the reader turned over the bookshelf. In this case, the image of the reader photographed by the mobile communication terminal 30 is input to determine whether the reader turns the bookshelf, and the background effect sound or the background effect image corresponding to the page is transmitted to the mobile communication terminal 30.

The mobile communication terminal 30 is equipped with a barcode reader or an RFID reader capable of reading the identification tag 10, and is equipped with a camera so as to photograph a bookshelf turning operation of the reader. Here, the mobile communication terminal 30 includes a mobile phone, a PDA, a PMP, and all devices capable of wireless communication. Accordingly, the mobile communication terminal 30 accesses the reading background effect server 20 through the mobile communication network and transmits the ID information of the identification tag 10 or the reading start page and the image of the reader photographed by the camera in real time.

In addition, the mobile communication terminal 30 downloads the background effect sound or the background effect image transmitted from the reading background effect server 20 and outputs or projects it through a speaker or a projector.

On the other hand, the mobile terminal 30 may be equipped with an operation recognition program for analyzing whether the image of the reading operation of the reader to read the bookshelf. In this case, the image directly photographed by the mobile communication terminal 30 is analyzed by a motion recognition program to read whether the reader turns over a bookcase, and transmits the result message to the reading background effect server 20.

As a method of photographing the reading operation of the reader, the photographing is performed to recognize the reader's hand motion when photographing at a close distance, and the photographing is possible to recognize the arm motion of the reader when photographing at a long distance.

As such, according to an embodiment of the present invention, the mobile terminal 30 and the reading background effect server 20 are provided with a background effect sound or a background effect image corresponding to the contents of the book being read, thereby producing an actual movie or TV. As you can see, you can be interested in reading or increase your level of immersion.

Hereinafter, an operation method of a reading background effect sound / image providing system using a mobile communication terminal according to an embodiment of the present invention will be described.

Prior to explanation, the case where the motion recognition program is mounted in the mobile communication terminal 30 (FIG. 2) and the case in which it is mounted in the reading background effect server 20 (FIG. 3) are demonstrated.

Referring to FIG. 2, first, the wireless data communication of the mobile communication terminal 30 is connected to the "reading background effect server" of the service menu (S100).

Next, before starting reading, the identification tag 10 attached to the book is input or read with a barcode reader or an RFID reader, and the ID information of the book is transmitted to the reading background effect server 20 (S101).

Next, a page of a book to start reading (for example, "30" in the case of page 30) is input to the mobile communication terminal 30 and transmitted to the reading background effect server 20 (S102).

Next, the reading background effect server 20 selects the start of the reading background effect and faces the reader to the camera of the mobile communication terminal 30 to take an image for motion recognition (S103). At this time, there are two methods of photographing the reading operation of the reader, one of which can be selected. The first is to select to recognize the reader's hand movement when shooting at close range, and the other is to select to recognize the entire movement of the reader's body, that is, the movement of the arm when shooting at a distance. One of the two may be selected in consideration of the distance between the reader and the mobile communication terminal 30.

Next, the image of the reader photographed by the camera of the mobile communication terminal 30 is analyzed in real time by the motion recognition program mounted on the mobile communication terminal 30 to determine whether the reader turns over a bookshelf (S104).

If the motion recognition program installed in the mobile communication terminal 30 determines that the reader has turned the bookshelf, a message informing that the bookshelf has been turned over is transmitted to the reading background effect server 20 (S105). If it is determined that the bookshelf has not been turned over, the flow returns to step S103 to continue photographing the reader.

Then, when the reading background effect server 20 receives the message from the mobile communication terminal 30, it stops the transmission of the background effect sound or the background effect image previously transmitted, and the background effect sound or the background effect image suitable for the new page. Select and transmit to the mobile communication terminal 30 (S106).

The mobile communication terminal 30 downloads a background effect sound or a background effect image suitable for a new page transmitted from the reading background effect server 20 and immediately plays it to a reader, or in the case of a background effect image, a projector mounted Project the background effect image through (S107).

Referring to FIG. 3, first, a wireless data communication of the mobile communication terminal 30 is connected to a "reading background effect server" of a service menu (S200).

Next, before starting reading, the identification tag 10 attached to the book is input or read with a barcode reader or an RFID reader, and the ID information of the book is transmitted to the reading background effect server 20 (S201).

Next, a page of a book to start reading (for example, "30" in the case of page 30) is input to the mobile communication terminal 30 and transmitted to the reading background effect server 20 (S202).

Next, the reading background effect server 20 selects the start of the reading background effect, and faces the reader to the camera of the mobile communication terminal 30 to take an image for motion recognition (S203). At this time, there are two methods of photographing the reading operation of the reader, one of which can be selected. The first is to select to recognize the reader's hand movement when shooting at close range, and the other is to select to recognize the entire movement of the reader's body, that is, the movement of the arm when shooting at a distance. One of the two may be selected in consideration of the distance between the reader and the mobile communication terminal 30.

Next, the image of the reader photographed by the camera of the mobile communication terminal 30 (video or a still image taken periodically) is transmitted to the reading background effect server 20 (S204).

Then, the moving image or the still image image transmitted by the motion recognition program mounted on the reading background effect server 20 is analyzed by real-time motion recognition to determine whether the reader turns over a bookshelf (S205).

If the motion recognition program installed in the reading background effect server 20 determines that the reader has turned the bookshelf, the reading background effect server 20 stops transmitting the background effect sound or the background effect image that was previously transmitted, and the new page. The background effect sound or the background effect image is selected and transmitted to the mobile communication terminal 30 (S206). If it is determined that the bookshelf has not been turned over, the process returns to step S203 where the image of the reader continues to be transmitted.

Finally, the mobile communication terminal 30 downloads a background effect sound or a background effect image corresponding to a new page transmitted from the reading background effect server 20 and immediately plays it to a reader, or in the case of a background effect image. The background effect image is projected through the mounted projector (S207).

According to the present invention, when reading a book such as a paper book or a comic book, a background effect sound or a background effect image related to the page being read is transmitted from a reading background effect server to a mobile terminal so that music flows or the image is projected. There is an effect that it is possible to increase the degree of immersion in the reading by increasing the hearing or visual mood.

Claims

An identification tag attached to a portion of the book and storing ID information of the book;

A reading background effect server for storing a background effect sound or a background effect image corresponding to the contents of each page of a book corresponding to ID information of the identification tag, and outputting a background effect sound or a background effect image corresponding to a reading page; And

After transmitting the ID information of the identification tag and the reading start page by accessing the reading background effect server through wireless data communication, photographing the reading operation of the reader and transmitting the operation image or the operation image reading result message, and the reading background effect A mobile communication terminal for downloading and outputting a background effect sound or a background effect image transmitted from a server;

Includes, the mobile communication terminal is

Reading background effect sound / image providing system characterized in that the recording to recognize the movement of the reader's hand when shooting at a close distance, and to recognize the movement of the reader's arm when shooting at a distance.

The method of claim 1,

The identification tag,

Reading background effect sound / image providing system, characterized in that it comprises at least one of a code, a barcode and an RFID tag consisting of letters, numbers or a combination thereof.

The method of claim 1,

The mobile communication terminal is equipped with a motion recognition program that analyzes the motion image of the photographed reader and reads whether the bookshelf has been turned over, and transmits a motion image reading result message to the reading background effect server. / Video providing system.

The method of claim 1,

The reading background effect server is a reading background effect sound / image providing system, characterized in that for analyzing the motion image transmitted from the mobile communication terminal to read whether the book turning over the reading recognition.

Accessing the reading background effect server through wireless data communication of the mobile communication terminal and transmitting the ID information of the identification tag attached to the book and the reading start page;

Photographing the reading operation of the reader by a camera of the mobile communication terminal at a close distance to recognize the reading of the reader's hand, and capturing the reading operation of the reader at a long distance;

Reading a picture taken by the mobile communication terminal and transmitting a message indicating that the reader has turned the bookshelf;

Selecting and transmitting a background effect sound or a background effect image corresponding to the message received from the reading background effect server; And

And reading and outputting the background effect sound or the background effect image in the mobile communication terminal.

delete

Transmitting a reading operation image photographed by the mobile communication terminal;

Reading a reading operation image received from the reading background effect server and selecting and transmitting a background effect sound or a background effect image corresponding to the corresponding page when it is determined that the reader turns the bookshelf; And

delete