KR101458521B1 - A system for play a contents of augmented reality - Google Patents

Abstract

The present invention relates to an augmented reality content reproducing system and method for reproducing 3D contents by recognizing a geometric marker displayed on a printed book, A 3D image retrieval unit for retrieving the 3D content corresponding to geometry marker information of the printed book through the content DB through a camera for continuously photographing the image and a profile DB, rendering the retrieved 3D content in a continuous manner, A 3D content reproduction unit for reproducing a caption, a sound source, and an image corresponding to the reproduction time of the 3D content, and a 3D content reproduction unit for converting the direction, angle, movement and movement of the 3D content continuously reproduced in correspondence with the geometry marker information of the printed book, And a content angle determiner for selectively controlling the marker information in accordance with the marker information.
According to the present invention, the user can control the direction, angle, movement, and movement of the 3D content by rotating the direction control cube on the augmented reality, and further, Content, sound source, and image can be appreciated, so that the learning efficiency can be improved.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a system for reproducing augmented reality contents,

The present invention relates to an augmented reality content reproducing system and method for reproducing 3D contents by recognizing a geometric marker displayed on a printed book.

Augmented Reality (AR) is a technique for recognizing images to be displayed on each page of a printed book and displaying 3D contents of different contents on an page in an animation form. In general, augmented reality can be implemented as a HMD-based real environment, a monitor-based real environment, and a hand-held real environment. Among them, the monitor-based real environment is realized through the web camera, so it is advantageous for realizing the augmented reality because the construction method is relatively convenient and the cost is low.

In this connection, Japanese Patent Laid-Open No. 10-2009-0061514 discloses a " system and method for reproducing mixed-content contents ".

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a perspective view of a digital camera according to an embodiment of the present invention; FIG. 2 is a block diagram illustrating a digital camera according to an embodiment of the present invention; Detecting geometric markers of a page and detecting data patent information of the printed book; detecting geometric markers of each page of the printed book from image information recognized by the camera, and detecting data characteristic information of the printed book; Detecting the real-time content information included in the information about the page of the printed book by analyzing the step, the geometry marker, and the coordinate information, and synthesizing and rendering the real- do.

Through such a configuration, the disclosed patent can apply the state of the art mixed reality technology at a low cost by using a material that is routinely used such as a print book, a web, a camera, and a hand, , Video, images, web pages, and the like.

However, in the case of the disclosure patent, since the geometrical marker and the coordinate information are analyzed to detect and express the sensible contents information included in the information about the page of the printed book, the technology for expressing the 3D contents on the augmented reality is very complicated have.

Therefore, there is a need for a technique capable of realizing an augmented reality with a simpler configuration.

According to an aspect of the present invention, there is provided an augmented reality contents reproducing system and method for controlling the direction, angle, movement, and movement of a 3D content by rotating a direction control cube on an augmented reality, The first object of the present invention is to improve the learning efficiency by providing corresponding contents, sound sources, and images for each page corresponding to the reproduction time of the 3D contents.

In addition, 3D contents for science and English are specifically implemented on the augmented reality, and the user can directly control the direction, angle, movement, and movement of the 3D contents implemented on the augmented reality, The second purpose is to make.

According to another aspect of the present invention, there is provided an augmented reality contents reproducing system for recognizing a geometric marker displayed on a printed book to reproduce 3D contents, the system comprising: Geometry marker information (n1) printed for identification; A profile DB storing geometric marker information n1 of the printed book; A content DB storing 3D content corresponding to geometry marker information n1 of the printed book; A direction control cube in which geometric marker information (n2) for controlling the direction of the content on each surface is printed in a cubic shape to determine the direction, angle, movement, and movement of the 3D content; A camera for selectively photographing the geometry marker information n1 printed on the printing book and selectively capturing the geometry marker information n2 printed on each face of the direction control cube; A geometry marker input unit connected to the camera by wire or wireless communication and selectively receiving geometry marker information n1 of a printed book and geometry marker information n2 of a direction control cube from an image photographed by the camera; A 3D content retrieving unit for retrieving, from the content DB, 3D content corresponding to geometry marker information n1 of the printed book through a profile DB based on geometry marker information n1 of a printed book inputted through the geometry marker input unit; ; A 3D content playback unit for rendering the searched 3D content to continuously play back the searched 3D content, and playing back the subtitle, sound source, and video corresponding to the playback time of the 3D content to be rendered; When the geometry marker information n2 of the direction control cube for the 3D content reproduced by the 3D content reproducing unit is selectively input corresponding to geometry marker information n1 of the printed book, A content angle determining unit for determining an angle, a movement, and a movement based on geometry marker information (n2) of each surface of the direction control cube input through the geometry marker input unit; And a content view composed of an augmented reality reproduction screen for outputting the 3D content output by the 3D content reproduction unit and a sub screen for reproducing a sound source, an image and a subtitle corresponding to the reproduction of the 3D content. do.

According to an aspect of the present invention, there is provided a method of reproducing an augmented reality content by recognizing a geometric marker displayed on a printed book, comprising the steps of: receiving geometric marker information of a printed book; The method of claim 1, further comprising the steps of: (a) capturing marker information selectively or continuously; retrieving 3D content corresponding to geometry marker information of the printed book through a profile DB in a content DB; rendering the retrieved 3D content by rendering, The method of claim 1, further comprising the steps of: reproducing a subtitle, a sound source, and an image corresponding to a reproduction time of the 3D content to be rendered; and controlling a direction, an angle, a movement and a movement of the 3D content continuously reproduced corresponding to the geometry marker information of the printed book, In response to geometry marker information of the geometry marker.

A method for reproducing an augmented reality content according to an embodiment of the present invention operates on a computer-readable recording medium on which a program is recorded.

The system and method for reproducing the augmented reality contents according to the present invention controls the direction, angle, movement, and movement of the 3D contents by rotating the direction control cube on the augmented reality, The contents, the sound source, and the image can be appreciated for each page, thereby improving the learning efficiency.

In addition, 3D contents for science and English are specifically implemented on the augmented reality, and the user can directly control the direction, angle, movement, and movement of the 3D contents implemented on the augmented reality, .

1 is a diagram illustrating a configuration of an augmented reality content playback system according to an embodiment of the present invention,
Figure 2 is an illustration of the content view implemented in Figure 1,
Fig. 3 is an enlarged view of the augmented reality reproduction screen of Fig. 2,
Figure 4 is a flow chart illustrating the method of operation of Figure 1;

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to facilitate a person skilled in the art to which the present invention pertains. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification. And a detailed description thereof will be omitted to omit descriptions of portions that can be readily understood by those skilled in the art.

Throughout the specification and claims, when a section is referred to as " including " an element, it is understood that it does not exclude other elements, but may include other elements, unless specifically stated otherwise.

The technical terms referred to in the description for describing the present invention are defined and interpreted in a broad sense as commonly used in the technical field to which the present invention belongs. For example, when a portable terminal is referred to in the present specification, the portable terminal is not limited to a cellular phone, and is understood to be collectively referred to as all portable devices having a communication function, a camera function, and an image editing function. However, even if it is a usual technical term, the case where the meaning is given separately in this specification is not so.

1 is a diagram illustrating a configuration of an augmented reality content playback system according to an embodiment of the present invention.

1, a system 1000 according to the present invention includes a camera 100, a geometry marker input unit 200, a 3D content search unit 300, a 3D content playback unit 400, a content angle determination unit 500, , And a content view (600).

The geometry marker input unit 200 is connected to the camera 100 via a wired or wireless communication so that the geometry marker information n1 of the printed book 10 photographed by the camera 100 and the geometry marker information n1 of the orientation control cube 20 And receives the geometry marker information n2 selectively or continuously. As a preferred example of the present invention, the camera 100 and the geometry marker input unit 200 may be equipped with a transmission / reception communication module for network connection.

The geometry marker information n1 of the printed book 10 in the augmented reality contents reproducing system 1000 of the present invention is used to reproduce the 3D contents on a page basis and geometry marker information n2 of the direction control cube 20, Is used so that the user can directly control the direction, angle, movement, and movement of the 3D content recognized by the printing book 10. [

The 3D content retrieving unit 300 receives geometry marker information n1 of the printed book 10 selectively or continuously through the geometry marker input unit 200 and stores the geometry marker information n1 in the profile DB 310 And provides the 3D content playback unit 400 with the 3D content. Here, the contents information includes 3D contents, subtitles, sound sources, and image information to be selectively and continuously reproduced for each page through the 3D contents reproducing unit 400.

The 3D content reproducing unit 400 renders 3D content among the content information input from the 3D content searching unit 300 and continuously reproduces the 3D content. Also, the 3D content reproducing unit 400 reproduces the 3D source, Playback.

On the other hand, the content angle determining unit 500 determines whether or not the 3D content that is continuously reproduced in the 3D content reproducing unit in correspondence with the geometry marker information n2 of the direction control cube 20, which is input selectively or continuously from the geometry marker input unit 200, The direction, the angle, the movement, and the movement of the object. That is, the content angle determining unit 500 selectively and continuously reproduces the 3D content provided by the 3D content searching unit 300 in correspondence with the geometry marker information n1 photographed in the printing book 10, Angle, movement, and movement of the 3D content to be reproduced corresponding to the geometry marker information n2 photographed by the viewer 20 (FIG.

The content view 600 receives the 3D content, the motion information, the sound source, and the image from the 3D content playback unit 400 and selectively and continuously displays the 3D content.

FIG. 2 is an example of a content view implemented in FIG. 1, and FIG. 3 is an example of an enlarged view of an augmented reality reproduction screen of FIG.

Referring to FIGS. 2 and 3, the content view 600 includes an augmented reality reproduction screen 610 for displaying the 3D contents retrieved through geometric marker recognition on a page-by-page basis, and a sound source, And an auxiliary screen 620 for reproducing the subtitles.

The user can control the direction, angle, movement, and movement of the 3D content by rotating the direction control cube 20 on the augmented reality, and also can control the direction, angle, The contents, sound source, and image can be appreciated, so that the learning efficiency can be improved.

Figure 4 is a flow chart illustrating the method of operation of Figure 1;

The geometry marker information n1 photographed from the printing book and the geometry marker information n2 of the direction control cube 20 are selectively or continuously input in step 410. [

If the geometry marker information n1 of the printed book is inputted selectively or continuously (step 420), the 3D content corresponding to the geometry marker information n1 is retrieved from the content DB through the profile DB, To render continuously. Also, the sound source and the image are reproduced in correspondence with the reproduction time of the 3D content to be rendered. Here, the contents information includes 3D contents, subtitles, sound sources, and image information to be selectively and continuously reproduced for each page through the 3D contents reproducing unit 400.

On the other hand, if the geometry marker information n2 of the direction control cube is selectively or continuously inputted in correspondence with the geometry marker information n1 of the printed book (step 440), the direction, angle, Is expressed in correspondence with the geometry marker information (n2) of the direction control cube.

The method embodiments according to one aspect of the invention described above are implemented as program instructions and executed on a computer readable recording medium.

The computer-readable recording medium may include program commands, data files, data structures, and the like, alone or in combination. The computer-readable recording medium may be any type of optical storage media such as magnetic media such as hard disks, floppy disks and magnetic tape, optical media such as CD-ROMs and DVDs, magnetic-optical media such as floppy disks, And a hardware device specifically configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like.

The program instructions may be specially designed, configured, or otherwise available to those skilled in the computer software to implement the method embodiments of the present invention. Program instructions include machine code generated by the compiler as well as high-level language code that is executed on the computer via an interpreter.

While the system and method embodiments according to one aspect of the present invention described above are described on the basis of a flowchart as a series of steps or blocks, the present invention is not limited to these embodiments. For example, in the case of a method embodiment, some steps may occur in a different order or in a different order than the steps described above. It will also be understood by those skilled in the art that the steps shown in the flowchart are not exclusive and that other steps may be included or that one or more steps in the flowchart may be deleted without affecting the scope of the invention.

The embodiments of the invention described above include examples of various aspects. Those of ordinary skill in the art will recognize that other combinations are possible. Accordingly, it is intended that the invention include all alternatives, modifications and variations that fall within the scope of the following claims.

10: print book, 20: direction control cube,
100: camera, 200: geometry marker input unit,
300: 3D content retrieval unit, 310: Profile DB,
320: content DB, 400: 3D content playback unit,
410: rendering unit, 420: sound source reproducing unit,
500: content angle determining unit, 600: content view

Claims (3)

1. An augmented reality contents reproducing system for reproducing a 3D content by recognizing a geometric marker displayed on a printed book,
Geometry marker information (n1) printed to identify the 3D content on a page-by-page basis of the printed book;
A profile DB storing geometric marker information n1 of the printed book;
A content DB storing 3D content corresponding to geometry marker information n1 of the printed book;
A direction control cube in which geometric marker information (n2) for controlling the direction of the content on each surface is printed in a cubic shape to determine the direction, angle, movement, and movement of the 3D content;
A camera for selectively photographing the geometry marker information n1 printed on the printing book and selectively capturing the geometry marker information n2 printed on each face of the direction control cube;
A geometry marker input unit connected to the camera by wire or wireless communication and selectively receiving geometry marker information n1 of a printed book and geometry marker information n2 of a direction control cube from an image photographed by the camera;
A 3D content retrieving unit for retrieving, from the content DB, 3D content corresponding to geometry marker information n1 of the printed book through a profile DB based on geometry marker information n1 of a printed book inputted through the geometry marker input unit; ;
A 3D content playback unit for rendering the searched 3D content to continuously play back the searched 3D content, and playing back the subtitle, sound source, and video corresponding to the playback time of the 3D content to be rendered;
When the geometry marker information n2 of the direction control cube for the 3D content reproduced by the 3D content reproducing unit is selectively input corresponding to geometry marker information n1 of the printed book, A content angle determining unit for determining an angle, a movement, and a movement based on geometry marker information (n2) of each surface of the direction control cube input through the geometry marker input unit; And
And a content view composed of an augmented reality reproduction screen for outputting the 3D content output by the 3D content reproduction unit and a sub screen for reproducing a sound source, an image and a subtitle corresponding to the reproduction of the 3D content. Realistic content playback system. delete delete

Images