Nothing Special   »   [go: up one dir, main page]

KR20140129936A - A Head Mounted Display and A Method for Providing Contents Using the Same - Google Patents

A Head Mounted Display and A Method for Providing Contents Using the Same Download PDF

Info

Publication number
KR20140129936A
KR20140129936A KR1020130048912A KR20130048912A KR20140129936A KR 20140129936 A KR20140129936 A KR 20140129936A KR 1020130048912 A KR1020130048912 A KR 1020130048912A KR 20130048912 A KR20130048912 A KR 20130048912A KR 20140129936 A KR20140129936 A KR 20140129936A
Authority
KR
South Korea
Prior art keywords
hmd
present
processor
augmented reality
display
Prior art date
Application number
KR1020130048912A
Other languages
Korean (ko)
Inventor
박수왕
Original Assignee
인텔렉추얼디스커버리 주식회사
(주)소셜네트워크
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 인텔렉추얼디스커버리 주식회사, (주)소셜네트워크 filed Critical 인텔렉추얼디스커버리 주식회사
Priority to KR1020130048912A priority Critical patent/KR20140129936A/en
Publication of KR20140129936A publication Critical patent/KR20140129936A/en

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0176—Head mounted characterised by mechanical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/02—Viewing or reading apparatus
    • G02B27/021—Reading apparatus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention relates to a head mounted display (HMD) and a method for providing content using the same, and more specifically, to an HMD which provides content corresponding to a condition of a user wearing the HMD and a method for providing content by using the same. For this purpose, the HMD according to the present invention comprises: a processor which controls the operation of the HMD, a sensor unit which detects an object adjacent to the HMD, and a display unit which outputs an image based on a command from the processor. The processor detects at least one object, acquires augmented reality information of the detected object, acquires position information of the object with respect to the HMD, and provides the augmented reality information based on the position information of the object.

Description

[0001] The present invention relates to a head mount display and a content providing method using the same,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a head mounted display (HMD) and a content providing method using the HMD. More particularly, the present invention relates to an HMD for providing contents adaptively to the situation of a user worn on the HMD, .

Head-mounted displays (HMDs) are various digital devices that can be worn on the head like glasses to receive multimedia contents. 2. Description of the Related Art [0002] Various wearable computers (wearable computers) have been developed in accordance with the trend of weight reduction and miniaturization of digital devices, and such HMDs are also widely used. The HMD can be combined with augmented reality technology, N screen technology, etc., beyond the simple display function, to provide various convenience to the user.

The user wearing the HMD can perform the interaction with the HMD in various situations. In this case, a more convenient user interface is required for the HMD to provide a better context aware service to the user.

The present invention has an object to provide a better situation recognition service to a user wearing an HMD.

In particular, the present invention has an object to provide a convenient command interface for a user wearing an HMD.

In addition, the present invention has an object to adaptively adjust the augmented reality information provided through the HMD.

According to an aspect of the present invention, there is provided a content providing method using a head mounted display (HMD), comprising: detecting at least one object; Acquiring augmented reality information of the detected object; Obtaining positional information of the object with respect to the HMD; And providing the augmented reality information based on position information of the object; And a control unit.

In this case, the position information of the object is detected using an image obtained through the front camera unit of the HMD.

Meanwhile, a head-mounted display (HMD) according to an embodiment of the present invention includes a processor for controlling the operation of the HMD; And a sensor unit for detecting an object around the HMD; And a display unit for outputting an image based on instructions of the processor, wherein the processor is configured to detect at least one object, obtain augmented reality information of the detected object, Acquiring positional information, and providing the augmented reality information based on position information of the object.

According to the embodiment of the present invention, it is possible to provide a convenient command interface for a user wearing the HMD.

According to an embodiment of the present invention, it is possible to provide a smart situation recognition service by discriminating whether the user's voice is a voice command for the HMD or a conversation with the other party.

According to another embodiment of the present invention, in a situation where augmented reality information for various objects is mixed, the user can extract and provide only the augmented reality information of the desired object.

1 is a block diagram showing an HMD according to an embodiment of the present invention;
2 is a schematic diagram illustrating an HMD according to one embodiment of the present invention.
3 is a schematic view of an HMD according to another embodiment of the present invention.
4 is a diagram showing a specific embodiment of a method for providing a user interface of the present invention.
5 is a diagram specifically illustrating a method for providing augmented reality information according to the present invention.

As used herein, terms used in the present invention are selected from general terms that are widely used in the present invention while taking into account the functions of the present invention. However, these terms may vary depending on the intention of a person skilled in the art, custom or the emergence of new technology. Also, in certain cases, there may be a term arbitrarily selected by the applicant, and in this case, the meaning thereof will be described in the description of the corresponding invention. Therefore, it is intended that the terminology used herein should be interpreted relative to the meaning of the term rather than to the nomenclature of the term, and the entire content of the specification.

1 is a block diagram illustrating an HMD 100 according to an embodiment of the present invention.

1, the HMD 100 of the present invention includes a processor 110, a display unit 120, a camera unit 130, a communication unit 140, a sensor unit 150 and a storage unit 160 can do.

First, the display unit 120 outputs an image on the display screen. The display unit 120 outputs content to be executed by the processor 110 or outputs an image based on a control command of the processor 110. [ Further, according to the embodiment of the present invention, the display unit 120 can display an image based on a control command of the external digital device 200 connected to the HMD 100. [ For example, the display unit 120 may display the content being executed by the external digital device 200 connected to the HMD 100. [ At this time, the HMD 100 receives data from the external digital device 200 through the communication unit 140, and can output an image based on the received data.

Next, the camera unit 130 senses the image and delivers the sensed image to the processor. According to an embodiment of the present invention, the camera unit 130 may include a front camera unit (not shown) and an eye tracking camera unit (not shown). The front camera unit can detect an image of the front direction of the HMD and provide it to the processor. The eye tracking camera unit can detect the pupil position of the user wearing the HMD 100 and track the gaze of the user. In the embodiment of the present invention, the camera unit 130 includes various types of image sensing devices such as a depth camera module and an infrared camera module, as well as a general CCD (Charge Coupled Device) or CMOS (Complementary Metal-Oxide Semiconductor) camera module.

Next, the communication unit 140 can communicate with the external digital device 200 or the server using various protocols to transmit / receive data. In the present invention, the communication unit 140 can access a server or a cloud through a network and can transmit / receive digital data, for example, contents. In addition, according to another embodiment of the present invention, the HMD 100 can perform the connection with the external digital device 200 using the communication unit 140. [ At this time, the HMD 100 can receive the display output information of the content being executed by the connected external digital device 200 in real time, and output the image to the display unit 120 using the received information.

The sensor unit 150 may transmit the user input or the environment recognized by the HMD 100 to the processor 110 using at least one sensor mounted on the HMD 100. [ At this time, the sensor unit 150 may include a plurality of sensing means. In one embodiment, the plurality of sensing means may be a gravity sensor, a geomagnetism sensor, a motion sensor, a gyro sensor, an acceleration sensor, an infrared sensor, an inclination sensor, an illuminance sensor, a proximity sensor, A sensor, a depth sensor, a pressure sensor, a banding sensor, an audio sensor, a video sensor, a microphone, a microphone array, a GPS (Global Positioning System) sensor, and a touch sensor. The sensor unit 150 collectively refers to the various sensing means described above, and can sense various inputs of the user and the environment of the user, and can transmit the sensing result so that the processor 110 can perform the operation accordingly. The above-described sensors may be included in the HMD 100 as separate elements, or integrated into at least one or more elements.

Next, the storage unit 160 may store digital data including various contents such as video, audio, photograph, document, and application. The storage unit 150 includes various digital data storage media such as a flash memory, a random access memory (RAM), and a solid state drive (SSD). The storage unit 150 may also store content received by the communication unit 140 from the external digital device 200 or the server.

The processor 110 of the present invention can execute the content of the HMD 100 itself or the content received through the data communication. In addition, it is possible to execute various applications and process data inside the device. In addition, the processor 110 controls each unit of the HMD 100 and controls transmission / reception of data between the units.

The HMD 100 shown in FIG. 1 is a block diagram according to an exemplary embodiment of the present invention, in which blocks shown separately are logically distinguished from elements of a device. Thus, the elements of the device described above can be mounted as one chip or as a plurality of chips depending on the design of the device.

2 is a schematic diagram showing an HMD 100 according to an embodiment of the present invention. The HMD 100 according to the embodiment of the present invention includes a display unit 120 and a camera unit 130. [

The display unit 120 displays an image based on a control command of a processor (not shown) of the HMD 100. [ In an embodiment of the present invention, the display unit 120 may include a display screen so that an image is formed on the display screen. In addition, according to another embodiment of the present invention, the display unit 120 can project an image at a specific position in the front direction of the HMD 100 without having a separate display screen.

According to an embodiment of the present invention, the display unit 120 may include a first display unit 120a and a second display unit 120b. In the embodiment of the present invention, the first display unit 120a displays an image for the left eye of the user wearing the HMD 100, and the second display unit 120b displays an image for the right eye of the user Display. According to the embodiment of the present invention, the HMD 100 can separate the source image for display on the display unit 120 into the left eye image and the right eye image, respectively. At this time, the separated left eye image and right eye image can be displayed on the first display unit 120a and the second display unit 120b, respectively.

The camera unit 130 also senses the image and delivers the sensed image to the processor. The camera unit 130 may include at least one of a front camera unit and an eye tracking camera unit as described above. The camera unit 130 may have a predetermined field of view area. That is, the camera unit 130 acquires an image in the field of view and delivers the acquired image to the processor.

FIG. 3 shows an HMD 100 and an external digital device 200 connected thereto according to another embodiment of the present invention. In the embodiment of FIG. 3, the HMD 100 may be connected to at least one external digital device 200, and may operate based on the control commands of the connected external digital device 200. A separate pairing or communication connection may be performed for connection between the HMD 100 and the external digital device 200. The pairing or communication connection operation may be performed by a user input to the HMD 100 or the external digital device 200 Lt; / RTI > For example, the HMD 100 may provide a separate button or user interface for pairing or communicating with the external digital device 200, receiving user input to the button or the user interface, And external digital device 200 can be performed.

The external digital device 200 includes various types of digital devices capable of controlling the HMD 100. [ For example, the external digital device 200 includes a smart phone, a PC, a PDA (Personal Digital Assistant), a notebook, a tablet PC, a media player, and the like. . The HMD 100 transmits / receives data to / from the external digital device 200 using various wired / wireless communication means. At this time, the available wireless communication means includes NFC (Near Field Communication), Zigbee, infrared communication, Bluetooth, Wi-Fi, etc., but the present invention is not limited thereto. In the present invention, the HMD 100 can be connected to and communicate with the external digital device 200 using any one of the above communication means, or a combination thereof.

Referring to FIG. 4, the HMD 100 may detect an area where the speaker 20 is located using a microphone or a voice signal 25 received by a microphone array (not shown). At this time, the HMD 100 may detect an area where the speaker 20 is located by using at least one of the time difference and the sound pressure difference of the received voice signal 25.

FIG. 5 shows how the HMD 100 provides the augmented reality information 530a, 530b, and 530c of the objects 40a, 40b, and 40c. The HMD 100 can detect the objects 40a, 40b and 40c and acquire the augmented reality information 530a, 530b and 530c of the objects 40a, 40b and 40c. 5, if the objects 40a, 40b, and 40c are specific devices, the augmented reality information 530a, 530b, and 530c includes various information such as a name of each device, a device product number, a price, . The HMD 100 may display the augmented reality information 530a, 530b, and 530c on the display unit 120. [ At this time, the augmented reality information 530a, 530b, and 530c may be displayed in an area corresponding to the position of the corresponding object 40a, 40b, or 40c.

The specific operations of the present invention performed by the HMD 100 have been described so far. However, the embodiment of the present invention is not limited to this, and includes operations that are performed by controlling the external digital device 200 connected to the HMD 100 as described with reference to FIG.

The HMD described in the present invention can be changed and replaced with various devices in accordance with the object of the present invention. For example, the HMD of the present invention includes various devices capable of providing a display by being worn by a user such as an EMD (Eye Mounted Display), eyeglass, eyepiece, eye wear, and HWD Lt; / RTI > While the present invention has been described with reference to the particular embodiments, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the spirit and scope of the invention. Therefore, it is to be understood that those skilled in the art can easily deduce from the detailed description and the embodiments of the present invention that they fall within the scope of the present invention.

10: User 20: Speaker
40a, 40b, 40c: Object 100: HMD
120: Display units 530a, 530b, 530c: Augmented reality information

Claims (4)

As a content providing method using a head mount display (HMD)
Detecting at least one object;
Acquiring augmented reality information of the detected object;
Obtaining positional information of the object with respect to the HMD; And
Providing the augmented reality information based on position information of the object;
(HMD), wherein the head-mounted display (HMD) comprises:
The method according to claim 1,
Wherein the position information of the object is detected using an image obtained through a front camera unit of the HMD.
With a head mount display (HMD)
A processor for controlling operation of the HMD; And
A sensor unit for detecting an object around the HMD;
And a display unit for outputting an image based on instructions of the processor,
The processor comprising:
At least one object is detected,
Acquiring augmented reality information of the detected object,
Acquiring positional information of the object with respect to the HMD,
And provides the augmented reality information based on position information of the object.
The method of claim 3,
Wherein the position information of the object is detected using an image obtained through a front camera unit of the HMD.
KR1020130048912A 2013-04-30 2013-04-30 A Head Mounted Display and A Method for Providing Contents Using the Same KR20140129936A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020130048912A KR20140129936A (en) 2013-04-30 2013-04-30 A Head Mounted Display and A Method for Providing Contents Using the Same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130048912A KR20140129936A (en) 2013-04-30 2013-04-30 A Head Mounted Display and A Method for Providing Contents Using the Same

Publications (1)

Publication Number Publication Date
KR20140129936A true KR20140129936A (en) 2014-11-07

Family

ID=52455095

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130048912A KR20140129936A (en) 2013-04-30 2013-04-30 A Head Mounted Display and A Method for Providing Contents Using the Same

Country Status (1)

Country Link
KR (1) KR20140129936A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017126741A1 (en) * 2016-01-20 2017-07-27 삼성전자 주식회사 Hmd device and method for controlling same
KR101983256B1 (en) * 2017-12-27 2019-05-28 주식회사 버넥트 Augmented reality system with dynamic representation technique of augmented image considering mutual positional relationship between objects
KR20190079008A (en) * 2017-12-27 2019-07-05 주식회사 버넥트 An augmented reality system to which a dynamic expression technique of an augmented image according to a user's gaze information is applied
KR101983249B1 (en) * 2017-12-27 2019-08-28 주식회사 버넥트 An augmented reality system with dynamic representation technique of augmented images according to distance from an object
US10535320B2 (en) 2015-07-07 2020-01-14 Samsung Electronics Co., Ltd Head-mounted display apparatus
KR102342872B1 (en) 2020-12-15 2021-12-24 옥재윤 Mutual sympathy system between user and avatar using motion tracking

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10535320B2 (en) 2015-07-07 2020-01-14 Samsung Electronics Co., Ltd Head-mounted display apparatus
WO2017126741A1 (en) * 2016-01-20 2017-07-27 삼성전자 주식회사 Hmd device and method for controlling same
US10643579B2 (en) 2016-01-20 2020-05-05 Samsung Electronics Co., Ltd. HMD device and method for controlling same
US11164546B2 (en) 2016-01-20 2021-11-02 Samsung Electronics Co., Ltd. HMD device and method for controlling same
KR101983256B1 (en) * 2017-12-27 2019-05-28 주식회사 버넥트 Augmented reality system with dynamic representation technique of augmented image considering mutual positional relationship between objects
KR20190079008A (en) * 2017-12-27 2019-07-05 주식회사 버넥트 An augmented reality system to which a dynamic expression technique of an augmented image according to a user's gaze information is applied
KR101983249B1 (en) * 2017-12-27 2019-08-28 주식회사 버넥트 An augmented reality system with dynamic representation technique of augmented images according to distance from an object
KR102342872B1 (en) 2020-12-15 2021-12-24 옥재윤 Mutual sympathy system between user and avatar using motion tracking

Similar Documents

Publication Publication Date Title
US8862186B2 (en) Lapel microphone micro-display system incorporating mobile information access system
KR101958778B1 (en) A Head Mounted Display and a Method for Controlling a Digital Device Using the Same
US9927877B2 (en) Data manipulation on electronic device and remote terminal
KR101989893B1 (en) A Head Mounted Display and A Method of Outputting Audio Signal Using the Same
US9304320B2 (en) Head-mounted display and method of controlling the same
KR101969351B1 (en) Head mounted display and method for controlling output of the same
CN107765429B (en) Image display device and operation method thereof
CN110166627B (en) Method and apparatus for providing notification
US9086687B2 (en) Smart watch and method for controlling the same
KR101861380B1 (en) A Method of Providing Contents Using Head Mounted Display and a Head Mounted Display Thereof
US20180033177A1 (en) Method for image display and electronic device supporting the same
KR20140129936A (en) A Head Mounted Display and A Method for Providing Contents Using the Same
KR20150088041A (en) A smart watch, a display device and the method of controlling thereof
KR20150037254A (en) Wearable display device and method of controlling layer
KR20150007130A (en) The mobile device and controlling method thereof, the head mounted display and controlling method thereof
EP3067782B1 (en) Information processing apparatus, control method, and program
KR20150142282A (en) Function controlling method and electronic device thereof
KR20150031614A (en) Portable device and method for controlling the same
US20170180626A1 (en) Live view control device, live view control method, live view system, and program
US9270982B2 (en) Stereoscopic image display control device, imaging apparatus including the same, and stereoscopic image display control method
US20170316261A1 (en) Systems and metohds of gesture recognition
CN115335795A (en) Information processing apparatus, information processing method, and program
KR20150001433A (en) Wearable device and the method for controlling the same
KR102462678B1 (en) Electronic device for adjusting a position of content displayed in a display based on ambient illumination and method of operating the same
KR20160009213A (en) A Head Mounted Display and A Method for Providing Contents Using the Same

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination