Nothing Special   »   [go: up one dir, main page]

WO2014010870A1 - Image display device for displaying personalized three-dimensional image according to location of viewer, and displaying method thereof - Google Patents

Image display device for displaying personalized three-dimensional image according to location of viewer, and displaying method thereof Download PDF

Info

Publication number
WO2014010870A1
WO2014010870A1 PCT/KR2013/005937 KR2013005937W WO2014010870A1 WO 2014010870 A1 WO2014010870 A1 WO 2014010870A1 KR 2013005937 W KR2013005937 W KR 2013005937W WO 2014010870 A1 WO2014010870 A1 WO 2014010870A1
Authority
WO
WIPO (PCT)
Prior art keywords
viewer
display device
displaying
dimensional
image
Prior art date
Application number
PCT/KR2013/005937
Other languages
French (fr)
Korean (ko)
Inventor
박민호
박지호
Original Assignee
인텔렉추얼 디스커버리 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 인텔렉추얼 디스커버리 주식회사 filed Critical 인텔렉추얼 디스커버리 주식회사
Publication of WO2014010870A1 publication Critical patent/WO2014010870A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/368—Image reproducers using viewer tracking for two or more viewers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/341—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N2013/40—Privacy aspects, i.e. devices showing different images to different viewers, the images not being viewpoints of the same scene
    • H04N2013/405—Privacy aspects, i.e. devices showing different images to different viewers, the images not being viewpoints of the same scene the images being stereoscopic or three dimensional

Definitions

  • the present invention relates to a video display device and a display method thereof, and more particularly, to a smart TV and a display method for displaying a personalized three-dimensional image according to the viewer position.
  • TV a representative home appliance
  • smart TV have various types of sensors, thereby enabling various types of new interfaces.
  • the basic principle of 3D imaging is the process of showing different images in both eyes and synthesizing the resulting visual differences in the brain. Therefore, the image is generated and synthesized based on a certain viewpoint, and there is a limit to the realization of the realistic image, such as not providing an effect that looks different depending on the viewer's position or viewing angle when viewing the actual scene.
  • the present invention has been made in the technical background as described above, when two or more viewers watch a three-dimensional image of the smart TV smart TV capable of providing a personalized three-dimensional image to fit each viewer's position and its display
  • the task is to provide a method.
  • the present invention checks the position of a plurality of viewers watching one TV, calculates the shape of the three-dimensional object when viewing the TV screen from the identified viewer position, and obtains a personalized three-dimensional image. Provide to each viewer.
  • the viewer position confirmation unit for confirming the viewer position of the image display device;
  • a three-dimensional object shape calculation unit configured to calculate a shape of a three-dimensional object when viewing the screen of the video display device at a confirmed viewer position;
  • An object synthesizing unit for synthesizing an object to be viewed by the viewer;
  • a display unit for displaying the synthesized object to the viewer.
  • the image display device may display a 3D image by a shutter glass method, and may further include a screen synchronizer configured to synchronize a screen with 3D glasses linked to the image display device.
  • the three-dimensional glasses may include a sensor for identifying the viewer position.
  • a method of displaying a personalized 3D image according to a viewer's position in a 3D image display apparatus comprising: identifying a viewer position of the image display apparatus; Calculating a shape of a three-dimensional object when viewing the screen of the image display device at a confirmed viewer position; Synthesizing an object to be shown to the viewer; And displaying the synthesized object to the viewer.
  • FIG. 1 is a diagram schematically illustrating an overall configuration of a smart TV system displaying a personalized 3D image according to a viewer's position according to an exemplary embodiment of the present invention.
  • FIG. 2 is a block diagram showing in more detail the configuration of a smart TV system for displaying a personalized three-dimensional image according to the viewer position according to an embodiment of the present invention.
  • FIG. 3 is a flowchart illustrating an image display method of a smart TV system displaying a personalized 3D image according to a viewer position according to an exemplary embodiment of the present invention.
  • FIG. 1 is a diagram schematically illustrating an overall configuration of a smart TV system displaying a personalized 3D image according to a viewer's position according to an exemplary embodiment of the present invention.
  • a smart TV system displaying a personalized 3D image according to a viewer's position may display a 3D image on a TV 100 and a TV 100.
  • the smart TV system for displaying a personalized three-dimensional image according to the viewer position according to an embodiment of the present invention is to display a personalized three-dimensional image to each viewer in a situation where two or more viewers watch a single TV (100) In FIG. 1, two three-dimensional glasses 200_1 and 200_2 corresponding to two viewers are illustrated.
  • the smart TV system displaying a personalized 3D image according to the viewer position according to the embodiment of the present invention does not necessarily target only two viewers, and even if one viewer exists, the 3D image optimized according to the position Of course, it is possible to provide a personalized three-dimensional image for three or more viewers, of course.
  • FIG. 2 is a block diagram showing in more detail the configuration of a smart TV system for displaying a personalized three-dimensional image according to the viewer position according to an embodiment of the present invention.
  • the smart TV 100 of the smart TV system displaying a personalized three-dimensional image according to the viewer location includes a viewer location checking unit 110 for checking the location of each viewer; 3D object shape calculation unit 120 for calculating the shape of the three-dimensional object when viewing the screen of the smart TV at the confirmed viewer position, an object synthesis unit 130 for synthesizing the object to be shown to each viewer, each viewer And a display synchronizer 140 for synchronizing with the 3D glasses to be worn and a display unit 150 for displaying the synthesized object to the viewer.
  • the three-dimensional glasses 200 of the smart TV system for displaying a personalized three-dimensional image according to the viewer position according to an embodiment of the present invention and the sensor 210 for checking the position of the viewer and It includes a screen synchronization unit 220 for screen synchronization with the image displayed on the smart TV (100).
  • a shutter glass method may be used to implement a 3D image.
  • a left eye image and a right eye image are switched at a high speed on a TV, and the left and right eye glasses of the shutter glass are opened and closed quickly so that the viewer can feel a stereoscopic effect through binocular disparity.
  • the principle that a person feels a three-dimensional feeling is because the left and right eyes are separated and the objects are viewed from different angles.
  • the 3D glasses 200 need screen synchronization with the smart TV 100 in order to determine a view point covering one of the left and right eyes, and according to an embodiment of the present invention, the 3D glasses 200 may display a personalized 3D image according to the viewer position.
  • a multi-synchronization of images of the 3D glasses 200 and the smart TV 100 for each viewer provides a personalized screen to two or more viewers simultaneously watching.
  • the smart TV 100 includes a viewer position checking unit 110.
  • the viewer location determiner 110 may be implemented using various sensors.
  • the light emitting sensor is used as the sensor 210 of the 3D glasses 200, and the light emitting sensor is mounted on the smart TV 100 as the viewer positioning unit 110.
  • the light emitted from the light emitting sensor 210 of the 200 may be recognized by the light emitting sensor 110 of the smart TV 100 to check glasses and a user position.
  • the viewer positioning unit 110 is included on the smart TV 110, and the sensor 210 for confirming the viewer location is included in the 3D glasses 200, but the present disclosure is not limited thereto. It is not.
  • the sensor included in the 3D glasses 200 may be omitted.
  • the smart TV 100 may be equipped with a camera to recognize the user's face by using the camera to determine the viewer's location. That is, the position of the face is confirmed by processing image data captured by the camera through a face recognition algorithm.
  • a face recognition algorithm There is no particular limitation on the face recognition algorithm, and various algorithms can be used.
  • the 3D object shape calculation unit 120 shows the right side of the cola can when the viewer watches from the right side of the TV screen, and shows the left side of the cola can when viewing the left side, that is, the viewer's time.
  • This module calculates what to show when viewing a 3D object in. Therefore, the 3D object shape calculation unit 120 calculates the shape of the 3D object that is to be viewed according to the time when viewed from the viewer's current position based on the viewer position confirmed by the viewer position checking unit 110. do.
  • the object synthesizer 130 synthesizes the 3D object calculated by the 3D object shape calculator 120 with the background screen. That is, an advertisement object (for example, cola can) is synthesized on a screen photographed in 2D or 3D (for example, a general street screen), and then synthesized into an image for showing to the viewer. Accordingly, the object synthesizing unit 130 performs a function of synthesizing the three-dimensional object calculated by the three-dimensional object type calculating unit 120 with the received or stored background image.
  • an advertisement object for example, cola can
  • FIG. 3 is a flowchart illustrating an image display method of a smart TV system displaying a personalized 3D image according to a viewer position according to an exemplary embodiment of the present invention.
  • the smart TV 100 first checks the location of each user watching the TV 100 (S310).
  • a 3D object shape is calculated according to the location of the viewer (S320).
  • the 3D object may be calculated using a left and right stereo image.
  • the calculated objects are synthesized for each viewer (S330), and a screen for each viewer is displayed (S340).
  • each viewer can watch the 3D image calculated to fit their position in synchronization with the smart TV 100, respectively.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The present invention provides each viewer with a personalized three-dimensional image by confirming locations of a plurality of viewers watching one TV and calculating shapes of three-dimensional objects when the viewers watch a screen of the TV at the confirmed locations of the viewers. A three-dimensional image display device according to the present invention comprises: a viewer location confirmation unit for confirming the locations of the viewers of the image display device; a three-dimensional object shape calculation unit for calculating the shapes of the three-dimensional objects when the viewers watch the screen of the image display device at the confirmed locations of the viewers; an object synthesis unit for synthesizing the objects to be shown to the viewers; and a display unit for displaying the synthesized objects.

Description

시청자 위치에 따른 개인화 3차원 영상을 표시하는 영상 표시 장치 및 그 표시 방법An image display device for displaying a personalized 3D image according to a viewer's position and a display method thereof
본 발명은 영상 표시 장치 및 그 표시 방법에 관한 것으로서, 더 구체적으로는 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 및 그 표시 방법에 관한 것이다.The present invention relates to a video display device and a display method thereof, and more particularly, to a smart TV and a display method for displaying a personalized three-dimensional image according to the viewer position.
최근 통신 및 정보기술의 발달로 대표적인 가전제품인 TV 또한 스마트 TV로 발전하고 있다. 화면과 스피커를 통해 정보를 전달했던 과거의 TV와는 달리 스마트 TV에는 다양한 형태의 센서들이 내장되어 이에 따라 다양한 형태의 새로운 인터페이스가 가능해진다. Recently, with the development of communication and information technology, TV, a representative home appliance, is also developing into a smart TV. Unlike the TVs of the past, which transmitted information through the screen and the speaker, smart TVs have various types of sensors, thereby enabling various types of new interfaces.
따라서, TV의 기본 기능인 정보 전달 외에도 다양한 기능이 부가되고 있으며, 양방향성을 이용한 다양한 서비스가 개발되고 있다.Accordingly, various functions are added in addition to information transmission, which is a basic function of a TV, and various services using interactive properties have been developed.
또한, 멀티미디어 기술의 발달로 3차원 컨텐츠가 개발 보급되어, 가정에서도 3차원 영상을 시청할 수 있는 3차원 TV가 보급되고 있다.In addition, with the development of multimedia technology, three-dimensional content has been developed and spread, and a three-dimensional TV capable of watching three-dimensional images at home has been spread.
기본적인 3차원 영상의 구현 원리는 양안에 다른 영상을 보여주고 그에 따른 시각 차이를 뇌에서 합성하는 과정이다. 따라서 일정한 시점을 기준으로 하여 영상을 생성하고 합성하게 되며, 실제의 장면을 볼 때 시청자의 위치나 시청 각도에 따라 다르게 보이는 효과를 제공하지 못하는 등 실감 영상 구현에 한계가 존재한다.The basic principle of 3D imaging is the process of showing different images in both eyes and synthesizing the resulting visual differences in the brain. Therefore, the image is generated and synthesized based on a certain viewpoint, and there is a limit to the realization of the realistic image, such as not providing an effect that looks different depending on the viewer's position or viewing angle when viewing the actual scene.
이러한 한계를 극복하고 3차원 영상의 실제감을 향상시키기 위한 다양한 시도가 이루어지고 있다. Various attempts have been made to overcome these limitations and to improve the realism of 3D images.
예를 들어, 특허출원 제10-2011-0026315호는 다층 배리어(multi-layer barrier) 방식을 기반으로 3D 영상을 표시하는 장치 및 방법에 관한 것으로, 3D 영상을 시청하는 시청자와 표시 화면 간의 시청 거리 및 좌우 위치와, 시청자의 얼굴 기울어짐을 측정하고, 상기 시청 거리 및 좌우 위치와, 시청자의 얼굴 기울어짐에 따라 다층 패럴랙스 배리어(multi=layer Parallax barrier)에서 소정 패럴랙스 배리어를 선택하고, 상기 선택한 소정 패럴랙스 배리어만을 온(ON)시키고 나머지 패럴랙스 배리어를 오프(OFF)시키며, 상기 다층 패럴랙스 배리어의 온/오프에 따라 투과/차단되는 빛을 통해 3D 영상을 표시하는 방법을 개시하고 있다. For example, Patent Application No. 10-2011-0026315 relates to an apparatus and method for displaying a 3D image based on a multi-layer barrier method, and a viewing distance between a viewer watching a 3D image and a display screen. And measuring left and right positions, the tilt of the viewer's face, selecting a predetermined parallax barrier in the multi = layer Parallax barrier according to the viewing distance, left and right positions, and tilting of the viewer, and selecting the selected parallax barrier. A method of turning on only a predetermined parallax barrier and turning off the remaining parallax barrier, and displaying a 3D image through light transmitted / blocked according to on / off of the multilayer parallax barrier.
본 발명은 상술한 바와 같은 기술적 배경에서 안출된 것으로서, 두 명 이상의 시청자가 스마트 TV의 3차원 영상을 시청할 때 각 시청자의 위치에 맞도록 개인화된 3차원 영상을 제공할 수 있는 스마트 TV 및 그 표시 방법을 제공하는 것을 그 과제로 한다.The present invention has been made in the technical background as described above, when two or more viewers watch a three-dimensional image of the smart TV smart TV capable of providing a personalized three-dimensional image to fit each viewer's position and its display The task is to provide a method.
이와 같은 과제를 해결하기 위하여 본 발명에서는 하나의 TV를 시청하는 다수의 시청자에 대하여 위치를 확인하고 확인된 시청자 위치에서 TV 화면을 볼 때의 3차원 객체의 형태를 계산하여 개인화된 3차원 영상을 각 시청자에게 제공한다.In order to solve the above problems, the present invention checks the position of a plurality of viewers watching one TV, calculates the shape of the three-dimensional object when viewing the TV screen from the identified viewer position, and obtains a personalized three-dimensional image. Provide to each viewer.
즉, 본 발명의 일면에 따른 3차원 영상 표시 장치는, 상기 영상 표시 장치의 시청자 위치를 확인하는 시청자 위치 확인부; 확인된 시청자 위치에서 상기 영상 표시 장치의 화면을 볼 때의 3차원 객체의 형태를 계산하는 3차원 객체 형태 계산부; 상기 시청자에게 보여질 객체를 합성하는 객체 합성부; 및 합성된 객체를 상기 시청자에게 표시하는 표시부를 포함하여 이루어진다.That is, the three-dimensional image display device according to an aspect of the present invention, the viewer position confirmation unit for confirming the viewer position of the image display device; A three-dimensional object shape calculation unit configured to calculate a shape of a three-dimensional object when viewing the screen of the video display device at a confirmed viewer position; An object synthesizing unit for synthesizing an object to be viewed by the viewer; And a display unit for displaying the synthesized object to the viewer.
상기 영상 표시 장치는 셔터글라스 방식으로 3차원 영상을 표시할 수 있으며, 이때 상기 영상 표시 장치와 연동하는 3차원 안경과 화면을 동기화하는 화면 동기화부를 더 포함할 수 있다.The image display device may display a 3D image by a shutter glass method, and may further include a screen synchronizer configured to synchronize a screen with 3D glasses linked to the image display device.
상기 3차원 안경은 시청자 위치 확인을 위한 센서를 포함할 수도 있다.The three-dimensional glasses may include a sensor for identifying the viewer position.
본 발명의 다른 면에 따른 3차원 영상 표시 방법은, 3차원 영상 표시 장치에서 시청자 위치에 따른 개인화 3차원 영상을 표시하는 방법으로서, 상기 영상 표시 장치의 시청자 위치를 확인하는 단계; 확인된 시청자 위치에서 상기 영상 표시 장치의 화면을 볼 때의 3차원 객체의 형태를 계산하는 단계; 상기 시청자에게 보여질 객체를 합성하는 단계; 및 합성된 객체를 상기 시청자에게 표시하는 단계를 포함한다. According to another aspect of the present invention, there is provided a method of displaying a personalized 3D image according to a viewer's position in a 3D image display apparatus, the method comprising: identifying a viewer position of the image display apparatus; Calculating a shape of a three-dimensional object when viewing the screen of the image display device at a confirmed viewer position; Synthesizing an object to be shown to the viewer; And displaying the synthesized object to the viewer.
본 발명에 따르면, 차세대 3D 방송이나 게임에서 같은 TV를 시청하는 시청자들에게 각각의 위치에 맞는 서로 다른 화면 구성을 제공하므로 자유로운 3D 영상 시청 환경을 제공할 수 있다.According to the present invention, since a different screen configuration for each location is provided to viewers watching the same TV in the next generation 3D broadcast or game, it is possible to provide a free 3D video viewing environment.
도 1은 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템의 전체 구성을 간략히 도시한 도면이다.FIG. 1 is a diagram schematically illustrating an overall configuration of a smart TV system displaying a personalized 3D image according to a viewer's position according to an exemplary embodiment of the present invention.
도 2는 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템의 구성을 좀 더 자세히 나타낸 블록도이다.2 is a block diagram showing in more detail the configuration of a smart TV system for displaying a personalized three-dimensional image according to the viewer position according to an embodiment of the present invention.
도 3은 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템의 영상 표시 방법을 나타내는 흐름도이다.3 is a flowchart illustrating an image display method of a smart TV system displaying a personalized 3D image according to a viewer position according to an exemplary embodiment of the present invention.
본 발명의 이점 및 특징, 그리고 그것들을 달성하는 방법은 첨부되는 도면과 함께 상세하게 후술되어 있는 실시예들을 참조하면 명확해질 것이다. 그러나 본 발명은 이하에서 개시되는 실시예들에 한정되는 것이 아니라 서로 다른 다양한 형태로 구현될 것이며, 단지 본 실시예들은 본 발명의 개시가 완전하도록 하며, 본 발명이 속하는 기술분야에서 통상의 지식을 가진 자에게 발명의 범주를 완전하게 알려주기 위해 제공되는 것이며, 본 발명은 청구항의 범주에 의해 정의될 뿐이다. 한편, 본 명세서에서 사용된 용어는 실시예들을 설명하기 위한 것이며 본 발명을 제한하고자 하는 것은 아니다. 본 명세서에서, 단수형은 문구에서 특별히 언급하지 않는 한 복수형도 포함한다. 명세서에서 사용되는 "포함한다(comprises)" 및/또는 "포함하는(comprising)"은 언급된 구성요소, 단계, 동작 및/또는 소자는 하나 이상의 다른 구성요소, 단계, 동작 및/또는 소자의 존재 또는 추가를 배제하지 않는다. Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various forms, and only the present embodiments are intended to complete the disclosure of the present invention, and the general knowledge in the art to which the present invention pertains. It is provided to fully convey the scope of the invention to those skilled in the art, and the present invention is defined only by the scope of the claims. Meanwhile, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and / or “comprising” refers to the presence of one or more other components, steps, operations and / or elements. Or does not exclude additions.
이하에서, 첨부한 도면을 참고로 하여 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 및 그 표시 방법에 대하여 상세히 설명하기로 한다.Hereinafter, a smart TV displaying a personalized 3D image according to a viewer's position and a display method thereof according to embodiments of the present invention will be described in detail with reference to the accompanying drawings.
도 1은 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템의 전체 구성을 간략히 도시한 도면이다.FIG. 1 is a diagram schematically illustrating an overall configuration of a smart TV system displaying a personalized 3D image according to a viewer's position according to an exemplary embodiment of the present invention.
도 1에 나타난 바와 같이, 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템은 3차원 영상을 표시할 수 있는 TV(100)와 TV(100)에서 표시하는 3차원 영상을 시청하기 위하여 사용자가 착용하는 3차원 안경(200_1, 200_2)으로 구성된다.As shown in FIG. 1, a smart TV system displaying a personalized 3D image according to a viewer's position according to an exemplary embodiment of the present invention may display a 3D image on a TV 100 and a TV 100. 3D glasses 200_1 and 200_2 worn by a user for viewing a 3D image.
본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템은 두 명 이상의 시청자가 한 대의 TV(100)를 시청하는 상황에서 각 시청자에게 개인화된 3차원 영상을 표시하는 것이므로 도 1에서는 두 명의 시청자에 대응하는 두 개의 3차원 안경(200_1, 200_2)을 도시하고 있다. 그러나, 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템은 반드시 두 명의 시청자만을 대상으로 하는 것은 아니며, 한 명의 시청자가 존재하더라도 그 위치에 따라 최적화된 3차원 영상을 제공할 수 있고, 세 명 이상의 시청자에 대해서도 각각 개인화된 3차원 영상을 제공할 수 있음은 물론이다.Since the smart TV system for displaying a personalized three-dimensional image according to the viewer position according to an embodiment of the present invention is to display a personalized three-dimensional image to each viewer in a situation where two or more viewers watch a single TV (100) In FIG. 1, two three-dimensional glasses 200_1 and 200_2 corresponding to two viewers are illustrated. However, the smart TV system displaying a personalized 3D image according to the viewer position according to the embodiment of the present invention does not necessarily target only two viewers, and even if one viewer exists, the 3D image optimized according to the position Of course, it is possible to provide a personalized three-dimensional image for three or more viewers, of course.
도 2는 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템의 구성을 좀 더 자세히 나타낸 블록도이다.2 is a block diagram showing in more detail the configuration of a smart TV system for displaying a personalized three-dimensional image according to the viewer position according to an embodiment of the present invention.
두 명 이상의 시청자가 각자 3차원 안경을 착용하게 되더라도 각 3차원 안경의 구성은 동일하므로 도 2에서는 하나의 3차원 안경만을 도시하고 있다.Even if two or more viewers wear three-dimensional glasses, the configuration of each three-dimensional glasses is the same, so only one three-dimensional glasses are shown in FIG.
도 2에 나타난 바와 같이, 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템의 스마트 TV(100)는 각 시청자의 위치를 확인하는 시청자 위치 확인부(110), 확인된 시청자 위치에서 스마트 TV의 화면을 볼 때의 3차원 객체의 형태를 계산하는 3차원 객체 형태 계산부(120), 각 시청자에게 보여질 객체를 합성하는 객체 합성부(130), 각 시청자가 착용하는 3차원 안경과의 동기화를 위한 화면 동기화부(140) 및 합성된 객체를 시청자에게 표시하는 표시부(150)를 포함한다.As shown in FIG. 2, the smart TV 100 of the smart TV system displaying a personalized three-dimensional image according to the viewer location according to the embodiment of the present invention includes a viewer location checking unit 110 for checking the location of each viewer; 3D object shape calculation unit 120 for calculating the shape of the three-dimensional object when viewing the screen of the smart TV at the confirmed viewer position, an object synthesis unit 130 for synthesizing the object to be shown to each viewer, each viewer And a display synchronizer 140 for synchronizing with the 3D glasses to be worn and a display unit 150 for displaying the synthesized object to the viewer.
또한, 도 2에 나타난 바와 같이, 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템의 3차원 안경(200)은 시청자의 위치를 확인하기 위한 센서(210)와 스마트 TV(100)에서 표시하는 영상과의 화면 동기화를 위한 화면 동기화부(220)를 포함한다. In addition, as shown in Figure 2, the three-dimensional glasses 200 of the smart TV system for displaying a personalized three-dimensional image according to the viewer position according to an embodiment of the present invention and the sensor 210 for checking the position of the viewer and It includes a screen synchronization unit 220 for screen synchronization with the image displayed on the smart TV (100).
본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템에서는 3차원 영상을 구현하기 위하여 셔터글래스 방식을 사용할 수 있다.In a smart TV system displaying a personalized 3D image according to a viewer's position according to an exemplary embodiment of the present invention, a shutter glass method may be used to implement a 3D image.
셔터글래스 방식은 좌안 영상과 우안 영상을 TV에서 고속으로 스위칭하고 이와 동기를 맞추어 셔터글래스의 좌안/우안 글래스가 빠르게 개폐됨으로써 시청자가 양안 시차를 통해 입체감을 느끼도록 하는 방식이다. 사람이 입체감을 느끼는 원리가 좌, 우 눈이 떨어져서 서로 다른 각도에서 사물을 보기 때문인데, 이를 인위적으로 셔터를 이용해 만들어 주는 원리이다.In the shutter glass method, a left eye image and a right eye image are switched at a high speed on a TV, and the left and right eye glasses of the shutter glass are opened and closed quickly so that the viewer can feel a stereoscopic effect through binocular disparity. The principle that a person feels a three-dimensional feeling is because the left and right eyes are separated and the objects are viewed from different angles.
따라서, 3차원 안경(200)은 좌, 우 눈 중 한쪽을 가리는 시점을 결정하기 위하여 스마트 TV(100)와의 화면 동기화가 필요하며, 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템에서는 각 시청자별로 3차원 안경(200)과 스마트 TV(100)의 영상을 다중 동기화함으로써 동시에 시청하는 두 명 이상의 시청자에게 개인화된 화면을 제공한다.Accordingly, the 3D glasses 200 need screen synchronization with the smart TV 100 in order to determine a view point covering one of the left and right eyes, and according to an embodiment of the present invention, the 3D glasses 200 may display a personalized 3D image according to the viewer position. In the displaying smart TV system, a multi-synchronization of images of the 3D glasses 200 and the smart TV 100 for each viewer provides a personalized screen to two or more viewers simultaneously watching.
각 시청자에게 맞는 화면을 생성하여 표시하기 위해서는 시청자의 위치를 측정하여야 하므로, 이를 위하여 스마트 TV(100)는 시청자 위치 확인부(110)를 포함한다. 시청자 위치 확인부(110)는 다양한 센서 등을 이용하여 구현될 수 있다.In order to generate and display a screen suitable for each viewer, the position of the viewer must be measured. For this purpose, the smart TV 100 includes a viewer position checking unit 110. The viewer location determiner 110 may be implemented using various sensors.
하나의 실시예로는, 3차원 안경(200)의 센서(210)로 발광 센서를 사용하고, 스마트 TV(100)에 시청자 위치 확인부(110)로 발광 인식 센서를 장착하여, 3차원 안경(200)의 발광 센서(210)에서 나오는 빛을 스마트 TV(100)의 발광 인식 센서(110)가 인식하여 안경 및 사용자 위치를 확인할 수 있다. In one embodiment, the light emitting sensor is used as the sensor 210 of the 3D glasses 200, and the light emitting sensor is mounted on the smart TV 100 as the viewer positioning unit 110. The light emitted from the light emitting sensor 210 of the 200 may be recognized by the light emitting sensor 110 of the smart TV 100 to check glasses and a user position.
한편, 도 2에서는 스마트 TV(110) 상에 시청자 위치 확인부(110)가 포함되고, 3차원 안경(200)에 시청자 위치를 확인하기 위한 센서(210)가 포함된 것으로 도시하였지만 반드시 이에 한정되는 것은 아니다.Meanwhile, in FIG. 2, the viewer positioning unit 110 is included on the smart TV 110, and the sensor 210 for confirming the viewer location is included in the 3D glasses 200, but the present disclosure is not limited thereto. It is not.
예를 들어, 스마트 TV(100) 상에 센서를 부착하여 시청자의 위치를 확인할 수 있다면, 3차원 안경(200)에 포함된 센서를 생략할 수 있다.For example, if the position of the viewer can be confirmed by attaching a sensor on the smart TV 100, the sensor included in the 3D glasses 200 may be omitted.
하나의 실시예로서 스마트 TV(100)에 카메라를 장착하여 이를 이용하여 사용자의 얼굴을 인식함으로써 시청자의 위치를 확인할 수 있다. 즉, 카메라에 캡쳐된 이미지 데이터를 얼굴인식 알고리즘을 통해 처리하여 얼굴의 위치를 확인한다. 얼굴인식 알고리즘에는 특별한 제한이 없으며 다양한 알고리즘을 사용할 수 있다. As an embodiment, the smart TV 100 may be equipped with a camera to recognize the user's face by using the camera to determine the viewer's location. That is, the position of the face is confirmed by processing image data captured by the camera through a face recognition algorithm. There is no particular limitation on the face recognition algorithm, and various algorithms can be used.
3차원 객체 형태 계산부(120)는 예를 들어, 콜라광고의 경우 TV 화면의 오른쪽에서 시청자가 시청을 하면 콜라캔의 오른쪽을 보여주고, 왼쪽에서 시청하면 콜라캔의 왼쪽을 보여주는, 즉 시청자 시각에서 3차원 객체를 봤을 때 어떤 부분을 보여주어야 하는지를 계산하는 모듈이다. 따라서, 3차원 객체 형태 계산부(120)는 시청자 위치 확인부(110)에 의해 확인된 시청자 위치를 기반으로, 시청자의 현재 위치에서 보았을 경우 그 시각에 맞는 3차원 객체의 보여져야 하는 모양을 계산한다.For example, the 3D object shape calculation unit 120 shows the right side of the cola can when the viewer watches from the right side of the TV screen, and shows the left side of the cola can when viewing the left side, that is, the viewer's time. This module calculates what to show when viewing a 3D object in. Therefore, the 3D object shape calculation unit 120 calculates the shape of the 3D object that is to be viewed according to the time when viewed from the viewer's current position based on the viewer position confirmed by the viewer position checking unit 110. do.
객체 합성부(130)는 3차원 객체 형태 계산부(120)에 의해 계산된 3차원 객체를 배경화면과 합성한다. 즉, 2차원이나 3차원으로 촬영된 화면(예: 일반 거리 화면)에 광고 객체 (예를 들면 콜라캔)를 합성하여 시청자에게 보여주기 위한 영상으로 합성하게 된다. 따라서, 객체 합성부(130)는 3차원 객체 형태 계산부(120)에 의해 계산된 3차원 객체를, 수신하거나 저장된 배경화면과 합성하는 기능을 수행한다.The object synthesizer 130 synthesizes the 3D object calculated by the 3D object shape calculator 120 with the background screen. That is, an advertisement object (for example, cola can) is synthesized on a screen photographed in 2D or 3D (for example, a general street screen), and then synthesized into an image for showing to the viewer. Accordingly, the object synthesizing unit 130 performs a function of synthesizing the three-dimensional object calculated by the three-dimensional object type calculating unit 120 with the received or stored background image.
도 3은 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템의 영상 표시 방법을 나타내는 흐름도이다.3 is a flowchart illustrating an image display method of a smart TV system displaying a personalized 3D image according to a viewer position according to an exemplary embodiment of the present invention.
도 3에 나타난 바와 같이, 스마트 TV(100)에서는 먼저 TV(100)를 시청하는 각 사용자의 위치를 확인한다(S310).As shown in FIG. 3, the smart TV 100 first checks the location of each user watching the TV 100 (S310).
각 사용자의 위치가 확인되면, 시청자의 위치에 따른 3차원 객체 형태를 계산한다(S320). 3차원 객체 형태의 계산은 좌우 스테레오 영상을 이용하는 방식 등을 사용할 수 있다. When the location of each user is confirmed, a 3D object shape is calculated according to the location of the viewer (S320). The 3D object may be calculated using a left and right stereo image.
3차원 객체 형태가 계산되면, 계산된 객체를 시청자별로 합성하고(S330), 시청자별 화면을 표시한다(S340). When the 3D object shape is calculated, the calculated objects are synthesized for each viewer (S330), and a screen for each viewer is displayed (S340).
이에 따라 각 시청자는 자신의 위치에 맞도록 계산된 3차원 영상을 각각 스마트 TV(100)와 동기화하여 시청할 수 있게 된다.Accordingly, each viewer can watch the 3D image calculated to fit their position in synchronization with the smart TV 100, respectively.
이러한 본 발명의 실시예에 따른 시청자 위치에 따른 개인화 3차원 영상을 표시하는 스마트 TV 시스템의 영상 표시 방법을 이용하면 차세대 3D 방송이나 게임에서 같은 TV를 시청하는 시청자들에게 각각의 위치에 맞는 서로 다른 화면 구성을 제공하므로 자유로운 3D 영상 시청 환경을 제공할 수 있다.Using the image display method of the smart TV system for displaying a personalized three-dimensional image according to the viewer position according to the embodiment of the present invention different screens for each position for viewers watching the same TV in the next generation 3D broadcast or game By providing a configuration, it is possible to provide a free 3D video viewing environment.
이상에서 바람직한 실시예를 기준으로 본 발명을 설명하였지만, 본 발명의 장치 및 방법은 반드시 상술된 실시예에 제한되는 것은 아니며 발명의 요지와 범위로부터 벗어남이 없이 다양한 수정이나 변형을 하는 것이 가능하다. 따라서, 첨부된 특허청구의 범위는 본 발명의 요지에 속하는 한 이러한 수정이나 변형을 포함할 것이다. Although the present invention has been described above with reference to preferred embodiments, the apparatus and method of the present invention are not necessarily limited to the above-described embodiments, and various modifications and variations can be made without departing from the spirit and scope of the invention. Accordingly, the appended claims will include such modifications and variations as long as they fall within the spirit of the invention.

Claims (5)

  1. 3차원 영상을 표시할 수 있는 영상 표시 장치로서,An image display device capable of displaying a three-dimensional image,
    상기 영상 표시 장치의 시청자 위치를 확인하는 시청자 위치 확인부;A viewer location checking unit for checking a viewer location of the video display device;
    확인된 시청자 위치에서 상기 영상 표시 장치의 화면을 볼 때의 3차원 객체의 형태를 계산하는 3차원 객체 형태 계산부;A three-dimensional object shape calculation unit configured to calculate a shape of a three-dimensional object when viewing the screen of the video display device at a confirmed viewer position;
    상기 시청자에게 보여질 객체를 합성하는 객체 합성부; 및An object synthesizing unit for synthesizing an object to be viewed by the viewer; And
    합성된 객체를 상기 시청자에게 표시하는 표시부를 포함하는 영상 표시 장치.And a display unit for displaying the synthesized object to the viewer.
  2. 제1항에 있어서, 상기 영상 표시 장치는,The video display device of claim 1, wherein the video display device comprises:
    셔터글라스 방식으로 3차원 영상을 표시하는 영상 표시 장치.An image display apparatus displaying a three-dimensional image by a shutter glass method.
  3. 제2항에 있어서, The method of claim 2,
    상기 영상 표시 장치와 연동하는 3차원 안경과 화면을 동기화하는 화면 동기화부를 더 포함하는 영상 표시 장치.And a screen synchronizer configured to synchronize a screen with the 3D glasses linked to the image display device.
  4. 제3항에 있어서, 상기 3차원 안경은,The method of claim 3, wherein the three-dimensional glasses,
    시청자 위치 확인을 위한 센서를 포함하는 영상 표시 장치.Image display device including a sensor for viewing the viewer position.
  5. 3차원 영상 표시 장치에서 시청자 위치에 따른 개인화 3차원 영상을 표시하는 방법으로서,A method of displaying a personalized 3D image according to a viewer's position in a 3D image display device,
    상기 영상 표시 장치의 시청자 위치를 확인하는 단계;Checking a viewer position of the video display device;
    확인된 시청자 위치에서 상기 영상 표시 장치의 화면을 볼 때의 3차원 객체의 형태를 계산하는 단계;Calculating a shape of a three-dimensional object when viewing the screen of the image display device at a confirmed viewer position;
    상기 시청자에게 보여질 객체를 합성하는 단계; 및Synthesizing an object to be shown to the viewer; And
    합성된 객체를 상기 시청자에게 표시하는 단계를 포함하는 3차원 영상 표시 방법.And displaying the synthesized object to the viewer.
PCT/KR2013/005937 2012-07-09 2013-07-04 Image display device for displaying personalized three-dimensional image according to location of viewer, and displaying method thereof WO2014010870A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2012-0074331 2012-07-09
KR1020120074331A KR101343552B1 (en) 2012-07-09 2012-07-09 Image display apparatus displaying personalized three-dimensional image based on audience position and displaying method thereof

Publications (1)

Publication Number Publication Date
WO2014010870A1 true WO2014010870A1 (en) 2014-01-16

Family

ID=49916268

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2013/005937 WO2014010870A1 (en) 2012-07-09 2013-07-04 Image display device for displaying personalized three-dimensional image according to location of viewer, and displaying method thereof

Country Status (2)

Country Link
KR (1) KR101343552B1 (en)
WO (1) WO2014010870A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10854171B2 (en) * 2018-12-31 2020-12-01 Samsung Electronics Co., Ltd. Multi-user personal display system and applications thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6220709B1 (en) * 1996-10-09 2001-04-24 Helmut Tan Projection system, in particular for three dimensional representations on a viewing device
US20120026290A1 (en) * 2010-07-30 2012-02-02 Lg Electronics Inc. Mobile terminal and controlling method thereof
KR20120009885A (en) * 2010-07-22 2012-02-02 주식회사 알티캐스트 Method and apparatus for synthesising stereoscopic 3 dimention image
KR20120018467A (en) * 2010-08-23 2012-03-05 엘지전자 주식회사 Method for displaying a streao scope image

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6220709B1 (en) * 1996-10-09 2001-04-24 Helmut Tan Projection system, in particular for three dimensional representations on a viewing device
KR20120009885A (en) * 2010-07-22 2012-02-02 주식회사 알티캐스트 Method and apparatus for synthesising stereoscopic 3 dimention image
US20120026290A1 (en) * 2010-07-30 2012-02-02 Lg Electronics Inc. Mobile terminal and controlling method thereof
KR20120018467A (en) * 2010-08-23 2012-03-05 엘지전자 주식회사 Method for displaying a streao scope image

Also Published As

Publication number Publication date
KR101343552B1 (en) 2013-12-20

Similar Documents

Publication Publication Date Title
US10054796B2 (en) Display
CN102802014B (en) Naked eye stereoscopic display with multi-human track function
KR20120016408A (en) Method for processing image of display system outputting 3 dimensional contents and display system enabling of the method
US20110248989A1 (en) 3d display apparatus, method for setting display mode, and 3d display system
US20190043245A1 (en) Information processing apparatus, information processing system, information processing method, and program
JP5257248B2 (en) Image processing apparatus and method, and image display apparatus
WO2013048221A2 (en) Image processing system based on stereo image
US20120154558A1 (en) Display apparatus and method for processing image thereof
JP2011010126A (en) Image processing apparatus, and image processing method
CN101299843B (en) 3D display mobile phone and 3D image display method
CN102799378B (en) A kind of three-dimensional collision detection object pickup method and device
CN113382224B (en) Interactive handle display method and device based on holographic sand table
KR101288124B1 (en) 3-dimension display device and method of displaying 3-dimension image
TWI486052B (en) Three-dimensional image processing device and three-dimensional image processing method
JP2019083504A (en) Hardware system for inputting stereoscopic image in flat panel
WO2014010870A1 (en) Image display device for displaying personalized three-dimensional image according to location of viewer, and displaying method thereof
CN113382222B (en) Display method based on holographic sand table in user moving process
CN113891063B (en) Holographic display method and device
US20140285484A1 (en) System of providing stereoscopic image to multiple users and method thereof
KR20110136326A (en) System for rendering of stereoscopic
JP6921204B2 (en) Information processing device and image output method
WO2013055012A1 (en) 3-d image shutter glasses
CN113467612B (en) Interaction method and device applied to UE 4-based holographic sand table
JP3088326B2 (en) 3D image display device
CN113382225B (en) Binocular holographic display method and device based on holographic sand table

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13817414

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13817414

Country of ref document: EP

Kind code of ref document: A1