JP2007213197A - Coordinate designation device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable an coordinate instruction on a set arbitrary display device while simplifying an operation to select coordinates in an object surface such as the display surface of a video display device or a screen on which a video is projected. <P>SOLUTION: Light emitting sections are arranged at four or more points at a instructing section such as a remote controller 2, at least three or more of the points being not arranged on a straight line, the images of the light emitting sections are detected by an imaging section 3, the instructing section is recognized from the arrangement of the imaged images of the light emitting sections, the direction and position of the instructing section are detected from a distance and angle between the images of the light emitting sections, and a point 5 crossing an object surface set from the direction and position of the instructing section is calculated. Also, the four corners of a symmetric plane coordinates are indicated more than once by using the instructing section, so that the position of the display device at an arbitrary position can be set. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a method for detecting coordinates designated by an instruction terminal on a coordinate detection target, such as an image displayed on a display device or an image projected on a screen, using an instruction terminal using an illuminant and an imaging device. About.

Conventionally, when receiving a data broadcast with a TV receiver and pressing a button on the screen within the data broadcast application, the cursor selection key on the remote control (remote controller) is pressed as many times as necessary to move the button selection. Even if you press a button on a single screen, such as pressing the OK key on the remote control, you can perform multiple operations using the keys on the remote control.
On the other hand, when specifying coordinates in a screen displayed on a display device including a TV receiver, a PC (personal computer) mainly uses a mouse or a trackball, and a game machine scans a television receiver. Coordinates are detected using a pen-type or pistol-type detector that detects lines with a photosensor. In addition, in an image projected on a screen by a projector, in a method of detecting the coordinates of a point irradiated by a laser pointer with an image sensor or a display device such as a television receiver, Japanese Patent Application Laid-Open Nos. 2004-023220 and 08 There is a method of performing coordinate designation by a remote control transmitter using a plurality of receiving sensors such as -1307779 (see, for example, Patent Documents 1, 2, and 3).
JP 2004-023220 A Japanese Patent Laid-Open No. 08-130779

  However, as described above, the method using the cursor movement key of the remote controller requires many key operations and is complicated. The method of detecting a scanning line by a photosensor cannot be used when there is no scanning line such as a liquid crystal panel, a plasma display panel, a projector using a liquid crystal or a light modulation element, or the like. Detection of irradiation light by a laser pointer does not function unless the irradiation target is appropriate. Also, there is a problem in using a laser pointer that may be harmful to eyes if it is directly viewed. The mouse and the trackball are complicated because they do not directly specify coordinates, and more delicate operations are required, and operations by children and the elderly are not suitable for ordinary households. Further, in a method using a plurality of receiving sensors such as Japanese Patent Application Laid-Open No. 2004-023220 and Japanese Patent Application Laid-Open No. 08-130779, a method in which the direction of the remote control cannot be specified, or the indication coordinates are determined from the irradiation angle and signal intensity with respect to the reception sensor by the remote control. In order to calculate by estimation, for example, when the television receiver 51 is placed on a reflecting object such as the table 57 as shown in FIG. 5, the sensor 53 and the sensor 55 do not receive reflected light, but the sensor 54 and Reflected light 58 from the table 57 enters the sensor 56, which affects the signal intensity and causes false detection.

  In order to solve the conventional problem, the coordinate designating device according to claim 1 is provided with an instruction unit corresponding to a remote controller and an imaging unit for detecting the instruction unit, and the instruction unit can detect the direction of the instruction unit by the imaging unit. In this way, at least four light emitting sections not arranged on a straight line are arranged, and at least four light emitting sections provided in the instruction section are detected by the imaging section, and a pattern is determined from the distance and angle between the images of the light emitting sections. The direction and position of the pointing unit is detected by the recognition process, and the point that intersects the display device, the screen, the screen of the television receiver, etc., which is the target surface on the extension line of the pointing unit from the direction and position of the pointing unit, that is, the target surface The coordinates of are calculated.

  The coordinate designating device according to claim 2 uses an infrared ray that is not visible light as an output signal of the light emitting unit so as to prevent reflection on the screen of the display device or the television receiver, or to have no influence during screen projection. By attaching an infrared filter to the part and detecting only infrared rays, false detection is reduced.

  The coordinate designating device according to claim 3 modulates the signal of the light emitting unit in a pulse, and the image of the light emitting unit appears in the imaging unit in accordance with the modulation pattern, and thus the image of the light emitting unit appears. By detecting, false detection is reduced.

  The coordinate designating device according to claim 4 is provided with a coordinate designating button in the instruction unit, and outputs from the light emitting unit only when the coordinate designating button is pressed, thereby limiting the use of power necessary for output only when necessary. Usability is improved by reducing the power consumption and specifying the coordinates only when the coordinates need to be specified.

  The coordinate designating device according to claim 5 prevents erroneous detection when the coordinate designating button is not pressed by detecting that a signal is output from the light emitting unit outside the imaging region.

  The coordinate designating apparatus according to claim 6 can perform coordinate designation of an arbitrary target surface by arbitrarily changing or setting the coordinates of the target surface. For example, when projecting by a projector, FIG. As described above, the CCD camera 43 and the screen 42 as the image pickup unit can be arranged at arbitrary positions.

The coordinate designating device according to claim 7 is capable of designating the coordinates of an arbitrary target surface by setting the coordinates of the target surface using an instruction unit.
The coordinate designating device according to claim 8 is capable of designating the coordinates of an arbitrary target surface by setting the coordinates of the target surface using the instruction unit by six coordinate designations.

  As described above, according to the coordinate designation device of the present invention, coordinate designation can be performed on a screen image projected by a display device, a television receiver, or a projector, and selection or pressing of a button on the screen is possible. Such operations can be easily performed.

  Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment 1)
FIG. 1 is a usage example when the present invention is combined with a remote control system of a television receiver, FIG. 2 is an enlarged view of the remote controller 2, and FIG. 3 is a block diagram of the television receiver. The television receiver 1 includes a CCD camera 3 that is an imaging unit and an infrared receiver 4 that receives an infrared signal.

  When the user presses the operation button from the remote controller 2 as an instruction unit, infrared light modulated by the operation code is emitted by the LED 22, LED 23, LED 24, LED 25, LED 26, and LED 27. When the LED 26 and the LED 27 are very close to the target surface, the LED 22 and the LED 23, the LED 24 and the LED 25 approach in the image captured by the CCD camera 3, and it becomes difficult to distinguish and cannot be recognized. Arranged. Infrared light emitted from each LED is received by the infrared receiver 4. Hereinafter, as shown in the block diagram of FIG. 3, the signal that has passed through the infrared filter 38 is received by the infrared receiver 32, and the operation code is recognized by the operation code recognition processor 34. The television receiver is controlled by the television receiver control unit 35 based on the identified operation code. For example, in the case of channel selection, a process of selecting a specified channel number is performed. Next, when a coordinate is designated, when the coordinate designation button 28 is pressed, infrared rays modulated by a coordinate selection operation code indicating a coordinate selection instruction are emitted as an operation code. In this case, because of the coordinate detection process described later, the delay from the post-transmission operation code recognition process to the end of photographing is also taken into consideration so that each LED can be photographed by the CCD camera 3, and infrared light is continuously output without being modulated. As in the channel selection described above, the operation code passes through the infrared filter 38 and is received by the infrared receiving unit 32, and the operation code recognition processing unit 34 recognizes the coordinate selection code. When the coordinate selection code is recognized, the image captured by the CCD camera 3 is sent to the remote control recognition processing unit 36. In the remote control recognition processing unit 36, the three-dimensional LED arrangement in FIG. 2 is preset, and the arrangement of the point light source that is similar to the arrangement obtained by projecting the preset LED arrangement on the plane in the captured image is detected. To do. If detected, the remote control position angle θ11 and the remote control position angle φ12 and the distance 15 to the remote control can be detected by the detected position and size, and the remote control orientation angle ω13 and the remote control orientation angle ρ14 can be detected by the detected LED orientation. . Next, the detected distance and angle are sent to the target in-plane coordinate calculation unit 37. The in-plane coordinate calculation unit 37 calculates a remote control coordinate X8, a remote control coordinate Y9, and a remote control coordinate Z10 from the distance 15 to the remote control, the remote control position angle θ, and the remote control position angle φ using a trigonometric function. A relative coordinate X16 from the remote control position to the designated coordinate 5 and a relative coordinate Y17 from the designated coordinate 5 are calculated by a trigonometric function from the remote control coordinate Z10, the remote control orientation angle ω, and the remote control orientation angle ρ. The designated coordinate X6 and the designated coordinate Y7 are calculated by adding the remote control coordinate X8 and the remote control coordinate Y9 to the relative coordinate X16 and the relative coordinate Y17. The calculated designated coordinate 5 is used by the television receiver control unit 35 for processing such as selecting a button if the button is selected on the screen at the coordinate position, for example. .

(Embodiment 2)
FIG. 4 shows an embodiment when the PC 43 is connected to the projector 41 and designates the coordinates of the image projected on the screen 42. In this case, first, it is necessary to specify the position and size of the screen 42 as the target surface. For this purpose, first, a designated point 46 is displayed so as to indicate that the upper left on the screen is designated. According to the display, the designated point 46 is designated at an arbitrary position, for example, the position of the remote controller 44, and the coordinate designation button 28 is pressed. This is photographed by the CCD camera 43, and the position and orientation of the remote controller are detected and stored by the software in the PC 43 as in the first embodiment. Next, the designated point 46 is similarly designated at a position different from the remote controller 44, for example, the position of the remote controller 45, and the coordinate designation button is pressed. This is photographed by the CCD camera 43 as with the remote controller 44, and the position and orientation of the remote controller 45 are detected and stored by software in the PC 43. From the intersection of the stored position and orientation of the remote controller 44 and the remote controller 45 on the extension line, the upper left point of the target surface can be determined. Subsequently, the designated point 47 is also displayed at the lower right, and is designated twice in the same manner as at the upper left, thereby calculating the intersection point on the extension line from the position and orientation of the remote controller and determining the lower right of the target surface. Since the Z position of the target surface is fixed, the coordinates of all four corners of the target surface are fixed by designating the upper right and lower left points once.
When all four corners of the target surface are determined, the PC application can be operated such as selecting a button on the screen by designating coordinates from the remote controller as in the first embodiment.

  In the second embodiment, a PC and a projector are taken as an example. However, for example, a video playback device such as a DVD player can be provided with the function of the coordinate designating device of the present invention.

  The coordinate designating device according to the present invention relates to a coordinate designating method in a screen in a device that performs an operation based on a video displayed on a screen, such as a television receiver, a video reproduction device, or a personal computer.

Schematic explaining the in-plane coordinate calculation from the remote controller position and orientation in Embodiment 1 of the present invention Schematic diagram of remote control for explaining remote control operation in the first and second embodiments of the present invention Block diagram for describing a configuration of a television receiver according to Embodiment 1 of the present invention. Schematic for demonstrating designation | designated of the screen coordinate used as the target surface in Embodiment 2 of this invention. Conceptual diagram for explaining problems with conventional technology

Explanation of symbols

1 Television receiver 2 Remote control 3 CCD camera 4 Infrared receiver 5 Specified coordinates 6 Specified coordinates X
7 designated coordinates Y
8 Remote control position X
9 Remote control position Y
10 Remote control position Z
11 Remote control position angle θ
12 Remote control position angle φ
13 Remote control angle ω
14 Remote control angle ρ
15 Distance to remote control 16 Relative coordinate X to designated coordinate 5
17 Relative coordinates Y up to the designated coordinate 5
21 Remote control 22, 23, 24, 25, 26, 27 LED
28 Coordinate designation button 31 Television receiver 32 Infrared receiving unit 33 CCD camera 34 Operation code recognition processing unit 35 Television receiver control unit 36 Remote control recognition processing unit 37 In-plane coordinate calculation unit 41 Projector 42 Screen 43 Personal computer (PC) )
44 Remote control at an arbitrary position 45 Remote control other than 44 46 Upper left instruction display 47 Lower right instruction display 51 Television receiver 52 Remote control 53 Sensor 54 Sensor 55 Sensor 56 Sensor 57 Table 58 Reflection from the table

Claims (8)

An apparatus for designating coordinates in a target surface such as a display surface of a video display device or a screen for projecting video, wherein the instruction unit directs the coordinates toward the target surface in the previous term and the instruction unit facing the instruction unit An imaging unit for detecting the image is provided, and at least four light emitting units that emit light that can be detected by the imaging unit are arranged on the straight line so that the direction of the pointing unit can be calculated. The light emitting unit is arranged, the imaging unit detects at least four images of the light emitting unit provided in the instruction unit, and the instruction unit recognizes the instruction unit from the distance and angle between the images of the light emitting unit. A point that intersects the target surface on the extension line of the pointing unit from the direction and position of the pointing unit, that is, a target in-plane coordinate calculating unit that calculates coordinates in the target surface. Coordinate designator featuring . Infrared filter means is provided so that infrared rays are emitted by the light emitting unit, and only the infrared rays are detected by the imaging unit, and the light emitting unit emits light. The coordinate designating device according to claim 1. A modulation unit that modulates light emitted from the light emitting unit, emits modulated light from the light emitting unit, and determines that an image of the light emitting unit detected by the imaging unit matches the characteristics of the modulated light The coordinate designating device according to claim 1, further comprising: a light detection unit that identifies light emitted by the light emitting unit. The instruction unit is provided with a light emission instruction button of the light emitting unit, and emits light only when the light emission instruction button is pressed. The coordinate designating device according to claim 1. A modulation unit that modulates light emitted from the light emitting unit, emits modulated light from the light emitting unit, and includes a modulated light detection unit that detects the modulated light from the light emitting unit in addition to the imaging unit. 5. The coordinate designating apparatus according to claim 4, wherein the light emission section is detected by another means by detecting the light emission signal from the light emitting unit by another means. The coordinate designating apparatus according to claim 1, wherein the position and size of the target surface in the target surface coordinate calculation means can be arbitrarily set. By instructing the position and size of the target surface in the target surface coordinate calculation means by the instruction unit a plurality of times, the position and size of the target surface are detected from the instructed position and direction, The coordinate designating apparatus according to claim 1, wherein the coordinate designating apparatus can be arbitrarily set. By indicating the position and size of the target surface in the target surface coordinate calculation means with at least two of the four corners in the screen by the instruction unit, the Z position of the target surface and two 8. The coordinate designating apparatus according to claim 7, wherein the position and size of the target surface are set by setting the position of the corner and instructing the remaining two corners.

Images