Nothing Special   »   [go: up one dir, main page]

WO2013108363A1 - Mirror device, method for controlling mirror device, and control program - Google Patents

Mirror device, method for controlling mirror device, and control program Download PDF

Info

Publication number
WO2013108363A1
WO2013108363A1 PCT/JP2012/050838 JP2012050838W WO2013108363A1 WO 2013108363 A1 WO2013108363 A1 WO 2013108363A1 JP 2012050838 W JP2012050838 W JP 2012050838W WO 2013108363 A1 WO2013108363 A1 WO 2013108363A1
Authority
WO
WIPO (PCT)
Prior art keywords
mirror
user
display
sensor
half mirror
Prior art date
Application number
PCT/JP2012/050838
Other languages
French (fr)
Japanese (ja)
Inventor
寿之 猪子
康毅 斎藤
加藤　哲朗
Original Assignee
チームラボ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by チームラボ株式会社 filed Critical チームラボ株式会社
Priority to PCT/JP2012/050838 priority Critical patent/WO2013108363A1/en
Priority to JP2013554114A priority patent/JP5898702B2/en
Publication of WO2013108363A1 publication Critical patent/WO2013108363A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • A—HUMAN NECESSITIES
    • A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47G—HOUSEHOLD OR TABLE EQUIPMENT
    • A47G1/00—Mirrors; Picture frames or the like, e.g. provided with heating, lighting or ventilating means
    • A47G1/02—Mirrors used as equipment
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G09F19/12—Advertising or display means not otherwise provided for using special optical effects
    • G09F19/16—Advertising or display means not otherwise provided for using special optical effects involving the use of mirrors

Definitions

  • the present invention relates to a mirror device, a mirror device control method, and a control program, and more particularly to display control of a video effect according to a user's operation.
  • the mirror reflects light and only displays a mirror image of an object that exists in the opposite direction, the image displayed on the mirror surface does not leave the user's expected range. On the other hand, if a video effect corresponding to the user's operation is displayed, it is possible to provide fun against the user's expectation.
  • Patent Document 1 displays a preset film, and is different from the present invention that displays a video effect according to the user's operation. That is, an apparatus capable of displaying a video effect with changes is desired.
  • the present invention has been made to solve such problems, and it is an object of the present invention to provide a mirror device that displays a video effect according to a user's operation.
  • one embodiment of the present invention is arranged such that a half mirror that reflects part of incident light and transmits part of the incident light and a display surface face the surface of the half mirror.
  • a mirror device comprising: a display device; a sensor that outputs a detection signal according to a user's action facing the half mirror; and a controller that controls display of the display device according to the detection signal. Calculates the position on the display surface of the display device corresponding to the position where the user has acted based on the output signal of the sensor, detects the user's action based on the output signal of the sensor, and When the action is detected, the display device is controlled to display a predetermined video pattern at the calculated position on the display surface.
  • a half mirror that reflects a part of incident light and transmits a part thereof
  • a display device that is arranged so that a display surface faces the surface of the half mirror
  • a sensor that outputs a detection signal corresponding to the action of the user facing the half mirror
  • the display device corresponds to a position where the user acts based on the output signal of the sensor.
  • a position on the display surface is calculated, the user's action is detected based on the output signal of the sensor, and a predetermined video pattern is displayed at the calculated position on the display surface when the user's action is detected
  • the display device is controlled so as to make it happen.
  • Still another aspect of the present invention provides a half mirror that reflects part of incident light and transmits part of the incident light, a display device that is arranged so that a display surface faces the surface of the half mirror, The display device corresponding to the position where the user acted based on the output signal of the sensor, the control program of the mirror device comprising a sensor that outputs a detection signal according to the behavior of the user facing the half mirror Calculating a position on the display surface, a discarding step for detecting the user's action based on an output signal of the sensor, and a position on the display surface when the user's action is detected. And causing the information processing apparatus to execute a step of controlling the display device so as to display a predetermined video pattern.
  • an effect mirror system including a mirror device that can display a video effect and a brush with a transmitter that is a dedicated makeup tool for displaying the video effect on the mirror device will be described as an example.
  • FIG. 1 is a diagram showing the entire system according to the present embodiment.
  • the effect mirror system 1 according to the present embodiment includes a mirror device 10 and a brush 20 with a transmitter.
  • the mirror device 10 is configured by arranging a half mirror 11 on the front surface of a box-shaped housing.
  • the brush 20 with a transmitter is a dedicated makeup tool for displaying a video effect in the mirror device according to the present embodiment, and the mirror device 10 detects the position of the brush 20 with a transmitter by detecting the position. Display the effect according to.
  • the half mirror 11 is a transflective optical component that reflects part of incident light and transmits part of it. For this reason, the half mirror 11 functions as a mirror if the back side of the surface to be viewed is dark, and functions as a transparent substrate if the back side is bright.
  • FIG. 2 is a diagram showing the inside of the mirror device 10. As shown in FIG. 2, the back side of the surface on which the half mirror 11 is provided is hollow, and no illumination is provided inside. Therefore, the half mirror 11 functions as a normal mirror when viewed from the outside of the mirror device 10. Thereby, the user can make up with the brush 20 with a transmitter, using the half mirror 11 as a mirror.
  • an LCD 12 is provided on the back side of the half mirror 11.
  • the LCD 12 is a display device arranged such that its display surface faces the back surface of the half mirror 11.
  • the LCD 12 is a display device that displays video effects.
  • the inside of the casing of the mirror device 10 other than the LCD 12 be a light color such as black. Further, it is preferable that the LCD 12 displays a low-lightness color such as black except for the display portion that displays the video effect.
  • an LCD is used as the display device, but other display devices such as an organic EL (Electro Luminescence) display may be used.
  • FIG. 3 is a diagram showing a positional relationship between the half mirror 11 and the LCD 12 in a state where the mirror device 10 is viewed from the side, and a path of light with a broken line.
  • a part of the light that is reflected by the face of the user facing the half mirror 11 from the outside of the mirror device 10 and reaches the half mirror 11 is reflected by the half mirror 11, and is reflected on the half mirror 11 by the user.
  • a mirror image of the face appears.
  • the half mirror 11 Since the inside of the housing of the mirror device 10 is in a dark state without illumination, when the half mirror 11 is viewed from the outside, the user can only see the light reflected by the surface of the half mirror 11, and as a result
  • the half mirror 11 functions as an ordinary mirror.
  • the light of the image reaches the half mirror 11 from the back side.
  • part of the light of the image displayed on the LCD 12 is transmitted through the half mirror 11 and reaches the eyes of the user viewing the mirror device 10 from the outside.
  • the user who is viewing the mirror device 10 from the outside can visually recognize the mirror image of the mirror device 10 reflected on the half mirror 11 and the image displayed on the LCD 12.
  • the mirror device uses the optical principle as shown in FIG. 3, and displays a video effect according to the movement of the brush 20 with a transmitter when the user puts on makeup, thereby making the makeup user It is possible to provide fun to the user.
  • FIG. 4A is a diagram showing only a mirror image of the user reflected on the half mirror 11. As shown in FIG. 11, when the user applies makeup with the brush 20 with a transmitter, the mirror image of the user who applies makeup with the brush 20 with a transmitter is reflected on the half mirror 11.
  • the mirror device 20 has a function of detecting the position of the brush 20 with the transmitter and the movement of the brush 20 with the transmitter.
  • the LCD 12 corresponds to the position of the brush 20 with the transmitter.
  • the video effect as shown in FIG. 4B is displayed.
  • FIG. 4B shows an example in which a video pattern in which a star flows in accordance with the movement of the brush 20 with a transmitter is displayed as an effect.
  • an image as shown in FIG. 4C is visually recognized by the user through the half mirror 11 according to the optical principle described in FIG. That is, the effect displayed by the LCD 12 is reflected in the mirror image of the confidence reflected by the half mirror 11, and it is visually recognized as if a star is flowing according to the movement of the brush 20 with the transmitter.
  • the gist of the present embodiment is to enable such a video effect.
  • the range of the semi-transmissive portion of the half mirror 11 and the range of the display surface of the LCD 12 are configured with substantially the same shape. It is preferable that they are arranged so as to overlap each other in a direction perpendicular to the respective surfaces. As a result, the video pattern displayed on the display surface of the LCD 12 is transferred to the semi-transmissive surface of the half mirror 11 as it is, so that it is not necessary to perform image processing for complicated alignment.
  • the effect around the user's face in the vertical and horizontal positions on the screen by combining the effect with an image obtained by photographing the user's face with the camera and displaying the effect on the display device.
  • the displayed effect is visible only as it is displayed on the surface of the screen, and there is no reality.
  • the half mirror 11 and the LCD 12 are arranged with a predetermined distance therebetween. Therefore, when the synthesized image as shown in FIG. 4C is visually recognized by the user, the image effect is visually recognized not in the surface of the half mirror 11 but in the back thereof. Therefore, not only the vertical and horizontal positions of the half mirror 11 but also the depth, it is possible for the user to visually recognize that the effect is generated around his / her face reflected as a mirror image, and the user has a more realistic effect. Can be visually recognized.
  • the half mirror 11 and the LCD 12 are arranged apart from each other.
  • FIG. 5 is a block diagram showing a functional configuration of the mirror device 10 according to the present embodiment.
  • the mirror device 10 according to this embodiment detects the transmission of the brush 20 with a transmitter in addition to the above-described half mirror 11 and LCD 12 and outputs a detection signal.
  • a controller 100 that controls the video effect displayed on the LCD 12 in accordance with the detection result of the sensor 13.
  • the controller 100 is configured by a combination of software and hardware, and controls the mirror device 10. As shown in FIG. 5, the controller 100 includes a sensor control unit 101, a position calculation unit 102, a motion detection unit 103, a display control unit 104, and an LCD drive unit 105.
  • the sensor control unit 101 acquires the detection signal of the sensor 13 and inputs it to the position calculation unit 102 as digital information. Specific examples of the sensor 13 and the sensor control unit 101 will be described in detail later.
  • the position calculation unit 102 calculates the position of the brush 20 with a transmitter based on information input from the sensor control unit 101 (hereinafter referred to as “sensor information”).
  • the position of the brush 20 with a transmitter calculated here is a position on the surface of the half mirror 11 and is a coordinate on the display surface of the LCD 12.
  • the sensor control unit 101 acquires a detection signal of the sensor 13 at predetermined intervals and inputs sensor information to the position calculation unit 102. And the position calculation part 102 calculates the position of the brush 20 with a transmitter, whenever sensor information is input, and inputs a calculation result into the motion detection part 103 each time.
  • the motion detection unit 103 detects the movement of the transmitter brush 20 based on the calculation result input at predetermined intervals from the position calculation unit 102.
  • the motion detection unit 102 compares the calculation results that are continuously input, that is, the position of the brush 20 with the transmitter, and detects the movement of the brush 20 with the transmitter when the position difference exceeds a predetermined threshold. To do.
  • the motion detection unit 103 detects the movement of the brush 20 with a transmitter
  • the motion detection unit 103 detects information about the motion (hereinafter referred to as “motion detection information”) and the position of the brush 20 with a transmitter (hereinafter referred to as “detection position”). Information ”) is input to the display control unit 104.
  • the display control unit 104 displays the position indicated by the detection position information, that is, the coordinates on the display surface of the LCD 12, as shown in FIG. Display information for displaying a video pattern effect is generated, and the LCD drive unit 105 is controlled to display the information on the LCD 12.
  • the display control unit 104 controls the LCD driving unit 105 so that the LCD 12 displays a low-brightness color such as black during normal times so that the half mirror 11 functions in the same manner as a normal mirror as described above.
  • the LCD drive unit 105 is driven so that a portion other than the display portion displays a low-lightness color such as black.
  • the LCD drive unit 105 is a driver that drives the LCD 12 and displays an effect as shown in FIG. 4B on the LCD 12 according to the control of the display control unit 104. By such control, the effect as shown in FIG. 4B is displayed on the LCD 12, and the display of the half mirror 11 as shown in FIG. 4C can be obtained.
  • the function of the controller 100 shown in FIG. 5 is realized by a combination of software and hardware as described above. With reference to FIG. 6, the hardware configuration of the controller 100 will be described.
  • the controller 100 of the mirror device 10 includes the same configuration as a general server, a PC (Personal Computer), or the like. That is, the controller 100 according to the present embodiment includes a CPU (Central Processing Unit) 110, a RAM (Random Access Memory) 120, a ROM (Read Only Memory) 130, an HDD (Hard Disk Drive) 140, and an I / F 150 via the bus 160. Connected through.
  • a CPU Central Processing Unit
  • RAM Random Access Memory
  • ROM Read Only Memory
  • HDD Hard Disk Drive
  • the CPU 110 is a calculation means and controls the operation of the entire controller 100.
  • the RAM 120 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 110 processes information.
  • the ROM 130 is a read-only nonvolatile storage medium, and stores programs such as firmware.
  • the HDD 140 is a non-volatile storage medium that can read and write information, and stores an OS (Operating System), various control programs, application programs, and the like.
  • the I / F 150 connects and controls the bus 160 and various hardware and networks. In the mirror device 10, the LCD 12 and the sensor 13 are connected via an I / F 150.
  • a program stored in a storage medium such as the ROM 130, the HDD 140, or an optical disk (not shown) is read into the RAM 120, and the CPU 110 performs calculations according to those programs, thereby configuring the software control unit.
  • the A functional block that realizes the function of the controller 100 according to the present embodiment is configured by a combination of the software control unit configured as described above and hardware.
  • the sensor control unit 101 starts acquiring the output of the sensor 13 (S701).
  • the position calculation unit 102 that has acquired the sensor information via the sensor control unit 101 calculates the position of the brush 20 with a transmitter based on the sensor information (S702), and inputs the calculation result to the motion detection unit 103.
  • the motion detection unit 103 detects the motion of the brush 20 with the transmitter by comparing the calculation results that are continuously input and comparing the difference in position of the brush 20 with the transmitter with a predetermined threshold value ( S703). If the movement of the brush with the transmitter 20 is not detected (S703 / NO), the controller 100 repeats the processing from S701 to S703. In other words, the process of S703 is a process of detecting the action of the user facing the half mirror 11.
  • the motion detection unit 103 inputs the motion detection information and the detection position information to the display control unit 104.
  • the display control unit 104 generates display information for displaying the effect as shown in FIG. 4B on the coordinates on the screen of the LCD 12 indicated by the detected position information (S704), and the LCD driving unit 105 is controlled to control the display on the LCD 12 (S705).
  • the controller 100 repeats the operation as shown in FIG. 7 so that the brush 20 with the transmitter 20 moves according to the movement of the makeup while the user is doing makeup. It is possible to generate interesting effects and provide fun to users who make up.
  • FIG. 8 is a diagram illustrating an example in the case of using three-point positioning.
  • a transmitter 21 is embedded in the brush 20 with a transmitter.
  • Sensors 13a to 13b that detect radio waves emitted from the transmitter 21 are provided at at least three of the four corners of the half mirror 11.
  • the sensors 13a to 13c When the radio waves transmitted from the transmitter 21 are detected by the sensors 13a to 13c arranged in this way, the sensors 13a to 13c output signals having an intensity corresponding to the distance from the transmitter 21. Then, the sensor control unit 101 obtains signals with different intensities output from the sensors 13a to 13c, and the position calculation unit 102 calculates the position of the transmitter 21 based on the principle of three-point positioning, whereby FIG. As shown in FIG. 4, the position obtained by projecting the position in the space of the brush 20 with the transmitter in the direction perpendicular to the surface of the half mirror 11 can be calculated.
  • the transmitter 21 and the sensors 13a to 13c various types of electromagnetic wave transmission and detection mechanisms can be used.
  • RFID Radio Frequency IDentification
  • a brush is used as an example of a makeup tool, and the case where the position of the brush 20 with a transmitter is detected has been described.
  • the transmitter 21 is not limited to a brush, such as a lipstick, a brush, or a buller.
  • An embedded makeup tool can be realized as well.
  • the sensor control unit 101 inputs information indicating the timing at which each of the sensors 13a to 13c detects the ultrasonic wave to the position calculation unit 102 as sensor information. Then, the position calculation unit 102 calculates the position of the brush 20 with a transmitter according to the difference in the detection timing of the ultrasonic waves in each of the sensors 13a to 13c, based on the principle of three-point positioning as described above.
  • FIG. 10 is a diagram illustrating an example in which image processing is used as a detection mechanism of the brush 20 with a transmitter by the sensor 13.
  • image processing is used as a detection mechanism of the brush 20 with a transmitter by the sensor 13.
  • a makeup tool such as an ordinary makeup brush can be used.
  • the image of the makeup tool used in the mirror device 10 needs to be stored in the position information calculation unit 102 in advance.
  • a camera 13 is installed in a space between the half mirror 11 and the LCD 12.
  • the camera 13 is an imaging device that captures an image in front of the half mirror 11 (hereinafter referred to as “front image”) and outputs the image at a predetermined frame rate.
  • front image an image in front of the half mirror 11
  • the sensor control unit 101 acquires an image in front of the half mirror 11 at a predetermined frame rate and inputs the acquired image to the position calculation unit 102.
  • the range imaged by the camera 13 is preferably aligned with the range of the semi-transmissive surface of the half mirror 11.
  • the position detected based on the image picked up by the camera 13 corresponds to the position on the semi-transmissive surface of the half mirror 11.
  • the display on the LCD 12 is performed according to the position detected based on the image captured by the camera 13. By displaying the video pattern on the surface, the video pattern can be displayed at a suitable position on the semi-transmissive surface of the half mirror 11.
  • the position calculation unit 102 searches for the image in the front image based on the image of the makeup tool stored in advance as described above, and the makeup tool in which the image is registered in advance. Is included in the front image.
  • an existing image search technique can be used.
  • the position calculation unit 102 performs the above-described image search for each front image input at a predetermined frame rate.
  • the position calculation unit 102 extracts the makeup tool on the extracted front image. Is input to the motion detection unit 103. Thereby, position detection and motion detection can be performed in the same manner as described above.
  • the mirror device 10 when the user performs makeup using the mirror device 10 as a mirror, the video effect corresponding to the movement of the makeup is superimposed on the mirror image to the user. It is possible to provide a mirror device that can be visually recognized and displays a video effect according to the user's operation.
  • the motion detection unit 103 determines the display timing of the video effect by detecting the motion of the makeup tool has been described as an example.
  • various factors can be used as the display timing of the video effect. For example, when applying makeup using a brush, the user may move the brush according to a certain pattern. Therefore, it is possible to determine the display timing of the video effect in the controller 100 by mounting a motion sensor or acceleration sensor on the brush side and outputting a detection signal when this pattern is detected.
  • the position detection is the same as in the above embodiment.
  • the pressure sensor 23 for detecting the pressure between the bristle portion and the handle portion of the brush is provided on the brush side, and a detection signal is output when the pressure is detected.
  • the controller 100 can determine the display timing of the video effect. The position detection is the same as in the above embodiment.
  • various makeup tools can be used as well as brushes. Therefore, by changing the content of the video effect according to the type of makeup tool, it is possible to provide a video effect that is more enjoyable for the user.
  • Such an aspect can be realized, for example, by changing the frequency of the electromagnetic wave transmitted from the transmitter 21 for each type of makeup tool and changing the content of the video effect in the controller 100 according to the frequency of the electromagnetic wave.
  • the controller 100 changes the ID information stored in the IC (Integrated Circuit) tag serving as the transmitter 21 for each type of makeup tool. In, it is possible to determine the content of the video effect based on the ID information.
  • IC Integrated Circuit
  • the position detection unit 102 stores an image for each makeup tool, and therefore the controller 100 responds to the image extracted by the image search. Thus, it is possible to determine the content of the video effect.
  • the image effect was visually recognized with respect to the user who makes up using the mirror apparatus 10 as an example, this is an example and it is with respect to the user who uses the mirror apparatus 10 as a mirror.
  • the video effect is displayed, it can be used similarly. That is, the gist of the present embodiment is that the user's action is detected based on the detection signal of the sensor 13 and the video effect is displayed at a position on the screen of the LCD 12 corresponding to the position where the user's action is detected. In other words, the mirror image of the user reflected by the half mirror and the video effect displayed by the LCD 12 are overlapped to make the user visually recognize.
  • the face of the user facing the half mirror 11 is recognized, and the eyes of the recognized face images are compared at a predetermined frame rate. Can detect that the user has closed his eyes.
  • the controller 100 detects that the user has opened his eyes again in a short period of time after closing his eyes, the controller 100 determines that the user has winked and displays the video effect at the position of the user's eyes. Thus, it is possible to display an image that will entertain the user.
  • the display on the LCD 12 can be controlled so that a predetermined video effect is displayed.
  • the motion detection unit 103 includes a motion ID for identifying choreography detected by the motion sensor function and an effect ID for identifying a video effect to be displayed on the LCD 12. It is made possible by notifying the display control unit 104 of the effect ID of the video effect associated with the choreography detected by the motion sensor function and the information on the position where the user is detected.
  • the function of the motion sensor described above uses an infrared sensor that can detect the range in front of the half mirror 11 as the sensor 13, and functions to analyze the information acquired by the infrared sensor 13 in time series. This is possible by mounting on the detection unit 103. Further, a transmitter is attached to each part of the user's body facing the half mirror 11, and the position of each transmitter is time-sequentially in the same manner as in FIGS. 8 and 9 based on the signal transmitted by each transmitter. It is also possible to calculate by
  • the senor 13 is a sensor that outputs a detection signal corresponding to the action of the user facing the half mirror 11. In addition, even if it is a case where the brush 20 with a transmitter is detected, it does not change in outputting the detection signal according to a user's action.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • Mirrors, Picture Frames, Photograph Stands, And Related Fastening Devices (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

[Problem] To provide a mirror device that displays a video effect in accordance with a user action. [Solution] The mirror device contains a half-silvered mirror (11), an LCD (12), a sensor (13), which outputs a detection signal in accordance with a user action facing the half-silvered mirror (11), and a controller (100), which controls the display by the LCD (12) in accordance with the detection signal, and the mirror device is characterized in that the controller (100) calculates, on the basis of the output signal of the sensor (13), the position on the display surface of the LCD (12) corresponding to the position at which the user has performed an action, detects the user action on the basis of the output signal of the sensor (13), and when the user action has been detected, controls the LCD (12) in a manner so as to cause the display of a predetermined video pattern at the calculated position on the display surface.

Description

ミラー装置、ミラー装置の制御方法及び制御プログラムMirror device, mirror device control method and control program
　本発明は、ミラー装置、ミラー装置の制御方法及び制御プログラムに関し、特に、ユーザの動作に応じた映像効果の表示制御に関する。 The present invention relates to a mirror device, a mirror device control method, and a control program, and more particularly to display control of a video effect according to a user's operation.
　人は化粧をする際、鏡に自身の顔を写した上で化粧道具を用いて化粧を行う。このように化粧に用いられる鏡に面白さを付加するための技術として、鏡としてハーフミラーを用い、背面側に表示させたい画像のフィルム及びフィルムを背面から照らす光源を配置することにより、背面に配置されたフィルムの画像が光源によって照らされてハーフミラーに映り込み、ハーフミラーの表面によって反射される自身の画像に合成されているように表示させる技術が提案されている（例えば、特許文献１参照）。 When a person puts on makeup, he / she puts his face on the mirror and uses makeup tools. In this way, as a technique for adding fun to the mirror used in makeup, a half mirror is used as the mirror, and the film of the image to be displayed on the back side and the light source that illuminates the film from the back side are arranged on the back side A technique has been proposed in which an image of a placed film is illuminated by a light source, reflected on a half mirror, and displayed so as to be synthesized with its own image reflected by the surface of the half mirror (for example, Patent Document 1). reference).
　鏡は光を反射するものであり、対向する方向に存在する物体の鏡像が表示されるのみであるため、鏡面に表示される画像はユーザの予想の範囲を出るものではない。これに対して、ユーザの動作に応じた映像効果が表示されれば、ユーザの予想に反して面白さを提供することができる。 Since the mirror reflects light and only displays a mirror image of an object that exists in the opposite direction, the image displayed on the mirror surface does not leave the user's expected range. On the other hand, if a video effect corresponding to the user's operation is displayed, it is possible to provide fun against the user's expectation.
　尚、特許文献１に開示された技術は、予めセットされたフィルムを表示させるものであり、ユーザの動作に応じた映像効果を表示させるという本件発明とはその趣旨が異なる。即ち、変化のある映像効果を表示させることが可能な装置が望まれる。 The technique disclosed in Patent Document 1 displays a preset film, and is different from the present invention that displays a video effect according to the user's operation. That is, an apparatus capable of displaying a video effect with changes is desired.
　本発明は、このような課題を解決するためになされたものであり、ユーザの動作に応じた映像効果を表示するミラー装置を提供することにある。 The present invention has been made to solve such problems, and it is an object of the present invention to provide a mirror device that displays a video effect according to a user's operation.
　上記課題を解決するために、本発明の一態様は、入射する光の一部を反射すると共に一部を透過させるハーフミラーと、表示面が前記ハーフミラーの面に対向するように配置された表示装置と、前記ハーフミラーに対向するユーザの行動に応じた検知信号を出力するセンサと、前記検知信号に応じて前記表示装置の表示を制御するコントローラとを含むミラー装置であって、前記コントローラは、前記センサの出力信号に基づいて前記ユーザが行動した位置に対応する前記表示装置の表示面上の位置を算出し、前記センサの出力信号に基づいて前記ユーザの行動を検知し、前記ユーザの行動を検知した場合に、算出した前記表示面上の位置に所定の映像パターンを表示させるように前記表示装置を制御することを特徴とする。 In order to solve the above problems, one embodiment of the present invention is arranged such that a half mirror that reflects part of incident light and transmits part of the incident light and a display surface face the surface of the half mirror. A mirror device, comprising: a display device; a sensor that outputs a detection signal according to a user's action facing the half mirror; and a controller that controls display of the display device according to the detection signal. Calculates the position on the display surface of the display device corresponding to the position where the user has acted based on the output signal of the sensor, detects the user's action based on the output signal of the sensor, and When the action is detected, the display device is controlled to display a predetermined video pattern at the calculated position on the display surface.
　また、本発明の他の態様は、入射する光の一部を反射すると共に一部を透過させるハーフミラーと、表示面が前記ハーフミラーの面に対向するように配置された表示装置と、前記ハーフミラーに対向するユーザの行動に応じた検知信号を出力するセンサとを含むミラー装置の制御方法であって、前記センサの出力信号に基づいて前記ユーザが行動した位置に対応する前記表示装置の表示面上の位置を算出し、前記センサの出力信号に基づいて前記ユーザの行動を検知し、前記ユーザの行動を検知した場合に、算出した前記表示面上の位置に所定の映像パターンを表示させるように前記表示装置を制御することを特徴とする。 According to another aspect of the present invention, there is provided a half mirror that reflects a part of incident light and transmits a part thereof, a display device that is arranged so that a display surface faces the surface of the half mirror, And a sensor that outputs a detection signal corresponding to the action of the user facing the half mirror, wherein the display device corresponds to a position where the user acts based on the output signal of the sensor. A position on the display surface is calculated, the user's action is detected based on the output signal of the sensor, and a predetermined video pattern is displayed at the calculated position on the display surface when the user's action is detected The display device is controlled so as to make it happen.
　また、本発明の更に他の態様は、入射する光の一部を反射すると共に一部を透過させるハーフミラーと、表示面が前記ハーフミラーの面に対向するように配置された表示装置と、前記ハーフミラーに対向するユーザの行動に応じた検知信号を出力するセンサとを含むミラー装置の制御プログラムであって、前記センサの出力信号に基づいて前記ユーザが行動した位置に対応する前記表示装置の表示面上の位置を算出するステップと、前記センサの出力信号に基づいて前記ユーザの行動を検知する捨てプと、前記ユーザの行動を検知した場合に、算出した前記表示面上の位置に所定の映像パターンを表示させるように前記表示装置を制御するステップとを情報処理装置に実行させることを特徴とする。 Still another aspect of the present invention provides a half mirror that reflects part of incident light and transmits part of the incident light, a display device that is arranged so that a display surface faces the surface of the half mirror, The display device corresponding to the position where the user acted based on the output signal of the sensor, the control program of the mirror device comprising a sensor that outputs a detection signal according to the behavior of the user facing the half mirror Calculating a position on the display surface, a discarding step for detecting the user's action based on an output signal of the sensor, and a position on the display surface when the user's action is detected. And causing the information processing apparatus to execute a step of controlling the display device so as to display a predetermined video pattern.
　本発明によれば、ユーザの動作に応じた映像効果を表示するミラー装置を提供することができる。 According to the present invention, it is possible to provide a mirror device that displays a video effect according to a user's operation.
本発明の実施形態に係るミラー装置システムの外観を示す図である。It is a figure which shows the external appearance of the mirror apparatus system which concerns on embodiment of this invention. 本発明の実施形態に係るミラー装置の内部を模式的に示す図である。It is a figure which shows typically the inside of the mirror apparatus which concerns on embodiment of this invention. 本発明の実施形態に係るミラー装置の光学的な原理を示す図である。It is a figure which shows the optical principle of the mirror apparatus which concerns on embodiment of this invention. 本発明の実施形態に係るミラー装置の表示例を示す図である。It is a figure which shows the example of a display of the mirror apparatus which concerns on embodiment of this invention. 本発明の実施形態に係るミラー装置の機能構成を示す図である。It is a figure which shows the function structure of the mirror apparatus which concerns on embodiment of this invention. 本発明の実施形態に係るミラー装置の情報処理機能に係るハードウェア構成を示す図である。It is a figure which shows the hardware constitutions which concern on the information processing function of the mirror apparatus which concerns on embodiment of this invention. 本発明の実施形態に係るミラー装置の動作を示すフローチャートである。It is a flowchart which shows operation | movement of the mirror apparatus which concerns on embodiment of this invention. 本発明の実施形態に係るセンサの設置例を示す図である。It is a figure which shows the example of installation of the sensor which concerns on embodiment of this invention. 本発明の実施形態に係る位置計算方法を示す図である。It is a figure which shows the position calculation method which concerns on embodiment of this invention. 本発明の実施形態に係るセンサの設置例を示す図である。It is a figure which shows the example of installation of the sensor which concerns on embodiment of this invention. 本発明の他の実施形態に係る発信器の態様を示す図である。It is a figure which shows the aspect of the transmitter which concerns on other embodiment of this invention. 本発明の他の実施形態に係る発信器の態様を示す図である。It is a figure which shows the aspect of the transmitter which concerns on other embodiment of this invention. 本発明の他の実施形態に係るコントローラが記憶している情報を示す図である。It is a figure which shows the information which the controller concerning other embodiment of this invention has memorize | stored.
　以下、図面を参照して、本発明の実施形態を詳細に説明する。本実施形態においては、映像効果を表示可能なミラー装置と、ミラー装置に映像効果を表示させるための専用の化粧道具である発信器付きブラシとを含むエフェクトミラーシステムを例として説明する。 Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the present embodiment, an effect mirror system including a mirror device that can display a video effect and a brush with a transmitter that is a dedicated makeup tool for displaying the video effect on the mirror device will be described as an example.
　図１は、本実施形態に係るシステムの全体を示す図である。図１に示すように、本実施形態に係るエフェクトミラーシステム１は、ミラー装置１０及び発信器付きブラシ２０を含む。ミラー装置１０は図１に示すように箱型の筐体の前面にハーフミラー１１が配置されて構成されている。発信器付きブラシ２０は、本実施形態に係るミラー装置において映像効果を表示させるための専用の化粧道具であり、ミラー装置１０は、発信器付きブラシ２０の位置を検知することにより、検知した位置に応じてエフェクトを表示させる。 FIG. 1 is a diagram showing the entire system according to the present embodiment. As shown in FIG. 1, the effect mirror system 1 according to the present embodiment includes a mirror device 10 and a brush 20 with a transmitter. As shown in FIG. 1, the mirror device 10 is configured by arranging a half mirror 11 on the front surface of a box-shaped housing. The brush 20 with a transmitter is a dedicated makeup tool for displaying a video effect in the mirror device according to the present embodiment, and the mirror device 10 detects the position of the brush 20 with a transmitter by detecting the position. Display the effect according to.
　ハーフミラー１１は、半透過型の光学部品であり、入射する光の一部を反射すると共に一部を透過させる。このため、ハーフミラー１１は、視認する面の背面側が暗ければミラーとして、背面側が明るければ透明の基板として機能する。図２は、ミラー装置１０の内部を示す図である。図２に示すようにハーフミラー１１が設けられた面の背面側は空洞になっており、内部には照明は設けられていない。そのため、ハーフミラー１１は、ミラー装置１０の外部から見ると普通の鏡として機能する。これにより、ユーザは、ハーフミラー１１を鏡として用いて、発信器付きブラシ２０により化粧をすることができる。 The half mirror 11 is a transflective optical component that reflects part of incident light and transmits part of it. For this reason, the half mirror 11 functions as a mirror if the back side of the surface to be viewed is dark, and functions as a transparent substrate if the back side is bright. FIG. 2 is a diagram showing the inside of the mirror device 10. As shown in FIG. 2, the back side of the surface on which the half mirror 11 is provided is hollow, and no illumination is provided inside. Therefore, the half mirror 11 functions as a normal mirror when viewed from the outside of the mirror device 10. Thereby, the user can make up with the brush 20 with a transmitter, using the half mirror 11 as a mirror.
　そして、図２に示すように、ハーフミラー１１の背面側には、ＬＣＤ（Ｌｕｉｑｕｉｄ　Ｃｒｙｓｔａｌ　Ｄｉｓｐｌａｙ）１２が設けられている。ＬＣＤ１２は、その表示面がハーフミラー１１の背面に対向するように配置されている表示装置である。このＬＣＤ１２が、映像効果を表示する表示装置である。 As shown in FIG. 2, an LCD (Luiquid Crystal Display) 12 is provided on the back side of the half mirror 11. The LCD 12 is a display device arranged such that its display surface faces the back surface of the half mirror 11. The LCD 12 is a display device that displays video effects.
　尚、ハーフミラー１１を可能な限り通常の鏡と同様に機能させるため、ＬＣＤ１２以外のミラー装置１０の筐体内部は、黒色のような明度の低い色とすることが好ましい。また、ＬＣＤ１２は、映像効果を表示する表示部分以外は黒色のような明度の低い色を表示していることが好ましい。また、本実施形態においては表示装置としてＬＣＤを用いるが、有機ＥＬ（ＥｌｅｃｔｒｏＬｕｍｉｎｅｓｃｅｎｃｅ）ディスプレイ等の他の表示装置でも良い。 In order to make the half mirror 11 function as much as possible as a normal mirror as much as possible, it is preferable that the inside of the casing of the mirror device 10 other than the LCD 12 be a light color such as black. Further, it is preferable that the LCD 12 displays a low-lightness color such as black except for the display portion that displays the video effect. In this embodiment, an LCD is used as the display device, but other display devices such as an organic EL (Electro Luminescence) display may be used.
　ここで、図３を参照して、本実施形態に係るミラー装置１０の光学的な原理について説明する。図３は、ミラー装置１０を側面から見た状態におけるハーフミラー１１とＬＣＤ１２との配置関係を示すと共に、光の一経路を破線で示す図である。図１１に示すように、ミラー装置１０の外側からハーフミラー１１に対向するユーザの顔で反射されてハーフミラー１１に到達する光の一部はハーフミラー１１によって反射され、ハーフミラー１１にユーザの顔の鏡像が映る。 Here, the optical principle of the mirror device 10 according to this embodiment will be described with reference to FIG. FIG. 3 is a diagram showing a positional relationship between the half mirror 11 and the LCD 12 in a state where the mirror device 10 is viewed from the side, and a path of light with a broken line. As shown in FIG. 11, a part of the light that is reflected by the face of the user facing the half mirror 11 from the outside of the mirror device 10 and reaches the half mirror 11 is reflected by the half mirror 11, and is reflected on the half mirror 11 by the user. A mirror image of the face appears.
　ミラー装置１０の筐体内部は照明の無い暗い状態であるため、ハーフミラー１１を外側から見た場合、ユーザが視認できるのはハーフミラー１１の表面によって反射された光のみであり、結果的に、ハーフミラー１１は普通の鏡として機能する。 Since the inside of the housing of the mirror device 10 is in a dark state without illumination, when the half mirror 11 is viewed from the outside, the user can only see the light reflected by the surface of the half mirror 11, and as a result The half mirror 11 functions as an ordinary mirror.
　他方、ＬＣＤ１２に画像が表示された場合、その画像の光はハーフミラー１１に裏側から到達する。この場合、ＬＣＤ１２に表示された画像の光の一部はハーフミラー１１を透過し、ミラー装置１０を外から視認しているユーザの目に到達する。これにより、ミラー装置１０を外から視認しているユーザには、ハーフミラー１１に映る自身の鏡像と、ＬＣＤ１２によって表示された画像とが合成されて視認される。 On the other hand, when an image is displayed on the LCD 12, the light of the image reaches the half mirror 11 from the back side. In this case, part of the light of the image displayed on the LCD 12 is transmitted through the half mirror 11 and reaches the eyes of the user viewing the mirror device 10 from the outside. As a result, the user who is viewing the mirror device 10 from the outside can visually recognize the mirror image of the mirror device 10 reflected on the half mirror 11 and the image displayed on the LCD 12.
　本実施形態に係るミラー装置は、図３に示すような光学原理を利用し、ユーザが化粧をする際の発信器付きブラシ２０の動きに応じた映像効果を表示させることにより、化粧をするユーザに面白さを提供することを可能とするものである。 The mirror device according to the present embodiment uses the optical principle as shown in FIG. 3, and displays a video effect according to the movement of the brush 20 with a transmitter when the user puts on makeup, thereby making the makeup user It is possible to provide fun to the user.
　次に、図４（ａ）～（ｃ）を参照して、本実施形態に係る映像効果について説明する。図４（ａ）は、ハーフミラー１１に映るユーザの鏡像のみを示す図である。図１１に示すように、ユーザが発信器付きブラシ２０によって化粧をすると、ハーフミラー１１には、発信器付きブラシ２０によって化粧するユーザの鏡像が映る。 Next, with reference to FIGS. 4A to 4C, the video effect according to the present embodiment will be described. FIG. 4A is a diagram showing only a mirror image of the user reflected on the half mirror 11. As shown in FIG. 11, when the user applies makeup with the brush 20 with a transmitter, the mirror image of the user who applies makeup with the brush 20 with a transmitter is reflected on the half mirror 11.
　これに対して、ミラー装置２０は、発信器付きブラシ２０の位置及び発信器付きブラシ２０の動きを検知する機能を有し、動きを検知した場合、発信器付きブラシ２０の位置に応じてＬＣＤ１２に図４（ｂ）に示すような映像効果を表示させる。図４（ｂ）においては、発信器付きブラシ２０の動きに合わせて星が流れるような映像パターンがエフェクトとして表示される例を示している。 On the other hand, the mirror device 20 has a function of detecting the position of the brush 20 with the transmitter and the movement of the brush 20 with the transmitter. When the movement is detected, the LCD 12 corresponds to the position of the brush 20 with the transmitter. The video effect as shown in FIG. 4B is displayed. FIG. 4B shows an example in which a video pattern in which a star flows in accordance with the movement of the brush 20 with a transmitter is displayed as an effect.
　このような場合、図３において説明した光学原理により、ハーフミラー１１を介してユーザに視認されるのは、図４（ｃ）に示すような映像である。即ち、ハーフミラー１１によって反射される自信の鏡像に、ＬＣＤ１２によって表示されたエフェクトが映りこみ、あたかも発信器付きブラシ２０の動きに合わせて星が流れているような映像として視認される。このような映像効果を可能とすることが、本実施形態に係る要旨である。 In such a case, an image as shown in FIG. 4C is visually recognized by the user through the half mirror 11 according to the optical principle described in FIG. That is, the effect displayed by the LCD 12 is reflected in the mirror image of the confidence reflected by the half mirror 11, and it is visually recognized as if a star is flowing according to the movement of the brush 20 with the transmitter. The gist of the present embodiment is to enable such a video effect.
　図４（ｃ）に示すような映像の重ね合わせを容易に実現するため、ハーフミラー１１の半透過部分の範囲と、ＬＣＤ１２の表示面の範囲とは、略同一の形状で構成されていると共に、夫々の面に垂直な方向においてぴったり重なるように配置されていることが好ましい。これにより、ＬＣＤ１２の表示面に表示された映像パターンは、そのままハーフミラー１１の半透過面に移りこむため、複雑な位置合わせのための画像処理を行う必要が無くなる。 In order to easily realize the superposition of images as shown in FIG. 4C, the range of the semi-transmissive portion of the half mirror 11 and the range of the display surface of the LCD 12 are configured with substantially the same shape. It is preferable that they are arranged so as to overlap each other in a direction perpendicular to the respective surfaces. As a result, the video pattern displayed on the display surface of the LCD 12 is transferred to the semi-transmissive surface of the half mirror 11 as it is, so that it is not necessary to perform image processing for complicated alignment.
　例えば、ユーザの顔をカメラで撮影した画像にエフェクトを合成し、表示装置に表示させることによっても、画面上の縦横の位置において、ユーザの顔の辺りにエフェクトを表示させることは可能である。しかしながら、この場合、表示されるエフェクトは画面の表面に表示されているようにしか視認されず、リアリティが無いものとなってしまう。 For example, it is possible to display the effect around the user's face in the vertical and horizontal positions on the screen by combining the effect with an image obtained by photographing the user's face with the camera and displaying the effect on the display device. However, in this case, the displayed effect is visible only as it is displayed on the surface of the screen, and there is no reality.
　これに対して、図３に示すように、ハーフミラー１１とＬＣＤ１２とは、所定の間隔分離れて配置されている。そのため、図４（ｃ）に示すような合成された映像がユーザによって視認される際、映像効果はハーフミラー１１の表面ではなく、その奥にあるように視認される。そのため、ハーフミラー１１の縦横の位置だけではなく、奥行においても、鏡像として映る自身の顔の辺りにエフェクトが発生しているようにユーザに視認させることが可能となり、よりリアリティのあるエフェクトとしてユーザに視認させることが可能となる。 On the other hand, as shown in FIG. 3, the half mirror 11 and the LCD 12 are arranged with a predetermined distance therebetween. Therefore, when the synthesized image as shown in FIG. 4C is visually recognized by the user, the image effect is visually recognized not in the surface of the half mirror 11 but in the back thereof. Therefore, not only the vertical and horizontal positions of the half mirror 11 but also the depth, it is possible for the user to visually recognize that the effect is generated around his / her face reflected as a mirror image, and the user has a more realistic effect. Can be visually recognized.
　従って、ハーフミラー１１の背面に間隔を空けずにＬＣＤ１２を配置することによっても、図４（ｃ）に示すようなエフェクトが合成された表示は可能であるが、上述したようなリアリティのある映像効果を実現するため、ハーフミラー１１とＬＣＤ１２とは離間させて配置することが好ましい。 Therefore, even if the LCD 12 is arranged on the back surface of the half mirror 11 without a space, a display in which the effect as shown in FIG. 4C is synthesized is possible, but the above-described reality video is provided. In order to realize the effect, it is preferable that the half mirror 11 and the LCD 12 are arranged apart from each other.
　次に、本実施形態に係るミラー装置１０の機能構成について説明する。図５は、本実施形態に係るミラー装置１０の機能構成を示すブロック図である。図５に示すように、図５に示すように、本実施形態に係るミラー装置１０は、上述したハーフミラー１１及びＬＣＤ１２に加えて、発信器付きブラシ２０の発信を検知して検知信号を出力するセンサ１３と、センサ１３による検知結果に応じてＬＣＤ１２に表示させる映像効果を制御するコントローラ１００を含む。 Next, the functional configuration of the mirror device 10 according to the present embodiment will be described. FIG. 5 is a block diagram showing a functional configuration of the mirror device 10 according to the present embodiment. As shown in FIG. 5, as shown in FIG. 5, the mirror device 10 according to this embodiment detects the transmission of the brush 20 with a transmitter in addition to the above-described half mirror 11 and LCD 12 and outputs a detection signal. And a controller 100 that controls the video effect displayed on the LCD 12 in accordance with the detection result of the sensor 13.
　コントローラ１００は、ソフトウェアとハードウェアとの組み合わせによって構成され、ミラー装置１０を制御する。図５に示すようにコントローラ１００は、センサ制御部１０１、位置計算部１０２、動き検知部１０３、表示制御部１０４及びＬＣＤ駆動部１０５を含む。 The controller 100 is configured by a combination of software and hardware, and controls the mirror device 10. As shown in FIG. 5, the controller 100 includes a sensor control unit 101, a position calculation unit 102, a motion detection unit 103, a display control unit 104, and an LCD drive unit 105.
　センサ制御部１０１は、センサ１３の検知信号を取得し、デジタル情報として位置計算部１０２に入力する。センサ１３及びセンサ制御部１０１の具体例については後に詳述する。位置計算部１０２は、センサ制御部１０１から入力された情報（以降、「センサ情報」とする）に基づき、発信器付きブラシ２０の位置を計算する。ここで計算する発信器付きブラシ２０の位置とは、ハーフミラー１１の面上における位置であり、ＬＣＤ１２の表示面における座標である。 The sensor control unit 101 acquires the detection signal of the sensor 13 and inputs it to the position calculation unit 102 as digital information. Specific examples of the sensor 13 and the sensor control unit 101 will be described in detail later. The position calculation unit 102 calculates the position of the brush 20 with a transmitter based on information input from the sensor control unit 101 (hereinafter referred to as “sensor information”). The position of the brush 20 with a transmitter calculated here is a position on the surface of the half mirror 11 and is a coordinate on the display surface of the LCD 12.
　センサ制御部１０１は、所定間隔毎にセンサ１３の検知信号を取得して位置計算部１０２にセンサ情報を入力する。そして、位置計算部１０２は、センサ情報が入力される度に発信器付きブラシ２０の位置を計算し、計算結果をその都度動き検知部１０３に入力する。動き検知部１０３は、位置計算部１０２から所定間隔毎に入力される計算結果に基づき、発信器ブラシ２０の動きを検知する。 The sensor control unit 101 acquires a detection signal of the sensor 13 at predetermined intervals and inputs sensor information to the position calculation unit 102. And the position calculation part 102 calculates the position of the brush 20 with a transmitter, whenever sensor information is input, and inputs a calculation result into the motion detection part 103 each time. The motion detection unit 103 detects the movement of the transmitter brush 20 based on the calculation result input at predetermined intervals from the position calculation unit 102.
　図４（ａ）～（ｃ）において説明したような化粧の動作に応じたエフェクトの表示を可能とするためには、発信器付きブラシ２０の位置を検知するのみでは足りず、化粧をすることにより発信器付きブラシ２０が動いていることを検知する必要がある。動き検知部１０２は、連続して入力される計算結果、即ち発信器付きブラシ２０の位置を比較し、位置の差異が所定の閾値を越えている場合に、発信器付きブラシ２０の動きを検知する。 In order to display the effect according to the makeup operation as described in FIGS. 4 (a) to 4 (c), it is not sufficient to detect the position of the brush 20 with the transmitter, and makeup is applied. Therefore, it is necessary to detect that the brush 20 with a transmitter is moving. The motion detection unit 102 compares the calculation results that are continuously input, that is, the position of the brush 20 with the transmitter, and detects the movement of the brush 20 with the transmitter when the position difference exceeds a predetermined threshold. To do.
　動き検知部１０３は、発信器付きブラシ２０の動きを検知すると、動きを検知したことを示す情報（以降、「動き検知情報」とする）及び発信器付きブラシ２０の位置（以降、「検知位置情報」とする）を表示制御部１０４に入力する。表示制御部１０４は、動き検知部１０３から動き検知情報及び検知位置情報が入力されると、検知位置情報によって示される位置、即ちＬＣＤ１２の表示面上の座標に、図４（ｂ）に示すような映像パターンのエフェクトを表示させるための表示情報を生成し、その情報をＬＣＤ１２に表示させるようにＬＣＤ駆動部１０５を制御する。 When the motion detection unit 103 detects the movement of the brush 20 with a transmitter, the motion detection unit 103 detects information about the motion (hereinafter referred to as “motion detection information”) and the position of the brush 20 with a transmitter (hereinafter referred to as “detection position”). Information ”) is input to the display control unit 104. When the motion detection information and the detection position information are input from the motion detection unit 103, the display control unit 104 displays the position indicated by the detection position information, that is, the coordinates on the display surface of the LCD 12, as shown in FIG. Display information for displaying a video pattern effect is generated, and the LCD drive unit 105 is controlled to display the information on the LCD 12.
　尚、表示制御部１０４は、上述したようにハーフミラー１１を通常の鏡と同様に機能させるため、平時は黒色のような明度の低い色をＬＣＤ１２に表示させるようにＬＣＤ駆動部１０５を制御すると共に、エフェクトを表示させる際にも、その表示部分以外の部分は黒色のような明度の低い色を表示させるようにＬＣＤ駆動部１０５を駆動する。 Note that the display control unit 104 controls the LCD driving unit 105 so that the LCD 12 displays a low-brightness color such as black during normal times so that the half mirror 11 functions in the same manner as a normal mirror as described above. At the same time, when the effect is displayed, the LCD drive unit 105 is driven so that a portion other than the display portion displays a low-lightness color such as black.
　ＬＣＤ駆動部１０５は、ＬＣＤ１２を駆動するドライバであり、表示制御部１０４の制御に従ってＬＣＤ１２に図４（ｂ）に示すようなエフェクトを表示させる。このような制御により、図４（ｂ）に示すようなエフェクトがＬＣＤ１２に表示され、図４（ｃ）に示すようなハーフミラー１１の表示を得ることができる。 The LCD drive unit 105 is a driver that drives the LCD 12 and displays an effect as shown in FIG. 4B on the LCD 12 according to the control of the display control unit 104. By such control, the effect as shown in FIG. 4B is displayed on the LCD 12, and the display of the half mirror 11 as shown in FIG. 4C can be obtained.
　図５に示すコントローラ１００の機能は、上述したようにソフトウェアとハードウェアとの組み合わせによって実現される。図６を参照して、コントローラ１００を構成するハードウェアの構成について説明する。 The function of the controller 100 shown in FIG. 5 is realized by a combination of software and hardware as described above. With reference to FIG. 6, the hardware configuration of the controller 100 will be described.
　図６に示すように、本実施形態に係るミラー装置１０のコントローラ１００は、一般的なサーバやＰＣ（Ｐｅｒｓｏｎａｌ　Ｃｏｍｐｕｔｅｒ）等と同様の構成を含む。即ち、本実施形態に係るコントローラ１００は、ＣＰＵ（Ｃｅｎｔｒａｌ　Ｐｒｏｃｅｓｓｉｎｇ　Ｕｎｉｔ）１１０、ＲＡＭ（Ｒａｎｄｏｍ　Ａｃｃｅｓｓ　Ｍｅｍｏｒｙ）１２０、ＲＯＭ（Ｒｅａｄ　Ｏｎｌｙ　Ｍｅｍｏｒｙ）１３０、ＨＤＤ（Ｈａｒｄ　Ｄｉｓｋ　Ｄｒｉｖｅ）１４０及びＩ／Ｆ１５０がバス１６０を介して接続されている。 As shown in FIG. 6, the controller 100 of the mirror device 10 according to the present embodiment includes the same configuration as a general server, a PC (Personal Computer), or the like. That is, the controller 100 according to the present embodiment includes a CPU (Central Processing Unit) 110, a RAM (Random Access Memory) 120, a ROM (Read Only Memory) 130, an HDD (Hard Disk Drive) 140, and an I / F 150 via the bus 160. Connected through.
　ＣＰＵ１１０は演算手段であり、コントローラ１００全体の動作を制御する。ＲＡＭ１２０は、情報の高速な読み書きが可能な揮発性の記憶媒体であり、ＣＰＵ１１０が情報を処理する際の作業領域として用いられる。ＲＯＭ１３０は、読み出し専用の不揮発性記憶媒体であり、ファームウェア等のプログラムが格納されている。 CPU 110 is a calculation means and controls the operation of the entire controller 100. The RAM 120 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 110 processes information. The ROM 130 is a read-only nonvolatile storage medium, and stores programs such as firmware.
　ＨＤＤ１４０は、情報の読み書きが可能な不揮発性の記憶媒体であり、ＯＳ（Ｏｐｅｒａｔｉｎｇ　Ｓｙｓｔｅｍ）や各種の制御プログラム、アプリケーション・プログラム等が格納される。Ｉ／Ｆ１５０は、バス１６０と各種のハードウェアやネットワーク等を接続し制御する。ミラー装置１０においては、ＬＣＤ１２及びセンサ１３が、Ｉ／Ｆ１５０を介して接続されている。 The HDD 140 is a non-volatile storage medium that can read and write information, and stores an OS (Operating System), various control programs, application programs, and the like. The I / F 150 connects and controls the bus 160 and various hardware and networks. In the mirror device 10, the LCD 12 and the sensor 13 are connected via an I / F 150.
　このようなハードウェア構成において、ＲＯＭ１３０やＨＤＤ１４０若しくは図示しない光学ディスク等の記憶媒体に格納されたプログラムがＲＡＭ１２０に読み出され、ＣＰＵ１１０がそれらのプログラムに従って演算を行うことにより、ソフトウェア制御部が構成される。このようにして構成されたソフトウェア制御部と、ハードウェアとの組み合わせによって、本実施形態に係るコントローラ１００の機能を実現する機能ブロックが構成される。 In such a hardware configuration, a program stored in a storage medium such as the ROM 130, the HDD 140, or an optical disk (not shown) is read into the RAM 120, and the CPU 110 performs calculations according to those programs, thereby configuring the software control unit. The A functional block that realizes the function of the controller 100 according to the present embodiment is configured by a combination of the software control unit configured as described above and hardware.
　次に、本実施形態に係るコントローラ１００の動作について、図７を参照して説明する。図７に示すように、コントローラ１００が動作を開始すると、センサ制御部１０１がセンサ１３の出力の取得を開始する（Ｓ７０１）。センサ制御部１０１を介してセンサ情報を取得した位置計算部１０２は、センサ情報に基づいて発信器付きブラシ２０の位置を計算し（Ｓ７０２）、計算結果を動き検知部１０３に入力する。 Next, the operation of the controller 100 according to the present embodiment will be described with reference to FIG. As shown in FIG. 7, when the controller 100 starts operation, the sensor control unit 101 starts acquiring the output of the sensor 13 (S701). The position calculation unit 102 that has acquired the sensor information via the sensor control unit 101 calculates the position of the brush 20 with a transmitter based on the sensor information (S702), and inputs the calculation result to the motion detection unit 103.
　動き検知部１０３は、連続して入力される計算結果を比較し、発信器付きブラシ２０の位置の差異と所定の閾値との比較を行うことにより、発信器付きブラシ２０の動きを検知する（Ｓ７０３）。発信器付きブラシの２０の動きが検知されなければ（Ｓ７０３／ＮＯ）、コントローラ１００は、Ｓ７０１からＳ７０３の処理を繰り返す。Ｓ７０３の処理は、換言すれば、ハーフミラー１１に対向するユーザの行動を検知する処理である。 The motion detection unit 103 detects the motion of the brush 20 with the transmitter by comparing the calculation results that are continuously input and comparing the difference in position of the brush 20 with the transmitter with a predetermined threshold value ( S703). If the movement of the brush with the transmitter 20 is not detected (S703 / NO), the controller 100 repeats the processing from S701 to S703. In other words, the process of S703 is a process of detecting the action of the user facing the half mirror 11.
　発信器付きブラシ２０の動きが検知された場合（Ｓ７０３／ＹＥＳ）、動き検知部１０３は、動き検知情報及び検知位置情報を表示制御部１０４に入力する。これにより、表示制御部１０４は、図４（ｂ）に示すようなエフェクトを、検知位置情報によって示されるＬＣＤ１２の画面上の座標に表示させるための表示情報を生成し（Ｓ７０４）、ＬＣＤ駆動部１０５を制御してＬＣＤ１２の表示を制御する（Ｓ７０５）。 When the movement of the brush 20 with a transmitter is detected (S703 / YES), the motion detection unit 103 inputs the motion detection information and the detection position information to the display control unit 104. Thereby, the display control unit 104 generates display information for displaying the effect as shown in FIG. 4B on the coordinates on the screen of the LCD 12 indicated by the detected position information (S704), and the LCD driving unit 105 is controlled to control the display on the LCD 12 (S705).
　コントローラ１００は、図７に示すような動作を繰り返すことにより、ユーザが化粧をしている間、化粧の動きに応じた発信器付きブラシ２０の動きに応じて、図４（ｃ）に示すようなエフェクトを発生させ、化粧をするユーザに面白さを提供することを可能とする。 As shown in FIG. 4C, the controller 100 repeats the operation as shown in FIG. 7 so that the brush 20 with the transmitter 20 moves according to the movement of the makeup while the user is doing makeup. It is possible to generate interesting effects and provide fun to users who make up.
　次に、センサ１３とセンサ制御部１０１の具体例について説明する。図８は、三点測位を用いる場合の例を示す図である。図８の例の場合、発信器付きブラシ２０には発信器２１が埋め込まれている。そして、ハーフミラー１１の４点の角のうち少なくとも３点に、発信器２１が発する電波を検知するセンサ１３ａ～１３ｂが設けられている。 Next, specific examples of the sensor 13 and the sensor control unit 101 will be described. FIG. 8 is a diagram illustrating an example in the case of using three-point positioning. In the case of the example in FIG. 8, a transmitter 21 is embedded in the brush 20 with a transmitter. Sensors 13a to 13b that detect radio waves emitted from the transmitter 21 are provided at at least three of the four corners of the half mirror 11.
　このように配置されたセンサ１３ａ～１３ｃによって発信器２１が発信する電波を検知すると、センサ１３ａ～１３ｃは、発信器２１との距離に応じた強度の信号を出力する。そして、センサ制御部１０１が、センサ１３ａ～１３ｃから夫々出力された強度の異なる信号を取得し、位置計算部１０２が、三点測位の原理により発信器２１の位置を計算することによって、図９に示すように、発信機付きブラシ２０の空間上の位置をハーフミラー１１の面に垂直な方向に射影した位置を算出することができる。 When the radio waves transmitted from the transmitter 21 are detected by the sensors 13a to 13c arranged in this way, the sensors 13a to 13c output signals having an intensity corresponding to the distance from the transmitter 21. Then, the sensor control unit 101 obtains signals with different intensities output from the sensors 13a to 13c, and the position calculation unit 102 calculates the position of the transmitter 21 based on the principle of three-point positioning, whereby FIG. As shown in FIG. 4, the position obtained by projecting the position in the space of the brush 20 with the transmitter in the direction perpendicular to the surface of the half mirror 11 can be calculated.
　発信器２１及びセンサ１３ａ～１３ｃとしては、電磁波の発信及び検知機構であれば様々な形式のものを用いることが可能であり、例えば、ＲＦＩＤ（Ｒａｄｉｏ　Ｆｒｅｑｕｅｎｃｙ　ＩＤｅｎｔｉｆｉｃａｔｉｏｎ）等を用いることができる。尚、本実施形態においては、ブラシを化粧道具の例とし、発信機付きブラシ２０の位置を検知する場合について説明しているが、ブラシに限らず、口紅、筆、ビューラー等、発信器２１が埋め込まれた化粧道具であれば同様に実現可能である。 As the transmitter 21 and the sensors 13a to 13c, various types of electromagnetic wave transmission and detection mechanisms can be used. For example, RFID (Radio Frequency IDentification) can be used. In the present embodiment, a brush is used as an example of a makeup tool, and the case where the position of the brush 20 with a transmitter is detected has been described. However, the transmitter 21 is not limited to a brush, such as a lipstick, a brush, or a buller. An embedded makeup tool can be realized as well.
　また、電磁波に限らず、超音波の発信及び検知機構を用いることも可能である。この場合、センサ制御部１０１は、センサ１３ａ～１３ｃ夫々が超音波を検知したタイミングを示す情報をセンサ情報として位置計算部１０２に入力する。そして、位置計算部１０２は、上記と同様に三点測位の原理により、センサ１３ａ～１３ｃ夫々における超音波の検知タイミングの違いに応じて発信器付きブラシ２０の位置を計算する。 Further, not only electromagnetic waves but also ultrasonic transmission and detection mechanisms can be used. In this case, the sensor control unit 101 inputs information indicating the timing at which each of the sensors 13a to 13c detects the ultrasonic wave to the position calculation unit 102 as sensor information. Then, the position calculation unit 102 calculates the position of the brush 20 with a transmitter according to the difference in the detection timing of the ultrasonic waves in each of the sensors 13a to 13c, based on the principle of three-point positioning as described above.
　図１０は、センサ１３による発信器付きブラシ２０の検知機構として、画像処理を用いる場合の例を示す図である。図１０の例の場合、発信器付きブラシ２０を用いる必要はなく、普通の化粧ブラシ等の化粧道具を用いることができる。但し、ミラー装置１０において用いる化粧道具の画像は位置情報計算部１０２に予め記憶させておく必要がある。 FIG. 10 is a diagram illustrating an example in which image processing is used as a detection mechanism of the brush 20 with a transmitter by the sensor 13. In the case of the example in FIG. 10, it is not necessary to use the brush 20 with a transmitter, and a makeup tool such as an ordinary makeup brush can be used. However, the image of the makeup tool used in the mirror device 10 needs to be stored in the position information calculation unit 102 in advance.
　図１０の例に係るミラー装置１０においては、ハーフミラー１１とＬＣＤ１２との間の空間に、カメラ１３が設置されている。カメラ１３は、ハーフミラー１１前方の画像（以降、「前方画像」とする）を撮像して所定のフレームレートで出力する撮像装置である。これにより、センサ制御部１０１は、所定のフレームレートでハーフミラー１１前方の画像を取得し、位置計算部１０２に入力する。 In the mirror device 10 according to the example of FIG. 10, a camera 13 is installed in a space between the half mirror 11 and the LCD 12. The camera 13 is an imaging device that captures an image in front of the half mirror 11 (hereinafter referred to as “front image”) and outputs the image at a predetermined frame rate. Thereby, the sensor control unit 101 acquires an image in front of the half mirror 11 at a predetermined frame rate and inputs the acquired image to the position calculation unit 102.
　尚、カメラ１３によって撮像される範囲は、ハーフミラー１１の半透過面の範囲と位置合わせされていることが好ましい。これにより、カメラ１３によって撮像された画像に基づいて検知された位置は、ハーフミラー１１の半透過面上における位置に対応したものとなる。そして、上述したように、ハーフミラー１１の半透過面の範囲とＬＣＤ１２の表示面の範囲とは位置合わせされているため、カメラ１３によって撮像された画像に基づいて検知された位置に従ってＬＣＤ１２の表示面上に映像パターンを表示させることにより、ハーフミラー１１の半透過面上における好適な位置に映像パターンを表示させることが可能となる。 It should be noted that the range imaged by the camera 13 is preferably aligned with the range of the semi-transmissive surface of the half mirror 11. Thereby, the position detected based on the image picked up by the camera 13 corresponds to the position on the semi-transmissive surface of the half mirror 11. As described above, since the range of the semi-transmissive surface of the half mirror 11 and the range of the display surface of the LCD 12 are aligned, the display on the LCD 12 is performed according to the position detected based on the image captured by the camera 13. By displaying the video pattern on the surface, the video pattern can be displayed at a suitable position on the semi-transmissive surface of the half mirror 11.
　位置計算部１０２は、センサ制御部１０１から前方画像を取得すると、上述したように予め記憶している化粧道具の画像に基づいて前方画像内の画像検索を行い、予め画像が登録された化粧道具が前方画像内に含まれるか否か判断する。この画像検索処理においては、既存の画像検索技術を用いることができる。 When the position calculation unit 102 obtains the front image from the sensor control unit 101, the position calculation unit 102 searches for the image in the front image based on the image of the makeup tool stored in advance as described above, and the makeup tool in which the image is registered in advance. Is included in the front image. In this image search process, an existing image search technique can be used.
　位置計算部１０２は、所定のフレームレートで入力される前方画像毎に上述した画像検索を行い、予め登録された化粧道具が前方画像から抽出された場合、その化粧道具が抽出された前方画像上の位置、即ち座標を動き検知部１０３に入力する。これにより、上記と同様に位置検知及び動き検知が可能となる。 The position calculation unit 102 performs the above-described image search for each front image input at a predetermined frame rate. When a pre-registered makeup tool is extracted from the front image, the position calculation unit 102 extracts the makeup tool on the extracted front image. Is input to the motion detection unit 103. Thereby, position detection and motion detection can be performed in the same manner as described above.
　以上説明したように、本実施形態に係るミラー装置１０によれば、ユーザがミラー装置１０を鏡として利用して化粧をする際に、化粧の動きに応じた映像効果を鏡像に重ねてユーザに視認させることが可能となり、ユーザの動作に応じた映像効果を表示するミラー装置を提供することができる。 As described above, according to the mirror device 10 according to the present embodiment, when the user performs makeup using the mirror device 10 as a mirror, the video effect corresponding to the movement of the makeup is superimposed on the mirror image to the user. It is possible to provide a mirror device that can be visually recognized and displays a video effect according to the user's operation.
　尚、上記実施形態においては、発信器付きブラシ２０を用いる際に、図８に示すように発信器２１が埋め込まれたブラシを用いる場合を例として説明した。この場合、ユーザが日頃から利用している化粧道具を利用することができない。このような課題は、図１１に示すように、発信器２１が埋め込まれたカバー２２を、通常の化粧ブラシに被せることにより解決することが可能である。 In addition, in the said embodiment, when using the brush 20 with a transmitter, the case where the brush with which the transmitter 21 was embedded as shown in FIG. 8 was used was demonstrated as an example. In this case, the user cannot use the makeup tool that the user uses regularly. As shown in FIG. 11, such a problem can be solved by covering a cover 22 in which the transmitter 21 is embedded with a normal makeup brush.
　また、上記実施形態においては、動き検知部１０３が、化粧道具の動きを検知することにより、映像効果の表示タイミングを判断することを例として説明した。この他、映像効果の表示タイミングとして、様々な要因を用いることができる。例えば、ブラシを用いて化粧をする際、ユーザは一定のパターンに従ってブラシを動かすことが考えられる。従って、ブラシ側にモーションセンサや、加速度センサを搭載し、このパターンを検知した場合に検知信号を出力することにより、コントローラ１００において映像効果の表示タイミングを判断することが可能となる。位置の検知においては上記実施形態と同様である。 In the above embodiment, the case where the motion detection unit 103 determines the display timing of the video effect by detecting the motion of the makeup tool has been described as an example. In addition, various factors can be used as the display timing of the video effect. For example, when applying makeup using a brush, the user may move the brush according to a certain pattern. Therefore, it is possible to determine the display timing of the video effect in the controller 100 by mounting a motion sensor or acceleration sensor on the brush side and outputting a detection signal when this pattern is detected. The position detection is the same as in the above embodiment.
　また、ブラシを用いて化粧をする際、ブラシが顔に接触することによってブラシの毛の部分とブラシの柄の部分との間には圧力がかかることが考えられる。従って、図１２に示すように、ブラシの毛の部分と柄の部分との間の圧力を検知する圧力センサ２３をブラシ側に持たせ、圧力が検知された場合に検知信号を出力することにより、コントローラ１００において映像効果の表示タイミングを判断することが可能となる。位置の検知においては上記実施形態と同様である。 Also, when applying makeup using a brush, it is considered that pressure is applied between the hair part of the brush and the handle part of the brush when the brush contacts the face. Therefore, as shown in FIG. 12, the pressure sensor 23 for detecting the pressure between the bristle portion and the handle portion of the brush is provided on the brush side, and a detection signal is output when the pressure is detected. The controller 100 can determine the display timing of the video effect. The position detection is the same as in the above embodiment.
　また、上述したように、化粧道具としては、ブラシに限らず様々なものを用いることが可能である。従って、化粧道具の種類に応じて映像効果の内容を変えることにより、よりユーザにとって楽しみのある映像効果を提供することが可能となる。このような態様は、例えば発信器２１が発信する電磁波の周波数を化粧道具の種類毎に異なるものとし、コントローラ１００において、電磁波の周波数に応じて映像効果の内容を変えることにより実現可能である。 As described above, various makeup tools can be used as well as brushes. Therefore, by changing the content of the video effect according to the type of makeup tool, it is possible to provide a video effect that is more enjoyable for the user. Such an aspect can be realized, for example, by changing the frequency of the electromagnetic wave transmitted from the transmitter 21 for each type of makeup tool and changing the content of the video effect in the controller 100 according to the frequency of the electromagnetic wave.
　また、発信器２１及びセンサ１３の機構としてとしてＲＦＩＤを用いる場合には、発信器２１となるＩＣ（Ｉｎｔｅｇｒａｔｅｄ　Ｃｉｒｃｕｉｔ）タグ内に格納されるＩＤ情報を化粧道具の種類毎に変えることにより、コントローラ１００においては、ＩＤ情報に基づいて映像効果の内容を判断することが可能となる。 When RFID is used as the mechanism of the transmitter 21 and the sensor 13, the controller 100 changes the ID information stored in the IC (Integrated Circuit) tag serving as the transmitter 21 for each type of makeup tool. In, it is possible to determine the content of the video effect based on the ID information.
　また、図１０において説明したように画像検索を用いる場合には、位置検知部１０２は夫々の化粧道具毎に画像を記憶しているため、コントローラ１００においては、画像検索により抽出された画像に応じて、映像効果の内容を判断することが可能である。 Further, when image search is used as described in FIG. 10, the position detection unit 102 stores an image for each makeup tool, and therefore the controller 100 responds to the image extracted by the image search. Thus, it is possible to determine the content of the video effect.
　また、上記実施形態においては、ミラー装置１０を用いて化粧をするユーザに対して映像効果を視認させる場合を例として説明したが、これは一例であり、ミラー装置１０を鏡として用いるユーザに対して映像効果を表示させる場合であれば同様に用いることが可能である。即ち、本実施形態に係る要旨は、センサ１３の検知信号に基づいてユーザの行動を検知し、ユーザの行動が検知された位置に対応するＬＣＤ１２の画面上の位置に映像効果を表示させることにより、ハーフミラーによって反射されるユーザの鏡像とＬＣＤ１２によって表示される映像効果とを重ねてユーザに視認させることにある。 Moreover, in the said embodiment, although the case where the image effect was visually recognized with respect to the user who makes up using the mirror apparatus 10 was demonstrated as an example, this is an example and it is with respect to the user who uses the mirror apparatus 10 as a mirror. In the case where the video effect is displayed, it can be used similarly. That is, the gist of the present embodiment is that the user's action is detected based on the detection signal of the sensor 13 and the video effect is displayed at a position on the screen of the LCD 12 corresponding to the position where the user's action is detected. In other words, the mirror image of the user reflected by the half mirror and the video effect displayed by the LCD 12 are overlapped to make the user visually recognize.
　例えば、図１０において説明したカメラを用いる態様により、ハーフミラー１１に対向するユーザの顔認識を行い、更に認識された顔の画像の目の部分を所定のフレームレートで比較することにより、コントローラ１００は、ユーザが目をつぶったことを検知することができる。そして、コントローラ１００は、ユーザが目をつぶった後、短期間で再び目を開けたことを検知した場合、ユーザがウィンクをしたと判断して、ユーザの目の位置に映像効果を表示させることにより、ユーザを楽しませるような映像の表示を行うことができる。 For example, by using the camera described with reference to FIG. 10, the face of the user facing the half mirror 11 is recognized, and the eyes of the recognized face images are compared at a predetermined frame rate. Can detect that the user has closed his eyes. When the controller 100 detects that the user has opened his eyes again in a short period of time after closing his eyes, the controller 100 determines that the user has winked and displays the video effect at the position of the user's eyes. Thus, it is possible to display an image that will entertain the user.
　また、センサ１３、センサ制御部１０１、位置計算部１０２及び動き検知部１０３によって構成される検知機能として、ハーフミラー１１に対向するユーザの動きを検知するモーションセンサ機能を持たせることにより、例えばユーザが所定の振り付けを行った場合に、所定の映像効果が表示されるようにＬＣＤ１２の表示を制御することが可能となる。 In addition, as a detection function configured by the sensor 13, the sensor control unit 101, the position calculation unit 102, and the motion detection unit 103, by providing a motion sensor function for detecting the movement of the user facing the half mirror 11, for example, a user When a predetermined choreography is performed, the display on the LCD 12 can be controlled so that a predetermined video effect is displayed.
　このような態様は、例えば、動き検知部１０３が、図１３に示すように、モーションセンサ機能によって検知される振付を識別するモーションＩＤと、ＬＣＤ１２に表示させるべき映像効果を識別するエフェクトＩＤとを関連付けて記憶しており、上述したモーションセンサ機能によって検知された振付に関連付けられた映像効果のエフェクトＩＤ及びユーザが検知された位置の情報を表示制御部１０４に通知することによって可能となる。 In such an aspect, for example, as shown in FIG. 13, the motion detection unit 103 includes a motion ID for identifying choreography detected by the motion sensor function and an effect ID for identifying a video effect to be displayed on the LCD 12. It is made possible by notifying the display control unit 104 of the effect ID of the video effect associated with the choreography detected by the motion sensor function and the information on the position where the user is detected.
　上述したモーションセンサの機能は、ハーフミラー１１の前方の範囲を検知可能な赤外線センサをセンサ１３として用いると共に、赤外線センサ１３によって取得された情報を時系列に解析する機能を位置計算部１０２及び動き検知部１０３に搭載することによって可能である。また、ハーフミラー１１に対向するユーザの体の各部に発信器を装着し、夫々の発信器の発信する信号に基づいて、図８、９と同様の態様により夫々の発信器の位置を時系列に計算することによっても可能である。 The function of the motion sensor described above uses an infrared sensor that can detect the range in front of the half mirror 11 as the sensor 13, and functions to analyze the information acquired by the infrared sensor 13 in time series. This is possible by mounting on the detection unit 103. Further, a transmitter is attached to each part of the user's body facing the half mirror 11, and the position of each transmitter is time-sequentially in the same manner as in FIGS. 8 and 9 based on the signal transmitted by each transmitter. It is also possible to calculate by
　このような場合、センサ１３は、ハーフミラー１１に対向するユーザの行動に応じた検知信号を出力するセンサとなる。尚、発信器付きブラシ２０を検知する場合であっても、ユーザの行動に応じた検知信号を出力することに変わりはない。 In such a case, the sensor 13 is a sensor that outputs a detection signal corresponding to the action of the user facing the half mirror 11. In addition, even if it is a case where the brush 20 with a transmitter is detected, it does not change in outputting the detection signal according to a user's action.
　１　エフェクトミラーシステム
　１０　ミラー装置
　１１　ハーフミラー
　１２　ＬＣＤ
　１３、１３ａ、１３ｂ、１３ｃ　センサ
　２０　発信器付きブラシ
　２１　発信器
　２２　カバー
　２３　圧力センサ
　１１０　ＣＰＵ
　１２０　ＲＡＭ
　１３０　ＲＯＭ
　１４０　ＨＤＤ
　１５０　Ｉ／Ｆ
　１６０　バス
　１００　コントローラ
　１０１　センサ制御部
　１０２　位置計算部
　１０３　動き検知部
　１０４　表示制御部
　１０５　ＬＣＤ駆動部 1 effect mirror system 10 mirror device 11 half mirror 12 LCD
13, 13a, 13b, 13c Sensor 20 Brush with transmitter 21 Transmitter 22 Cover 23 Pressure sensor 110 CPU
120 RAM
130 ROM
140 HDD
150 I / F
160 Bus 100 Controller 101 Sensor Control Unit 102 Position Calculation Unit 103 Motion Detection Unit 104 Display Control Unit 105 LCD Drive Unit
特開２０１１－８３５７０号公報JP 2011-83570 A

Claims (10)

  1. 　入射する光の一部を反射すると共に一部を透過させるハーフミラーと、
    　表示面が前記ハーフミラーの面に対向するように配置された表示装置と、
    　前記ハーフミラーに対向するユーザの行動に応じた検知信号を出力するセンサと、
    　前記検知信号に応じて前記表示装置の表示を制御するコントローラとを含み、
    　前記コントローラは、
    　前記センサの出力信号に基づいて前記ユーザが行動した位置に対応する前記表示装置の表示面上の位置を算出し、
    　前記センサの出力信号に基づいて前記ユーザの行動を検知し、
    　前記ユーザの行動を検知した場合に、算出した前記表示面上の位置に所定の映像パターンを表示させるように前記表示装置を制御することを特徴とするミラー装置。     A half mirror that reflects part of the incident light and transmits part of it;
    A display device disposed such that a display surface faces the surface of the half mirror;
    A sensor that outputs a detection signal according to the action of the user facing the half mirror;
    A controller for controlling display of the display device in response to the detection signal,
    The controller is
    Calculating the position on the display surface of the display device corresponding to the position where the user has acted based on the output signal of the sensor;
    Detecting the user's behavior based on the output signal of the sensor;
    A mirror device, wherein when the user's action is detected, the display device is controlled to display a predetermined video pattern at the calculated position on the display surface.
  2. 　前記ハーフミラーと前記表示装置とが離間して配置されていることを特徴とする請求項１に記載のミラー装置。 The mirror device according to claim 1, wherein the half mirror and the display device are spaced apart from each other.
  3. 　前記ハーフミラーと前記表示装置の間の空間における前記ミラー装置の筐体の内壁は、黒色及びそれに準ずる明度の色であることを特徴とする請求項２に記載のミラー装置。 3. The mirror device according to claim 2, wherein an inner wall of a casing of the mirror device in a space between the half mirror and the display device is black and has a lightness color equivalent thereto.
  4. 　前記コントローラは、前記所定の映像パターンを表示させる前記表示装置の表示面の範囲以外の範囲に黒色及びそれに準ずる明度の色を表示させるように前記表示装置を制御することを特徴とするエフェクト付きミラー装置。 The controller controls the display device so as to display black and a color of lightness equivalent thereto in a range other than the range of the display surface of the display device that displays the predetermined video pattern. apparatus.
  5. 　前記コントローラは、前記ユーザが手にしている器具の位置に対応する前記表示装置の表示面上の位置を算出すると共に、前記器具の動きを検知し、前記器具の動きを検知した場合に、算出した前記表示面上の位置に所定の映像パターンを表示させるように制御することを特徴とする請求項１乃至４いずれか１項に記載のエフェクト付きミラー装置。 The controller calculates a position on the display surface of the display device corresponding to the position of the instrument that the user is holding, detects the movement of the instrument, and calculates the movement of the instrument. The mirror device with an effect according to any one of claims 1 to 4, wherein control is performed so that a predetermined video pattern is displayed at a position on the display surface.
  6. 　前記センサは、前記器具に搭載された発信器の発信を検知することにより前記ハーフミラーに対向するユーザの行動に応じた検知信号を出力し、
    　前記コントローラは、前記センサの出力信号に基づいて前記器具の位置を求めることにより、前記ユーザが手にしている器具の位置に対応する前記表示装置の表示面上の位置を算出することを特徴とする、請求項５に記載のエフェクト付きミラー装置。     The sensor outputs a detection signal corresponding to the action of the user facing the half mirror by detecting the transmission of a transmitter mounted on the instrument,
    The controller calculates a position on the display surface of the display device corresponding to the position of the instrument held by the user by obtaining the position of the instrument based on an output signal of the sensor. The mirror device with an effect according to claim 5.
  7. 　前記センサは、前記ミラー装置において異なる位置に複数配置されており、
    　前記コントローラは、前記複数のセンサ夫々によって出力される検知信号に基づいて計算を行うことにより、前記器具の位置を求めることを特徴とする請求項６に記載のエフェクト付きミラー装置。     A plurality of the sensors are arranged at different positions in the mirror device,
    The mirror device with an effect according to claim 6, wherein the controller obtains the position of the instrument by performing a calculation based on detection signals output by the plurality of sensors.
  8. 　前記センサは、前記ハーフミラーに対向する範囲を撮像した画像信号を前記検知信号として出力する撮像装置であり、
    　前記コントローラは、予め記憶された前記器具の画像を前記センサが出力する画像信号に応じた画像情報から抽出することによって前記ユーザが手にしている器具の位置に対応する前記表示装置の表示面上の位置を算出すると共に、前記器具の動きを検知することを特徴とする請求項５に記載のエフェクト付きミラー装置。     The sensor is an imaging device that outputs an image signal obtained by imaging a range facing the half mirror as the detection signal,
    The controller extracts an image of the instrument stored in advance from image information corresponding to an image signal output from the sensor, thereby corresponding to the position of the instrument held by the user on the display surface of the display device. 6. The mirror device with an effect according to claim 5, wherein the movement of the instrument is detected while calculating the position of the mirror.
  9. 　入射する光の一部を反射すると共に一部を透過させるハーフミラーと、
    　表示面が前記ハーフミラーの面に対向するように配置された表示装置と、
    　前記ハーフミラーに対向するユーザの行動に応じた検知信号を出力するセンサとを含むミラー装置の制御方法であって、
    　前記センサの出力信号に基づいて前記ユーザが行動した位置に対応する前記表示装置の表示面上の位置を算出し、
    　前記センサの出力信号に基づいて前記ユーザの行動を検知し、
    　前記ユーザの行動を検知した場合に、算出した前記表示面上の位置に所定の映像パターンを表示させるように前記表示装置を制御することを特徴とするミラー装置の制御方法。     A half mirror that reflects part of the incident light and transmits part of it;
    A display device disposed such that a display surface faces the surface of the half mirror;
    A control method of a mirror device including a sensor that outputs a detection signal according to a behavior of a user facing the half mirror,
    Calculating the position on the display surface of the display device corresponding to the position where the user has acted based on the output signal of the sensor;
    Detecting the user's behavior based on the output signal of the sensor;
    A method for controlling a mirror device, comprising: controlling the display device to display a predetermined video pattern at the calculated position on the display surface when detecting the user's action.
  10. 　入射する光の一部を反射すると共に一部を透過させるハーフミラーと、
    　表示面が前記ハーフミラーの面に対向するように配置された表示装置と、
    　前記ハーフミラーに対向するユーザの行動に応じた検知信号を出力するセンサとを含むミラー装置の制御プログラムであって、
    　前記センサの出力信号に基づいて前記ユーザが行動した位置に対応する前記表示装置の表示面上の位置を算出するステップと、
    　前記センサの出力信号に基づいて前記ユーザの行動を検知する捨てプと、
    　前記ユーザの行動を検知した場合に、算出した前記表示面上の位置に所定の映像パターンを表示させるように前記表示装置を制御するステップとを情報処理装置に実行させることを特徴とするミラー装置の制御プログラム。     A half mirror that reflects part of the incident light and transmits part of it;
    A display device disposed such that a display surface faces the surface of the half mirror;
    A control program for a mirror device including a sensor that outputs a detection signal according to the action of a user facing the half mirror,
    Calculating a position on the display surface of the display device corresponding to a position where the user has acted based on an output signal of the sensor;
    A discarding block for detecting the user's action based on an output signal of the sensor;
    A mirror device that causes the information processing device to execute a step of controlling the display device to display a predetermined video pattern at the calculated position on the display surface when the user's action is detected Control program.
PCT/JP2012/050838 2012-01-17 2012-01-17 Mirror device, method for controlling mirror device, and control program WO2013108363A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2012/050838 WO2013108363A1 (en) 2012-01-17 2012-01-17 Mirror device, method for controlling mirror device, and control program
JP2013554114A JP5898702B2 (en) 2012-01-17 2012-01-17 Mirror device, mirror device control method and control program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2012/050838 WO2013108363A1 (en) 2012-01-17 2012-01-17 Mirror device, method for controlling mirror device, and control program

Publications (1)

Publication Number Publication Date
WO2013108363A1 true WO2013108363A1 (en) 2013-07-25

Family

ID=48798813

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/050838 WO2013108363A1 (en) 2012-01-17 2012-01-17 Mirror device, method for controlling mirror device, and control program

Country Status (2)

Country Link
JP (1) JP5898702B2 (en)
WO (1) WO2013108363A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015186734A1 (en) * 2014-06-05 2015-12-10 シャープ株式会社 Mirror display and mirror display unit
DE102014010352A1 (en) * 2014-07-10 2016-01-14 Iconmobile Gmbh Interactive mirror
DE102016204983A1 (en) * 2016-03-24 2017-09-28 Bayerische Motoren Werke Aktiengesellschaft Arrangement, means of transport and method for the cosmetic assistance of a user

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS623318A (en) * 1985-06-28 1987-01-09 Canon Inc Coordinate detector
JPH03210622A (en) * 1990-01-16 1991-09-13 Fujitsu Ltd Data input system
JPH11345087A (en) * 1998-03-31 1999-12-14 Seiko Epson Corp Presentation system and position detecting method
JP3085756U (en) * 2001-11-01 2002-05-17 京子 毛利 Mirror device with information terminal function
JP2002229494A (en) * 2001-02-02 2002-08-14 Shin Etsu Polymer Co Ltd Mirror with information display function
JP2003153739A (en) * 2001-09-05 2003-05-27 Fuji Photo Film Co Ltd Makeup mirror device, and makeup method
JP2005117285A (en) * 2003-10-07 2005-04-28 Hitachi Ltd Information input device, communication terminal and communication method
JP2006330011A (en) * 2005-05-23 2006-12-07 Hitachi Ltd Information presenting device
JP2009156990A (en) * 2007-12-25 2009-07-16 Panasonic Electric Works Co Ltd Mirror system
JP2010015127A (en) * 2007-12-25 2010-01-21 Panasonic Electric Works Co Ltd Information display apparatus
JP2011083570A (en) * 2009-10-15 2011-04-28 Sakamoto Co Ltd Compact key holder

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS623318A (en) * 1985-06-28 1987-01-09 Canon Inc Coordinate detector
JPH03210622A (en) * 1990-01-16 1991-09-13 Fujitsu Ltd Data input system
JPH11345087A (en) * 1998-03-31 1999-12-14 Seiko Epson Corp Presentation system and position detecting method
JP2002229494A (en) * 2001-02-02 2002-08-14 Shin Etsu Polymer Co Ltd Mirror with information display function
JP2003153739A (en) * 2001-09-05 2003-05-27 Fuji Photo Film Co Ltd Makeup mirror device, and makeup method
JP3085756U (en) * 2001-11-01 2002-05-17 京子 毛利 Mirror device with information terminal function
JP2005117285A (en) * 2003-10-07 2005-04-28 Hitachi Ltd Information input device, communication terminal and communication method
JP2006330011A (en) * 2005-05-23 2006-12-07 Hitachi Ltd Information presenting device
JP2009156990A (en) * 2007-12-25 2009-07-16 Panasonic Electric Works Co Ltd Mirror system
JP2010015127A (en) * 2007-12-25 2010-01-21 Panasonic Electric Works Co Ltd Information display apparatus
JP2011083570A (en) * 2009-10-15 2011-04-28 Sakamoto Co Ltd Compact key holder

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015186734A1 (en) * 2014-06-05 2015-12-10 シャープ株式会社 Mirror display and mirror display unit
US10254455B2 (en) 2014-06-05 2019-04-09 Sharp Kabushiki Kaisha Mirror display and mirror display unit
DE102014010352A1 (en) * 2014-07-10 2016-01-14 Iconmobile Gmbh Interactive mirror
DE102016204983A1 (en) * 2016-03-24 2017-09-28 Bayerische Motoren Werke Aktiengesellschaft Arrangement, means of transport and method for the cosmetic assistance of a user

Also Published As

Publication number Publication date
JPWO2013108363A1 (en) 2015-05-11
JP5898702B2 (en) 2016-04-06

Similar Documents

Publication Publication Date Title
US20230125265A1 (en) Safety for wearable virtual reality devices via object detection and tracking
US11341711B2 (en) System and method for rendering dynamic three-dimensional appearing imagery on a two-dimensional user interface
ES2620762T3 (en) Power management in an eye tracking system
CN102802502B (en) For the system and method for the point of fixation of tracing observation person
US9767613B1 (en) Systems and method of interacting with a virtual object
US20170032166A1 (en) Handheld biometric scanner device
KR102322813B1 (en) 3d silhouette sensing system
JP6558839B2 (en) Intermediary reality
US20170199576A1 (en) Interactive Mirror
CN109923499B (en) Portable eye tracking device
KR20210069491A (en) Electronic apparatus and Method for controlling the display apparatus thereof
CN108209857A (en) Portable eyes tracing equipment
BR112016026714B1 (en) VISION SENSOR AND SENSOR SET
KR20100085328A (en) Display apparatus and displaying method of the same
WO2016135183A1 (en) Interactive mirror
US20230140737A1 (en) Drift cancelation for portable object detection and tracking
KR102183692B1 (en) An augmented reality service apparatus for a mirror display by recognizing the reflected images on the mirror and method thereof
JP5898702B2 (en) Mirror device, mirror device control method and control program
CN114450729A (en) Mesh-based registration for face authentication
EP4189526A1 (en) Systems and methods for object tracking using fused data
JP5651639B2 (en) Information processing apparatus, information display apparatus, information processing method, and program
Kreiensieck et al. A Comprehensive Evaluation of OpenFace 2.0 Gaze Tracking
WO2021106552A1 (en) Information processing device, information processing method, and program
WO2021131950A1 (en) Information processing device, information processing method, and program
JP5843943B2 (en) Information processing apparatus, information display apparatus, information processing method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12865713

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2013554114

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12865713

Country of ref document: EP

Kind code of ref document: A1