JP2012060547A - Electronic mirror system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic mirror system capable of enabling users of different heights to obtain clear front images and thereby making the users to feel just like viewing a mirror.SOLUTION: The electronic mirror system comprises: a left-side camera 6 and a right-side camera 7 for taking images of a user; a CPU 2b for processing the images taken by the left-side camera 6 and the right-side camera 7; and a liquid crystal display 2 for displaying an image processed by the CPU 2b. The left-side camera 6 and the right-side camera 7 are movably arranged on the side sections of the liquid crystal display 2, and an image taken at the height of the user's eyes is displayed on the liquid crystal display 2.

Description

  The present invention relates to an electronic mirror system that displays an image captured by an imaging apparatus.

  Mirrors installed in clothing stores and the like have problems such as difficulty in seeing their backs and the inability to compare various clothes. In recent years, research has been conducted on using display devices as mirrors instead of mirrors.

  Patent Document 1 discloses a digital mirror device, which is shown in FIG. A monitor screen 802 is installed on the mirror installation portion of the wash basin 801, and a first visual sensor 803 and a second visual sensor 804, each of which is a set of a plurality of cameras, are installed on both sides of the monitor screen 802. Is output to the image processing unit 807. The image processing unit 807 forms an image viewed from a specific direction of the user based on these image data and displays the image on the monitor screen 802. The user's image can be displayed as an image in an arbitrary direction or converted into an enlarged image.

  Patent Document 2 discloses an electronic mirror system, which is shown in FIG. This electronic mirror system includes a liquid crystal display device 911 that is a display unit that displays a captured image, and an imaging unit that captures an image of a user 914 that is an imaging target through the liquid crystal display device 911 in the imaging mode of the liquid crystal display device 911. A camera 912, a light 915 that functions as a light source in the imaging mode and, if necessary, a display mode, and a switching control unit 913 that controls ON / OFF of the liquid crystal display device 911, the camera 912, and the light 915. Has been. The camera 912 is disposed on the back surface side of the liquid crystal display device 911, and in the imaging mode in which the liquid crystal display device 911 is in a transmission state, the imaging target is imaged via the liquid crystal display device 911, and is obtained by the camera 912 in the display mode. Function to draw the image. With this configuration, the user can acquire and display an image with a line of sight toward the liquid crystal display device 911.

Japanese Patent Laid-Open No. 2002-200964 (released on October 4, 2002) JP2004-297733 (released on October 21, 2004)

  However, Patent Document 1 installs a visual sensor composed of a set of a plurality of cameras on both sides of a monitor screen, processes each three-dimensional image data with an image processing unit, and forms an image viewed from a specific direction. Although displayed on the monitor screen, depending on the installation position of the visual sensor, it is not always possible to synthesize the user's image viewed from the front without a sense of incongruity. In other words, because the face is uneven, if the camera is not installed below the face height, the area under the nose and chin and around the eyes cannot be displayed well, and the camera is above the face height. If it is not installed, the forehead cannot be displayed well on the nose, resulting in an uncomfortable image.

  In Patent Document 2, the camera is arranged on the back side of the liquid crystal display device, the liquid crystal panel is set in the transmission state in the imaging mode, and a front image of the subject is obtained, so that the user feels as if he is looking at the mirror. However, since the subject is imaged through the liquid crystal, the image becomes blurred and the image is captured from a fixed camera, so that there is a problem that it is impossible to cope with users of different heights. .

  An object of the present invention is to provide an electronic mirror system capable of obtaining a clear front image even for users of different heights and giving the user a feeling of looking at a mirror. Is to provide.

  The present invention includes an imaging device for capturing an image of a user, an image processing unit that processes an image captured by the imaging device, and a display device that displays an image processed by the image processing unit. In the electronic mirror system, the imaging device is arranged to be movable on a side portion of the display device, and displays an image taken at the eye level of the user.

  Further, it is preferable that a plurality of the imaging devices are arranged at least on a side portion of the display device, and an image photographed by the imaging device is processed into a front image by the image processing unit and displayed on the display device.

  Further, a distance sensor is provided on the upper part of the display device, the distance sensor detects that the user has approached within a certain range from the display device, and stays within the certain range for a certain time, It preferably functions as a mirror.

  Furthermore, it is preferable that the display device displays the user at the same magnification.

  Furthermore, it is preferable that a storage unit that stores image data is provided, and the storage unit stores an image captured by the imaging device.

  Further, the user's image is stored, the display of the display device is divided into right and left halves, the stored user image is displayed on one side, and the current user is displayed on the other side. It is preferable to display the image.

  Furthermore, it is preferable that the stored image of the user is erased when the user leaves the display device outside a certain range and a certain time elapses.

  Furthermore, it is preferable that the image processing unit lowers the brightness of the background.

  Furthermore, it is preferable that the image processing unit erases the background.

  In addition, an audio storage unit is provided, and when a certain range is entered from the display device, a message is displayed on the upper part of the screen of the display device, and after a certain time, the video and voice are stored until the display device leaves the certain range. It is preferable to do.

  According to the present invention, it is possible to obtain a front image with a clear image even for users of different heights, and to give a feeling of use as if looking at the mirror to the user. A system can be provided.

1 is an overview of an electronic mirror system according to an embodiment of the present invention. It is a flow showing operation | movement of the electronic mirror system which concerns on one Embodiment of this invention. It is the perspective view which showed the positional relationship of the electronic mirror system which concerns on one Embodiment of this invention, and a user. It is a state transition diagram showing transition of the display mode of the electronic mirror system which concerns on one Embodiment of this invention. It is the schematic of the digital mirror apparatus based on a prior art. It is the schematic of the electronic mirror system which concerns on a prior art.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the scope of the present invention is not limited to the description of the drawings.

Embodiment
FIG. 1 is an overview of an electronic mirror system 1 according to this embodiment. FIG. 2 shows a flow of displaying a mirror image in the electronic mirror system 1 according to the present embodiment. FIG. 3 is a perspective view showing the positional relationship between the camera and the user. FIG. 4 is a state transition diagram showing transition of the display mode of the electronic mirror system 1 according to the present embodiment. Note that this embodiment is merely an example, and the present invention is not limited to this.

〔Constitution〕
First, the configuration of the electronic mirror system according to the present embodiment will be described with reference to FIG.

  1A shows the top surface of the electron mirror system 1, FIG. 1B shows the front surface of the electron mirror system 1, and FIG. 1C shows the side surface of the electron mirror system 1. FIG.

  The electronic mirror system 1 includes a liquid crystal display 2, a stand 3, a left upper and lower guide 4, a right upper and lower guide 5, a left camera 6, a right camera 7, an upper frame 8, a distance measuring sensor 9, and an operation panel 10.

  The liquid crystal display 2 includes an image display unit 2a, a CPU (Central Processing Unit) 2b, and a storage unit 2c, and is held by being connected to the stand 3 with a screw or the like. Further, an upper frame 8 having a distance measuring sensor 9 is fixed to the upper part of the liquid crystal display 2, and a left upper and lower guide 4 is fixed to the left and a right upper and lower guide 5 is fixed to the right.

  The CPU 2b implements each function by reading and executing various programs and data stored in the storage unit 2c.

  The storage unit 2c includes (Read Only Memory), RAM (Random Access Memory), HDD (Hard Disc Drive), and the like. The CPU 2b can synthesize the images taken by the left camera 6 and the right camera 7 into one image, display the image on the liquid crystal display 2 by inverting the mirror image. The CPU 2b, the storage unit 2c, the left camera 6, the right camera 7, the distance measuring sensor 9, and a stepping motor 14 described later are connected to each other via a bus (not shown).

  The stand 3 includes a pedestal 3a, and the operation panel 10 is placed on the pedestal 3a in a portable state. The stand 3 has wheels 3b and can move while holding the liquid crystal display 2.

  The left upper / lower guide 4 is fixed by sandwiching the side surface of the liquid crystal display 2. Similarly, the right upper and lower guides 5 are fixed by sandwiching the side surface of the liquid crystal display 2. Further, the left upper and lower guides 4 support the left camera 6, and the right upper and lower guides 5 support the right camera 7, so that the left camera 6 and the right camera 7 can slide up and down. The mechanism for moving the camera up and down will be described in detail later.

  The distance measuring sensor 9 is a sensor that measures the distance to the user, sends distance data to the user to the CPU 2b, and the user is within a predetermined range (in the present embodiment, the radius within 3 m forward of the distance measuring sensor 9). When entering, the CPU 2b transmits a signal to start photographing to the left camera 6 and the right camera 7, and photographing starts. The captured image is stored in the storage unit 2c. Then, when the user leaves the predetermined range and a certain time (in this embodiment, 5 minutes) elapses, the memory is erased. By doing so, it is possible to prevent an image from leaking to a third party. Note that, depending on the installation location, it is possible to change the predetermined range where the left camera 6 and the right camera 7 start shooting, and for example, the distance can be within 2 m of the front radius of the distance measuring sensor 9.

  The operation panel 10 is an operation unit that changes the display mode of the liquid crystal display 2, and can send an operation signal to the CPU 2b by wire or wirelessly and can be carried like a TV remote control. The display mode will be described in detail together with the operation of the electronic mirror system described later.

  Next, a mechanism for moving the camera up and down will be described in detail.

  The left camera 6 is attached to the timing belt left 4a, and can be moved up and down using the left vertical guide 4 as a rail. Similarly, the right camera 7 is attached to the timing belt right 5a, and can be moved up and down using the right upper guide 5 as a rail. The timing belt left 4a is driven by the left rotation pulley 11, and the timing belt right 5a is driven by the right rotation pulley 12. The left rotation pulley 11 and the right rotation pulley 12 are connected to a drive shaft 13, and the drive shaft 13 is connected to a stepping motor 14. The stepping motor 14 is connected to the CPU 2b and can be rotated by an instruction from the CPU 2b.

  As the stepping motor 14 rotates, the drive shaft 13 rotates, and the left rotation pulley 11 and the right rotation pulley 12 connected to the drive shaft 13 rotate in conjunction with each other. The timing belt left 4a and the timing belt right 5a are rotated by the left rotation pulley 11 and the right rotation pulley 12. The left camera 6 and the right camera 7 move up and down by the rotation of the timing belt left 4a and the timing belt right 5a.

  That is, the positions of the left camera 6 and the right camera 7 are determined by the number of rotations of the stepping motor 14.

  Therefore, in the present embodiment, the number of rotations of the stepping motor is associated with the heights of the left camera 6 and the right camera 7 in advance, and the CPU 2b can designate the heights of the left camera 6 and the right camera 7 in advance. To do.

  The stepping motor 14 rotates, the drive shaft 13 rotates, the left rotation pulley 11 and the right rotation pulley 12 rotate, the timing belt left 4a and the timing belt right 5a rotate, and the left camera 6 and the right camera 7 descend. . The initial position of the left camera 6 and the right camera 7 is the uppermost part of the vertical slide.

  If the user leaves the front radius 3 m of the distance measuring sensor 9 and 5 minutes or more have passed and the camera image is blocked, each camera moves to the initial position and stands by. However, when the frequency of using the electronic mirror system 1 is high, it may be set not to return to the initial position.

[Operation]
FIG. 2 shows a flow of displaying a mirror image in the electronic mirror system 1 according to the present embodiment.

  First, it waits until the distance measuring sensor 9 detects a user within a forward radius of 3 m (S11: NO (S indicates a step; the same applies hereinafter)). When a user is detected (S11: YES), the process proceeds to S12. . FIG. 3 shows a state where a user enters within 3 m forward radius of the distance measuring sensor 9 and the distance measuring sensor detects the user.

  Next, a shooting start signal is sent from the CPU 2b to the left camera 6 and the right camera 7, and shooting is started (S12).

  The captured image is stored in the storage unit 2c, and the CPU 2b calculates the three-dimensional position of the user's eyes from the image (S13).

  Furthermore, as shown in FIG. 3B, from the state where the left camera 6 and the right camera 7 are above the height of the user's eyes, based on the three-dimensional position of the user's eyes calculated in S13. As shown in FIG. 3C, the left camera 6 and the right camera 7 are moved to the height of the user's eyes (S14).

  The images taken by the left camera 6 and the right camera 7 that have been moved to the eye level of the user are mirror-inverted by the CPU 2b and displayed on the liquid crystal display 2 (S15). The image taken at this time is stored in the storage unit 2c for a predetermined time (1 minute in the present embodiment).

  Here, the three-dimensional position of the user's eyes in S13 can be derived by processing the images captured by the left camera 6 and the right camera 7 with the CPU 2b and detecting the three-dimensional position of the eyes.

  FIG. 4 is a state transition diagram showing the transition of the display mode when the highlight button 10a of the operation panel 10 is pressed. When the emphasis button 10a on the operation panel 10 is pressed in the normal mirror image display mode shown in S15, the image captured by the left camera 6 and the right camera 7 is processed by the CPU 2b, and the background of the background other than the user is used. Move to display mode to lower brightness. Furthermore, when the highlight button 10a is pressed again, the display mode can be shifted to darkening the background, and when the highlight button 10a is pressed again, the normal mirror image display mode is restored.

  By setting the display mode to lower the brightness of the background or the display mode to darken the background, the mirror image of the user can be clearly displayed. I can do it.

  Further, as shown in FIG. 3 (d), the image to be displayed on the liquid crystal display 2 is divided into vertical halves, the previously captured image is displayed on the left screen half, and the current state is displayed on the right screen half. Can also be done.

  The divided display starts when the user presses the playback key 10b. While the playback key 10b is pressed, the stored image is rewound within one minute before it is moved from the playback key 10b. When you release, the image stops as a still image and is displayed on the left half of the screen.

  If the user leaves the front of the liquid crystal display 2 and comes back after changing clothes, the mirror image after changing clothes is displayed on the right half, so that the two images before and after changing clothes can be compared side by side on the liquid crystal display 2. I can do it.

  Further, if it is within a certain range from the distance measuring sensor 9 (in this embodiment, within 1 m of the front radius of the distance measuring sensor 9), the same size display, that is, the user is displayed on the liquid crystal display 2 with a life size. This can be realized by performing image processing on images taken by the left camera 6 and the right camera 7.

  When comparing two-side images before and after changing clothes on the liquid crystal display 2, the size of the mirror image before changing clothes and the size of the mirror image after changing clothes are compared by entering and comparing within a 1 m forward radius of the distance measuring sensor 9. Can be made equal, and the user can easily compare clothes.

  Moreover, if it tries on and makes one rotation in front of the electronic mirror system 1, while pressing the playback key 10b of the operation panel 10, for example, the stored image within one minute before is rewound, and the hand is pressed from the playback key 10b. When released, the image stops as a still image and is displayed on the left half of the screen. For example, if it is the rear view at this time, it is displayed, the playback key 10b is pressed again and the hand is released, and the side image is displayed on the right screen half of the liquid crystal monitor. If the same operation is performed again, the right screen half can be moved to the left screen half and the next still image can be projected. When the clear key 10c is pressed, the normal mirror image display can be restored.

  Further, when the user is farther than 3 m from the distance measuring sensor 9, the mirror image display is stopped after 5 minutes, and the liquid crystal display 2 is used as an advertisement display for wearing a normal display product or a sales floor guide. However, the present invention is not limited to this, and if the user is farther than 3 m from the distance measuring sensor 9, the mirror image display may be stopped after 5 minutes and the liquid crystal display 2 may be set in the power saving mode.

  Further, the liquid crystal display 2 may be configured to have a slot for a storage medium, for example, a memory card slot (not shown) or a Blu-ray disc slot (not shown), and after the message storage key 10d on the operation panel 10 is pressed. When the user approaches within 3m of the distance measuring sensor 9, it switches to the mirror and displays on the liquid crystal display 2 "Please give me a message. It will switch automatically after 5 seconds." It can be stored in the storage unit 2c. When the message storage key 10d is pressed again, the display returns to the normal mirror image display shown in S15. Here, the message can be left in the storage medium inserted in the storage medium slot. By adopting the configuration as described above, as represented by wedding receptions, traditionally, visitors were only booked at wedding receptions, but by installing the electronic mirror system 1 Visitors can leave a video and audio congratulations in addition to the bookkeeping.

  The present invention is not limited to the above embodiment.

  In the above embodiment, the CPU 2b and the storage unit 2c are built in the liquid crystal display 2. However, the present invention is not limited to this, and the CPU 2b and the storage unit 2c are installed outside the liquid crystal display 2. It is good also as a structure. For example, a PC (Personal Computer) may be installed outside.

  Further, the number of the imaging devices is not limited to the total of the left camera 6 and the right camera 7, and a plurality of imaging devices may be installed. For example, one camera may be installed above and below the liquid crystal display, or two cameras may be installed on the left and right of the liquid crystal display.

  The present invention can be used in an image processing apparatus having an imaging device for capturing a user image and a display device for displaying the imaging device.

DESCRIPTION OF SYMBOLS 1 Electronic mirror system 2 Liquid crystal display 2a Image display part 2b CPU
2c Storage unit 3 Stand 3a Pedestal 3b Wheel 4 Left top / bottom guide 4a Timing belt left 5 Right top / bottom guide 5a Timing belt right 6 Left camera 7 Right camera 8 Upper frame 9 Distance sensor 10 Operation panel 10a Highlight button 10b Playback key 10c Clear Key 10d Message storage key 11 Left-hand rotating pulley 12 Right-hand rotating pulley 13 Drive shaft 14 Stepping motor

Claims (10)

An imaging device for capturing a user image;
An image processing unit that processes an image captured by the imaging device;
A display device for displaying an image processed by the image processing unit;
An electronic mirror system comprising:
The imaging device is arranged to be movable on the side of the display device,
An electronic mirror system that displays an image taken at the eye level of the user. A plurality of the imaging devices are arranged at least on the side of the display device,
The electronic mirror system according to claim 1, wherein an image captured by the imaging device is processed into a front image by the image processing unit and displayed on the display device. Furthermore, a distance measuring sensor is provided on the upper part of the display device,
The distance measuring sensor detects that the user has approached within a certain range from the display device, and functions as a mirror when staying within the certain range for a certain time. The electronic mirror system described in 1. 4. The electronic mirror system according to claim 1, wherein the display device displays the user at an equal magnification. Furthermore, a storage unit for storing image data is provided,
The electronic mirror system according to claim 1, wherein the storage unit stores an image captured by the imaging device. The user image is stored, the display of the display device is divided into right and left halves, the stored user image is displayed on one side, and the current user image is displayed on the other side. The electronic mirror system according to claim 5, wherein the electronic mirror system is displayed. The electronic mirror system according to claim 6, wherein the stored user image is erased when the user leaves the display device outside a certain range and a certain time elapses. The electronic mirror system according to claim 1, wherein the image processing unit lowers the brightness of the background. The electronic mirror system according to claim 1, wherein the image processing unit erases a background. Furthermore, a voice storage unit is provided,
A message is displayed at an upper part of the screen of the display device when entering a certain range from the display device, and after a certain time, an image and a voice are stored until the display device leaves the certain range. The electronic mirror system according to any one of 1 to 9.