KR20120130394A - Mobile terminal and method for controlling the same - Google Patents

Abstract

PURPOSE: A portable terminal and control method thereof are provided to offer a three dimensional video communication image to a user by converting a two dimensional video communication screen including a user image and an opponent image into the three dimensional video communication image. CONSTITUTION: A wireless communication unit(110) transmits a first image inputted by one or more cameras(121) to one or more opponent terminals. The wireless communication unit receives a second image from the opponent terminal. A display unit(151) displays a video communication screen including the first and the second image. A control unit(180) constructs a three dimensional video communication screen which the first or the second image is stereographically converted. The control unit displays the constructed three dimensional video communication screen on the display unit. [Reference numerals] (110) Wireless communication unit; (111) Broadcasting reception module; (112) Mobile communication module; (113) Wireless internet module; (114) Near field communication module; (115) Location information module; (120) A/V input unit; (121) Camera; (122) Microphone; (130) User input unit; (140) Sensing unit; (141) Proximity sensor; (142) Motion sensor; (150) Output unit; (151) Display unit; (152) Sound output module; (153) Alarm unit; (154) Haptic module; (155) Projector module; (160) Memory; (170) Interface unit; (180) Control unit; (181) Multimedia module; (190) Power providing unit

Description

MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME

The present invention relates to a portable terminal and a control method thereof, in which the use of the terminal can be realized by further considering the convenience of the user.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

As described above, the portable terminal supports a video communication function.

An object of the present invention is to provide a portable terminal capable of three-dimensional image communication screen including the image of the user and the image of the counterpart terminal and a control method thereof.

According to an aspect of the present invention, there is provided a portable terminal including: at least one camera to which a first image is input; A wireless communication unit which transmits a first image input from the camera to at least one counterpart terminal for video communication, and receives a second image from the counterpart terminal; A display unit which displays a video communication screen including the first and second images; When a command for converting the video communication screen into a 3D (3-Dimensional) video communication screen is input, the 3D video communication screen is formed by stereoscopicizing at least one of the first and second images, and the configured 3D video communication. And a controller configured to display a screen on the display unit.

In addition, the control method of a portable terminal according to the present invention comprises the steps of establishing a video communication with at least one counterpart terminal; Transmitting a first image input from at least one camera to the counterpart terminal; Receiving a second image from the counterpart terminal; Displaying a video communication screen including a first image input from the camera and a second image received from the counterpart terminal; When the command for converting the video communication screen into a 3D (3-Dimensional) video communication screen is input, constructing the 3D video communication screen in which at least one of the first and second images is stereoscopic; And displaying the configured 3D video communication screen.

The portable terminal and the control method thereof according to the present invention have the following effects.

First, there is an effect of converting the entire 2D (2-Dimensional) video communication screen including the user image and the other party image to the 3D video communication screen to provide to the user.

Second, in the 2D (2-Dimensional) video communication screen including the user image and the counterpart image, there is an effect of providing the user with a video communication screen in which the user image or the counterpart image is three-dimensional.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2A is a front perspective view of a mobile terminal according to an embodiment of the present invention.
2B is a rear perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a conceptual diagram for explaining the principle of binocular disparity.
4 is a conceptual diagram for explaining a sense of distance and 3D depth due to binocular parallax.
FIG. 5 is a conceptual diagram illustrating a method of implementing 3D stereoscopic images in a view barrier type display unit applicable to embodiments of the present invention.
6 is a flowchart illustrating a video communication control process of the mobile terminal according to the present invention.
7 to 12 are flowcharts illustrating a process of three-dimensionalizing a user image and / or a counterpart image according to the present invention.
13 to 18 are screen explanatory diagrams illustrating a process of converting a video communication screen into a 3D video communication screen according to various kinds of conversion commands.
19 to 21 are screen explanatory diagrams illustrating a process of controlling an operation related to a 3D video communication screen converted according to the present invention.

Hereinafter, a portable terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The portable terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, etc., except when applicable only to mobile terminals.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The portable terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in Fig. 1 are not essential, and a portable terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the wireless terminal 100 and the wireless communication system or between the wireless terminal 100 and a network in which the wireless terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only A digital broadcasting system such as DVB-CB, OMA-BCAST, or Integrated Services Digital Broadcast-Terrestrial (ISDB-T). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

In addition, when video communication is connected to at least one counterpart terminal, the mobile communication module 112 transmits a user image input from the camera 121 or a substitute image provided in the memory 160 to the counterpart terminal. Receive the counterpart image from the counterpart terminal.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or externally mounted in the mobile terminal 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

In addition, when the video communication is connected to one or more counterpart terminals, the wireless Internet module 113 transmits a user image input from the camera 121 or a substitute image provided in the memory 160 to the counterpart terminal. Receive the counterpart image from the counterpart terminal.

The short range communication module 114 refers to a module for short range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The location information module 115 is a module for acquiring the location of the portable terminal, and a representative example thereof is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

For example, the camera 121 may include first and second cameras 121a and 121b for photographing a 3D image of a user on a surface of the portable terminal 100 where the display unit 151 is provided. The third camera 121c for photographing the external subject may be provided in an area opposite to the surface on which the display unit 151 of the portable terminal 100 is provided.

In this case, the first camera 121a may be for photographing a left eye image, which is a source image of a 3D image, and the second camera 121b may be for photographing a right eye image.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal.

The user input unit 130 may be provided with a conversion key 135 assigned with a function for converting between the 2D video communication screen and the 3D video communication screen according to the present invention.

As described above, the user input unit 130 may be composed of a direction key, a key pad, a dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a position of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be sensed. The sensing unit 140 may include a proximity sensor 141 and a motion sensor 142. The proximity sensor 141 will be described later in relation to the touch screen.

The motion sensor 142 detects a posture and a movement of the mobile terminal 100 and outputs the detection result to the controller 180. The motion sensor 142 may include an attitude sensor, an acceleration sensor, a gyro sensor, and the like.

The output unit 150 is for generating an output relating to visual, auditory or tactile sense and includes a display unit 151, an acoustic output module 152, an alarm unit 153, a haptic module 154, 155, and the like.

The display unit 151 displays (outputs) the information processed in the portable terminal 100. For example, when the portable terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the portable terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received image, UI, or GUI is displayed.

As described above, the display unit 151 may include a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), The display device may include at least one of a flexible display and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the portable terminal 100. [ For example, in the portable terminal 100, a plurality of display units may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

The proximity sensor 141 may be disposed in an inner area of the portable terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception tones, message reception tones, etc.) performed in the portable terminal 100. The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the portable terminal 100. Examples of events occurring in the portable terminal include receiving a call signal, receiving a message, inputting a key signal, and touch input. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. Since the video signal or the audio signal may be output through the display unit 151 or the audio output module 152, in this case, the display unit 151 and the audio output module 152 are a kind of alarm unit 153. It may be classified as.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 may be configured to provide a pin array that vertically moves with respect to the contact skin surface, a jetting force or suction force of air through an injection or inlet port, grazing to the skin surface, contact of an electrode, electrostatic force, and the like. Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The projector module 155 is a component for performing an image project function using the portable terminal 100 and is the same as an image displayed on the display unit 151 according to a control signal of the controller 180. Or at least partially different images may be displayed on an external screen or wall.

Specifically, the projector module 155 includes a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, a light source And a lens (not shown) for enlarging and outputting the image at a predetermined focal distance to the outside. Further, the projector module 155 may include a device (not shown) capable of mechanically moving the lens or the entire module to adjust the image projection direction.

The projector module 155 can be divided into a CRT (Cathode Ray Tube) module, an LCD (Liquid Crystal Display) module and a DLP (Digital Light Processing) module according to the type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by enlarging and projecting an image generated by reflecting light generated from a light source on a DMD (Digital Micromirror Device) chip.

Preferably, the projector module 155 may be provided in the longitudinal direction on the side, front, or back of the portable terminal 100. Of course, the projector module 155 may be provided at any position of the mobile terminal 100 as necessary.

The memory 160 may store a program for processing and controlling the controller 180, and stores input / output data (for example, a phone book, a message, an audio, a still image, an e-book, a video, etc.). You can also perform a function for temporary storage. The memory 160 may also store a frequency of use of each of the data (eg, a phone number, a message, and a frequency of use of each multimedia). In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

In addition, the memory 160 is provided with a substitute image for replacing a user's image during video communication. The replacement image may be provided in advance when the portable terminal 100 is released, or may be an image set by a user among images stored in the memory 160.

In addition, the memory 160 may include 3D depth detection software that recognizes an object included in the 3D image and detects a depth level of the recognized 3D object.

In this case, the 3D depth detection software operates under the control of the controller 180, and in some cases, the 3D depth detection software is provided in a module form inside the controller 180 so that the controller 180 performs the same operation of the 3D depth detection software. It can also be done.

In the following description, it is assumed that the 3D depth detection software is provided inside the controller 180 and the controller 180 performs the same operation as the 3D depth detection software.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.) ), A random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- A magnetic disk, an optical disk, a memory, a magnetic disk, or an optical disk. The portable terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the portable terminal 100. The interface unit 170 receives data from an external device or receives power from the external device and transmits the data to each component in the portable terminal 100 or allows data in the portable terminal 100 to be transmitted to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identification module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the portable terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the portable terminal 100, or various command signals input from the cradle by the user It can be a passage to be transmitted to the terminal. The various command signals input from the cradle or the power source may be operated as a signal for recognizing that the portable terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the portable terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2A is a front perspective view of an example of a mobile terminal according to the present invention;

The disclosed portable terminal 100 has a bar-shaped main body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The terminal body, mainly the front case 101, includes a display unit 151, an audio output unit 152, first and second cameras 121a and 121b for 3D user images in video communication according to the present invention, and a user input unit. 130, 131, and 132, a microphone 122, and an interface 170 may be disposed.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion.

The content input by the first or second manipulation units 131 and 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 The touch recognition mode can be activated or deactivated.

FIG. 2B is a rear perspective view of the portable terminal shown in FIG. 2A.

Referring to FIG. 2B, a third camera 121c may be additionally mounted on the rear of the terminal body, that is, the rear case 102. The third camera 121c may be a camera having a photographing direction substantially opposite to the first and second cameras 121a and 121b and having the same or different pixels as the first and second cameras 121a and 121b. have.

The flash 123 and the mirror 124 may be further disposed adjacent to the third camera 121c. The flash 123 shines light toward the subject when the subject is photographed by the third camera 121c. The mirror 124 allows the user to see his / her own face or the like when the user wishes to photograph (self-photograph) the user using the third camera 121c.

An acoustic output module 152 'may be additionally disposed on the rear side of the terminal body. The sound output unit 152 ′ may implement a stereo function together with the sound output module 152 (see FIG. 2A), and may be used to implement a speakerphone mode during a call.

In addition to the antenna for communication, a broadcast signal receiving antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116 constituting a part of the broadcast receiving unit 111 (refer to FIG. 1) may be installed to be pulled out from the terminal body.

The terminal body is equipped with a power supply unit 190 for supplying power to the portable terminal 100. The power supply unit 190 may be built in the terminal body or may be directly detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type for the display unit 151. [ In this case, if the display unit 151 is configured to output visual information on both sides (i.e., in both the front and rear sides of the mobile terminal), the visual information can be recognized through the touch pad 135 as well. do. The information output on both sides may be all controlled by the touch pad 135. [

Meanwhile, the display for exclusive use of the touch pad 135 may be separately installed, so that the touch screen may be disposed in the rear case 102 as well.

The touch pad 135 operates in association with the display unit 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Hereinafter, a 3D image control process of a portable terminal that can be applied in embodiments of the present invention will be described.

Stereoscopic images that can be implemented on the display unit 151 of the portable terminal can be largely classified into two categories. The criterion of this division is whether different images are provided to both eyes.

First, the first stereoscopic image category will be described.

The first category is a method in which the same image is provided in both eyes (monoscopic), which can be implemented as a general display unit. More specifically, the controller 180 arranges a polyhedron generated through one or more points, lines, planes, or a combination thereof in a virtual three-dimensional space, and displays an image viewed from a specific viewpoint on the display unit 151. That's how. Therefore, the substantial part of such a stereoscopic image can be referred to as a planar image.

The second category is a stereo scopic method in which different images are provided in both eyes. It is a method using a principle of feeling a three-dimensional feeling when a human is looking at an object with the naked eye. In other words, the two eyes of a person see different plane images when they see the same thing by the distance between them. These different planar images are transmitted to the brain through the retina, and the brain fuses them to feel the depth and reality of the stereoscopic image. Therefore, binocular disparity due to the distance between the two eyes makes a sense of stereoscopic effect, and this binocular disparity becomes the most important element of the second category. This binocular disparity will be described in more detail with reference to Fig.

3 is a conceptual diagram for explaining the principle of binocular disparity.

In FIG. 3, it is assumed that the cube 31 is viewed with the naked eye in front of the eye level. In this case, the left eye planar image 32 is seen in which only three surfaces of the top, front, and left sides of the hexahedron 31 are visible. In addition, as the right eye, the right eye planar image 33 showing only three surfaces of the top, front, and right sides of the cube 31 is visible.

If the left eye plane image 32 is reached in the left eye and the right eye plane image 33 is reached in the right eye, even if the object is not actually an object in front of the eye, the person may feel as if the person actually sees the cube 31.

As a result, in order to implement the stereoscopic image of the second category in the mobile terminal, the left eye image and the right eye image, which are seen at the same time with the same object, must be separated and reached through the display unit. Next, the 3D depth due to binocular disparity will be described with reference to FIG. 4.

4 is a conceptual diagram for explaining a sense of distance and 3D depth due to binocular parallax.

Referring to FIG. 4, when the hexahedron 40 is viewed at a distance d1 through both eyes, the lateral gravity of an image that enters each eye is relatively higher than that of the hexahedron 40 at a d2 distance, The difference is also great. In addition, the degree of three-dimensional feeling that a person feels when viewing the cube 40 at a distance d1 is greater than when the cube 40 is viewed at a distance d2. In other words, when a person looks at an object through both eyes, the closer to the object, the greater the three-dimensional feeling, and the farther the object, the less the three-dimensional feeling.

This difference in stereoscopic dimensions can be quantified to 3D depth or 3D level.

Next, an implementation method of the 3D stereoscopic image will be described.

As described above, in order to realize a 3D stereoscopic image, it is necessary that the right eye image and the left eye image are divided into two and reach the binocular. Various methods for this are described below.

1) parallax barrier method

The parallax barrier method is a method of controlling a light propagation direction by electronically driving a blocking device provided between a general display unit and both eyes so that different images may be reached in both eyes.

This will be described with reference to FIG.

FIG. 5 is a conceptual diagram illustrating a method of implementing 3D stereoscopic images in a view barrier type display unit applicable to embodiments of the present invention.

The structure of the display barrier type display unit 151 for displaying a 3D stereoscopic image may have a configuration in which the switch liquid crystal 151b is combined with a general display device 151a. Using the switch liquid crystal 151b, the optical parallax barrier 50 may be operated as shown in FIG. 5 (a) to control the traveling direction of the light to separate the light to reach the left and right eyes. Therefore, when an image in which a right eye image and a left eye image are combined is displayed on the display device 151a, the image corresponding to each eye is seen from the user's point of view as if it is displayed in three dimensions.

In addition, as shown in FIG. 5B, the parallax barrier 50 by the switch liquid crystal is electrically controlled so that all of the light is transmitted, thereby eliminating separation of the light by the parallax barrier so that the same image can be seen by the left and right eyes. It may be. In this case, the same function as that of the general display unit may be performed.

5 illustrates that the parallax barrier moves in parallel in one axial direction, but the present invention is not limited thereto, and a parallax barrier capable of moving in parallel in two or more axial directions according to a control signal of the controller 180 may be used. have.

2) Lens refraction method

The lens refraction method (lenticular) is a method using a lenticular screen provided between a display part and a binocular eye, and a method of refracting a traveling direction of light through lenses on a lenticular screen so that different images are reached in both eyes.

3) polarized glasses system

Polarized light is polarized so that the directions of polarization are orthogonal to each other to provide different images in both directions or in the case of the circular polarized light so that the directions of rotation are different from each other.

4) Active shutter method

Eye image is alternately displayed at a predetermined cycle through the display unit and the user's eyeglasses are arranged such that when the image in the corresponding direction is displayed, the shutter in the opposite direction is closed, To reach the eye. That is, during the time when the left eye image is displayed, the shutter of the right eye is closed to allow the left eye image to be reached only in the left eye, and the shutter of the left eye is closed during the time when the right eye image is displayed.

It is assumed that the mobile terminal according to an embodiment of the present invention described below can provide the 3D preview image and the 3D object information to the user through the display unit 151 through any one of the above-described methods.

However, since the principle of the 3D image described above with reference to FIGS. 4 and 5 is a situation that assumes a three-dimensional object, the shape of the object is different in the left eye image and the right eye image. However, in the case of a planar object instead of a three-dimensional object, the shape of the object is the same in the left eye image and the right eye image. However, if the position where the object is arranged in each image is different, the user may feel the perspective of the object. In the present specification, for the sake of understanding, it is assumed that the stereoscopic image appearing below is a plane object. Of course, it is apparent that the present invention can be applied to a three-dimensional object.

Hereinafter, according to the present invention, a process of converting and displaying a video communication screen including a user image and a counterpart image into a 3D video communication screen in video communication with one or more counterpart terminals will be described in detail.

In addition, the first image referred to in the following description is an image of the mobile terminal 100, which is an image input from the camera 121 or a replacement image preset in the memory 160.

In addition, the second image referred to in the following description is an image of one or more counterpart terminals, which is a video communication image received from the counterpart terminal.

6 is a flowchart illustrating a video communication control process of the mobile terminal according to the present invention.

7 to 12 are flowcharts illustrating a process of three-dimensionalizing a user image and / or a counterpart image according to the present invention.

First, referring to FIG. 6, when the video communication is connected to at least one counterpart terminal externally through the wireless communication unit 110 [S110], the controller 180 of the portable terminal 100 receives an input from the camera 121. When the first image is transmitted to the counterpart terminal through the wireless communication unit 110 [S120], when the second video is received from the counterpart terminal [S130], a video communication screen including the first and second images is configured and displayed. [S140].

In this case, the first image may not be an image input from the camera 121 but may be a substitute image preset in the memory 160.

The first image may be one of a user image and a substitute image of the portable terminal 100, and the second image may be one of a counterpart image and a substitute image of the counterpart terminal.

In addition, the first image may be a 2D image input from any one of the first and second cameras 121a and 121b, and the 3D stereoscopic image may be input from the first and second cameras 121a and 121b. It can be left eye and right eye images.

That is, when the left and right eye images are input from the first and second cameras 121a and 121b, the controller 180 generates a 3D image using the input left and right eye images, and the generated 3D image is It may be the first image.

The second image received from the counterpart terminal may be a 2D image corresponding to any one of the left eye and the right eye, and may be a 3D image including the left and right eye images.

That is, when the second image including the left and right eye images is received from the counterpart terminal, the controller 180 can 3D convert the second image using the left and right eye images included in the received second image. have.

Next, the controller 180 detects whether a command for converting the video communication screen into a 3D video communication screen is input from the user while displaying the video communication screen [S150]. The conversion command will be described later in detail with reference to FIGS. 13 to 18.

When the conversion command is input [S160], the controller 180 constructs and displays a 3D video communication screen in which at least one of the first and second images are stereoscopically displayed [S170]. Controls the operation related to the communication screen [S180].

Hereinafter, referring to FIGS. 7 to 12, a process of configuring a 3D video communication screen of step S170 when the first and second images are both 2D or one is 2D and the other is 3D is described in detail. Explain.

7 and 8 are flowcharts illustrating a process of configuring a 3D image communication screen when the first and second images are 2D images.

First, referring to FIG. 7, when the conversion command is input in step S160, the controller 180 detects whether the first and second images are 2D images [S171A].

If the first and second images are 2D images [S172A], the controller 180 generates respective left and right eye images for the first and second images [S173A].

For example, the controller 180 may determine the first image as a left eye image, and generate a right eye image with respect to the first image based on the determined left eye image. In addition, the controller 180 may determine the second image as a left eye image, and generate a right eye image for the second image based on the determined left eye image.

Subsequently, the controller 180 stereograms each of the first and second images by using the left and right eye images of the first and second images, respectively (S174A).

In this case, the controller 180 may stereoscopically apply the depth level preset by the user when the first and second images are stereoscopically respectively.

In addition, the controller 180 recognizes an object included in the first image input through the camera 121, grasps a distance between the object and the camera 121, and grasps the new image when the new image is stereoscopically identified. It can also be stereoscopically applied by applying a depth level corresponding to the given distance. In this case, each depth level may be set for each distance between the object and the camera 121 in the memory 160, and the depth level may be set by a user or optimized by an experimental value measured a plurality of times. Can be a level.

Next, referring to FIG. 8, when the conversion command is input in step S160, the controller 180 detects whether the first and second images are 2D images [S171B].

If the first and second images are 2D images [S172B], the controller 180 generates a new image obtained by combining the first and second images into one [S173B].

In addition, the controller 180 generates left and right eye images with respect to the generated new image [S174B].

For example, the controller 180 may determine the generated new image as a left eye image, and generate a right eye image for the new image based on the determined left eye image.

In addition, the controller 180 stereoscopicizes the new image using the left and right eye images of the new image [S175B], and composes and displays a 3D video communication screen including the stereoscopic new image [S176B]. In this case, the controller 180 may stereoscopically apply the depth level preset by the user when the new image is stereoscopic.

Meanwhile, the controller 180 may transmit the stereoscopic first image 310B through the wireless communication unit 110 to the counterpart terminal through the processes of FIGS. 7 and 8.

9 and 10 are flowcharts illustrating a process of configuring a 3D video communication screen when the first image is 2D and the second image is 3D.

First, referring to FIG. 9, when the conversion command is input in step S160, the controller 180 detects whether the first image is 2D and the second image is 3D.

If the first image is 2D [S171C] and the second image is 3D [S172C], the controller 180 generates left and right eye images for the first image [S173C].

For example, the controller 180 may determine the first image as a left eye image, and generate a right eye image with respect to the first image based on the determined left eye image.

Subsequently, the controller 180 three-dimensionalizes the first image by using the left and right eye images of the generated first image [S174C].

The controller 180 configures and displays a 3D video communication screen including the stereoscopic first image and the original stereoscopic second image [S175C].

For example, if the first image is displayed as the main and the original stereoscopic second image is overlaid and displayed in the form of a thumbnail in the first image displayed as the main before the first image is three-dimensional, the controller 180 Is to display the stereoscopic first image as a main and overlay the second image in a thumbnail form in the first image displayed as the main.

In addition, the controller 180 determines the depth level of the second image in 3D when the first image is stereoscopically processed in step S174C, and applies the depth level of the determined second image to the first image. Can be three-dimensional.

Next, referring to FIG. 10, if the first image is 2D [S171D] and the second image is 3D [S172D], the controller 180 may include a left eye image included in the second image and the first image. A new left eye image obtained by synthesizing the images is generated [S173D].

In addition, the controller 180 generates a new right eye image obtained by synthesizing the right eye image included in the second image and the first image [S174D].

The controller 180 constructs and displays a 3D video communication screen by using the generated new left and right eye images [S175D].

In this case, the controller 180 may determine the depth level of the 3D second image in the process of S175D, and apply the depth level of the second image to the new left and right eyes to make a stereoscopic image.

Meanwhile, the controller 180 may transmit the stereoscopic first image 310B through the wireless communication unit 110 to the counterpart terminal through the processes of FIGS. 9 and 10.

11 and 12 are flowcharts illustrating a process of configuring a 3D video communication screen when the first image is 3D and the second image is 2D.

First, referring to FIG. 11, when the conversion command is input in step S160, the controller 180 detects whether the first image is 3D and the second image is 2D.

If the first image is 3D [S171E] and the second image is 2D [S172E], the controller 180 generates left and right eye images for the second image [S173E].

For example, the controller 180 may determine the second image as a left eye image, and generate a right eye image with respect to the second image based on the determined left eye image.

Subsequently, the controller 180 three-dimensionalizes the second image by using the left and right eye images of the generated second image [S174E].

The controller 180 constructs and displays a 3D video communication screen including the original stereoscopic first image and the stereoscopic second image [S175E].

In this case, the controller 180 determines the depth level of the first image in 3D and applies the depth level of the first image to the second image when the second image is stereoscopically processed in step S174E. Can be three-dimensional.

Next, referring to FIG. 12, if the first image is 3D [S171F] and the second image is 2D [S172F], the controller 180 may include the left eye image included in the first image and the second image. A new left eye image obtained by synthesizing the images is generated [S173F].

In addition, the controller 180 generates a new right eye image obtained by synthesizing the right eye image included in the first image and the second image [S174F].

The controller 180 constructs and displays a 3D video communication screen by using the generated new left and right eye images [S175D].

In this case, the controller 180 may determine the depth level of the 3D first image in step S175F, and apply the depth level of the first image to the new left and right eye images to stereoscopically determine the depth level.

Next, the process of S160 and S170 of FIG. 6 will be described in detail with reference to FIGS. 13 to 18.

13 to 18 are screen explanatory diagrams illustrating a process of converting a video communication screen into a 3D video communication screen according to various kinds of conversion commands.

First, FIG. 13 illustrates a process of converting a video communication screen into a 3D video communication screen using the 2D / 3D conversion key 135 provided in the user input unit 130.

That is, as shown in (a) of FIG. 13, the user input unit 130 of the portable terminal 100 includes a conversion key 135 for converting a 2D video communication screen into a 3D video communication screen. The thing provided in the case of 100) is shown.

That is, the controller 180 is a 2D video communication screen 300A including a user's image, a 2D first image 310A and a counterpart image, and a 2D second image 320A on the display unit 151. ), When the conversion key 135 is input, as shown in (b) of FIG. 13, the first and second images 310A, The stereoscopic image 320A is displayed and the 3D video communication screen 300B including the stereoscopic first and second images 310B and 320B is displayed.

In addition, when the conversion key 135 is input again while the 3D video communication screen 300B is displayed, the controller 180 returns the 3D video communication screen 300B to the original 2D video communication screen 300A. It can also be converted and displayed again.

Next, referring to FIG. 14, the controller 180 inputs contact information of a counterpart terminal to which video communication is to be connected, and according to an input of the video communication connection key 350, 2D or 3D video communication with the counterpart terminal. The mode can be determined.

That is, when the video communication connection key 350 is input in a first manner (eg, “short touch”), the controller 180 provides 2D video communication with the counterpart terminal and the video communication connection key 350. ) Is input in a second manner (eg, "long touch") to provide 3D video communication with the counterpart terminal.

Next, FIG. 15 illustrates a process of converting a video communication screen into a 3D video communication screen according to a preset user's touch gesture.

First, as illustrated in FIG. 15A, the controller 180 is a user's image on the display unit 151, a first image 310A in 2D, and a second image in 2D and a counterpart. When the touch gesture 410A having the preset directionality is input while the 2D video communication screen 300A including the 320A is displayed, as shown in FIG. 15C, FIGS. The 3D video communication screen 300B including the stereoscopic first and second images 310B and 320B is displayed by three-dimensionalizing the first and second images 310A and 320A by the process of FIG. 12.

In this case, the touch gesture 410A may be a flicking touch having a specific first directionality, and the controller 180 indicates that the flicking touch having a second directionality different from the first directionality is the 3D video communication. When input on the screen 300B, the 3D video communication screen 300B may be converted back to the original 2D video communication screen 300A and displayed.

Subsequently, as shown in FIG. 15B, when the touch gesture 410B having a preset pattern is input on the 2D video communication screen 300A, the controller 180 may display FIG. 15C. As shown in FIG. 6), the first and second images 310A and 320A are three-dimensionalized by the process of FIGS. 6 to 12, and the stereoscopic first and second images 310B and 320B are included. Display the 3D video communication screen 300B.

In this case, the touch gesture 410B has a pattern corresponding to a number or shape representing 3D.

Next, FIG. 16 and FIG. 17 show a process of stereoscopicizing only a desired image in a 2D video communication screen including a user image and a counterpart image.

First, as illustrated in FIG. 16A, the controller 180 is a user's image on the display unit 151, a first image 310A which is 2D, and a second image which is 2D, which is an image of the other party. When the first image 310A is touched while the 2D image communication screen 300A including the 320A is displayed, as shown in FIG. 16B, the first image 310A is stereoscopically displayed. The 3D video communication screen 300B including the stereoscopic first image 310B is displayed.

Next, as shown in (a) of FIG. 17, when the second image 310A is touched, the controller 180 displays the second image 320A as shown in (b) of FIG. 17. 3D and displays a 3D video communication screen 300B including the stereoscopic second image 320B.

Next, FIG. 18 illustrates a process of converting a 2D video communication screen including a user image and a counterpart image into a 3D video communication screen according to the posture of the portable terminal.

That is, as shown in FIG. 18A, the controller 180 is a user's image on the display unit 151, a first image 310A which is 2D, and a second image which is 2D, which is an image of the other party. When the posture of the mobile terminal 100 is changed to a preset posture through the motion sensor 142 in the state where the 2D video communication screen 300A including the 320A is displayed, as illustrated in FIG. 18B. As described above, the first and second images 310A and 320A are stereoscopic, and the 3D video communication screen 300B including the stereoscopic first and second images 310B and 320B is displayed.

For example, the mobile terminal 100 may take a "portrait" posture in the 2D video communication mode, and may take a "landscape" posture in the 3D video communication mode, and the controller 180 may determine the posture of the mobile terminal 100. When the image is “landscape” or “vertical,” the video communication mode of the mobile terminal 100 is changed to the video communication mode (2D or 3D) corresponding to the posture.

Next, the process of S180 of FIG. 6 will be described in detail with reference to FIGS. 19 to 21.

19 to 21 are screen explanatory diagrams illustrating a process of controlling an operation related to a 3D video communication screen converted according to the present invention.

First, FIG. 19 illustrates a process of adjusting a depth level of a 3D video communication screen according to a user's manipulation.

That is, as shown in (a) of FIG. 19, the controller 180 includes a 3D video communication screen 300B including first and second images 310B and 320B stereoscopically formed by the processes of FIGS. 6 to 18. In the state of displaying, when the pinching-out multi-touch of the user's finger is spread on the first image 310B, as shown in (b) of FIG. Correspondingly, the depth level of the first image 310B may be increased to be displayed.

In this case, the pinching-out multi-touch refers to a touch in which the distance between the first and second points is gradually increased while the specific first and second points on the first image 310B are multi-touched. .

In addition, although not shown in FIG. 19, the controller 180 corresponds to a degree of pinching when the user's finger is pinched-in multi-touch on the first image 310B. The depth level of the first image 310B may be reduced and displayed.

In this case, the pinching-in multi-touch refers to a touch in which the distance between the first and second points is gradually reduced while the specific first and second points on the first image 310B are multi-touched. .

In addition, although not shown in FIG. 19, when the pinching-out multi-touch is input on the second image 320B, the controller 180 determines the depth of the second image 320B according to the degree of pinching-out. Can be displayed by increasing the level.

In addition, although not shown in FIG. 19, when the pinching-in multi-touch is input on the second image 320B, the controller 180 determines the depth of the second image 320B according to the degree of pinching-in. Can be displayed by decreasing the level.

In addition, although not shown in FIG. 19, when the pinching-out multi-touch is input on the 3D video communication screen 300B, the controller 180 controls the first and second images according to the degree of pinching-out. Increasing the depth level of the 320A, 320B can be displayed.

In addition, although not shown in FIG. 19, when the pinching-in multi-touch is input on the 3D video communication screen 300B, the controller 180 may adjust the first and second images according to the degree of pinching-in. Depth levels of the 320A and 320B may be reduced and displayed.

In addition, although not shown in the drawing, the controller 180 may apply a predetermined depth level to the stereoscopic first and second images 310B and 320B, and then, may be disposed within the first and second images 310B and 320B. Each object may be recognized, the movement degree of each recognized object may be determined, and a corresponding depth level may be applied according to the detected movement degree.

For example, when a specific object in the first image 310B is far from the screen, the depth level of the first image 310B may be decreased to maximize the maximum. When the specific object is close to the screen, the maximum depth is maximized. For this reason, the depth level of the first image 310B may be increased.

In addition, although not shown in the drawing, the controller 180 recognizes the user face and the counterpart face in the first and second images 310B and 320B, respectively, and any one of the recognized user face and the counterpart face is preset. When a graphic change more than a numerical value occurs, the image in which the graphic change is generated may be regarded as a speaker (talker) in current video communication, and the depth level of the image corresponding to the image in which the graphic change is generated may be increased and displayed. .

For example, when a graphic change of more than the predetermined value occurs in the user's face, the user is regarded as a speaker (talker) who is currently talking on video communication, and a depth level is applied to the first image 310B corresponding to the user's face. It can be increased and displayed.

In addition, although not shown in the drawing, the controller 180 displays the 3D video communication screen 300B converted by the process of FIGS. 6 to 18, and the user's voice for video communication through the microphone 122. If is input, it is regarded as a speaker (speaker) who speaks the user in the current video communication, and the depth level of the first image 310B corresponding to the user may be increased and displayed in the 3D video communication screen 300B.

In addition, although not shown in the drawing, the controller 180 displays the 3D video communication screen 300B converted by the processes of FIGS. 6 to 18, and controls the counterpart for video communication through the wireless communication unit 110. When the voice is received, the person may be regarded as a speaker (talker) in the current video communication, and the depth level of the second image 320B corresponding to the other party may be increased and displayed in the 3D video communication screen 300B. .

Next, FIGS. 20 and 21 illustrate a process of providing an editing function to the converted 3D video communication screen 300B.

That is, as shown in FIG. 20A, the controller 180 includes the 3D video communication screen 300B including the first and second images 310B and 320B stereoscopically formed by the processes of FIGS. 6 to 18. When the command for editing the 3D video communication screen 300B is input in the state of displaying, as illustrated in FIG. 20B, one or more methods of editing the 3D video communication screen 300B are displayed. Displays an edit menu 420 that provides a function.

In this case, as an example, in FIG. 20, an icon to which an editing menu 420 call function is assigned is displayed in the 3D video communication screen 300B, and the controller 180 controls the editing menu 420 when the icon is touched by a user. ) Is displayed.

Also, as an example, the edit menu 420 includes a 3D effect menu 421, a 3D shape menu 422, a 3D capture menu 423, and a 3D recording menu 424. Of course, the menus 421 to 424 are only illustrated as an example, and all menu functions for editing the 3D video communication screen 300B may belong to the edit menu 420.

The 3D effect menu 421 may provide a list of all 3D effects that can be applied to the 3D video communication screen 300B, and the controller 180 may select one of the first and second images 310B and 320B. When a specific 3D effect is selected in the list, the selected 3D effect may be assigned to any one selected from the first and second images 310B and 320B.

In this case, when the selected 3D effect is applied to the first image 310B, the controller 180 may transmit the first image 310B to which the 3D effect is applied to the counterpart terminal through the wireless communication unit 110. In some cases, only data corresponding to the selected 3D effect may be transmitted to the counterpart terminal. For example, the 3D effect may include Blur, Funny, Snow, Big, Mosaic, Fish eye, Concave, Shallow, and the like.

In addition, the 3D shape menu 421 may provide a list of shapes having all 3D patterns that can be synthesized on the 3D video communication screen 300B, and the controller 180 may control the first and second images 310B and 320B. ), And when a specific 3D shape is selected in the list, the selected 3D shape may be synthesized with any one selected from the first and second images 310B and 320B.

For example, FIG. 21A illustrates that a 3D shape 422A representing a "happy birthday cake" is synthesized with the first image 310B, and FIG. 21B illustrates the first image 310B. ) Shows that a 3D shape 422B having a depth level and "3D motion pattern" representing "love" is synthesized.

The 3D capture menu 423 captures the 3D video communication screen 300B converted from the 2D to 3D, or the 3D video communication screen edited through the 3D effect menu 421 and the 3D shape menu 422 ( 300B) to capture and store in the memory 160.

The 3D recording menu 424 records a 3D video communication screen 300B converted from 2D to 3D, or is edited through the 3D effect menu 421 and the 3D shape menu 422. A function of recording 300B) and storing the same in the memory 160 is provided.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which are also implemented in the form of carrier waves (eg, transmission over the Internet). It also includes. Also, the computer may include a control unit 180 of the terminal.

Accordingly, the above detailed description should not be construed as limiting in all aspects and should be considered as illustrative. The scope of the invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

The above-described mobile terminal and its control method are not limited to the configuration and method of the above-described embodiments, but the embodiments may be modified such that all or some of the embodiments are selectively And may be configured in combination.

Claims (18)

One or more cameras to which the first image is input;
A wireless communication unit which transmits a first image input from the camera to at least one counterpart terminal for video communication, and receives a second image from the counterpart terminal;
A display unit which displays a video communication screen including the first and second images; And
When a command for converting the video communication screen into a 3D (3-Dimensional) video communication screen is input, the 3D video communication screen is formed by stereoscopicizing at least one of the first and second images, and the configured 3D video communication. And a controller which displays a screen on the display unit. The method according to claim 1,
The first image is any one of a user image and a substitute image of the portable terminal.
And the second image is one of a counterpart image and a substitute image of the counterpart terminal. The method according to claim 1,
The conversion command is a preset touch gesture to which a function for converting the video communication screen into the 3D video communication screen is assigned.
The display unit is a touch screen type,
The controller may be configured to convert the video communication screen into a 3D video communication screen when an input of the preset touch gesture is detected through the touch screen. The method according to claim 1,
Further comprising: a motion sensor for detecting the posture of the horizontal or vertical of the mobile terminal,
The controller may be configured to convert the video communication screen into a 3D video communication screen when the mobile terminal detects a posture corresponding to a horizontal or vertical position through the motion sensor. The method according to claim 1,
If the first and second images are both 2D (2-Dimensional) images, the controller generates a new image obtained by synthesizing the first and second images, and the left and right eye images of the newly synthesized image. The mobile terminal, characterized in that for configuring the 3D video communication screen. 6. The method of claim 5,
The controller may be configured to configure the 3D video communication screen by applying a preset depth value to the newly generated left and right eye images. 6. The method of claim 5,
The controller recognizes an object in the first image, obtains a depth value corresponding to a distance between the recognized object and the camera, and applies the acquired depth value to the newly generated left and right eye images. A portable terminal comprising a 3D video communication screen. The method according to claim 1,
The first image input from the camera is a 2D image,
The received second image is a 3D image including a left eye and a right eye image,
The controller generates a new left eye image obtained by combining the left eye image and the first image in the second image, generates a new right eye image obtained by synthesizing the right eye image and the first image in the second image. And a 3D video communication screen using the generated left and right eye images. The method of claim 8,
The controller may determine the depth value of the received second image and apply the depth value of the second image to the newly generated left and right eyes to configure the 3D video communication screen. Mobile terminal. The method according to claim 1,
The camera is provided with two or more for inputting left and right eyes for generating 3D images,
The first image is a 3D image input from the cameras,
The received second image is a 2D image,
The controller generates a new left eye image obtained by synthesizing the left eye image of the first image and the second image, generates a new right eye image obtained by synthesizing the right eye image and the second image in the first image, And a 3D video communication screen using the generated left and right eye images. The method of claim 10,
The controller may determine the depth value of the received second image and apply the depth value of the second image to the newly generated left and right eyes to configure the 3D video communication screen. Mobile terminal. The method according to claim 1,
The stereoscopic first and second images are portable terminals, wherein a corresponding depth value is adjustable according to a user's operation of the portable terminal. The method according to claim 1,
The controller, when one of the stereoscopic first and second images is selected, displays the selected image to be emphasized by applying a preset depth value. The method according to claim 1,
And a microphone through which a voice for the video communication is input from a user of the portable terminal.
The controller, when the 3D video communication screen is displayed, when the voice of the user of the portable terminal is input, the portable terminal characterized in that the display to be highlighted by applying a predetermined depth value to the first image. The method according to claim 1,
The controller may be configured to display the 3D video communication screen to be emphasized by applying a preset depth value to the second image when the voice for the video communication is received from the counterpart terminal through the wireless communication unit. A mobile terminal, characterized in that. The method according to claim 1,
The controller may be configured to transmit the stereoscopic first image to the counterpart terminal through the wireless communication unit. The method according to claim 1,
The controller may display a user interface (UI) for providing a 3D effect to at least one of the first and second images in the 3D video communication screen, and display the 3D effect set through the UI in the 3D video communication screen. And at least one of the first and second images. Establishing a video communication with at least one counterpart terminal;
Transmitting a first image input from at least one camera to the counterpart terminal;
Receiving a second image from the counterpart terminal;
Displaying a video communication screen including a first image input from the camera and a second image received from the counterpart terminal;
When the command for converting the video communication screen into a 3D (3-Dimensional) video communication screen is input, constructing the 3D video communication screen in which at least one of the first and second images is stereoscopic; And
And displaying the configured 3D video communication screen.

Images