KR20120076137A - Mobile terminal and method for controlling screen display thereof - Google Patents

Abstract

PURPOSE: A portable terminal and screen display control method thereof are provided to control screen display states according to rotation angles by recognizing the rotation angle of a portable terminal. CONSTITUTION: A memory unit stores preview images inputted through a camera. An analysis unit acquires the rotation information of a portable terminal(100) based on the change of the preview image. A control unit maintains the designated standard direction and displays content(11) displayed through a display screen(10) of the portable terminal based on the acquired terminal rotation information.

Description

Mobile terminal and method for controlling screen display

The present invention relates to a mobile terminal, and more particularly, to a method for controlling screen display in the mobile terminal.

A terminal such as a personal computer, a notebook computer, or a mobile phone has various functions, for example, a multimedia device having a complex function such as photographing or photographing of a moving picture, reproduction of music or a moving picture file, (Multimedia player).

The terminal can move It may be divided into a mobile terminal and a stationary terminal, depending on whether it is present. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

In order to support and enhance the functionality of the terminal, it is contemplated to improve the structural and / or software portion of the terminal.

According to the conventional terminal, the information displayed on the screen can be rotated only based on the 90 degree angle. In addition, in order to rotate the screen, a separate sensor (for example, a G sensor, a motion sensor, etc.) must be added, thereby increasing the manufacturing cost of the terminal.

The present invention generally provides a method for recognizing a rotation angle of a terminal and controlling a screen display to correspond to the same by using a camera included as an essential component of the terminal.

In another aspect, the present invention provides a method for displaying the display content on the screen as a fixed view image even if the terminal is rotated at any angle.

According to an aspect of the invention, the camera; A memory unit for storing a preview image input through the camera; An analyzer configured to acquire rotation information of the mobile terminal based on a change of the preview image input through the camera; And a controller configured to display the content displayed on the display screen of the mobile terminal while maintaining the predetermined reference direction based on the terminal rotation information obtained by the analyzer.

Here, the analysis unit may calculate the rotation angle of the terminal by comparing the preview image before and after each time the preview image input through the camera is sequentially stored in the memory unit.

Here, whenever the preview image input through the camera is sequentially stored in the memory unit, the analyzer may calculate the rotation angle of the terminal by comparing the first stored preview image and the preview image stored at the present time.

Here, the controller may allow the content displayed on the display screen to be rotated and displayed in a direction opposite to the rotation direction according to the calculated terminal rotation angle by an absolute value of the calculated terminal rotation angle.

The controller may control the operation of the camera to be activated when the mobile terminal enters the screen orientation maintaining mode.

Here, the predetermined reference direction may be a display direction of content displayed on the display screen when the mobile terminal enters the screen direction maintenance mode.

According to another aspect of the present invention, a method for controlling a screen display in a mobile terminal, the method comprising: storing a preview image input through a camera; Acquiring rotation information of the mobile terminal based on a change of a preview image input through the camera; And displaying the content displayed on the display screen of the mobile terminal on a screen while maintaining a predetermined reference direction based on the obtained terminal rotation information.

Further, according to another aspect of the present invention, a recording medium in which a program for executing the above-described screen display control method is recorded and can be read by a mobile terminal can be provided.

According to an exemplary embodiment of the present invention, a camera, which is generally included as an essential part of the terminal, may be used as it is to recognize the rotation angle of the terminal and control the screen display to correspond thereto.

In addition, according to an embodiment of the present invention, even if the terminal is rotated at any angle, the display contents displayed on the screen may be displayed to the user as a fixed (ie, forward) view image.

1 is a block diagram of a mobile terminal to which an embodiment of the present invention can be applied.
Figure 2 is a perspective view showing the appearance of a mobile terminal to which an embodiment of the present invention can be applied.
3 is a flow chart schematically showing a screen display control method according to an embodiment of the present invention.
4 is a diagram illustrating an example in which the screen display control method according to FIG. 3 is applied.

The present invention may be variously modified and have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail with reference to the accompanying drawings. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

In describing the present invention, when it is determined that the detailed description of the related known technology may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, numerals (eg, first, second, etc.) used in the description process of the present specification are merely identification symbols for distinguishing one component from another component.

In addition, in the present specification, when one component is referred to as "connected" or "connected" with another component, the one component may be directly connected or directly connected to the other component, but in particular It is to be understood that, unless there is an opposite substrate, it may be connected or connected via another component in the middle.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention. 2 is a perspective view showing the appearance of a mobile terminal to which an embodiment of the present invention can be applied.

The mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory unit 160, and an interface. The unit 170, the controller 180, and the power supply unit 190 may be included. The components shown in FIG. 1 are not essential and may implement a mobile terminal having more or fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory unit 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Near Field Communication (NFC) may be used.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the location information module is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates information about a distance of one point (object) away from three or more satellites, and information on a time at which the distance information is measured, and then calculates the calculated distance information. By applying the trigonometric method to, three-dimensional positional information according to latitude, longitude, and altitude of one point at a time can be calculated. Furthermore, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module 115 continuously calculates the current position in real time and uses the same to calculate speed information.

Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory unit 160 or transmitted to the outside through the wireless communication unit 110. The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 is a user interface for receiving various commands from a user, and its implementation is not particularly limited. For example, the input unit 130 may include a plurality of operation units (see 131 and 132 of FIG. 2) as shown in FIG. 2, and these operation units may include a key pad and a touch pad ( Static pressure / capacitance), wheel keys, jog switches and the like.

In particular, recently, the mobile terminal 100 generally uses a full touch method employing a touch screen method. In this case, the user input unit 130 is integrally combined with the display module 151 to be described later, thereby displaying a display screen. It may be implemented in a soft key method through the entire surface of the.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it may be responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

The output unit 150 is used to generate an output related to sight, hearing, or tactile sense, and may include a display unit 151, an audio output module 152, an alarm unit 153, a haptic module 154, and the like. have.

The display module 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays photographed and / or received images, a UI, and a GUI.

The display module 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. 3D display).

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is a transparent LCD. The rear structure of the display module 151 may also be of a light transmission type. With this structure, the user can see the object located behind the terminal body through the area occupied by the display module 151 of the terminal body.

According to an implementation form of the mobile terminal 100, two or more display modules 151 may exist. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

When the display module 151 and a sensor for detecting a touch motion (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter, abbreviated as “touch screen”), the display module 151 is an output device. It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display module 151 or capacitance generated at a specific portion of the display module 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure and directionality of the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display module 151 is touched or the like.

In this case, a proximity sensor may be disposed in the inner region of the mobile terminal or the vicinity of the touch screen covered by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using physical contact by using an electromagnetic force or infrared rays. Proximity sensors have a longer life and higher utilization than touch sensors.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, and a magnetic proximity sensor.

And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory unit 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 may output a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed by the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or audio signal may also be output through the display module 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may be used for the effects of stimulation by the arrangement of pins vertically moving with respect to the contact skin surface, the effect of the injection force of the air through the injection or inlet or the stimulation through the suction force, and the stimulation that rubs the skin surface. Various tactile effects may be generated, such as effects by stimulation through contact of electrodes, effects by stimulation using electrostatic force, and effects of reproducing a sense of warmth and heat using an endothermic or heat generating element.

The haptic module 154 may not only deliver a haptic effect through direct contact, but also implement a haptic effect through a muscle sense of a user's finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The memory unit 160 may store a program for the operation of the controller 180 and may store input / output data (eg, a phone book, a message, a still image, a video, etc.). The memory unit 160 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory unit 160 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory unit 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit 170 serves as a passage through which power from the cradle is supplied to the mobile terminal 100, or various command signals input from the cradle by a user. May be a passage that is delivered to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the memory unit 160 and executed by the controller 180.

In the above, the overall block diagram and appearance of the mobile terminal to which the present invention can be applied are described as an example. Hereinafter, screen display control in the mobile terminal according to an embodiment of the present invention will be described with reference to FIGS. The method will be described.

The present invention calculates the rotation angle of the terminal using a preview image input through the camera, and controls the screen display of the terminal based on the calculated rotation angle, even if the terminal rotates, the contents displayed on the terminal screen Should always remain in the forward direction. One embodiment of the specific method is as described below.

3 is a flowchart schematically illustrating a screen display control method according to an exemplary embodiment of the present invention, and FIG. 4 is a diagram illustrating an example in which the screen display control method according to FIG. 3 is applied.

In operation S310, the controller (refer to 180 in FIG. 1, as described below) determines whether the terminal is executing the screen orientation maintaining mode (ie, entering the screen orientation maintaining mode).

Here, the screen orientation maintaining mode refers to a mode that is set such that content displayed through the terminal screen always maintains a specified reference direction (hereinafter, simply referred to as a forward direction) even when the terminal rotates.

The screen orientation maintaining mode may be executed (or entered) by selection by the user. For example, when a user presses a specific key button (such as a mode conversion key) of the terminal or enters a UI screen prepared for mode conversion, touch a specific soft key provided on the screen to select a screen orientation mode. It can be implemented by entering. Alternatively, a specific pattern may be executed by a specific pattern of motion input, voice input, etc., in addition to input of a specific key (hereinafter, the specific key includes a soft key as well as a physical operation unit as a predetermined key).

In addition, entry into the screen orientation maintaining mode may be made even without receiving a clear command input from the user. For example, the case in which the user holds the terminal in a state where the user holds the terminal for more than a predetermined time (for example, 2 minutes or more) may be regarded as an intention to enter the screen direction maintenance mode. In other words, this may be the case where the user continues to search the Internet news for more than a predetermined time through the terminal screen while holding the terminal in the hand. Here, whether the terminal is held in the user's hand may be detected by the contact sensor or the proximity sensor.

In various ways as described above, when it is confirmed that the screen orientation maintaining mode is executed, the controller 180 controls the camera controller (not shown) to automatically turn on the camera (see 121 of FIG. 1). can be turned on. Here, the activation of the operation of the camera 121 may be desirable to be performed after the screen orientation maintaining mode is executed as described above in terms of battery consumption. However, the activation time of the camera operation is not necessarily the same as above. to be.

When entering the screen orientation maintenance mode, it is determined whether the preview image input through the camera 121 is rotated in step S320. Whether the preview image is rotated may be confirmed by, for example, the following method.

When entering the screen orientation maintaining mode, the preview image input through the camera 121 may be stored in the memory unit (see 160 of FIG. 1, hereinafter described above). In this case, the preview image may be deleted after the screen orientation maintaining mode is released while the terminal maintains the storage state while the terminal operates in the screen orientation maintaining mode. Alternatively, the device may be implemented to be updated or deleted at regular intervals even while operating in the screen orientation maintaining mode.

When the preview image input from the camera 121 is stored in the memory unit 160 as described above, the analyzer (not shown) checks the rotation information of the terminal based on the change of the stored preview image. That is, in the present invention, whether or not the rotation of the terminal is determined by analyzing whether the change occurs in the preview image sequentially input through the camera 121 through analysis of the preview image.

In other words, when the terminal rotates, the preview image input through the camera 121 is rotated at the same angle while having a direction opposite to the rotation direction of the terminal. That is, when the terminal is rotated in the clockwise direction, the preview image rotates in the counterclockwise direction. Thus, using this principle, by analyzing the change (ie, rotation) of the preview image, the direction in which the terminal is rotated (that is, the direction opposite to the direction in which the preview image is rotated) and the rotation angle can be calculated. .

In this case, the rotation information of the terminal may be the rotation angle of the terminal as described in the following description, but may also be information in which the rotation displacement amount and the rotation displacement amount every moment are combined. Here, as the rotational displacement amount, various displacements such as angular shift amount, distance displacement amount, speed / angular velocity displacement amount, etc. at each reference time point (for example, every 1 second or every storage time point of the preview image) may be used. However, hereinafter, the terminal rotation angle will be described.

However, at this time, the preview image input through the camera 121 is not displayed through the display screen. That is, in the following description, the preview image input through the camera 121 is not displayed through the display screen unlike when the general camera function is executed, and the input preview image is stored only in the memory unit 160. As a result, it is utilized only as basic information for controlling the screen display in the future.

When it is confirmed that the terminal is rotated (that is, when a change occurs in the preview image according to the analysis of the preview image), in step S330, the analyzer (not shown) calculates the terminal rotation angle according to the rotation of the terminal. The terminal rotation angle may be calculated by the following method.

As an example, the analysis unit (not shown) may calculate the rotation angle of the terminal by comparing the preview image before and after each time the preview image input through the camera 121 is sequentially stored in the memory unit 160. have.

For example, when a specific two-point pixel is designated in the previous and subsequent preview images to track or acquire coordinates in which data corresponding to the pixels moves in real time, the terminal may determine which one is based on the movement of the coordinates. Information (rotation angle information) regarding whether or not it has rotated to a degree can be calculated. Of course, various methods may be used as a method of calculating the terminal rotation angle.

Here, the terminal rotation angle includes an indicator that can measure the rotation direction, such as +5 degrees when rotated by 5 degrees clockwise from a predetermined reference position, and -5 degrees when rotated by 5 degrees counterclockwise. It can be calculated as a value.

In addition, the terminal rotation angle may be calculated as a final rotation angle changed from a predetermined reference position, but may also be an angular displacement amount changed between a previous time point and a subsequent time point. For example, after the screen orientation maintenance mode is executed, the rotation angle between the first stored preview image (called the preview image 1) and the next stored preview image (called the preview image 2) is -2 degrees. Assume that the rotation angle between the preview image 3 and the preview image 3 is -3 degrees. In this case, since the terminal rotation angle at the time when the preview image 3 is input is the same angle in the direction opposite to the rotation direction of the preview image, +5 degrees (that is, +2 degrees plus +3 degrees) (that is, Final rotation angle). Of course, when the latter (that is, the angle displacement calculation method), the terminal rotation angle may be calculated as +3 degrees, the angle displacement amount. Although it is irrelevant to either of the above methods, it will be described below assuming that the former (ie, the most recent rotation angle) for convenience of description.

In addition, although the above description has been mainly focused on comparing the previous and subsequent preview images as a method of calculating the terminal rotation angle, other methods may be used. For example, whenever the preview image input through the camera 121 is sequentially stored in the memory unit 160, the analysis unit calculates a current comparison time point (ie, a rotation angle) based on the preview image stored first. The rotation angle of the terminal may be calculated by comparing the preview image stored last.

An analysis unit (not shown) that performs the above-described function (terminal rotation angle calculation function) may be mounted in the terminal as a separate module (for example, an image processing / analyzing device). 180) may be implemented integrally.

When the terminal rotation angle is calculated by the above-described method or the like, in step S340, the controller 180 displays the screen display contents (i.e., the contents displayed on the display screen 10 in FIG. 4) based on the calculated terminal rotation angle. (Refer to 11 of FIG. 4) to control the screen display while maintaining a predetermined reference direction (i.e., forward direction).

The following method may be used as a method for ensuring that the content displayed through the display screen always has the positive direction regardless of the rotation of the terminal. For example, when the calculated terminal rotation angle is +4 degrees (that is, 4 degrees in the clockwise direction), the controller 180 determines that the content displayed on the display screen is the absolute value of the terminal rotation angle calculated before (ie, 4 degrees). FIG. 7) may be controlled to be rotated in a direction opposite to the rotation direction according to the terminal rotation angle (that is, counterclockwise) and displayed on the display screen. That is, the method of inversely correcting the display screen by the same rotation angle in the direction opposite to the terminal rotation direction is that.

Therefore, according to the screen display control method as described above, even if the terminal rotates from the initial position to another position, the user can maintain the content display direction of the content displayed on the terminal as seen from the initial position of the terminal. It will be recognized together. A specific example is shown through FIG. 4.

4 is a representation of a user viewing a Google web page using the mobile terminal 100. If (a) of FIG. 4 is the first screen when entering the screen orientation maintenance mode, as shown in (b) and (c) of FIG. 4, the display screen 10 may be used regardless of the rotation of the terminal. It can be seen that the display direction of the displayed content 11 remains the same as in FIG. 4A.

Therefore, according to the present invention, since the content direction displayed on the screen is fixed in a predetermined forward direction regardless of the posture change of the terminal, there is an advantage of minimizing the change in the gaze of the user.

Here, the forward direction as a reference for fixing the content direction may be determined as the display direction of the content displayed on the display screen (see FIG. 4A) when the terminal enters the screen direction maintenance mode. . Of course, depending on the need or setting, the direction according to other criteria may be determined as the positive direction.

In addition, as described above, in the process of fixing the content display direction, the controller 180 may reduce the size of the content to be displayed on the display screen. In general, the display screen is generally rectangular. As a result, the rotationally reversed screen cannot be matched with the display screen. Therefore, by reducing the size of the content screen to be displayed in the display screen, it may be necessary to display the display screen in accordance with the outside size of the display screen. Of course, even if the portion that does not match the display screen size at the time of rotation without reducing the content screen size is cut, the original magnification may be displayed as it is. That is, in the present invention, any of the above two methods may be employed.

Accordingly, the controller 180 may perform image processing on the original content, such as pixel coordinate transformation, for content screen size reduction or content display having a fixed direction (that is, forward direction).

The screen display control method as described above may be repeatedly performed until the screen direction maintenance mode is released (see step S350). Such repetition may be performed every predetermined time interval, every time a preview image is stored, or whenever a predetermined angle (eg, 1 degree) variation occurs.

Although the above has been described with reference to embodiments of the present invention, those skilled in the art may variously modify the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. And can be changed easily.

100: mobile terminal 121: camera
150: output unit 151: display module
160: memory unit 180: control unit

Claims (11)

camera;
A memory unit for storing a preview image input through the camera;
An analyzer configured to acquire rotation information of the mobile terminal based on a change of the preview image input through the camera; And
A controller configured to display the content displayed on the display screen of the mobile terminal while maintaining a predetermined reference direction based on the terminal rotation information obtained by the analyzer;
Mobile terminal comprising a.
The method of claim 1,
The analysis unit,
Whenever the preview image inputted through the camera is sequentially stored in the memory unit, the terminal rotation angle is calculated by comparing a preview image before and after.
The method of claim 1,
The analysis unit,
Whenever the preview image inputted through the camera is sequentially stored in the memory unit, the terminal rotation angle is calculated by comparing the first stored preview image with the preview image stored at the present time.
The method according to claim 2 or 3,
The control unit,
And display the content displayed on the display screen in a direction opposite to the rotation direction according to the calculated terminal rotation angle by an absolute value of the calculated terminal rotation angle.
The method of claim 1,
The control unit,
And controlling the camera to be activated when the mobile terminal enters a screen orientation maintaining mode.
The method of claim 1,
The predetermined reference direction is,
When the mobile terminal enters the screen direction maintenance mode, the mobile terminal, characterized in that the display direction of the content displayed on the display screen.
In the method for controlling the screen display in the mobile terminal,
Storing a preview image input through a camera;
Acquiring rotation information of the mobile terminal based on a change of a preview image input through the camera; And
Based on the obtained terminal rotation information, causing the content displayed on the display screen of the mobile terminal to be displayed on the screen while maintaining a predetermined reference direction;
Screen display control method comprising a.
The method of claim 7, wherein
Obtaining rotation information of the mobile terminal,
Whenever the preview image inputted through the camera is sequentially stored, the terminal rotation angle is calculated by comparing previous and subsequent preview images.
The method of claim 7, wherein
Obtaining rotation information of the mobile terminal,
Whenever the preview image inputted through the camera is sequentially stored, the rotation angle of the terminal is calculated by comparing the first stored preview image with the preview image stored at the current time point.
The method of claim 7, wherein
The step of causing the content displayed on the display screen of the mobile terminal to be displayed on the screen while maintaining a predetermined reference direction,
And displaying the content displayed on the display screen in a direction opposite to the rotation direction according to the terminal rotation angle by an absolute value of the terminal rotation angle of the mobile terminal.
A recording medium on which a program for executing the screen display control method according to any one of claims 7 to 10 is recorded and can be read by a mobile terminal.

Images