KR20230139748A - Electronic device with flexible dispaly - Google Patents

Abstract

A portable electronic device comprising: a first housing; a second housing arranged to be slidably driven relative to the first housing; a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing; a motor that generates a driving force to slide the second housing; a driving circuit for driving the motor; and a processor. The processor sets the display area of the flexible display as an active area for displaying visual information, and while displaying an application execution screen in the active area in a slide-out state, a slide-in trigger for shrinking the active area is generated. Based on this, it is possible to recognize that a consistency problem has occurred in the application execution screen when changing from the slide-out state to the slide-in state, and to expand the active area based on the consistency problem. A user interface can be provided to do so.

Description

Electronic device having a flexible display {ELECTRONIC DEVICE WITH FLEXIBLE DISPALY}

Various embodiments relate to an electronic device having a flexible display and a sliding structure that can change an active area in which visual information is displayed.

The electronic device may have a sliding structure that allows a portion of the display to be moved from the front of the electronic device to the internal space (or rear) of the electronic device. For example, an electronic device may include a slideable housing including a housing and a slider, a roller that allows a portion of the slider to be retracted into or out of the housing, and a flexible display.

The sliding structure of the electronic device may be configured to move and arrange a portion of the display into the internal space of the electronic device formed by the slideable housing while a portion of the slider is slid into the housing. Alternatively, the sliding structure may be configured to move a portion of the display toward the rear of the electronic device through the side of the electronic device in a slide-in state. When a portion of the slider is changed to a slide-out state in which a portion of the slider is pulled out from the housing, a portion of the display that was moved toward the rear may be moved and disposed to the front of the electronic device.

An electronic device may display visual information by activating only a portion of the display. For example, the active area in which visual information will be displayed can be virtually the entire area of the display when in a slide-out state. As the state changes from the slide-out state to the slide-in state, part of the display can move into the internal space or move to the side and back. The rest, excluding the part moved to the internal space (or the back), may be determined as the active area.

As the slider slides toward the housing, the activation area may shrink and as the slider slides away from the housing, the activation area may expand.

As the size of the active area of the display is expanded or reduced, the electronic device may change the layout (or arrangement) of visual information (e.g., an execution screen of an application) to be displayed in the active area. For example, the spacing between UI (user interface) elements (or views) as components constituting visual information may widen and narrow as the size of the active area expands and shrinks. If the screen continues to shrink, UI elements on the screen may overlap each other or some of the UI elements may go beyond the screen, causing consistency (or readability) problems that make it difficult to clearly see the content of the visual information.

In various embodiments, an electronic device may enable a user to clearly recognize the contents of visual information by preventing consistency problems from occurring when the configuration of visual information is changed. The technical problem to be achieved in the present disclosure is not limited to the technical problem mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description below. There will be.

According to one embodiment, a portable electronic device includes: a first housing; a second housing arranged to be slidably driven relative to the first housing; a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing; a motor that generates a driving force to slide the second housing; a driving circuit for driving the motor; Memory for storing instructions; and at least one processor operably connected to the driving circuit, the flexible display, and the memory. The at least one processor may set the display area of the flexible display as an active area that displays visual information. The at least one processor may recognize that a slide-in trigger for shrinking the active area has occurred while displaying an application execution screen in the active area in a slide-out state. The at least one processor may identify whether a consistency problem occurs in the application execution screen when changing from the slide-out state to the slide-in state, based on the occurrence of the slide-in trigger. The at least one processor may provide a user interface that allows expansion of the active area when the consistency problem occurs.

According to one embodiment, a portable electronic device includes a first housing; a second housing arranged to be slidably driven relative to the first housing; a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing; a motor that generates a driving force to slide the second housing; a driving circuit for driving the motor; Memory for storing instructions; and at least one processor operably connected to the driving circuit, the flexible display, and the memory. The at least one processor may set the display area of the flexible display as an active area. The at least one processor may set a part of the activation area as an app window area for displaying the application execution screen. The at least one processor may recognize that a slide-in trigger for shrinking the active area has occurred while displaying an application execution screen in the app window area in the slide-out state. Based on the occurrence of the slide-in trigger, the at least one processor may control the driving circuit to reduce the activation area and change the layout of the application execution screen. The at least one processor may recognize that a consistency problem has occurred in the layout-changed application execution screen in which some UI elements are not visible in the app window area designated for displaying the application execution screen. The at least one processor, based on recognizing the occurrence of the consistency problem, removes another area of the active area and expands the app window area to the location where the other area was, thereby making a part of the UI element visible. You can.

According to one embodiment, a portable electronic device includes a first housing; a second housing arranged to be slidably driven relative to the first housing; a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing; a motor that generates a driving force to slide the second housing; a driving circuit for driving the motor; Memory for storing instructions; and at least one processor operably connected to the driving circuit, the flexible display, and the memory. The at least one processor may set part or all of the activation area as an app window area for displaying the application execution screen. The at least one processor may recognize that a slide-in trigger for shrinking the active area has occurred while displaying an application execution screen in the app window area in the slide-out state. Based on the occurrence of the slide-in trigger, the at least one processor may control the driving circuit to reduce the activation area and change the layout of the application execution screen. The at least one processor may recognize that a consistency problem has occurred in the layout-changed application execution screen in which some UI elements are not visible in the app window area designated for displaying the application execution screen. Based on recognition of the occurrence of the consistency problem, the at least one processor may be set to a layer higher than the app window area and remove another area that obscures part of the UI element or increase transparency of the other area. .

According to one embodiment, a portable electronic device includes a first housing; a second housing arranged to be slidably driven relative to the first housing; a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing; a motor that generates a driving force to slide the second housing; a driving circuit for driving the motor; Memory for storing instructions; and at least one processor operably connected to the driving circuit, the flexible display, and the memory. The at least one processor may set part or all of the activation area as an app window area for displaying the application execution screen. The at least one processor may recognize that a slide-in trigger for shrinking the active area has occurred while displaying an application execution screen in the app window area in the slide-out state. The at least one processor may confirm that a consistency problem occurs in the application execution screen when changing the layout of the application execution screen to the first layout to match the size of the activated area reduced in response to the slide-in trigger. there is. The at least one processor may change the layout of the application execution screen to a second layout that does not have a consistency problem. The at least one processor may reduce the size of the application execution screen changed to the second layout to fit the size of the reduced activation area and display it on the reduced activation area.

Various embodiments may provide an electronic device configured so that a consistency problem does not occur in an active area when the configuration of visual information is changed. In addition, various effects that can be directly or indirectly identified through this document may be provided.

1 is a block diagram of an electronic device in a network environment, according to various embodiments.
2A and 2B illustrate a portable electronic device with a sliding structure, according to one embodiment.
3A and 3B illustrate a portable electronic device with a sliding structure, according to one embodiment.
4A, 4B, and 4C illustrate a portable electronic device with a sliding structure, according to one embodiment.
Figure 5 shows an example of classification of active areas of an electronic device.
FIGS. 6A, 6B, and 6C illustrate cases where a consistency problem occurs when an electronic device switches from a slide-out state to a slide-in state.
FIG. 7 illustrates an electrical block configuration of an electronic device having a sliding structure according to various embodiments.
FIG. 8 is a diagram for explaining processor operations for determining whether a consistency problem occurs, according to an embodiment.
FIGS. 9A, 9B, and 9C are screen examples for explaining processor operations for solving a consistency problem, according to an embodiment.
FIG. 10 is an example screen diagram for explaining the operation of a processor to set whether to solve a consistency problem, according to an embodiment.
FIGS. 11A, 11B, 11C, and 11D are screen examples for explaining processor operations for solving the consistency problem without expanding the active area, according to an embodiment.
FIG. 12 is a flowchart illustrating processor operations for solving a consistency problem, according to an embodiment.
FIG. 13 is a flowchart illustrating processor operations for solving a consistency problem, according to an embodiment.
FIG. 14 is a flowchart illustrating processor operations for solving the consistency problem without expanding the active area, according to an embodiment.
FIGS. 15A, 15B, and 15C are screen examples for explaining operations of the processor 799 for solving the consistency problem without expanding the active area, according to one embodiment.

1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments. Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores instructions or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes the main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, co-processor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 may be a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 to communicate within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for the communication method used in the communication network, such as the first network 198 or the second network 199, is connected to the plurality of antennas by, for example, the communication module 190. can be selected Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 must perform a function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of performing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one element from another, and may be used to distinguish such elements in other respects, such as importance or order) is not limited. One (e.g. first) component is said to be "coupled" or "connected" to another (e.g. second) component, with or without the terms "functionally" or "communicatively". Where mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. According to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term refers to cases where data is semi-permanently stored in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or via an application store (e.g. Play Store ^TM ) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

Hereinafter, for convenience of explanation, the side of the display visually exposed to the user may be referred to as the front of the electronic device 101. And, the side opposite to the front may be referred to as the back of the electronic device 101. Additionally, the surface surrounding the space between the front and back may be referred to as the side of the electronic device 101. The term “state” may refer to the structural form, posture, shape, or configuration of the electronic device 101 (or the display, slider, or housing that makes up the electronic device 101). there is.

Various sliding structures can be applied to the electronic device 101. According to one embodiment, the electronic device 101 is a slideable housing including a housing (or first housing) and a slider (or second housing), so that the slider is inserted into the housing and the slider is pulled out from the housing. It may include a roller and a flexible display. The slider can be divided into a part that can enter the inside of the housing (hereinafter referred to as an inlet part) and a part that remains exposed to the outside. A slide-out state in which the inlet part of the slider is completely withdrawn from the housing (in other words, first state, open state, extended state, roll-out state) In this case, the entire display (or most of the display area) may be exposed to the outside through the front. As the insertion portion of the slider is retracted into the housing, the display can also be retracted into the housing. The display also has a part that remains exposed to the outside (e.g., first display area, first section) and a part that can enter the inside of the housing (e.g., second display area, second section, bendable section). ) can be divided into: Slide-in state in which the entire inlet part of the slider is inserted into the housing (in other words, second state, closed state, reduced state, roll-in) state), the entire second display area of the display may be retracted into the housing. As another example, when changing the state from the slide-out state to the slide-in state, a part of the display (e.g., the second display area) may not be retracted into the housing, but may be moved to the rear via the side. As illustrated above, the electronic device 101 may have a sliding structure in which a portion of the display is retracted into the housing, or a sliding structure in which a portion of the display is moved from the front to the back. In the display, only the portion exposed through the front can be determined as the active area to display visual information. A portion that is introduced into the housing or moved to the rear may be determined as a deactivated area.

The electronic device 101 may have a sliding structure different from that illustrated previously. According to one embodiment, the electronic device 101 includes a housing, a roller disposed inside the housing, and a flexible (or rollable) display that is drawn into the housing by being wound around the roller or pulled out of the housing by being unwound from the roller. can do. Even if the display is wound around the roller, a part of the display (eg, the first display area) may remain exposed to the outside. According to one embodiment, the entire display area may be retracted into the housing.

2A and 2B illustrate a portable electronic device 200 having a sliding structure, according to one embodiment. 2A and 2B, the portable electronic device 200 (e.g., the electronic device 101 of FIG. 1) has a housing (or first housing) 210, and is driven to slide with respect to the first housing 210. A slider (or second housing) 220 arranged to be so arranged, a flexible display 230 whose display area is reduced or expanded based on the slide-in or slide-out operation of the slider 220, and a portable electronic device 200 ) It may include a motor disposed in the internal space and generating a driving force for driving the slider 220, and a driving circuit disposed in the internal space of the portable electronic device 200 and driving the motor.

The slider 220 may be coupled to the housing 210 to enable sliding. The motor may be placed in the interior space of the slider 220. A roller rotating by the driving force of the motor may be placed in the inner space of the slider 220. The roller does not necessarily have to roll (rotate), and may serve to mechanically guide the display when it is wound or unwound. The display 230 includes a first display area 231 disposed adjacent to the housing 210 and visually exposed through the front of the electronic device 200, and a second display area 232 retractable into the internal space. can do. The second display area 232 may enter the inside of the slider 220 and be wrapped around a roller when the slider 220 slides toward the housing 210. The second display area 232 is released from the roller when the slider 220 is slid in a direction away from the housing 210 (e.g., -y-axis direction as shown in FIG. 2A) and covers the front of the electronic device 200. It can be visually exposed through

According to one embodiment, the state of the electronic device 200 may be defined based on the rotation angle of the roller (e.g., the angle at which the roller is rotated in the direction in which the display 230 is released from the roller (e.g., clockwise)). . For example, when the rotation angle of the roller exceeds the first threshold, the state of the electronic device 200 is such that only the first display area 231 of the display 230 is exposed (or the second display area 232). It can be defined as a slide-in state (placed in this internal space). When the rotation angle of the roller exceeds the second threshold value greater than the first threshold value, the state of the electronic device 200 changes to the entire display 230 (e.g., the first display area 231 and the second display area ( 232)) can be defined as an exposed slide-out state. The second display area 232 may be maintained in a partially exposed (or partially hidden) partially slide-in state (in other words, a third state, a partial slide-out state, or an intermediate state). there is.

According to one embodiment, the state of the electronic device 200 may be defined based on the curvature (degree of bending) of a designated portion of the display 230. For example, if the curvature of the second display area 232 corresponds to a value (or within a range) indicating concave (or convex), the state of the electronic device 200 may be defined as a slide-in state. . When the curvature of the second display area 232 corresponds to a value (or within a range) indicating flatness, the state of the electronic device 200 may be defined as a slide-out state.

Based on the state of the electronic device 200, an active area on the display 230 in which visual information (eg, navigation bar, status bar, application execution screen) will be displayed may be determined. For example, when the electronic device 200 is in a slide-in state, the active area is determined to be the first display area 231, and visual information may be displayed in the first display area 231 accordingly. When the electronic device 200 is in a slide-out state, the active area is determined to be the entire area of the display 230 (e.g., the first display area 231 and the second display area 232), and accordingly, the entire area is visually Information may be displayed.

3A and 3B illustrate a portable electronic device 300 having a sliding structure, according to one embodiment. In describing the portable electronic device 300, configurations, functions, and/or structures that overlap with those of FIG. 2 are briefly described or omitted. 3A and 3B, the portable electronic device 300 (e.g., the electronic device 101 of FIG. 1) is formed by a housing 310, a slider 320, and slideable housings 310 and 320. It may include a flexible display 330 arranged in the space. The display 330 includes a first display area 331 disposed adjacent to the housing 310 and visually exposed through the front of the electronic device 300, and a second display area 332 disposed in the internal space. It can be included. The second display area 332 is visually exposed through the front of the electronic device 200 as the slider 320 slides in a direction away from the housing 310 (e.g., in the x-axis direction as shown in FIG. 3A). It can be.

4A, 4B, and 4C illustrate a portable electronic device 400 with a sliding structure, according to one embodiment. Referring to FIGS. 4A, 4B, and 4C, the portable electronic device 400 (e.g., the electronic device 101 of FIG. 1) includes a housing 410, a ruler (not shown) disposed inside the housing 410, and It may include a flexible (or rollable) display 420. The display 420 may be released from the ruler and exposed to the outside of the housing 410, or may be wound around a roller and entered into the housing 410.

According to one embodiment, the state of the electronic device 400 based on the rotation angle of the roller in the housing 410 (e.g., the angle by which the roller is rotated in the direction in which the display 420 is released from the roller (e.g., clockwise)) can be defined. For example, when the rotation angle A of the roller in the housing 410 exceeds the first threshold, the state of the electronic device 400 is a first partially unlocked state indicating that the display 420 is partially unlocked. (e.g., the reduced state or the slide-in state). When the rotation angle B of the roller exceeds the second threshold value greater than the first threshold value, the state of the electronic device 400 indicates that the display 420 is more unlocked than when it is in the first partially unlocked state. It may be defined as a second partial release state (e.g., partial expansion state, partial slide-out state). When the rotation angle C of the roller exceeds a third threshold value that is greater than the second threshold value, the state of the electronic device 400 is more unlocked than in the second partially unlocked state (or display 420 It may be defined as a fully released state (e.g., the extended state or the slide-out state) indicating that the entire state is completely released.

According to one embodiment, the state of the electronic device 400 may be defined based on the curvature (degree of bending) of a designated portion of the display 420. For example, in the display 420, a first part 421, a second part 422, and a third part 423 for determining the state may be designated. As shown, portions parallel to the rotation axis of the display 420 may be set as the portions 421, 422, and 423. When the curvature of the first part 421 corresponds to a value (or within a range) indicating flatness and the curvature of the other parts 422 and 423 corresponds to a value (or within a range) indicating concave (or convexity) , the state of the electronic device 400 may be defined as a first partially unlocked state. The curvature of the first part 421 and the second part 422 corresponds to a value (or within a range) indicating that it is flat, and the curvature of the third part 423 corresponds to a value (or within a range) indicating that it is concave (or convex). ), the state of the electronic device 400 may be defined as a second partially unlocked state. If the curvatures of the designated parts 421, 422, and 423 all correspond to values (or within a range) indicating flatness, the state of the electronic device 400 may be defined as a fully unlocked state.

Based on the state of the electronic device 400, an active area may be determined on the display 420. For example, when the electronic device 400 is determined to be in a first partially unlocked state, the active area may be determined to be the first display area 431. When the electronic device 400 is determined to be in the second partially unlocked state, the active area may be determined to be the first display area 431 and the second display area 432 extending therefrom. When the electronic device 400 is determined to be in a fully unlocked state, the first display area 431, the second display area 432, and the third display area 433 extending from the second display area 432 (e.g. The entire display 420 may be determined as an active area.

In addition to the methods described above, the state of the electronic device 200 can be defined by identifying the size of the active area of the display exposed to the front through a state detection sensor, where the state detection sensor detects the amount of light according to the sliding of the slider. A sensor capable of detecting at least one of a change in value, a change in capacitance sensing value, a change in magnetic force or magnetic flux sensing value, a change in resistance sensing value, a change in pressure sensing value, and a change in rotation angle sensing value. means, and representative sensors will be described later.

Figure 5 shows an example of classification of the active area 500 of an electronic device.

Referring to Figure 5, the activation area is a first area (or top area) 510, a second area (or middle area) 520, and a third area (or , bottom area) (530). Information indicating the operating state of the electronic device (e.g., time, network connection status, remaining battery level, notification icon) may be provided through the first area (e.g., status bar) 510. A screen of a running foreground application may be provided through the second area (e.g., app window area) 520. One or more UI elements for navigation between execution screens may be provided through the third area (eg, navigation bar) 530. The navigation bar is a user interface that allows you to move to the screen of a background application and may be composed of, for example, a button to move to a recently used app, a button to move to the home screen, and a button to move to the previous screen. The foreground application may refer to an application whose execution screen is currently displayed on the display among running applications. A background application may refer to an application that is running but whose execution screen is not displayed on the display.

Area division is not limited to the case of FIG. 5. For example, the activation area 500 is divided into a second area 520 and a third area 530 without the first area 510, or into a first area 510 and a second area without the third area 530. It may also be classified as (530). Alternatively, the processor (e.g., processor 120 of FIG. 1) may use the entire activation area 500 or the second area 520 and the third area 530 (or the first area 510 and the first area 500) without distinguishing areas. Area 2 (520) can be set as an app window area for displaying the application execution screen, and the application execution screen can be displayed in the set app window area. The processor sets the entire activation area 500 as an app window area, sets the first area 520 as an area for displaying the status bar, and sets the third area 530 as an area for displaying the navigation bar. In the order of operations, the navigation bar and status bar can be designated as a higher layer than the application execution screen. Accordingly, the portion of the execution screen located beyond the second area 520 and located in the third area 530 may be covered by the navigation bar. A portion located in the first area 530 outside the second area 520 may also be obscured by the status bar. In addition to the top and bottom of the screen, a separate area may be located on the side.

FIGS. 6A, 6B, and 6C illustrate cases where a consistency problem occurs when an electronic device switches from a slide-out state to a slide-in state.

The layout of the application execution screen (e.g., size of UI elements, size of content within UI elements, and/or position of UI elements) may change according to changes in the size of the activation area. For example, as the activation area is reduced, the spacing between UI elements may be narrowed. If it continues to shrink (e.g. when the electronic device is in a slide-in state), consistency problems may occur. Referring to FIG. 6A, the arrangement of UI elements 611, 612, and 613 may be optimized and displayed in a slide-out state. When the electronic device switches from the slide-out state to the slide-in state, the first UI element 611 is located below the second UI element 612, so it may be difficult to clearly see what the content of the first UI element 611 is. there is. Referring to FIG. 6B , when the electronic device switches from the slide-out state to the slide-in state, a part of the UI element 621 moves out of the app window area 622, and accordingly, the contents of the UI element 621 may not be visible. Referring to FIG. 6C, when the electronic device switches from the slide-out state to the slide-in state, new UI elements 631 and 632 are provided through the app window area and may overlap each other.

FIG. 7 illustrates an electrical block configuration of an electronic device 700 having a sliding structure according to various embodiments. The electronic device 700 (e.g., the electronic device 101 in FIG. 1) changes the layout of the application execution screen as the activation area of the display changes (its size is enlarged or reduced) and changes the layout of the application execution screen to the activation area. Can be configured to provide through the app window area. If a consistency problem occurs in an application execution screen with a changed layout, the electronic device 700 may be configured to enlarge the size of the active area to solve the consistency problem. Referring to FIG. 7 , the electronic device 700 may include a touch-sensitive display 710, a state detection sensor 720, a motor driving circuit 730, a memory 788, and a processor 799. .

The display 710 may be divided into a first display area 711 and a second display area 712. For example, the first display area 711 is a part that is visually exposed through the front of the electronic device 700, and the second display area 712 is drawn into the inside of the electronic device 700 or moves to the back. It may be a part that is placed. As another example, both the first display area 711 and the second display area 712 can be introduced into the electronic device 700, but the first display area 711 is introduced before the second display area 712, The activation area in which visual information will be displayed may be a designated minimum area (eg, the first display area 431 in FIG. 4). The activation area may be determined as a portion of the display 710 that is visually exposed to the user. For example, the activation area includes the first display area 711, the first display area 711, and the second display area 711, depending on the state of the electronic device 700 (e.g., slide-in state, slide-out state, intermediate state). It may be determined as a portion of the display area 712 or the entire display 710 (eg, the first display area 711 and the second display area 712).

The state detection sensor 720 (e.g., the sensor module 176 in FIG. 1) recognizes the state (e.g., slide-in state, slide-out state, intermediate state) of the electronic device 700 and selects an activation area in which visual information will be displayed. Can generate data used to determine. For example, the state detection sensor 720 is a sensor (e.g., attached to the roller) that generates and outputs data corresponding to the rotation angle when the roller rotates due to force transmitted from the motor or force transmitted from the user through the slider. : Encoder, Hall sensor)) may be included. As another example, the status detection sensor 720 is disposed in a designated part of the display 710 (e.g., the second display area 232 in FIG. 2 or the second display area 332 in FIG. 3) and detects the curvature of the corresponding part. It may also include a sensor (e.g., a pressure sensor) that generates corresponding data.

According to one embodiment, the motor driving circuit 730 may rotate the roller by driving a motor disposed inside the electronic device 700 under the control of the processor 799. By rotating the roller, the inlet portion of the slider may enter or be withdrawn from the inside of the housing. For example, the processor 799 may respond to user input to a button for state transition (e.g., a button disposed on the side of the electronic device 700, a button displayed on the display 710) or to resolve a consistency problem. For this purpose, the motor driving circuit 730 can be controlled to perform state transition. The motor driving circuit 730 may rotate the roller under the control of the processor 799 to change the electronic device 500 from a slide-in state to a slide-out state or vice versa.

The electronic device 700 may further include a haptic module 740 (eg, the haptic module 179 in FIG. 1). The instructions may cause the processor 799 to: perform an operation to notify the user that there is a consistency problem using the haptic module 740 as a tactile means in addition to a visual notification using the display 710.

The portable electronic device 700 may further include a sound output module 750 (eg, the sound output module 155 of FIG. 1). The instructions may cause the processor 799 to perform an operation that notifies the user that there is a consistency problem, using the sound output module 750 as an auditory means. The instructions may cause processor 499 to perform notification using a combination of two or more of: visual, auditory, and tactile means.

Memory 788 may store visual information to be displayed in the active area. For example, visual information may include background elements and user interface (UI) elements (in other words, user experience (UX) elements, foreground elements, or views). . UI elements are graphic elements that enable interaction between the electronic device 500 and the user, for example, videos, images, guides related to changes in the size of the active area (e.g., visual cue), active area. May include guides, text, thumbnails, emoticons, icons, keypads, buttons, or menus related to the extension. UI elements can be operatively linked to specific functionality. Accordingly, the processor 799 may execute a function connected to the UI element in response to the user's touch input on the UI element. The background element is a graphic element that is unrelated to the interaction between the electronic device 700 and the user and is not connected to a specific function and may include, for example, a background image or text. Visual information may include an application execution screen composed of a plurality of UI elements. For example, an application stored in the memory 788 (e.g., the application 146 in FIG. 1) may provide UI elements constituting the application execution screen to the processor 799.

The memory 788 may store layout information used to configure visual information to be displayed in the active area. For example, the application stored in the memory 788 (e.g., the application 146 in FIG. 1) has the size of each UI element on the application execution screen and the size of the content included in the UI element (e.g., font size, amount of text). , and a resource file (e.g., xml file) containing layout information used to determine the position of UI elements may be provided to the processor 799. When the electronic device 700 is in a slide-out state, the application may provide the processor 799 with first layout information optimized for the aspect ratio (ratio of height to width) of the active area (or app window area). The application may provide second layout information optimized for the aspect ratio of the active area (or app window area) to the processor 799 when the electronic device 700 is in a slide-in state. The processor 799 may configure an application execution screen based on the layout information and display it in the activation area (or app window area).

The processor 799 (eg, processor 120 of FIG. 1) may be configured to perform operations stored as instructions in the memory 788. The operations of processor 799 are described in detail below.

The processor 799 recognizes changes in the state of the electronic device 700 based on data received from the state detection sensor 720, and is activated in response to the change in the state of the electronic device 700 in real time or hysteresis. You can expand or contract the area. As an example of a real-time response, the processor 799 recognizes a portion that is exposed to the outside (or moves to the front) in the second display area 712, and selects the active area from the first display area 711 to the second display area. It can be expanded to the exposed portion of the display area 712. When the entire second display area 712 is exposed (or moves to the front), the processor 799 changes the activation area from the first display area 711 to the entire area of the display 710 (the first display area 712). It can be expanded to the display area 711 and the second display area 712. The processor 799 may recognize a part of the second display area 712 that enters the internal space (or moves to the rear) and exclude the recognized part from the activation area. The processor 799 may exclude the entire second display area 712 from the activation area when the entire second display area 712 enters the internal space (or moves to the rear). As an example of a hysteresis response, when the entire second display area 712 is exposed, the processor 799 changes the active area from the first display area 711 to the entire area of the display 710 (first display area 711 ) and the second display area 712).

When the electronic device 700 is in a slide-out state, the processor 799 determines the size of each UI element of the application execution screen and the position on the app window based on layout information (e.g., first layout information) and determines the position of the app window. It can be displayed in the area. When reducing the activation area, the processor 799 changes the layout of the application execution screen (e.g., the size of the UI element, the size of the contents within the UI element, and/or the position of the UI element) and places the application execution screen with the changed layout in the app window area. It can be displayed in . The processor 799 may determine whether a consistency problem has occurred based on the results of the layout change. According to one embodiment, while the electronic device 700 is in a slide-in state or an intermediate state, the processor 799 determines whether there is a consistency problem in the execution screen based on the layout information of the application execution screen provided through the app window area. You can judge whether or not. For example, the processor 799 may determine that UI elements overlap each other as a consistency problem. The processor 799 may determine that at least some of the UI elements are not included in the app window area and are therefore not visible to the user as a consistency problem.

FIG. 8 is a diagram for explaining operations of the processor 799 for determining whether a consistency problem occurs, according to an embodiment.

Referring to FIG. 8, the application 810 may provide layout information optimized for the execution screen and slide-out state to the processor 799. The processor 799 may obtain the first text 821 from the execution screen received from the application 810 and store it in the memory 788. While in the slide-out state, the processor 799 can determine the size and position of each UI element on the application execution screen and the location on the app window based on the layout information received from the application 810 and display them in the app window area. When reducing the activation area, the processor 799 changes the layout of the application execution screen (e.g., the size of the UI element, the size of the contents within the UI element, and/or the position of the UI element) and places the application execution screen with the changed layout in the app window area. It can be displayed in . When the size of the active area changes in a direction to decrease, the processor 799 can capture the app window area and generate a screenshot image 830. The processor 799 may extract the second text 822 by performing character recognition 840 using an artificial intelligence model generated through OCR (optical character recognition) or machine learning on the screen shot image 830. . The processor 799 may store the second text 822 in the memory 788. The processor 799 may compare the first text 821 and the second text 822 (850) and determine whether there is a consistency problem in the execution screen based on the result. For example, the processor 799 may determine that a discrepancy between the two texts 821 and 822 is a consistency problem. Alternatively, the processor 799 may determine that there is a consistency problem in the execution screen when the matching rate between the two texts 821 and 822 is below a predetermined standard value.

If it is determined that the execution screen displayed in the app window area has a consistency problem, the processor 799 may perform an operation to solve the consistency problem. According to one embodiment, the activation area may be automatically expanded. For example, the processor 799 may control the motor driving circuit 730 to increase the activation area by one step by a specified size and then perform a consistency check as illustrated above. If there is still a consistency problem, the processor 799 may increase the activation area by one step. If there is no problem with consistency, the processor 799 stores the aspect ratio setting value indicating the size of the active area in the memory 388 and uses this value in a later operation to ensure that there is no consistency problem. For example, when a slide-in trigger for zooming out of the active area occurs (e.g., when a user input for a zooming out button disposed on the side of the electronic device 700 is received), the processor 799 may use the stored aspect ratio setting value. By controlling the motor driving circuit 730, it is possible to ensure that there is no problem with consistency in the execution screen.

FIGS. 9A, 9B, and 9C are screen examples for explaining operations of the processor 799 for solving the consistency problem, according to one embodiment.

Referring to FIGS. 9A to 9C , the processor 799 may provide a user interface to the app window area 910 to enable expansion of the active area when a consistency problem occurs. According to one embodiment, the processor 799 may display a selection item in the app window area 910 that allows the user to select whether to expand the activation area. For example, the processor 799 may display the expansion button 920 of FIG. 9A including an arrow pointing outward from the active area in the app window area 910. Processor 799 may display aspect ratio selection menu 930 of FIG. 9B in app window area 910 indicating one or more aspect ratios of the active area to be expanded. In the aspect ratio selection menu 930, the aspect ratio may be prepared based on the aspect ratio setting value stored in the memory 388. The processor 399 recognizes that there is a problem with the consistency of the execution screen and creates a pop-up window 940 of FIG. 9C in the app window area 910 to allow the user to select whether to expand the activation area to solve the problem. It can also be displayed.

If there is no user input for the selection items 920, 930, 940 for a specified time after the selection items 920, 930, 940 are displayed, the processor 799 does not expand the activation area and selects the selection items 920, 930, 940) can be removed from the app window area 910. Alternatively, the processor 799 may provide a user input requesting removal of the selection items 920, 930, and 940 (e.g., a touch gesture that pushes the selection items 920, 930 to the side, a cancel button in the pop-up window 940). In response to the user's selection) being received through the display 788, the selection items 920, 930, and 940 may be removed from the app window area 910 without expanding the activation area.

FIG. 10 is an example screen diagram for explaining the operation of the processor 799 for setting whether to solve the consistency problem, according to one embodiment.

Referring to FIG. 10 , the processor 799 may execute an application for setting up the electronic device 700 and display a setting screen in the app window area. For example, when an item with the title 'consistency expansion mode' is selected by the user, the processor 799 provides a setting item 1010 that allows the user to set whether to expand the activation area to solve a consistency problem when it occurs. A settings screen including a settings item 1020 that allows the user to select whether to automatically resolve consistency when selected to be used may be displayed in the app window area. When ‘Affordance’ is selected in the setting item 1020, the processor 799 may display the selection items 920, 930, and 940 when a consistency problem occurs.

FIGS. 11A, 11B, 11C, and 11D are screen examples for explaining operations of the processor 799 for solving the consistency problem without expanding the active area, according to an embodiment.

Referring to FIG. 11A , as a result of the layout change, a consistency problem may occur in which at least part of the UI element 1110 is not visible in the app window area 1120. For example, at least a portion of the UI element 1110 exceeds the boundary of the app window area 1120 (e.g., a border in contact with the navigation bar 1130) and is not included in the app window area 1120 or is not included in the app window area 1120. A consistency problem may occur where the area is obscured by another area (e.g., navigation bar 1130) set to a higher layer than 1120.

According to one embodiment, the processor 799 removes the navigation bar 1130 from the active area and extends the app window area 1120 to the area where the navigation bar 1130 was, so that the UI element 1110 is clearly visible. can do. In the case where the UI element 1110 is obscured by the navigation bar 1130 as a result of the navigation bar 1130 being set to a higher layer than the app window area 1120, the processor 799 moves the navigation bar 1130 into the active area. By removing it from , the UI element 1110 can be clearly visible. Instead of removing the navigation bar 1130, the processor 799 may increase the transparency of the navigation bar 1130 so that the UI element 1110 is visible.

11A and 11B, the processor 799 selects a selection item (e.g., an arrow pointing outward from the active area) 1140 to allow the user to select removal of the navigation bar 1120. can be displayed on the navigation bar 1120. When the selection item 1140 is selected, the processor 799 may remove the navigation bar 1120 from the active area. The processor 799 may display a selection item (e.g., an arrow pointing inward to the activation area) 1150 where the navigation bar 1120 was located so that the user can select the display of the navigation bar 1130. When the selection item 1150 is selected, the processor 799 may display the navigation bar 1120 again or lower the transparency to the original transparency set in the navigation bar 1120 before the selection item 1140 is selected.

11A and 11C, the processor 799 removes the status bar 1160 at the top of the activation area and the navigation bar 1130 at the bottom of the activation area from the activation area and reinstalls the app window area 1120. ) can be expanded to the entire active area so that the UI element 1110 is clearly visible.

11B and 11D, when the selection item 1150 is selected, the processor 799 displays the navigation bar 1120 instead of displaying the navigation bar 1120. A pop-up window (e.g., assistant menu) 1170 may be displayed in the app window area 1120. The processor 799 may increase the transparency of the pop-up window 1170 so that UI elements placed below the pop-up window 1170 are visible. The processor 799 displays a button 1171 for moving to a recently used app, a button 1172 for moving to the home screen, and a button 1173 for moving to the previous screen in the pop-up window 1170. can do. In addition to the navigation buttons 1171, 1172, and 1173, the processor 799 may add and display buttons for executing other functions on the pop-up window 1170. For example, a button 1174 for turning off the screen, a button 1175 for adjusting the volume, and a button 1176 for taking a screenshot may be displayed through the pop-up window 1170.

FIG. 12 is a flowchart illustrating operations of the processor 799 for solving a consistency problem, according to an embodiment.

In operation 1210, the processor 799 may recognize that a slide-in trigger for shrinking the active area has occurred while displaying the application execution screen in the active area in the slide-out state. For example, the processor 799 may recognize a state change to the slide-in state as a slide-in trigger through the state detection sensor 720. As another example, the processor 799 may recognize a user input for a button for state change (e.g., a button placed on the side of the electronic device 700 or a button displayed on the display 710) as a slide-in trigger.

In operation 1220, the processor 799 may determine whether an aspect ratio setting value corresponding to the currently displayed application execution screen is stored in the memory 788 in response to the occurrence of a slide-in trigger. If the corresponding aspect ratio setting value exists in the memory 788, in operation 1230, the processor 799 reduces the active area based on the aspect ratio setting value to ensure consistency in the execution screen.

If the corresponding aspect ratio setting value is not in the memory 788, in operation 1240, the processor 799 may reduce the active area to a size specified as a default (e.g., minimum size).

After reducing the activation area, the processor 799 may check the consistency of the application execution screen in operation 1250. In operation 1260, the processor 799 may determine whether there is a problem with the consistency of the test results. In operations 1250 and 1260, as described above, a method of determining whether there is a consistency problem in the execution screen based on the layout of the application execution screen or a consistency determination method as described with reference to FIG. 8 may be used.

If it is determined that there is a consistency problem, in operation 1270, the processor 799 may control the motor driving circuit 730 to expand the activation area by one step by a specified size, and then perform the consistency check (operation 1250) again. If it is determined that there is still a consistency problem (operation 1260, example), the processor 799 may increase the activation area by one step (operation 1270).

If it is determined that there is no problem with consistency, in operation 1280, the processor 799 stores the aspect ratio setting value indicating the size of the active area in the memory 388 and can use this value later (e.g., when performing operation 1230).

Figure 13 is a flowchart for explaining the operations of the processor 799 for solving the consistency problem, according to one embodiment.

In operation 1310, while the electronic device is in a slide-out state and the application execution screen is displayed in an area (e.g., app window area) designated for displaying the application execution screen among the activation areas, the processor 799 performs a process for reducing the activation area. It is possible to recognize that a slide-in trigger has occurred. For example, the processor 799 may recognize a state change to the slide-in state as a slide-in trigger through the state detection sensor 720. As another example, the processor 799 may recognize a user input for a button for state change (e.g., a button placed on the side of the electronic device 700 or a button displayed on the display 710) as a slide-in trigger.

In operation 1320, the processor 799, in response to the occurrence of a slide-in trigger, reduces the active area (e.g., slide-in state) and layouts the application execution screen (e.g., size of UI elements, etc.) of the application execution screen according to the aspect ratio of the reduced size. You can change the position of a UI element and/or the size of the content within the UI element.

In operation 1330 after changing the layout, the processor 799 may recognize that there is a problem with the consistency of the application execution screen. Operation 1330 may use a method of determining whether there is a consistency problem in the application execution screen based on the layout of the application execution screen, as described above, or a consistency determination method as described with reference to FIG. 8.

In operation 1340, the processor 799 may expand the activation area to solve the consistency problem.

FIG. 14 is a flowchart illustrating operations of the processor 799 for solving the consistency problem without expanding the active area, according to one embodiment. FIGS. 15A, 15B, and 15C are screen examples for explaining operations of the processor 799 for solving the consistency problem without expanding the active area, according to one embodiment.

In operation 1410, the processor 799 may recognize that a slide-in trigger for shrinking the active area has occurred while displaying the application execution screen in the active area in the slide-out state. For example, the processor 799 may recognize a state change to the slide-in state as a slide-in trigger through the state detection sensor 720. As another example, the processor 799 may recognize a user input for a button for state change (e.g., a button placed on the side of the electronic device 700 or a button displayed on the display 710) as a slide-in trigger.

In operation 1420, when changing the layout of the application execution screen to the first layout to match the size of the activation area reduced by the slide-in trigger, the processor 799 detects a consistency issue (e.g., US elements) in the application execution screen. It can be confirmed that an issue occurs where some UI elements overlap and/or some UI elements are not visible in the app window area. For example, as shown in Figure 15A, the activation area may be reduced in the longitudinal direction. Accordingly, the processor 799 fixes the width (or horizontal length) of the application execution screen to w1, but reduces the height (or vertical length) of the application execution screen to h1 to match the height of the reduced activation area. You can. Depending on the height reduction, the processor 799 may rearrange (e.g., narrow the gap) UI elements within the application execution screen. The processor 799 can confirm that a consistency problem has occurred in the application execution screen as a result of the rearrangement. For example, the processor 799 may check a consistency problem in which a portion of the first UI element 1510 is obscured by the second UI element 1520 in the reduced application execution screen.

In operation 1430, the processor 799 may change the layout of the application execution screen to a second layout without the consistency problem, based on the confirmation of the consistency problem. For example, as shown in FIG. 15B, the processor 799 may enlarge the height of the application execution screen from h1 to h2. Additionally, the processor 799 may expand the width of the application execution screen from w1 to w2 by the ratio of h1/h2. As the height increases, the processor 799 may rearrange (e.g., increase spacing) UI elements within the application execution screen. The processor 799 can confirm that the consistency problem in the application execution screen has been resolved as a result of the rearrangement. For example, the processor 799 can confirm that the gap between the first UI element 1510 and the second UI element 1520 has widened and the consistency problem has been resolved.

In operation 1440, the processor 799 reduces the size (or scale) of the application execution screen changed to the second layout to fit the size of the reduced activation area and displays the application execution screen in the activation area. You can. For example, as shown in FIG. 15C, the processor 799 may reduce the size (h2*w2) of the application execution screen to fit the size (h1*w1) of the activation area 1530. The height of UI elements within the application execution screen may be reduced by the h1/h2 ratio, and the width of UI elements may be reduced by the w1/w2 ratio. Since the sizes of UI elements within the application execution screen are all reduced by the same ratio, the application execution screen can be displayed in the reduced activation area without consistency problems.

According to one embodiment, a portable electronic device (eg, electronic device 101 or electronic device 700) includes a first housing; a second housing arranged to be slidably driven relative to the first housing; a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing; a motor that generates a driving force to slide the second housing; a driving circuit for driving the motor; Memory for storing instructions; and at least one processor (eg, processor 120 or processor 799) operably connected to the driving circuit, the flexible display, and the memory. The at least one processor may set the display area of the flexible display as an active area that displays visual information. The at least one processor may recognize that a slide-in trigger for shrinking the active area has occurred while displaying an application execution screen in the active area in a slide-out state. The at least one processor may identify whether a consistency problem occurs in the application execution screen when changing from the slide-out state to the slide-in state, based on the occurrence of the slide-in trigger. The at least one processor may provide a user interface that allows expansion of the active area when the consistency problem occurs.

The at least one processor may control the driving circuit to reduce the active area and change the layout of the application execution screen. The at least one processor may recognize that a consistency problem occurs in which UI elements overlap each other in the layout-changed application execution screen or a portion of a UI element is not visible in an app window area designated for displaying the application execution screen. The at least one processor may control the driving circuit to expand the activation area based on recognition of the occurrence of the consistency problem.

The at least one processor may determine that there is a consistency problem in the application execution screen based on the size and position of the UI elements.

The at least one processor may obtain the first text from the application execution screen received from the application. A screenshot image can be created by capturing the application execution screen displayed in the app window area. The at least one processor may extract second text from the screenshot image. The at least one processor may compare the first text and the second text and, based on the comparison result, determine that there is a consistency problem with the application execution screen displayed in the app window area.

The at least one processor may expand the active area based on selection of expansion of the active area through the user interface.

The at least one processor may include in the user interface an arrow pointing outward from the active area, information indicating an aspect ratio of the active area to be expanded, or information for notifying the consistency problem, and display the information on the active area.

The at least one processor may display a setting item in the active area that allows the user to set whether to resolve the consistency problem when it occurs. The at least one processor may expand the activation area based on recognizing the occurrence of the consistency problem after the consistency problem is set to be resolved through the setting item.

In response to the occurrence of the slide-in trigger, the at least one processor may check the aspect ratio setting value corresponding to the application execution screen in the memory. The at least one processor may reduce the active area based on the aspect ratio setting value.

According to one embodiment, a portable electronic device (e.g., electronic device 700 of FIG. 7) includes a first housing; a second housing arranged to be slidably driven relative to the first housing; a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing; a motor that generates a driving force to slide the second housing; a driving circuit for driving the motor; Memory for storing instructions; and at least one processor (eg, processor 120 or processor 799) operably connected to the driving circuit, the flexible display, and the memory. The at least one processor may set the display area of the flexible display as an active area. The at least one processor may set a part of the activation area as an app window area for displaying the application execution screen. The at least one processor may recognize that a slide-in trigger for shrinking the active area has occurred while displaying an application execution screen in the app window area in the slide-out state. Based on the occurrence of the slide-in trigger, the at least one processor may control the driving circuit to reduce the activation area and change the layout of the application execution screen. The at least one processor may recognize that a consistency problem has occurred in the layout-changed application execution screen in which some UI elements are not visible in the app window area designated for displaying the application execution screen. The at least one processor, based on recognizing the occurrence of the consistency problem, removes another area of the active area and expands the app window area to the location where the other area was, thereby making a part of the UI element visible. You can.

The at least one processor may determine that there is a consistency problem in the application execution screen based on the size and position of UI elements in the application execution screen.

The at least one processor may obtain the first text from the application execution screen received from the application. The at least one processor may capture an application execution screen displayed in the app window area and generate a screenshot image. The at least one processor may extract second text from the screenshot image. The at least one processor may compare the first text and the second text and, based on the comparison result, determine that there is a consistency problem with the application execution screen displayed in the app window area.

In response to recognizing the occurrence of the consistency problem, the at least one processor may display a first selection item in the other area to allow the user to select removal of the other area. In response to removal of the other area being selected through the first selection item, the at least one processor may remove the other area and expand the app window area to the location where the other area was.

After removing the other area, the at least one processor may display a second selection item in the place where the other area was to allow the user to select display of the other area. The at least one processor may display the other area in response to the display of the other area being selected through the second selection item.

According to one embodiment, a portable electronic device (e.g., electronic device 700 of FIG. 7) includes a first housing; a second housing arranged to be slidably driven relative to the first housing; a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing; a motor that generates a driving force to slide the second housing; a driving circuit for driving the motor; Memory for storing instructions; and at least one processor (eg, processor 120 or processor 799) operably connected to the driving circuit, the flexible display, and the memory. The at least one processor may set part or all of the activation area as an app window area for displaying the application execution screen. The at least one processor may recognize that a slide-in trigger for shrinking the active area has occurred while displaying an application execution screen in the app window area in the slide-out state. Based on the occurrence of the slide-in trigger, the at least one processor may control the driving circuit to reduce the activation area and change the layout of the application execution screen. The at least one processor may recognize that a consistency problem has occurred in the layout-changed application execution screen in which some UI elements are not visible in the app window area designated for displaying the application execution screen. Based on recognition of the occurrence of the consistency problem, the at least one processor may be set to a layer higher than the app window area and remove another area that obscures part of the UI element or increase transparency of the other area. .

The at least one processor may determine that there is a consistency problem in the application execution screen based on the size and position of UI elements in the application execution screen.

The at least one processor may obtain the first text from the application execution screen received from the application. The at least one processor may capture an application execution screen displayed in the app window area and generate a screenshot image. The at least one processor may extract second text from the screenshot image. The at least one processor may compare the first text and the second text and, based on the comparison result, determine that there is a consistency problem with the application execution screen displayed in the app window area.

In response to recognizing the occurrence of the consistency problem, the at least one processor may display a first selection item in the other area to allow the user to select removal of the other area. The at least one processor may remove the other area or increase transparency of the other area in response to the removal of the other area being selected through the first selection item.

After removing the other area or increasing transparency, the at least one processor may display a second selection item in the place where the other area was to allow the user to select the display of the other area. The at least one processor may display the other area or lower its transparency in response to the display of the other area being selected through the second selection item.

According to one embodiment, a portable electronic device (e.g., electronic device 700 of FIG. 7) includes a first housing; a second housing arranged to be slidably driven relative to the first housing; a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing; a motor that generates a driving force to slide the second housing; a driving circuit for driving the motor; Memory for storing instructions; and at least one processor (eg, processor 120 or processor 799) operably connected to the driving circuit, the flexible display, and the memory. The at least one processor may set part or all of the activation area as an app window area for displaying the application execution screen. The at least one processor may recognize that a slide-in trigger for shrinking the active area has occurred while displaying an application execution screen in the app window area in the slide-out state. The at least one processor may confirm that a consistency problem occurs in the application execution screen when changing the layout of the application execution screen to the first layout to match the size of the activated area reduced in response to the slide-in trigger. there is. The at least one processor may change the layout of the application execution screen to a second layout that does not have a consistency problem. The at least one processor may reduce the size of the application execution screen changed to the second layout to fit the size of the reduced activation area and display it on the reduced activation area.

The at least one processor may determine that there is a consistency problem in the application execution screen based on the size and position of UI elements in the application execution screen.

Claims (20)

In a portable electronic device,
first housing;
a second housing arranged to be slidably driven relative to the first housing;
a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing;
a motor that generates a driving force to slide the second housing;
a driving circuit for driving the motor;
Memory for storing instructions; and
At least one processor operably connected to the driving circuit, the flexible display, and the memory,
The at least one processor,
Setting the display area of the flexible display as an active area for displaying visual information,
While displaying an application execution screen in the active area in a slide-out state, recognizing that a slide-in trigger for shrinking the active area has occurred,
Based on the occurrence of the slide-in trigger, identify whether a consistency problem occurs in the application execution screen when changing from the slide-out state to the slide-in state,
An electronic device configured to provide a user interface that allows expansion of the active area when the consistency problem occurs. The method of claim 1, wherein the at least one processor:
Controlling the driving circuit to reduce the activation area and change the layout of the application execution screen,
Recognizing that a consistency problem has occurred in which UI elements overlap each other in the layout-changed application execution screen or some UI elements are not visible in the app window area designated for displaying the application execution screen,
An electronic device configured to expand the activation area by controlling the driving circuit based on recognition of the occurrence of the consistency problem. The method of claim 2, wherein the at least one processor:
An electronic device configured to determine that there is a consistency problem in the application execution screen based on the size and position of the UI elements. The method of claim 2, wherein the at least one processor:
Obtaining the first text from the application execution screen received from the application,
Generate a screenshot image by capturing the application execution screen displayed in the app window area,
Extract a second text from the screenshot image,
Compare the first text and the second text,
An electronic device configured to determine that an application execution screen displayed in the app window area has a consistency problem, based on the comparison result. The method of claim 1, wherein the at least one processor:
An electronic device configured to expand the active area based on selection of expansion of the active area through the user interface. The method of claim 5, wherein the at least one processor:
An electronic device configured to display in the active area an arrow pointing out of the active area, information indicating an aspect ratio of the active area to be expanded, or information for notifying the consistency problem in the user interface. The method of claim 1, wherein the at least one processor:
Displaying a setting item in the activation area that allows the user to set whether to resolve the consistency problem when it occurs,
An electronic device configured to expand the activation area based on recognition of occurrence of the consistency problem after the consistency problem is set to be resolved through the setting item. The method of claim 1, wherein the at least one processor:
In response to the occurrence of the slide-in trigger, check the aspect ratio setting value corresponding to the application execution screen in the memory,
An electronic device configured to reduce the active area based on the aspect ratio setting value. In a portable electronic device,
first housing;
a second housing arranged to be slidably driven relative to the first housing;
a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing;
a motor that generates a driving force to slide the second housing;
a driving circuit for driving the motor;
Memory for storing instructions; and
At least one processor operably connected to the driving circuit, the flexible display, and the memory,
The at least one processor,
Set the display area of the flexible display as an active area,
Setting a part of the activation area as an app window area for displaying the application execution screen,
While displaying an application execution screen in the app window area in the slide-out state, recognizing that a slide-in trigger for reducing the active area has occurred,
Based on the occurrence of the slide-in trigger, control the driving circuit to reduce the activation area and change the layout of the application execution screen,
Recognizing that a consistency problem has occurred in the layout-changed application execution screen where some of the UI elements are not visible in the app window area designated for displaying the application execution screen,
An electronic device configured to make a part of the UI element visible by removing another area of the active area and extending the app window area to the location of the other area, based on the occurrence of the consistency problem being recognized. The method of claim 9, wherein the at least one processor:
An electronic device configured to determine that there is a consistency problem in the application execution screen based on the size and position of UI elements in the application execution screen. The method of claim 9, wherein the at least one processor:
Obtaining the first text from the application execution screen received from the application,
Generate a screenshot image by capturing the application execution screen displayed in the app window area,
Extract a second text from the screenshot image,
Compare the first text and the second text,
An electronic device configured to determine that an application execution screen displayed in the app window area has a consistency problem, based on the comparison result. The method of claim 9, wherein the at least one processor:
In response to recognizing the occurrence of the consistency problem, displaying a first selection item in the other area to allow the user to select removal of the other area,
In response to removal of the other area being selected through the first selection item, the electronic device is configured to remove the other area and expand the app window area to the location where the other area was. 13. The method of claim 12, wherein the at least one processor:
After removing the other area, displaying a second selection item in the place where the other area was to allow the user to select the display of the other area,
An electronic device configured to display the different area in response to the display of the different area being selected through the second selection item. In a portable electronic device,
first housing;
a second housing arranged to be slidably driven relative to the first housing;
a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing;
a motor that generates a driving force to slide the second housing;
a driving circuit for driving the motor;
Memory for storing instructions; and
At least one processor operably connected to the driving circuit, the flexible display, and the memory,
The at least one processor,
Setting part or all of the activation area as an app window area for displaying the application execution screen,
While displaying an application execution screen in the app window area in the slide-out state, recognizing that a slide-in trigger for reducing the active area has occurred,
Based on the occurrence of the slide-in trigger, control the driving circuit to reduce the activation area and change the layout of the application execution screen,
Recognizing that a consistency problem has occurred in the layout-changed application execution screen where some of the UI elements are not visible in the app window area designated for displaying the application execution screen,
Based on the occurrence of the consistency problem being recognized, an electronic device configured to remove another area that is set as a layer higher than the app window area and obscure a part of the UI element or to increase transparency of the other area. 15. The method of claim 14, wherein the at least one processor:
An electronic device configured to determine that there is a consistency problem in the application execution screen based on the size and position of UI elements in the application execution screen. 15. The method of claim 14, wherein the at least one processor:
Obtaining the first text from the application execution screen received from the application,
Generate a screenshot image by capturing the application execution screen displayed in the app window area,
Extract a second text from the screenshot image,
Compare the first text and the second text,
An electronic device configured to determine that an application execution screen displayed in the app window area has a consistency problem, based on the comparison result. 15. The method of claim 14, wherein the at least one processor:
In response to recognizing the occurrence of the consistency problem, displaying a first selection item in the other area to allow the user to select removal of the other area,
An electronic device configured to remove the other area or increase transparency of the other area in response to removal of the other area being selected through the first selection item. 18. The method of claim 17, wherein the at least one processor:
After removing the other area or increasing transparency, displaying a second selection item in the place where the other area was to allow the user to select the display of the other area,
An electronic device configured to display the other area or reduce transparency in response to the display of the other area being selected through the second selection item. In a portable electronic device,
first housing;
a second housing arranged to be slidably driven relative to the first housing;
a flexible display in which a display area of the display is reduced or expanded based on a slide-in or slide-out operation of the second housing;
a motor that generates a driving force to slide the second housing;
a driving circuit for driving the motor;
Memory for storing instructions; and
At least one processor operably connected to the driving circuit, the flexible display, and the memory,
The at least one processor,
Setting part or all of the activation area as an app window area for displaying the application execution screen,
While displaying an application execution screen in the app window area in the slide-out state, recognizing that a slide-in trigger for reducing the active area has occurred,
When changing the layout of the application execution screen to the first layout to match the size of the activation area reduced in response to the slide-in trigger, confirm that a consistency problem occurs in the application execution screen,
Change the layout of the application execution screen to a second layout that does not have a consistency problem,
An electronic device configured to reduce the size of the application execution screen changed to the second layout to fit the size of the reduced activation area and display it in the reduced activation area. 20. The method of claim 19, wherein the at least one processor:
An electronic device configured to determine that there is a consistency problem in the application execution screen based on the size and position of UI elements in the application execution screen.

Images