KR20240117975A - Electronic device communicating with external device and method for controlling the same - Google Patents

Abstract

According to one embodiment, an electronic device includes a communication module, a display, at least one processor operatively coupled to the communication module and the display, wherein the at least one processor extends the display beyond an area comprising a first edge of the display. Based on receiving a user input that moves the pointer in the first direction, it is confirmed whether there is a connectable external device, and based on it being confirmed that there is a connectable external device, a first UI indicating that a connection is possible is displayed at the first edge. displays in an area including, and controls the communication module to connect to the external device based on receiving a user input for connecting to the external device after displaying the first UI, and the size of the display of the external device received from the external device. Adjust the resolution information of the display of the external device based on the information, identify a connection area with the display of the external device among the first edges of the display based on the adjusted resolution information, and, in the connection area among the first edges, a connection area A second UI indicating that the pointer can be moved to the display of the external device can be displayed.

Description

Electronic device communicating with external device and method of controlling same { ELECTRONIC DEVICE COMMUNICATING WITH EXTERNAL DEVICE AND METHOD FOR CONTROLLING THE SAME }

Embodiments of the present disclosure relate to an electronic device that communicates with an external device and a method of controlling the same.

The variety of services and additional functions provided through electronic devices, for example, portable electronic devices such as smart phones, tablet PCs, and laptops, is gradually increasing. In order to increase the utility value of these electronic devices and satisfy the needs of various users, communication service providers or electronic device manufacturers are competitively developing electronic devices to provide various functions and differentiate themselves from other companies. Accordingly, various functions provided through electronic devices are becoming increasingly sophisticated.

As communication technology between electronic devices develops, the displays of multiple electronic devices are connected, and an input device built into or connected to one electronic device is used to move the displays of the multiple connected electronic devices with a controllable pointer to control each electronic device. A multi-control function that can be controlled is used.

According to one embodiment, an electronic device may include a communication module, a display, and at least one processor operatively connected to the communication module and the display.

According to one embodiment, the at least one processor determines whether there is a connectable external device based on receiving a user input that moves a pointer from an area including a first edge of the display in a first direction away from the display. You can check.

According to one embodiment, based on confirmation that there is an external device that can be connected, the at least one processor may display a first UI indicating that a connection is possible in an area including the first edge.

According to one embodiment, the at least one processor may control the communication module to connect to the external device based on receiving a user input for connecting to the external device after displaying the first UI.

According to one embodiment, the at least one processor may adjust resolution information on the display of the external device based on size information on the display of the external device received from the external device.

According to one embodiment, the at least one processor may identify a connection area with the display of the external device among the first edges of the display based on the adjusted resolution information.

According to one embodiment, the at least one processor may display a second UI notifying that the pointer can be moved to the display of the external device through the connection area on the connection area of the first edge.

According to one embodiment, a method of controlling an electronic device includes, based on receiving a user input moving a pointer from an area including a first edge of a display of the electronic device in a first direction away from the display, a connectable external device. It may include an operation to check whether .

According to one embodiment, a method of controlling an electronic device may include displaying a first UI indicating that a connection is possible in an area including the first edge, based on confirmation that there is an external device that can be connected. there is.

According to one embodiment, a method of controlling an electronic device includes controlling a communication module of the electronic device to connect to the external device based on receiving a user input for connecting to the external device after displaying the first UI. Can include actions.

According to one embodiment, a method of controlling an electronic device may include adjusting resolution information of a display of the external device based on size information of the display of the external device received from the external device.

According to one embodiment, a method of controlling an electronic device may include identifying a connection area with a display of the external device among the first edges of the display based on the adjusted resolution information.

According to one embodiment, a method of controlling an electronic device includes displaying a second UI notifying that the pointer can be moved to the display of the external device through the connection area on the connection area of the first edge. can do.

According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs, the one or more programs comprising: an electronic device configured to store a first edge of the display, It may include commands to check whether there is a connectable external device based on receiving a user input that moves the pointer in a direction.

According to one embodiment, the one or more programs include instructions for displaying a first UI indicating that a connection is possible in an area including the first edge, based on the electronic device confirming that there is a connectable external device. It can be included.

According to one embodiment, the one or more programs control the communication module so that the electronic device connects to the external device based on receiving a user input for connecting to the external device after displaying the first UI. May contain commands.

According to one embodiment, the one or more programs may include instructions that allow the electronic device to adjust resolution information on the display of the external device based on size information on the display of the external device received from the external device. .

According to one embodiment, the one or more programs may include instructions for the electronic device to identify a connection area with the display of the external device among the first edges of the display based on the adjusted resolution information. .

According to one embodiment, the one or more programs display, in the connection area of the first edge, a second UI notifying that the pointer can be moved to the display of the external device through the connection area. May contain commands.

1 is a block diagram of an electronic device in a network environment according to an embodiment.
FIG. 2 is a diagram for explaining the connection relationship between an electronic device and an external device, according to an embodiment.
FIG. 3A is a flowchart illustrating a connection operation of an electronic device with an external device through gesture input, according to an embodiment.
FIG. 3B is a flowchart illustrating operations depending on whether a connection is made to an external device when a gesture input from an electronic device is received, according to an embodiment.
FIG. 4A is a diagram illustrating a gesture input for connecting an electronic device and an external device according to an embodiment.
FIG. 4B is a diagram for explaining a pointer movement operation related to a connection operation of an electronic device with an external device, according to an embodiment.
FIG. 4C is a diagram illustrating an operation of an electronic device to display a UI indicating that there is an external device that can be connected to the electronic device, according to an embodiment.
FIG. 4D is a diagram illustrating an operation of displaying a UI for checking whether an electronic device is connected to a connectable external device, according to an embodiment.
FIG. 4E is a diagram illustrating an operation of displaying a UI for checking whether an electronic device is connected to a connectable external device, according to an embodiment.
FIG. 4F is a diagram illustrating an operation of an electronic device to display a UI indicating that the connection between the electronic device and an external device has been completed and connection settings, according to an embodiment.
FIG. 4G is a diagram illustrating an operation of displaying a UI indicating that the connection between an electronic device and an external device has been completed and connection settings, according to an embodiment.
FIG. 5 is a diagram illustrating an automatic connection setting operation of an electronic device according to an embodiment.
FIG. 6 is a diagram for explaining a connection method of an electronic device with an external device, according to an embodiment.
FIG. 7A is a diagram illustrating connection settings of an electronic device before adjusting the resolution of a display of an external device, according to an embodiment.
FIG. 7B is a diagram illustrating connection settings after adjusting the resolution of the display of an external device in an electronic device, according to an embodiment.
FIG. 8A is a diagram illustrating an operation of changing connection settings with an external device through a connection settings screen of an electronic device, according to an embodiment.
FIG. 8B is a diagram illustrating an operation of displaying a UI based on connection settings changed through a connection settings screen of an electronic device according to an embodiment.
FIG. 9A is a diagram for explaining existing connection settings of an electronic device with external devices, according to an embodiment.
FIG. 9B is a diagram illustrating an operation of an electronic device when a gesture input is received to cancel an existing connection with external devices and establish a connection different from the existing connection setting, according to an embodiment.
FIG. 9C is a diagram illustrating an operation of an electronic device when a gesture input is received to cancel an existing connection with external devices and establish a connection different from the existing connection setting, according to an embodiment.
FIG. 9D is a diagram illustrating the operation of an electronic device when an external device to be connected to the direction in which a gesture input is received is not disposed, according to an embodiment.
FIG. 10A is a diagram illustrating an operation of an electronic device when a gesture input for connection is received when a plurality of external devices are placed on one side of the electronic device, according to an embodiment.
FIG. 10B is a diagram for explaining a connection operation of an electronic device when a plurality of external devices are placed on one side of the electronic device, according to an embodiment.
FIG. 11A is a diagram illustrating an example of a UI displayed when a plurality of external devices are sequentially connected to one side of the electronic device, according to an embodiment.
FIG. 11B is a diagram illustrating an example of a UI displayed when a plurality of external devices are sequentially connected to one side of the electronic device, according to an embodiment.
FIG. 12A is a diagram illustrating an operation of an electronic device when a gesture input for connection is received when a plurality of external devices are placed on one side of the electronic device, according to an embodiment.
FIG. 12B is a diagram for explaining a connection operation of an electronic device when a plurality of external devices are placed on one side of the electronic device, according to an embodiment.
FIG. 12C illustrates an operation of setting an external device to be connected through a UI displayed based on a gesture input for connection when a plurality of external devices are placed on one side of the electronic device according to an embodiment of the present invention. It is a drawing.
FIG. 13A illustrates setting the external device to be connected and/or the connection order through a UI displayed based on a gesture input for connection when a plurality of external devices are placed on one side of the electronic device according to an embodiment. This is a drawing to explain the operation.
FIG. 13B is a diagram for explaining connection settings of an electronic device and a plurality of external devices according to settings input through the UI of FIG. 13A.
FIG. 14A is a diagram illustrating an operation of moving a UI corresponding to a connection area displayed on a display of an electronic device according to an embodiment of the present invention by a user input.
FIG. 14B is a diagram illustrating an operation of moving a UI corresponding to a connection area displayed on a display of an electronic device according to an embodiment of the present invention by a user input.
FIG. 15 is a diagram illustrating an operation of changing the size of a UI corresponding to a connection area displayed on a display according to a user input, according to an embodiment.

1 is a block diagram of an electronic device 101 in a network environment 100, according to one embodiment. Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or operations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes the main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, co-processor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

Battery 189 may supply power to at least one component of electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g. : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band), for example, to achieve a high data rate. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected to the plurality of antennas by, for example, the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to one embodiment, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes: a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

FIG. 2 is a diagram for explaining the connection relationship between an electronic device and an external device, according to an embodiment.

Referring to FIG. 2, the electronic device 101 (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) is connected to an external device 104 (e.g., the electronic device 104 of FIG. 1). can be connected For example, the display of the electronic device 101 and the display of the external device 104 may be connected to be used as one virtual display.

According to one embodiment, the electronic device 101 may adjust the resolution of the display of the external device 104 so that the physical connection area between displays matches the connection area where the pointer 230 moves. For example, if the resolution of the display of the external device 104 is higher than the resolution of the display of the electronic device 101, the electronic device 101 lowers the resolution of the display of the external device 104 and bases the lowered resolution on the display. It can be connected to the display of the electronic device 101.

According to one embodiment, the electronic device 101 may display the UI 210 indicating that the connection has been completed in an area including an edge where the pointer can be moved to the external device 104 among a plurality of edges of the display. there is. For example, the edge of the display may be a boundary surrounding a displayable area of the display. According to one embodiment, the electronic device 101 displays a user interface (UI) 210 in an area corresponding to the location and/or size of the connection area where the pointer 230 can move to the external device 104. You can. For example, the electronic device 101 may include the relative arrangement (e.g., position and/or direction) of the pointer 230 with the display of the movable external device 104, the size of the display of the electronic device 101, and the electronic device 101. Depending on the resolution of the display of the device 101, the size of the display of the external device 104, and/or the resolution of the display of the external device 104, the display direction, shape, size, length, and/or color are different (UI) 210) can be displayed on the display. For example, if the pointer 230 displayed on the display of the electronic device 101 can be moved to the external device 104 through the entire right edge of the display, the connection is completed in the area including the entire right edge of the display. A UI 210 indicating that this has been done can be displayed. According to one embodiment, when the pointer 230 displayed on the display of the electronic device 101 can be moved to the external device 104 through the top of the right edge of the display, it is connected to an area including the top of the right edge of the display. A UI 210 indicating that this has been completed may be displayed.

According to one embodiment, the external device 104 may display the UI 220 indicating that the connection has been completed in an area that includes an edge where the pointer can be moved to the electronic device 101 among a plurality of edges of the display. According to one embodiment, the UI 220 may be displayed in an area corresponding to the location and/or size of the connection area with the electronic device 101.

According to one embodiment, the pointer 230 displayed on the display of the electronic device 101 (e.g., the display module 160 of FIG. 1) is an input module (e.g., the display module 160 of FIG. 1) built into and/or connected to the electronic device 101. You can move within the display based on the control of the input module 150, and when the display of the electronic device 101 and the display of the external device 104 are connected, the display of the electronic device 101 displays the external device 104. ) You can move to the display. For example, the pointer 230 may move from the display of the electronic device 101 to the display of the external device 104 through the connection area of the display of the electronic device 101 and the connection area of the display of the external device 104. there is.

According to one embodiment, a user input that moves the pointer 230 displayed on the display of the electronic device 101 in a direction away from the display of the electronic device 101 is received, and an external device connected to the display of the electronic device 101 If there is no display of 104, the electronic device 101 searches for at least one connectable external device, connects it to the display of one or more external devices among the searched at least one external device, and sends a pointer to the connected one or more external devices. (230) can be moved.

Hereinafter, in FIGS. 3A to 15 , the connection between the display of the electronic device 101 and the display of the external device 104 and the operation of displaying a UI corresponding to the connection area according to the connection will be described in more detail.

FIG. 3A is a flowchart illustrating a connection operation of an electronic device with an external device through gesture input, according to an embodiment.

Referring to FIG. 3A, in operation 310, the electronic device (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) moves from an area including the first edge of the display in a first direction away from the display. Based on the user input moving the pointer being received, it can be confirmed whether there is an external device that can be connected. For example, the electronic device determines whether there is an external device that can be connected based on receiving a user input that moves the pointer in a right direction away from the display in an area including the right edge of the right, left, top, and bottom edges of the display. You can find out whether

According to one embodiment, the electronic device can check the moving distance of the pointer by hooking the coordinates of the pointer. For example, when the electronic device detects movement of more than a set movement distance (e.g., about 3000px) in the right direction from a set area including the right edge of the display, it can determine that the pointer has left the display. According to one embodiment, when the electronic device detects that the pointer moves left before moving a set movement distance (e.g., about 3000px) to the right from a set area including the right edge of the display, the electronic device moves the pointer to the right side of the display. The moving distance from the set area including the edge can be initialized.

According to one embodiment, when the pointer deviates from one of the plurality of edges of the display by more than a set distance (e.g., 3000px) or a gesture input approaching within a set distance from the edge of the display is detected, the electronic device detects a connectable external device. You can check whether the device exists.

According to one embodiment, the electronic device may check whether there is an external device that can be connected to the electronic device through a first communication method (eg, Bluetooth).

According to one embodiment, a gesture input operation for connecting an external device will be described below with reference to FIGS. 4A and 4B.

According to one embodiment, in FIG. 3A, operation 310 is limited to the state in which the electronic device and the external device are not connected. However, when the electronic device receives a user input that moves the pointer to leave the display, the electronic device performs the operation as shown in FIG. 3B. You can also check whether an external device is connected.

FIG. 3B is a flowchart illustrating operations depending on whether a connection is made to an external device when a gesture input from an electronic device is received, according to an embodiment. For example, FIG. 3B may further include an operation of checking whether a connection is made to an external device according to an embodiment of operation 310 of FIG. 3A.

Referring to FIG. 3B, in operation 311, the electronic device may receive a user input that moves a pointer from an area including the first edge of the display in a first direction away from the display. For example, the electronic device may receive a user input that moves the pointer in a right direction away from the display in an area including the right edge among the right, left, top, and bottom edges of the display.

According to one embodiment, in operation 312, the electronic device may check whether there is an external device connected in the first direction. For example, the electronic device may check whether there is an external device connected to move the pointer in the first direction at the time a user input for moving the pointer in the first direction is received.

According to one embodiment, if there is an external device connected in the first direction (operation 312 - Yes), the electronic device may move the pointer to the external device in operation 313.

According to one embodiment, if there is no external device connected in the first direction (operation 312 - No), in operation 314, the electronic device may check whether there is a connectable external device. For example, if the pointer approaches the first edge or a gesture input that deviates from the first edge by more than a set distance in the first direction is detected, and there is no external device connected in the first direction, the electronic device requests a connection to the external device. You can send a request and receive a response from an external device. According to one embodiment, a response received from an external device may include information about the external device (e.g., Ashley’s Tablet).

According to one embodiment, if the information about the external device included in the response received from the external device is included in at least one external device information stored in the memory of the electronic device (e.g., memory 130 of FIG. 1), You can check the external device as a connectable external device.

According to one embodiment, if the information on the external device included in the response received from the external device is included in the device information registered in the server account where the electronic device is registered, the electronic device verifies the external device as a connectable external device, You can choose to automatically connect (multi auto connection) or wait for user confirmation to connect.

According to one embodiment, the electronic device may proceed to operation 320 of FIG. 3A after operation 314.

According to one embodiment, in the case of a first connection attempt with no connection history with an external device, the electronic device determines whether there is an external device connected in the first direction even if a user input that moves the pointer in the first direction is received. The operation (e.g., operation 312 in FIG. 3B) may not be performed.

According to one embodiment, even if it is the first connection attempt with no history of connection to an external device, if the external device is a device registered to the user account, the electronic device checks the external device as a connectable device and adds it to the list of connectable devices. You can display it by adding an external device.

In this way, even if a separate display connection setting screen is not activated and displayed, a display connection with an external device can be performed.

According to one embodiment, in operation 320, based on confirmation that there is an external device that can be connected, the electronic device may display a first UI indicating that a connection is possible in an area including the first edge.

According to one embodiment, if there is a connectable external device, the electronic device may display the first UI in an area including the entire first edge. For example, the first UI may be in the form of a bar. According to one embodiment, the electronic device may delete the displayed first UI when a set time elapses after displaying the first UI.

According to one embodiment, the operation of displaying the first UI indicating that there is an external device to which the electronic device can be connected will be described below with reference to FIG. 4C.

According to one embodiment, when automatic connection is not established with at least some of the connectable devices, the electronic device may display a first UI indicating that there is an external device that can be connected. For example, when automatic connection is set, if a connectable device is confirmed, the electronic device may perform automatic connection regardless of reception of a gesture input for connection.

According to one embodiment, when only external devices connected to the same access point (AP) are set to automatically connect or when automatic connection is set to not occur, the electronic device connects in response to receiving a gesture input for connection. If there is a possible external device, the first UI can be displayed.

According to one embodiment, a screen for setting whether to automatically connect an external device will be described with reference to FIG. 5 below.

According to one embodiment, when it is confirmed that there is no connectable external device, the electronic device performs a process without any additional action in response to a user input that moves the pointer from the area including the first edge in the first direction away from the display. You can quit.

According to one embodiment, even when a connectable device is confirmed, the operation of displaying the first UI indicating that a connectable device exists may be omitted. For example, when a connectable device is confirmed, the electronic device may not display the first UI, but may display a UI to confirm whether or not it is connected to an external device, or may perform a connection to the external device.

According to one embodiment, the electronic device includes at least one option (e.g., auto connection (on/off), edge alignment, plurality) that can be set on a screen for connection settings with an external device (e.g., multi-control setting screen) A first UI including a UI related to (selection of a connected device) may be displayed. According to an embodiment, an operation of including an option related to connection settings with an external device in the first UI will be described below with reference to FIG. 4D. According to an embodiment, the electronic device determines whether to connect to an external device. A UI for checking can be displayed in the area surrounding the first edge.

According to one embodiment, the electronic device displays a UI in an area of the display (e.g., the center of the display or the surrounding area of the first edge) to allow the user to confirm whether or not it is connected to an external device within a set time after the first UI is displayed. It can be displayed.

According to one embodiment, while the display of the first UI is maintained, a UI for confirming from the user whether or not it is connected to an external device is displayed around the first UI or to confirm to the user whether or not it is connected to an external device. A part of the UI for receiving may be displayed to overlay a part of the first UI.

According to one embodiment, when the first UI is displayed and then deleted, a UI for confirming from the user whether or not it is connected to an external device may be displayed in one area of the display.

According to one embodiment, an operation of displaying a UI for confirming from the user whether a connection to an external device is separate from the first UI will be described below with reference to FIG. 4E.

According to one embodiment, the operation of displaying a UI to ask the user to confirm whether or not the connection is connected may be omitted. For example, when a connectable device is confirmed, the electronic device displays the first UI and then performs operation 330 to connect to the external device. Operation 330 may be performed to connect to an external device without displaying the first UI.

According to one embodiment, in operation 330, the electronic device may control the communication module to connect to the external device based on receiving a user input for connecting to the external device after displaying the first UI. For example, when a user input for selecting the displayed first UI is received, the electronic device may connect to an external device. According to one embodiment, when a user input is received through a UI for checking whether or not to connect to an external device included in the first UI, the electronic device may connect to the external device. According to one embodiment, when a user input is received through a UI for asking the user to confirm whether or not the electronic device is connected to an external device displayed separately from the first UI, the electronic device may connect to the external device.

According to one embodiment, the electronic device may control the communication module to connect through a second communication method (e.g., an access point) based on the connectable external device using the same access point (AP). .

According to one embodiment, the electronic device uses a communication module to connect through a third communication method (e.g., Wi-Fi direct) based on the fact that the connectable external devices do not use the same access point (AP). You can control it.

According to one embodiment, an operation of connecting using a different communication method based on whether a connectable external device uses the same access point will be described with reference to FIG. 6 below.

According to one embodiment, based on confirming that there are a plurality of connectable external devices, the electronic device may control the communication module to connect to the external device that was most recently disconnected from the display among the plurality of external devices. For example, if the most recently disconnected external device is an external device that was connected through a second edge of the display of the electronic device, when the electronic device receives a user input to connect through the first edge, the electronic device connects to the second edge An external device that was connected through can be connected through the first edge.

According to one embodiment, based on confirming that there are a plurality of connectable external devices, the electronic device may determine the external device to be connected by further considering the connection direction of the external devices. For example, based on determining that there are a plurality of connectable external devices, the electronic device uses a communication module to connect with the external device whose connection through the first edge of the display was most recently released among the plurality of external devices. You can control it.

According to one embodiment, the operation of connecting the most recently released external device to the first edge of the display where the user input was received will be described with reference to FIG. 9B, regardless of the existing connection setting.

For example, after an external device connected through the first edge of the display is disconnected, an external device that was connected through the second edge of the display is disconnected, such that the most recently disconnected external device is connected through the second edge. Even in the case of a connected external device, when a user input for connection is received through the first edge, the electronic device can connect the external device that was connected through the first edge through the first edge.

According to one embodiment, the operation of connecting to an external device that was connected to the first edge of the display on which the user input was received in the existing connection settings will be described below with reference to FIG. 9C.

According to one embodiment, based on confirming that a plurality of external devices are arranged side by side in a first direction, the electronic device may connect the pointer so that it can sequentially move to each display of the plurality of external devices. For example, an electronic device may obtain the location (e.g., distance and/or direction from the electronic device) of an external device through at least one communication method (e.g., Bluetooth 3.0 and/or ultra wide band (UWB)). And the arrangement order can be obtained through the locations of a plurality of external devices.

According to one embodiment, the electronic device can move a pointer to the display of an external device and display a second UI indicating a connection area on the display.

According to one embodiment, the operation of connecting to each display of a plurality of external devices will be described below with reference to FIGS. 10A and 10B.

According to one embodiment, the electronic device may display a second UI on the display indicating that the pointer is connected to be able to move sequentially to each display of a plurality of external devices, to distinguish it from an embodiment in which the electronic device is connected to a single external device. .

According to one embodiment, the second UI may include type information and/or connection order for each of a plurality of external devices.

According to one embodiment, the second UI indicating connection to each display of a plurality of external devices will be described below with reference to FIGS. 11A and 11B.

According to one embodiment, the UI for confirming from the user whether the first UI and/or an external device displayed separately from the first UI is connected is based on confirming that a plurality of external devices are arranged side by side in the first direction. , may include items for setting whether to connect each of a plurality of external devices and/or setting the connection order.

According to one embodiment, the electronic device displays the first UI and/or each of the external devices selected through the UI to allow the user to confirm whether the pointer is connected to the first UI and/or the external device displayed separately from the first UI. The connection may be made so that the device can be moved sequentially in a connection order set through the UI for the user to confirm whether or not it is connected to an external device that is displayed separately from the UI and/or the first UI.

According to one embodiment, an operation of determining external devices to be connected to the display and/or a connection order based on a user input will be described below with reference to FIGS. 12A to 13B.

According to one embodiment, in operation 340, the electronic device may adjust resolution information on the display of the external device based on size information on the display of the external device received from the external device.

According to one embodiment, the external device may include a display that has a resolution higher than that of the display of the electronic device and is smaller than the display of the electronic device. In this case, if display connection is performed based only on resolution, the electronic device may determine that the display of the external device is larger, even though the display of the external device is actually smaller, and a step may occur when the pointer is moved between displays. Likewise, continuity may be reduced.

According to one embodiment, the electronic device may reduce the resolution information on the display of the external device.

According to one embodiment, based on the type information of the external device, the electronic device may reduce the resolution information of the display of the external device at a rate corresponding to the type information of the external device. For example, the resolution of the electronic device, which is a laptop PC (or a monitor connected to a desktop), is maintained at 100%, and if the external device is a tablet PC, the resolution of the tablet PC is reduced to about 80% and the resolution of the external device is maintained at 100%. If it is a smartphone, the resolution of the smartphone can be reduced to about 60%. The resolution reduction ratio according to the type of external device is an example, and other ratios may be applicable.

In this way, by reducing the resolution of the external device based on the type of the external device, the resources consumed in calculations for adjusting the resolution can be reduced.

According to one embodiment, the electronic device may reduce the resolution information of the display of the external device so that the size ratio and resolution ratio of the display and the display of the external device correspond. For example, the electronic device may obtain the ratio of the actual physical size of the display of the electronic device and the display of the external device based on the resolution information and size information of the display of the external device received based on connection with the external device. there is. According to one embodiment, the electronic device may reduce the resolution of the external device so that the resolution ratio between the display of the electronic device and the display of the external device corresponds to the size ratio.

In this way, by reducing the resolution of the external device based on the resolution information and display size information of the external device, display connection can be performed more accurately and the step difference when moving the pointer between displays can be reduced.

According to one embodiment, in operation 350, the electronic device may identify a connection area with the display of the external device among the first edges of the display based on the adjusted resolution information.

According to one embodiment, the connection area of the display may be an area where a pointer can be moved from the display of the electronic device to the display of the external device.

According to one embodiment, the electronic device adjusts the resolution of the display of the external electronic device based on the resolution of the display of the electronic device and the size of the display of the external electronic device. Connection areas can be identified.

According to one embodiment, since the size of the display of the external electronic device is smaller than the size of the display of the electronic device, the display connection area may be a portion of the first edge.

According to one embodiment, in the 360 operation, the electronic device may display a second UI on the connection area of the first edge indicating that the pointer can be moved to the display of the external device through the connection area.

According to one embodiment, the area where the second UI is displayed may be smaller than the area where the first UI is displayed. According to one embodiment, the first UI is displayed in an area that includes the entirety of the first edge, while the display connection area includes a portion of the first edge, so the second UI corresponding to the display connection area is the first UI. It can be smaller than For example, the second UI may be in the form of a bar that is shorter than the first UI.

According to one embodiment, the electronic device may move the location of the second UI based on receiving a user input for moving the location of the second UI through the second UI. For example, the electronic device may move the position of the second UI through an input of selecting and dragging the second UI, or may move the second UI to a set position by touching the second UI.

According to one embodiment, when the location of the second UI is moved on the display of the electronic device, the electronic device may change the connection area with the display of the external device to the moved location of the second UI.

According to one embodiment, the operation of moving the position of the second UI based on user input will be described below with reference to FIGS. 14A to 15.

According to one embodiment, the electronic device may be connected to each display of a plurality of external devices through a plurality of edges of the display.

According to one embodiment, after the second UI is displayed, the electronic device connects based on receiving a user input that moves the pointer in a second direction away from the display from an area including a second edge different from the first edge of the display. It is possible to check whether there is a possible second external device. According to one embodiment, the operation of checking whether a second external device exists is the same as operation 310, and thus duplicate description will be omitted.

According to one embodiment, based on confirming that there is a second external device that can be connected, the electronic device may display a third UI indicating that a connection is possible in the area including the second edge. According to one embodiment, the operation of displaying the third UI is the same as operation 320, so duplicate descriptions will be omitted.

According to one embodiment, the electronic device may control the communication module to connect to the second external device based on receiving a user input for connecting to the second external device after displaying the first UI. According to one embodiment, the operation of connecting to the second external device is the same as operation 330, so duplicate description will be omitted.

According to one embodiment, the electronic device may adjust resolution information on the display of the second external device based on size information on the display of the second external device received from the second external device. According to one embodiment, the operation of adjusting the resolution information of the display of the second external device is the same as operation 340, so duplicate description will be omitted.

According to one embodiment, the electronic device may identify a connection area with the display of the second external device among the second edges of the display based on the adjusted resolution information. According to one embodiment, the operation of identifying the connection area with the display of the second external device among the second edges is the same as operation 350, and thus duplicate description will be omitted.

According to one embodiment, the electronic device may display a fourth UI notifying that the pointer can be moved to the display of the second external device through the connection area in the connection area of the second edge. According to one embodiment, the operation of displaying the fourth UI is the same as the 360 operation, so duplicate descriptions will be omitted.

According to one embodiment, after displaying the fourth UI, the electronic device may further connect to the display of the third external device through a third edge that is different from the first and second edges of the display.

According to one embodiment, an operation of connecting to each display of a plurality of external devices through a plurality of edges of the display of the electronic device will be described below with reference to FIGS. 9A to 9D.

As such, the electronic device according to various embodiments of the present disclosure can connect to the display of an external device through gesture input even without displaying a separate display connection setting screen. Additionally, by adjusting the resolution of the display of the external device based on the type of the external device and/or the actual size of the display of the external device to connect it to the display of the electronic device, the occurrence of steps when moving the pointer can be reduced.

FIG. 4A is a diagram illustrating a gesture input for connecting an electronic device and an external device according to an embodiment.

Referring to FIG. 4A, the electronic device 101 (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) displays a plurality of edges (e.g., the display module 160 of FIG. 1). : Position the pointer 410 in the area containing the first edge (e.g., the right edge) among the right, left, upper, and lower edges of the display, and point the pointer 410 in the right direction 420 out of the display. You can receive user input that moves with .

According to one embodiment, the electronic device 101 connects a connectable external device (e.g., the electronic device 104 of FIG. 1) based on receiving a user input that moves the pointer 410 in the right direction 420 beyond the display. ) can be found out.

In FIG. 4A, it is shown that a user input moving in the right direction 420 is received while the entire pointer 410 is displayed in the area including the first edge. However, according to one embodiment, a part of the pointer 410 is displayed. A user input moving in the right direction 420 may be received while only a portion of the pointer 410 is displayed in an area including the first edge, such as outside the display.

FIG. 4B is a diagram for explaining a pointer movement operation related to a connection operation of an electronic device with an external device, according to an embodiment.

Referring to FIG. 4B, the electronic device 101 detects that the pointer 410 deviates by a set distance 411 (e.g., 3000px) or more from one of the plurality of edges of the display or a set distance 412 from an edge of the display. When a gesture input approaching the device is detected, scanning for connection to the external device 104 may begin.

According to one embodiment, when the pointer 410 approaches an edge or detects a gesture input that deviates from the edge by a set distance, the electronic device 101 transmits a connection request to the external device 104, A response may be received from the external device 104.

According to one embodiment, the response received from the external device 104 may include information about the external device 104 (eg, Ashley's Tablet).

According to one embodiment, the electronic device 101 stores information about the external device 104 included in the response received from the external device 104 in the memory of the electronic device 101 (e.g., memory 130 of FIG. 1). If it is included in at least one external device information stored in , the external device 104 can be confirmed as a connectable external device, and automatic connection (multi auto connection) or user confirmation for connection can be waited for.

According to one embodiment, the electronic device 101 includes the information of the external device 104 included in the response received from the external device 104 in the device information registered to the server account in which the electronic device 101 is registered. Once this is done, the external device 104 can be confirmed as a connectable external device, and automatic connection (multi auto connection) or user confirmation for connection can be waited for.

According to one embodiment, when the pointer 410 approaches the edge 412, the electronic device 101 may switch to an invisible state so that the pointer 410 is not visible.

FIG. 4C is a diagram illustrating an operation of an electronic device to display a UI indicating that there is an external device that can be connected to the electronic device, according to an embodiment.

Referring to FIG. 4C, based on confirmation that there is an external device connectable to the electronic device 101, the electronic device 101 includes a first UI 430 at the first edge indicating that there is a connectable external device. It can be displayed in the area.

According to one embodiment, if there is a connectable external device, the electronic device 101 may display the first UI 430 in an area including the entire first edge. For example, the first UI 430 may be in the form of a bar displayed in an area including the entire first edge.

According to one embodiment, the electronic device 101 may delete the displayed first UI 430 when a set time elapses after displaying the first UI 430.

According to one embodiment, after displaying the first UI 430, the electronic device 101 may maintain display of the first UI 430 until connected to an external device.

FIG. 4D is a diagram illustrating an operation of displaying a UI for checking whether an electronic device is connected to a connectable external device, according to an embodiment.

Referring to FIG. 4D, if there is a connectable external device, the electronic device 101 may display the first UI 431 (e.g., visual que (affordance)) in an area including the entire first edge.

According to one embodiment, the first UI 431 displays at least one option (e.g., auto connection (on/off)) that can be set on a screen for setting up a connection with the external device 104 (e.g., a multi-control setting screen). , edge alignment, and selection of multiple connected devices) may be further included.

For example, the first UI 431 uses the UI 432 and/or the edge of the display of the electronic device 101 and the display of the external device 104 to allow the user to confirm whether or not it is connected to the external device 104. May include a UI 433 for selecting alignment (e.g. edge alignment).

According to one embodiment, the electronic device 101 connects the display of the electronic device 101 to an external device based on a user input received through the UI 433 for selecting an alignment between displays or a recent alignment between displays stored in memory. The alignment 444 of the display 104 can be confirmed.

According to one embodiment, the electronic device 101 adjusts the resolution information of the display of the external device 104 based on the size information of the display of the external device 104 received from the external device 104, and adjusts the adjusted resolution. Based on the information, the alignment 444 of the display of the electronic device 101 and the display of the external device 104 can be confirmed.

According to one embodiment, the electronic device 101 does not include a UI for confirming from the user whether or not it is connected to the external device 104 in the first UI 431, and provides a separate UI as shown in FIG. 4E. It may also be displayed as. FIG. 4e is a diagram for explaining an operation of displaying a UI for checking whether an electronic device is connected to a connectable external device, according to an embodiment.

Referring to FIG. 4E, the electronic device 101 may display a UI 440 in the area surrounding the first edge to check whether or not it is connected to an external device. For example, the UI 440 for checking whether or not the connection to an external device is connected may be a pop-up message for the user to confirm whether or not to connect to the external device.

According to one embodiment, after the first UI 430 of FIG. 4C is displayed, the electronic device displays the UI 440 in an area of the display (e.g., the center of the display) to ask the user to confirm whether or not it is connected to an external device within a set time. or the surrounding area of the first edge).

According to one embodiment, when the first UI 430 of FIG. 4C is displayed and then deleted, the UI 440 for checking whether or not it is connected to an external device may be displayed in one area of the display.

According to one embodiment, while the display of the first UI 430 of FIG. 4C is maintained, the UI 440 for checking whether or not it is connected to an external device is displayed around the first UI 430, or A part of the UI 440 for checking whether a connection to an external device is present may be displayed to overlay a part of the first UI 430.

According to one embodiment, when the electronic device 101 receives a user input 441 for connecting to an external device through the UI 440 to check whether or not to connect to an external device, the electronic device 101 performs a connection to the external device. can do. According to one embodiment, the electronic device 101 is configured to connect a communication module (e.g., an access point) to connect through a second communication method (e.g., an access point) based on the connectable external device using the same access point (AP). : The communication module 190 in FIG. 1 can be controlled.

According to one embodiment, the electronic device 101 is configured to connect through a third communication method (e.g., Wi-Fi direct) based on the fact that connectable external devices do not use the same access point (AP). Communication modules can be controlled.

According to one embodiment, the electronic device 101 is configured to display the UI 440 to check whether or not to connect to an external device, if no user input is received within a set time, a user input indicating no connection is received, or an external device 101 is displayed. Based on the user input being received in an area other than the UI 440 for checking whether or not connected to the device, the UI 440 for checking whether connected to an external device is deleted and the connection process with the external device is started. You can quit.

FIG. 4F is a diagram illustrating an operation and connection settings of an electronic device displaying a UI indicating that the connection between the electronic device and an external device has been completed, according to an embodiment.

Referring to FIG. 4F, the electronic device 101 can connect the display of the electronic device 101 and the display of the external device 104. According to one embodiment, the electronic device 101 connects the display of the electronic device 101 and the external device 104 so that the pointer 410 displayed on the display of the electronic device 101 can be moved to the display of the external device 104. A display can be connected.

According to one embodiment, the electronic device 101 adjusts the resolution information of the display of the external device 104 based on the size information of the display of the external device 104 received from the external device 104, and adjusts the adjusted resolution. Based on the information, connection areas can be identified.

According to one embodiment, the external device 104 may include a display that has a higher resolution than the resolution of the display of the electronic device 101 and has a smaller size than the display of the electronic device 101.

According to one embodiment, the electronic device 101 displays the external device 104 based on the type information of the external device 104 and/or the size ratio of the display of the electronic device 101 and the display of the external device 104. You can reduce the resolution information on the display.

For example, when the external device 104 is a tablet PC, the electronic device 101 reduces the resolution of the tablet PC to about 80%, and when the external device 104 is a smart phone, the electronic device 101 reduces the resolution of the smart phone to about 60%. It can be reduced to

According to one embodiment, the electronic device 101 may reduce the resolution information of the display of the external device 104 so that the size ratio and resolution ratio of the display of the electronic device 101 and the display of the external device 104 correspond. .

According to one embodiment, the electronic device 101 may identify an area connected to the display of the external device 104 among the first edges of the display based on the adjusted resolution information.

According to one embodiment, the electronic device 101 displays a second UI (UI) in the connection area of the first edge of the display of the electronic device 101, indicating that the pointer can be moved to the display of the external device 104 through the connection area. 450) can be displayed.

According to one embodiment, the electronic device 101 reduces the resolution information of the display of the external device 104 to correspond to the display size ratio and resolution ratio of the display of the electronic device 101 and the external device 104, and reduces the resolution. Based on the information, information (e.g., size and/or position of the UI) of the UI indicating that the pointer to be displayed on the external device 104 can be moved to the display of the electronic device 101 is transmitted to the same access point connected to the external device ( It can be transmitted via AP) or WiFi-direct method.

According to one embodiment, when the entire edge of one side of the display of the external device 104 is connected to a portion of the first edge of the display of the electronic device 101, the external device 104 selects the electronic device from the display of the external device 104. A UI 451 indicating that the pointer can be moved to the display of the electronic device 101 may be displayed in an area including the entire edge connected to the display of the device 101. For example, the external device 104 places a pointer in an area including the entire edge connected to the display of the electronic device 101 based on the information of the UI received from the electronic device 101. A UI 451 indicating that movement is possible can be displayed.

According to one embodiment, when a part of one edge of the display of the external device 104 is connected to a part of the first edge of the display of the electronic device 101, the external device 104 displays the electronic device 104. A UI 451 indicating that the pointer can be moved to the display of the electronic device 101 may be displayed in an area including an edge portion connected to the display of the device 101. For example, the external device 104 sets a pointer to an area including an edge portion connected to the display of the electronic device 101 based on the information of the UI received from the electronic device 101. A UI 451 indicating that movement is possible can be displayed.

According to one embodiment, the length of the second UI 450 and the UI 451 displayed on the display of the external device 104 may correspond. For example, the difference between the length of the second UI 450 and the length of the UI 451 displayed on the display of the external device 104 may be less than a set value (eg, about 5%).

According to one embodiment, when the connection between the display of the electronic device 101 and the display of the external device 104 is completed, the electronic device 101 may display a UI 460 indicating that the connection has been completed. For example, the UI 460 notifying that the connection is complete may be a pop-up message, and may display information about the connected external device 104 and/or the connected external device 104 as an input device (e.g., the input module 150 of FIG. 1 ). ) (e.g. keyboard and/or mouse)) may be included.

According to one embodiment, when activating the display connection settings screen 470 of the electronic device 101, the display connection settings screen 470 displays connection settings between the display of the electronic device 101 and the display of the external device 104. 471 and/or an external device list 472 connectable to the electronic device 101 may be included.

According to one embodiment, as the connection area is identified after reducing the resolution of the display of the external device 104, the connection setting 471 of the display is configured to physically connect the display of the electronic device 101 and the display of the external device 104. The layout (e.g., size and/or location of displays) may be similar.

FIG. 4G is a diagram illustrating an operation of displaying a UI indicating that the connection between an electronic device and an external device has been completed and connection settings, according to an embodiment.

Referring to FIG. 4G, based on completion of connection between the electronic device 101 and the external device 104, the electronic device 101 aligns the display of the electronic device 101 with the display of the external device 104 (444). ) Based on this, a second UI indicating that the pointer 410 can move may be displayed in at least a partial area including the edge of the display.

According to one embodiment, the external device 104 displays the UI 452 indicating that the pointer can move while the electronic device 101 displays the second UI at least in part including an edge of the display of the external device. It can be displayed in the area.

According to one embodiment, the external device 104 indicates that the pointer can be moved based on information in the UI (e.g., the size and/or position of the UI) indicating that the pointer received from the electronic device 101 can be moved. The UI 452 may be displayed on at least a partial area including the edge of the display of the external device. According to one embodiment, information on the UI displayed on the external device 104 may be obtained by the electronic device 101. According to one embodiment, the location and/or size information of the UI displayed on the external device 104 is received through an inter-display alignment (e.g., edge alignment) item included in the second UI displayed on the electronic device 101. It may be acquired by the electronic device 101 based on user input and/or resolution information of the display of the electronic device 101 and the display of the external device 104.

According to one embodiment. The second UI displayed on the display of the electronic device 101 and/or the UI 452 displayed on the display of the external device 104 may disappear after a set time has elapsed after being displayed.

According to one embodiment, after completion of connection, the pointer 410 displayed on the display of the electronic device 101 is aligned 444 between the display of the electronic device 101 and the display of the external device 104 based on user input. When moving to the external device 104 through the edge area of the display of the included electronic device 101, the external device 104 displays a pointer 413 on the display, and the electronic device 101 displays the pointer 410. The mark can be deleted.

FIG. 5 is a diagram illustrating an automatic connection setting operation of an electronic device according to an embodiment.

Referring to FIG. 5, an electronic device (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) connects an external device (e.g., a connectable device) based on a user input through the automatic connection setting screen 510. It is possible to set whether to automatically connect the electronic device 104 in FIG. 1.

According to one embodiment, the automatic connection setting screen 510 includes a first item 511 for performing automatic connection when there is a connectable external device, and automatically connecting only external devices that use the same access point among the connectable external devices. It may include a second item 512 for performing and/or a third item 513 for not performing automatic connection even if there is an external device that can be connected.

According to one embodiment, when automatic connection is set by selecting the first item 511, if a connectable device is confirmed, the electronic device may perform automatic connection regardless of receiving a gesture input for connection. . According to one embodiment, with the display of an external device connected to one side of the display of the electronic device, when a gesture input for connecting the external device is received in the direction in which the external device is connected, the electronic device is already connected to the external device. A UI indicating its presence can be displayed. For example, when a gesture input for connecting an external device is received in the direction in which the external device is connected, the electronic device displays a UI including information on the already connected external device and/or a message asking to disconnect the already connected external device. can do.

According to one embodiment, when automatic connection is not established with at least some of the connectable devices, the electronic device may display a first UI indicating that there is an external device that can be connected.

For example, by selecting the second item 512, only external devices connected to the same access point (AP) can be set to automatically connect, or by selecting the third item 513, automatic connection is not possible. When set to not, the electronic device may respond to receiving a gesture input for connection and, if there is an external device that can be connected, display a first UI indicating that there is an external device that can be connected.

FIG. 6 is a diagram illustrating a connection method of an electronic device with an external device, according to an embodiment.

Referring to FIG. 6, in operation 610, an electronic device (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) may attempt to connect to a device found through Bluetooth (BT). For example, the electronic device determines that an external device connected via Bluetooth is a connectable external device, and when a connectable external device is confirmed or a user input for connecting to a connectable external device is received, the connectable external device is connected to the external device. You can try to connect.

According to one embodiment, in operation 620, the electronic device may check whether a connectable external device is using the same access point (AP) as the electronic device.

According to one embodiment, based on the fact that the connectable external device uses the same AP (operation 620 - example), in operation 630, the electronic device may connect to the external device through the same AP.

According to one embodiment, based on the fact that the connectable external device does not use the same AP (operation 620 - No), in operation 640, the electronic device may connect to the external device through Wi-Fi direct.

In this way, when the external device uses the same AP as the electronic device, less power can be consumed while connected to the external device by connecting to the external device through the same AP.

FIG. 7A is a diagram illustrating connection settings of an electronic device before adjusting the resolution of a display of an external device, according to an embodiment.

FIG. 7B is a diagram illustrating connection settings of an electronic device before adjusting the resolution of a display of an external device, according to an embodiment.

Referring to FIG. 7A, the external device 104 (e.g., the electronic device 104 of FIG. 1) displays the display (e.g., the electronic device 104 of FIG. 1) of the electronic device 101 (e.g., the electronic device 101 of FIG. 1). It may include a display that has a higher resolution than that of the display module 160 and is smaller in size than the display of the electronic device 101. In this case, if the display connection is performed based only on the resolution, the display connection setting 710 is set to a smaller size than the display of the electronic device 101, even though the display of the external device 104 is actually smaller. The display may be larger.

In this case, the electronic device 101 has a display connected to the display of the external device 104 based on the display connection setting 710 when the display connection is performed without adjusting the resolution information of the external device 104. The area including the entire edge of can be identified as a connection area, and a UI 720 indicating that the area including the entire edge is a connection area can be displayed.

In addition, the external device 104 identifies an area including the lower part of the edge of the display of the external device 104 connected to the display of the electronic device 101 as a connection area based on the display connection setting 710, A UI 721 indicating that it is a connection area may be displayed in an area including only the lower part of the edge.

In this case, if you position the pointer at the top of the UI 720 displayed on the electronic device 101 and then move the pointer to the display of the external device 104, the UI 721 displayed on the external device 104 will physically appear. If the pointer moves to the central part of the external device 101, which is the uppermost part of , continuity may be deteriorated, such as a step occurring when the pointer moves between displays.

According to one embodiment, as shown in FIG. 7B, the electronic device 101 displays type information of the external device 104 and/or the size ratio of the display of the electronic device 101 and the display of the external device 104. When the resolution information of the display of the external device 104 is reduced based on the display connection setting 730, the display connection setting 730 is similar to the physical arrangement of the display of the electronic device 101 and the display of the external device 104. The display may be smaller than the display of the electronic device 101.

According to one embodiment, the electronic device 101 adjusts the resolution information of the external device 104 and connects to the display of the external device 104 based on the display connection setting 730 when display connection is performed. The area including the lower part of the edge of the display may be identified as the connection area, and a UI 740 indicating that the area including the lower part of the edge is the connection area may be displayed.

According to one embodiment, the external device 104 selects an area including the entire edge of the display of the external device 104 connected to the display of the electronic device 101 as a connection area based on the display connection setting 730. It can be identified, and a UI 741 indicating that it is a connection area can be displayed in the area including the entire edge.

According to one embodiment, when the pointer is placed at the top of the UI 740 displayed on the electronic device 101 and the pointer is moved to the display of the external device 104, the UI displayed on the electronic device 101 is physically ( By moving the pointer to the uppermost part of the external device 104 connected to the uppermost part of 740), continuity can be improved by reducing the step that occurs when the pointer moves between displays.

FIG. 8A is a diagram illustrating an operation of changing connection settings with an external device through a connection settings screen of an electronic device, according to an embodiment.

FIG. 8B is a diagram illustrating an operation of displaying a UI based on connection settings changed through a connection settings screen of an electronic device according to an embodiment.

Referring to FIG. 8A, an electronic device (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) configures the display based on user input through the display connection settings 810 included in the display connection settings screen. Connection settings 810 can be adjusted.

According to one embodiment, a first external device (e.g., tablet PC) is connected after adjusting the resolution so that the bottom of each display is aligned on the right side of the electronic device, and a second external device (e.g., tablet PC) is connected so that the bottom of each display is aligned on the left side. : Smartphone) is connected after adjusting the resolution, as shown in FIG. 8B, the electronic device 101 (e.g., the electronic device 101 in FIG. 1 or the processor 120 in FIG. 1) is connected to the electronic device ( A connection area with the first external device 104-1 on the entire lower portion of the edge of the right edge of 101) connected to the entire side of the first external device 104-1 (e.g., the electronic device 104 in FIG. 1). The UI 831 displayed as can be displayed. According to one embodiment, as shown in FIG. 8B, the electronic device 101 is connected to the second external device 104-2 (e.g., the electronic device 104 of FIG. 1) among the left edges of the electronic device 101. A UI 833 indicating a connection area with the second external device 104-2 may be displayed on the entire lower portion of the edge connected to one side.

According to one embodiment, the first external device 104-1 displays a UI 832 indicating a connection area with the electronic device 101 in an area including the entire edge connected to one side of the electronic device 101. You can. According to one embodiment, the UI 831 displayed as a connection area with the first external device 104-1 displayed on the display of the electronic device 101 and the electronic device displayed on the display of the first external device 104-1 ( The length of the UI 832 displayed as the connection area with 101) may correspond.

According to one embodiment, the second external device 104-2 displays a UI 834 indicating a connection area with the electronic device 101 in an area including the entire edge connected to one side of the electronic device 101. You can. According to one embodiment, the UI 833 displayed as a connection area with the second external device 104-2 displayed on the display of the electronic device 101 and the electronic device displayed on the display of the second external device 104-2 ( The length of the UI 834 displayed as the connection area with 101) may correspond.

According to one embodiment, in a state where the bottoms of the displays of the electronic device, the first external device, and the second external device are aligned, the electronic device receives a user input 811 that moves the position of the second external device upward and the first A user input 812 that moves the position of the external device downward may be received.

According to one embodiment, the electronic device changes the display connection setting 820 based on the user inputs 811 and 812 by connecting the lower part of the right edge of the electronic device and the upper part of the first external device and the left side of the electronic device. It may include connecting the upper portion of the edge and the lower portion of the right edge of the second external device.

According to one embodiment, in the case of the changed display connection settings 820 of FIG. 8A, as shown in FIG. 8B, the electronic device 101 is connected to the first external device 104-1 among the right edges of the electronic device 101. ) A UI 841 indicating a connection area with the first external device 104-1 is displayed on the entire lower part of the edge connected to the upper part of one side, and the second external device ( 841 ) is displayed on the left edge of the electronic device 101. A UI 843 indicating a connection area with the second external device 104-2 may be displayed on the entire upper part of the edge connected to a lower part of one side of the 104-2).

According to one embodiment, the first external device 104-1 displays a UI 842 that displays the area including the entire upper part of the edge connected to one side of the electronic device 101 as a connection area with the electronic device 101. It can be displayed. According to one embodiment, the UI 841 displayed as a connection area with the first external device 104-1 displayed on the display of the electronic device 101 and the electronic device displayed on the display of the first external device 104-1 ( The length of the UI 842 displayed as the connection area with 101) may correspond. According to one embodiment, when only the top of the first external device 104-1 is connected to the electronic device 101, the UIs 841 and 842 are connected to the electronic device 101 so that the entire side of the first external device 104-1 is connected to the electronic device 101. It may be shorter than UI (831, 832) when connected to 101).

According to one embodiment, the second external device 104-2 displays a UI 844 that displays the area including the entire bottom of the edge connected to one side of the electronic device 101 as a connection area with the electronic device 101. It can be displayed. According to one embodiment, the UI 843 displayed as a connection area with the second external device 104-2 displayed on the display of the electronic device 101 and the electronic device displayed on the display of the second external device 104-2 ( The length of the UI 844 displayed as the connection area with 101) may correspond. According to one embodiment, when only the bottom of the second external device 104-2 is connected to the electronic device 101, the UIs 843 and 844 are configured so that the entire side of the second external device 104-2 is connected to the electronic device (101). It may be shorter than UI (833, 834) when connected to 101).

In this way, as the display connection is performed after adjusting the resolution of the external device, a display connection similar to the physical arrangement is performed. If the physical arrangement of the external device changes as a result, the connection area between displays is changed by changing the connection settings on the display connection settings screen. It can be easily changed.

FIG. 9A is a diagram for explaining existing connection settings of an electronic device with external devices, according to an embodiment.

Referring to FIG. 9A, the existing connection setting 910 configures the first external device 104-1 (e.g., the electronic device 101 in FIG. 1) so that the bottom of each display is aligned to the right side of the electronic device 101 (e.g., the electronic device 101 in FIG. 1). Example: The electronic device 104 of FIG. 1 (e.g., tablet PC) is connected after adjusting the resolution, and the second external device 104-2 (e.g., the electronic device of FIG. 1) is connected so that the bottom of each display is aligned on the left. (104)) (e.g. smartphone) may be connected after adjusting the resolution.

FIG. 9B is a diagram illustrating an operation of an electronic device when a gesture input is received to cancel an existing connection with external devices and establish a connection different from the existing connection setting, according to an embodiment.

Referring to FIG. 9B, when the electronic device 101 releases the existing connection, changes the positions of the external devices 104-1 and 104-2, and then attempts to reconnect, the external device 101 is placed in the direction in which the connection was attempted. Connection with the device can be recommended first.

For example, after disconnecting the second external device 104-2 that was connected to the left side of the electronic device 101 and placing it on the right side of the electronic device 101, the second external device 104-2 is connected to the right edge of the display of the electronic device 101. When a user control that positions the pointer 910 in the area and moves it to the right side of the display 920 is input to the electronic device 101, the electronic device 101 displays a UI 930 indicating that a connectable device exists. You can. According to one embodiment, the electronic device 101 uses a second external device 104-2 physically disposed on the right side of the electronic device 101 based on a user input that moves the pointer 910 to the right side of the display. A UI 931 confirming whether to connect may be displayed.

According to one embodiment, when the second external device 104-2 is most recently disconnected in the existing connection state, the electronic device 101 displays a pointer 910 in the right edge area of the display of the electronic device 101. When a user input is received to position and move to the right side of the display 920, a UI 931 may be displayed to confirm whether to connect the most recently disconnected second external device 104-2.

FIG. 9C is a diagram illustrating an operation of an electronic device when a gesture input is received to cancel an existing connection with external devices and establish a connection different from the existing connection setting, according to an embodiment.

Referring to FIG. 9C, the first external device 104-1 connected to the right side of the electronic device 101 and the second external device 104-2 connected to the left side of the electronic device 101 are disconnected, After placing on the right side of the electronic device 101, inputting a user control to the electronic device 101 to position the pointer 910 in the right edge area of the display of the electronic device 101 and move it to the right side 920 of the display. If so, the electronic device 101 may display a UI 930 indicating that there is a connectable device.

According to one embodiment, the electronic device 101 is configured such that the first external device 104-1 is disposed below the electronic device 101, and the second external device 104-2 is disposed below the electronic device 101. UI that checks whether to connect the first external device 104-1 (e.g., tablet PC) that was most recently connected to the right side of the electronic device 101 based on existing connection settings regardless of the current arrangement on the right side. (940) can also be displayed.

FIG. 9D is a diagram illustrating the operation of an electronic device when an external device to be connected to the direction in which a gesture input is received is not disposed, according to an embodiment.

Referring to FIG. 9D, the first external device 104-1 connected to the right side of the electronic device 101 is disconnected and placed below the electronic device 101, and the first external device 104-1 connected to the left side of the electronic device 101 is disconnected. After disconnecting the second external device 104-2 and placing it on the right side of the electronic device 101, position the pointer 910 on the left edge area of the display of the electronic device 101 and move it to the left side 950 of the display. When a user control to escape is input to the electronic device 101, the electronic device 101 may not display a UI indicating a connectable device because there is no connectable device on the left side of the electronic device 101.

According to one embodiment, the electronic device acquires the location (e.g., distance and/or direction from the electronic device) of the external device through at least one communication method (e.g., Bluetooth 3.0 and/or ultra wide band (UWB)). can do.

According to one embodiment, if there is no connectable external device on the left side of the electronic device 101, but there is a connectable first external device 104-1 in the other direction, the first external device (104-1) UI (UI) for checking whether to connect 104-1 to the left side of the electronic device 101 based on user input or to the bottom of the electronic device 101 based on the location of the first external device 104-1 960) can be displayed.

FIG. 10A is a diagram illustrating an operation of an electronic device when a gesture input for connection is received when a plurality of external devices are placed on one side of the electronic device, according to an embodiment.

Referring to FIG. 10A, the electronic device 101 (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) positions the pointer 1010 in the right edge area of the display of the electronic device 101. When receiving a user input that moves the display to the right side 1020, it can be confirmed whether there is an external device that can be connected to the electronic device 101.

According to one embodiment, if there is an external device that can be connected to the electronic device 101, the electronic device 101 may display a UI 1030 notifying that there is a connectable device.

According to one embodiment, a first external device 104-1 (e.g., electronic device 104 in FIG. 1) and a second external device 104-2 (e.g., FIG. 1) are located on the right side of the electronic device 101. When the electronic devices 104) are arranged side by side and there are a plurality of connectable devices on the right side of the electronic device 101, the electronic device 101 displays a UI 1031 to check whether to connect to all of the plurality of external devices. It can be displayed.

According to one embodiment, the electronic device 101 determines the locations of a plurality of external devices 104-1 and 104-2 through at least one communication method (e.g., Bluetooth 3.0 and/or ultra wide band (UWB)). (e.g., distance and/or direction from the electronic device) can be obtained, and the arrangement order can be obtained through the positions of the plurality of external devices 104-1 and 104-2.

According to one embodiment, when a user input for connecting to a plurality of external devices is received through the UI 1031 that confirms whether to connect to all of the plurality of external devices, the electronic device 101 connects to a plurality of external devices as shown in FIG. 10B. The display can be connected to a plurality of external devices 104-1 and 104-2 so that the pointer can move sequentially based on the arrangement of the external devices 104-1 and 104-2.

FIG. 10B is a diagram for explaining a connection operation of an electronic device when a plurality of external devices are placed on one side of the electronic device, according to an embodiment.

Referring to FIG. 10B, the electronic device 101 may display a UI 1040 indicating a connection area with the first external device 104-1 in an area including a portion of the right edge of the display. According to one embodiment, when a plurality of external devices 104-1 and 104-2 are sequentially connected to one side of the electronic device 101, a UI (UI) indicating the connection area with the first external device 104-1 1040) may be the same as the UI displayed when only one external device is connected to one side of the electronic device 101, but may be in a different form. According to one embodiment, an example of a UI displayed when a plurality of external devices 104-1 and 104-2 are sequentially connected to one side of the electronic device 101 will be described with reference to FIGS. 11A and 11B below. Do this.

According to one embodiment, the first external device 104-1 displays a UI 1041 indicating a connection area with the electronic device 101 in an area including the left edge of the display of the first external device 104-1. It can be displayed.

According to one embodiment, the resolution information of the first external device 104-1 is adjusted based on the size of the display of the first external device 104-1 and then the display connection with the electronic device 101 is performed. , a UI 1040 indicating a connection area with the first external device 104-1 displayed on the display of the electronic device 101 and the electronic device 101 displayed on the display of the first external device 104-1. The length of the UI 1041 representing the connection area may be less than a set difference value (eg, about 5%).

According to one embodiment, the first external device 104-1 has a connection area with the second external device 104-2 in an area including a portion of the right edge of the display of the first external device 104-1. The UI 1042 may be displayed.

According to one embodiment, the second external device 104-2 displays a UI indicating a connection area with the first external device 104-1 in the area including the left edge of the display of the second external device 104-2. (1043) can be displayed.

According to one embodiment, the resolution information of the second external device 104-2 is adjusted based on the size of the display of the second external device 104-2 and then the display is connected to the first external device 104-1. As this is performed, the UI 1042 indicating the connection area with the second external device 104-2 displayed on the display of the first external device 104-1 and the display of the second external device 104-2. The length of the displayed UI 1043 indicating the connection area with the first external device 104-1 may be less than a set difference value (eg, about 5%).

According to one embodiment, the first external device 104-1 and the second external device 104-2 are connected to the display after adjusting the resolution, so the display connection setting 1060 displayed on the display connection setting screen is the electronic device ( 101), the physical arrangement of the first external device 104-1 and the second external device 104-2 may be similar.

FIG. 11A is a diagram illustrating an example of a UI displayed when a plurality of external devices are sequentially connected to one side of the electronic device, according to an embodiment.

FIG. 11B is a diagram illustrating an example of a UI displayed when a plurality of external devices are sequentially connected to one side of the electronic device, according to an embodiment.

Referring to FIG. 11A, the electronic device 101 (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) has a plurality of external devices sequentially connected to one side of the electronic device 101. , a second UI 1110 indicating that each display of a plurality of external devices is sequentially connected from the display of the electronic device may be displayed.

According to one embodiment, the second UI 1110 is a 2-1 UI 1111 indicating a connection area between the electronic device 101 and a first external device (e.g., the electronic device 104 of FIG. 1) connected to the display. may include.

According to one embodiment, the second UI 1110 may include a 2-2 UI 1112 indicating a connection area between the first external device and the second external device connected to the display. According to one embodiment, the electronic device 101 receives display connection information of the first external device and the second external device from the first external device, and creates a connection area between the first external device and the second external device connected to the display. The 2-2 UI 1112 may be displayed.

According to one embodiment, the 2-1 UI 1111 and the 2-2 UI 1112 may be displayed to correspond to the length and/or position of each connection area. In Figure 11a, the length of the 2-2 UI (1112) is shown to be shorter than the length of the 2-1 UI (1111), but depending on the shape of the connection area, it may be longer than the length of the 2-1 UI (1111). It may be possible.

According to one embodiment, the 2-1 UI 1111 and the 2-2 UI 1112 may further include information on an external device connected to the display. For example, the 2-1 UI 1111 may have a color corresponding to the first external device, and the 2-2 UI 1112 may have a color corresponding to the second external device.

According to one embodiment, the 2-1 UI 1111 and the 2-2 UI 1112 may include information on an external device connected to the display as an icon, as shown in FIG. 11B. For example, the 2-1 UI 1111 may include an icon 1120 corresponding to a tablet PC, which is a first external device, and the 2-2 UI 1112 may include a smartphone and a second external device. It may include a corresponding icon 1121.

According to one embodiment, in FIG. 11B, icons 1120 and 1121 are shown as being displayed on the 2-1 UI 1111 and the 2-2 UI 1112, but the 2-1 UI 1111 and It may be displayed in the surrounding area of the 2-2 UI 1112 (e.g., above, below, or to the sides of the 2-1 UI 1111 and the 2-2 UI 1112).

FIG. 12A is a diagram illustrating an operation of an electronic device when a gesture input for connection is received when a plurality of external devices are placed on one side of the electronic device, according to an embodiment.

Referring to FIG. 12A, the electronic device 101 (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) positions the pointer 1210 in the right edge area of the display of the electronic device 101. When receiving a user input that moves the display to the right side 1220, it can be confirmed whether there is an external device that can be connected to the electronic device 101.

According to one embodiment, if there is an external device that can be connected to the electronic device 101, the electronic device 101 may display a UI 1230 notifying that there is a connectable device.

According to one embodiment, on the right side of the electronic device 101, there is a first external device 104-1 (e.g., the electronic device 104 of FIG. 1) and a second external device 104-2 (e.g., the electronic device 104-2 of FIG. 1). When the electronic device 104) and the third external device 104-3 (e.g., the electronic device 104 of FIG. 1) are arranged side by side and there are multiple devices connectable to the right of the electronic device 101, the electronic device 104-3 The device 101 may display a UI 1240 for selecting an external device to connect among the plurality of external devices 104-1, 104-2, and 104-3.

According to one embodiment, the electronic device 101 communicates with a plurality of external devices 104-1, 104-2, and 104- through at least one communication method (e.g., Bluetooth 3.0 and/or ultra wide band (UWB)). 3) The location (e.g., distance and/or direction from the electronic device) can be obtained, and the arrangement order can be obtained through the positions of the plurality of external devices 104-1, 104-2, and 104-3. You can.

According to one embodiment, the UI 1240 for selecting an external device to connect among a plurality of external devices 104-1, 104-2, and 104-3 includes information on the first external device 104-1 and It may include an item 1241 for selection, an item 1242 for information and selection of the second external device 104-2, and an item 1243 for information and selection of the third external device 104-3. You can.

According to one embodiment, when the first external device 104-1 and the second external device 104-2 are selected and the third external device 104-3 is not selected, as shown in FIG. 12B Display connection can be performed.

FIG. 12B is a diagram for explaining a connection operation of an electronic device when a plurality of external devices are placed on one side of the electronic device, according to an embodiment.

Referring to FIG. 12B, the electronic device 101 may display a UI 1250 indicating a connection area with the first external device 104-1 in an area including a portion of the right edge of the display. According to one embodiment, the UI 1250 indicating the connection area with the first external device 104-1 may be in the form of FIG. 11A or FIG. 11B.

According to one embodiment, the first external device 104-1 displays a UI 1251 indicating a connection area with the electronic device 101 in an area including the left edge of the display of the first external device 104-1. It can be displayed.

According to one embodiment, the resolution information of the first external device 104-1 is adjusted based on the size of the display of the first external device 104-1 and then the display connection with the electronic device 101 is performed. , a UI 1250 indicating a connection area with the first external device 104-1 displayed on the display of the electronic device 101 and the electronic device 101 displayed on the display of the first external device 104-1. The length of the UI 1251 representing the connection area may be less than a set difference value.

According to one embodiment, the first external device 104-1 has a connection area with the second external device 104-2 in an area including a portion of the right edge of the display of the first external device 104-1. The UI 1255 may be displayed.

According to one embodiment, the second external device 104-2 displays a UI indicating a connection area with the first external device 104-1 in the area including the left edge of the display of the second external device 104-2. (1256) can be displayed.

According to one embodiment, the resolution information of the second external device 104-2 is adjusted based on the size of the display of the second external device 104-2 and then the display is connected to the first external device 104-1. As this is performed, the UI 1255 indicating the connection area with the second external device 104-2 displayed on the display of the first external device 104-1 and the display of the second external device 104-2. The length of the displayed UI 1256 indicating the connection area with the first external device 104-1 may be less than a set difference value (eg, about 5%).

According to one embodiment, the third external device 104- is connected through the UI 1240 for selecting an external device to be connected among the plurality of external devices 104-1, 104-2, and 104-3 shown in FIG. 12A. Based on 3) not being selected, display connection may not be performed between the second external device 104-2 and the third external device 104-3.

According to one embodiment, since the first external device 104-1 and the second external device 104-2 are connected to the display after adjusting the resolution, the display connection settings 1261 displayed on the display connection settings screen 1260 are The physical arrangement of the electronic device 101, the first external device 104-1, and the second external device 104-2 may be similar.

FIG. 12C illustrates an operation of setting an external device to be connected through a UI displayed based on a gesture input for connection when a plurality of external devices are placed on one side of the electronic device according to an embodiment of the present invention. It is a drawing.

Referring to FIG. 12C, the electronic device 101 displays a first external device ( An item 1241 for information and selection of 104-1), an item 1242 for information and selection of the second external device 104-2, and an item 1242 for information and selection of the third external device 104-3. The first external device 104-1 and the third external device 104-3 may be selected through the item 1243, and the second external device 104-2 may receive a non-selected user input.

According to one embodiment, based on a user input that selects the first external device 104-1 and the third external device 104-3 and does not select the second external device 104-2, FIG. 12C Display connection may be performed as shown in .

According to one embodiment, the electronic device 101 may display a UI 1270 indicating a connection area with the first external device 104-1 in an area including a portion of the right edge of the display. According to one embodiment, the UI 1270 indicating the connection area with the first external device 104-1 may be in the form of FIG. 12A or FIG. 12B.

According to one embodiment, the first external device 104-1 displays a UI 1271 indicating a connection area with the electronic device 101 in an area including the left edge of the display of the first external device 104-1. It can be displayed.

According to one embodiment, the resolution information of the first external device 104-1 is adjusted based on the size of the display of the first external device 104-1 and then the display connection with the electronic device 101 is performed. , a UI 1270 indicating a connection area with the first external device 104-1 displayed on the display of the electronic device 101 and the electronic device 101 displayed on the display of the first external device 104-1. The length of the UI 1271 representing the connection area may be less than a set difference value (e.g., about 5%).

According to one embodiment, the first external device 104-1 displays a UI indicating a connection area with the third external device 104-3 in the area including the right edge of the display of the first external device 104-1. (1272) can be displayed.

According to one embodiment, the third external device 104-3 has a connection area with the first external device 104-1 in an area including a portion of the left edge of the display of the third external device 104-3. The UI 1273 may be displayed.

According to one embodiment, the resolution information of the third external device 104-3 is adjusted based on the size of the display of the third external device 104-3 and then the display is connected to the first external device 104-1. As this is performed, the UI 1272 indicating the connection area with the third external device 104-3 displayed on the display of the first external device 104-1 and the display of the third external device 104-3 The length of the displayed UI 1273 indicating the connection area with the first external device 104-1 may be less than a set difference value (eg, about 5%).

According to one embodiment, the second external device 104-2 is not selected through the UI 1240 for selecting an external device to connect among the plurality of external devices 104-1, 104-2, and 104-3. Based on this, the display connection of the second external device 104-2 may not be performed.

According to one embodiment, the first external device 104-1 and the third external device 104-3 are connected to the display after adjusting the resolution, so the display connection settings 1262 displayed on the display connection settings screen 1260 are The physical arrangement of the electronic device 101, the first external device 104-1, and the third external device 104-3 may be similar.

FIG. 13A illustrates setting the external device to be connected and/or the connection order through a UI displayed based on a gesture input for connection when a plurality of external devices are placed on one side of the electronic device according to an embodiment. This is a drawing to explain the operation.

Referring to FIG. 13A, the electronic device 101 (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) positions the pointer 1310 in the right edge area of the display of the electronic device 101. When receiving a user input that moves the display to the right side 1320, it is possible to check whether there is an external device that can be connected to the electronic device 101.

According to one embodiment, if there is an external device that can be connected to the electronic device 101, the electronic device 101 may display a UI 1330 notifying that there is a connectable device.

According to one embodiment, on the right side of the electronic device 101, there is a first external device 104-1 (e.g., the electronic device 104 of FIG. 1) and a second external device 104-2 (e.g., the electronic device 104-2 of FIG. 1). When the electronic device 104) and the third external device 104-3 (e.g., the electronic device 104 of FIG. 1) are disposed and there are multiple devices that can be connected to the right side of the electronic device 101, the electronic device 104-3 101 may display a UI 1340 for selecting an external device to be connected among a plurality of external devices 104-1, 104-2, and 104-3.

According to one embodiment, the electronic device 101 communicates with a plurality of external devices 104-1, 104-2, and 104- through at least one communication method (e.g., Bluetooth 3.0 and/or ultra wide band (UWB)). 3) The location (e.g., distance and/or direction from the electronic device) can be obtained, and the arrangement order can be obtained through the positions of the plurality of external devices 104-1, 104-2, and 104-3. You can.

According to one embodiment, the electronic device 101 connects the plurality of external devices 104-1, 104-3 based on the arrangement order through the positions of the plurality of external devices 104-1, 104-2, and 104-3. A UI 1340 for selecting an external device to connect among (-2, 104-3) can be displayed. For example, the electronic device 101 identifies the first external device 104-1 as being closer to the electronic device 101 than the second external device 104-2, and uses a UI for selecting an external device to connect. 1340), the first external device 104-1, the second external device 104-2, and the third external device 104-3 may be displayed in that order.

According to one embodiment, the UI 1340 for selecting an external device to connect may include a UI 1341 for changing the arrangement order of the plurality of external devices 104-1, 104-2, and 104-3. You can.

According to one embodiment, when a user input for changing the arrangement order is received through the UI 1340 for selecting an external device to be connected, the electronic device 101 connects a plurality of external devices 104-1 and 104-2. , 104-3) can be changed. For example, when a user input that raises the second external device 104-2 to a higher priority than the first external device 104-1 is received, the electronic device 101 The external device 104-1 and the third external device 104-3 can be displayed in that order.

According to one embodiment, when the second external device 104-2 and the first external device 104-1 are selected through the UI 1340 for selecting an external device to be connected, the display as shown in FIG. 13B Connection can be performed.

FIG. 13B is a diagram illustrating connection settings of an electronic device and a plurality of external devices according to settings input through the UI of FIG. 13A.

Referring to FIG. 13B, the electronic device 101 may display a UI 1350 indicating a connection area with the second external device 104-2 in an area including a portion of the right edge of the display. According to one embodiment, the UI 1350 indicating the connection area with the second external device 104-2 may be in the form of FIG. 11A or FIG. 11B.

According to one embodiment, the second external device 104-2 displays a UI 1351 indicating a connection area with the electronic device 101 in the area including the left edge of the display of the second external device 104-2. It can be displayed.

According to one embodiment, the resolution information of the second external device 104-2 is adjusted based on the size of the display of the second external device 104-2 and then the display connection with the electronic device 101 is performed. , a UI 1350 indicating a connection area with the second external device 104-2 displayed on the display of the electronic device 101 and the electronic device 101 displayed on the display of the second external device 104-2. The length of the UI 1351 representing the connection area may be less than a set difference value (e.g., about 5%).

According to one embodiment, the second external device 104-2 has a connection area with the first external device 104-1 in an area including a portion of the right edge of the display of the second external device 104-2. The UI 1360 may be displayed.

According to one embodiment, the first external device 104-1 displays a UI indicating a connection area with the second external device 104-2 in the area including the left edge of the display of the first external device 104-1. (1361) can be displayed.

According to one embodiment, the resolution information of the first external device 104-1 is adjusted based on the size of the display of the first external device 104-1 and then the display is connected to the second external device 104-2. As this is performed, the UI 1360 indicating the connection area with the first external device 104-1 displayed on the display of the second external device 104-2 and the display of the first external device 104-1. The length of the displayed UI 1361 indicating the connection area with the second external device 104-2 may be less than a set difference value (eg, about 5%).

According to one embodiment, the third external device 104- is connected through the UI 1340 for selecting an external device to be connected among the plurality of external devices 104-1, 104-2, and 104-3 shown in FIG. 13A. Based on 3) not being selected, display connection may not be performed between the second external device 104-2 and the third external device 104-3.

In this way, even if the arrangement order of the external devices identified by the electronic device is different from the arrangement order of the external devices determined by the user, the arrangement order of the external devices identified by the electronic device is changed through user input, and based on the changed arrangement order, Display connections can be performed sequentially.

FIG. 14A is a diagram illustrating an operation of moving a UI corresponding to a connection area displayed on a display of an electronic device according to an embodiment of the present disclosure by a user input.

Referring to FIG. 14A, the electronic device 101 (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) displays the display of the electronic device 101 (e.g., the display module 160 of FIG. 1). ) may be displayed on one edge of the second UI 1410 indicating a connection area with an external device (e.g., the electronic device 104 of FIG. 1). For example, the electronic device 101 may display the second UI 1410 on the right edge of the display.

According to one embodiment, when an input for dragging the second UI 1410 to another edge of the display is received after selecting the second UI 1410, the electronic device 101 may change the position of the second UI 1410 based on the drag input. . For example, when the input 1420 of selecting the second UI 1410 displayed on the right edge of the display and then dragging it toward the left edge is received, the electronic device 101 selects the second UI 1410 displayed on the right edge of the display. can be displayed.

According to one embodiment, the electronic device 101 may change the connection area with the display of the external device to the location of the changed second UI 1411 based on the changed location of the second UI 1411. For example, the electronic device 101 may move the pointer to the external device through the changed location of the second UI 1411.

According to one embodiment, the electronic device 101 determines the location of the external device (e.g., the distance and/or direction from the electronic device) through at least one communication method (e.g., Bluetooth 3.0 and/or ultra wide band (UWB)). ), the position of the second UI can be changed based on confirmation that it has changed. For example, based on the electronic device 101 confirming that an external device placed on the right side of the electronic device 101 moves to the left side of the electronic device 101 through at least one communication method, the electronic device 101 ) can be moved to the left edge of the display. For example, the electronic device 101 may delete the second UI 1410 displayed on the right edge of the display of the electronic device 101 and display the second UI 1411 on the left edge of the display.

FIG. 14B is a diagram illustrating an operation of moving a UI corresponding to a connection area displayed on a display of an electronic device according to an embodiment of the present invention by a user input.

Referring to FIG. 14B, the electronic device 101 may display a second UI 1410 indicating a connection area with an external device on one edge of the display of the electronic device 101. For example, the electronic device 101 may display the second UI 1410 on the right edge of the display.

According to one embodiment, when an input for touching the second UI 1410 is received, the electronic device 101 may change the position of the second UI 1410 based on a set order. For example, when the second UI 1410 displayed on the right edge of the display is touched (1430), the electronic device 101 may display the second UI 1412 on the upper edge of the display.

According to one embodiment, the electronic device 101 may change the connection area with the display of the external device to the location of the changed second UI 1412 based on the changed location of the second UI 1412. For example, the electronic device 101 may move the pointer to the external device through the changed location of the second UI 1412.

According to one embodiment, when an input 1431 that touches the second UI 1412 displayed on the upper edge of the display is received, the electronic device 101 moves to the left edge of the display based on the set order. The second UI 1413 may be displayed.

According to one embodiment, the electronic device 101 may change the connection area with the display of the external device to the location of the changed second UI 1413 based on the changed location of the second UI 1413. For example, the electronic device 101 may move the pointer to the external device through the changed location of the second UI 1413.

In FIG. 14B, the second UI is shown to move in the order of the right edge, top edge, and left edge of the display, but it can also be moved to the bottom edge, and the movement order is not limited to this.

FIG. 15 is a diagram illustrating an operation of changing the size of a UI corresponding to a connection area displayed on a display according to a user input, according to an embodiment.

Referring to FIG. 15, the electronic device 101 (e.g., the electronic device 101 of FIG. 1 or the processor 120 of FIG. 1) displays the display of the electronic device 101 (e.g., the display module 160 of FIG. 1). ) displays a second UI 1510 indicating a connection area with an external device (e.g., the electronic device 104 in FIG. 1) on one edge, and the external device displays a UI 1511 smaller than the second UI 1510. It can be displayed. For example, the electronic device 101 displays the second UI 1510 on the right edge of the display, and the external device displays a UI 1511 smaller than the second UI 1510 on the left edge of the display of the external device. You can.

According to one embodiment, when a user input 1520 for reducing the length of the second UI 1510 is received, the electronic device 101 may display the second UI 1530 with the reduced length. For example, when a drag input 1520 to reduce the length of the second UI 1510 is received, the electronic device 101 may display the second UI 1530 whose length has been reduced based on the drag input.

According to one embodiment, the electronic device 101 may change the connection area with the display of the external device based on the second UI 1530 whose length has been reduced. For example, the electronic device 101 may adjust the resolution of the display of the electronic device 101 and/or the display of the external device so that the pointer can be moved to the external device only through the second UI 1530 of reduced length.

According to one embodiment, an electronic device may include a communication module, a display, and at least one processor operatively connected to the communication module and the display.

According to one embodiment, the at least one processor determines whether there is a connectable external device based on receiving a user input that moves a pointer from an area including a first edge of the display in a first direction away from the display. You can check.

According to one embodiment, based on confirmation that there is an external device that can be connected, the at least one processor may display a first UI indicating that a connection is possible in an area including the first edge.

According to one embodiment, the at least one processor may control the communication module to connect to the external device based on receiving a user input for connecting to the external device after displaying the first UI.

According to one embodiment, the at least one processor may adjust resolution information on the display of the external device based on size information on the display of the external device received from the external device.

According to one embodiment, the at least one processor may identify a connection area with the display of the external device among the first edges of the display based on the adjusted resolution information.

According to one embodiment, the at least one processor may display a second UI notifying that the pointer can be moved to the display of the external device through the connection area on the connection area of the first edge.

According to one embodiment, the external device may include a display that has a resolution higher than that of the display and is smaller than the display.

According to one embodiment, the at least one processor may reduce resolution information on the display of the external device.

According to one embodiment, the at least one processor may reduce the resolution information of the display of the external device at a rate corresponding to the type information of the external device, based on the type information of the external device.

According to one embodiment, the at least one processor may reduce resolution information of the display of the external device so that the size ratio and resolution ratio of the display and the display of the external device correspond.

According to one embodiment, the area where the second UI is displayed may be smaller than the area where the first UI is displayed.

According to one embodiment, the at least one processor may control the communication module to connect through the access point based on the connectable external device using the same access point (AP).

According to one embodiment, the at least one processor controls the communication module to connect via Wi-Fi direct based on the connectable external device not using the same access point (AP). You can.

According to one embodiment, the at least one processor is configured to connect the external device that was most recently disconnected from the display among the plurality of external devices based on confirmation that there are a plurality of connectable external devices. Communication modules can be controlled.

According to one embodiment, the at least one processor, based on determining that there are a plurality of connectable external devices, selects the external device whose connection through the first edge of the display is most recently released among the plurality of external devices. The communication module can be controlled to connect to a device.

According to one embodiment, the at least one processor is configured to, after the second UI is displayed, a user moves a pointer in a second direction away from the display from an area including a second edge different from the first edge of the display. Based on the input being received, it can be confirmed whether there is a second external device that can be connected.

According to one embodiment, based on confirmation that there is a second external device that can be connected, the at least one processor may display a third UI indicating that a connection is possible in the area including the second edge.

According to one embodiment, the at least one processor controls the communication module to connect to the second external device based on receiving a user input for connecting to the second external device after displaying the second UI. can do.

According to one embodiment, the at least one processor may adjust resolution information of the display of the second external device based on size information of the display of the second external device received from the second external device.

According to one embodiment, the at least one processor may identify a connection area with the display of the second external device among the second edges of the display based on the adjusted resolution information.

According to one embodiment, the at least one processor may display a fourth UI on the connection area of the second edge notifying that the pointer can be moved to the display of the second external device through the connection area. there is.

According to one embodiment, the at least one processor may connect the pointer to sequentially move to each display of the plurality of external devices based on confirmation that the plurality of external devices are arranged side by side in the first direction. there is.

According to one embodiment, the second UI may include information about the type and/or connection order of each of the plurality of external devices.

According to one embodiment, the at least one processor may display a fourth UI in a peripheral area of the first edge to check whether or not a connection is made to the external device after displaying the first UI.

According to one embodiment, the at least one processor may control the communication module to connect to the external device based on receiving the user input for connecting to the external device through the fourth UI.

According to one embodiment, the fourth UI includes an item for setting whether to connect each of the plurality of external devices and/or setting the connection order based on confirmation that the plurality of external devices are arranged side by side in the first direction. can do.

According to one embodiment, the at least one processor may connect the pointer to sequentially move the pointer to each display of external devices selected through the fourth UI in a connection order set through the fourth UI.

According to one embodiment, the at least one processor may move the position of the third UI based on receiving a user input for moving the position of the second UI through the second UI.

According to one embodiment, the at least one processor may change the connection area with the display of the external device to the moved location of the second UI.

According to one embodiment, a method of controlling an electronic device includes, based on receiving a user input moving a pointer from an area including a first edge of a display of the electronic device in a first direction away from the display, a connectable external device. It may include an operation to check whether .

According to one embodiment, a method of controlling an electronic device may include displaying a first UI indicating that a connection is possible in an area including the first edge, based on confirmation that there is an external device that can be connected. there is.

According to one embodiment, a method of controlling an electronic device includes controlling a communication module of the electronic device to connect to the external device based on receiving a user input for connecting to the external device after displaying the first UI. Can include actions.

According to one embodiment, a method of controlling an electronic device may include adjusting resolution information of a display of the external device based on size information of the display of the external device received from the external device.

According to one embodiment, a method of controlling an electronic device may include identifying a connection area with a display of the external device among the first edges of the display based on the adjusted resolution information.

According to one embodiment, a method of controlling an electronic device includes displaying a second UI notifying that the pointer can be moved to the display of the external device through the connection area on the connection area of the first edge. can do.

According to one embodiment, the external device may include a display that has a resolution higher than that of the display and is smaller than the display.

According to one embodiment, the operation of adjusting the resolution information of the display of the external device may reduce the resolution information of the display of the external device.

According to one embodiment, the operation of adjusting the resolution information of the display of the external device includes adjusting the resolution information of the display of the external device at a ratio corresponding to the type information of the external device, based on the type information of the external device. It can be reduced.

According to one embodiment, the operation of adjusting the resolution information of the display of the external device may reduce the resolution information of the display of the external device so that the size ratio and resolution ratio of the display and the display of the external device correspond.

According to one embodiment, the area where the second UI is displayed may be smaller than the area where the first UI is displayed.

According to one embodiment, the operation of controlling the communication module of the electronic device to connect to the external device is based on the connectable external device using the same access point (AP) through the access point. The communication module can be controlled to connect.

According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs, the one or more programs comprising: an electronic device configured to store a first edge of the display, It may include commands to check whether there is a connectable external device based on receiving a user input that moves the pointer in a direction.

According to one embodiment, the one or more programs include instructions for displaying a first UI indicating that a connection is possible in an area including the first edge, based on the electronic device confirming that there is a connectable external device. It can be included.

According to one embodiment, the one or more programs control the communication module so that the electronic device connects to the external device based on receiving a user input for connecting to the external device after displaying the first UI. May contain commands.

According to one embodiment, the one or more programs may include instructions that allow the electronic device to adjust resolution information on the display of the external device based on size information on the display of the external device received from the external device. .

According to one embodiment, the one or more programs may include instructions for the electronic device to identify a connection area with the display of the external device among the first edges of the display based on the adjusted resolution information. .

According to one embodiment, the one or more programs display, in the connection area of the first edge, a second UI notifying that the pointer can be moved to the display of the external device through the connection area. May contain commands.

According to one embodiment, the external device may include a display that has a resolution higher than that of the display and is smaller than the display.

According to one embodiment, the one or more programs may include instructions for the electronic device to reduce resolution information on the display of the external device.

According to one embodiment, the one or more programs include instructions that cause the electronic device to reduce the resolution information of the display of the external device at a rate corresponding to the type information of the external device, based on the type information of the external device. can do.

According to one embodiment, the one or more programs may include instructions for the electronic device to reduce resolution information of the display of the external device so that the size ratio and resolution ratio of the display and the display of the external device correspond.

According to one embodiment, the area where the second UI is displayed may be smaller than the area where the first UI is displayed.

According to one embodiment, the one or more programs control the communication module so that the electronic device connects through the access point based on the connectable external device using the same access point (AP). May contain commands.

According to one embodiment, the one or more programs, the communication module allows the electronic device to connect via Wi-Fi direct based on the connectable external device not using the same access point (AP). It may include commands that control .

According to one embodiment, the one or more programs may be performed by the electronic device, based on confirmation that there are a plurality of connectable external devices, and an external device that was most recently disconnected from the display among the plurality of external devices. It may include commands that control the communication module to connect.

According to one embodiment, the one or more programs may be configured to cause the electronic device to determine that the connection through the first edge of the display among the plurality of external devices is the most recent, based on confirmation that there are a plurality of connectable external devices. It may include commands that control the communication module to connect to a released external device.

According to one embodiment, the one or more programs, after the second UI is displayed, display a pointer in a second direction away from the display from an area including a second edge different from the first edge of the display. It may include commands for checking whether there is a second external device that can be connected, based on receiving a user input that moves the device.

According to one embodiment, the one or more programs display a third UI indicating that a connection is possible based on the electronic device confirming that there is a second external device that can be connected, in an area including the second edge. May contain commands.

According to one embodiment, the one or more programs communicate with the electronic device to connect with the second external device based on receiving a user input for connecting with the second external device after displaying the third UI. It may contain instructions including instructions that control the module.

According to one embodiment, the one or more programs allow the electronic device to adjust resolution information of the display of the second external device based on size information of the display of the second external device received from the second external device. May contain commands.

According to one embodiment, the one or more programs may include instructions for the electronic device to identify a connection area with the display of the second external device among the second edges of the display based on the adjusted resolution information. You can.

According to one embodiment, the one or more programs display a fourth UI in the connection area of the second edge, indicating that the pointer can be moved to the display of the second external device through the connection area. It may contain display commands.

According to one embodiment, the one or more programs may sequentially move the pointer to each display of the plurality of external devices based on the electronic device confirming that the plurality of external devices are arranged side by side in the first direction. It may contain commands that connect to:

According to one embodiment, the second UI may include information about the type and/or connection order of each of the plurality of external devices.

According to one embodiment, the one or more programs include commands that cause the electronic device to display a fourth UI in the surrounding area of the first edge to check whether or not the external device is connected after displaying the first UI. It can be included.

According to one embodiment, the one or more programs control the communication module so that the electronic device connects to the external device based on receiving the user input for connecting to the external device through the fourth UI. May contain commands.

According to one embodiment, the fourth UI includes an item for setting whether to connect each of the plurality of external devices and/or setting the connection order based on confirmation that the plurality of external devices are arranged side by side in the first direction. can do.

According to one embodiment, the one or more programs are instructions for connecting the electronic device to enable the pointer to sequentially move to each display of external devices selected through the fourth UI in a connection order set through the fourth UI. may include.

According to one embodiment, the one or more programs include a command for the electronic device to move the location of the second UI based on receiving a user input for moving the location of the second UI through the third UI. may include.

According to one embodiment, the one or more programs may include commands that cause the electronic device to change the connection area with the display of the external device to the moved location of the second UI.

Electronic devices according to embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to those components in other respects (e.g., importance or order) is not limited. One (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” Where mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term "module" used in embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

One embodiment of the present document is one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is stored semi-permanently in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, the method according to the embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play StoreTM) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store server, or a relay server.

According to one embodiment, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to one embodiment, one or more of the above-described corresponding components or operations may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component of the plurality of components prior to the integration. . According to embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

Claims (20)

In electronic devices,
communication module;
display;
At least one processor operatively connected to the communication module and the display,
The at least one processor,
Based on receiving a user input that moves a pointer from an area including a first edge of the display in a first direction away from the display, determine whether there is a connectable external device,
Based on confirmation that there is a connectable external device, displaying a first UI indicating that a connection is possible in the area including the first edge,
Controlling the communication module to connect to the external device based on receiving a user input for connecting to the external device after displaying the first UI,
Adjusting the resolution information of the display of the external device based on the size information of the display of the external device received from the external device,
Identifying a connection area with the display of the external device among the first edges of the display based on the adjusted resolution information,
An electronic device configured to display a second UI on the connection area among the first edges, indicating that the pointer can be moved to the display of the external device through the connection area.
According to paragraph 1,
The external device is,
A display having a resolution higher than that of the display and smaller than the display,
The at least one processor,
An electronic device that reduces resolution information on a display of the external device.
According to paragraph 2,
The at least one processor,
An electronic device that reduces resolution information on a display of the external device at a rate corresponding to the type information of the external device, based on the type information of the external device.
According to paragraph 2,
The at least one processor,
An electronic device that reduces resolution information of the display of the external device so that the size ratio and resolution ratio of the display and the display of the external device correspond.
According to any one of claims 2 to 4,
The area where the second UI is displayed is,
The electronic device is smaller than the area where the first UI is displayed.
According to any one of claims 1 to 5,
The at least one processor,
An electronic device that controls the communication module to connect through the access point, based on the connectable external device using the same access point (AP).
According to any one of claims 1 to 5,
The at least one processor,
An electronic device that controls the communication module to connect via Wi-Fi direct based on the fact that the connectable external devices do not use the same access point (AP).
According to any one of claims 1 to 7,
The at least one processor,
An electronic device that controls the communication module to connect to the external device that was most recently disconnected from the display among the plurality of external devices, based on confirmation that there are a plurality of connectable external devices.
According to any one of claims 1 to 7,
The at least one processor,
An electronic device that controls the communication module to connect to an external device whose connection through the first edge of the display was most recently released among the plurality of external devices, based on confirmation that there are a plurality of connectable external devices.
According to any one of claims 1 to 9,
The at least one processor,
After the second UI is displayed, a second connectable external device is received based on receiving a user input that moves a pointer in a second direction away from the display from an area including a second edge different from the first edge of the display. Check whether there is a
Based on confirmation that there is a second external device that can be connected, displaying a third UI indicating that a connection is possible in the area including the second edge,
Controlling the communication module to connect with the second external device based on receiving a user input for connecting with the second external device after displaying the third UI,
Adjusting the resolution information of the display of the second external device based on the size information of the display of the second external device received from the second external device,
Identifying a connection area with the display of the second external device among the second edges of the display based on the adjusted resolution information,
An electronic device that displays a fourth UI on the connection area among the second edges, indicating that the pointer can be moved to the display of the second external device through the connection area.
According to any one of claims 1 to 10,
The at least one processor,
An electronic device that connects the pointer to sequentially move to each display of the plurality of external devices based on confirmation that the plurality of external devices are arranged side by side in the first direction.
According to clause 11,
The second UI is,
An electronic device including information about the type and/or connection order of each of the plurality of external devices.
According to any one of claims 10 to 12,
The at least one processor,
After displaying the first UI, displaying a fourth UI in the surrounding area of the first edge to check whether or not the connection is made with the external device,
An electronic device that controls the communication module to connect to the external device based on receiving the user input for connecting to the external device through the fourth UI.
According to clause 13,
The fourth UI is,
Based on confirmation that a plurality of external devices are arranged side by side in the first direction, an item for setting whether to connect each of the plurality of external devices and/or setting a connection order,
The at least one processor,
An electronic device that connects the pointer so that it can sequentially move to each display of external devices selected through the fourth UI in a connection order set through the fourth UI.
According to any one of claims 1 to 14,
The at least one processor,
Moving the location of the second UI based on receiving a user input for moving the location of the second UI through the second UI,
An electronic device that changes the connection area with the display of the external device to the moved location of the third UI.
In a method of controlling an electronic device,
Checking whether there is a connectable external device based on receiving a user input that moves a pointer from an area including a first edge of the display of the electronic device in a first direction away from the display;
Based on confirmation that there is a connectable external device, displaying a first UI indicating that a connection is possible in an area including the first edge;
Controlling a communication module of the electronic device to connect to the external device based on receiving a user input for connecting to the external device after displaying the first UI;
adjusting resolution information of the display of the external device based on size information of the display of the external device received from the external device;
identifying a connection area with a display of the external device among the first edges of the display based on the adjusted resolution information; and
Displaying a second UI on the connection area among the first edges indicating that the pointer can be moved to the display of the external device through the connection area.
According to clause 16,
The external device is,
A display having a resolution higher than that of the display and smaller than the display,
The operation of adjusting the resolution information of the display of the external device is:
A control method for an electronic device that reduces resolution information on a display of the external device.
According to clause 17,
The operation of adjusting the resolution information of the display of the external device is:
A control method of an electronic device that reduces resolution information on a display of the external device at a rate corresponding to the type information of the external device, based on the type information of the external device.
According to clause 17,
The operation of adjusting the resolution information of the display of the external device is:
A control method for an electronic device that reduces resolution information of the display of the external device so that the size ratio and resolution ratio of the display and the display of the external device correspond.
According to any one of claims 17 to 19,
The area where the second UI is displayed is,
A method of controlling an electronic device, wherein the first UI is smaller than the displayed area.

Images