KR20240141603A - Electronic device for processing an input of a stylus pen and method of operating the same - Google Patents

Abstract

According to one embodiment, an electronic device includes a display and a processor electrically connected to the display, wherein the processor is configured to display a first object through the display, detect a first input of a stylus pen to the first object, obtain a first tilt of the stylus pen while the first input is maintained, and further display a second object related to the first object based on the first tilt being included in a first range.

Description

{ELECTRONIC DEVICE FOR PROCESSING AN INPUT OF A STYLUS PEN AND METHOD OF OPERATING THE SAME}

Embodiments of the present disclosure relate to an electronic device for processing input from a stylus pen and a method of operating the same.

Electronic devices are being developed to be able to receive various inputs from a user through a specified input device (e.g., a stylus pen) connected to the electronic device via wireless communication. The electronic device can identify a location on the electronic device specified by an input device having a pen function (which may be referred to as a “stylus pen” for convenience of explanation in this disclosure) and perform a function corresponding thereto.

The electronic device can detect a magnetic field generated from a stylus pen using an electromagnetic resonance (EMR) method. The electronic device can identify the position of the stylus pen based on the induced electromotive force generated by the magnetic field for each channel.

The stylus pen can be connected to an electronic device via short-range communication (e.g., Bluetooth low energy (BLE)). The stylus pen can transmit information about the pressed state of a button disposed on the housing of the stylus pen to the electronic device via short-range communication, and the electronic device can perform a designated action based on the received information.

According to one embodiment, an electronic device may include a display and at least one processor electrically connected to the display.

According to one embodiment, the at least one processor can display a first object through the display.

In one embodiment, the at least one processor can detect a first input of a stylus pen to the first object.

In one embodiment, the at least one processor can obtain a first tilt of the stylus pen while the first input is maintained.

In one embodiment, the at least one processor can further display a second object related to the first object based on the first slope being within a first range.

According to one embodiment, a method of controlling an electronic device may include an action of displaying a first object.

According to one embodiment, a method of controlling an electronic device may include an operation of detecting a first input of a stylus pen to the first object.

According to one embodiment, a method of controlling an electronic device may include an operation of obtaining a first tilt of the stylus pen while the first input is maintained.

According to one embodiment, a control method of an electronic device may include an operation of further displaying a second object related to the first object based on the first slope being included in a first range.

According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs, wherein the one or more programs may include instructions for causing an electronic device including a display and at least one processor to display a first object through the display.

In one embodiment, the one or more programs may include instructions for the electronic device to detect a first input of a stylus pen to the first object.

In one embodiment, the one or more programs may include instructions for causing the electronic device to obtain a first tilt of the stylus pen while the first input is maintained.

In one embodiment, the one or more programs may include instructions that cause the electronic device to further display a second object related to the first object based on the first slope being within the first range.

FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.
FIG. 2 is a perspective view of an electronic device including a stylus pen according to one embodiment.
FIG. 3 is a block diagram illustrating a stylus pen according to one embodiment.
FIG. 4 is a block diagram of an electronic device according to one embodiment.
FIG. 5 is a drawing for explaining the operation of an electronic device based on the tilt of a stylus pen according to one embodiment.
FIG. 6a is a drawing for explaining the tilt direction of a stylus pen according to one embodiment.
FIG. 6b is a drawing for explaining the operation of an electronic device based on the tilt direction of a stylus pen according to one embodiment.
FIG. 6c is a drawing for explaining the operation of an electronic device based on the tilt direction of a stylus pen according to one embodiment.
FIG. 6d is a drawing for explaining the operation of an electronic device based on the tilt direction of a stylus pen according to one embodiment.
FIG. 7A is a drawing for explaining the operation of an electronic device based on the tilt direction of a stylus pen according to one embodiment.
FIG. 7b is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.
FIG. 7c is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.
FIG. 8A is a drawing for explaining the operation of an electronic device based on the tilt direction of a stylus pen according to one embodiment.
FIG. 8b is a drawing for explaining the operation of an electronic device based on the tilt angle of a stylus pen according to one embodiment.
FIG. 9 is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.
FIG. 10A is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.
FIG. 10b is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.
FIG. 11A is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.
FIG. 11b is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.
FIG. 12 is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.
FIG. 13 is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.

FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

The processor (120) may control at least one other component (e.g., a hardware or software component) of an electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store result data in a nonvolatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

The auxiliary processor (123) may control at least a portion of functions or states associated with at least one of the components of the electronic device (101) (e.g., the display module (160), the sensor module (176), or the communication module (190)), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. Such learning may be performed, for example, in the electronic device (101) itself on which the artificial intelligence model is executed, or may be performed through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers. The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may additionally or alternatively include a software structure.

The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or nonvolatile memory (134).

The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

The audio output module (155) can output an audio signal to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive an incoming call. According to one embodiment, the receiver can be implemented separately from the speaker or as a part thereof.

The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) can include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) can include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can obtain sound through an input module (150), or output sound through an audio output module (155), or an external electronic device (e.g., an electronic device (102)) (e.g., a speaker or a headphone) directly or wirelessly connected to the electronic device (101).

The sensor module (176) can detect an operating state (e.g., power or temperature) of the electronic device (101) or an external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., the electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that a user can perceive through a tactile or kinesthetic sense. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module (180) can capture still images and moving images. According to one embodiment, the camera module (180) can include one or more lenses, image sensors, image signal processors, or flashes.

The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery (189) can power at least one component of the electronic device (101). In one embodiment, the battery (189) can include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

The communication module (190) may support establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., the electronic device (102), the electronic device (104), or the server (108)), and performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., the application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module may communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196) to identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199).

The wireless communication module (192) can support a 5G network and next-generation communication technology after a 4G network, for example, NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), terminal power minimization and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) may support various requirements specified in an electronic device (101), an external electronic device (e.g., an electronic device (104)), or a network system (e.g., a second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL) each, or 1 ms or less for round trip) for URLLC realization.

The antenna module (197) may transmit or receive signals or power to or from the outside (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and the external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

In one embodiment, the antenna module (197) can form a mmWave antenna module. In one embodiment, the mmWave antenna module can include a printed circuit board, an RFIC positioned on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) positioned on or adjacent a second side (e.g., a top side or a side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

At least some of the above components may be connected to each other and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, a general purpose input and output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)).

In one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). In one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of executing the function or service itself or in addition, request one or more external electronic devices to perform at least a part of the function or service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide an ultra-low latency service by using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an IoT (Internet of Things) device. The server (108) may be an intelligent server using machine learning and/or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199). The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

FIG. 2 is a perspective view (200) of an electronic device (101) including a stylus pen (201) (e.g., the electronic device (102) of FIG. 1) according to various embodiments. According to one embodiment, the stylus pen (201) may correspond to the input module (150) of FIG. 1 rather than the electronic device (102) of FIG. 1.

Referring to FIG. 2, according to one embodiment, an electronic device (101) may include the configuration illustrated in FIG. 1, and may include a structure into which a stylus pen (201) may be inserted. The electronic device (101) includes a housing (210), and a portion of the housing (210), for example, a portion of a side surface (210a), may include a hole (211). The electronic device (101) may include a first internal space (212), which is a storage space connected to the hole (211), and the stylus pen (201) may be inserted into the first internal space (212). According to the illustrated embodiment, the stylus pen (201) may include a first button (201a) that can be pressed at one end to facilitate taking the stylus pen (201) out of the first internal space (212) of the electronic device (101). When the first button (201a) is pressed, a rebound mechanism (e.g., a rebound mechanism by at least one elastic member (e.g., a spring)) connected to the first button (201a) is operated, so that the stylus pen (201) can be detached from the first internal space (212).

According to one embodiment, the electronic device (101) may include a structure capable of attaching a stylus pen (201) to the electronic device (101). For example, the electronic device (101) may include at least one magnetic body at a location adjacent to an attachment area so that the stylus pen (201) may be attached to the exterior of the housing (210). The stylus pen (201) may be attached to the exterior of the housing (210) of the electronic device (101) via the at least one magnetic body.

FIG. 3 is a block diagram (300) illustrating a stylus pen (e.g., the stylus pen (201) of FIG. 2) according to one embodiment.

Referring to FIG. 3, according to one embodiment, the stylus pen (201) may include a processor (220), a memory (230), a resonant circuit (287), a charging circuit (288), a battery (289), a communication circuit (290), an antenna (297), a trigger circuit (298), and/or a sensor (299). In some embodiments, the processor (220), at least a portion of the resonant circuit (287), and/or at least a portion of the communication circuit (290) of the stylus pen (201) may be configured on a printed circuit board or in the form of a chip. The processor (220), the resonant circuit (287), and/or the communication circuit (290) may be electrically connected to the memory (230), the charging circuit (288), the battery (289), the antenna (297), the trigger circuit (298), and/or the sensor (299).

According to one embodiment, the processor (220) may include a generic processor configured to execute a customized hardware module or software (e.g., an application program). The processor (220) may include a hardware component (function) or a software element (program) including at least one of various sensors provided in the stylus pen (201), a data measurement module, an input/output interface, a module for managing a state or environment of the stylus pen (201), or a communication module. The processor (220) may include, for example, one or a combination of two or more of hardware, software, or firmware. According to one embodiment, the processor (220) may be configured to transmit information indicating a pressed state of a button (e.g., button (337)), sensing information acquired by a sensor (299), and/or information calculated based on the sensing information (e.g., information associated with a position of a stylus pen (201)) to the electronic device (101) via the communication circuit (290).

According to one embodiment, the resonant circuit (287) may resonate based on an electromagnetic field signal generated from a digitizer (e.g., a display module (160)) of the electronic device (101) and may radiate an electro-magnetic resonance (EMR) input signal (or a magnetic field and) by resonance. The electronic device (101) may identify a position of the stylus pen (201) on the electronic device (101) using the electromagnetic resonance input signal. For example, the electronic device (101) may identify the position of the stylus pen (201) based on the magnitude of an induced electromotive force (e.g., an output current) generated by the electromagnetic resonance input signal in each of a plurality of channels (e.g., a plurality of loop coils) in the digitizer. Meanwhile, in the above-described manner, the electronic device (101) and the stylus pen (201) have been described as operating based on the EMR method, but this is merely exemplary, and the electronic device (101) may also generate a signal based on an electric field based on an ECR (electrically coupled resonance) method. The resonance circuit of the stylus pen (201) may be resonated by an electric field. The electronic device (101) may check the potential in a plurality of channels (e.g., electrodes) due to resonance in the stylus pen (201), and may also check the position of the stylus pen (201) based on the potential. The stylus pen (201) may be implemented using an AES (active electrostatic) method, and those skilled in the art will understand that there is no limitation on the type of implementation. Additionally, the electronic device (101) may detect the stylus pen (201) based on a change in capacitance (self capacitance or mutual capacitance) associated with at least one electrode of the touch panel. In this case, the stylus pen (201) may not include a resonant circuit. In the present disclosure, the “panel” or “sensing panel” may be used as a term encompassing a digitizer and a TSP (touch screen panel).

According to one embodiment, the memory (230) may store information related to the operation of the stylus pen (201). For example, the information may include information for communication with the electronic device (101) and frequency information related to the input operation of the stylus pen (201). In addition, the memory (230) may store a program (or an application, an algorithm, or a processing loop) for calculating information (e.g., coordinate information and/or displacement information) about the position of the stylus pen (201) from the sensing data of the sensor (299). The memory (230) may also store a communication stack of the communication circuit (290). Depending on the implementation, the communication circuit (290) and/or the processor (220) may include a dedicated memory.

According to one embodiment, the resonant circuit (287) may include a coil (or an inductor) and/or a capacitor. The resonant circuit (287) may resonate based on an input electric field and/or magnetic field (e.g., an electric field and/or a magnetic field generated from a digitizer of the electronic device (101). When the stylus pen (201) transmits a signal by the EMR method, the stylus pen (201) may generate a signal including a resonant frequency based on an electromagnetic field generated from an inductive panel of the electronic device (101). When the stylus pen (201) transmits a signal by the AES method, the stylus pen (201) may generate a signal by using capacitive coupling with the electronic device (101). When the stylus pen (201) transmits a signal by the ECR method, the stylus pen (201) can generate a signal including a resonant frequency based on an electric field generated from a capacitive device of an electronic device. According to one embodiment, the resonant circuit (287) can be used to change the intensity or frequency of an electromagnetic field according to a user's manipulation state. For example, the resonant circuit (287) can provide various frequencies for recognizing a hovering input, a drawing input, a button input, or an erasing input. For example, the resonant circuit (287) can provide various resonant frequencies according to a connection combination of a plurality of capacitors, or can provide various resonant frequencies based on a variable inductor and/or a variable capacitor.

According to one embodiment, the charging circuit (288) may, when connected to the resonant circuit (287) based on the switching circuit, rectify the resonant signal generated from the resonant circuit (287) into a DC signal and provide it to the battery (289). According to one embodiment, the stylus pen (201) may use the voltage level of the DC signal detected by the charging circuit (288) to determine whether the stylus pen (201) is inserted into the electronic device (101). Alternatively, the stylus pen (201) may check a pattern corresponding to a signal detected by the charging circuit (288) to determine whether the stylus pen (201) is inserted.

In one embodiment, the battery (289) may be configured to store power required for the operation of the stylus pen (201). The battery (289) may include, for example, a lithium-ion battery or a capacitor, and may be rechargeable or replaceable. In one embodiment, the battery (289) may be charged using power provided from the charging circuit (288) (e.g., a direct current signal (DC power)).

According to one embodiment, the communication circuit (290) may be configured to perform a wireless communication function between the stylus pen (201) and the communication module (190) of the electronic device (101). According to one embodiment, the communication circuit (290) may transmit information related to the status information, input information, and/or location of the stylus pen (201) to the electronic device (101) using a short-range communication method. For example, the communication circuit (290) may transmit direction information (e.g., motion sensor data) of the stylus pen (201) obtained through the trigger circuit (298), voice information input through a microphone, or remaining amount information of the battery (289) to the electronic device (101). For example, the communication circuit (290) may transmit sensing data obtained from the sensor (299) and/or information related to the location of the stylus pen (201) confirmed based on the sensing data to the electronic device (101). For example, the communication circuit (290) can transmit information about the state of a button (e.g., button (337)) provided in the stylus pen (201) to the electronic device (101). As an example, the short-range communication method may include at least one of Bluetooth, BLE (Bluetooth low energy), NFC, and Wi-Fi direct, but there is no limitation on the type.

According to one embodiment, the antenna (297) can be used to transmit or receive a signal or power to or from an external device (e.g., the electronic device (101)). According to one embodiment, the stylus pen (201) can include a plurality of antennas (297), and among them, at least one antenna (297) suitable for a communication method can be selected. Through the selected at least one antenna (297), the communication circuit (290) can exchange a signal or power with an external electronic device.

According to one embodiment, the trigger circuit (298) may include at least one button or sensor circuit. According to one embodiment, the processor (220) may check the input method (e.g., touch or press) or type (e.g., EMR button or BLE button) of the button of the stylus pen (201). According to one embodiment, the trigger circuit (298) may transmit a trigger signal to the electronic device (101) using an input signal of the button or a signal through the sensor (299).

According to one embodiment, the sensor (299) may include an accelerometer, a gyro sensor, and/or a geomagnetic sensor. The acceleration sensor may sense information about the linear movement of the stylus pen (201) and/or acceleration about three, six, or nine axes of the stylus pen (201). The gyro sensor may sense information related to the rotation of the stylus pen (201). The geomagnetic sensor may sense information about the direction in which the stylus pen (201) is facing within the absolute coordinate system. According to one embodiment, the sensor (299) may include at least one of a sensor for measuring movement, as well as a sensor for generating an electrical signal or data value corresponding to an internal operating state or an external environmental state of the stylus pen (201), for example, a battery level detection sensor, a pressure sensor, a light sensor, a temperature sensor, and a biometric sensor. According to various embodiments, the processor (220) may transmit information acquired from the sensor (299) to the electronic device (101) through the communication circuit (290). Alternatively, the processor (220) may transmit information related to the position of the stylus pen (201) (e.g., coordinates of the stylus pen (201) and/or displacement of the stylus pen (201)) to the electronic device (101) through the communication circuit (290) based on the information acquired from the sensor (299).

FIG. 4 is a block diagram of an electronic device according to one embodiment.

Referring to FIG. 4, the electronic device (401) may include a processor (420), a memory (430), and a touch screen (460). For example, the electronic device (401) may be implemented in the same or similar manner as the electronic device (101) of FIG. 1.

According to one embodiment, the processor (420) may control the overall operation of the electronic device (401). For example, the processor (420) may be implemented identically or similarly to the processor (120) of FIG. 1.

According to one embodiment, the processor (420) may confirm a touch input generated by a stylus pen (201) or a user's hand through the touch screen (460) (e.g., the display module (160) of FIG. 1). Alternatively, the processor (420) may confirm an input generated by an input means such as a mouse or a trackball through the touch screen (460) (e.g., the display module (160) of FIG. 1). The processor (420) may confirm the start and completion of a touch input (or an input generated by the input means). For example, when a touch down by the stylus pen (201) or the user's hand is confirmed on the touch screen (460), the processor (420) may confirm that the touch input has started. Thereafter, when a touch up by the stylus pen (201) or the user's hand is confirmed on the touch screen (460), the processor (420) may confirm that the touch input has been completed.

According to one embodiment, the processor (420) can check the movement path of the touch input from the start of the touch to the completion of the touch. In addition, the processor (420) can check the movement distance of the touch input from the start of the touch to the completion of the touch.

According to one embodiment, the processor (420) may determine whether a gesture indicated by a touch input (or an input generated by the input means) satisfies a preset gesture occurrence condition. For example, the processor (420) may determine a gesture indicated by a touch input based on the start, movement path, and completion of the touch input among a plurality of preset gestures. The processor (420) may determine whether a gesture indicated by the touch input satisfies a gesture occurrence condition that generates a specific gesture among a plurality of gestures supported by the electronic device (401) based on the touch start, touch move, and/or touch completion. For example, the plurality of gestures may include a single tap, a multi-tap, a hold, a long press, a move and then hold, a scroll input, a fling input, a movement of two touches in different directions, and/or a rotation of two touches in different directions. For example, the gesture occurrence condition may be set to a different condition for each of the plurality of gestures.

According to one embodiment, the processor (420) may display the handwriting (or drawing) indicated by the touch input on the touch screen (460) if the gesture indicated by the touch input does not satisfy a gesture generation condition for generating a specific gesture. For example, the processor (420) may display the handwriting (or drawing) input by the touch input on the touch screen (460) if the touch input does not indicate a pre-designated gesture.

According to one embodiment, the processor (420) may determine whether the touch input satisfies at least one of a time condition, a distance condition, and a space condition specified for the gesture, based on a touch start point of the touch input or an end point of a previous touch input, if the gesture indicated by the touch input satisfies a gesture occurrence condition that causes a specific gesture to occur. That is, the processor (420) may not immediately execute a function corresponding to the specific gesture, even if the gesture indicated by the touch input satisfies the gesture occurrence condition. For example, the time condition may mean a condition on the time at which the touch input was touched. The distance condition may mean a condition on the path length of the touch input. The space condition may mean a condition on whether the touch input is located inside or outside a specific space.

According to one embodiment, the reference point for determining the time condition, distance condition, and space condition specified for the gesture may be different for each gesture. For example, the reference point may be the start point of the touch or the end point of the previous touch input. Alternatively, the reference point may be the start point or end point of the oldest touch input among the most recent 500 ms touches, the point at which the movement of the touch input first leaves the preset area, the start point or end point of the oldest touch input among the most recently confirmed 10 touch inputs, a touch input corresponding to a data value satisfying a specific condition among the data of the touch inputs (for example, a touch input having an x-coordinate of 1000 or more), or the start point or end point of a touch input selected by a specific algorithm. For example, the reference point may be automatically set by the processor (420) or may be set by the user.

According to one embodiment, the processor (420) may determine whether to execute a function corresponding to a gesture indicated by the touch input based on whether the touch input satisfies at least one condition specified for a specific gesture among a time condition, a distance condition, and a space condition. For example, if the touch input satisfies the time condition, the distance condition, and/or the space condition specified for the corresponding gesture, the processor (420) may execute the function corresponding to the gesture indicated by the touch input. Alternatively, if the touch input does not satisfy the time condition, the distance condition, and/or the space condition specified for the corresponding gesture, the processor (420) may not execute the function corresponding to the gesture indicated by the touch input. In this case, the processor (420) may display a movement (e.g., writing or drawing) indicated by the touch input on the touch screen (460).

According to one embodiment, the processor (420) may determine whether to execute a function corresponding to a gesture indicated by a plurality of touch inputs based on whether the plurality of touch inputs satisfy at least one condition specified for a particular gesture among a time condition, a distance condition, and/or a space condition.

According to one embodiment, each of the plurality of gestures may be set to at least some of different time conditions, distance conditions, and/or space conditions. In addition, the processor (420) may execute a function corresponding to a gesture if only some of the time conditions, distance conditions, and/or space conditions are satisfied for some of the plurality of gestures.

According to one embodiment, the memory (430) may store information about a gesture occurrence condition of each of the plurality of gestures. In addition, the memory (420) may store information about a time condition, a length condition, and/or a space condition of each of the plurality of gestures. For example, the memory (430) may be implemented in the same or similar manner as the memory (130) of FIG. 1.

Hereinafter, for convenience of explanation, the electronic device (401) is described as performing the operations below, but at least some of the operations performed by the electronic device (401) may be controlled by the processor (420).

FIG. 5 is a drawing for explaining the operation of an electronic device based on the tilt of a stylus pen according to one embodiment.

Referring to FIG. 5, in operation 510, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a first object through a display (e.g., the display module (160) of FIG. 1).

According to one embodiment, the first object may include an icon for running an application, a user interface for running a function (e.g., a widget, showing a previous screen (back), providing information, controlling playback position, controlling brightness, controlling volume).

In one embodiment, in operation 520, the electronic device may detect a first input of a stylus pen (e.g., the electronic device (102) of FIG. 1, the stylus pen (201) of FIG. 2, and the stylus pen (201) of FIG. 3) to a first object. In one embodiment, the electronic device may detect the first input of the stylus pen connected via a communication module (e.g., the communication module (190) of FIG. 1) to the first object. In one embodiment, the electronic device may also detect the first input of a stylus pen not connected to a communication module to the first object.

In one embodiment, the first input may include hovering over or touching a first object displayed on the display. In one embodiment, the first input may include hovering over or touching a first object displayed on the display while pressing a button included in a stylus pen.

In one embodiment, in operation 530, the electronic device can acquire a first tilt of the stylus pen while the first input is maintained.

According to one embodiment, the electronic device may acquire a first tilt of a stylus pen hovering or touching a first object, if the first object includes a function related to an angle. According to one embodiment, the electronic device may acquire a first tilt of a stylus pen hovering or touching a first object while the stylus pen maintains a first input to the first object, if the first object includes a function related to an angle.

In one embodiment, the first slope may include slope direction and/or slope angle information.

In one embodiment, the angle of the first tilt may include an angle between an orientation of the display (e.g., the orientation of an axis perpendicular to a surface of the display) and the stylus pen and/or an angle between a surface of the display and the stylus pen.

According to one embodiment, the electronic device may receive information about a direction of a first inclination and/or an angle of the first inclination from the stylus pen via the communication module. For example, the electronic device may receive, from the stylus pen, information about a direction of a first inclination and/or an angle of the first inclination of the stylus pen, which is acquired by a sensor (e.g., an acceleration sensor and/or a gyro sensor) provided in the stylus pen (e.g., a sensor (299) of FIG. 3).

According to one embodiment, the electronic device may further include at least one sensor (e.g., a touch sensor and/or a magnetic field sensor) (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the electronic device may obtain the direction of the first inclination of the stylus pen and/or the angle of the first inclination based on the at least one sensor.

For example, if a stylus pen includes two or more points that can be recognized by a touch sensor of an electronic device (e.g., a touch screen panel (TSP) or a digitizer), the electronic device can obtain the direction of the tilt and/or the angle of the tilt of the stylus pen based on the distance and direction between the recognized points.

In one embodiment, the stylus pen may include a tip electrode at a tip, and a ring electrode spaced apart from the tip electrode and surrounding the stylus pen. In one embodiment, the electronic device may detect a point-shaped touch or hovering by the tip electrode, and a ring-shaped hovering by the ring electrode, through a touch sensor. In one embodiment, the electronic device may obtain at least one of a direction of inclination or an angle of inclination of the stylus pen based on a distance and a direction between the point-shaped touch or hovering and the ring-shaped hovering, or a shape of the detected ring.

For example, the electronic device can obtain the direction of the inclination of the stylus pen based on the direction between the center of the point-shaped detection area and the center of the ring-shaped detection area, and can obtain the angle of the inclination of the stylus pen based on the distance between the center of the point-shaped detection area and the center of the ring-shaped detection area.

According to one embodiment, the electronic device determines that the stylus pen is not tilted when the shape of the ring-shaped detection area is close to a circle, and determines that the stylus pen is tilted in a direction with a longer radius when the shape of the ring-shaped detection area is oval, and obtains an angle of inclination of the stylus pen based on the length of the longer radius or the ratio of the longer radius to the shorter radius.

According to one embodiment, when the stylus pen includes a magnetic field generating unit recognizable by a magnetic field sensor of the electronic device, the electronic device can detect a magnetic field generated by the stylus pen to obtain an angle with respect to each of the x-axis, the y-axis, and/or the z-axis, and obtain a direction of inclination and/or an angle of inclination of the stylus pen based on the angle with respect to each of the x-axis, the y-axis, and/or the z-axis.

In one embodiment, in operation 540, the electronic device may further display a second object related to the first object based on the first slope being within the first range.

According to one embodiment, the electronic device may further display a second object related to the first object if an angle of a first tilt of the stylus pen is within a first range while a first input of the stylus pen for the first object is maintained.

According to one embodiment, the electronic device may determine a location where a second object is displayed by considering the direction of the first inclination of the stylus pen. For example, the electronic device may display the second object in an area opposite to the direction of the first inclination of the stylus pen based on the location of the first object.

In one embodiment, the second object may be displayed in a different layer from the first object. An embodiment in which the second object is displayed in an area opposite to the direction of the first inclination of the stylus pen and in a different layer from the first object will be described in more detail with reference to FIGS. 6b and 7a below.

In one embodiment, the electronic device may move the second object further away from the first object based on the angle of the first tilt being changed to fall within a second range greater than the first range.

According to one embodiment, when a first object includes a plurality of UIs (e.g., widgets) that are at least partially overlapped, the electronic device may expand and display the overlapped UIs as the angle of the first inclination increases. According to one embodiment, an embodiment in which a second object is displayed in an area opposite to the direction of the first inclination of the stylus pen and a position of the second object is changed according to a change in the angle of the first inclination will be described in more detail with reference to FIGS. 7b and 7c below.

In one embodiment, the second object may be a pop-up screen. An embodiment in which the second object is displayed as a pop-up screen in an area opposite to the direction of the first inclination of the stylus pen according to one embodiment will be described in more detail with reference to FIGS. 6C, 8A, 9, 10A, 11A, and 11B below.

According to one embodiment, when the electronic device displays detailed information of the selected first object as a pop-up screen, the electronic device may adjust the amount (level) of the displayed information based on the angle of the first inclination of the stylus pen. For example, the electronic device may increase the amount of content included in the second object based on the change in the angle of the first inclination to be included in a second range greater than the first range. According to one embodiment, an embodiment of adjusting the amount of content displayed in the second object based on the change in the angle of the first inclination of the stylus pen will be described in more detail with reference to FIG. 8B below.

According to one embodiment, the electronic device can increase transparency of the second object based on a change in an angle of a first inclination of the stylus pen to be included in a second range smaller than the first range while a first input of the stylus pen for the first object is maintained. According to one embodiment, the second object is displayed in an area opposite to a direction of the first inclination of the stylus pen, and an embodiment of changing transparency of the second object according to a change in the angle of the first inclination will be described in more detail with reference to FIG. 9 below.

In one embodiment, the second object may include a plurality of optionally selectable items. For example, if there are multiple selectable options in relation to the first object, the second object may include a plurality of optionally selectable items in relation to the first object. For example, the second object may include a plurality of playback speeds, a plurality of previous screens.

According to one embodiment, the electronic device may change an item to be selected from among a plurality of items based on a change in the angle of the first inclination of the stylus pen and/or the direction of the first inclination. For example, the electronic device may change a position of an indicator indicating an item to be selected from among a plurality of items based on a change in the angle of the first inclination and/or the direction of the first inclination. For example, if the angle of the first inclination and/or the direction of the first inclination changes based on the rotation of the stylus pen counterclockwise, the electronic device may move the position of the indicator to the left. For example, if the angle of the first inclination and/or the direction of the first inclination changes based on the rotation of the stylus pen clockwise, the electronic device may move the position of the indicator to the right. According to one embodiment, if the stylus pen rotates upward or downward, the electronic device may change the position of the indicator upward or downward. In one embodiment, an embodiment in which the second object includes a plurality of optionally selectable items is described in more detail with reference to FIGS. 6d, 10a, 11a and 11b below.

In one embodiment, the first object may be associated with a setting whose value can be adjusted. For example, the first object may be a user interface associated with brightness control or volume control.

According to one embodiment, the electronic device may adjust a value of a setting based on a change in an angle of a first tilt of the stylus pen and/or a direction of the first tilt, and display a second object related to the adjusted value of the setting.

For example, when a first input of a stylus pen for a first object is received, the electronic device may display a bar-shaped slider as a second object, and adjust a setting value related to the first object based on a change in the angle and/or direction of the first inclination of the stylus pen while the first input is maintained, and change the position of a node included in the slider.

According to one embodiment, the electronic device can adjust a setting value associated with a first object based on a change in an angle and/or direction of a first inclination of the stylus pen while a first input of the stylus pen for the first object is maintained, and display the setting value (e.g., a numerical value) as a second object. An embodiment of adjusting the setting value based on a change in an angle and/or direction of the inclination of the stylus pen according to one embodiment will be described in more detail with reference to FIGS. 6d and 10b below.

In this way, the electronic device can provide the user with additional information or perform functions based on the tilt of the stylus pen when hovering or touching an object within the display of the electronic device with the stylus pen, thereby minimizing the movement of the stylus pen and continuously performing functions from the previously performed task without switching screens.

FIG. 6a is a drawing for explaining the tilt direction of a stylus pen according to one embodiment.

Referring to FIG. 6A, an electronic device (e.g., an electronic device (101) of FIG. 1 or a processor (120) of FIG. 1) can identify an x-axis and a y-axis (62) with a first object (61) as an origin that is touched or hovered by a stylus pen (102-1, 102-2, 102-3, 102-4) (e.g., an electronic device (102) of FIG. 1, a stylus pen (201) of FIG. 2, and a stylus pen (201) of FIG. 3), and can identify two diagonal axes (63) with the first object (61) as an origin.

According to one embodiment, the electronic device can be divided into eight regions based on the x-axis and y-axis (62) as reference points and two diagonal axes (63), and can obtain the tilt direction of the stylus pen (102-1, 102-2, 102-3, 102-4) among eight directions corresponding to each of the eight regions. For example, the eight directions are: a first direction corresponding to a first region (610) that touches the x-axis among two regions included in the first quadrant of the xy plane composed of the x-axis and the y-axis (62); a second direction corresponding to a second region (611) that touches the y-axis among two regions included in the first quadrant of the xy plane; a third direction corresponding to a third region (612) that touches the y-axis among two regions included in the second quadrant of the xy plane; a fourth direction corresponding to a fourth region (613) that touches the x-axis among two regions included in the second quadrant of the xy plane; a fifth direction corresponding to a fifth region (614) that touches the x-axis among two regions included in the third quadrant of the xy plane; a sixth direction corresponding to a sixth region (615) that touches the y-axis among two regions included in the third quadrant of the xy plane; and a seventh direction corresponding to a y-axis among two regions included in the fourth quadrant of the xy plane. It may include an 8th direction corresponding to the 7th direction corresponding to the area (616) and an 8th direction corresponding to the 8th area (617) that is in contact with the x-axis among the two areas included in the 4th quadrant of the xy plane.

For example, the inclination of the first stylus pen (102-1) may be in the seventh direction corresponding to the seventh area (616), the inclination of the second stylus pen (102-2) may be in the second direction corresponding to the second area (611), the inclination of the third stylus pen (102-3) may be in the eighth direction corresponding to the eighth area (617), and the inclination of the fourth stylus pen (102-4) may be in the fourth direction corresponding to the fourth area (613).

According to one embodiment, the direction of the stylus pen is illustrated as being divided into eight directions in FIG. 6A, but it may be divided into a total of four directions, up and down based on the x-axis and left and right based on the y-axis, using only the x-axis and y-axis (62). According to one embodiment, the direction of the stylus pen may be divided into nine or more directions.

According to one embodiment, the electronic device may display a second object as illustrated in FIGS. 6B to 6D below based on the tilt direction of the stylus pen (102-1, 102-2, 102-3, 102-4).

FIG. 6b is a drawing for explaining the operation of an electronic device based on the tilt direction of a stylus pen according to one embodiment.

Referring to FIG. 6B, the electronic device may display a second object (630, 631, 632, 633) related to the first object (620) if the inclination of the stylus pen (102-1, 102-2, 102-3, 102-4) is within a first range while the first input of the stylus pen (102-1, 102-2, 102-3, 102-4) hovering or touching the first object (620) is maintained. For example, if the angle of the inclination of the stylus pen (102-1, 102-2, 102-3, 102-4) is included in the first range while the first input of the stylus pen (102-1, 102-2, 102-3, 102-4) is maintained, the electronic device may display a second object (630, 631, 632, 633) related to the first object (620). According to one embodiment, the second object (630, 631, 632, 633) may be displayed in a different layer from the first object (620) so as to overlap at least partially with the first object (620).

According to one embodiment, the electronic device may determine a location where the second object (630, 631, 632, 633) is displayed by further considering the tilt direction of the stylus pen (102-1, 102-2, 102-3, 102-4). For example, the electronic device may display the second object (630, 631, 632, 633) in an area opposite to the tilt direction of the stylus pen (102-1, 102-2, 102-3, 102-4).

For example, if the tilt direction of the first stylus pen (101-1) is downward with respect to the first object (620), the electronic device may display the second object (630) above the first object (620). According to one embodiment, if the tilt direction of the second stylus pen (101-2) is upward with respect to the first object (620), the electronic device may display the second object (631) below the first object (620). According to one embodiment, if the tilt direction of the third stylus pen (101-3) is right with respect to the first object (620), the electronic device may display the second object (632) to the left of the first object (620). According to one embodiment, the electronic device may display the second object (633) to the right of the first object (620) when the tilt direction of the fourth stylus pen (101-4) is to the left with respect to the first object (620).

According to one embodiment, when the first object (620) includes a plurality of layers, the electronic device may display at least one layer that was not visible because it was covered by the uppermost layer among the plurality of layers of the first object (620) as a second object (630, 631, 632, 633) while the first input of the stylus pen (102-1, 102-2, 102-3, 102-4) hovering or touching the first object (620) is maintained and the inclination of the stylus pen (102-1, 102-2, 102-3, 102-4) is within the first range.

According to one embodiment, the electronic device may further consider the tilt direction of the stylus pen (102-1, 102-2, 102-3, 102-4) and display at least one layer that was not visible as a second object (630, 631, 632, 633) in an area opposite to the tilt direction of the stylus pen (102-1, 102-2, 102-3, 102-4).

FIG. 6c is a drawing for explaining the operation of an electronic device based on the tilt direction of a stylus pen according to one embodiment.

Referring to FIG. 6c, the electronic device may display a second object (640, 641, 642, 643) related to the first object (620) if the inclination of the stylus pen (102-1, 102-2, 102-3, 102-4) is within a first range while the first input of the stylus pen (102-1, 102-2, 102-3, 102-4) hovering or touching the first object (620) is maintained. For example, if the angle of inclination of the stylus pen (102-1, 102-2, 102-3, 102-4) is within a first range while the first input of the stylus pen (102-1, 102-2, 102-3, 102-4) is maintained, the electronic device may display a second object (640, 641, 642, 643) related to the first object (620). According to an embodiment, the second object (640, 641, 642, 643) may be a pop-up screen and may include additional information and/or selectable options for the first object (620).

According to one embodiment, the electronic device may determine a location where the second object (640, 641, 642, 643) is displayed by further considering the tilt direction of the stylus pen (102-1, 102-2, 102-3, 102-4). For example, the electronic device may display the second object (640, 641, 642, 643) in an area opposite to the tilt direction of the stylus pen (102-1, 102-2, 102-3, 102-4).

For example, if the tilt direction of the first stylus pen (101-1) is downward with respect to the first object (620), the electronic device may display the second object (640) above the first object (620). According to one embodiment, if the tilt direction of the second stylus pen (101-2) is upward with respect to the first object (620), the electronic device may display the second object (641) below the first object (620). According to one embodiment, if the tilt direction of the third stylus pen (101-3) is right with respect to the first object (620), the electronic device may display the second object (642) to the left of the first object (620). According to one embodiment, the electronic device may display the second object (643) to the right of the first object (620) when the tilt direction of the fourth stylus pen (101-4) is to the left with respect to the first object (620).

FIG. 6d is a drawing for explaining the operation of an electronic device based on the tilt direction of a stylus pen according to one embodiment.

Referring to FIG. 6d, the electronic device may display a second object (650, 660) related to the first object (620) if the inclination of the stylus pen (102) is within a first range while the first input of the stylus pen (102) hovering or touching the first object (620) is maintained. For example, if the angle of the inclination of the stylus pen (102) is within the first range while the first input of the stylus pen (102) is maintained, the electronic device may display the second object (650, 660) related to the first object (620). According to one embodiment, the second object (650, 660) may be a pop-up screen including selectable options or sliders.

In one embodiment, if there are multiple options associated with the first object (620), the second object (650) may include multiple selectable options (651, 652).

According to one embodiment, when an indicator is displayed indicating that the first option (651) located on the far right among a plurality of options (651, 652) is an option to be selected based on the tilt of the stylus pen (102) in a first direction (e.g., downward right) and a first angle, as the tilt of the stylus pen (102) moves in a second direction (614), the indicator may move from the first option (651) among the plurality of options (651, 652) to the second option (652) located to the left of the first option (651).

In this way, the electronic device can change which option is selected from among a plurality of options based on changes in the angle and/or direction of the tilt of the stylus pen (102).

In one embodiment, if the first object (620) relates to an adjustable setting, the second object (650) may include a slider (660) that can adjust a setting value (e.g., brightness, volume, playback position) and a knob (661) that indicates the current setting value.

According to one embodiment, the electronic device may adjust a setting value related to the first object (620) based on a change in the tilt direction and/or tilt angle of the stylus pen (102), and change the position of the knob (661) based on the adjusted setting value.

In FIG. 6d, when the first object (620) is related to an adjustable setting, the electronic device is illustrated as displaying a second object (660) including a slider when the inclination of the stylus pen (102) is included in a first range while the first input of the stylus pen (102) to the first object (620) is maintained. However, according to one embodiment, the electronic device may not display the slider, but may adjust the setting value related to the first object (620) based on a change in the inclination direction and/or inclination angle of the stylus pen (102), and display the adjusted setting value (e.g., a numerical value) as the second object.

FIG. 7A is a drawing for explaining the operation of an electronic device based on the tilt direction of a stylus pen according to one embodiment.

Referring to FIG. 7A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a second object (720, 721) related to a first object (710) (e.g., a widget) displayed on a display (e.g., the display module (160) of FIG. 1) based on a tilt of the stylus pen (102) being included in a first range while a first input of the stylus pen (102) (e.g., the electronic device (102) of FIG. 1, the stylus pen (201) of FIG. 2, and the stylus pen (201) of FIG. 3) is maintained.

According to one embodiment, the electronic device may determine the location where the second object (720, 721) is displayed by further considering the tilt direction of the stylus pen (102). For example, the electronic device may display the second object (720, 721) in an area opposite to the tilt direction of the stylus pen (102).

For example, if the direction of the stylus pen (102) is downward with respect to the first object (710), the electronic device can display a second object (720) related to the first object (710) on top of the first object (710).

According to one embodiment, when the direction of the stylus pen (102) is upward with respect to the first object (710), the electronic device may display a second object (721) related to the first object (710) at the bottom of the first object (710).

In one embodiment, the second object (720, 721) may include summary information or a simple operation mode related to the first object (710).

According to one embodiment, the electronic device may provide (e.g., output, display, play, execute) different content depending on the direction in which the second object (720, 721) is displayed.

For example, the electronic device may include summary information related to the first object (710) in a second object (720) displayed on top of the first object (710), and may include a simple operation mode (e.g., delete, set) of the first object (710) in a second object (721) displayed on the bottom of the first object (710).

According to one embodiment, examples of the first object and the second object may be as shown in [Table 1] below.

Apps Set widget
(First object) If the slope is in the first range
The second object displayed If the slope is in the second range
The second object displayed Weather Weather Weather forecast
Yesterday, Tomorrow weather Remove / Settings Calendar Month List Clock Digital clock / Analog clock Alarm: Show only if there is an alarm set.
If there are no alarms set, “No alarms set” is displayed. Alarm Timer Notes Note shortcut Note creator Contacts Contact Call / Message Digital wellbeing Screen time App timers Gallery Album or Story Pictures Details

According to one embodiment, the content provided according to the tilt direction of the stylus pen (102) may be set by the manufacturer during the manufacture of the electronic device. According to one embodiment, the content provided according to the tilt direction of the stylus pen may also be set through an input via a user interface that allows selection or change.

As described above, the electronic device can provide information and/or functions related to an object based on the tilt of the stylus pen without entering an application related to the object.

According to one embodiment, when the inclination of the stylus pen changes, the location where the second object is displayed may change. This will be described below with reference to FIGS. 7b and 7c.

FIG. 7b is a drawing for explaining the tilt direction of a stylus pen and the operation of an electronic device based on the tilt according to one embodiment.

FIG. 7c is a drawing for explaining the operation of an electronic device based on the tilt direction and tilt angle of a stylus pen according to one embodiment.

Referring to FIGS. 7B and 7C, the electronic device can display a second object (741, 742) related to a first object (740) when the tilt angle of the stylus pen (102) is in the first range (730, 750). According to one embodiment, the tilt angle of the stylus pen (102) may be an angle between the direction (72) of the display plane (71) and the stylus pen (102). For example, the direction (72) of the display plane (71) may be a direction orthogonal to all straight lines included in the display plane (71).

According to one embodiment, when the first object (740) includes a plurality of layers, the electronic device may display at least one layer that was not visible due to being obscured by the uppermost layer of the first object (740) as the second object (741, 742) when the tilt angle of the stylus pen (102) is within the first range (730, 750).

According to one embodiment, as illustrated in FIG. 7b, when the tilt direction of the stylus pen (102) is to the right, the second object (741, 742) may be displayed to the left of the first object (740).

According to one embodiment, based on a change in the tilt angle of the stylus pen (102), the electronic device can move the position of the second object (741, 742).

For example, when the tilt angle of the stylus pen (102) changes from a first range (730) to a second range (731) that is greater than the first range (730), the electronic device may move the second object (741, 742) to the left so as to be further away from the first object (740).

For example, when the tilt angle of the stylus pen (102) changes from the second range (731) to the third range (732) that is greater than the second range (731), the electronic device may move the second object (741, 742) to the left so as to be further away from the first object (740).

According to one embodiment, as illustrated in FIG. 7c, when the tilt direction of the stylus pen (102) is to the left, the second object (741, 742) may be displayed on the right side of the first object (740).

According to one embodiment, based on a change in the tilt angle of the stylus pen (102), the electronic device can move the position of the second object (741, 742).

For example, when the tilt angle of the stylus pen (102) changes from a first range (750) to a second range (751) that is greater than the first range (750), the electronic device may move the second object (741, 742) to the right so as to be further away from the first object (740).

For example, when the tilt angle of the stylus pen (102) changes from the second range (751) to the third range (752) that is greater than the second range (751), the electronic device can move the second object (741, 742) to the right so that it is further away from the first object (740).

In this way, as the tilt angle of the stylus pen (102) increases, the overlapping portion between the first object (740) and the second object (741, 742) decreases or disappears, and more information included in the second object (741, 742) can be displayed.

In FIGS. 7b and 7c, only an embodiment in which the inclination angle of the stylus pen (102) increases is illustrated; however, according to an embodiment, when the inclination angle of the stylus pen (102) decreases, the second object (741, 742) may be moved closer to the first object (740).

In FIGS. 7B and 7C, the second object (741, 742) is disclosed as including two layers, but according to an embodiment, the second object may be one layer, and a third object may be additionally displayed as the inclination angle of the stylus pen (102) increases. According to an embodiment, when the inclination angle of the stylus pen (102) decreases while the third object is additionally displayed as the inclination angle of the stylus pen (102) increases, the third object may be deleted.

In this way, the electronic device can display more information about the second object covered by the first object based on the change in the inclination of the stylus pen. In addition, if the first object is a plurality of overlapping widgets, the electronic device can unfold and provide the overlapping widgets based on the change in the inclination of the stylus pen without executing the widgets.

According to one embodiment, the amount of information included in the second object may vary depending on the tilt angle of the stylus pen. An embodiment in which the amount of information included in the second object varies depending on the tilt angle of the stylus pen according to one embodiment will be described in more detail below with reference to FIG. 8b.

FIG. 8A is a drawing for explaining the operation of an electronic device based on the tilt direction of a stylus pen according to one embodiment.

Referring to FIG. 8A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a second object (820, 821) related to the first object (810) (e.g., an object corresponding to a specific location) included in an execution screen of a map application displayed on a display (e.g., the display module (160) of FIG. 1) based on the inclination of the stylus pen (102) being included in a first range while a first input of the stylus pen (102) (e.g., the electronic device (102) of FIG. 1, the stylus pen (201) of FIG. 2, and the stylus pen (201) of FIG. 3) is maintained while hovering or touching a first object (810) (e.g., an object corresponding to a specific location).

According to one embodiment, the electronic device may determine the location where the second object (820, 821) is displayed by further considering the tilt direction of the stylus pen (102). For example, the electronic device may display the second object (820, 821) in an area opposite to the tilt direction of the stylus pen (102).

For example, if the tilt direction of the stylus pen (102) is downward with respect to the first object (810), the electronic device may display a second object (820) related to the first object (810) on top of the first object (810). For example, the second object (820) may include information on a location located in an upward direction of the first object (810).

According to one embodiment, if the tilt direction of the stylus pen (102) is upward with respect to the first object (810), the electronic device may display a second object (821) related to the first object (810) at the bottom of the first object (810). For example, the second object (821) may include information on a location located in the downward direction of the first object (810).

FIG. 8b is a drawing for explaining the operation of an electronic device based on the tilt angle of a stylus pen according to one embodiment.

Referring to FIG. 8b, the electronic device can adjust the amount of information included in the second object based on a change in the tilt angle of the stylus pen (102).

For example, when the tilt direction of the stylus pen (102) is upward with respect to the first object and the tilt angle is within the first range (81), the electronic device can display a second object (821) including brief information (e.g., a representative photo) of a location located in a downward direction of the first object.

According to one embodiment, when the tilt angle of the stylus pen (102) is changed from the first range (81) to the second range (82) greater than the first range (81), the electronic device may further display detailed information (e.g., store name, address information, whether the store is open, phone connection UI, and/or map display UI) of a location located in a downward direction of the first object.

According to one embodiment, when the tilt angle of the stylus pen (102) is changed from the second range (82) to the first range (81) smaller than the second range (82), the electronic device can delete the detailed information of the location located in the downward direction of the first object and display only brief information.

In this way, the electronic device can maintain the current screen and provide more detailed information based on changes in the tilt of the stylus pen without switching to a screen related to the first object.

In Fig. 8b, only the content in which the amount of information is adjusted according to the change in the inclination of the stylus pen is disclosed, but when combined with the embodiments of Figs. 7b and 7c, if the inclination of the stylus pen increases, the second object with an increased amount of information may move further away from the first object.

FIG. 9 is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.

Referring to FIG. 9, an electronic device (101) (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a second object (920) related to a first object (910) (e.g., an icon for executing an application) displayed on a display (e.g., the display module (160) of FIG. 1) based on the inclination of the stylus pen (102) being included in a first range (91) while a first input of the stylus pen (102) (e.g., the electronic device (102) of FIG. 1, the stylus pen (201) of FIG. 2, and the stylus pen (201) of FIG. 3) is maintained while hovering or touching a first object (910) (e.g., an icon for executing an application).

According to one embodiment, the electronic device may determine a location where the second object (920) is displayed by further considering the tilt direction of the stylus pen (102). For example, the electronic device may display the second object (920) in an area opposite to the tilt direction of the stylus pen (102). For example, the second object (920) may be a pop-up screen including a preview and/or options menu related to the first object (910).

According to one embodiment, the electronic device can adjust the transparency of the second object (920) based on a change in the tilt angle of the stylus pen (102).

For example, when the tilt angle of the stylus pen (102) changes from a first range (91) to a second range (92) greater than the first range (91), the electronic device can display a second object (921) with increased transparency.

In this way, the electronic device can provide a screen that was not visible due to the second object without moving the position of the second object by adjusting the transparency of the second object as the tilt angle of the stylus pen (102) changes.

In one embodiment, when the second object (920) includes a plurality of selectable items, the electronic device may perform at least one of item selection or transparency adjustment of the second object (920) based on the tilt of the stylus pen (102).

For example, if a plurality of selectable items are arranged vertically in the second object (920), the electronic device may move an indicator indicating an item to be selected, displayed on the second object (920), up and down according to the angle of inclination of the stylus pen (102) when the direction of inclination of the stylus pen (102) is up and down. According to one embodiment, if the direction of inclination of the stylus pen (102) is left and right, the electronic device may adjust the transparency of the second object (920) according to the angle of inclination of the stylus pen (102).

According to one embodiment, when a plurality of selectable items are arranged horizontally on the second object (920), the electronic device may move an indicator indicating an item to be selected, displayed on the second object (920), left and right according to the angle of inclination of the stylus pen (102) when the direction of inclination of the stylus pen (102) is left and right. According to one embodiment, when the direction of inclination of the stylus pen (102) is up and down, the electronic device may adjust the transparency of the second object (920) according to the angle of inclination of the stylus pen (102).

In FIG. 9, only the content of adjusting the transparency of the second object according to the change in the inclination of the stylus pen is disclosed, but when combined with the embodiments of FIGS. 7b and 7c, if the inclination of the stylus pen increases, the second object with increased transparency may move further away from the first object.

According to one embodiment, the embodiments of FIG. 8 and FIG. 9 are combined such that as the inclination of the stylus pen increases, the amount of information of the second object may increase and the transparency may increase.

In one embodiment, the embodiments of FIGS. 7b, 7c, and 8 may be combined with the embodiment of FIG. 9 such that as the inclination of the stylus pen increases, a second object with increased amount of information and increased transparency may be moved further away from the first object.

FIG. 10A is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.

Referring to FIG. 10A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a second object (1020) related to the first object (1010) (e.g., a play knob) included in a video application execution screen displayed on a display (e.g., the display module (160) of FIG. 1) based on the inclination of the stylus pen (102) being included in a first range (1030) while a first input of the stylus pen (102) (e.g., the electronic device (102) of FIG. 1, the stylus pen (201) of FIG. 2, and the stylus pen (201) of FIG. 3) is maintained while hovering or touching a first object (1010) (e.g., a play knob) included in a video application execution screen displayed on the display.

In one embodiment, the second object (1020) may be a pop-up screen including a plurality of options related to the first object (1010). For example, based on the first object (1010) being a play knob, the second object (1020) may include a plurality of options related to play speeds (e.g., play speed x1, play speed x1.5, play speed x2).

According to one embodiment, the electronic device may select one of a plurality of options included in the second object (1020) based on a change in the tilt angle of the stylus pen (102). For example, when the stylus pen (102) is tilted to the right as it is rotated clockwise, the electronic device may move an indicator indicating an option to be selected from the plurality of options to the right, and when the stylus pen (102) is tilted to the left as it is rotated counterclockwise, the electronic device may move an indicator indicating an option to be selected from the plurality of options to the left.

For example, when the tilt angle of the stylus pen (102) changes from a first range (1030) to a second range (1031) greater than the first range (1030), the electronic device may move the indicator from a playback speed x1 to a playback speed x1.5. In one embodiment, when the tilt angle of the stylus pen (102) changes from a second range (1031) to a third range (1032) greater than the second range (1031), the electronic device may move the indicator from a playback speed x1.5 to a playback speed x2.

FIG. 10b is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.

Referring to FIG. 10b, the electronic device can adjust a setting value related to the first object (1040) (e.g., a brightness control user interface, a volume control user interface, or a play knob) displayed on a display by adjusting a tilt angle of the stylus pen (102) while a first input of the stylus pen (102) hovering or touching the first object (1040) included in the video application execution screen displayed on the display is maintained.

For example, if the first object (1040) is a user interface related to brightness control, the electronic device can control the brightness of the screen based on a change in the tilt of the stylus pen (102) while the first input of hovering or touching the first object (1040) of the stylus pen (102) is maintained.

For example, the electronic device can maintain the current brightness when the tilt angle of the stylus pen (102) is in the first range (1051). According to one embodiment, the electronic device can adjust the brightness of the screen to be brighter when the tilt direction of the stylus pen (102) is to the right or upward and the tilt angle changes to a second range (1052) greater than the first range (1051). According to one embodiment, the electronic device can adjust the brightness of the screen to be darker when the tilt direction of the stylus pen (102) is to the left or downward and the tilt angle changes to a third range (1050) greater than the first range (1051).

According to one embodiment, the electronic device may display a second object related to the first object (1040) when a tilt angle of the stylus pen (102) is within a first range (1051) while a first input of the stylus pen (102) hovering or touching the first object (1040) is maintained. For example, the second object may include a slider related to a setting value or an adjusted setting value (e.g., a numerical value).

According to one embodiment, if the first object (1040) is a user interface related to volume control, the electronic device can adjust the volume based on a change in the tilt angle of the stylus pen (102). According to one embodiment, if the first object (1040) is a user interface related to a currently playing portion of a video, the electronic device can adjust the playing portion of the video based on a change in the tilt angle of the stylus pen (102).

FIG. 11A is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.

Referring to FIG. 11A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a second object (1120) related to a first object (1110) based on a tilt of the stylus pen (102) (e.g., the electronic device (102) of FIG. 1, the stylus pen (201) of FIG. 2, and the stylus pen (201) of FIG. 3) being included in a first range while hovering or touching a first object (1110) (e.g., a back key) included in a browser execution screen displayed on a display (e.g., the display module (160) of FIG. 1)) is maintained.

In one embodiment, the second object (1120) may be a pop-up screen including a plurality of options related to the first object (1110). For example, based on the first object (1110) being a back key for displaying a previous screen, the second object (1120) may include options related to a plurality of previous screens (e.g., tab 1, tab 2, tab 3).

According to one embodiment, the electronic device may select one of a plurality of options included in the second object (1120) based on a change in the tilt angle of the stylus pen (102). For example, when the stylus pen (102) is tilted to the right as it is rotated clockwise, the electronic device may move an indicator indicating an option to be selected from the plurality of options to the right, and when the stylus pen (102) is tilted to the left as it is rotated counterclockwise, the electronic device may move an indicator indicating an option to be selected from the plurality of options to the left.

In one embodiment, the electronic device may move the indicator to an option corresponding to a previous screen as the tilt of the stylus pen (102) increases.

According to one embodiment, when the first input is released, the electronic device may display a screen corresponding to an option that was displayed when the indicator was maintained during the first input.

According to one embodiment, when an input of pressing a button of a stylus pen (102) or an input of pressing a button of the electronic device is received while the first input is maintained, the electronic device may display a screen corresponding to an option on which an indicator was displayed.

FIG. 11b is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.

Referring to FIG. 11B, the electronic device may display a second object (1140) related to the first object (1130) based on the inclination of the stylus pen (102) being included in a first range while a first input of the stylus pen (102) hovering or touching a first object (1130) (e.g., a back key) included in a browser execution screen displayed on the display is maintained. For example, the second object (1120) may include options related to a plurality of previous screens, and each option may include a tab name of the previous screen.

According to one embodiment, the electronic device may select one of a plurality of options included in the second object (1140) based on a change in the tilt angle of the stylus pen (102). For example, when the stylus pen (102) is tilted upward, the electronic device may move an indicator indicating an option to be selected from the plurality of options upward, and when the stylus pen (102) is tilted downward, the electronic device may move an indicator indicating an option to be selected from the plurality of options downward.

According to one embodiment, when the first input is released, the electronic device may display a screen corresponding to an option that was displayed when the indicator was maintained during the first input.

FIG. 12 is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.

Referring to FIG. 12, an electronic device (e.g., an electronic device (101) of FIG. 1 or a processor (120) of FIG. 1) may display a screen (1210) including at least one icon (e.g., A, B, C, ..., X) and a widget (1220) on a display (e.g., a display module (160) of FIG. 1). According to one embodiment, the screen (1210) may be a home screen.

According to one embodiment, at least one icon and widget (1220) included in the home screen may be arranged in a grid shape. According to one embodiment, the widget (1220) may be placed in an area where one or more grid areas are merged. According to one embodiment, the grid shape is displayed in FIG. 12 for convenience of explanation, but the grid shape may not be displayed in an actual implementation.

According to one embodiment, the widget (1220) is a plurality of widgets in a stack form.

It may be a stack widget that is nested to form multiple layers. For example, widget (1220) may be a stack widget in which three widgets are nested in a stack form.

In one embodiment, when the electronic device receives an input of touching or hovering a widget (1220) with a stylus pen (102) (e.g., the electronic device (102) of FIG. 1 , the stylus pen (201) of FIG. 2 , and the stylus pen (201) of FIG. 3 ), and the angle of inclination of the stylus pen (102) changes from a first range (1230) to a second range (1231), the electronic device may display at least one object (1221) associated with the widget (1220). In one embodiment, the inclination angle of the stylus pen (102) may be an angle between a direction of a display plane and the stylus pen (102). For example, the direction of the display plane may be a direction orthogonal to all straight lines included in the display plane.

According to one embodiment, the electronic device may display at least one object (1221) in a direction opposite to the direction in which the stylus pen (102) is tilted. For example, when the stylus pen (102) is tilted to the right and the angle is within the second range (1231), the electronic device may display at least one layer (1221) (e.g., a second widget, a third widget) that was not visible due to being obscured by the top layer (e.g., a first widget) of the widget (1220) on the left side of the widget (1220). According to one embodiment, when at least one layer (1221) related to a widget (1220) is displayed in a first area (1240) to the left of the widget (1220) where a 'G' icon and an 'I' icon are displayed, the electronic device may reduce the size of the 'G' icon and the 'I' icon displayed in the first area (1240) and display the reduced-sized 'G' icon and the 'I' icon (1241) to the left of the area where at least one layer (1221) is displayed in the first area (1240).

According to one embodiment, when the angle of inclination of the stylus pen (102) is changed from the second range (1231) to the first range (1230), or when the touch or hovering of the stylus pen (102) is released, the electronic device can restore the size and display position of the 'G' icon and 'I' icon (1241) that were reduced in size.

According to one embodiment, based on a change in the tilt angle of the stylus pen (102), the electronic device can expand the size of at least one layer (1221) associated with the widget (1220).

For example, when the tilt angle of the stylus pen (102) changes from the second range (1231) to a third range (1232) greater than the second range (1231), the electronic device may move at least one layer (1221) associated with the widget (1220) to the left so as to be further away from the widget (1220).

For example, when the stylus pen (102) is tilted to the right and the angle is included in the third range (1232), the electronic device may display at least one layer (1222) related to the widget (1220) in the first area (1240) which is to the left of the widget (1220) where the 'G' icon and the 'I' icon are displayed and in the second area (1250) which is to the left of the first area (1240) where the 'F' icon and the 'H' icon are displayed, the electronic device may reduce the sizes of the 'G' icon and the 'I' icon displayed in the first area (1240) and the F' icon and the 'H' icon displayed in the second area (1250), and display the 'G' icon, the 'I' icon, the F' icon, and the 'H' icon (1251) which are reduced in size on the left side of the area where at least one layer (1222) of the second area (1250) is displayed.

According to one embodiment, when the angle of the inclination of the stylus pen (102) is changed from the third range (1232) to the second range (1231), the electronic device may reduce the size of at least one layer (1222) related to the widget (1220) and display it in the first area (1240), and restore the size and display position of the 'F' icon and the 'H' icon whose size has been reduced. According to one embodiment, the 'G' icon and the 'I' icon whose size has been reduced may be displayed on the left side of at least one layer (1221) related to the widget (1220) in the first area (1240).

According to one embodiment, when the angle of inclination of the stylus pen (102) is changed from the third range (1232) to the first range (1230), or when the touch or hovering of the stylus pen (102) is released, the electronic device can restore the size and display positions of the 'G' icon, 'I' icon, 'F' icon, and 'H' icon (1251) that have been reduced in size.

FIG. 13 is a drawing for explaining the operation of an electronic device based on the tilt direction and angle of a stylus pen according to one embodiment.

Referring to FIG. 13, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a first object (1320) including a single layer on a display (e.g., the display module (160) of FIG. 1). For example, the first object (1320) may include a widget displayed on a home screen. For example, the first object (1320) may include brief information including temperature information of a current location, current time information, and weather information.

According to one embodiment, the electronic device can adjust the amount of information included in the first object (1320) based on a change in a tilt angle of the stylus pen (102) while a first input of touching or hovering the first object (1320) is maintained by the stylus pen (102) (e.g., the electronic device (102) of FIG. 1 , the stylus pen (201) of FIG. 2 , and the stylus pen (201) of FIG. 3 ).

For example, when the tilt angle of the stylus pen (102) is changed from the first range (1310) to the second range (1311), the electronic device may change the first object (1320) including brief information into the second object (1321) including detailed information. For example, the second object (1321) may further include date information and day-of-the-week weather forecast information in addition to current temperature information, current location information, current time information, and weather information. According to an embodiment, the size of the second object (1321) may be larger than the size of the first object (1320).

In one embodiment, when the size of an object on the home screen is increased so that an icon is displayed in an area where the icon is arranged, the electronic device may reduce the size of the icon that was previously displayed and display it around the object whose size has increased, as illustrated in FIG. 12.

In one embodiment, when the tilt angle of the stylus pen (102) is changed from a second range (1311) to a first range (1310) smaller than the second range (1311), the electronic device may change a second object (1321) including detailed information into a first object (1320) including brief information.

In this way, the electronic device can maintain the current screen and provide more detailed information based on changes in the tilt of the stylus pen without switching to a screen related to the first object.

According to one embodiment, an electronic device (e.g., an electronic device (101) of FIG. 1) may include a display (e.g., a display (160) of FIG. 1) and at least one processor (e.g., a processor (120) of FIG. 1) electrically connected to the display.

According to one embodiment, the at least one processor can display a first object through the display.

According to one embodiment, the at least one processor can detect a first input to the first object from a stylus pen (e.g., the electronic device (102) of FIG. 1, the stylus pen (201) of FIG. 2, and the stylus pen (201) of FIG. 3).

In one embodiment, the at least one processor can obtain a first tilt of the stylus pen while the first input is maintained.

In one embodiment, the at least one processor can further display a second object related to the first object based on the first slope being within a first range.

According to one embodiment, the electronic device may further include a communication module (e.g., the communication module (190) of FIG. 1).

According to one embodiment, the at least one processor can receive information about at least one of a direction of the first tilt or an angle of the first tilt from the stylus pen connected via the communication module.

According to one embodiment, the electronic device may further include at least one sensor (e.g., the sensor module (176) of FIG. 1).

According to one embodiment, the at least one processor can obtain at least one of a direction of the first inclination of the stylus pen or an angle of the first inclination based on the at least one sensor.

In one embodiment, the angle of the first inclination may include an angle between a direction in which the surface of the display is facing and the stylus pen.

In one embodiment, the at least one processor can increase the amount of content included in the second object based on the angle of the first inclination being changed to fall within a second range greater than the first range.

In one embodiment, the at least one processor can move the second object further away from the first object based on the angle of the first tilt being changed to fall within a second range greater than the first range.

In one embodiment, the at least one processor can increase the transparency of the second object based on the angle of the first tilt being changed to fall within a second range greater than the first range.

In one embodiment, the second object may include a plurality of optionally selectable items.

In one embodiment, the at least one processor can change an item to be selected from the plurality of items based on a change in at least one of an angle of the first inclination or a direction of the first inclination.

In one embodiment, the first object may be associated with a setting whose value can be adjusted.

According to one embodiment, the at least one processor can adjust a value of the setting based on a change in at least one of an angle of the first inclination or a direction of the first inclination, and display the second object related to the adjusted value of the setting.

In one embodiment, the second object may be displayed in a different layer than the first object.

According to one embodiment, the at least one processor may display the second object in an area opposite to a direction of the first inclination of the stylus pen based on a position of the first object.

According to one embodiment, a method of controlling an electronic device may include an action of displaying a first object.

According to one embodiment, a method of controlling an electronic device may include an operation of detecting a first input of a stylus pen to the first object.

According to one embodiment, a method of controlling an electronic device may include an operation of obtaining a first tilt of the stylus pen while the first input is maintained.

According to one embodiment, a control method of an electronic device may include an action of further displaying a second object related to the first object based on the first slope being included in a first range.

According to one embodiment, the operation of acquiring the first inclination of the stylus pen may receive information on at least one of a direction of the first inclination or an angle of the first inclination from the stylus pen connected via a communication module of the electronic device.

According to one embodiment, the operation of acquiring the first inclination of the stylus pen may acquire at least one of a direction of the first inclination of the stylus pen or an angle of the first inclination based on at least one sensor of the electronic device.

In one embodiment, the angle of the first inclination may include an angle between a direction in which the surface of the display is facing and the stylus pen.

According to one embodiment, the control method of the electronic device may further include an operation of increasing an amount of content included in the second object based on a change in the angle of the first inclination to fall within a second range greater than the first range.

According to one embodiment, the control method of the electronic device may further include an action of moving the second object further away from the first object based on a change in the angle of the first inclination to fall within a second range greater than the first range.

According to one embodiment, the control method of the electronic device may further include an operation of increasing transparency of the second object based on a change in the angle of the first inclination to fall within a second range greater than the first range.

In one embodiment, the second object may include a plurality of optionally selectable items.

According to one embodiment, the control method of the electronic device may further include an operation of changing an item to be selected from among the plurality of items based on a change in at least one of an angle of the first inclination or a direction of the first inclination.

In one embodiment, the first object may be associated with a setting whose value can be adjusted.

According to one embodiment, the control method of the electronic device may further include an operation of adjusting a value of the setting based on a change in at least one of an angle of the first inclination or a direction of the first inclination.

According to one embodiment, the control method of the electronic device may further include an action of displaying the second object related to a value of the adjusted setting.

In one embodiment, the second object may be displayed in a different layer than the first object.

According to one embodiment, the action of further displaying the second object may display the second object in an area opposite to the direction of the first inclination of the stylus pen based on the position of the first object.

According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs, wherein the one or more programs may include instructions for causing an electronic device including a display and at least one processor to display a first object through the display.

In one embodiment, the one or more programs may include instructions for the electronic device to detect a first input of a stylus pen to the first object.

In one embodiment, the one or more programs may include instructions for causing the electronic device to obtain a first tilt of the stylus pen while the first input is maintained.

In one embodiment, the one or more programs may include instructions that cause the electronic device to further display a second object related to the first object based on the first slope being within the first range.

According to one embodiment, the one or more programs may include instructions for the electronic device to receive information about at least one of a direction of the first tilt or an angle of the first tilt from the stylus pen connected via a communication module of the electronic device.

According to one embodiment, the electronic device may further include at least one sensor.

According to one embodiment, the one or more programs may include instructions for the electronic device to obtain at least one of a direction of the first inclination of the stylus pen or an angle of the first inclination based on the at least one sensor.

In one embodiment, the angle of the first inclination may include an angle between a direction in which the surface of the display is facing and the stylus pen.

In one embodiment, the one or more programs may include instructions for causing the electronic device to increase an amount of content included in the second object based on a change in the angle of the first tilt to fall within a second range greater than the first range.

In one embodiment, the one or more programs may include instructions for causing the electronic device to move the second object further away from the first object based on a change in the angle of the first tilt to fall within a second range greater than the first range.

In one embodiment, the one or more programs may include instructions for causing the electronic device to increase transparency of the second object based on a change in the angle of the first tilt to fall within a second range greater than the first range.

In one embodiment, the second object may include a plurality of optionally selectable items.

In one embodiment, the one or more programs may include instructions for the electronic device to change an item to be selected from the plurality of items based on a change in at least one of the angle of the first inclination or the direction of the first inclination.

In one embodiment, the first object may be associated with a setting whose value can be adjusted.

In one embodiment, the one or more programs may include instructions that cause the electronic device to adjust a value of the setting based on a change in at least one of an angle of the first inclination or a direction of the first inclination, and to display the second object associated with the adjusted value of the setting.

In one embodiment, the second object may be displayed in a different layer than the first object.

According to one embodiment, the one or more programs may include commands that cause the electronic device to display the second object in an area opposite to a direction of the first inclination of the stylus pen based on a position of the first object.

The electronic devices according to various embodiments disclosed in this document may be devices of various forms. The electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliance devices. The electronic devices according to embodiments of this document are not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but rather to encompass various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly dictates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first) is referred to as "coupled" or "connected" to another (e.g., a second) component, with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

The term "module" used in the embodiments of this document may include a unit implemented in hardware, software or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be an integrally configured component or a minimum unit of the component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., the electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, ‘non-transitory’ simply means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a commodity. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play StoreTM) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a part of the computer program product may be at least temporarily stored or temporarily generated in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or an intermediary server.

According to one embodiment, each component (e.g., a module or a program) of the above-described components may include a single or multiple entities, and some of the multiple entities may be separated and arranged in other components. According to one embodiment, one or more of the components or operations of the above-described components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, the multiple components (e.g., a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each of the multiple components identically or similarly to those performed by the corresponding component of the multiple components before the integration. According to one embodiment, the operations performed by the module, program, or other component may be executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims (20)

In an electronic device (101),
display (160); and
At least one processor (120) electrically connected to the display;
At least one processor of the above,
Displaying a first object through the above display,
Detecting a first input of the stylus pen (102, 201) to the first object,
Obtaining the first tilt of the stylus pen while the first input is maintained;
An electronic device set to further display a second object related to the first object based on the first slope being included in the first range.
In the first paragraph,
Further comprising a communication module (190);
At least one processor of the above,
An electronic device that receives information about at least one of a direction of the first inclination or an angle of the first inclination from the stylus pen connected through the communication module.
In paragraph 1 or 2,
further comprising at least one sensor (176);
At least one processor of the above,
An electronic device that obtains at least one of a direction of the first inclination of the stylus pen or an angle of the first inclination based on at least one sensor.
In any one of claims 1 to 3,
The angle of the first slope is,
Including the angle between the direction in which the surface of the display is viewed and the stylus pen,
At least one processor of the above,
An electronic device that increases the amount of content included in the second object based on the angle of the first inclination being changed to fall within a second range greater than the first range.
In any one of claims 1 to 4,
The angle of the first slope is,
Including the angle between the direction in which the surface of the display is viewed and the stylus pen,
At least one processor of the above,
An electronic device that moves the second object further away from the first object based on the angle of the first inclination being changed to fall within a second range greater than the first range.
In any one of paragraphs 1 to 5,
The angle of the first slope is,
Including the angle between the direction in which the surface of the display is viewed and the stylus pen,
At least one processor of the above,
An electronic device that increases the transparency of the second object based on the angle of the first inclination being changed to fall within a second range greater than the first range.
In any one of claims 1 to 3,
The second object above is,
Contains multiple optionally selectable items,
At least one processor of the above,
An electronic device that changes an item to be selected from among the plurality of items based on a change in at least one of the angle of the first inclination or the direction of the first inclination.
In any one of claims 1 to 3,
The above first object is,
It has to do with settings that can be adjusted in value,
At least one processor of the above,
An electronic device that adjusts a value of the setting based on a change in at least one of the angle of the first inclination or the direction of the first inclination, and displays the second object related to the adjusted value of the setting.
In any one of claims 1 to 8,
The second object above is,
An electronic device that is displayed on a different layer from the first object.
In any one of claims 1 to 9,
At least one processor of the above,
An electronic device that displays the second object in an area opposite to the direction of the first inclination of the stylus pen based on the position of the first object.
In a method for controlling an electronic device,
Action to display the first object;
An operation of detecting a first input of a stylus pen to the first object;
An operation of obtaining a first tilt of the stylus pen while the first input is maintained; and
A control method of an electronic device, comprising: an operation of further displaying a second object related to the first object based on the first slope being included in the first range;
In Article 11,
The operation of obtaining the first inclination of the above stylus pen is,
A control method of an electronic device for receiving information on at least one of a direction of the first inclination or an angle of the first inclination from the stylus pen connected through a communication module of the electronic device.
In clause 11 or 12,
The operation of obtaining the first inclination of the above stylus pen is,
A control method of an electronic device, wherein at least one of a direction of the first inclination of the stylus pen or an angle of the first inclination is obtained based on at least one sensor of the electronic device.
In any one of Articles 11 to 13,
The angle of the first slope is,
Including the angle between the direction in which the surface of the display is viewed and the stylus pen,
A control method of an electronic device further comprising: an operation of increasing an amount of content included in the second object based on a change in the angle of the first inclination to be included in a second range greater than the first range;
In any one of Articles 11 to 14,
The angle of the first slope is,
Including the angle between the direction in which the surface of the display is viewed and the stylus pen,
A control method of an electronic device further comprising: an operation of moving the second object further away from the first object based on a change in the angle of the first inclination to be included in a second range greater than the first range;
In any one of Articles 11 to 15,
The angle of the first slope is,
Including the angle between the direction in which the surface of the display is viewed and the stylus pen,
A control method of an electronic device further comprising: an operation of increasing transparency of the second object based on the angle of the first inclination being changed to fall within a second range greater than the first range.
In any one of Articles 11 to 13,
The second object above is,
Contains multiple optionally selectable items,
A control method of an electronic device further comprising: an operation of changing an item to be selected from among the plurality of items based on a change in at least one of the angle of the first inclination or the direction of the first inclination.
In any one of Articles 11 to 13,
The above first object is,
It has to do with settings that can be adjusted in value,
An operation of adjusting the value of the setting based on a change in at least one of the angle of the first inclination or the direction of the first inclination; and
A method of controlling an electronic device, further comprising: an operation of displaying the second object related to the value of the adjusted setting;
In any one of Articles 11 to 18,
The second object above is,
A method for controlling an electronic device, wherein the electronic device is displayed on a different layer from the first object.
In any one of Articles 11 to 19,
The action of further displaying the above second object is:
A control method of an electronic device that displays a second object in an area opposite to the direction of the first inclination of the stylus pen based on the position of the first object

Images