JP5653920B2 - Method for indicating the placement and orientation of graphical user interface elements - Google Patents

Description

CROSS REFERENCE TO RELATED APPLICATIONS This disclosure is a benefit of provisional application 61 / 095,225 filed on September 8, 2008, which is hereby incorporated by reference in its entirety and claims its priority. Insist.

  The present disclosure relates generally to indicating the orientation and placement of graphical user interface elements.

  Advances in technology have resulted in smaller and more powerful computing devices. For example, there currently exists a variety of portable personal computing devices including wireless computing devices such as portable wireless phones, personal digital assistants (PDAs), and paging devices that are small and lightweight and can be easily carried by users. More specifically, portable wireless phones such as cellular phones and Internet Protocol (IP) phones can carry voice and data packets over a wireless network. In addition, many such portable wireless telephones include other types of devices incorporated therein. For example, a portable wireless phone can also include a digital still camera, a digital video camera, a digital recorder, and an audio file player. Such wireless phones can also process executable instructions, including software applications that can be used to access the Internet, such as web browser applications. Thus, these portable wireless phones can include significant computing power.

  While such portable devices can support software applications, the usefulness of such portable devices is limited by the size of the device's display screen. In general, a smaller display screen allows the device to have a smaller form factor for easier portability and convenience. However, smaller display screens may limit the amount of content that can be displayed to the user and thus reduce the richness of user interaction with the portable device.

  In a multi-panel electronic device, user input indicating that a graphical user interface (GUI) element should be moved toward the gap between the first display surface and the second display surface is the first display. When received at the surface, a portion of the GUI element is displayed on the second display surface. Thus, a user of a multi-panel electronic device may be provided with a continuous visual cue for the GUI element, including when a portion of the moving GUI element will be otherwise “hidden” by the gap. By indicating direction, placement, and ability to cross the gap, errors can be reduced and usability of multi-panel electronic devices can be improved.

  In one particular embodiment, a method is disclosed that includes receiving at a first display surface user input for moving a graphical user interface element displayed on the first display surface of the electronic device. The electronic device further includes a second display surface that is separated from the first display surface by a gap. The method should also move at least a portion of the graphical user interface element beyond the edge of the first display surface and into the gap so that at least a portion of the graphical user element is not displayed on the first display surface. Including judging. The method further includes displaying at least a portion of the graphical user interface element on the second display surface based on the placement and direction of movement of the graphical user interface element on the first display surface.

  In another specific embodiment, an electronic device is disclosed. The electronic device includes a first panel having a first display surface. The electronic device also includes a second panel having a second display surface that is separated from the first display surface by a gap. The electronic device further includes a processor configured to receive at the first display surface user input for moving a graphical user interface element displayed on the first display surface. The processor should also move at least a portion of the graphical user interface element beyond the edge of the first display surface and into the gap so that at least a portion of the graphical user interface element is not displayed on the first display surface. Configured to determine that. The processor is further configured to display at least a portion of the graphical user interface element on the second display surface based on the placement and direction of movement of the graphical user interface element on the first display surface.

  One particular advantage provided by at least one of the disclosed embodiments relates to a moving GUI element that a user will otherwise be hidden by the gap between the display surfaces of the multi-panel electronic device. Intuitive operation of multi-panel electronic devices that can be given continuous visual cues.

  Other aspects, advantages, and features of the present disclosure will become apparent after review of the entire application, including the following sections, including a brief description of the drawings, a mode for carrying out the invention, and the claims. Let's go.

1 illustrates a first exemplary embodiment of an electronic device. FIG. FIG. 2 illustrates an exemplary embodiment of the electronic device of FIG. 1 in a fully folded configuration. FIG. 3 illustrates an exemplary embodiment of the electronic device of FIG. 1 in a summing configuration. FIG. 3 illustrates an exemplary embodiment of the electronic device of FIG. 1 in a travel clock configuration. FIG. 2 illustrates a first exemplary embodiment of the electronic device of FIG. 1 in a fully deployed configuration. FIG. 3 illustrates a second exemplary embodiment of the electronic device of FIG. 1 in a fully deployed configuration. FIG. 2 illustrates an exemplary embodiment of the electronic device of FIG. 1 in a video conference configuration. FIG. 4 is a block diagram of a second exemplary embodiment of an electronic device. FIG. 4 illustrates a third exemplary embodiment of an electronic device. FIG. 10 is a partial cross-sectional view of the electronic device of FIG. 9. FIG. 10 illustrates an exemplary embodiment of the electronic device of FIG. 9 in a tilted configuration. FIG. 12 is a partial cross-sectional view of the electronic device in the inclined configuration of FIG. FIG. 10 illustrates an exemplary embodiment of the electronic device of FIG. 9 in a folded configuration. FIG. 14 is a partial cross-sectional view of the electronic device in the folded configuration of FIG. 13. FIG. 6 illustrates a fourth exemplary embodiment of an electronic device. The figure which shows the electronic device of FIG. 15 in a travel clock structure. The figure which shows the electronic device of FIG. 16 in a full expansion | deployment form. FIG. 9 shows a fifth exemplary embodiment of an electronic device. The figure which shows the electronic device of FIG. 18 in a travel clock structure. The figure which shows the electronic device of FIG. 18 in a fully expansion | deployment form. FIG. 9 shows a sixth exemplary embodiment of an electronic device. FIG. 9 shows a seventh exemplary embodiment of an electronic device. The figure which shows the electronic device of FIG. 22 in a partial folding form. FIG. 10 shows an eighth exemplary embodiment of an electronic device. The figure which shows the electronic device of FIG. 24 in an assembly structure. 2 is a flowchart of a first exemplary embodiment of a method for changing a software state in a multi-panel electronic device. FIG. 10 shows a ninth exemplary embodiment of an electronic device. FIG. 28 illustrates an exemplary embodiment of the electronic device of FIG. 27 in a summing configuration. FIG. 28 illustrates an exemplary embodiment of the electronic device of FIG. 27 in a fully deployed configuration. FIG. 28 illustrates an exemplary embodiment of the electronic device of FIG. 27 in a travel clock configuration. FIG. 28 illustrates an exemplary embodiment of the electronic device of FIG. 27 in a video conference configuration. FIG. 11 shows a tenth exemplary embodiment of an electronic device. FIG. 33 illustrates an exemplary embodiment of the electronic device of FIG. 32 in a fully deployed configuration. FIG. 34 is a diagram illustrating an exemplary embodiment of an electronic device in the fully expanded configuration of FIG. 33 illustrating the movement of application icons in response to user input. FIG. 34 illustrates an exemplary embodiment of an electronic device in the fully expanded configuration of FIG. 33 displaying an application window. FIG. 34 is a diagram illustrating an exemplary embodiment of an electronic device in the fully expanded configuration of FIG. 33 illustrating the movement of an application window in response to user input. FIG. 37 illustrates the exemplary embodiment of the electronic device of FIG. 36 after a predetermined portion of the application window has crossed the gap between the display surfaces. FIG. 18 shows an eleventh exemplary embodiment of an electronic device. FIG. 39 illustrates an exemplary embodiment of the electronic device of FIG. 38 in a lateral orientation. FIG. 39 illustrates an exemplary embodiment of the electronic device of FIG. 38 in a rotating position. FIG. 39 illustrates an exemplary embodiment of the electronic device of FIG. 38 in a vertical orientation. 6 is a flowchart of a second exemplary embodiment of a method for changing a software state in a multi-panel electronic device. 6 is a flowchart of a third exemplary embodiment of a method for changing a software state in a multi-panel electronic device. 6 is a flowchart of a fourth exemplary embodiment of a method for changing a software state in a multi-panel electronic device. 10 is a flowchart of a fifth exemplary embodiment of a method for changing a software state in a multi-panel electronic device. 10 is a flowchart of a sixth exemplary embodiment of a method for changing a software state in a multi-panel electronic device. 7 is a flowchart of a seventh exemplary embodiment of a method for changing a software state in a multi-panel electronic device. 10 is a flowchart of an eighth exemplary embodiment of a method for changing a software state in a multi-panel electronic device. FIG. 18 shows a twelfth exemplary embodiment of an electronic device. FIG. 50 illustrates an exemplary embodiment of the electronic device of FIG. 49 in a fully deployed configuration. FIG. 50 illustrates an exemplary embodiment of the electronic device of FIG. 49 in a folded configuration. FIG. 50 illustrates an exemplary embodiment of the electronic device of FIG. 49 in a summing configuration. FIG. 50 illustrates an exemplary embodiment of the electronic device of FIG. 49 in a video conference configuration. FIG. 50 illustrates an exemplary embodiment of the electronic device of FIG. 49 in a travel clock configuration. FIG. 50 illustrates an exemplary embodiment of the electronic device of FIG. 49 in a dual panel configuration. 2 is a flowchart of a first exemplary embodiment of a method for determining a configuration of an electronic device. 6 is a flowchart of a second exemplary embodiment of a method for determining a configuration of an electronic device. 6 is a flowchart of a third exemplary embodiment of a method for determining a configuration of an electronic device. FIG. 16 is a block diagram of a thirteenth exemplary embodiment of an electronic device. FIG. 18 shows a fourteenth exemplary embodiment of an electronic device. FIG. 61 illustrates an exemplary embodiment for displaying an image in the electronic device of FIG. 60. FIG. 61 illustrates a second exemplary embodiment for displaying an image in the electronic device of FIG. 60. FIG. 61 illustrates a third exemplary embodiment for displaying an image in the electronic device of FIG. 60. FIG. 61 illustrates a first exemplary embodiment for displaying an image in a three-panel version of the electronic device of FIG. 60. FIG. 61 illustrates a second exemplary embodiment for displaying an image in a three panel version of the electronic device of FIG. 60. FIG. 61 illustrates a third exemplary embodiment for displaying an image in a three panel version of the electronic device of FIG. 60. 2 is a flowchart of a first exemplary embodiment of a method for displaying an image in an electronic device. 6 is a flowchart of a second exemplary embodiment of a method for displaying an image in an electronic device. 6 is a flowchart of a third exemplary embodiment of a method for displaying an image in an electronic device.

  With reference to FIG. 1, a first illustrated embodiment of an electronic device is shown and generally designated 100. The electronic device 101 includes a first panel 102, a second panel 104, and a third panel 106. The first panel 102 is coupled to the second panel 104 along a first edge at a first folded position 110. The second panel 104 is coupled to the third panel 106 along the second edge of the second panel 104 at the second folded position 112. Each of the panels 102, 104, and 106 includes a display surface configured to provide a visual display, such as a liquid crystal display (LCD) screen. The electronic device 101 is a wireless communication device that has a plurality of display surfaces and is configured to automatically adjust a user interface or display an image when a user changes the physical configuration of the electronic device 101. is there.

  As shown in FIG. 1, the first panel 102 and the second panel 104 are rotatably coupled in a first folded position 110 to allow various device configurations. For example, the first panel 102 and the second panel 104 can be arranged such that the display surfaces are substantially coplanar to form a substantially flat surface. As another example, the first panel 102 and the second panel 104 rotate relative to each other about the first folded position 110 until the back surface of the first panel 102 contacts the back surface of the second panel 104. Can be done. Similarly, the second panel 104 is rotatably coupled to the third panel 106 along the second folded position 112 so that the display surface of the second panel 104 contacts the display surface of the third panel 106. Various configurations, including a fully folded closed configuration, and a fully deployed configuration in which the second panel 104 and the third panel 106 are substantially coplanar.

  In one particular embodiment, as described below with respect to FIGS. 2-7, the first panel 102, the second panel 104, and the third panel 106 are hand-operated in one or more physical folded states. Can consist of work. By allowing the electronic device 101 to be arranged in multiple foldable configurations, a user of the electronic device 101 may choose to have a small form factor for easy maneuverability and functionality. Expanded, larger form factors to display rich content and to allow more meaningful interaction with one or more software applications via an extended user interface You can choose.

  In one particular embodiment, electronic device 101 includes a plurality of foldable display panels 102, 104, and 106. When fully deployed, the electronic device 101 can provide a panoramic view similar to a wide screen television. When fully folded to the closed position, the electronic device 101 can provide a small form factor and can also provide an abbreviated view similar to a cell phone. In general, multiple configurable displays 102, 104, and 106 are used as multiple types of devices, depending on how the electronic device 101 is folded or configured. Can make it possible.

  Referring to FIG. 2, a second embodiment of the electronic device 101 of FIG. 1 in a fully folded configuration is shown and generally designated 200. The first panel 102 is shown on the top surface of the electronic device 101. As shown in FIG. 2, the display surface of the first panel 102 is visible, and the first panel 102 is in contact with the back surface of the second panel 104 so that the back surface of the first panel 102 is in contact with The first folding position 110 with the second panel 104 is fully folded. The third panel 106 is fully folded with respect to the second panel 104 along the second folding position 112. The second panel 104 is configured such that the second display surface is substantially proximate to the display surface of the third panel 106 inside the fully folded configuration. As shown in FIG. 2, the electronic device 101 includes substantially stacked layers (ie, a first panel 102, a second panel 104, and a third panel 106), Has a rectangular shape or form factor. The display surfaces of the second panel 104 and the third panel 106 are substantially protected from damage by external sources inside the fully folded configuration 200 of FIG. The embodiment shown in FIG. 2 shows a specific embodiment of the electronic device 101 next to a US 25 cent coin and pencil for size comparison purposes, but FIG. 2 shows all other views of this application. Similarly, it should be clearly understood that it is not necessarily to scale and should not be construed as limiting the scope of the present disclosure.

  Referring to FIG. 3, the electronic device 101 of FIG. 1 in a “summing” configuration is shown and generally designated 300. The first panel 102 and the second panel 104 are coupled at the first folding position 110 in a substantially coplanar configuration. The second panel 104 and the third panel 106 are offset from each other along the second folding position 112. In one particular embodiment, the angle of rotation 318 from the display surface of the third panel 106 to the display surface of the second panel 104 is greater than 90 degrees and less than 180 degrees. For example, as shown in FIG. 3, the angle 318 formed between the second panel 104 and the third panel 106 can be substantially 135 degrees.

As shown in FIG. 3, the back surface 314 of the third panel 106 can rest on a support surface such as a table surface, desk surface, user's hand, and the like. In one particular embodiment, the third panel 106 can be weighted so that in the particular configuration shown in FIG. 3, the electronic device 101 can be stable when maintained in a summing configuration 300 on the surface. . As shown, in the summing configuration 300, the user is conveniently tilted, formed by a substantially horizontal keyboard 316 and a display surface of the first panel 102 and a display surface of the second panel 104; The third panel 106 can display a keyboard 316 so that it can have an effective two-panel display surface disposed, and the first panel 102 and the second panel 104 are one of the graphical user interfaces. One or more parts can be displayed. In one particular embodiment, the electronic device 101 can be held in the summing configuration 300 by the user so that the keyboard 316 can be actuated by the user's one or both thumbs.

  Referring to FIG. 4, the electronic device 101 of FIG. 1 in a travel clock configuration is shown and is generally designated 400. The first panel 102 is folded at an angle 420 smaller than 180 degrees and larger than 0 degrees along the first folding position 110 with respect to the second panel 104. For example, the angle 420 formed by the first panel 102 and the second panel 104 can be substantially 60 degrees. The second panel 104 is oriented relative to the third panel 106 at an angle 422 that is greater than 90 degrees and less than 180 degrees along the second folded position 112. As shown, the angle 422 along the second folding position 112 may be about 135 degrees.

In one particular embodiment, travel clock configuration 400 includes a display of clock display 418 such as a digital clock display or an analog clock display on the display surface of second panel 104. For example, clock display 418 may be an image of a clock face. In one particular embodiment, the display surface of the first panel 102 may be in a power down configuration, and the display surface of the third panel 106 may be configured as an alarm set control, volume control, radio station tuning control, or other control ( One or more controls common to travel clocks can be displayed, such as (not shown).

  FIG. 5 shows the electronic device 101 of FIG. The first panel 102 and the second panel 104 are substantially flush with each other, and the second panel 104 is substantially flush with the third panel 106. Panels 102, 104, and 106 are first so as to effectively form a three-panel display screen in which the display surfaces of first panel 102, second panel 104, and third panel 106 are unfolded. Contact may occur at the folded position 110 and the second folded position 112. As shown, in the fully expanded configuration 500, each display surface displays a portion of a larger image, with each display surface displaying a portion of the larger image in a portrait mode, Expand in landscape mode across an active 3-panel screen. In one particular embodiment, the panels 102, 104, and 106 may be lockable so that they are maintained in a substantially fully deployed configuration 500.

  FIG. 6 illustrates the electronic device 101 of FIG. 1 in a fully expanded configuration 600 with a reduced effective display surface on the first panel 102, the second panel 104, and the third panel 106 compared to FIG. Indicates. Similar to FIG. 5, the panels 102, 104, and 106 can be substantially deployed and locked in place. However, as shown in FIG. 6, the upper and lower surface portions of each of the longitudinal modes of panels 102, 104, and 106 cannot include a display surface; instead, a hinge, microphone , One or more hardware functions, such as speakers or other hardware functions (not shown).

  FIG. 7 shows the electronic device 101 of FIG. The first panel 102 is coupled to the second panel 104 at the first folded position 110 such that the first panel 102 is substantially flush with the second panel 104. The second panel 104 and the third panel 106 are such that the display surface of the second panel 104 and the display surface of the third panel 106 are substantially adjacent to each other and protected inside the folded configuration. , Coupled in a folded configuration along the second folding position 112. By folding the third panel 106 on the second panel 104, the back surface 108 of the third panel 106 including the camera 720 is exposed to the user of the electronic device 101. The lower edge of the third panel 106 includes a microphone 722 and a speaker 724. Although shown at the lower edge of the third panel 106, it should be clearly understood that the microphone 722 and speaker 724 may be located at other locations on the electronic device 101. For example, as shown with respect to FIG. 32, the microphone 722 can be placed on the top of the display surface of the first panel 102 and the speaker 724 can be placed on the bottom of the display surface of the first panel 102. The video conferencing configuration 700 allows a user of the electronic device 101 to view an image of a participant in a video conference call on the display surface of the first panel 102 and is simultaneously placed in the field of view of the camera 720 to display the user image. Capturing and allowing the user's captured image to be provided to one or more participants in a video conference.

  In one particular embodiment, the electronic device 101 of FIGS. 1-7 is mechanically connected and foldable and can be used three or three separate touch screen displays 102, 104, which can be used individually or together. And 106 are used. This enables multiple user interfaces that can be changed based on the shape or configuration of the electronic device 101. Multiple configurable user interfaces allow the electronic device 101 to be used as multiple types of devices, depending on how the electronic device 101 is folded or configured. . When using the electronic device 101, the user can start by interacting with a single screen (the device is fully folded), and then the electronic device 101 is folded into a different physical configuration. Automatically change the interface (based on application or configuration). The electronic device 101 may be configured to execute simultaneous applications on multiple screens and reconfigure the application based on user interaction that changes the device configuration. For example, the electronic device 101 runs an application on a single display 102, 104, or 106 in one physical configuration, and runs an application across all three displays 102, 104, and 106 in a different physical configuration. It can be configured to perform.

  For example, when the electronic device 101 is fully folded to a closed position (a single screen is displayed, such as the fully folded form 200 of FIG. 2), the electronic device 101 retains a small form factor and displays an abbreviated user interface view. Can be given. Based on user interaction, this fully folded form can be a phone, short message service (SMS), personal digital assistant (PDA) type browser application, keypad, menu, other interface elements, or any combination thereof, etc. The application can be displayed.

  When fully deployed (all screens are displayed, such as fully deployed configuration 500 in FIG. 5 or 600 in FIG. 6), electronic device 101 can provide a panoramic view. Based on the application selected by the user, the panoramic view is illustrative and non-limiting example, with or without a keyboard, widescreen video, desktop environment with application (eg, email, text editor), or web An interface similar to a browser can be automatically displayed. The interactions for these interfaces can be similar to the native format of the interface, instead of being limited to mobile phone type interactions.

  When the display is folded into a triangle (such as travel clock configuration 400 in FIG. 4, one part of the triangle is a rear-facing display, the other part of the triangle is a forward-facing display, and the last part is folded down. This configuration can automatically trigger the display of the directional user interface. In other words, the front display (s) is for a specific configuration, such as a game application, email, SMS, phone, alarm clock, digital radio, or music player, as an illustrative non-limiting example The device display can be shown, while the rear display, the lower display, or both can be idle or off.

  When one outer display is configured at an angle of about 45 degrees relative to the other display (such as the summing configuration 300 of FIG. 3), the electronic device 101 can automatically change the interface. For example, the interface can be a text input device. A 45 degree display can show a keyboard, and other displays can display text entry applications, non-PDA type browsers, or other desktop-like applications.

  Thus, the electronic device 101 can have the ability to automatically change the user interface and interaction method based on mechanical triggers, sensor information, and the like. The electronic device 101 can provide the advantage of predicting the user's expectations for the device without the user having to browse through multiple menus. The electronic device 101, when fully deployed, becomes larger than the current mobile device interface, thus overcoming the disadvantages of conventional mobile devices that have insufficient screen area. The user of the electronic device 101 can change the application interface to more closely match the user's needs and preferences when used. The difficulties that may be encountered by users of conventional mobile devices that use complex desktop-like interfaces, such as text editors or browsers, may be mitigated by the electronic device 101 that allows the interface to spread across multiple displays.

  With reference to FIG. 8, a particular exemplary embodiment of an electronic device is shown and generally designated 800. Device 800 includes a main board 801 coupled to a first display board 803 and a second display board 805 via a set of connections 890 on a hinge (not shown). Each of the boards 801, 803, and 805 may be in a separate panel of a multi-panel hinge coupling device, such as the electronic device 101 of FIGS.

  The main board 801 includes a display 802, a processor 810 coupled to a memory 832, a display controller 862, a touch screen controller 852, a wireless controller 840, a short-range wireless interface 846, and a coder / decoder (codec) 834. And a power management integrated circuit (PMIC) 880. The first display board 803 includes a display 804 coupled to a display controller 864, a touch screen controller 854, and one or more folded / tilt sensors 874. The second display board 805 includes a display 806 coupled to a display controller 866, a touch screen controller 856, and one or more folded / tilt sensors 876. The first display board 803 is coupled to the main board 801 via a first communication path such as a first high speed serial link 892. The second display board 805 is coupled to the main board 801 via a second communication path such as a second high speed serial link 894. First display board 803 and second display board 805 each have batteries 884 and 886 coupled to PMIC 880 via power line 896, and power line 896 is at least one between PMIC 880 and batteries 884 and 886. It may be possible to conduct .5 amps (A). In one particular embodiment, camera 820 and power input 882 are also coupled to main board 801.

  The processor 810 can include one or more processing devices, such as one or more ARM type processors, one or more digital signal processors (DSPs), other processors, or any combination thereof. . The processor 810 can access one or more computer-readable media, such as the exemplary memory 832. Memory 832 stores data (not shown) and processor-executable instructions such as software 833. In general, software 833 includes processor-executable instructions that are executable by processor 810, and may include application software, operating system software, other types of program instructions, or any combination thereof. Although memory 832 is shown external to processor 810, in other embodiments memory 832 may be a cache, one or more registers or register files, other storage devices in processor 810, or any combination thereof. Etc., may be internal to the processor 810.

  The processor 810 is also coupled to a fold form sensor such as a fold form and tilt sensor 874 in the first display panel 803 and a fold form and tilt sensor 876 in the second display panel 805, respectively. In the illustrative example, the device 800 may be the electronic device 101 of FIG. 1, and the sensors 874 and 876 may be configured such that the folded configuration of the device 800 is the fully folded configuration shown in FIG. 2, the summing configuration shown in FIG. 4 may be adapted to detect as one or more of the travel clock configurations shown in FIG. 4, the fully deployed configuration shown in FIGS. 5-6, or the video conferencing configuration shown in FIG.

  Display controllers 862, 864, and 866 are configured to control displays 802, 804, and 806. In one particular embodiment, displays 802, 804, and 806 can correspond to display surfaces 102, 104, and 106 shown in FIGS. Display controllers 862, 864, and 866 may be configured to provide graphical data to display on displays 802, 804, and 806 in response to processor 810 depending on the configuration of device 800. For example, when the device 800 is in a fully folded configuration, the display controllers 862, 864, and 866 can control the first display 802 to display a graphical user interface, while the other displays 804 and 806 are controlled. It can be turned off or not used. As another example, when the device 800 is in a fully deployed configuration, the display controllers 862, 864, and 866 can display the displays 802, 804, and 806 as a single active screen across all three displays 802, 804, and 806. Can be controlled to display each part of the image.

  In one particular embodiment, each of the displays 802, 804, and 806 is responsive to user input via a respective touch screen coupled to a touch screen controller 852, 854, or 856, respectively. Touch screen controllers 852, 854, and 856 are configured to receive signals representing user input from displays 802, 804, and 806 and provide data indicative of the user input to processor 810. For example, the processor 810 can respond to user input indicating a double tap of an application icon on the first display 802, launches the application in response to the user input, and displays one of the displays 802, 804, or 806. One or more application windows can be displayed.

  In one particular embodiment, having each display controller 862, 864, and 866 and each touch screen controller 852, 854, and 856 with a corresponding display 802, 804, and 806 provides a controller and a corresponding display. Compared to other embodiments having on separate panels, the amount of data communicated between the panels may be reduced. However, in other embodiments, two or more of the display controllers 862, 864, or 866, or the touch screen controllers 853, 854, or 856, are single control units that control all three displays 802, 804, and 806. It can be combined with a single controller or the like. Further, although three displays 802, 804, and 806 are shown, in other embodiments, the device 800 may include more or less than three displays.

  High speed serial links 892 and 894 may be high speed bidirectional serial links. For example, links 892 and 894 may be mobile display digital interface (MDDI) type links. Touch screen data and sensor data are returned from panels 803 and 805 to processor 810 so that only four differential pairs can be used for signaling on the respective hinges between panels 801, 803, and 805. Can be embedded in a serial stream.

  In one particular embodiment, sensors 874 and 876 may be adapted to detect the folded configuration of device 800 based on inputs received at one or more sensors. For example, one or more of sensors 874 and 876 include input from one or more accelerometers, inclinometers, hinge detectors, other detectors, or any combination thereof. Or can be received. Sensors 874 and 876 can provide information to processor 810 that indicates the detected folded configuration of device 800. Sensors 874 and 876 can respond to the relative folded position, such as by detecting the angle of rotation of the display panel relative to the adjacent display panel of device 800. Sensors 874 and 876 may also be responsive to one or more other sensors such as one or more accelerometers or inclinometers coupled to one or more display panels of device 800.

  A coder / decoder (codec) 834 may also be coupled to the processor 810 as shown in FIG. Speaker 822 and microphone 824 may be coupled to codec 834. FIG. 8 also illustrates that a wireless controller 840 can be coupled to the processor 810 and the wireless antenna 842 to enable the device 800 to communicate over a wireless network, such as a wide area network (WAN). When device 800 receives an incoming call, processor 810 responds to wireless controller 840 with a call indication, such as caller identification information or caller number, on one or more of displays 802, 804, and 806. Can be displayed. The processor 810 displays the call display based on at least in part on the collapsed configuration of the device 800 determined based on inputs from the sensors 874 and 876, and a specific display 802, 804 and 806 can be determined. For example, the call display may be displayed on one or more other applications as a pop-up window or text having a size, placement, and orientation based on a collapsed configuration.

  In one particular embodiment, device 800 is configured to be operable for wireless telephony in all folded configurations. In one particular embodiment, processor 810 is coupled to a short range wireless interface 846 that can be coupled to headset 850 via antenna 848. The short range wireless interface 846 may be wirelessly coupled to a headset 850 such as a device including an earpiece and a microphone via an ad hoc wireless network such as a Bluetooth network. The processor 810 may implement logic to determine whether to display a call indication or to alert the headset 850 in response to an incoming call. For example, if the device 800 is in a fully deployed configuration and a multimedia file or streaming media is displayed across all displays 802, 804, and 806, the processor 810 can automatically alert the headset 850. In other cases, a call display can be displayed.

  In one particular embodiment, one or more of the components of FIG. 8 may be located proximate to or within one or more of the device panels. For example, the processor 810 can be located in the center panel, and the external panels can store batteries 884 and 886, respectively. In one particular embodiment, the panel may be weighted to allow the device to remain standing in the summing configuration.

  With reference to FIG. 9, a particular exemplary embodiment of an electronic device is shown and generally designated 900. Device 900 includes a first panel 902 and a second panel 904. The first panel 902 and the second panel 904 are coupled via embedded hinges 905 near the upper and lower edges of the panels 902 and 904. In one particular embodiment, the electronic device 900 can be manipulated by the user into various configurations for use, and can automatically adjust software configurations or displayed images in response to configuration changes. In the illustrated embodiment, the electronic device 900 is a two-panel embodiment of the electronic device 101 of FIG. 1, the electronic device 800 of FIG. 8, or any combination thereof. In one particular embodiment, the embedded hinge 905 includes a coupling member 906. FIG. 9 is substantially flush with the surfaces of the first panel 902 and the second panel 904 and is defined by the first aperture 1040 and the second panel 904 defined by the first panel. FIG. 9 includes an enlarged view of the embedded hinge 905 showing the coupling member 906 visible through the second aperture 1044.

  Folded display panels 902 and 904 can provide a panoramic view similar to a wide screen television when fully deployed, provide a small form factor when fully folded to a closed position, and are more traditional cellular telephones. An abbreviated view similar to can be given. Small hinges, such as embedded hinges 905 that give more complex movements including translation and rotation, can be used to reduce the display panel gap and create more continuous tiling, with multiple displays or panels. It can be used in one or more designs.

FIG. 10 shows a side partial cross-sectional view of the device 900 of FIG. The first panel 902 defines a first aperture 1040 that is in communication with the first cavity 1042 within the first panel 902. The second panel 904 defines a second aperture 1044 that is in communication with a second cavity 1046 in the second panel 904. The coupling member 906 is coupled to a first pivot member such as the first pin 1010 and a second pivot member such as the second pin 1008. The first pin 1010 allows the first panel 902 to be rotatably coupled to the coupling member 906, and the second pin 1008 is the second panel 904 is rotatably coupled to the coupling member 906. Makes it possible to As a result, the first panel 902 and the second panel 904 are rotatably coupled to each other. In addition, the aperture 1040 defined in the first panel 902 and the aperture 1044 defined in the second panel 904 each allow the coupling member 906 to be inserted therein, And is formed to allow a range of rotational movement of each of the panels 902 and 904 relative to the coupling member 906. In addition, the first pin 1010 has an embedded hinge 905 in the deployed configuration to allow lateral movement of the first panel 902 relative to the second panel 904, and the first pin 1010 is the first of the slot 1012. The first panel 902 is engaged in a slot 1012 in the first cavity 1042 such that the first panel 902 has a range of motion relative to the second panel 904. Further, the first panel 902 has a second range of motion relative to the second panel 904 when the embedded hinge 905 is in a retracted configuration and the first pin 1010 is at the second end of the slot 1012. And the first movement range is larger than the second movement range. As discussed with respect to FIGS. 15-20, a sensor may be coupled to the embedded hinge 905 to detect the relative orientation of the first panel 902 with respect to the second panel 904.

  As shown, the first aperture 1040 is sized to receive at least a first portion of the coupling member 906, and the first portion includes a portion of the coupling member 906 coupled to the pin 1010. Further, the second aperture 1044 is sized to receive at least a second portion of the coupling member 906, the second portion including a portion coupled to the second pin 1008. Further, when the first pin 1010 is in the innermost position within the slot 1012, the first cavity 1042 includes a deployed embedded component 1014 for receiving the coupling member 906.

  FIG. 11 shows the electronic device 900 of FIG. 9 in a tilted configuration 1100. The first panel 902 is oriented at an angle with respect to the second panel 904 via an embedded hinge 905 shown as including a coupling member 906. FIG. 11 includes an enlarged view of the embedded hinge 905 showing the coupling member 906 deployed through different areas of the second aperture 1044 of the second panel 904 compared to FIG.

  FIG. 12 shows the first panel 902 rotatably coupled to the second panel 904 via a coupling member 906. The coupling member 906 is rotatably coupled to the first panel 902 via a first pin 1010 engaged in the slot 1012 and is rotatable to the second panel 904 via a second pin 1008. Combined. As shown in FIG. 12, the second panel 904 is abutted against the first panel 902 to provide an angle stop 1216. In the configuration of FIG. 12, the second panel 904 can be rotated inward to a fully folded position so that it is flat with respect to the surface of the panel 902, up to a predetermined angle 1218 relative to the first panel 902. It can be rotated outward and angle stop 1216 can prevent further rotational separation. The angle stop 1216 can hold the second panel 904 at a predetermined angle 1218, shown in the embodiment of FIG. 12 as being substantially 135 degrees with respect to the first panel 902.

  Referring to FIG. 13, the electronic device 900 shown in FIG. 9 is shown in a fully folded configuration 1300. Fully folded configuration 1300 has a first panel 902 having a first surface, such as a display surface substantially proximate to second panel 904, including a screen. The embedded hinge 905 is in a retracted configuration to allow the first panel 902 to be positioned substantially proximate to the second panel 904 to reduce the device height in the fully folded configuration 1300. Is shown in An enlarged view of the embedded hinge 905 is shown in FIG. 13 showing the coupling member 906 extending through the first aperture 1040 of the first panel 902 and the second aperture 1044 of the second panel 904.

  FIG. 14 shows a cross-sectional side view of the fully folded configuration 1300. As shown in FIG. 14, the first panel 902 is fully folded relative to the second panel 904, and the coupling member 906 includes the first cavity 1042 of the first panel 902 and the second panel 904. It is completely inside the second cavity 1046. As shown, the coupling member 906 has a second pin 1010 engaged into the first cavity 1042 at one end of the slot 1012 so that the first panel 902 and the second panel 904 are substantially connected. Placed in close proximity to each other, allowing them to be substantially flat relative to each other as shown.

  In one particular embodiment, as will be discussed in more detail with respect to FIGS. 15-17 and 18-20, the multi-fold mobile device may display the orientation of the display image based on feedback from the hinge sensor and The embedded hinge 905 can be detented and can be equipped with sensors so that the contents can be adjusted. The hinge can use a pressure sensor, an electrical contact, a hall sensor, an optical element, or inductive detection, for example, to read position, as an illustrative and non-limiting example. Feedback may be received from more than one hinge position or rotation. The hinge can allow the folding panel to be set in place, and the multi-fold mobile device can display the display image based at least in part on detecting the folding panel in place. Attitude and content or user interface can be set. For example, the hinge can be ball detented, can have one or more intermediate positions or stops between fully open and fully closed, can be spring biased, or Other configurations that allow the folding panel to be held in multiple positions can be provided. For example, one or more hinges can be spring biased so that the panels can be slightly separated for repositioning and allowed to rebound to different configurations. Furthermore, the electronic device can have a first type of hinge in one fold and a second type of hinge in another fold.

  For example, in one particular embodiment, the detent hinge allows the panel to be placed flat or in one plane and the display image is active and ready to be viewed in the landscape mode. Can do. When the multifold device is not flat, the left panel can include a touch panel keyboard in a vertical orientation, and other displays can be combined in a vertical mode. When the multifold device is closed, the right display may be active and in a vertical orientation, and the remaining displays may remain off and inactive. The functional flow can include a multi-fold device set at a particular position, one or more smart hinges that read the position, and an image or user interface that adjusts in response to reading the position. A wide variety of possible configurations for display images or user interfaces may be enabled by detent hinges in multifold devices, and in one particular embodiment, a small form factor device is used as a large screen multimedia device Can be enabled to be deployed.

  FIG. 15 illustrates a particular exemplary embodiment of a three panel electronic device in a folded configuration 1500. The three-panel device 1501 includes a first panel 1502, a second panel 1504, and a third panel 1506. The first panel 1502 is coupled to the second panel 1504 via a first hinge 1505 shown as an embedded hinge shown in broken lines. Second panel 1504 is coupled to third panel 1506 via second hinge 1507. The first panel 1502 can include one or more electrodes, pressure sensors, other sensors, or any combination thereof, and can be at the first end 1508 of the second panel 1504 in various configurations. It includes a first sensor 1512, a second sensor 1514, and a third sensor 1516 that can be contacted. Further, the second panel 1504 can contact the first sensor 1522, the second sensor 1524, and the third sensor 1526 of the third panel 1506, or any combination thereof in various configurations. It has a second end 1510 that can be made. The first panel 1502 includes a first internal sensor 1532, the second panel 1504 includes a second internal sensor 1534, and the third panel 1506 includes a third internal sensor 1536. In one exemplary embodiment, the three-panel device 1501 is the three-panel embodiment of the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, or any of them. It can be a combination of

  In one particular embodiment, the three panel device 1501 can recognize the configuration based on activity at the sensors 1512-1516 and 1521-1526. In particular, the relative orientation of the first panel 1502 with respect to the second panel 1504 is such that the contact between the first edge 1508 and one or more of the sensors 1512-1516 at the first hinge. It can be detected through the presence or absence of. Further, the relative orientation of the second panel 1504 with respect to the third panel 1506 is detected or detected through the presence or absence of contact between the second edge 1510 and one or more of the sensors 1522-1526. Can be sensed. As shown, electronic device 1501 in configuration 1500 is in a fully folded configuration. Similarly, one or more of the sensors 1532, 1534, and 1536 may include accelerometers, inclinometer sensors that measure tilt, gyroscope sensors, and other types of sensors that measure relative movement. Sensors, or any combination thereof, can be included. By using sensors at the hinges, such as these sensors 1512-1516 and 1522-1526, and internal sensors 1532-1536, the folded configuration, relative or absolute alignment, device tilt or other physical configuration is shown in FIG. Can be detected and responded via a processor that controls the device, such as the processor 810 of the device.

  For example, sensors 1512-1516 and 1522-1526, and internal sensors 1532-1536 may be included or supplied in the folded configuration sensor 826 of FIG. The device can include a processor, such as the processor 810 of FIG. 8, that detects the device configuration from at least a set of three predetermined configurations in response to a sensor coupled to the hinge. The sensor can include at least one of a Hall sensor, an optical sensor, or an inductive sensor. One or more of the hinges are detented to allow a stable extended configuration, a folded configuration, and an intermediate configuration of the first panel relative to the second panel. And the processor may be configured to execute a software application having at least three predetermined modes of operation corresponding to at least three predetermined configurations. The processor also adjusts the operating mode of the software application based on the detected device configuration, and the first display surface, the second display surface, and the third display surface based on the detected device configuration. May be adapted to adjust the user interface displayed on the screen. For example, in a first predetermined configuration, the first display surface, the second display surface, and the third display surface may be configured to emulate a single screen in a lateral configuration, In a predetermined configuration, the first display surface may be active, the second display surface and the third display surface may be inactive, and in a third predetermined configuration, a keyboard on the third display surface Can be displayed and the first display surface and the second display surface can be configured to emulate a single screen in a vertical configuration. While sensors 1532-1536 are shown as internal sensors, in other embodiments, one or more of the sensors need not be internal; instead, the surface of each panel, or other relative to the panel Can be combined at the positions of

FIG. 16 shows the electronic device 1501 of FIG. 15 in a travel clock configuration 1600. The first panel 1502 includes sensors 1512 to 1516 and a first internal sensor 1532. The first sensor 1512 and the second sensor 1514 do not contact the first end 1508 of the second panel 1504, the third sensor 1516 contacts the first end 1508, and the first panel 1502 Indicates that the second panel 1504 is disposed at the first angle stop in a substantially 90-degree relative posture. Similarly, the second edge 1510 of the second panel 1504 is in contact with the second sensor 1524 of the third panel 1506, but the first sensor 1522 or the third sensor of the third panel 1506. 1526 is not touching. Accordingly, the processor of device 1501 determines that the second panel 1504 is relatively aligned with the third panel 1506 at the second angle stop, such as in a relative attitude of 135 degrees as shown in FIG. can do. Further, the internal sensor 1534 of the second panel 1504 can indicate that the second panel 1504 is tilted with respect to the gravitational pull, and the internal sensor 1536 of the third panel 1506 is It can be shown that the panel 1506 is in a relatively horizontal position and is stationary, so that the electronic device 1501 can recognize that the electronic device 1501 is placed in the travel clock configuration 1600.

  FIG. 17 shows the electronic device 1501 of FIG. The first panel 1502 and the second panel 1504 are such that the first end 1508 of the second panel 1504 substantially contacts the first sensor 1512 and the third sensor 1516 of the first panel 1502. However, the first sensor 1502 and the second panel 1504 are arranged so as not to contact the second sensor 1514 and are end-to-end aligned at the third angle stop, and are approximately 180 degrees relative to each other. It shows that it is substantially the same plane in the general rotation posture. Similarly, in both the second panel 1504 and the third panel 1506, the second edge 1510 contacts the first sensor 1522 and the third sensor 1526 of the third panel 1506, but the second sensor 1524. Is substantially flush with the third angle stop so that it can be detected by not touching. Further, one or more of internal sensors 1532, 1534, and 1536 may be used to indicate acceleration, tilt, one or more relative positions, or any combination thereof. By including sensors, such as electronic sensors, pressure sensors, magnetic field detectors, or any combination thereof, at one or more angle stops or rest positions of panels 1502, 1504, and 1506, electronic device 1501 is panel 1502. ˜1506 can be determined, electronic device 1501 can determine its current hardware configuration, and sensors 1512-1516 and 1522-1526 can be engaged and disengaged, respectively. Allows detection of hardware configuration changes when done.

  FIG. 18 shows an electronic device 1801 having a first panel 1802, a second panel 1804, and a third panel 1806 in a fully folded configuration 1800. The first panel 1802 is rotatably coupled to the second panel 1804 via an embedded hinge that includes a first sensor 1812. Second panel 1804 is coupled to third panel 1806 via an embedded hinge that includes second sensor 1822. Second panel 1804 also includes one or more internal sensors 1834. In one particular embodiment, the first sensor 1812 in the embedded hinge allows the relative placement of the first panel 1802 relative to the second panel 1804 to be detected at the first sensor 1812. Rotational alignment of the first panel 1802 to the second panel 1804, or the degree of rotation between one or more of the panels 1802 and 1804 relative to the coupling member, rotation relative to one or more of the hinge pins. Degrees, degrees of rotation relative to the direction of gravity, degrees of rotation via other mechanisms, or any combination thereof can be detected. The second sensor 1822 may be configured to perform substantially the same as the first sensor 1812 to detect the relative attitude between the second panel 1804 and the third panel 1806. In contrast to the electronic device 1501 of the embodiment shown in FIGS. 15-17, the electronic device 1801 of FIG. 18 in the fully folded configuration 1800 includes a single internal sensor 1834 and two hinge sensors 1812 and 1822; The electronic device 1801 uses the internal sensor 1834 to detect the first parameter, such as posture, position, momentum, or acceleration, and the folding of the panels 1802, 1804, 1806 via the hinge sensors 1812 and 1822. Allows further detection of morphology, deployed configuration, or partially folded configuration. In one particular embodiment, electronic device 1801 is a three-panel embodiment of electronic device 101 of FIGS. 1-7, electronic device 800 of FIG. 8, electronic device 900 of FIGS. 9-14, of FIGS. It can be an electronic device 1501, or any combination thereof.

FIG. 19 shows the electronic device 1801 of FIG. 18 in a travel clock configuration 1900. The first panel 1802 is coupled to the second panel 1804 at an angle of about 90 degrees via a hinge that includes a first sensor 1812. Second panel 1804 is coupled to third panel 1806 at an angle of about 135 degrees via a hinge that includes second sensor 1822. The internal sensor 1834 can be combined with sensor readings at the first sensor 1812 and the second sensor 1822 to indicate to the processor that controls the electronic device 1801 that the electronic device 1801 is in the travel clock configuration 1900. The inclination of the second panel can be detected. The electronic device 1801 is also configured to communicate electronic data and control signals between the first panel 1802 and the second panel 1804 and between the second panel 1804 and the third panel 1806, respectively. One or more signal paths 1940 and 1942 are also included. In one particular embodiment, signal paths 1940 and 1942 may be a flex cable, one or more wires, other signal bearing media such as fiber optic cables, other conductive materials that transmit signals, or any of them. Combinations can be included. Signals transmitted over signal paths 1940 and 1942 may be transmitted in series, parallel, or a combination of series and parallel, and may be transmitted according to one or more protocols. In one particular embodiment, one or more of signaling paths 1940 and 1942 can include a mobile display digital interface (MDDI) .

  FIG. 20 shows the electronic device 1801 of FIG. The first panel 1802 is substantially flush with the second panel 1804. The second panel 1804 is also substantially flush with the third panel 1806. As shown, the first sensor 1812 can detect that the first hinge is in a fully deployed position, and the second sensor 1822 can be that the second hinge is in a fully deployed position. Can be detected. Further, the internal sensor 1834 can detect that the second panel 1804 is in a substantially flat or horizontal position or aligned. Based on the sensors 1812, 1822, and 1834, the electronic device 1801 can recognize that it is in the fully deployed position, and software or a graphical user interface can be used for one or more of the adjacent panels 1802-1806. It can be configured to display in a horizontal configuration on the display surface.

  With reference to FIG. 21, a particular embodiment of an electronic device is shown and generally designated 2100. In one particular embodiment, the electronic device 2100 includes the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device 1501 of FIGS. It can be the electronic device 1801 of FIGS. 18-20, or any combination thereof.

  Device 2100 includes a first display surface 2120 on first panel 2122 and a second display surface 2130 on second panel 2132 separated by embedded hinges. Each display surface 2120 and 2130 has a vertical height 2106, a vertical width 2108, and a diagonal dimension 2110. Display surfaces 2120 and 2130 extend approximately to the edges of each of panels 2122 and 2132. The gap 2102 indicates the distance between the edge of the first display surface 2120 and the edge of the second display surface 2130. Panels 2122 and 2132 have a height dimension 2104. The electronic device 2100 includes an embedded hinge with a slot that allows a range of linear movement of the pin, shown as the hinge travel distance 2112. In one particular embodiment, the gap 2102 is designed to be small relative to the dimensions of the display surfaces 2120 and 2130. Further, the height dimension 2104 is designed to be small with respect to the display surface to be a convenient size in the fully folded configuration. In addition, the hinge travel distance 2112 is adjusted to allow the panels 2120 and 2130 to rotate from the fully deployed position to the fully folded position and deployed to be embedded in a substantially locked position after reconfiguration. obtain. In one exemplary embodiment, the hinge travel distance 2112 can be between 2 millimeters (mm) and 10 mm. For example, the hinge travel distance 2112 can be about 5 mm.

  In one particular embodiment, the longitudinal height 2106 can be between 5-10 centimeters (cm), the longitudinal width 2108 can be between 4-8 cm, and the diagonal dimension 2110 can be between 6-13 cm. Of a size and spacing sufficient to be individually selected by the user's finger via a touch screen interface, while allowing a convenient size to fit into a trouser or jacket pocket when fully folded Give the display area large enough to give multiple icons or controls. In one exemplary embodiment, the longitudinal height 2106 can be about 8 cm, the longitudinal width 2108 can be about 6 cm, and the diagonal dimension 2110 can be about 10.2 cm (ie, about 4 inches). .

  In one particular embodiment, the gap 2102 is between about 0-2.4 mm. In an exemplary embodiment, the gap 2102 is less than 2 mm, the portion of the first panel 2122 that extends beyond the edge of the first display surface 2120 toward the second panel 2132, and the second display The portion of the second panel 2132 that extends toward the first panel 2122 beyond the edge of the surface 2130 may be formed substantially uniformly. In one particular embodiment, the gap 2102 is such that when an image or video is displayed on the display surfaces 2120 and 2130, the human visual system immediately or ultimately ignores the missing portion corresponding to the gap 2102. Is dimensioned so that it can be or cannot be substantially distracted by that part.

  In one particular embodiment, the height dimension 2104 is large enough to include the thickness of the display panels 2120 and 2130, internal electronics, one or more batteries, sensors, or any combination thereof, When 2100 is in the fully folded configuration, it is small enough to conveniently fit in the pants pocket. For example, in one embodiment having three panels, the height dimension 2104 may be less than 5.5 mm, such that the height of the device in a three-panel fully folded configuration is 16.5 mm or less. In one exemplary embodiment, the height dimension 2104 is about 5 mm.

  FIG. 22 illustrates a particular exemplary embodiment of an electronic device 2201 having five configurable panels. The electronic device 2201 includes a first panel 2202, a second panel 2204, a third panel 2206, a fourth panel 2208, and a fifth panel 2210 in the fully expanded configuration 2200. In one particular embodiment, each of the panels 2202-2210 has a respective display surface 2222, 2224, 2226 such that, in the fully deployed configuration 2200, an effective screen area can be formed by all display surfaces of the panels 2202-2210. , 2228, and 2230. In one particular embodiment, the electronic device 2201 is the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device 1501 of FIGS. It may be a five-panel embodiment of the electronic device 1801 of FIGS. 18-20, the electronic device 2100 of FIG. 21, or any combination thereof.

  FIG. 23 illustrates a specific embodiment of electronic device 2201 of FIG. 22 in transition configuration 2300. The first panel 2202 is rotated by the first panel 2202 and the second panel 2204 from the fully expanded position shown in FIG. 22 to the position where the back surface of each panel 2202 and 2204 is close to the back surface of the other panel. It is coupled to the second panel 2204 so as to be able to do so. Similarly, the second panel 3204 and the third panel 2206 can be positioned at least from a fully deployed position to a fully folded position where the display surface 2224 of the panel 2204 is proximate to the display surface 2226 of the panel 2206. Combined for rotation. Panel 2206 and panel 2208 are rotatably coupled such that they are positioned at least from a fully deployed position to a fully folded position where the back surface of panel 2206 is proximate to the back surface of panel 2208. Panel 2208 and panel 2210 are rotatably coupled such that the display surface 2228 of panel 2208 can be positioned from at least a fully deployed position to a fully folded position proximate display surface 2230 of panel 2210. In one particular embodiment, the electronic device 2201 shown in FIGS. 22 and 23 may be generally similar to the electronic device 101, 800, 900, 1501, 1801, or 2100 shown in FIGS. Can include one or more of the configurations, operations, sensors, hinges, or other functions of the disclosed embodiments. It should be understood that any number of panels may be included in a portable electronic device that automatically adjusts the graphical display based on changes in the folded configuration and is within the scope of the present disclosure.

  FIG. 24 illustrates a particular exemplary embodiment of an electronic device 2401 having three removable panels in a separate configuration 2400. The first panel 2402 includes a coupling mechanism 2410 that allows the first panel 2402 to couple to the second panel 2404 via the second coupling mechanism 2412 of the second panel 2404. Coupling mechanisms 2410 and 2412 may be configured to provide mechanical and electronic coupling between first panel 2402 and second panel 2404. Similarly, the second panel 2404 includes a third coupling mechanism 2414 configured to provide mechanical and electronic coupling to the fourth coupling mechanism 2416 of the third panel 2406. In one particular embodiment, the electronic device 2401 is the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device 1501 of FIGS. It may be a removable panel embodiment of the electronic device 1801 of FIGS. 18-20, the electronic device 2100 of FIG. 21, the electronic device 2201 of FIGS. 22-23, or any combination thereof.

  FIG. 25 shows the electronic device 2401 of FIG. 24 in a fully coupled configuration 2500. The first panel 2402 is fixedly coupled to the second panel 2404 and the second panel 2404 is fixedly coupled to the third panel 2406. Panels 2402-2406 are in a fully deployed configuration. In one particular embodiment, the coupling mechanisms 2410-2416 shown in FIG. 24 can securely couple the panels 2402, 2404, 2406 such that little rotational movement is allowed between the panels 2402-2406. However, in other embodiments, the coupling mechanisms 2410-2416 provide rotational movement of one or more of the panels 2402-2406 relative to each other to allow the functions described with respect to FIGS. Can be given or enabled.

  FIG. 26 is a flowchart of an exemplary embodiment of a method for changing software state in a multi-panel electronic device, generally designated 2600. In one particular embodiment, method 2600 includes electronic device 101 of FIGS. 1-7, electronic device 800 of FIG. 8, electronic device 900 of FIGS. 9-14, electronic device 1501, FIGS. The electronic device 1801 in FIG. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22-23, the electronic device 2401 in FIGS. 24 and 25, or any combination thereof may be implemented.

  In one particular embodiment, the electronic device can include well-defined hardware configurations including a folding mode, a fully expanded mode, a summing mode, a video conferencing mode, and a travel clock mode. Sensors during folding between each panel or panels can detect and report changes in panel or hinge positions. The panel or hinge position may be reported with a degree of folding, such as within a range between about -180 degrees to about 180 degrees. One or more sensors in the intermediate panel, such as the internal sensor 1834 shown in FIGS. 18-20, can detect and report posture changes. The software controller can collect and analyze sensor inputs and can determine to take one or more actions in response to the sensor inputs. For example, a software controller initiates a change in the size of an application, such as an application window or user interface element, initiates a change in the attitude of the application, initiates an automatic launch of the application, initiates an automatic termination of the application, A state change can be initiated or a combination of actions can be performed.

  As shown in FIG. 26, the electronic device has a software state defined at 2602. For example, the defined software state may include one or more application window sizes, position, orientation, and whether the application is running or waiting, whether the application receives user input such as keyboard input, and so on. One or more parameters can be indicated, such as the type of user interface provided to the application. The defined software state 2602 can indicate the number of panels available for the application and the display mode. For example, the device may be in a folded configuration and the software controller may be launching an application in a one panel portrait mode. The application may define or include one or more predetermined states to improve the user experience in response to the number of available panels and the display mode.

  A sensor input 2604 is received and at 2606 the panel position is analyzed. In one particular embodiment, sensor input 2604 can indicate one or more changes in hinge position, posture, or movement. For example, changes in the hinge position can be detected by hinge sensors such as sensors 1512-1516 in FIGS. 15-17 or sensors 1812 and 1822 in FIGS. 18-20, and changes in posture or movement are shown in FIGS. May be detected by one or more internal sensors, such as internal sensors 1532-1536 or internal sensors 1834 of FIGS. Further, the change in the hinge position can be detected indirectly by a sensor other than the hinge sensor, such as through a change in the relative posture of the adjacent panel detected by an inclinometer coupled to the adjacent panel.

  Moving to decision 2608, a determination is made whether the electronic device is in a defined hardware state. If the electronic device is not in the defined hardware state, processing returns to 2602. For example, if the determined hardware configuration is not one of the predefined hardware configurations, the software controller may assume that the device is in transition to a known state and wait for additional sensor inputs .

  If it is determined at 2608 that the electronic device is in a defined hardware state, at 2610 the electronic device enters a new software state. For example, if it is determined that the electronic device is in a fully deployed hardware configuration, the software controller can reconfigure the application with new layout requirements such as a three panel horizontal mode or a three panel vertical mode. .

  In one particular embodiment, the software controller is a circuit or other hardware, firmware, one or more processors that execute program instructions, such as processor 810 of FIG. 8, general purpose processor or dedicated processor, or any of them. It can be implemented by a combination. In one particular embodiment, an application such as software 834 of FIG. 8 may be written to support multiple predefined operating states, such as an interrupt or semaphore indicating a particular hardware state or state change. Responsive to the control signal. In one particular embodiment, the software is responsible for querying the hardware configuration and self-adjusting the software state. In another embodiment, the software is responsible for supporting an interface that receives hardware state change messages from the software controller.

  FIGS. 27-31 illustrate a specific embodiment of automatically configuring the keyboard in response to the detected hardware configuration of the electronic device 2701. In one particular embodiment, the electronic device 2701 is the three-panel version of the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device of FIGS. It may be device 1501, electronic device 1801 of FIGS. 18-20, electronic device 2100 of FIG. 21, electronic device 2201 of FIGS. 22-23, electronic device 2401 of FIGS. 24 and 25, or any combination thereof. In one particular embodiment, electronic device 2701 is configured to operate according to method 2600 of FIG.

  FIG. 27 shows an electronic device 2701 in a fully folded configuration 2700. The electronic device 2701 in the fully folded configuration 2700 has a single panel display surface exposed and shows a display window 2704 and a keyboard area 2702. In one particular embodiment, the keyboard area 2702 is an image that is also displayed as part of the display surface, including the display window, and can be activated by key presses detected on the touch screen surface. As shown, an image including a display window 2704 and a keyboard area 2702 is displayed in a vertical orientation on a single exposed display surface. In another embodiment, the electronic device 2701 may be configured to display an image including a display window and a keyboard area in a horizontal orientation. In response to the one or more sensors, the electronic device 2701 can selectively display the keyboard area in the vertical orientation or the horizontal orientation based on the detected orientation of the electronic device 2701.

  FIG. 28 shows the electronic device 2701 of FIG. 27 in a summing configuration 2800. In the summing configuration 2800, the lower panel has a display surface that displays a keyboard area 2802 that is larger than the smaller keyboard area 2702 shown in FIG. The first display surface 2804 of the middle panel and the second display surface 2806 of the upper panel can form two separate display windows or can be combined to form a two-panel active screen. A keyboard area 2802 that is larger than the keyboard area 2702 in FIG.

  FIG. 29 shows the electronic device 2701 of FIG. In the fully expanded configuration 2900, the keyboard is shown expanded across all three panels to form an effective display screen that is three panels wide and one panel high. Each panel with an effective screen displays a respective portion of the displayed horizontal image in a vertical configuration, but the effective display screen in the horizontal mode is wider than the height. The right end portion 2902 of the keyboard is displayed below the right end portion 2908 of the display area of the right end panel. The center panel displays a central portion 2904 of the keyboard below the central portion 2910 of the display area. The left end panel displays a left end portion 2906 of the keyboard below the left end portion 2912 of the display area.

  FIG. 30 shows the electronic device 2701 of FIG. 27 in the travel clock configuration 3000. The first horizontal panel displays a keyboard area 3002 that can be activated via a touch recognized by the touch screen surface. The second display surface 3004 of the center panel can be used for visual display of application windows, icons, other controls, and clock displays. The third display surface 3006 provides a display area that is turned off, or other functions such as a night light, displaying one or more decorative designs, a user specified display, or any combination thereof. It can have a display area to execute.

  FIG. 31 shows the device 2701 of FIG. Camera 3104 is shown on the back side of the leftmost panel shown in the folded configuration. The back side of the leftmost panel can include additional user interface features such as an additional display 3102. Further, the rightmost panel may be divided to provide a keyboard area 3106 at the bottom of the display surface and a display area 3108 that is located above the keyboard area 3106 and that can show the participant's image in a video conference call. In general, as shown in FIGS. 27-31, the electronic device 2701 recognizes the form of the device 2701 via the inside of the panel, one or more sensors inside the hinge, or other sensors. The keyboard display can be automatically reconfigured at appropriate portions of one or more suitable display surfaces. Display panel, and in particular keyboard reconfiguration, re-display, and re-orientation settings, allow further user input in response to user configuration, folding, hardware adjustment, tilt, attitude, acceleration, or any combination thereof. It can be performed automatically without needing or being detected.

  FIGS. 32-37 illustrate an electronic device 3201 having an icon control panel that responds to user input to open and close an application in response to the configuration of the electronic device 3201. In one particular embodiment, the electronic device 3201 is the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the three-panel version of the electronic device 900 of FIGS. 9-14, the electronic device of FIGS. Device 1501, electronic device 1801 of FIGS. 18 to 20, electronic device 2100 of FIG. 21, electronic device 2201 of FIGS. 22 to 23, electronic device 2401 of FIGS. 24 and 25, electronic device 2701 of FIGS. Or any combination thereof. In one particular embodiment, electronic device 3201 is configured to operate according to method 2600 of FIG.

  FIG. 32 shows the electronic device 3201 in the fully folded configuration 3200. The display surface of the leftmost panel can be one or more controls, or other, such as a wireless telephone display including, for example, a power indicator, signal strength indicator, alarm signal, digital network bandwidth indication, display, or any combination thereof Is displayed 3204. The upper display surface further includes a plurality of application icons, such as a representative application icon 3206. The application icon can respond to user input via a touch-sensitive surface on the display surface. The electronic device 3201 may be usable for telephone communications and includes a microphone 3240, a speaker 3242, other hardware elements that enable one or more functions of the electronic device 3201, or any combination thereof. be able to.

  FIG. 33 shows the electronic device 3201 of FIG. 32 in a fully deployed configuration 3300. When the device 3201 is deployed from the fully collapsed configuration 3200 of FIG. 32 to the fully expanded configuration 3300 of FIG. Display screens 3308 and 3310 can show a desktop area, and the leftmost panel can continue to show an icon panel that includes a representative application icon 3206.

  FIG. 34 illustrates the movement of the exemplary application icon 3206 towards the gap 3414 between the leftmost display surface and the central display surface 3308 in response to user input. For example, the user input can be a drag action that indicates the movement of the representative application icon 3206 toward the gap 3414, depending on the speed and direction of movement of the application icon 3206. Can indicate that it should be moved. The movement of the exemplary application icon 3206 is shown as arrow 3412, the speed of movement is shown as the length of arrow 3412, and the direction of movement is shown as the direction of arrow 3412. The speed and direction of movement of the application icon 3206 can be used to make a prediction of the user's intent associated with the user input so that the user input is received as a drag action on the touch screen. For example, even if the user input ends before reaching the gap 3206, the speed and direction of movement of the application icon 3206 predicts that the user input is intended to move the application icon 3206 across the gap 3414. Can be used for. In one particular embodiment, such as momentum and friction, so that the user can initiate movement of the user interface element and the user interface element can continue its movement according to the simulated physical properties of the interface. One or more physical laws may be simulated for the user interface element. For example, an interface element moved and released by a drag action can be decelerated and stopped in a manner that is predictable to the user and can be perceived as natural or intuitive by the user.

  As shown in FIG. 34, the speed and direction of movement provided by the user input indicates a command for the icon 3206 to cross the gap 3414 so that at least a portion of the icon 3206 can be displayed on the central display panel 3308; The remaining portion of icon 3206 may be displayed on the leftmost display panel. In this way, the user can maintain a visual reference of the representative application icon 3206 that has continuous movement across the gap 3414. In one particular embodiment, as shown, when the icon 3206 is moved relatively slowly, the representative application icon 3206 can be moved across the gap 3414 and placed in the central display area 3308. obtain. However, if the application icon 3206 is moved across the gap 3414 at a sufficient speed, the electronic device 3201 may receive user input indicating movement of the representative application icon 3206 across the gap 3414 to the representative application icon 3206. It can be interpreted as a startup command for the associated application.

  As shown in FIG. 35, in one particular embodiment, when application icon 3206 of FIGS. 32-34 is pulled across gap 3414 at a sufficient rate, application window 3516 is opened in central display area 3308, etc. As a result, the application associated with the application icon 3206 is activated. In another embodiment, the application window 3516 can extend across the central display surface 3308 and the rightmost display surface 3310 and can be configured to operate as a two-panel enabled display screen.

  As shown in FIG. 36, in one particular embodiment, the user provides user input to direct application window 3516 to have movement toward gap 3414, as indicated by arrow 3618. The electronic device can be instructed to close the application window 3516. The application window 3516 may be displayed as it progresses toward the gap 3414 and provides visual continuity to the user of the electronic device 3201 that makes the application window 3516 appear at least partially beyond the gap 3414. To provide, at least a portion can be displayed to be displayed on the first display surface of the leftmost panel. In one particular embodiment, the application window 3516 is moved a sufficient distance toward the gap 3414 by user input, such as when a specific movement of the application window 3516 occurs or will occur beyond the gap 3414. When instructed, the electronic device 3201 interprets user input as a command to close the application displayed in the application window 3516, closes the application and the application window 3516, and its original in the leftmost surface panel as shown in FIG. A representative application icon 3206 can be returned to the position of.

  FIGS. 32-37 illustrate a method of interaction using a gap between touch screens on a multi-screen electronic device to trigger an event or interaction with a user interface. Knowing the placement and size of the gap allows the application or software to use the gap as another way of interaction. As an example, a browser can be launched from one screen to display on the remaining screens. The first screen may include application icons including browser icons, such as application icon 3206 of FIG. The user can place his finger on the browser icon and then drag the icon in the direction of the screen gap, such as gap 3414 in FIG. When the user reaches the gap, an interaction can be initiated and visualized to show the open browser in the remaining screens. The reverse use of this trigger is to drag a part of an open application across a given gap, such as the application window 3516 of FIG. 35, which initiates a close or hide function and returns to the start screen. Can include.

  As shown in FIGS. 34 and 36, visual cues are used on the forward side of the user interface element to indicate both the direction and placement across the gap while the user is dragging on multiple screens. Can be done. When dragged, user interface elements such as icons or application windows can be shifted forward by a few pixels so that the user interface elements are still visible to the user and cue the direction. When dragging across the gap between multiple screens, such as for automatically launching an application or moving a user interface element to another screen, the user interface element has the direction and ability to move across the screen. To show both, it can be shifted forward by the same distance as the measured gap. By indicating the direction, placement, and ability to cross the gap, the electronic device 3201 can provide the user with a continuous cue while dragging the user interface element. As a result, user errors can be reduced and usability of the electronic device 3201 can be improved.

  Referring to FIG. 38, a particular exemplary embodiment of an electronic device 3801 having an accelerometer and an inclinometer is shown and generally designated 3800. In one particular embodiment, the electronic device 3801 is a three panel version of the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, and the electronic device of FIGS. Device 1501, electronic device 1801 of FIGS. 18 to 20, electronic device 2100 of FIG. 21, electronic device 2201 of FIGS. 22 to 23, electronic device 2401 of FIGS. 24 and 25, electronic device 2701 of FIGS. It can be the electronic device 3201 of FIGS. 32-37, or any combination thereof. In one particular embodiment, electronic device 3801 is configured to operate according to method 2600 of FIG.

  The electronic device 3801 includes a first panel 3802 having a first display surface 3832, a second panel 3804 having a second display surface 3834, and a third panel 3806 having a third display surface 3836. Including. The three display surfaces 3832-3836 are controlled to emulate a single display screen that extends across all three display surfaces 3832-3836. The first panel 3802 is rotatably coupled to the first edge of the second panel 3804 and the third panel 3806 is rotatably coupled to the second edge of the second panel 3804. The inclinometer 3810 is positioned on the second panel 3810 and the accelerometer 3820 is offset from the longitudinal axis 3814 of the second panel. A controller, such as processor 3830, is coupled to inclinometer 3810 and accelerometer 3820.

  The inclinometer 3810 is configured to detect a change in tilt of the second panel 3804. For example, the inclinometer 3810 can be configured to detect a change in posture caused by the longitudinal rotation direction 3812 relative to the longitudinal axis 3814. The accelerometer 3820 can be configured to detect an in-plane rotation direction 3822 from the lateral orientation of the second panel 3804 to the longitudinal orientation.

  In one particular embodiment, the processor 3830 is configured to execute at least one software application having a graphical user interface. The processor 3830 is responsive to the inclinometer 3810 and the accelerometer 3820 to have the first panel 3832, the second panel 3834, and the third panel 3836 in at least one predetermined folded configuration, The first display surface 3832, the second display surface 3834, the third display surface 3836, or any of them when the change in tilt of the second panel 3834 does not exceed the threshold during rotation of the first panel 3834 The image displayed in the combination is redrawn from the horizontal type display of the image to the vertical type display of the image. For example, the threshold may be an angle within a range between 5 degrees and 30 degrees (or -5 degrees to -30 degrees), and may be about 15 degrees (or -15 degrees).

  For example, the controller may indicate that the detected acceleration is faster than the expected acceleration that would be expected for a person walking with the device 3801 and the inclinometer 3810 is tilted. It may be configured to calculate that it has detected no change (or a change below a threshold). As device 3801 rotates around the content, the controller can hold the content in place. The display can change position relative to the original position of the display, so the controller can intermittently redraw the content until acceleration stops. For example, this may be because the user of device 3801 places device 3801 on the desk and rotates device 3801 clockwise or counterclockwise to switch the display from portrait to landscape or any intermediate position. Enable.

  39 to 41 show the operation of the device 3801 when the electronic device 3801 of FIG. 38 is rotated from the horizontal posture to the vertical posture.

  In FIG. 39, the electronic device 3801 is shown in a landscape mode 3900, where a web browser application image is displayed as a landscape type display across all three display surfaces. The device 3801 can be rotated counterclockwise through the transition position 4000 shown in FIG. 40 to the profile mode position 4100 shown in FIG. 41 without substantially changing the tilt of the intermediate panel. For example, the device 3801 can be placed flat on a surface such as a table or desk and rotated. As another example, when the device 3801 is rotated, the device 3801 can be held at a substantially constant tilt, such as a vertical tilt.

  As shown in FIG. 40, processor 3830 receives input from accelerometer 3820 and inclinometer 3810 indicating that device 3801 rotates in in-plane rotation direction 3822 but does not rotate significantly in longitudinal rotation direction 3812. When received, the image displayed on the display panel may be intermittently redrawn to maintain the image's orientation with respect to the viewer. Such redrawing can give the user the appearance that the display surface acts like a window with respect to the underlying image, the window rotates and the image remains fixed. FIG. 41 shows the electronic device 3801 in a longitudinal type orientation achieved by rotating the device by a quarter turn counterclockwise from the lateral type configuration of FIG. Therefore, the user can rotate the device 3801 intermittently until the user is satisfied with the posture for browsing the content.

  In one particular embodiment, the gaming application may be executed by device 3801 so that the user provides control input by rotating device 3801. For example, the driving application can display the racetrack as viewed by the driver across the unfolded display panel, and the user can rotate the device 3801 as a handle that controls the steering of the vehicle on the racetrack, The view does not rotate with the device, but instead remains in a substantially fixed posture from the user's viewpoint. Further, in some situations, the detected rotation of device 3801 can be used to initiate a particular process in addition to continuous redrawing of the display. For example, when the device 3801 is executing a game application, the detected rotation can trigger one or more vibration actuators (not shown) or other hardware elements of the device 3801.

  FIG. 42 is a flowchart of a second exemplary embodiment of a method 4200 for changing software state in a multi-panel electronic device. In one particular embodiment, the method 4200 includes the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device 1501, FIGS. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, and the FIGS. Of the electronic device 3201, the electronic device 3801 of FIGS. 38-41, or any combination thereof.

  Method 4200 shows the default state of the electronic device when the user interface for executing the application is not displayed, such as after the device is powered on and before the user launches the application. A sensor input 4202 is received and used at 4204 to detect a new hardware configuration. For example, sensor input 4202 may be one or more of a multi-panel device, such as via one or more hinge sensors, inclinometers, accelerometers, one or more other sensors, or any combination thereof. May indicate a relative orientation of the panel or a change in orientation.

  Moving to decision 4206, a determination is made at 4206 whether the device is in a fully folded configuration. If it is determined that the device is in a fully folded configuration, at 4208, an icon panel may be displayed on the active screen and the other screens may be powered off.

  If it is determined that the device is not in the fully folded configuration, a determination is made at decision 4210 as to whether the device is in a summing configuration. If it is determined that the device is in a summing configuration, at 4212 a desktop icon may be displayed on the top two viewing screens and a keyboard may be displayed on the lower screen.

  If it is determined that the device is not in the summing configuration, a determination 4214 is made as to whether the device is in the travel clock configuration. If it is determined that the device is in the travel clock configuration, at 4216, the clock can be displayed on the intermediate screen, the clock mode control can be displayed on the horizontal screen, and the back screen can be powered off.

  If it is determined that the device is not in the travel clock configuration, at decision 4218, a determination is made whether the device is in a fully deployed configuration. If it is determined that the device is in a fully deployed configuration, at 4220, an icon panel may be displayed on the leftmost screen and the other two screens may be left clear for the application.

  If it is determined that the device is not in the fully deployed configuration, at decision 4222, a determination is made whether the device is in a video conference configuration. If it is determined that the device is in a video conferencing configuration, at 4224, video conferencing video may be displayed at the top of the active screen, video conferencing mode controls may be displayed at the bottom of the active screen, and other screens may be powered off. obtain.

  If it is determined that the device is not in the video conferencing configuration, a determination can be made at 4226 that the device is in the transition configuration, no changes can be performed on the display panel, and the process can return to 4204.

  Although method 4200 illustrates five hardware configurations, in other embodiments, more than six configurations or fewer than five configurations may be used. For example, an upright configuration similar to a folding screen automatically displays streaming real-time news, stock quotes, and blog feeds received over a wireless data network for use as a secondary desktop device on an electronic device. Start an audio or video file player that starts or starts playing a playlist stored on the device or received via a data network, or automatically starts other applications according to user configuration Or any combination thereof. Further, custom configurations can be programmed into the electronic device and tested in preparation for when sensor input 4202 is received.

  FIG. 43 is a flowchart of a third exemplary embodiment of a method 4300 for changing software state in a multi-panel electronic device. In one particular embodiment, the method 4300 includes the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device 1501, FIGS. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, and the FIGS. Of the electronic device 3201, the electronic device 3801 of FIGS. 38-41, or any combination thereof.

  The method 4300 shows a default state of the electronic device when an application that supports multiple software states and is responsive to a change in configuration of the electronic device is running. While executing an active application, sensor input 4302 is received and used at 4304 to detect a new hardware configuration. For example, the sensor input 4302 may include one or more of the multi-panel device, such as via one or more hinge sensors, inclinometers, accelerometers, one or more other sensors, or any combination thereof. May indicate a relative orientation of the panel or a change in orientation.

  Moving to decision 4306, a determination is made at 4306 whether the device is in a fully folded configuration. If it is determined that the device is in a fully folded configuration and the application supports a single screen configuration, then in 4308, the application's application window in single screen mode is displayed on the active screen and the other screens are powered off. . If the application does not support single screen mode, the application is interrupted and cannot be displayed on the active screen.

  If it is determined that the device is not in the fully folded configuration, a determination is made at decision 4310 as to whether the device is in a summing configuration. If it is determined that the device is in the summing configuration, at 4312 an application window may be displayed on the two-panel active screen and a keyboard is displayed on the lower screen.

  If it is determined that the device is not in the summing configuration, at decision 4314, a determination is made whether the device is in the travel clock configuration. If it is determined that the device is in travel clock configuration, if the application supports travel clock configuration, an application interface with a clock on the intermediate screen and / or a clock mode control on the horizontal screen is displayed at 4316, and The rear screen is turned off. If the application does not support travel clock configuration, the application can be interrupted and cannot be displayed.

  If it is determined that the device is not in the travel clock configuration, at decision 4318, a determination is made whether the device is in a fully deployed configuration. If it is determined that the device is in the fully expanded configuration, at 4320, an application window may be displayed across all three screens if the application supports the fully expanded configuration. If the application does not support a fully expanded configuration, an application window can be displayed on one or more screens.

  If it is determined that the device is not in the fully deployed configuration, a determination is made at decision 4322 as to whether the device is in a video conference configuration. If the device is determined to be in video conferencing configuration, an application interface with video at the top of the active screen and / or video conferencing mode control at the bottom of the active screen is displayed at 4324 if the application supports video conferencing configuration. Other screens can be turned off. If the application does not support video conferencing configuration, the application can be interrupted.

  If it is determined that the device is not in the video conferencing configuration, a determination may be made at 4326 that the device is in the transition configuration, no changes may be performed on the display panel, and the process may return to 4304.

  In one particular embodiment, in one or more configurations that are not supported by the application, if the application is suspended, one or more icons or other indicators may be displayed to indicate that the application has been suspended. . In another embodiment, rather than interrupting the application, the application may continue to run, but the graphical user interface may not be displayed. For example, if the device is changed to a configuration that is not supported by the audio file player, the interface for the audio file player cannot be displayed, but the audio file player can continue to play the playlist. In another embodiment, the application may be auto-terminated rather than interrupted in response to a transition to a configuration not supported by the application. In another embodiment, the application can include configuration data that controls whether the application should be interrupted or automatically terminated.

  In one particular embodiment, the device may perform other operations based on detecting configuration changes. For example, as discussed with respect to FIG. 48, when a browser window opens and displays content from a particular website, the device replays the content based on available screen sizes or resolutions that increase or decrease due to configuration changes. The website can be automatically requested to send. As another example, a video player may change from a wide screen display mode to a low resolution narrow display when the available screen size is reduced, such as by changing the configuration from a fully expanded configuration to a fully folded, travel clock, or summing configuration. Can change to mode automatically.

  Although the method 4300 shows five hardware configurations, in other embodiments, more than six configurations or less than five configurations may be used. For example, an upright configuration, similar to a folding screen, displays an application interface for an application on the left-hand panel for use as a secondary desktop device on an electronic device, and a wireless data network on the center and right-hand panels. Streaming real-time news, stock quotes, and blog feeds received via can be started to automatically display. Further, custom configurations can be programmed into the electronic device and tested in preparation for when sensor input 4302 is received.

  Furthermore, one or both of the embodiments shown in FIGS. 42 and 43 can include additional configuration decisions. For example, method 4200, 4300, or both are ones where the device is in a vertical, horizontal, or rotational position (eg, as described with respect to FIGS. 38-41). One or more decisions can be included. Based on the determination, the device can make additional software configurations and user interface changes. For illustration, sensor input 4202 or 4302 indicates that the device is in a fully deployed configuration, and when the active application is a video player, the video is in a lateral orientation (eg, the device is in a vertical orientation Can be displayed across all three screens, but the device is in a vertical orientation (eg, the device is If it is detected that the device is held so that the vertical direction is longer, it can only be displayed on the top two screens. In one particular embodiment, the video may be stretched across the available display area, while in another embodiment, the video aspect ratio may be preserved during display.

  FIG. 44 is a flowchart of a fourth exemplary embodiment of a method 4400 for changing software state in a multi-panel electronic device. In one particular embodiment, method 4400 includes electronic device 101 of FIGS. 1-7, electronic device 800 of FIG. 8, electronic device 900 of FIGS. 9-14, electronic device 1501, FIGS. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, and the FIGS. Of the electronic device 3201, the electronic device 3801 of FIGS. 38-41, or any combination thereof.

  At 4402, a hardware configuration change from the first configuration to the second configuration is detected at the electronic device. The electronic device includes at least a first panel having a first display surface and a second panel having a second display surface. The hardware configuration change includes a change in the relative posture of the first display panel with respect to the second display panel. Proceeding to 4404, the graphical user interface displayed on the first display surface and the second display surface is automatically modified based at least in part on the second configuration.

  In one particular embodiment, the first panel is rotatably coupled to the second panel along the first hinged edge of the second panel, and the third panel is the second panel's second A second panel is rotatably coupled to the second panel along two hinged edges, the third panel having a third display surface.

  In one particular embodiment, the first panel has a first back surface opposite the first display surface and the second panel has a second back surface opposite the second display surface. The third panel has a third back surface opposite the third display surface. The second configuration can include a folded configuration having a first back surface proximate to the second back surface and a second display surface proximate to the third display surface. The graphical user interface may be automatically modified to display on the first display surface and not on the second display surface or the third display surface. For example, the second configuration may be the fully folded configuration 200 of FIG.

In another embodiment, the second configuration has a fully deployed configuration having a first panel that is substantially flush with the second panel and a second panel that is substantially flush with the third panel. Including. The first display surface, the second display surface, and the third display surface are substantially continuous display surfaces that extend across the first panel, the second panel, and the third panel. Can be formed. The graphical user interface can be automatically modified to extend the graphical elements displayed across a substantially continuous display surface. For example, the second configuration may be the fully deployed configuration 500 or 600 of FIG. 5 or FIG. 6, respectively.

  In another embodiment, the second form includes a first panel that is substantially flush with the second panel to form a substantially continuous two-panel display surface. The second form may also include a third panel arranged such that the angle formed by the second display surface and the third display surface is greater than 90 degrees and less than 180 degrees. . The angle is about 135 degrees. The graphical user interface may be automatically modified to display a keyboard on a third display surface and other interface elements on a substantially continuous two-panel display surface. For example, the second configuration may be the summing configuration 300 of FIG.

  In another embodiment, the second form includes a first panel and a second panel arranged such that a first angle formed by the first display surface and the second display surface is about 270 degrees. The second angle formed by the second display surface and the third display surface is about 135 degrees. The graphical user interface can be automatically modified to display the clock on the second display panel. For example, the second form may be travel clock configuration 400 of FIG.

  In another embodiment, the second form is a video conferencing configuration, wherein the first panel and the second panel are substantially coplanar, and the third panel has a second display surface on the third display. A camera that is folded onto the second panel so as to be close to the surface and stored within the back surface of the third panel has a field of view that captures an image of the user of the device. The graphical user interface may be automatically modified to display a video image on the first display surface and not on the second or third display surface. For example, the second form may be the video conference configuration 700 of FIG.

  FIG. 45 is a flowchart of a fifth exemplary embodiment of a method 4500 for changing software state in a multi-panel electronic device. In one particular embodiment, method 4500 includes electronic device 101 of FIGS. 1-7, electronic device 800 of FIG. 8, electronic device 900 of FIGS. 9-14, electronic device 1501, FIGS. The electronic device 1801 of FIG. 20, the electronic device 2100 of FIG. 21, the electronic device 2201 of FIGS. 22 to 23, the electronic device 2401 of FIGS. 24 and 25, the electronic device 2701 of FIGS. Of the electronic device 3201, the electronic device 3801 of FIGS. 38-41, or any combination thereof.

  At 4502, user input for moving a graphical user interface element on a first display surface of an electronic device is received. The electronic device further includes a second display surface that is separated from the first display surface by a gap. Moving to 4504, a determination is made that at least a portion of the graphical user interface element should be moved off the edge of the first display surface and toward the gap. Proceeding to 4506, at least a portion of the graphical user interface element is displayed on the second display surface based on the placement and direction of movement of the graphical user interface element on the first display surface.

  For example, in FIG. 34 the graphical user interface element has a first portion displayed on the leftmost display surface and a second portion displayed on the central display surface during movement 3412 across the gap 3414. May be an application icon such as icon 3206 displayed on the screen. As another example, the graphical user interface element has a first portion displayed on the leftmost display surface and has a second portion displayed on the central display surface during movement 3618 across gap 3414. It may be an application window such as window 3516 displayed in FIG.

  FIG. 46 is a flowchart of a sixth exemplary embodiment of a method 4600 for changing software state in a multi-panel electronic device. In one particular embodiment, method 4600 includes electronic device 101 of FIGS. 1-7, electronic device 800 of FIG. 8, electronic device 900 of FIGS. 9-14, electronic device 1501, FIGS. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, and the FIGS. Of the electronic device 3201, the electronic device 3801 of FIGS. 38-41, or any combination thereof.

  At 4602, user input for moving an application icon on a first display surface of an electronic device is received. The electronic device further includes a second display surface that is separated from the first display surface by a gap. For example, the user input can include a drag operation of an application icon on the touch screen on the first display surface. In one exemplary embodiment, the application icon is icon 3206 of FIGS.

  Proceeding to 4604, a determination is made that the application icon should be moved off the edge of the first display surface and toward the gap based on user input. For example, icon 3206 may be moved toward gap 3414 as shown in FIG. Proceeding to 4606, the application associated with the application icon is launched in response to the application icon being moved off the edge of the first display. Proceeding to 4608, at least a portion of the user interface for the application associated with the application icon is displayed on a second display surface, such as an application window 3516 in the second display surface 3308 shown in FIG.

  FIG. 47 is a flowchart of a seventh exemplary embodiment of a method 4700 for changing software state in a multi-panel electronic device. In one particular embodiment, the method 4700 includes the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device 1501, FIGS. The electronic device 1801 of FIG. 20, the electronic device 2100 of FIG. 21, the electronic device 2201 of FIGS. 22 to 23, the electronic device 2401 of FIGS. 24 and 25, the electronic device 2701 of FIGS. Of the electronic device 3201, the electronic device 3801 of FIGS. 38-41, or any combination thereof.

  At 4702, a plurality of application icons are displayed on the first display surface of the electronic device, and an application interface window for the application is displayed on the second display surface of the electronic device. The first display surface is separated from the second display surface by a gap. In one exemplary embodiment, the application interface window may be an application window 3516 on the second display surface 3308 separated from the application icon by a gap 3414, as shown in FIG.

  Moving to 4704, user input is received moving through at least a portion of the application interface window on the second display surface. For example, the user input can include a drag operation of an application icon on the touch screen on the second display surface. Proceeding to 4706, a determination is made that at least a portion of the application interface window should be moved off the edge of the second display surface and toward the gap based on user input. Proceeding to 4708, a portion of the application interface window is moved off the edge of the second display surface, as shown in FIGS. 36-37 as application window 3516 is moved across gap 3414. In response, the application interface window is closed.

  Proceeding to 4710, in one particular embodiment, an application icon associated with the application is displayed on the first display surface in response to the portion of the application interface window being moved off the edge of the second display. Is displayed. For example, the application icon 3206 after the portion of the application window 3516 has been moved beyond the gap 3414 is displayed in FIG. Proceeding to 4712, in one particular embodiment, the application is closed in response to a portion of the application interface window being moved off the edge of the second display.

  FIG. 48 is a flowchart of an eighth exemplary embodiment of a method 4800 for changing software state in a multi-panel electronic device. Depending on the screen size and screen resolution, the web browser in the multi-panel electronic device can automatically change the way the web browser presents itself to the web server. If the screen size and / or screen resolution changes, such as by folding or unfolding the panel of the electronic device, the current website may be automatically refreshed with the website served for the new browser identification parameters. The user changes the parameters of the device by changing the folding form, and the device automatically sends information that enables the website to automatically serve web content that may be suitable for the new parameters of the device can do.

  In one particular embodiment, the method 4800 includes the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device 1501, FIGS. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, and the FIGS. Of the electronic device 3201, the electronic device 3801 of FIGS. 38-41, or any combination thereof.

  At 4802, a hardware configuration change from the first configuration to the second configuration is detected in the electronic device. The electronic device includes at least a first panel having a first display surface and a second panel having a second display surface. At least one of the effective screen size or the screen resolution corresponding to the viewing area of the first display surface and the second display surface is modified in response to the hardware configuration change. For example, the first panel can be coupled to the second panel via a hinge, and the hardware configuration change can include a change in the relative orientation of the first panel relative to the second panel.

  Moving to 4804, in response to at least one parameter based on a hardware configuration change, ie, at least one of a modified effective screen size or a modified screen resolution, at least one parameter is sent to the web server. The

  In one particular embodiment, the at least one parameter indicates browser settings. Proceeding to 4806, the browser interface may be automatically modified based on the hardware configuration change. Proceeding to 4808, modified content may be received from the web server, and the modified content is formatted to be displayed based on browser settings. Proceeding to 4810, the modified content may be displayed in a modified browser interface.

  In response to detecting the hardware configuration change, the electronic device sends at least one parameter and automatically modifies the browser interface to receive the modified content without receiving additional user input. Can be configured to display. To illustrate, when the electronic device 101 of FIG. 1 is folded into the fully folded configuration 200 of FIG. 2 while the browser application is running, the device 101 automatically automates the browser to display on the first surface 102. Send a request for a mobile device web page with reduced page content to a web server providing content to be displayed in the browser, such as by identifying the web browser as a mobile browser type can do. When the device 101 is changed to the fully deployed configuration 500 of FIG. 5 or 600 of FIG. 6, the device 101 has three display surfaces 102-106, such as by identifying the web browser as a desktop browser type or a laptop browser type. The browser can be automatically configured to display all of the above, and a request for a desktop type web page with more content can be sent to the providing web server.

  Referring to FIG. 49, a particular exemplary embodiment of an electronic device 4901 having an accelerometer is shown and generally designated 4900. In one particular embodiment, the electronic device 4901 is the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the three panel version of the electronic device 900 of FIGS. 9-14, the electronic device of FIGS. Device 1501, electronic device 1801 of FIGS. 18 to 20, electronic device 2100 of FIG. 21, electronic device 2201 of FIGS. 22 to 23, electronic device 2401 of FIGS. 24 and 25, electronic device 2701 of FIGS. It is the electronic device 3201 of FIGS. 32-37, the electronic device 3801 of FIGS. 38-41, or any combination thereof. In one particular embodiment, the electronic device 4901 may include the method 2600 of FIG. 26, the method 4200 of FIG. 42, the method 4300 of FIG. 43, the method 4400 of FIG. 44, the method 4500 of FIG. 45, the method 4600 of FIG. Configured to operate according to method 4700 of FIG. 48, method 4800 of FIG. 48, or any combination thereof.

  The electronic device 4901 includes a first panel 4902 having a first display surface 4908, a second panel 4904 having a second display surface 4910, and a third panel 4906 having a third display surface 4912. Including. The three display surfaces 4908-4912 can be controlled to emulate a single display screen that extends across all three display surfaces 4908-4912. The first panel 4902 is rotatably coupled to the first edge of the second panel 4904 and the third panel 4906 is rotatably coupled to the second edge of the second panel 4904. The first accelerometer 4922 is disposed on the first panel 4902, the second accelerometer 4924 is disposed on the second panel 4904, and the third accelerometer 4926 is disposed on the third panel 4906. Attitude module 4994 is coupled to receive first acceleration data 4982 from first accelerometer 4922. Attitude module 4994 is coupled to receive second acceleration data 4984 from second accelerometer 4924. Attitude module 4994 is coupled to receive third acceleration data 4986 from third accelerometer 4926. A controller such as processor 4998 is coupled to attitude module 4994 as indicated by arrow 4996. The mutually orthogonal axes X1, Y1, and Z1 are associated with a first accelerometer 4922. The mutually orthogonal axes X2, Y2, and Z2 are associated with the second accelerometer 4924. The mutually orthogonal axes X3, Y3, and Z3 are associated with a third accelerometer 4926.

  The first accelerometer 4922 may be coupled to the first panel 4902 and configured to generate first acceleration data 4982 related to the acceleration of the first panel 4902. Second accelerometer 4924 may be coupled to second panel 4904 and configured to generate second acceleration data 4984 that is related to the acceleration of second panel 4904. Third accelerometer 4926 may be coupled to third panel 4906 and configured to generate third acceleration data 4986 related to the acceleration of third panel 4906. Posture module 4994 receives first acceleration data 4982 received from first accelerometer 4922, second acceleration data 4984 received from second accelerometer 4924, and third accelerometer 4926. Further, the configuration of the electronic device 4901 may be determined based at least in part on the third acceleration data 4986.

  In one particular embodiment, posture module 4994 includes a first posture of first display surface 4908 relative to the direction of gravity, a second posture of second display surface 4910 relative to the direction of gravity, and a direction of gravity. The configuration of the electronic device 4901 is determined based on the third posture of the third display surface 4912. In one particular embodiment, the processor 4998 determines at least one of the first display surface 4908, the second display surface 4910, and the third display surface 4912 based on a detected change in the configuration of the electronic device 4901. A graphical user interface (GUI) provided to one is configured to automatically adjust.

  Referring to FIG. 50, the electronic device 4901 of FIG. 49 in a fully deployed configuration is shown and generally designated 5000. In the fully deployed configuration 5000, the acceleration sensed by the first accelerometer 4922 is indicated by arrow 5032, the acceleration sensed by the second accelerometer 4924 is indicated by arrow 5034, and sensed by the third accelerometer 4926. The acceleration that is performed is indicated by arrow 5036. The accelerations 5032 to 5036 are caused by gravity and are all in the direction of gravity. According to the first accelerometer 4922, the acceleration is in the negative Z1 direction. According to the second accelerometer 4924, the acceleration is in the negative Z2 direction. The accelerometer 4926 is in the negative Z3 direction. Accelerations 5032-5036 are also substantially the same magnitude as represented by the respective lengths of arrows 5032-5036.

  Referring to FIG. 51, the electronic device 4901 of FIG. 49 in a fully folded configuration is shown and generally designated 5100. In the fully folded configuration 5100, the acceleration sensed by the first accelerometer 4922 is indicated by arrow 5132, the acceleration sensed by the second accelerometer 4924 is indicated by arrow 5134 and sensed by the third accelerometer 4926. The acceleration that is performed is indicated by arrow 5136. The accelerations 5132 to 5136 are caused by gravity and are all in the direction of gravity. According to the first accelerometer 4922, the acceleration is in the negative Z1 direction. According to the second accelerometer 4924, the acceleration is in the positive Z2 direction. The accelerometer 4926 is in the negative Z3 direction. The direction of acceleration 5134 sensed by second accelerometer 4924 is opposite to the direction of acceleration 5132 sensed by first accelerometer 4922 and the direction of acceleration 5136 sensed by third accelerometer 4926. The opposite is the case. In the fully folded configuration 5100, the second accelerometer 4924 is “upside down” with respect to the first accelerometer 4922 and with respect to the third accelerometer 4926. The accelerations 5132-5136 are all substantially the same size as represented by the respective lengths of arrows 5132-5136.

  Referring to FIG. 52, the electronic device 4901 of FIG. 49 in the summing configuration is shown and is generally designated 5200. In the summing configuration 5200, the acceleration sensed by the first accelerometer 4922 is indicated by arrow 5232 and the acceleration sensed by the second accelerometer 4924 is indicated by arrow 5234 and sensed by the third accelerometer 4926. The acceleration is indicated by arrow 5236. The accelerations 5232-5236 are all due to gravity and are in the direction of gravity, according to the first accelerometer 4922 are in the negative Z1 direction, and according to the second accelerometer 4924, the gravity component 5250 is negative Z2. In the direction, the gravity component 5252 is in the negative X2 direction, and according to the third accelerometer 4926, the gravity component 5240 is in the negative Z3 direction and the gravity component 5242 is in the negative X3 direction. Accelerations 5232-5236 are all substantially the same size as represented by the respective lengths of arrows 5232-5236.

  The magnitude of the gravity component 5240 is equal to the product of the sine of the angle between the acceleration 5236 and the gravity component 5242 and the magnitude of the acceleration 5236. For example, when the angle is 30 degrees, the magnitude of the gravitational component 5240 is ½ of the magnitude of the acceleration 5236, and the magnitude of the acceleration 5232 is the same as the magnitude of the acceleration 5236, so 1/2 of this. Similarly, the magnitude of the gravity component 5250 is equal to the product of the sine of the angle between the acceleration 5234 and the gravity component 5252 and the magnitude of the acceleration 5234. For example, when the angle is 30 degrees, the magnitude of the gravity component 5250 is ½ of the magnitude of the acceleration 5234, and the magnitude of the acceleration 5234 is the same as the magnitude of the acceleration 5232, and thus the magnitude of the acceleration 5232. 1/2 of this.

  Referring to FIG. 53, the electronic device 4901 of FIG. 49 in a video conferencing configuration is shown and generally designated 5300. In video conferencing configuration 5300, acceleration sensed by first accelerometer 4922 is indicated by arrow 5332, acceleration sensed by second accelerometer 4924 is indicated by arrow 5334, and sensed by third accelerometer 4926. The acceleration that is performed is indicated by arrow 5336. The accelerations 5332 to 5336 are caused by gravity and are all in the direction of gravity. According to the first accelerometer 4922, the third accelerometer is in the negative Z1 direction. According to the second accelerometer 4924, the third accelerometer is in the negative Z2 direction. The accelerometer 4926 is in the positive Z3 direction. The direction of acceleration 5336 sensed by third accelerometer 4926 is opposite to the direction of acceleration 5332 sensed by first accelerometer 4922 and the direction of acceleration 5334 sensed by second accelerometer 4924. The opposite is the case. In video conferencing configuration 5300, third accelerometer 4926 is “upside down” with respect to first accelerometer 4922 and with respect to second accelerometer 4924. The accelerations 5332 to 5336 are all substantially the same size as represented by the lengths of the arrows 5332 to 5336, respectively.

  Referring to FIG. 54, the electronic device 4901 of FIG. 49 in a travel clock configuration is shown and generally designated 5400. In travel clock configuration 5400, acceleration sensed by first accelerometer 4922 is indicated by arrow 5432, acceleration sensed by second accelerometer 4924 is indicated by arrow 5434, and sensed by third accelerometer 4926. The acceleration that is performed is indicated by arrow 5436. The accelerations 5432-5436 are all due to gravity and are in the direction of gravity. According to the first accelerometer 4922, the gravity component 5440 is in the negative Z1 direction, the gravity component 5442 is in the negative X1 direction, and the second According to the accelerometer 4924, the gravitational component 5450 is in the negative Z2 direction, the gravitational component 5452 is in the positive X2 direction, and the third accelerometer 4926 is in the negative Z3 direction. The accelerations 5432-5436 are all substantially the same size as represented by the respective lengths of arrows 5432-5436.

  The magnitude of the gravity component 5440 is equal to the product of the sine of the angle between the acceleration 5432 and the gravity component 5442 and the magnitude of the acceleration 5432. For example, when the angle is 30 degrees, the magnitude of the gravity component 5440 is ½ of the magnitude of the acceleration 5432, and the magnitude of the acceleration 5432 is the same as the magnitude of the acceleration 5436. 1/2. Similarly, the magnitude of the gravity component 5450 is equal to the product of the sine of the angle between the acceleration 5434 and the gravity component 5452 and the magnitude of the acceleration 5434. For example, when the angle is 30 degrees, the magnitude of the gravity component 5450 is ½ of the magnitude of the acceleration 5434, and the magnitude of the acceleration 5434 is the same as the magnitude of the acceleration 5436. 1/2.

  Referring to FIG. 55, the electronic device 4901 of FIG. 49 in a dual panel configuration is shown and generally designated 5500. In dual panel configuration 5500, the acceleration sensed by first accelerometer 4922 is indicated by arrow 5532, the acceleration sensed by second accelerometer 4924 is indicated by arrow 5534, and sensed by third accelerometer 4926. The acceleration that is performed is indicated by arrow 5536. The accelerations 5532 to 5536 are caused by gravity and are all in the direction of gravity. According to the first accelerometer 4922, the acceleration is in the positive Z1 direction. The accelerometer 4926 is in the negative Z3 direction. The direction of acceleration 5532 sensed by first accelerometer 4922 is opposite to the direction of acceleration 5534 sensed by second accelerometer 4924 and the direction of acceleration 5536 sensed by third accelerometer 4926. The opposite is the case. In the dual panel configuration 5500, the first accelerometer 4922 is “upside down” with respect to the second accelerometer 4924 and with respect to the third accelerometer 4926. The accelerations 5532-5536 are all substantially the same size as represented by the respective lengths of arrows 5532-5536.

  In one particular embodiment, the dual panel configuration shown in FIG. 55 functions as a “book mode”, and a panel including a second accelerometer 4924 and a third accelerometer 4926 simulates both sides of the book. be able to. In such a book mode configuration, the panel containing the first accelerometer 4922 is folded back away from the user during normal operation, and energy (eg, energy supplied by the batteries 884 and 886 in FIG. 8) is transferred. Can be turned off to save. The particular configuration shown in FIG. 55 shows the book mode panels as being substantially coplanar, but instead the panels are mutually connected to further simulate viewing text and images in the book. Note that it can be bent slightly towards.

  Further, the electronic device 101 in FIGS. 1 to 7, the electronic device 800 in FIG. 8, the three-panel version of the electronic device 900 in FIGS. 9 to 14, the electronic device 1501 in FIGS. 15 to 17, and the electronic in FIGS. 21, the electronic device 2100 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, the electronic device 3201 in FIGS. 32 to 37, As well, one or more of the electronic devices 3801 of FIGS. 38-41 may be configured to operate in a book mode configuration in addition to the one or more predetermined configurations described above.

  FIG. 56 is a flowchart of a first exemplary embodiment of a method 5600 for determining the configuration of an electronic device. In one particular embodiment, method 5600 includes electronic device 101 of FIGS. 1-7, electronic device 800 of FIG. 8, electronic device 900 of FIGS. 9-14, electronic device 1501, FIGS. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, and the FIGS. Of the electronic device 3201, the electronic device 3801 of FIGS. 38-41, the electronic device 4901 of FIGS. 49-55, or any combination thereof.

  Sensor input 5602 is received and used at 5604 to detect a new hardware configuration. The new hardware configuration uses acceleration magnitude data (M) and direction (D) for the first panel (g1), the second panel (g2), and the third panel (g3). Is detected based on For example, sensor input 4202 may indicate a relative orientation or change in orientation of one or more panels of a multi-panel device, such as via one or more accelerometers.

  Moving to decision 5606, in 5606, the direction of gravity relative to the first panel D (g1) is substantially the same as the direction of gravity relative to the third panel D (g3) and the second panel D (g2 Is determined to be substantially opposite to the direction of gravity with respect to). If it is determined that D (g1) is substantially the same as D (g3) and is substantially opposite to D (g2), at 5608, the device is determined to be in a fully folded configuration. For example, the device may be in the fully folded configuration 5100 of FIG. When the magnitude of acceleration data in the y direction (ie, direction Y1 in FIG. 49) is greater than the magnitude of acceleration data in the x direction (ie, direction X1 in FIG. 49), the device is determined to be in the vertical configuration. . When the magnitude of acceleration data in the x direction (ie, direction X1 in FIG. 49) is greater than the magnitude of acceleration data in the y direction (ie, direction Y1 in FIG. 49), the device is determined to be in the lateral configuration. . If the configuration has changed (eg, the previously detected configuration was not the fully folded configuration 5100 of FIG. 51), the graphic user interface is modified according to the configuration change, and in 5604 the process detects a new configuration. You can return to

  If it is determined that D (g1) is not substantially the same as D (g3) and / or not substantially opposite D (g2), at decision 5610, D (g1) is substantially equal to D (g2). , And substantially the same as D (g3), and the magnitude of the z component of gravity for the first panel M (g1) (ie, the component of gravity in the direction Z1 in FIG. 49) Is substantially the same as the magnitude of the z component of gravity for the second panel M (g2) (ie, the component of gravity in the direction Z2 of FIG. 49), and the z component of gravity for the third panel M (g3) It is determined whether or not it is substantially the same as the magnitude of (ie, the gravity component in the direction Z3 in FIG. 49). D (g1) is substantially the same as D (g2), substantially the same as D (g3), M (g1) is substantially the same as M (g2), and M (g3) Is determined to be substantially the same, at 5612 the device is determined to be in a fully deployed configuration. For example, the device may be in the fully deployed configuration 5000 of FIG. When the magnitude of acceleration data in the x direction (ie, direction X1 in FIG. 49) is larger than the magnitude of acceleration data in the y direction (ie, direction Y1 in FIG. 49), the device is determined to be in the vertical configuration. . When the magnitude of acceleration data in the y direction (ie, direction Y1 in FIG. 49) is greater than the magnitude of acceleration data in the x direction (ie, direction X1 in FIG. 49), the device is determined to be in the lateral configuration. . If the configuration has changed (eg, the previously detected configuration was not the fully expanded configuration 5000 of FIG. 50), the graphic user interface is modified according to the configuration change, and in 5604 the process detects a new configuration. You can return to

  D (g1) is not substantially the same as D (g2) and / or is not substantially the same as D (g3) and / or M (g1) is not substantially the same as M (g2) and / or If it is determined that it is not substantially the same as M (g3), whether or not D (g1) is substantially the same as D (g2) and substantially the same as D (g3) in decision 5614 As well as 2 × M (g1) is substantially the same as 2 × M (g2) and a determination is made as to whether it is substantially the same as M (g3). D (g1) is substantially the same as D (g2), substantially the same as D (g3), 2 × M (g1) is substantially the same as 2 × M (g2), If it is determined that it is substantially the same as M (g3), at 5616 the device is determined to be in the travel clock configuration. For example, the device may be in the travel clock configuration 5400 of FIG. 54 where the angle between the first panel and the second panel is 60 degrees. In another embodiment, the angle between the first panel and the second panel can be greater or less than 60 degrees. If the configuration has changed (eg, the previously detected configuration was not the travel clock configuration 5400 of FIG. 54), the graphic user interface is modified according to the configuration change, and at 5604 the process detects a new configuration. You can return to

  D (g1) is not substantially the same as D (g2) and / or not substantially the same as D (g3) and / or 2 × M (g1) is substantially the same as 2 × M (g2) And / or if it is determined that it is not substantially the same as M (g3), in decision 5618, D (g1) is substantially the same as D (g2) and substantially opposite D (g3) As well as whether M (g1) is substantially the same as M (g2) and substantially the same as M (g3). D (g1) is substantially the same as D (g2), is substantially opposite to D (g3), M (g1) is substantially the same as M (g2), and M (g3) Is determined to be substantially the same, at 5620, the device is determined to be in a video conference configuration. For example, the device may be in video conferencing configuration 5300 of FIG. If the configuration has changed (eg, the previously detected configuration was not the video conferencing configuration 5300 of FIG. 53), the graphic user interface is modified according to the configuration change, and at 5604 the process detects a new configuration. You can return to

  D (g1) is not substantially the same as D (g2) and / or is not substantially opposite D (g3) and / or M (g1) is not substantially the same as M (g2) and / or If it is determined that it is not substantially the same as M (g3), whether or not D (g1) is substantially opposite to D (g2) and substantially opposite to D (g3) in decision 5622 As well as whether M (g1) is substantially the same as M (g2) and substantially the same as M (g3). D (g1) is substantially opposite to D (g2), substantially opposite to D (g3), M (g1) is substantially the same as M (g2), and M (g3) Is determined to be substantially the same, at 5624 the device is determined to be in a dual screen configuration. For example, the device may be in the dual screen configuration 5500 of FIG. When the magnitude of acceleration data in the x direction (ie, direction X1 in FIG. 49) is larger than the magnitude of acceleration data in the y direction (ie, direction Y1 in FIG. 49), the device is determined to be in the vertical configuration. . When the magnitude of acceleration data in the y direction (ie, direction Y1 in FIG. 49) is greater than the magnitude of acceleration data in the x direction (ie, direction X1 in FIG. 49), the device is determined to be in the lateral configuration. . If the configuration has changed (eg, the previously detected configuration was not the dual screen configuration 5500 of FIG. 55), the graphic user interface is modified according to the configuration change, and at 5604 the process detects a new configuration. You can return to

  D (g1) is not substantially opposite to D (g2) and / or is not substantially opposite to D (g3) and / or M (g1) is not substantially the same as M (g2) and / or If it is determined that it is not substantially the same as M (g3), then in decision 5626, whether D (g1) is substantially the same as D (g2) and whether it is substantially the same as D (g3) As well as whether M (g1) is substantially the same as 2 × M (g2) and substantially the same as 2 × M (g3). D (g1) is substantially the same as D (g2), substantially the same as D (g3), M (g1) is substantially the same as 2 × M (g2), 2 × If it is determined that it is substantially the same as M (g3), then at 5628 the device is determined to be in the summing configuration. For example, the device may be in the summing configuration 5200 of FIG. 52 where the angle between the first panel and the second panel is 120 degrees. In another embodiment, the angle between the first panel and the second panel can be greater or less than 120 degrees. If the configuration has changed (eg, the previously detected configuration was not the summing configuration 5200 of FIG. 52), the graphic user interface is modified according to the configuration change, and at 5604 the process is to detect the new configuration. You can go back.

  D (g1) is not substantially the same as D (g2) and / or not substantially the same as D (g3) and / or M (g1) is not substantially the same as 2 × M (g2) and If a determination is made that it is not substantially the same as 2 × M (g3), then at 5630 a determination is made that the device is in a transition configuration and no change can be performed on the display panel, and processing at 5604 Can return to detecting a new configuration.

  In various exemplary embodiments, a posture cannot be considered a changed posture until the new posture lasts for a period of time, eg, about 200 milliseconds (ms). When the magnitude of the acceleration data in the z direction (ie, the direction Z1 in FIG. 49) is substantially 0, it may be difficult to determine the orientation of the panel from the magnitude of the acceleration in the z direction. If the magnitude of acceleration data in the x direction (ie, direction X1 in FIG. 49) is greater than 0, the magnitude of acceleration data in the x direction can be used instead. If the magnitude of the acceleration data in the x direction and the magnitude of the acceleration data in the z direction are both substantially zero, the magnitude of the acceleration data in the y direction (ie, the direction Y1 in FIG. 49) can be used instead. .

  FIG. 57 is a flowchart of a second exemplary embodiment of a method 5700 for determining the configuration of an electronic device. In one particular embodiment, method 5700 includes electronic device 101 of FIGS. 1-7, electronic device 800 of FIG. 8, electronic device 900 of FIGS. 9-14, electronic device 1501, FIGS. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, and the FIGS. Of the electronic device 3201, the electronic device 3801 of FIGS. 38-41, the electronic device 4901 of FIGS. 49-55, or any combination thereof.

  The method 5700 includes, at 5702, receiving first acceleration data from a first sensor coupled to a first portion of the electronic device. For example, attitude module 4994 can receive first acceleration data 4982 from first accelerometer 4922 coupled to first panel 4902 of electronic device 4901 of FIG. The method further includes, at 5704, receiving second acceleration data from a second sensor coupled to the second portion of the electronic device, wherein the position of the first portion is at the position of the second portion. In contrast, it is movable. For example, attitude module 4994 may receive second acceleration data 4984 from second accelerometer 4924 coupled to second panel 4904 of electronic device 4901 of FIG. Is movable relative to the position of the second panel 4904.

  The method further includes, at 5706, determining a configuration of the electronic device based at least in part on the first acceleration data and the second acceleration data. For example, the first acceleration data 4982 indicates the direction of gravity in the negative Z1 direction in the first accelerometer 4922, and the second acceleration data 4984 indicates the direction of gravity in the positive Z2 direction in the second accelerometer 4924. If shown, the posture module 4994 determines that the first panel 4902 is fully folded relative to the second panel 4904 so that the device 4901 of FIG. 49 can be in the fully folded configuration 5100 of FIG. Can do. Similarly, the first acceleration data 4982 indicates the direction of gravity in the negative Z1 direction in the first accelerometer 4922, and the second acceleration data 4984 indicates the direction of gravity in the negative Z2 direction in the second accelerometer 4924. The orientation module 4994 determines that the first panel 4902 is fully deployed relative to the second panel 4904 so that the device 4901 of FIG. 49 can be in the fully deployed configuration 5000 of FIG. be able to.

  FIG. 58 is a flowchart of a third exemplary embodiment of a method 5800 for determining the configuration of an electronic device. In one particular embodiment, method 5800 includes electronic device 101 of FIGS. 1-7, electronic device 800 of FIG. 8, electronic device 900 of FIGS. 9-14, electronic device 1501, FIGS. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, and the FIGS. Of the electronic device 3201, the electronic device 3801 of FIGS. 38-41, the electronic device 4901 of FIGS. 49-55, or any combination thereof.

  The method 5800 includes, at 5802, receiving first acceleration data from a first sensor coupled to a first portion of the electronic device. For example, attitude module 4994 can receive first acceleration data 4982 from first accelerometer 4922 coupled to first panel 4902 of electronic device 4901 of FIG. The method further includes, at 5804, receiving second acceleration data from a second sensor coupled to the second portion of the electronic device, wherein the position of the first portion is at the position of the second portion. In contrast, it is movable. For example, attitude module 4994 may receive second acceleration data 4984 from second accelerometer 4924 coupled to second panel 4904 of electronic device 4901 of FIG. Is movable relative to the position of the second panel 4904. The method further includes, at 5806, receiving third acceleration data from a third sensor coupled to the third portion of the electronic device, the third portion being rotatable to the second panel. Including a third panel coupled, the configuration is further determined based on the third acceleration data. For example, the attitude module 4994 can receive third acceleration data 4986 from a third accelerometer 4926 coupled to a third panel 4906 of the electronic device 4901 of FIG. Two panels 4904 are rotatably coupled. First acceleration data 4982 indicates the direction of gravity in the negative Z1 direction in the first accelerometer 4922, second acceleration data 4984 indicates the direction of gravity in the positive Z2 direction in the second accelerometer 4924, If the third acceleration data 4986 indicates the direction of gravity in the negative Z3 direction in the third accelerometer 4926, the attitude module 4994 determines that the device 4901 of FIG. 49 can be in the fully folded configuration 5100 of FIG. be able to. Similarly, the first acceleration data 4982 indicates the direction of gravity in the negative Z1 direction in the first accelerometer 4922, and the second acceleration data 4984 indicates the direction of gravity in the negative Z2 direction in the second accelerometer 4924. When the third acceleration data 4986 indicates the direction of gravity in the negative Z3 direction in the third accelerometer 4926, the attitude module 4994 can be the device 4901 of FIG. 49 in the fully deployed configuration 5000 of FIG. It can be judged.

  The method further includes, at 5808, determining a first attitude of the first portion based on the first gravity component of the first acceleration data. For example, the first acceleration data 4982 includes the acceleration 5432 of FIG. 54 due to gravity in the direction of gravity, having a gravity component 5440 in the negative Z1 direction and a gravity component 5442 in the negative X1 direction, by the first accelerometer 4922. Can show. The magnitude of the gravity component 5440 is equal to the product of the sine of the angle between the acceleration 5432 and the gravity component 5442 and the magnitude of the acceleration 5432. For example, when the angle is 30 degrees, the magnitude of the gravity component 5440 is ½ of the magnitude of the acceleration 5432. The attitude of the first panel 4902 may be that shown in the travel clock configuration 5400 of FIG.

  The method further includes determining, at 5810, a second attitude of the second portion based on the second gravity component of the second acceleration data. For example, the second acceleration data 4984 includes the acceleration 5434 of FIG. 54 due to gravity in the direction of gravity, having a gravity component 5450 in the negative Z2 direction and a gravity component 5252 in the positive X2 direction, by the second accelerometer 4924. Can show. The magnitude of the gravity component 5450 is equal to the product of the sine of the angle between the acceleration 5434 and the gravity component 5252 and the magnitude of the acceleration 5434. For example, when the angle is 30 degrees, the magnitude of the gravity component 5450 is ½ of the magnitude of the acceleration 5434. The attitude of the second panel 4904 may be that shown in the travel clock configuration 5400 of FIG.

  The method further includes, at 5812, determining a third orientation of the third portion based on the third gravity component of the third acceleration data. For example, the third acceleration data 4986 includes the acceleration 5236 of FIG. 52 due to gravity in the direction of gravity, having a gravity component 5240 in the negative Z3 direction and a gravity component 5242 in the negative X3 direction, by the third accelerometer 4926. Can show. The magnitude of the gravity component 5240 is equal to the product of the sine of the angle between the acceleration 5236 and the gravity component 5242 and the magnitude of the acceleration 5236. For example, when the angle is 30 degrees, the magnitude of the gravity component 5240 is ½ of the magnitude of the acceleration 5236. The posture of the third panel 4906 may be the posture shown in the summing configuration 5200 of FIG. The method further includes, at 5814, determining a configuration of the electronic device based on the first acceleration data, the second acceleration data, and the third acceleration data. For example, the configuration of the electronic device 4901 of FIG. 49 can be determined based on the first acceleration data 4982, the second acceleration data 4984, and the third acceleration data 4986 according to the method 5600 of FIG.

  Referring to FIG. 59, a particular exemplary embodiment of an electronic device having a folded / tilt sensor such as an accelerometer is shown and generally designated 5900. In one particular embodiment, the electronic device 5900 is the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the three-panel version of the electronic device 900 of FIGS. Device 1501, electronic device 1801 of FIGS. 18 to 20, electronic device 2100 of FIG. 21, electronic device 2201 of FIGS. 22 to 23, electronic device 2401 of FIGS. 24 and 25, electronic device 2701 of FIGS. The electronic device 3201 of FIGS. 32-37, the electronic device 3801 of FIGS. 38-41, the electronic device 4901 of FIGS. 49-55, or any combination thereof. In one particular embodiment, electronic device 5900 may include method 2600 in FIG. 26, method 4200 in FIG. 42, method 4300 in FIG. 43, method 4400 in FIG. 44, method 4500 in FIG. 45, method 4600 in FIG. 48, method 4800 of FIG. 48, method 5600 of FIG. 56, method 5700 of FIG. 57, method 5800 of FIG. 58, or any combination thereof.

  Device 5900 includes a main board 5901 coupled to a first display board 5903 and a second display board 5905 via a set of connections 5990 on a hinge (not shown). Each of the boards 5901, 5903, and 5905 may be in a separate panel of a multi-panel hinge coupling device, such as the electronic device 101 of FIGS.

  Main board 5901 includes display 5902, processor 5910 coupled to memory 5932, attitude module 5970 coupled to one or more fold / tilt sensors 5972, display controller 5962, touch screen controller 5952, A wireless controller 5940, a short-range wireless interface 5946, a coder / decoder (codec) 5934, and a power management integrated circuit (PMIC) 5980 are included. The first display board 5903 includes a display 5904 coupled to a display controller 5964, a touch screen controller 5954, and one or more fold / tilt sensors 5974. The second display board 5905 includes a display 5906 coupled to the display controller 5966, a touch screen controller 5956, and one or more folded / tilt sensors 5976. The first display board 5903 is coupled to the main board 5901 via a first communication path such as a first high speed serial link 5992. The second display board 5905 is coupled to the main board 5901 via a second communication path such as a second high speed serial link 5994. First display board 5903 and second display board 5905 each have batteries 5984 and 5986 coupled to PMIC 5980 via power line 5996, and power line 5996 is at least one between PMIC 5980 and batteries 5984 and 5986. It may be possible to conduct .5 amps (A). In one particular embodiment, camera 5920 and power input 5982 are also coupled to main board 5901.

  The processor 5910 can include one or more processing devices, such as one or more ARM type processors, one or more digital signal processors (DSPs), other processors, or any combination thereof. . The processor 5910 can access one or more computer-readable media, such as the exemplary memory 5932. Memory 5932 stores data (not shown) and processor-executable instructions such as software 5933. In general, software 5933 includes processor-executable instructions that are executable by processor 5910 and may include application software, operating system software, other types of program instructions, or any combination thereof. Although memory 5932 is shown external to processor 5910, in other embodiments memory 5932 may be a cache, one or more registers or register files, other storage devices in processor 5910, or any combination thereof. Etc., may be internal to processor 5910.

  The processor 5910 is also coupled to folded form sensors such as the folded form and tilt sensors 5972, 5974, and 5976 in the main board 5901, the first display panel 5903, and the second display panel 5905, respectively. In the illustrative example, device 5900 can be electronic device 4901 of FIG. 49, and sensors 5972, 5974, and 5976 are shown in the folded configuration of device 5900, the fully folded configuration shown in FIG. 51, FIG. One of a summing configuration, a travel clock configuration shown in FIG. 54, a fully expanded configuration shown in FIG. 50, a dual screen configuration shown in FIG. 55, or a video conferencing configuration shown in FIG. It can be adapted to detect as multiple. In one particular embodiment, sensors 5972, 5974, and 5976 include accelerometers such as first accelerometer 4922, second accelerometer 4924, and third accelerometer 4986 in FIG. Attitude module 5970 may be attitude module 4994 of FIG. 49 and may implement method 5600 of FIG. 56, method 5700 of FIG. 57, method 5800 of FIG. 58, or any combination thereof. The attitude module 5970 can be hardware, software 5933 executed by the processor 5910, or any combination thereof.

  Display controllers 5962, 5964, and 5966 are configured to control displays 5902, 5904, and 5906. In one particular embodiment, displays 5902, 5904, and 5906 may correspond to display surfaces 102, 104, and 106 shown in FIGS. Display controllers 5962, 5964, and 5966 may be configured to provide graphical data to be displayed on displays 5902, 5904, and 5906 in response to processor 5910, depending on the configuration of device 5900. For example, when device 5900 is in a fully folded configuration, display controllers 5962, 5964, and 5966 can control first display 5902 to display a graphical user interface, while other displays 5904 and 5906 can be controlled. It can be turned off or not used. As another example, when the device 5900 is in a fully deployed configuration, the display controllers 5962, 5964, and 5966, the displays 5902, 5904, and 5906, a single active screen that spans all three displays 5902, 5904, and 5906. Can be controlled to display each part of the image.

  In one particular embodiment, each of displays 5902, 5904, and 5906 is responsive to user input via a respective touch screen coupled to touch screen controller 5952, 5954, or 5956, respectively. Touch screen controllers 5952, 5954, and 5956 are configured to receive signals representing user input from displays 5902, 5904, and 5906 and to provide data indicative of the user input to processor 5910. For example, the processor 5910 can respond to user input indicating a double tap of an application icon on the first display 5902, launch the application in response to the user input, and display 5902, 5904, or 5906 One or more application windows can be displayed.

  In one particular embodiment, having each display controller 5962, 5964, and 5966 and each touch screen controller 5952, 5954, and 5956 together with a corresponding display 5902, 5904, and 5906 provides a controller and corresponding display. Compared to other embodiments having on separate panels, the amount of data communicated between the panels may be reduced. However, in other embodiments, two or more of the display controllers 5962, 5964, or 5966, or the touch screen controllers 5953, 5954, or 5956, are simply the ones that control all three displays 5902, 5904, and 5906. It can be combined with a single controller or the like. Further, although three displays 5902, 5904, and 5906 are shown, in other embodiments, device 5900 may include more or fewer than three displays.

  High speed serial links 5992 and 5994 may be high speed bi-directional serial links. For example, links 5992 and 5994 may be mobile display digital interface (MDDI) type links. Touch screen data and sensor data is returned from panels 5903 and 5905 to processor 5910 so that only four differential pairs can be used for signaling on the respective hinges between panels 5901, 5903, and 5905. Can be embedded in a serial stream.

  In one particular embodiment, sensors 5972, 5974, and 5976 may be adapted to detect the folded configuration of device 5900 based on input received at one or more sensors. For example, one or more of sensors 5972, 5974, and 5976 include input from one or more accelerometers, inclinometers, hinge detectors, other detectors, or any combination thereof. Or can be received. Sensors 5972, 5974, and 5976 can provide information indicative of the detected folded configuration of device 5900 to attitude module 5970 and processor 5910. Sensors 5972, 5974, and 5976 can respond to the relative folded position, such as by detecting the angle of rotation of the display panel relative to the adjacent display panel of device 5900. Sensors 5972, 5974, and 5976 may also be responsive to one or more other sensors, such as one or more accelerometers or inclinometers coupled to one or more display panels of device 5900. it can.

  A coder / decoder (codec) 5934 may also be coupled to the processor 5910 as shown in FIG. Speaker 5922 and microphone 5924 may be coupled to codec 5934. FIG. 59 also illustrates that a wireless controller 5940 can be coupled to the processor 5910 and the wireless antenna 5942 to allow the device 5900 to communicate over a wireless network, such as a wide area network (WAN). When device 5900 receives an incoming call, processor 5910 responds to wireless controller 5940 and displays a call indication, such as caller identification information or caller number, on one or more of displays 5902, 5904, and 5906. Can be displayed. The processor 5910 may display a size, position, and orientation as well as a specific to display a call indication based at least in part on the folded configuration of the device 5900 determined based on inputs from sensors 5972, 5974, and 5976. Displays 5902, 5904, and 5906 can be determined. For example, the call display may be displayed on one or more other applications as a pop-up window or text having a size, placement, and orientation based on a collapsed configuration.

  In one particular embodiment, device 5900 is configured to be operable for wireless telephony in all folded configurations. In one particular embodiment, the processor 5910 is coupled to a short range wireless interface 5946 that can be coupled to the headset 5950 via an antenna 5948. The short range wireless interface 5946 can be wirelessly coupled to a headset 5950 such as a device including an earpiece and a microphone via an ad hoc wireless network such as a Bluetooth network. The processor 5910 can implement logic to determine whether to display a call indication or to alert the headset 5950 in response to an incoming call. For example, if device 5900 is in a fully deployed configuration and a multimedia file or streaming media is displayed across all displays 5902, 5904, and 5906, processor 5910 can automatically alert headset 5950. In other cases, a call display can be displayed.

  In one particular embodiment, one or more components of FIG. 59 may be located proximate to or within one or more of the device panels. For example, the processor 5910 can be located in the center panel, and the external panels can store batteries 5984 and 5986, respectively. In one particular embodiment, the panel may be weighted to allow the device to remain standing in the summing configuration.

  As described above with reference to FIG. 21, when a multi-panel electronic device displays an image or video on multiple display surfaces, a portion of the image or video is lost due to the presence of gaps between the display surfaces. Sometimes. For example, referring to FIGS. 39 to 41, the displayed web page portion may disappear due to the gap between the display surfaces of the electronic device 3801. In order to avoid this appearance of missing parts, the image or video can be “split” along the edges of the display surface. For example, application icon 3206 in FIG. 33 and application window 3516 in FIG. 36 may be “split”. However, when such a “split” is performed, the geometry of application icon 3206 in FIG. 33 and application window 3516 in FIG. 36 may appear distorted. That is, the application icon 3206 in FIG. 33 and the application window 3516 in FIG. 36 may appear stretched due to the presence of the gap 3414 in FIGS.

  Referring to FIG. 60, a particular exemplary embodiment of electronic device 6001 is shown and generally designated 6000. The electronic device 6001 includes a first display surface 6002 and a second display surface 6004 that are separated by a gap 6006. The electronic device 6001 also includes a motion sensor 6008. In one particular embodiment, the electronic device 6001 includes the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device 1501 of FIGS. 18 to 20, electronic device 2100 of FIG. 21, electronic device 2201 of FIGS. 22 to 23, electronic device 2401 of FIGS. 24 and 25, electronic device 2701 of FIGS. 27 to 31, and FIGS. 37 electronic device 3201, electronic device 3801 of FIGS. 38-41, electronic device 4901 of FIGS. 49-55, or any combination thereof. In one particular embodiment, the electronic device 6001 may include the method 2600 of FIG. 26, the method 4200 of FIG. 42, the method 4300 of FIG. 43, the method 4400 of FIG. 44, the method 4500 of FIG. 48, method 4800 of FIG. 48, method 5600 of FIG. 56, method 5700 of FIG. 57, method 5800 of FIG. 58, or any combination thereof.

  From time to time, the electronic device 6001 may display an image that is larger than either of the display surfaces 6002 and 6004. For example, in the particular embodiment shown in FIG. 60, electronic device 6001 displays the well-known pangram “The quick brown fox jumps over the lazy dog.”. The first part of the image “ps over the lazy dog.” Is displayed on the first display surface 6002, and the second part of the image “The quick brown fox j” is displayed on the second display surface 6004. . Due to the presence of the gap 6006, the third part “um” between the first part and the second part is not displayed.

  Motion sensor 6008 may be configured to detect movement of electronic device 6001. For example, the motion sensor 6008 may be configured to detect translational, rotational, or tilting motion of the electronic device 6001 as described with reference to the above figures. In one exemplary embodiment, motion sensor 6008 includes an accelerometer, an inclinometer, or any combination thereof. In one particular embodiment, motion sensor 6008 functions as described with reference to sensors 3810 and 3820 in FIG. 38, accelerometers 4922-4926 in FIGS. 49-55, or any combination thereof. In response to motion sensor 6008 detecting movement of electronic device 6001, electronic device 6001 may include first display surface 6002 and second display as described herein with reference to FIGS. The image portion displayed on the second display surface 6004 can be changed. Although the motion sensor 6008 is shown as being coupled to the first display surface 6002, alternatively, the motion sensor may be coupled to the second display surface 6004 or disposed in the gap 6006. Please keep in mind.

  Referring to FIG. 61, an exemplary embodiment for displaying an image in electronic device 6001 is shown and generally designated 6100. As described with reference to FIG. 60, the third portion “um” of the image is not displayed by the gap 6006.

  When the motion sensor 6008 of FIG. 60 detects the movement of the electronic device 6001, the electronic device 6001 may display the third portion “mp” of the image on the first display surface 6002 or the second display surface 6004, etc. it can. In one particular embodiment, the third portion of the image is displayed for a short period of time (eg, 1 or 2 seconds). After a short period of time has elapsed, the image is displayed again in its original state (ie, the first portion of the image is displayed on the first display surface 6002 and the second portion of the image is displayed on the second display surface). 6004 and the third part of the image is not displayed). Alternatively, the third portion of the image can be displayed until the motion sensor 6008 detects a second movement of the electronic device 6001.

  Thus, electronic device 6000 can be “shake” or “tilted” by the user to view a third portion of the image that is not displayed by gap 6006. The third portion of the image may be displayed in the direction of movement of electronic device 6001 or in the direction opposite to the movement of electronic device 6001.

  Referring to FIG. 62, an exemplary embodiment for displaying an image in the electronic device 6001 is shown and generally designated 6200. In the particular embodiment shown in FIG. 62, the image moves in the same direction as the movement of the electronic device 6001. Thus, the user of electronic device 6001 can be made to feel as if they are “pushing” an image in a direction that shakes electronic device 6001. For example, in response to the user of electronic device 6001 moving electronic device 6001 to translate electronic device 6001 to the left substantially within the plane of first display surface 6002, the third portion “ um ”may be displayed on the second display surface 6004.

  Similarly, the user of the electronic device 6001 can be made to feel as if they are “sliding” the image in a direction to tilt the electronic device 6001. For example, the user of the electronic device 6001 may have the electronic device in a direction substantially perpendicular to the plane of the first display surface 6002 such that the third portion “um” slides down on the second display surface 6004. In response to tilting the right edge of the image upward, a third portion “um” of the image may be displayed on the second display surface 6004.

  When the third portion “um” of the image is displayed on the second display surface 6004 to maintain the geometry of the image, the hidden portion “Th” of the second portion of the image is no longer the second display. Note that it is not displayed on surface 6004. In one particular embodiment, the third portion “um” and the hidden portion “Th” each have a width substantially equal to the width of the gap 6006.

  With reference to FIG. 63, an exemplary embodiment for displaying an image in electronic device 6001 is shown and generally designated 6300. In the particular embodiment shown in FIG. 63, the image moves in the opposite direction to the movement of electronic device 6001. Thus, a user of electronic device 6001 may perceive as if electronic device 6001 functions as a “window” that is movable relative to a fixed image.

  When the third portion “um” of the image is displayed on the first display surface 6002 to maintain the geometry of the image, the hidden portion “g.” Of the first portion of the image is no longer the first portion. Note that it is not displayed on the display surface 6002. In one particular embodiment, the third portion “um” and the hidden portion “g.” Each have a width substantially equal to the width of the gap 6006.

  Referring to FIG. 64, an exemplary embodiment for displaying an image on an electronic device 6401 is shown and generally designated 6400. In one particular embodiment, electronic device 6401 is a three panel version of electronic device 6001 of FIG. Electronic device 6401 includes a first display surface 6402 and a second display surface 6403 separated by a gap 6404. The electronic device 6401 also includes a third display surface 6405 that is separated from the second display surface 6403 by a second gap 6406. The electronic device 6401 also includes a motion sensor (not shown) similar to the motion sensor 6008 of FIG.

  In the particular embodiment shown in FIG. 64, the electronic device 6401 is displaying images of the alphabet “ABCDEFGHIJKLMNOPQRSTUVWXYZ”. For illustration purposes, display surfaces 6402, 6403, and 6405 are shown to be substantially equal in size and capable of displaying eight alphabetic characters. The first display surface 6402 displays the first part “ABCDEFGH” of the image. The second display surface 6403 displays the second part “JKLMNOPQ” of the image. The third portion “I” of the image is not displayed by gap 6404. The third display surface 6405 displays the fourth part “STUVWXYZ” of the image. The fifth portion “R” of the image is not displayed by the second gap 6406.

  When the motion sensor of the electronic device 6401 detects the motion of the electronic device 6401, the electronic device can display the third portion “I” and the fifth portion “R” of the image. In one particular embodiment, the third portion and the fifth portion are displayed for a short time period (eg, 1 or 2 seconds). Thus, the electronic device 6401 can be “shake” or “tilted” by the user to view portions of the image that are not displayed by the gaps 6404 and 6406.

  Referring to FIG. 65, an exemplary embodiment for displaying an image on an electronic device 6401 is shown, generally designated 6500. In the particular embodiment shown in FIG. 65, the image moves in the same direction as the movement of the electronic device 6401. The third portion “I” is displayed on the first display surface 6401 proximate to the gap 6404 and the fifth portion “R” is displayed on the second display surface 6403 proximate to the second gap 6406. The Thus, a user of electronic device 6401 may perceive that he is “pushing” an image in a direction that shakes or rapidly moves electronic device 6401. Similarly, a user of electronic device 6401 may alternatively perceive that he “slides” the image in a direction to tilt electronic device 6401.

  With reference to FIG. 66, an exemplary embodiment for displaying an image on an electronic device 6401 is shown and generally designated 6600. In the particular embodiment shown in FIG. 66, the image moves in the opposite direction to the movement of electronic device 6401. The third portion “I” is displayed on the second display surface 6403 proximate to the gap 6404 and the fifth portion “R” is displayed on the third display surface 6405 proximate to the second gap 6406. The Accordingly, the user of electronic device 6401 perceives that electronic device 6401 functions as a “window” that is movable relative to a fixed image.

  It should be noted that although the embodiments shown in FIGS. 60-66 show images that include text, the images can also include non-text content such as geometric shapes, digital illustrations, and photographs.

  FIG. 67 is a flowchart of a first exemplary embodiment of a method 6700 for displaying an image on an electronic device. In one particular embodiment, the method 6700 includes the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device 1501, FIGS. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, and the FIGS. Electronic device 3201 of FIGS. 38-41, electronic device 4901 of FIGS. 49-55, electronic device 6001 of FIGS. 60-63, electronic device 6401 of FIGS. 64-66, or any of them Can be performed by combination.

  The method 6700 includes, at 6702, displaying an image on an electronic device that includes a first display surface and a second display surface. The first display surface is separated from the second display surface by a gap. A first portion of the image is displayed on the first display surface, a second portion of the image is displayed on the second display surface, and a third portion of the image between the first portion and the second portion. The part is not displayed. For example, in FIG. 60, the first portion “ps over the lazy dog.” Is displayed on the first display surface 6002 and the second portion “The quick brown fox j” is displayed on the second display surface 6004. And the third part “um” cannot be displayed.

  The method 6700 also includes, at 6704, detecting motion of the electronic device. For example, in FIG. 60, the motion sensor 6008 can detect the motion of the electronic device 6001.

  The method 6700 further includes displaying a third portion of the image on the second display surface in response to detecting the motion at 6706. For example, a third portion “um” of the image may be displayed on the second display surface 6004 as shown in FIG.

  FIG. 68 is a flowchart of a second exemplary embodiment of a method 6800 for displaying an image on an electronic device. In one particular embodiment, the method 6800 includes the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device 1501, FIGS. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, and the FIGS. Electronic device 3201 of FIGS. 38-41, electronic device 4901 of FIGS. 49-55, electronic device 6001 of FIGS. 60-63, electronic device 6401 of FIGS. 64-66, or any of them Can be performed by combination.

  The method 6800 includes, at 6802, displaying an image in an original state on an electronic device that includes a first display surface and a second display surface. The first display surface is separated from the second display surface by a gap. Displaying the image in its original state includes displaying a first portion of the image on the first display surface, displaying a second portion of the image on the second display surface, and the first portion. And not displaying a third part of the image between the first part and the second part, the third part having a width substantially equal to the width of the gap. For example, in FIG. 60, the first portion “ps over the lazy dog.” Is displayed on the first display surface 6002 and the second portion “The quick brown fox j” is displayed on the second display surface 6004. And the third part “um” cannot be displayed.

  The method 6800 also includes, at 6804, detecting motion of the electronic device at a motion sensor of the electronic device. This movement is a shake motion that translates the electronic device in a direction substantially in the plane of the first display surface, or at least one of the electronic devices in a direction substantially perpendicular to the plane of the first display surface. It can be an edge tilt motion. The motion sensor can be an accelerometer, an inclinometer, or any combination thereof. For example, in FIG. 60, motion sensor 6008 can detect movement of electronic device 6001 (eg, translational or tilting).

  The method 6800 further includes displaying the image in a modified state at 6806 in response to detecting the motion. Displaying the image in a modified state is to display the third part of the image on the second display surface and to hide the hidden part of the second part while the third part is displayed. Includes not displaying. For example, as shown in FIG. 62, the hidden portion “Th” of the second portion cannot be displayed while the third portion “um” of the image is displayed on the second display surface 6004.

  The method 6800 includes, at 6808, displaying the image in its original state after a period of time after detecting motion. For example, after a period of time after movement, the image may be displayed in its original state, as shown in FIG. In another embodiment, the second movement of the electronic device can trigger a change to the original state. For example, if an electronic device displays an image in a modified state in response to detecting a left shake motion, the electronic device may return the image in response to detecting a right shake motion. Can be displayed.

  FIG. 69 is a flowchart of a third exemplary embodiment of a method 6900 for displaying an image on an electronic device. In one particular embodiment, the method 6900 includes the electronic device 101 of FIGS. 1-7, the electronic device 800 of FIG. 8, the electronic device 900 of FIGS. 9-14, the electronic device 1501, FIGS. 20, the electronic device 2100 in FIG. 21, the electronic device 2201 in FIGS. 22 to 23, the electronic device 2401 in FIGS. 24 and 25, the electronic device 2701 in FIGS. 27 to 31, and the FIGS. Electronic device 3201 of FIGS. 38-41, electronic device 4901 of FIGS. 49-55, electronic device 6001 of FIGS. 60-63, electronic device 6401 of FIGS. 64-66, or any of them It can be implemented by a three panel version of the combination.

  The method 6900 includes, at 6902, displaying an image in an original state on an electronic device that includes a first display surface, a second display surface, and a third display surface. The first display surface is separated from the second display surface by a gap, and the third display surface is separated from the second display surface by a second gap. Displaying the image in its original state includes displaying a first portion of the image on the first display surface, displaying a second portion of the image on the second display surface, Not displaying the third part of the image between the second part, displaying the fourth part of the image on the third display surface, and between the second part and the fourth part Including not displaying the fifth portion of the image. For example, referring to FIG. 64, the first portion “ABCDEFGH” may be displayed on the first display surface 6402 and the second portion “JKLMNOPQ” may be displayed on the second display surface 6404, and the third portion “ I ”cannot be displayed, the fourth portion“ STUVWXYZ ”can be displayed on the third display surface 6405, and the fifth portion“ R ”cannot be displayed.

  The method 6900 also includes, at 6904, detecting motion of the electronic device. For example, referring to FIG. 64, movement of electronic device 6401 can be detected.

  The method 6900 further includes, at 6906, displaying the image in a modified state in response to detecting the motion. Displaying the image in a modified state may include displaying a third portion of the image on the second display surface and displaying a fifth portion of the image on the third display surface. it can. For example, as shown in FIG. 66, the third portion “I” may be displayed on the second display surface 6403 and the fifth portion “R” may be displayed on the third display surface 6405.

  The method 6900 further includes, at 6908, displaying the image in its original state after a period of time after detecting the motion. For example, after a period of time after movement, the image may be displayed in its original state, as shown in FIG. Alternatively, the second movement of the electronic device can trigger a change to the original state. For example, if an electronic device displays an image in a modified state in response to detecting a left shake motion, the electronic device may return the image in response to detecting a right shake motion. Can be displayed.

  In this way, a user of a multi-display device will respond to the gap when the multi-display device “divides” the image along the gap (thus displaying the entire image with distorted geometry). It will be appreciated that it may be possible to control (eg, by movement) when parts of the image are “hidden” (thus maintaining the geometry of the image but not displaying the entire image). Thus, the user only needs to make a quick move to see the text and shape of the image that would otherwise not be displayed by the gap. In addition, content providers deliver such “extra” content to users without having to worry about ensuring that critical information is never placed in a “gap area” that can be hidden by multi-display devices. Can do.

  Further, the various exemplary logic blocks, configurations, modules, circuits, and algorithm steps described with respect to the embodiments disclosed herein can be implemented as electronic hardware, computer software, or a combination of both. Will be appreciated by those skilled in the art. Various illustrative components, blocks, configurations, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Those skilled in the art may implement the described functionality in a variety of ways for each particular application, but such implementation decisions should not be construed as departing from the scope of the present disclosure.

  The method or algorithm steps described in connection with the embodiments disclosed herein may be implemented directly in hardware, implemented in software modules executed by a processor, or implemented in combination of the two. obtain. Software modules include random access memory (RAM), flash memory, read only memory (ROM), programmable read only memory (PROM), erasable programmable read only memory (EPROM), electrically erasable programmable read only memory (EEPROM) , Registers, hard disks, removable disks, tangible storage media such as compact disk read only memory (CD-ROM), or any other form of tangible storage medium known in the art. An exemplary storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium can reside in an application specific integrated circuit (ASIC). The ASIC can reside in a computing device or user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a computing device or user terminal.

The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the disclosed embodiments. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the principles defined herein may be applied to other embodiments without departing from the scope of the disclosure. Accordingly, the present disclosure is not intended to be limited to the embodiments shown herein, but is to be accorded the widest scope that is consistent with the principles and novel features defined by the claims. Is.
Hereinafter, the invention described in the scope of claims of the present application will be appended.
(1) receiving at the first display surface a user input for moving a graphical user interface element displayed on the first display surface of the electronic device further comprising a second display surface separated therefrom by a gap; To do
The at least a portion of the graphical user interface element should be moved into the gap beyond an edge of the first display surface such that at least a portion of the graphical user interface element is not displayed on the first display surface. Judging that
Displaying the at least a portion of the graphical user interface element on the second display surface based on an arrangement and direction of movement of the graphical user interface element on the first display surface;
A method comprising:
(2) The method according to (1), wherein the user input includes a drag operation of the graphical user element on a touch screen on the first display surface.
(3) determining that the at least a portion of the graphical user interface element is to be moved away from the gap;
Stop displaying the at least a portion of the graphical user interface element on the second display surface;
The method according to (1), further comprising:
(4) The moving direction of the graphical user interface element may be a horizontal moving direction along the plane of the first display surface, a vertical moving direction along the plane of the first display surface, or any of them. The method according to (1), comprising a combination.
(5) The method of (1), wherein a width of the at least part of the graphical user element is approximately equal to a width of the gap.
(6) The method according to (1), wherein a width of the at least part of the graphical user element is smaller than a width of the gap.
(7) The electronic device further includes a third display surface that is separated from the second display surface by a second gap, the method comprising:
The at least second portion of the graphical user interface element displayed on the second display surface is such that at least a second portion of the graphical user interface element is not displayed on the second display surface. Determining that it should be moved into the second gap beyond the edge of the display surface of
Displaying the at least second portion of the graphical user interface element on the third display surface based on a second arrangement and a second direction of movement of the graphical user interface element on the second display surface. And
The method according to (1), further comprising:
(8) The method of (6), wherein a width of the at least second portion of the graphical user element is approximately equal to a width of the second gap.
(9) The method of (6), wherein a width of the at least second portion of the graphical user interface element is smaller than a width of the second gap.
(10) The method according to (6), wherein the second movement direction is the same as the first movement direction.
(11) The method according to (1), wherein the graphical user interface element is an application icon.
(12) The method of (1), wherein the graphical user interface element includes at least one text character.
(13) a first panel having a first display surface;
A second panel having a second display surface separated from the first display surface by a gap;
Receiving user input at the first display surface for moving a graphical user interface element displayed on the first display surface;
The at least a portion of the graphical user interface element should be moved into the gap beyond an edge of the first display surface such that at least a portion of the graphical user interface element is not displayed on the first display surface. Is determined,
Before Symbol Based on the arrangement and movement direction of said graphical user interface element at the first display surface, the at least a portion of said graphical user interface element displayed on the second display surface at a time,
A processor configured to:
An electronic device comprising:
(14) The electronic device according to (13), wherein the user input includes a drag operation of the graphical user element on a touch screen on the first display surface.
(15) The processor
Determining that the at least a portion of the graphical user interface element is to be moved away from the gap;
Stop displaying the at least a portion of the graphical user interface element on the second display surface;
The electronic device according to (13), further configured as follows.
(16) The electronic device according to (13), wherein a width of the at least part of the graphical user element is substantially equal to a width of the gap.
(17) The electronic device according to (13), wherein a width of the at least part of the graphical user element is smaller than a width of the gap.
(18) The first panel and the second panel are each rotatably coupled to a hinge disposed between the first panel and the second panel. Electronic devices.
(19) The electronic device according to (18), wherein a width of the gap is substantially equal to a width of the hinge.
(20) receiving at the first display surface user input for moving a graphical user interface element displayed on the first display surface of the electronic device further comprising a second display surface separated therefrom by a gap; Means for
The at least a portion of the graphical user interface element should be moved into the gap beyond an edge of the first display surface such that at least a portion of the graphical user interface element is not displayed on the first display surface. Means for determining that,
Means for displaying the at least a portion of the graphical user interface element on the second display surface based on an arrangement and direction of movement of the graphical user interface element on the first display surface;
A device comprising:
(21) The device according to (29), wherein the user input includes a drag operation of the graphical user element on a touch screen on the first display surface.
(22) means for determining that the at least a portion of the graphical user interface element should be moved away from the gap;
Means for stopping the at least a portion of the graphical user interface element from being displayed on the second display surface;
The apparatus according to (20), further comprising:
(23) receiving at the first display surface a user input for moving a graphical user interface element displayed on the first display surface of the electronic device further comprising a second display surface separated therefrom by a gap; And code to do
The at least a portion of the graphical user interface element should be moved into the gap beyond an edge of the first display surface such that at least a portion of the graphical user interface element is not displayed on the first display surface. Code to determine that
Code for displaying the at least a portion of the graphical user interface element on the second display surface based on an arrangement and direction of movement of the graphical user interface element on the first display surface;
A computer readable medium storing computer executable code.
(24) The computer-readable medium according to (23), wherein the user input includes a drag operation of the graphical user element on a touch screen on the first display surface.
(25) code for determining that the at least a portion of the graphical user interface element should be moved away from the gap;
Code for stopping displaying at least a portion of the graphical user interface element on the second display surface;
The computer-readable medium according to (23), further storing computer executable code comprising:

Claims (24)

Receiving at the first display surface user input for moving a graphical user interface element displayed on the first display surface of the electronic device further comprising a second display surface separated therefrom by a gap; ,
The portion of the graphical user interface element should be moved into the gap beyond the edge of the first display surface so that a portion of the graphical user interface element is not displayed on the first display surface. Judging
The position of the portion of the graphical user interface element on the second display surface depends on the speed of movement of the graphical user interface element and the simulated momentum or simulated friction. Displaying the portion of the graphical user interface element on the second display surface based on an arrangement and direction of movement of the graphical user interface element on the first display surface;
A method comprising:   The method of claim 1, wherein the user input includes a drag operation of the graphical user interface element on a touch screen on the first display surface. Determining that the portion of the graphical user interface element should be moved away from the gap;
Stopping displaying the portion of the graphical user interface element on the second display surface;
The method of claim 1, further comprising:   The moving direction of the graphical user interface element includes a lateral moving direction along a plane of the first display surface, a vertical moving direction along the plane of the first display surface, or any combination thereof. The method of claim 1. The method of claim 1, wherein a width of the portion of the graphical user interface element is approximately equal to a width of the gap. The method of claim 1, wherein a width of the portion of the graphical user interface element is less than a width of the gap. The electronic device further includes a third display surface that is separated from the second display surface by a second gap, the method comprising:
It said graphical As the second portion of the user interface element is not visible in the second display surface, wherein the second portion of the graphical user interface elements displayed on the second display surface is the second display Determining that it should be moved into the second gap beyond the edge of the surface;
Displaying the second portion of the graphical user interface element on the third display surface based on a second arrangement and a second direction of movement of the graphical user interface element on the second display surface. When,
The method of claim 1, further comprising: The method of claim 7, wherein a width of the second portion of the graphical user interface element is less than or substantially equal to a width of the second gap.   The method of claim 7, wherein the second direction of movement is the same as the first direction of movement.   The method of claim 1, wherein the graphical user interface element is an application icon.   The method of claim 1, wherein the graphical user interface element includes at least one text character. A first panel having a first display surface;
A second panel having a second display surface separated from the first display surface by a gap, the second panel connecting the first panel and the second panel; ,
Receiving user input at the first display surface for moving a graphical user interface element displayed on the first display surface;
The portion of the graphical user interface element should be moved into the gap beyond the edge of the first display surface so that a portion of the graphical user interface element is not displayed on the first display surface. Judge that
The position of the portion of the graphical user interface element on the second display surface depends on the speed of movement of the graphical user interface element and the simulated momentum or simulated friction. Displaying the portion of the graphical user interface element on the second display surface based on an arrangement and direction of movement of the graphical user interface element on the first display surface;
A processor configured to:
An electronic device comprising:   The electronic device of claim 12, wherein the user input includes a drag operation of the graphical user interface element on a touch screen on the first display surface. The processor is
Determining that the portion of the graphical user interface element should be moved away from the gap;
Stop displaying the portion of the graphical user interface element on the second display surface;
The electronic device of claim 12, further configured as follows. The electronic device of claim 12, wherein a width of the portion of the graphical user interface element is approximately equal to a width of the gap. The electronic device of claim 12, wherein a width of the portion of the graphical user interface element is less than a width of the gap.   The electronic device of claim 12, wherein the first panel and the second panel are each rotatably coupled to a hinge disposed between the first panel and the second panel. .   The electronic device of claim 17, wherein a width of the gap is approximately equal to a width of the hinge. For receiving at the first display surface a user input for moving a graphical user interface element displayed on the first display surface of the electronic device further comprising a second display surface separated therefrom by a gap. Means,
The portion of the graphical user interface element should be moved into the gap beyond the edge of the first display surface so that a portion of the graphical user interface element is not displayed on the first display surface. Means for judging that,
The position of the portion of the graphical user interface element on the second display surface depends on the speed of movement of the graphical user interface element and the simulated momentum or simulated friction. Means for displaying the portion of the graphical user interface element on the second display surface based on an arrangement and direction of movement of the graphical user interface element on the first display surface;
A device comprising:   The apparatus of claim 19, wherein the user input includes a drag operation of the graphical user interface element on a touch screen on the first display surface. Means for determining that the portion of the graphical user interface element should be moved away from the gap;
Means for stopping the portion of the graphical user interface element from being displayed on the second display surface;
20. The apparatus of claim 19, further comprising: For receiving at the first display surface a user input for moving a graphical user interface element displayed on the first display surface of the electronic device further comprising a second display surface separated therefrom by a gap. Code,
The portion of the graphical user interface element should be moved into the gap beyond the edge of the first display surface so that a portion of the graphical user interface element is not displayed on the first display surface. Code to determine that,
The position of the portion of the graphical user interface element on the second display surface depends on the speed of movement of the graphical user interface element and the simulated momentum or simulated friction. Code for displaying the portion of the graphical user interface element on the second display surface based on the placement and direction of movement of the graphical user interface element on the first display surface;
A computer readable medium storing computer executable code.   23. The computer readable medium of claim 22, wherein the user input includes a drag operation of the graphical user interface element on a touch screen on the first display surface. Code for determining that the portion of the graphical user interface element should be moved away from the gap;
Code to stop displaying the portion of the graphical user interface element on the second display surface;
23. The computer readable medium of claim 22, further storing computer executable code comprising:

Images