US20040240650A1 - Real-time communications architecture and methods for use with a personal computer system - Google Patents
Real-time communications architecture and methods for use with a personal computer system Download PDFInfo
- Publication number
- US20040240650A1 US20040240650A1 US10/429,905 US42990503A US2004240650A1 US 20040240650 A1 US20040240650 A1 US 20040240650A1 US 42990503 A US42990503 A US 42990503A US 2004240650 A1 US2004240650 A1 US 2004240650A1
- Authority
- US
- United States
- Prior art keywords
- call
- user
- video
- communications
- computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/57—Arrangements for indicating or recording the number of the calling subscriber at the called subscriber's set
- H04M1/575—Means for retrieving and displaying personal data about calling party
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/60—Substation equipment, e.g. for use by subscribers including speech amplifiers
- H04M1/6033—Substation equipment, e.g. for use by subscribers including speech amplifiers for providing handsfree use or a loudspeaker mode in telephone sets
- H04M1/6041—Portable telephones adapted for handsfree use
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/02—Details of telephonic subscriber devices including a Bluetooth interface
Definitions
- the invention relates generally to communications and computer systems.
- Voice communications include audio over landline telephones such as connected to POTS (plain old telephone service) lines or PBX (private branch exchange) lines, and cellular and satellite telephones, as well as voice over Internet Protocol (VoIP). Audiovisual communications include video tele-conference (VTC), which also may be Internet Protocol-based communication. Text communications include electronic mail, instant messaging, pagers with text messaging, and so forth.
- POTS plain old telephone service
- PBX private branch exchange
- VoIP voice over Internet Protocol
- Audiovisual communications include video tele-conference (VTC), which also may be Internet Protocol-based communication.
- Text communications include electronic mail, instant messaging, pagers with text messaging, and so forth.
- Some contemporary devices provide multiple ways to communicate, e.g., pocket sized personal computers may have a cellular telephone connection to place audio calls, and a wireless internet connection for sending and receiving electronic mail messages and instant messaging communications.
- Some mobile devices e.g., a Smartphone
- Some mobile devices are considered to be more like telephones, but likewise provide Internet access, and may handle text messaging generally.
- the present invention provides a system and method for improved real-time communications leveraging a personal computer and/or other processing resources, in which the boundaries between various devices and communication channels are blurred, as are the boundaries between types of communication, including voice, text and video.
- the channel on which an incoming call is being received, as well as the device on which the call may be answered, are made significantly less important to the user than the fact that a call is coming in from another party.
- Outgoing calls focus on connecting to the called party, rather than any particular device.
- the user When connected, the user may easily move between modalities, including switching devices on which the user is communicating, and transitioning between types of communication. For example, two or more users may connect with voice only communication, and then, with relatively little effort, one or more may move to voice and video.
- One or more users may employ instant messaging (IM) or similar text communication, such as to enhance an existing connection, or to avoid receiving a voice call but still respond in some manner.
- IM instant messaging
- a computer system includes various integrated communications-related devices, such as an attached camera, an attached telephone handset, and an attached speaker and microphone, which may function as a speakerphone.
- Other devices include mobile communications devices such as a cellular telephone or other mobile computing device.
- An auxiliary display device such as for displaying caller ID data is coupled to the computer, but may remain functional when the computer operating system is not running. Buttons related to controlling real-time communications, and indicators related to the state of real-time communications are also provided.
- the present invention provides a real-time communications architecture including a controller comprising software that facilitating communications in general, switches communications to and from appropriate devices, and/or transitions communications among the various communications channels and/or types of communications.
- the real-time communications controller couples the communication devices to voice over IP, video, POTS, PBX, cellular networks and virtually any communications medium.
- the devices may be wired to the computer system to which the real-time communications controller software is running, or may be wireless, e.g., BluetoothTM based devices.
- the user may interact with the real-time communications controller through user interface software of one or more programs, and/or user interface software of the real-time communications controller, but in one implementation, may also do so without running user interface software.
- the real-time communication control buttons are easy to use and understand, and along with the indicators are positioned at locations that intuitively facilitate interaction with the real-time communications controller.
- the user is able to input data via any input mechanism, e.g., any microphone on any device, via any text or pointing-based user data entry mechanism such as the keyboard and/or mouse, and/or the camera.
- the real-time communications controller is able to receive data and output appropriate data to the user on any of the output mechanisms when activated, such as the speaker of a speakerphone, the handset telephone, a headset, the mobile phone or similar computing device, a PBX phone and/or a network card.
- Video, graphical and/or text information can also be displayed on the main display and/or the auxiliary display when available.
- mode control logic in the real-time communications controller follows various real-time communication rules and user-configured settings to handle a users communication needs, and in one implementation, can do so when the computer system is otherwise powered down.
- the mode control logic also appropriately responds to external events, such as incoming calls, pages, text messages, forwarded voicemail messages, and so forth.
- User actions may comprise lifting or replacing the attached handset, typing and pointing-and-clicking a mouse or the like into a user interface, pressing phone controls buttons, issuing voice commands, and so forth.
- the real-time communications controller also follows various real-time communication rules and user-configured settings to handle incoming calls in a manner that matches a users communication needs. For example, for an incoming call, the mode control logic will display the caller ID information, sound a ring or call waiting tone on the speaker as appropriate, and respond to a user action such as selection of a device to answer the call by routing the voice, text and/or video as appropriate. Any other audio may be automatically muted until no calls remain.
- the present invention allows a user to switch devices, transition between communication channels, and transition between types of calls.
- a user can answer a cellular phone call via the headset, handset or speakerphone, add video to a call when available, switch a POTS call to a cell-phone carrier, and vice-versa.
- Improved caller ID navigation is also provided, in which a user can switch among parties on hold, and also conference in multiple parties, in a non-linear manner.
- a user can use any active display device such as the auxiliary display to perform such operations.
- FIG. 1 is a block diagram generally representing a computer system into which the present invention may be incorporated;
- FIG. 2 is a general representation of a computer system arranged with communications-related mechanism in accordance with an aspect of the present invention
- FIG. 3 is a block diagram generally representing the central control of communication devices and connections to communications channels, in accordance with an aspect of the present invention
- FIG. 4 is a block diagram generally representing components to couple various devices and control and display connection state in accordance with an aspect of the present invention
- FIG. 5 is a state diagram generally representing a dialer object and related operation in accordance with an aspect of the present invention
- FIG. 6 is a state diagram generally representing a ringer object and related operation in accordance with an aspect of the present invention
- FIG. 7 is a state diagram generally representing a line device object and related operation in accordance with an aspect of the present invention.
- FIG. 8 is a state diagram generally representing a phone device object and related operation in accordance with an aspect of the present invention.
- FIG. 9 is a general state diagram representing states of operation when making a call, receiving a call, and when a call is waiting, in accordance with an aspect of the present invention
- FIGS. 10-12 comprise a state diagram representing the transitions between instant messaging, voice and video states in accordance with an aspect of the present invention
- FIGS. 13-15 are representations of an example display which allows non-linear selection of calls displayed based on caller ID information.
- FIGS. 16 and 17 are representations of an example display which allows non-linear conferencing of calls displayed based on caller ID information.
- FIG. 1 illustrates an example of a suitable computing system environment 100 on which the invention may be implemented.
- the computing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing environment 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment 100 .
- the invention is operational with numerous other general purpose or special purpose computing system environments or configurations.
- Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to: personal computers, server computers, hand-held or laptop devices, tablet devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
- the invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer.
- program modules include routines, programs, objects, components, data structures, and so forth, which perform particular tasks or implement particular abstract data types.
- the invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network.
- program modules may be located in local and/or remote computer storage media including memory storage devices.
- an exemplary system for implementing the invention includes a general purpose computing device in the form of a computer 110 .
- Components of the computer 110 may include, but are not limited to, a processing unit 120 , a system memory 130 , and a system bus 121 that couples various system components including the system memory to the processing unit 120 .
- the system bus 121 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures.
- such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus.
- ISA Industry Standard Architecture
- MCA Micro Channel Architecture
- EISA Enhanced ISA
- VESA Video Electronics Standards Association
- PCI Peripheral Component Interconnect
- the computer 110 typically includes a variety of computer-readable media.
- Computer-readable media can be any available media that can be accessed by the computer 110 and includes both volatile and nonvolatile media, and removable and non-removable media.
- Computer-readable media may comprise computer storage media and communication media.
- Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data.
- Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by the computer 110 .
- Communication media typically embodies computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
- modulated data signal means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.
- communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer-readable media.
- the system memory 130 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random access memory (RAM) 132 .
- ROM read only memory
- RAM random access memory
- BIOS basic input/output system
- RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120 .
- FIG. 1 illustrates operating system 134 , application programs 135 , other program modules 136 and program data 137 .
- the computer 110 may also include other removable/non-removable, volatile/nonvolatile computer storage media.
- FIG. 1 illustrates a hard disk drive 141 that reads from or writes to non-removable, nonvolatile magnetic media, a magnetic disk drive 151 that reads from or writes to a removable, nonvolatile magnetic disk 152 , and an optical disk drive 155 that reads from or writes to a removable, nonvolatile optical disk 156 such as a CD ROM or other optical media.
- removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like.
- the hard disk drive 141 is typically connected to the system bus 121 through a non-removable memory interface such as interface 140
- magnetic disk drive 151 and optical disk drive 155 are typically connected to the system bus 121 by a removable memory interface, such as interface 150 .
- the drives and their associated computer storage media provide storage of computer-readable instructions, data structures, program modules and other data for the computer 110 .
- hard disk drive 141 is illustrated as storing operating system 144 , application programs 145 , other program modules 146 and program data 147 .
- operating system 144 application programs 145 , other program modules 146 and program data 147 .
- these components can either be the same as or different from operating system 134 , application programs 135 , other program modules 136 , and program data 137 .
- Operating system 144 , application programs 145 , other program modules 146 , and program data 147 are given different numbers herein to illustrate that, at a minimum, they are different copies.
- a user may enter commands and information into the computer 110 through input devices such as a tablet, or electronic digitizer, 164 , a microphone 163 , a keyboard 162 and pointing device 161 , commonly referred to as mouse, trackball or touch pad.
- Other input devices not shown in FIG. 1 may include a joystick, game pad, satellite dish, scanner, or the like.
- These and other input devices are often connected to the processing unit 120 through a user input interface 160 that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB).
- a monitor 191 or other type of display device is also connected to the system bus 121 via an interface, such as a video interface 190 .
- the monitor 191 may also be integrated with a touch-screen panel or the like. Note that the monitor and/or touch screen panel can be physically coupled to a housing in which the computing device 110 is incorporated, such as in a tablet-type personal computer. In addition, computers such as the computing device 110 may also include other peripheral output devices such as speakers 195 and printer 196 , which may be connected through an output peripheral interface 194 or the like.
- the computer 110 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 180 .
- the remote computer 180 may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 110 , although only a memory storage device 181 has been illustrated in FIG. 1.
- the logical connections depicted in FIG. 1 include a local area network (LAN) 171 and a wide area network (WAN) 173 , but may also include other networks.
- LAN local area network
- WAN wide area network
- Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.
- the computer system 110 may comprise source machine from which data is being migrated, and the remote computer 180 may comprise the destination machine.
- source and destination machines need not be connected by a network or any other means, but instead, data may be migrated via any media capable of being written by the source platform and read by the destination platform or platforms.
- the computer 110 When used in a LAN networking environment, the computer 110 is connected to the LAN 171 through a network interface or adapter 170 .
- the computer 110 When used in a WAN networking environment, the computer 110 typically includes a modem 172 or other means for establishing communications over the WAN 173 , such as the Internet.
- the modem 172 which may be internal or external, may be connected to the system bus 121 via the user input interface 160 or other appropriate mechanism.
- program modules depicted relative to the computer 110 may be stored in the remote memory storage device.
- FIG. 1 illustrates remote application programs 185 as residing on memory device 181 . It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.
- the present invention is generally directed towards blurring various communications modalities, such that a user communicates with one or more other users typically without having to deal with the connection channel or any particular device considerations. For example, audio, video and text communications will be initiated by the user using any suitable device that the user has available and wants to use, regardless of the channel (or channels) on which the communication ultimately occurs. Similarly, received communications can be handled by any appropriate device that the user selects. As will be understood, the various channels, devices and scenarios described herein are only examples, and there are many others to which the present invention will apply.
- FIG. 2 of the drawings there is shown a computer system, such as the computer system 110 of FIG. 1, in which various communications-related devices are integrated.
- the computer system 110 includes a monitor 191 having an attached camera 202 , an attached telephone (e.g., handset) 204 , and an attached speaker 206 , which along with a microphone 208 , may function as a speakerphone.
- Other devices not separately represented in FIG. 2 include mobile communications devices such as a cellular telephone or other mobile computing device capable of connecting in some way (e.g., by wired cradle or BluetoothTM technology) with the computer system.
- mobile communications devices such as a cellular telephone or other mobile computing device capable of connecting in some way (e.g., by wired cradle or BluetoothTM technology) with the computer system.
- any or all of these devices may be combined into a unitary assembly, or built into other devices, such as the monitor 191 .
- each of these devices may be present and if so are connected directly or indirectly by a wired or wireless connection to interfaces at the main PC housing 214 (containing at least the motherboard, but also typically containing some non-volatile storage).
- auxiliary display device 220 such as for displaying caller ID data or like information as described below.
- the auxiliary display 220 is typically small (relative to the main display screen 191 ), and may be the display of another device, such as the screen of a mobile computing device, but may also be a dedicated display, such as one that is operably connected or coupled to the computer operating system when the computer system 110 is in a powered-up state.
- the auxiliary display may comprise a simple text display, such as a two-line display or the like.
- the auxiliary display need not be an actual display, but can be a projection (e.g., onto a wall) of the information.
- the auxiliary display device 220 may provide some of its own processing and storage resources, so as to remain functional to some extent when the computer operating system is not running.
- the auxiliary display device 220 includes control buttons or the like thereon for interacting with that display 220 , and possibly with the computer system 110 in general, as described below.
- the keyboard 162 and/or monitor 191 (and/or possibly the pointing device 161 ) may also include non-conventional buttons 222 , such as buttons related to controlling real-time communications, and non-conventional LED indicators 224 , such as indicators related to the state of real-time communications.
- the computer system 110 includes, a real-time communications controller 300 , primarily implemented in a software component or set of software components, that intelligently handles various aspects of a user's real-time communication needs, including facilitating communications in general, switching communications to and from appropriate devices, and/or transitioning communications among the various communications channels and/or types of communication.
- the real-time communications controller 300 need not be built into the computer system 110 , but can connect thereto as an add-on device, such as via a USB connection.
- the real-time communications controller 300 allows a user to connect to various communication channels (e.g., a telephone company switching network, a mobile phone network, the internet or an intranet, and virtually any other local area or wide area network over which communication is possible) using the various communications-related data input/output devices.
- the user is able to input data via any input mechanism, e.g., any microphone on any device, via any text or pointing-based user data entry mechanism 302 such as the keyboard and/or mouse, and/or the camera 202 , and have that data configured as appropriate (e.g., converted from speech to text) and sent to an appropriate (one or possibly more) of the available communication channels.
- the real-time communications controller 300 is able to receive data and output appropriate data to the user on any one or more of the output mechanisms, such as the speaker of a speakerphone 304 when the user has selected that device, the handset telephone 204 when lifted, a headset 306 if activated, the mobile phone or similar computing device 308 if selected, a PBX phone 310 connected to a PBX mechanism 312 and/or a network card 314 .
- the output mechanisms such as the speaker of a speakerphone 304 when the user has selected that device, the handset telephone 204 when lifted, a headset 306 if activated, the mobile phone or similar computing device 308 if selected, a PBX phone 310 connected to a PBX mechanism 312 and/or a network card 314 .
- video, graphical and/or text information is available, data can also be displayed on the main display 191 (if active), and/or the auxiliary display 220 . Note that some of the devices are represented in FIG.
- any device may be wired or wireless, e.g., a typical mobile computing device or mobile telephone may be cradled and thus “wired” to the computer, and/or may integrate a cellular phone, Wireless Ethernet (also known as 802.11b or Wi-Fi), and/or BluetoothTM wireless technology.
- any “connection” referred to herein and the like should be considered equivalent to a “coupling,” whether directly or indirectly connected through any type of intermediary.
- the real-time communications controller 300 controls the communication modes for the user, thereby removing much of the user's need to deal with device and connection considerations. As generally represented in FIG. 4, this is accomplished by responding to the user's actions, via mode control logic 400 in the real-time communications controller 300 that follows various real-time communication rules 402 and/or is based at least in part on other user-configurable settings and a current operating state 404 .
- the mode control logic 400 likewise responds to external events, such as incoming calls, pages, text messages, forwarded voicemail messages, and so forth.
- User actions can occur and be detected in any number of ways, and the present invention contemplates essentially any way of providing user action data or intended action data to a computer system.
- such actions can include lifting or replacing the attached handset, which correspondingly actuates a hook switch 408 that is connected to the real-time communications controller 300 , and thus can be detected as state data.
- Phone controls 410 such as in the form of buttons on a device such as a talk button or buttons on the keyboard or monitor, (e.g., a speakerphone button, a flash button, and so on) can similarly provide user action information, as can a PBX telephone 310 or other computing device/telephone 308 (FIG. 3) connected to the computer system.
- Controls 420 accompanying the auxiliary display 220 can also provide user action data, as can the computer data entry mechanisms 302 such as a keyboard and mouse.
- Any microphone such as the microphone 208 , can also provide user action data, e.g., via speech recognition (command and control) performed with a speech to text recognizer 430 .
- Text may also be converted to speech by an appropriate converter 432 , such as when the user enters text to leave a message, but instead actually leaves a voice message on a called device, e.g., when the logic 400 detects that forwarding text would not be appropriate.
- User action information may also be communicated by wireless radio 434 , and/or from a network connection or other communication channel. Motion and/or proximity sensing can likewise serve as a user action sensor.
- a graphical user interface component 440 shown as part of the mode control logic 400 may facilitate entry of the user action information.
- the user may interact with one of the displays to select a displayed telephone number for connecting or reconnecting with a person or device at that number.
- the present invention similarly outputs information to the user in any feasible manner, including via the user interface when appropriate.
- anything capable of outputting something that can be sensed by a user can serve as an output mechanism, including the displays 191 and/or 220 , lights and other indicators 224 , the speaker 206 or other audio generating device such as a ringer on a cell phone, and other mechanisms such as one that provides tactile feedback (e.g., a vibrating cell phone).
- the term “display” is only an example, and is not limited to visible information, but can include any sensed output.
- a hook indicator in the form of an LED may be configured to flash red to indicate an incoming call, be lit green when off hook, blink amber when the call is on hold, and blink on-and-off when a call is muted.
- a tone and pattern can “display” the same information audibly.
- the related hook switch 408 , controls 410 , 420 , displays 191 and 220 and indicators 224 provide additional value that is consistent with but go beyond a user's past communications experiences.
- the various controls and indicators are generally placed in proximity to the functions that they control and represent.
- the various devices such as handsets, headsets, and speakerphones are already familiar to users, and the physical interfaces for these devices are largely equivalent to conventional devices.
- the present invention allows for various levels of computing skill.
- the various control buttons 410 , 420 and the hook switch 408 that are provided allow the user to take advantage of much of the real-time communications controller's functionality without ever having to operate the graphical user interface software 440 .
- a user can also connect via the user interface 440 , e.g., to automatically dial calls, answer via a mouse click, customize settings and preferences and so forth.
- the logic 400 receives user action data or remotely communicated data (such as an incoming call), and based on various real-time communications rules 402 and user configurable settings 404 , responds in a proper manner. For example, as described below, for an incoming call, the mode control logic 400 will display the caller ID information on the auxiliary display 220 , or possibly the main display 191 if so configured by the user, sound a ring or call waiting tone on the speaker 206 , and wait for a user action. If the user presses a phone control button such as a speakerphone button, the call will be connected to the appropriate device, e.g., routed to the speaker 206 and microphone 208 . Any other audio, such as music that the user was listening to, may be automatically muted until the call is complete, e.g., until the user again presses the speakerphone button to disconnect.
- a phone control button such as a speakerphone button
- the present invention thus automatically and transparently responds in an appropriate manner to a user's needs.
- a user who is working at the computer when a call comes in. Instead of figuring out what type of call it is, finding the device necessary to (possibly) answer it, and so on, the user merely glances at the auxiliary display, decides whether to take the call, and if so, selects any appropriate device to answer.
- the real-time communications controller 300 is the center of communication, a call to any of the user's landline telephone devices or any (smart) cellular telephone will relay the caller ID data to the real-time communications controller 300 , which will display that caller ID data displayed on the same auxiliary display 220 as any other call.
- the user can answer any incoming call on the speakerphone 304 , the handset 204 , the headset 306 , the cellular telephone or mobile computing device 308 and so on.
- the user need not even know whether a given call came in on a given communications channel, such as the cellular channel instead of a POTS channel or network channel, although for reasons such as cost of airtime, the user may want to know this information.
- a given communications channel such as the cellular channel instead of a POTS channel or network channel, although for reasons such as cost of airtime, the user may want to know this information.
- the user is provided access to a universal address book, call log, and inbox.
- the present invention allows a user to transition between communication channels.
- a user who receives a POTS telephone call can answer talk for awhile, and switch that call over to a mobile phone to continue the conversation away from the computer system.
- this is not conventional call forwarding set up in advance for switching at the central switching office or the like, but rather on-demand transitioning during a telephone call.
- rules 402 can be set up to favor landline over cellular for local calls since there is no airtime charge, however long distance may be favored over cellular when there is no additional charge and the user is likely to have unused airtime before the next billing cycle.
- Voice over IP may be the most favored, but may not be available when the computer system is powered down.
- One simple way to accomplish transitioning live connections is via a different telephone line relative to the source of the call. For example, if a user is leaving his or her office, the real-time communications controller 300 can transparently (or mostly transparently) establish a cellular connection to the user's mobile telephone device on that other line and connect the other caller to that mobile telephone device through the real-time communications controller 300 . Voice over IP can similarly be used.
- Three-way and conference calling capabilities can also be leveraged, e.g., a user can walk into his or her office while connected to another person via a cell phone, the real-time communications controller 400 can establish another call to the other party via a POTS, PBX or voice over IP call, and when connected, terminate the cellular phone call.
- the present invention can switch and/or transition among types of communication. For example, a user can respond to a telephone call with an instant message, either automatically or by typing/speech recognition, e.g., to notify the caller that the call was received but could not be answered at that moment.
- the real-time communications controller 300 can adjust the instant message as appropriate, e.g., convert a text message to speech to leave a voice message when the call was known to be from a mobile phone that does not handle text, or when the user is known to be traveling.
- the instant message does not have to be sent to the same device that called the user, e.g., a user can respond to a received phone call from a conventional telephone with an instant message to the caller's computer system.
- a simple database lookup or the like by the mode control logic can provide the recipient's address from the caller ID data so that the user does not even have to enter this information.
- the present invention can start with an audio call and add video (one-way or two-way) and/or instant messaging as desired by the parties, or start with an instant message and add audio and/or video.
- video one-way or two-way
- instant messaging as desired by the parties
- a user can press a camera button, or select video via a mouse click, to establish a video connection and start transmitting video.
- a video call can similarly be transitioned to a non-video (e.g., audio-only) call.
- the present invention facilitates switching and/or transitioning between any modes of communication. Transitioning between text, voice and video states is described below with reference to FIGS. 10-12.
- the computer system need not be fully operational for communications to work in accordance with the present invention. Indeed, communications should still work when the computer is powered down, at least to a default extent or to an extent configured by a user, such as when the computer system is in a sleep state or a hibernate mode, and/or when the user is locked out of the system via security mechanisms.
- the type and extent of communications may be configured by the user. For example, the user may want the telephone handset, speakerphone and caller-ID device to work as conventional appliances when the computer system is powered down, but not the camera, headset, or network card.
- the user may limit the extent of the communications based on the computer system state, e.g., when the user is not logged in, the real-time communications controller 300 may be set to block long distance calls, block calls to a certain prefix, and so forth.
- the real-time communications controller 300 may be loaded into executable non-volatile memory, operated with a secondary processor, and so forth, so that communications works as long as some power is available, even though the disk, main processor, main display, network card and/or other parts of the system are powered down.
- FIGS. 5-8 represent general logic and rules in the form of state diagrams for various objects that control behavior of the various mechanisms.
- FIG. 5 shows the logic and rules for connecting a call when initiating the call via a dialer object or the like.
- the user when starting in an idle state 500 , the user will send a dial request to line device (FIG. 7).
- a dialer program may be automatically displayed on the graphical user interface (GUI) on the main display 191 , from which the user may enter a state where the user can select a person to call or close the dialer, or the user may dial (or hang-up) in a conventional fashion.
- GUI graphical user interface
- a user may also be able to scroll through and select a number on the auxiliary display 220 , such as to call a number from a list of calls logged via caller ID information, speak a name or number into a microphone, press a speed dial button and so on. If dialed in any manner, the logic will attempt to connect the call, and if successful, the system will end up in a connected state 504 until terminated.
- FIG. 5 also shows that a call answered (in any manner) when in the idle state 500 goes directly to the connected state 504 . More particularly, a pick-up request is sent to the line device (FIG. 7). If no receiver is active/off hook, a default (which may be user-configurable) receiver is selected as the active receiver, and the audio stream is sent to that active receiver. The call event may be logged in the system.
- connection When connected, if the connection supports video and a video camera is present and its use is allowed, video is streamed.
- a user may disallow video by closing the camera's shutter, or by configuring the system to not automatically allow video, that is, only allow video if some manual user action is detected.
- the user can see when an incoming call supports video and can answer the call immediately in that mode, such as by pressing a camera button.
- the user can set a preference so that the camera is automatically enabled whenever answering a call that supports video.
- connection supports text or rich ink messaging
- an embedded instant messenger (IM) chat control is also enabled.
- an indicator serves as a “connection” light, i.e., to indicate when a communication link is established between two users, then the indicator may also indicate when an IM connection is active, such as by a different LED behavior (e.g., color and/or flash pattern) with respect to a voice-only call, to communicate to the user that an IM connection exists.
- LED behavior e.g., color and/or flash pattern
- FIG. 6 shows other operation of the logic 400 , such as with respect to an object that controls a ringer or other suitable notification mechanism when an incoming call is received.
- a ringer idle state 600 (which means idle with respect to notifying a user of a new incoming call, and may include a state in which a user is already on a current call)
- the logic 400 will look up and display the new caller information and enter a waiting state 602 .
- the waiting call may be displayed via a side bar notification fly-out if the main display is on, and/or may be displayed on the auxiliary display device.
- the logic 400 also may sound an audible alert (and/or providing another suitable notification, such as flashing an LED and/or vibrating a device).
- the type of alert may depend on whether the user is on another call or on other state information, e.g., if in a Do Not Disturb mode, no sound is played, else if no receiver is active, a ringing sound is played, otherwise a receiver call waiting tone is played.
- the ringer leaves the waiting state 602 when the call is connected, after placing any current call on hold.
- a conference button or the like (not shown) can add the caller to an existing call. If no action is taken to connect the call, a voice mail time out will send the call to voice mail and return the ringer to the idle state with respect to further incoming calls.
- FIG. 7 shows the operation of the line device object in an idle state 700 , a waiting state 702 , a connecting state 704 and a connected state 706 .
- these states have been previously described above in slightly different context, and will thus not be repeated herein except to note that while attempting to establish a connection as represented by state 704 , a connecting status or the like may be displayed by the line device object, during which time the user can cancel the attempt.
- a hold request can transition the user from the connected state 706 to a waiting state 702 by placing the line on hold, while a pick-up request works in the opposite way, by connecting the line.
- multimedia playback may be turned off or muted while any receiver is active, and restored when no receiver is active.
- FIG. 8 represents the operation of a phone device object in an idle state 800 , and in two off hook states, a normal state 802 and a muted state 804 .
- the transitions between the states are readily apparent in FIG. 8, although it should be noted that as described above, another receiver can be set as the active receiver without disconnecting the line. For example, selecting a speakerphone logically hangs-up an active handset or headset, picking up the handset turns off the speakerphone or headset, pressing a talk button on the headset turns off the speakerphone or handset, and so forth.
- FIG. 9 represents a general overview of the logic 400 that summarizes various states of operation.
- the hook switch operates in a number of ways, including using it to terminate a call, lifting it to make a receiver active and pick up waiting line, as a flash button to switch lines or terminate a call if no lines are waiting.
- the hook switch may be implemented as a cradle hook switch mechanically integrated into the handset cradle, comprising a two-position toggle switch that closes when the handset is off hook and opens when the handset is in the cradle.
- lifting the handset from the cradle usually takes the handset off hook and displays a dialog box for selecting the person to call.
- replacing the handset in the cradle will hang up the call.
- lifting the handset from the cradle will make the handset the active receiver, switching off the old active receiver (e.g., the speakerphone or headset).
- the phone is ringing from an incoming call, lifting the handset will answer the call, taking the handset off hook. If the phone is ringing while another phone conversation is already in progress, depressing the cradle hook switch quickly will toggle between the two calls, like flashing the hook switch will do with call waiting present on a legacy phone system.
- a talk button usually integrated into the keypad of telephone devices, such as a headset or handset, performs similar functionality to the hook switch and can generally be considered similar to the hook switch operation in FIG. 9.
- a talk button or cradle hook switch (or at least a graphical user interface equivalent) is required for each phone handset or headset.
- the talk button comprises a single-throw, momentary switch that toggles the hook state for a telephone receiver. Its primary function is to initiate or answer a call, and then hang up when the conversation is finished. During a call, pressing a talk button on the active receiver will hang up the call. Pressing the talk button on another receiver will have the effect of making it the active receiver, switching off the old active receiver (handset or headset).
- pressing the talk button will answer the call, taking the receiver off hook. If the phone is ringing while another phone conversation is already in progress, pressing the talk button will toggle between the two calls.
- FIG. 9 also shows various operations via a speakerphone button similarly comprising a single-throw, momentary switch to toggle the hook state for a speakerphone. Its primary function is to initiate or answer a call, and then hang up when the conversation is finished.
- the speakerphone button is a special case of the talk button, used where the incoming call is broadcast over a speaker and audio is collected via a far field microphone. In a cordless handset with speaker phone capabilities, it may be important to indicate to the user that the speakerphone is active to differentiate it from the handset talk switch.
- a speakerphone button may be located on the keyboard, e.g., to the left of the main keyboard keys. This button usually takes the PC speakerphone off hook and displays a dialog box for selecting the person to call. During a call, pressing the speakerphone button when the speakerphone is the active receiver will hang up the call. If the speakerphone is not the active receiver, this will have the effect of making it the active receiver, switching off the old active receiver. When the phone is ringing from an incoming call, pressing the speakerphone button will answer the call, taking the speakerphone off hook. If the phone is ringing while another phone conversation is already in progress, pressing the speaker phone button will toggle between the two calls like flashing the hook switch.
- a hook indicator may be used in conjunction with a talk or speakerphone button, and, for example, may be located adjacent or integrated into the talk button or speakerphone button.
- the hook indicator may indicate state via various colors and flash patterns, e.g., steady state unlit when the receiver is on hook, steady state green when the receiver is off hook, or steady state red when no service is available.
- a flashing indicator such as with a “wink” duty cycle can overlay the steady state, e.g., a red wink overlay can indicate call waiting, or an amber flash overlay can indicate a call holding.
- the call waiting overlay indicator will continue to blink as long as the user can pick up the phone to connect to the incoming caller, even if the call is no longer ringing. This allows call screening when callers are recording voice mail.
- the call holding overlay is generally only needed when a dedicated hold indicator is not present.
- buttons may be provided.
- a flash button often used for alternate line selection, generates a momentary on hook condition for signaling purposes.
- pressing the flash button will place the current call on hold and answer the incoming call.
- pressing the flash button places the current call on hold and picks up the next call in the hold queue.
- a hold button places a current call on hold by placing the current call into a call waiting state as generally represented in FIG. 7, freeing the receiver to make another call, answer an incoming call, or hang up to pick up on another receiver.
- a conference button initiates a conference call, in which pressing the conference button joins the current call with one or more calls waiting on hold.
- buttons are feasible, such as a button to immediately send an incoming call to voice mail.
- conference calls can also be handled via the graphical user interface 440 , e.g., additional contacts or groups of contacts can be clicked and dragged to a window to conference in others.
- FIG. 9 also represents a number of user interaction scenarios with respect to real-time communications, including handling an incoming call and making a call.
- the user to make a phone call, the user lifts the handset or presses the talk switch on the speakerphone or headset, and then dials a number.
- the user may select a contact from the display 220 or graphical user interface 440 , or employ voice dialing.
- the user can initiate a phone call from any standard contact object supported by an API.
- the operating system takes the default receiver off hook and makes the connection using a preferred or specified telecommunications service.
- the user To answer a phone call, the user lifts the handset, presses a speakerphone switch, or presses a talk switch headset (or on the speakerphone). Before answering, the user has the ability to view caller ID, and possibly other pertinent contact information displayed with the notification message (on the main display or auxiliary display), allowing the user to pre-screen the call. Depending on preferences, the user can then choose to pick up the call or transfer it to voice mail, which may include transferring it to one of a plurality of custom or standard voice mail messages. While the caller is recording voice mail, the user can monitor the incoming recording and pick up the receiver, similar to a traditional answering machine.
- the examples below provide additional interaction detail for common telephony functions, including an incoming call scenario, wherein the real-time communications controller sounds the ringer and blinks the talk button indicator, while using caller ID information to display contact information.
- the real-time communications controller 300 may light an indicator for the active receiver.
- the user receives the call, and can switch among devices, e.g., to switch to the speakerphone, the user presses the talk button or mic button; to switch to the video speakerphone, the user presses the camera button; to switch to the handset, the user picks it up (activating the hook switch); or to switch to the headset, the user presses the hook (talk) switch on the headset.
- a cell phone or mobile computing device may be similarly used, even without actually switching the call to the cellular network (which may require some additional user action).
- the system disables the previous receiver to prevent feedback, and updates indicators to reflect the active receiver.
- the real-time communications controller blinks the camera indicator. If the user presses the blinking camera button, or automatic video is set by user preference to automatically stream video when video is available, the system opens the video monitor, lights the camera indicator, and starts streaming video.
- the user can take an appropriate action. For example, to mute video and audio, the user presses the camera button, whereby the real-time communications controller blinks the audio and video indicators until the camera button is pressed again or the call is terminated. To mute video only, the user shuts the camera's privacy shutter, whereby the system un-lights the video indicators and closes the A/V monitor, but maintains the audio indicator. To mute speakerphone audio, the user presses the microphone (speakerphone) button, whereby the real-time communications controller blinks an appropriate indicator until the button is pressed again or the call is terminated. To hang up, the user presses the hook switch for the active receiver.
- the real-time communications controller 300 reacts when the user presses the talk button, picks up the handset, or presses the hook switch on headset, by displaying a dialog box for selecting the person to call.
- the system may also audibly ask through the active receiver, such as when voice dialing is enabled, as to who the user would like to call.
- the real-time communications controller uses resulting input to select a contact from the dialog box, and the user can query to search and can re-query to refine the search, if necessary.
- the real-time communications controller shows contact information for the selected recipient and shows a status dialog box while the call is connecting.
- the user can switch devices as described above, and also switch modes, e.g., audio to video, and so forth, with the indicators operating in the above-described manner.
- the user can also perform other communications-related tasks, including checking voice mail and call screening.
- an indicator light may blink to indicate a voice mail, whereby the user can user press a notification button causing the real-time communications controller to enter a callback routine for the highest priority notification.
- this may open the user's unified In Box.
- Call screening logic follows various rules, including showing caller ID information and contact summary data until, after a preset number of rings, the system stops the ringer and sends a voice mail message to an incoming caller. If the call screening option is enabled, the system echoes the incoming message to a system audio output device (usually the speaker). If the user presses the hook switch of any receiver, the system discards the message and switches to real-time voice, otherwise, when the user hangs up or after a certain time limit, the system stops blinking the talk button indicator and files a voice message.
- FIG. 10-12 generally show the relationships between instant messaging, and/or voice communication states, with various incoming and/or outgoing video states, and the various channel switching transitions between these states.
- instant messaging is used as an example in FIG. 10, any other type of real-time text messaging is equivalent, including text messages sent to pagers, and possibly electronic mail if relatively fast enough to be considered real-time.
- One state represented in FIG. 10 is a no call state 1000 than can transition to various voice and/or instant messaging states.
- the connected states can have automatic video active, or video can be added (or ended) at any time by either party.
- FIG. 10 represents the instant messaging states without voice, including a state with no video 1002 , and states with incoming, outgoing and two-way video, states 1004 , 1006 and 1008 , respectively.
- each user controls these states by user actions or configured preferences for automatic video operation. Note that voice can be added from these states, in which event a new state will be entered as represented in FIG. 12.
- FIG. 11 represents the voice without instant messaging states, with similar video-related states of voice only, incoming, outgoing and two-way video, states 1004 , 1006 and 1008 , respectively. Note that instant messaging can be added from these voice states, in which event a new state will be entered as represented in FIG. 12.
- FIG. 12 represents the states and transitions when both instant messaging and voice are active, with transitions within the same four possible video-related states of none, incoming, outgoing and two-way video available.
- the communication may transition to a no instant messaging state (FIG. 11) or no voice state (FIG. 10), or no communication at all at state 1000 of FIG. 10, based on straightforward actions of the users who are communicating.
- a caller ID navigation mechanism that allows users to navigate a stack of calls in a non-linear manner.
- the available calls may be displayed on the auxiliary display device 220 , with the currently connected call 1302 indicated in some manner to differentiate it from the calls on hold.
- richer information may be provided depending on the amount of display area available, such as the length of time the user was on hold, the type of connections that are available and its current state (voice, video, instant message) and so forth.
- the user presses the scroll buttons 1304 and 1306 to navigate to a call, such as represented by the dashed box 1410 in FIG. 14, and presses a select button 1308 to switch to the call, as represented by the connected box 1502 moving relative to its position in FIG. 13.
- the switching may be non-linear.
- the scroll buttons are typically near or part of the auxiliary display unit because the user will be looking at the display, however the select button 1308 may be another button located elsewhere, such as a flash button on the keyboard, (as long as that button remains active while the computer system is otherwise in a powered off state).
- the user need not scroll, but can instead simply select a call to switch two via a point and click operation.
- the user can also scroll, such as via keyboard cursor keys to highlight, and the Enter key to select. Again, richer information may be provided, particularly since the main display 191 will provide more display area relative to the auxiliary display 220 .
- FIGS. 16 and 17 which shows a richer set of information
- conferencing by selecting users is also feasible.
- holding the select button while on a connected call, and then scrolling through the list view can keep any existing connections connected, and releasing the select button can add (or drop if already selected) another user.
- more elaborate schemes are available, e.g., to drag and drop other parties into a “connected” window, right click on a list view similar to that shown in FIGS. 16 and 17, and so forth.
- a real-time communications method and system for handling the switching and transitioning between communications modalities including switching devices, switching communication channels and/or transitioning types of communications, e.g., audio, video and text.
- the present invention facilitates user communication by blurring the distinction between these various modalities, allowing the user to focus on the communication rather than the mechanisms for accomplishing the communication.
- the method and system thus provide significant advantages and benefits needed in contemporary computing and communications.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
- The present invention is related to the following copending U.S. patent applications filed concurrently herewith, assigned to the assignee of the present invention, and hereby incorporated by reference in their entireties:
- “Method and System for Auxiliary Display of Information for a Computing Device,” Attorney Docket No. 3810;
- “Record Button on a Computer System,” Attorney Docket No. 3830;
- “Method and System for Auxiliary Processing Of Information for a Computing Device,” Attorney Docket No. 3840;
- “System and Method for Activating a Computer System;” Attorney Docket No. 3850;
- “Computer System with Do Not Disturb System and Method,” Attorney Docket No. 3860;
- “Computer Camera System and Method for Reducing Parallax,” Attorney Docket No. 3870;
- “Control and Communications Panel for a Computer System,” Attorney Docket No. 3880; and
- “Notification Lights, Locations and Rules for a Computer System,” Attorney Docket No. 3900.
- The invention relates generally to communications and computer systems.
- People communicate in many ways over many types of devices and channels, including by voice, by audio/video, and by text or the like. Voice communications include audio over landline telephones such as connected to POTS (plain old telephone service) lines or PBX (private branch exchange) lines, and cellular and satellite telephones, as well as voice over Internet Protocol (VoIP). Audiovisual communications include video tele-conference (VTC), which also may be Internet Protocol-based communication. Text communications include electronic mail, instant messaging, pagers with text messaging, and so forth.
- Some contemporary devices provide multiple ways to communicate, e.g., pocket sized personal computers may have a cellular telephone connection to place audio calls, and a wireless internet connection for sending and receiving electronic mail messages and instant messaging communications. Some mobile devices (e.g., a Smartphone) are considered to be more like telephones, but likewise provide Internet access, and may handle text messaging generally.
- While all of these technologies are fairly easy to use, from the user's perspective there is still a substantial emphasis on the communication channels and protocols, and the devices themselves, rather than on what is really important to the user, which is communicating with someone else over an available device. For example, a user who needs to talk to someone else may need to consider many factors before selecting a device and attempting to call the other person, such as whether to use a landline phone or a mobile telephone, e.g., because the call may take a long time, part of which could be spent while traveling. Other factors that a user may consider include the other device that the caller should be calling (whether to call the recipient's landline telephone or mobile telephone), the cost of the call, whether the call should be a video call, and so forth. Each of the devices in turn has its own idiosyncrasies, such as a custom user interface, a different set of stored numbers from those stored in other devices, and so forth.
- What is needed is an automated architecture (system) and related methods for hiding much of the device and connection considerations from users, and replacing those considerations with a model that focuses on the user's real time communication with one or more other users. The method and system should be flexible and extensible to handle many user scenarios and usage patterns, yet straightforward for users to implement.
- Briefly, the present invention provides a system and method for improved real-time communications leveraging a personal computer and/or other processing resources, in which the boundaries between various devices and communication channels are blurred, as are the boundaries between types of communication, including voice, text and video. The channel on which an incoming call is being received, as well as the device on which the call may be answered, are made significantly less important to the user than the fact that a call is coming in from another party. Outgoing calls focus on connecting to the called party, rather than any particular device.
- When connected, the user may easily move between modalities, including switching devices on which the user is communicating, and transitioning between types of communication. For example, two or more users may connect with voice only communication, and then, with relatively little effort, one or more may move to voice and video. One or more users may employ instant messaging (IM) or similar text communication, such as to enhance an existing connection, or to avoid receiving a voice call but still respond in some manner.
- To provide such real-time communications functionalities, a computer system includes various integrated communications-related devices, such as an attached camera, an attached telephone handset, and an attached speaker and microphone, which may function as a speakerphone. Other devices include mobile communications devices such as a cellular telephone or other mobile computing device. An auxiliary display device such as for displaying caller ID data is coupled to the computer, but may remain functional when the computer operating system is not running. Buttons related to controlling real-time communications, and indicators related to the state of real-time communications are also provided.
- The present invention provides a real-time communications architecture including a controller comprising software that facilitating communications in general, switches communications to and from appropriate devices, and/or transitions communications among the various communications channels and/or types of communications. For example, the real-time communications controller couples the communication devices to voice over IP, video, POTS, PBX, cellular networks and virtually any communications medium. The devices may be wired to the computer system to which the real-time communications controller software is running, or may be wireless, e.g., Bluetooth™ based devices. The user may interact with the real-time communications controller through user interface software of one or more programs, and/or user interface software of the real-time communications controller, but in one implementation, may also do so without running user interface software. To this end, the real-time communication control buttons are easy to use and understand, and along with the indicators are positioned at locations that intuitively facilitate interaction with the real-time communications controller.
- In general, the user is able to input data via any input mechanism, e.g., any microphone on any device, via any text or pointing-based user data entry mechanism such as the keyboard and/or mouse, and/or the camera. Similarly, the real-time communications controller is able to receive data and output appropriate data to the user on any of the output mechanisms when activated, such as the speaker of a speakerphone, the handset telephone, a headset, the mobile phone or similar computing device, a PBX phone and/or a network card. Video, graphical and/or text information can also be displayed on the main display and/or the auxiliary display when available.
- By responding to the user's actions, mode control logic in the real-time communications controller follows various real-time communication rules and user-configured settings to handle a users communication needs, and in one implementation, can do so when the computer system is otherwise powered down. The mode control logic also appropriately responds to external events, such as incoming calls, pages, text messages, forwarded voicemail messages, and so forth. User actions may comprise lifting or replacing the attached handset, typing and pointing-and-clicking a mouse or the like into a user interface, pressing phone controls buttons, issuing voice commands, and so forth.
- The real-time communications controller also follows various real-time communication rules and user-configured settings to handle incoming calls in a manner that matches a users communication needs. For example, for an incoming call, the mode control logic will display the caller ID information, sound a ring or call waiting tone on the speaker as appropriate, and respond to a user action such as selection of a device to answer the call by routing the voice, text and/or video as appropriate. Any other audio may be automatically muted until no calls remain.
- The present invention allows a user to switch devices, transition between communication channels, and transition between types of calls. Thus, for example, a user can answer a cellular phone call via the headset, handset or speakerphone, add video to a call when available, switch a POTS call to a cell-phone carrier, and vice-versa.
- Improved caller ID navigation is also provided, in which a user can switch among parties on hold, and also conference in multiple parties, in a non-linear manner. A user can use any active display device such as the auxiliary display to perform such operations.
- Other advantages will become apparent from the following detailed description when taken in conjunction with the drawings, in which:
- FIG. 1 is a block diagram generally representing a computer system into which the present invention may be incorporated;
- FIG. 2 is a general representation of a computer system arranged with communications-related mechanism in accordance with an aspect of the present invention;
- FIG. 3 is a block diagram generally representing the central control of communication devices and connections to communications channels, in accordance with an aspect of the present invention;
- FIG. 4 is a block diagram generally representing components to couple various devices and control and display connection state in accordance with an aspect of the present invention;
- FIG. 5 is a state diagram generally representing a dialer object and related operation in accordance with an aspect of the present invention;
- FIG. 6 is a state diagram generally representing a ringer object and related operation in accordance with an aspect of the present invention;
- FIG. 7 is a state diagram generally representing a line device object and related operation in accordance with an aspect of the present invention;
- FIG. 8 is a state diagram generally representing a phone device object and related operation in accordance with an aspect of the present invention;
- FIG. 9 is a general state diagram representing states of operation when making a call, receiving a call, and when a call is waiting, in accordance with an aspect of the present invention;
- FIGS. 10-12 comprise a state diagram representing the transitions between instant messaging, voice and video states in accordance with an aspect of the present invention;
- FIGS. 13-15 are representations of an example display which allows non-linear selection of calls displayed based on caller ID information; and
- FIGS. 16 and 17 are representations of an example display which allows non-linear conferencing of calls displayed based on caller ID information.
- Exemplary Operating Environment
- FIG. 1 illustrates an example of a suitable computing system environment100 on which the invention may be implemented. The computing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing environment 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment 100.
- The invention is operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to: personal computers, server computers, hand-held or laptop devices, tablet devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
- The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, and so forth, which perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in local and/or remote computer storage media including memory storage devices.
- With reference to FIG. 1, an exemplary system for implementing the invention includes a general purpose computing device in the form of a computer110. Components of the computer 110 may include, but are not limited to, a processing unit 120, a system memory 130, and a system bus 121 that couples various system components including the system memory to the processing unit 120. The system bus 121 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus.
- The computer110 typically includes a variety of computer-readable media. Computer-readable media can be any available media that can be accessed by the computer 110 and includes both volatile and nonvolatile media, and removable and non-removable media. By way of example, and not limitation, computer-readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by the computer 110. Communication media typically embodies computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer-readable media.
- The system memory130 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random access memory (RAM) 132. A basic input/output system 133 (BIOS), containing the basic routines that help to transfer information between elements within computer 110, such as during start-up, is typically stored in ROM 131. RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120. By way of example, and not limitation, FIG. 1 illustrates operating system 134, application programs 135, other program modules 136 and program data 137.
- The computer110 may also include other removable/non-removable, volatile/nonvolatile computer storage media. By way of example only, FIG. 1 illustrates a hard disk drive 141 that reads from or writes to non-removable, nonvolatile magnetic media, a magnetic disk drive 151 that reads from or writes to a removable, nonvolatile magnetic disk 152, and an optical disk drive 155 that reads from or writes to a removable, nonvolatile optical disk 156 such as a CD ROM or other optical media. Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The hard disk drive 141 is typically connected to the system bus 121 through a non-removable memory interface such as interface 140, and magnetic disk drive 151 and optical disk drive 155 are typically connected to the system bus 121 by a removable memory interface, such as interface 150.
- The drives and their associated computer storage media, discussed above and illustrated in FIG. 1, provide storage of computer-readable instructions, data structures, program modules and other data for the computer110. In FIG. 1, for example, hard disk drive 141 is illustrated as storing operating system 144, application programs 145, other program modules 146 and program data 147. Note that these components can either be the same as or different from operating system 134, application programs 135, other program modules 136, and program data 137. Operating system 144, application programs 145, other program modules 146, and program data 147 are given different numbers herein to illustrate that, at a minimum, they are different copies. A user may enter commands and information into the computer 110 through input devices such as a tablet, or electronic digitizer, 164, a microphone 163, a keyboard 162 and pointing device 161, commonly referred to as mouse, trackball or touch pad. Other input devices not shown in FIG. 1 may include a joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit 120 through a user input interface 160 that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB). A
monitor 191 or other type of display device is also connected to the system bus 121 via an interface, such as a video interface 190. Themonitor 191 may also be integrated with a touch-screen panel or the like. Note that the monitor and/or touch screen panel can be physically coupled to a housing in which the computing device 110 is incorporated, such as in a tablet-type personal computer. In addition, computers such as the computing device 110 may also include other peripheral output devices such as speakers 195 and printer 196, which may be connected through an output peripheral interface 194 or the like. - The computer110 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 180. The remote computer 180 may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 110, although only a memory storage device 181 has been illustrated in FIG. 1. The logical connections depicted in FIG. 1 include a local area network (LAN) 171 and a wide area network (WAN) 173, but may also include other networks. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet. For example, in the present invention, the computer system 110 may comprise source machine from which data is being migrated, and the remote computer 180 may comprise the destination machine. Note however that source and destination machines need not be connected by a network or any other means, but instead, data may be migrated via any media capable of being written by the source platform and read by the destination platform or platforms.
- When used in a LAN networking environment, the computer110 is connected to the LAN 171 through a network interface or adapter 170. When used in a WAN networking environment, the computer 110 typically includes a modem 172 or other means for establishing communications over the WAN 173, such as the Internet. The modem 172, which may be internal or external, may be connected to the system bus 121 via the user input interface 160 or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer 110, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation, FIG. 1 illustrates remote application programs 185 as residing on memory device 181. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.
- Real Time Communications Modality Blurring
- The present invention is generally directed towards blurring various communications modalities, such that a user communicates with one or more other users typically without having to deal with the connection channel or any particular device considerations. For example, audio, video and text communications will be initiated by the user using any suitable device that the user has available and wants to use, regardless of the channel (or channels) on which the communication ultimately occurs. Similarly, received communications can be handled by any appropriate device that the user selects. As will be understood, the various channels, devices and scenarios described herein are only examples, and there are many others to which the present invention will apply.
- Turning to FIG. 2 of the drawings, there is shown a computer system, such as the computer system110 of FIG. 1, in which various communications-related devices are integrated. For example, the computer system 110 includes a
monitor 191 having an attached camera 202, an attached telephone (e.g., handset) 204, and an attachedspeaker 206, which along with amicrophone 208, may function as a speakerphone. Other devices not separately represented in FIG. 2 include mobile communications devices such as a cellular telephone or other mobile computing device capable of connecting in some way (e.g., by wired cradle or Bluetooth™ technology) with the computer system. Although shown as individual devices in FIG. 2, it is understood that any or all of these devices, such as thespeaker 206 andmicrophone 208, may be combined into a unitary assembly, or built into other devices, such as themonitor 191. In any event, each of these devices may be present and if so are connected directly or indirectly by a wired or wireless connection to interfaces at the main PC housing 214 (containing at least the motherboard, but also typically containing some non-volatile storage). - Also represented in FIG. 2 is an
auxiliary display device 220, such as for displaying caller ID data or like information as described below. Theauxiliary display 220 is typically small (relative to the main display screen 191), and may be the display of another device, such as the screen of a mobile computing device, but may also be a dedicated display, such as one that is operably connected or coupled to the computer operating system when the computer system 110 is in a powered-up state. The auxiliary display may comprise a simple text display, such as a two-line display or the like. Further, note that the auxiliary display need not be an actual display, but can be a projection (e.g., onto a wall) of the information. As will become apparent below, theauxiliary display device 220 may provide some of its own processing and storage resources, so as to remain functional to some extent when the computer operating system is not running. In one alternative implementation described below, theauxiliary display device 220 includes control buttons or the like thereon for interacting with thatdisplay 220, and possibly with the computer system 110 in general, as described below. The keyboard 162 and/or monitor 191 (and/or possibly the pointing device 161) may also include non-conventional buttons 222, such as buttons related to controlling real-time communications, andnon-conventional LED indicators 224, such as indicators related to the state of real-time communications. - In accordance with an aspect of the present invention, as generally represented in FIG. 3, the computer system110 includes, a real-
time communications controller 300, primarily implemented in a software component or set of software components, that intelligently handles various aspects of a user's real-time communication needs, including facilitating communications in general, switching communications to and from appropriate devices, and/or transitioning communications among the various communications channels and/or types of communication. Note that the real-time communications controller 300 need not be built into the computer system 110, but can connect thereto as an add-on device, such as via a USB connection. - To handle a user's various communications needs, the real-
time communications controller 300 allows a user to connect to various communication channels (e.g., a telephone company switching network, a mobile phone network, the internet or an intranet, and virtually any other local area or wide area network over which communication is possible) using the various communications-related data input/output devices. In general, the user is able to input data via any input mechanism, e.g., any microphone on any device, via any text or pointing-based userdata entry mechanism 302 such as the keyboard and/or mouse, and/or the camera 202, and have that data configured as appropriate (e.g., converted from speech to text) and sent to an appropriate (one or possibly more) of the available communication channels. Similarly, the real-time communications controller 300 is able to receive data and output appropriate data to the user on any one or more of the output mechanisms, such as the speaker of a speakerphone 304 when the user has selected that device, the handset telephone 204 when lifted, a headset 306 if activated, the mobile phone or similar computing device 308 if selected, a PBX phone 310 connected to a PBX mechanism 312 and/or a network card 314. When video, graphical and/or text information is available, data can also be displayed on the main display 191 (if active), and/or theauxiliary display 220. Note that some of the devices are represented in FIG. 3 as directly connected (coupled) to the computer system while other are shown as being wireless, however it is understood that any device may be wired or wireless, e.g., a typical mobile computing device or mobile telephone may be cradled and thus “wired” to the computer, and/or may integrate a cellular phone, Wireless Ethernet (also known as 802.11b or Wi-Fi), and/or Bluetooth™ wireless technology. Further, any “connection” referred to herein and the like should be considered equivalent to a “coupling,” whether directly or indirectly connected through any type of intermediary. - In accordance with an aspect of the present invention, the real-
time communications controller 300 controls the communication modes for the user, thereby removing much of the user's need to deal with device and connection considerations. As generally represented in FIG. 4, this is accomplished by responding to the user's actions, viamode control logic 400 in the real-time communications controller 300 that follows various real-time communication rules 402 and/or is based at least in part on other user-configurable settings and acurrent operating state 404. Themode control logic 400 likewise responds to external events, such as incoming calls, pages, text messages, forwarded voicemail messages, and so forth. - User actions can occur and be detected in any number of ways, and the present invention contemplates essentially any way of providing user action data or intended action data to a computer system. For example, such actions can include lifting or replacing the attached handset, which correspondingly actuates a
hook switch 408 that is connected to the real-time communications controller 300, and thus can be detected as state data. Phone controls 410, such as in the form of buttons on a device such as a talk button or buttons on the keyboard or monitor, (e.g., a speakerphone button, a flash button, and so on) can similarly provide user action information, as can a PBX telephone 310 or other computing device/telephone 308 (FIG. 3) connected to the computer system.Controls 420 accompanying theauxiliary display 220, such as in the form of scroll buttons and possibly an enter or select button (or equivalent button elsewhere on the system such as the flash button), can also provide user action data, as can the computerdata entry mechanisms 302 such as a keyboard and mouse. Any microphone, such as themicrophone 208, can also provide user action data, e.g., via speech recognition (command and control) performed with a speech totext recognizer 430. Text may also be converted to speech by anappropriate converter 432, such as when the user enters text to leave a message, but instead actually leaves a voice message on a called device, e.g., when thelogic 400 detects that forwarding text would not be appropriate. User action information may also be communicated bywireless radio 434, and/or from a network connection or other communication channel. Motion and/or proximity sensing can likewise serve as a user action sensor. - Where appropriate, a graphical
user interface component 440 shown as part of the mode control logic 400 (but possibly anywhere in the computer system, such as in another application program) may facilitate entry of the user action information. For example, the user may interact with one of the displays to select a displayed telephone number for connecting or reconnecting with a person or device at that number. - The present invention similarly outputs information to the user in any feasible manner, including via the user interface when appropriate. Essentially, anything capable of outputting something that can be sensed by a user can serve as an output mechanism, including the
displays 191 and/or 220, lights andother indicators 224, thespeaker 206 or other audio generating device such as a ringer on a cell phone, and other mechanisms such as one that provides tactile feedback (e.g., a vibrating cell phone). Thus, as used herein, the term “display” is only an example, and is not limited to visible information, but can include any sensed output. For example, a hook indicator in the form of an LED may be configured to flash red to indicate an incoming call, be lit green when off hook, blink amber when the call is on hold, and blink on-and-off when a call is muted. A tone and pattern can “display” the same information audibly. - In keeping with the present invention, the
related hook switch 408, controls 410, 420,displays indicators 224 provide additional value that is consistent with but go beyond a user's past communications experiences. To this end, the various controls and indicators are generally placed in proximity to the functions that they control and represent. Further, the various devices such as handsets, headsets, and speakerphones are already familiar to users, and the physical interfaces for these devices are largely equivalent to conventional devices. - Moreover, the present invention allows for various levels of computing skill. In general, the
various control buttons hook switch 408 that are provided allow the user to take advantage of much of the real-time communications controller's functionality without ever having to operate the graphicaluser interface software 440. However, to accomplish more sophisticated operations as desired, a user can also connect via theuser interface 440, e.g., to automatically dial calls, answer via a mouse click, customize settings and preferences and so forth. - In general, the
logic 400 receives user action data or remotely communicated data (such as an incoming call), and based on various real-time communications rules 402 and userconfigurable settings 404, responds in a proper manner. For example, as described below, for an incoming call, themode control logic 400 will display the caller ID information on theauxiliary display 220, or possibly themain display 191 if so configured by the user, sound a ring or call waiting tone on thespeaker 206, and wait for a user action. If the user presses a phone control button such as a speakerphone button, the call will be connected to the appropriate device, e.g., routed to thespeaker 206 andmicrophone 208. Any other audio, such as music that the user was listening to, may be automatically muted until the call is complete, e.g., until the user again presses the speakerphone button to disconnect. - The present invention thus automatically and transparently responds in an appropriate manner to a user's needs. By way of example, consider the example above of a user who is working at the computer when a call comes in. Instead of figuring out what type of call it is, finding the device necessary to (possibly) answer it, and so on, the user merely glances at the auxiliary display, decides whether to take the call, and if so, selects any appropriate device to answer. Because the real-
time communications controller 300 is the center of communication, a call to any of the user's landline telephone devices or any (smart) cellular telephone will relay the caller ID data to the real-time communications controller 300, which will display that caller ID data displayed on the sameauxiliary display 220 as any other call. For the same reason, the user can answer any incoming call on the speakerphone 304, the handset 204, the headset 306, the cellular telephone or mobile computing device 308 and so on. The user need not even know whether a given call came in on a given communications channel, such as the cellular channel instead of a POTS channel or network channel, although for reasons such as cost of airtime, the user may want to know this information. Regardless of the device and the channel, the user is provided access to a universal address book, call log, and inbox. - Moreover, the present invention allows a user to transition between communication channels. Thus, for example, a user who receives a POTS telephone call can answer talk for awhile, and switch that call over to a mobile phone to continue the conversation away from the computer system. Note that this is not conventional call forwarding set up in advance for switching at the central switching office or the like, but rather on-demand transitioning during a telephone call. For example, rules402 can be set up to favor landline over cellular for local calls since there is no airtime charge, however long distance may be favored over cellular when there is no additional charge and the user is likely to have unused airtime before the next billing cycle. Voice over IP may be the most favored, but may not be available when the computer system is powered down.
- One simple way to accomplish transitioning live connections is via a different telephone line relative to the source of the call. For example, if a user is leaving his or her office, the real-
time communications controller 300 can transparently (or mostly transparently) establish a cellular connection to the user's mobile telephone device on that other line and connect the other caller to that mobile telephone device through the real-time communications controller 300. Voice over IP can similarly be used. - Three-way and conference calling capabilities can also be leveraged, e.g., a user can walk into his or her office while connected to another person via a cell phone, the real-
time communications controller 400 can establish another call to the other party via a POTS, PBX or voice over IP call, and when connected, terminate the cellular phone call. - In addition to switching and transitioning among devices and channels, the present invention can switch and/or transition among types of communication. For example, a user can respond to a telephone call with an instant message, either automatically or by typing/speech recognition, e.g., to notify the caller that the call was received but could not be answered at that moment. In the event that the real-
time communications controller 300 has the caller ID and/or other information from that call, possibly including preset knowledge such as that the incoming telephone number belongs to a mobile device, the real-time communications controller 300 can adjust the instant message as appropriate, e.g., convert a text message to speech to leave a voice message when the call was known to be from a mobile phone that does not handle text, or when the user is known to be traveling. Note that the instant message does not have to be sent to the same device that called the user, e.g., a user can respond to a received phone call from a conventional telephone with an instant message to the caller's computer system. A simple database lookup or the like by the mode control logic can provide the recipient's address from the caller ID data so that the user does not even have to enter this information. - As another type change, when available, the present invention can start with an audio call and add video (one-way or two-way) and/or instant messaging as desired by the parties, or start with an instant message and add audio and/or video. For example, a user can press a camera button, or select video via a mouse click, to establish a video connection and start transmitting video. A video call can similarly be transitioned to a non-video (e.g., audio-only) call. In general, the present invention facilitates switching and/or transitioning between any modes of communication. Transitioning between text, voice and video states is described below with reference to FIGS. 10-12.
- It should be noted that the computer system need not be fully operational for communications to work in accordance with the present invention. Indeed, communications should still work when the computer is powered down, at least to a default extent or to an extent configured by a user, such as when the computer system is in a sleep state or a hibernate mode, and/or when the user is locked out of the system via security mechanisms. Note that the type and extent of communications may be configured by the user. For example, the user may want the telephone handset, speakerphone and caller-ID device to work as conventional appliances when the computer system is powered down, but not the camera, headset, or network card. Further, the user may limit the extent of the communications based on the computer system state, e.g., when the user is not logged in, the real-
time communications controller 300 may be set to block long distance calls, block calls to a certain prefix, and so forth. - To enable and control communications in these powered down modes, the real-
time communications controller 300 may be loaded into executable non-volatile memory, operated with a secondary processor, and so forth, so that communications works as long as some power is available, even though the disk, main processor, main display, network card and/or other parts of the system are powered down. - Turning to an explanation of the operation of the present invention with particular reference to the
mode control logic 400, FIGS. 5-8 represent general logic and rules in the form of state diagrams for various objects that control behavior of the various mechanisms. For example, FIG. 5 shows the logic and rules for connecting a call when initiating the call via a dialer object or the like. As represented in FIG. 5, when starting in anidle state 500, the user will send a dial request to line device (FIG. 7). In the event that the computer system is not powered-down, a dialer program may be automatically displayed on the graphical user interface (GUI) on themain display 191, from which the user may enter a state where the user can select a person to call or close the dialer, or the user may dial (or hang-up) in a conventional fashion. A user may also be able to scroll through and select a number on theauxiliary display 220, such as to call a number from a list of calls logged via caller ID information, speak a name or number into a microphone, press a speed dial button and so on. If dialed in any manner, the logic will attempt to connect the call, and if successful, the system will end up in aconnected state 504 until terminated. - FIG. 5 also shows that a call answered (in any manner) when in the
idle state 500 goes directly to theconnected state 504. More particularly, a pick-up request is sent to the line device (FIG. 7). If no receiver is active/off hook, a default (which may be user-configurable) receiver is selected as the active receiver, and the audio stream is sent to that active receiver. The call event may be logged in the system. - When connected, if the connection supports video and a video camera is present and its use is allowed, video is streamed. A user may disallow video by closing the camera's shutter, or by configuring the system to not automatically allow video, that is, only allow video if some manual user action is detected. The user can see when an incoming call supports video and can answer the call immediately in that mode, such as by pressing a camera button. Optionally, the user can set a preference so that the camera is automatically enabled whenever answering a call that supports video.
- If the connection supports text or rich ink messaging, an embedded instant messenger (IM) chat control is also enabled. If an indicator serves as a “connection” light, i.e., to indicate when a communication link is established between two users, then the indicator may also indicate when an IM connection is active, such as by a different LED behavior (e.g., color and/or flash pattern) with respect to a voice-only call, to communicate to the user that an IM connection exists.
- FIG. 6 shows other operation of the
logic 400, such as with respect to an object that controls a ringer or other suitable notification mechanism when an incoming call is received. When in a ringeridle state 600, (which means idle with respect to notifying a user of a new incoming call, and may include a state in which a user is already on a current call), thelogic 400 will look up and display the new caller information and enter a waitingstate 602. For example, the waiting call may be displayed via a side bar notification fly-out if the main display is on, and/or may be displayed on the auxiliary display device. At that time, thelogic 400 also may sound an audible alert (and/or providing another suitable notification, such as flashing an LED and/or vibrating a device). The type of alert may depend on whether the user is on another call or on other state information, e.g., if in a Do Not Disturb mode, no sound is played, else if no receiver is active, a ringing sound is played, otherwise a receiver call waiting tone is played. - If the active receiver goes off hook or is clicked, a flash button or the like is pressed, or the user requests that the call be answered via the graphical user interface, the ringer leaves the waiting
state 602 when the call is connected, after placing any current call on hold. A conference button or the like (not shown) can add the caller to an existing call. If no action is taken to connect the call, a voice mail time out will send the call to voice mail and return the ringer to the idle state with respect to further incoming calls. - FIG. 7 shows the operation of the line device object in an
idle state 700, a waitingstate 702, a connectingstate 704 and aconnected state 706. In general, these states have been previously described above in slightly different context, and will thus not be repeated herein except to note that while attempting to establish a connection as represented bystate 704, a connecting status or the like may be displayed by the line device object, during which time the user can cancel the attempt. Also, a hold request can transition the user from theconnected state 706 to a waitingstate 702 by placing the line on hold, while a pick-up request works in the opposite way, by connecting the line. Also, not shown in FIG. 7, multimedia playback may be turned off or muted while any receiver is active, and restored when no receiver is active. - FIG. 8 represents the operation of a phone device object in an
idle state 800, and in two off hook states, anormal state 802 and amuted state 804. The transitions between the states are readily apparent in FIG. 8, although it should be noted that as described above, another receiver can be set as the active receiver without disconnecting the line. For example, selecting a speakerphone logically hangs-up an active handset or headset, picking up the handset turns off the speakerphone or headset, pressing a talk button on the headset turns off the speakerphone or handset, and so forth. - FIG. 9 represents a general overview of the
logic 400 that summarizes various states of operation. For example, as represented in FIG. 9, the hook switch operates in a number of ways, including using it to terminate a call, lifting it to make a receiver active and pick up waiting line, as a flash button to switch lines or terminate a call if no lines are waiting. The hook switch may be implemented as a cradle hook switch mechanically integrated into the handset cradle, comprising a two-position toggle switch that closes when the handset is off hook and opens when the handset is in the cradle. - In general, as represented in FIG. 9 lifting the handset from the cradle usually takes the handset off hook and displays a dialog box for selecting the person to call. During a call, replacing the handset in the cradle will hang up the call. If the handset is not the active receiver during a call, lifting the handset from the cradle will make the handset the active receiver, switching off the old active receiver (e.g., the speakerphone or headset). When the phone is ringing from an incoming call, lifting the handset will answer the call, taking the handset off hook. If the phone is ringing while another phone conversation is already in progress, depressing the cradle hook switch quickly will toggle between the two calls, like flashing the hook switch will do with call waiting present on a legacy phone system.
- A talk button, usually integrated into the keypad of telephone devices, such as a headset or handset, performs similar functionality to the hook switch and can generally be considered similar to the hook switch operation in FIG. 9. In general, either a talk button or cradle hook switch (or at least a graphical user interface equivalent) is required for each phone handset or headset. The talk button comprises a single-throw, momentary switch that toggles the hook state for a telephone receiver. Its primary function is to initiate or answer a call, and then hang up when the conversation is finished. During a call, pressing a talk button on the active receiver will hang up the call. Pressing the talk button on another receiver will have the effect of making it the active receiver, switching off the old active receiver (handset or headset). When the phone is ringing from an incoming call, pressing the talk button will answer the call, taking the receiver off hook. If the phone is ringing while another phone conversation is already in progress, pressing the talk button will toggle between the two calls.
- FIG. 9 also shows various operations via a speakerphone button similarly comprising a single-throw, momentary switch to toggle the hook state for a speakerphone. Its primary function is to initiate or answer a call, and then hang up when the conversation is finished. The speakerphone button is a special case of the talk button, used where the incoming call is broadcast over a speaker and audio is collected via a far field microphone. In a cordless handset with speaker phone capabilities, it may be important to indicate to the user that the speakerphone is active to differentiate it from the handset talk switch.
- If a virtual speakerphone is implemented using the microphone and speakers that are already part of the PC system, a speakerphone button may be located on the keyboard, e.g., to the left of the main keyboard keys. This button usually takes the PC speakerphone off hook and displays a dialog box for selecting the person to call. During a call, pressing the speakerphone button when the speakerphone is the active receiver will hang up the call. If the speakerphone is not the active receiver, this will have the effect of making it the active receiver, switching off the old active receiver. When the phone is ringing from an incoming call, pressing the speakerphone button will answer the call, taking the speakerphone off hook. If the phone is ringing while another phone conversation is already in progress, pressing the speaker phone button will toggle between the two calls like flashing the hook switch.
- Because the talk button or speakerphone button state may not be readily apparent to a user, a hook indicator may be used in conjunction with a talk or speakerphone button, and, for example, may be located adjacent or integrated into the talk button or speakerphone button. The hook indicator may indicate state via various colors and flash patterns, e.g., steady state unlit when the receiver is on hook, steady state green when the receiver is off hook, or steady state red when no service is available. A flashing indicator, such as with a “wink” duty cycle can overlay the steady state, e.g., a red wink overlay can indicate call waiting, or an amber flash overlay can indicate a call holding. The call waiting overlay indicator will continue to blink as long as the user can pick up the phone to connect to the incoming caller, even if the call is no longer ringing. This allows call screening when callers are recording voice mail. The call holding overlay is generally only needed when a dedicated hold indicator is not present.
- Although not specifically represented in FIG. 9, other buttons may be provided. For example, a flash button, often used for alternate line selection, generates a momentary on hook condition for signaling purposes. When the user is notified of a call waiting, pressing the flash button will place the current call on hold and answer the incoming call. With calls on hold, pressing the flash button places the current call on hold and picks up the next call in the hold queue. A hold button places a current call on hold by placing the current call into a call waiting state as generally represented in FIG. 7, freeing the receiver to make another call, answer an incoming call, or hang up to pick up on another receiver. A conference button initiates a conference call, in which pressing the conference button joins the current call with one or more calls waiting on hold. Other buttons are feasible, such as a button to immediately send an incoming call to voice mail. Note that because the real
time communications controller 300 handles the calls, conference calls can also be handled via thegraphical user interface 440, e.g., additional contacts or groups of contacts can be clicked and dragged to a window to conference in others. - FIG. 9 also represents a number of user interaction scenarios with respect to real-time communications, including handling an incoming call and making a call. As described above, to make a phone call, the user lifts the handset or presses the talk switch on the speakerphone or headset, and then dials a number. Alternatively, the user may select a contact from the
display 220 orgraphical user interface 440, or employ voice dialing. When initiating a call from thegraphical user interface 440, such as within the context of a communications application such as Microsoft® Outlook, the user can initiate a phone call from any standard contact object supported by an API. The operating system takes the default receiver off hook and makes the connection using a preferred or specified telecommunications service. - To answer a phone call, the user lifts the handset, presses a speakerphone switch, or presses a talk switch headset (or on the speakerphone). Before answering, the user has the ability to view caller ID, and possibly other pertinent contact information displayed with the notification message (on the main display or auxiliary display), allowing the user to pre-screen the call. Depending on preferences, the user can then choose to pick up the call or transfer it to voice mail, which may include transferring it to one of a plurality of custom or standard voice mail messages. While the caller is recording voice mail, the user can monitor the incoming recording and pick up the receiver, similar to a traditional answering machine.
- The examples below provide additional interaction detail for common telephony functions, including an incoming call scenario, wherein the real-time communications controller sounds the ringer and blinks the talk button indicator, while using caller ID information to display contact information. When the user presses the talk button, a microphone button, camera button, or picks up the handset, or presses the hook (talk) switch on the headset, the real-
time communications controller 300 may light an indicator for the active receiver. The user receives the call, and can switch among devices, e.g., to switch to the speakerphone, the user presses the talk button or mic button; to switch to the video speakerphone, the user presses the camera button; to switch to the handset, the user picks it up (activating the hook switch); or to switch to the headset, the user presses the hook (talk) switch on the headset. A cell phone or mobile computing device may be similarly used, even without actually switching the call to the cellular network (which may require some additional user action). When the user switches active receivers, the system disables the previous receiver to prevent feedback, and updates indicators to reflect the active receiver. - If the call supports video, the real-time communications controller blinks the camera indicator. If the user presses the blinking camera button, or automatic video is set by user preference to automatically stream video when video is available, the system opens the video monitor, lights the camera indicator, and starts streaming video.
- To mute a component, the user can take an appropriate action. For example, to mute video and audio, the user presses the camera button, whereby the real-time communications controller blinks the audio and video indicators until the camera button is pressed again or the call is terminated. To mute video only, the user shuts the camera's privacy shutter, whereby the system un-lights the video indicators and closes the A/V monitor, but maintains the audio indicator. To mute speakerphone audio, the user presses the microphone (speakerphone) button, whereby the real-time communications controller blinks an appropriate indicator until the button is pressed again or the call is terminated. To hang up, the user presses the hook switch for the active receiver.
- To place a call, the real-
time communications controller 300 reacts when the user presses the talk button, picks up the handset, or presses the hook switch on headset, by displaying a dialog box for selecting the person to call. The system may also audibly ask through the active receiver, such as when voice dialing is enabled, as to who the user would like to call. The real-time communications controller uses resulting input to select a contact from the dialog box, and the user can query to search and can re-query to refine the search, if necessary. - When the user makes a selection or acknowledges a match, the real-time communications controller shows contact information for the selected recipient and shows a status dialog box while the call is connecting. When connected, the user can switch devices as described above, and also switch modes, e.g., audio to video, and so forth, with the indicators operating in the above-described manner.
- The user can also perform other communications-related tasks, including checking voice mail and call screening. For example, an indicator light may blink to indicate a voice mail, whereby the user can user press a notification button causing the real-time communications controller to enter a callback routine for the highest priority notification. In case of voice mail or priority email, this may open the user's unified In Box. Call screening logic follows various rules, including showing caller ID information and contact summary data until, after a preset number of rings, the system stops the ringer and sends a voice mail message to an incoming caller. If the call screening option is enabled, the system echoes the incoming message to a system audio output device (usually the speaker). If the user presses the hook switch of any receiver, the system discards the message and switches to real-time voice, otherwise, when the user hangs up or after a certain time limit, the system stops blinking the talk button indicator and files a voice message.
- FIG. 10-12 generally show the relationships between instant messaging, and/or voice communication states, with various incoming and/or outgoing video states, and the various channel switching transitions between these states. Note that although instant messaging is used as an example in FIG. 10, any other type of real-time text messaging is equivalent, including text messages sent to pagers, and possibly electronic mail if relatively fast enough to be considered real-time. One state represented in FIG. 10 is a no
call state 1000 than can transition to various voice and/or instant messaging states. As also represented in FIGS. 10-12, the connected states can have automatic video active, or video can be added (or ended) at any time by either party. - FIG. 10 represents the instant messaging states without voice, including a state with no
video 1002, and states with incoming, outgoing and two-way video, states 1004, 1006 and 1008, respectively. As is readily apparent, each user controls these states by user actions or configured preferences for automatic video operation. Note that voice can be added from these states, in which event a new state will be entered as represented in FIG. 12. - FIG. 11 represents the voice without instant messaging states, with similar video-related states of voice only, incoming, outgoing and two-way video, states1004, 1006 and 1008, respectively. Note that instant messaging can be added from these voice states, in which event a new state will be entered as represented in FIG. 12.
- FIG. 12 represents the states and transitions when both instant messaging and voice are active, with transitions within the same four possible video-related states of none, incoming, outgoing and two-way video available. As can be seen in FIG. 12, the communication may transition to a no instant messaging state (FIG. 11) or no voice state (FIG. 10), or no communication at all at
state 1000 of FIG. 10, based on straightforward actions of the users who are communicating. - In accordance with another aspect of the present invention, there is provided a caller ID navigation mechanism that allows users to navigate a stack of calls in a non-linear manner. As represented in FIG. 13, the available calls may be displayed on the
auxiliary display device 220, with the currently connectedcall 1302 indicated in some manner to differentiate it from the calls on hold. As can be appreciated, richer information may be provided depending on the amount of display area available, such as the length of time the user was on hold, the type of connections that are available and its current state (voice, video, instant message) and so forth. - In general, the user presses the
scroll buttons box 1410 in FIG. 14, and presses aselect button 1308 to switch to the call, as represented by the connectedbox 1502 moving relative to its position in FIG. 13. Because the real-time controller 300, and not a remote switch at the telephone is in charge, the switching may be non-linear. Note that the scroll buttons are typically near or part of the auxiliary display unit because the user will be looking at the display, however theselect button 1308 may be another button located elsewhere, such as a flash button on the keyboard, (as long as that button remains active while the computer system is otherwise in a powered off state). - Further, if the main display is active, the user need not scroll, but can instead simply select a call to switch two via a point and click operation. Of course, the user can also scroll, such as via keyboard cursor keys to highlight, and the Enter key to select. Again, richer information may be provided, particularly since the
main display 191 will provide more display area relative to theauxiliary display 220. - As represented in FIGS. 16 and 17, (which shows a richer set of information), depending on the available buttons and their meaning, conferencing by selecting users is also feasible. For example, holding the select button while on a connected call, and then scrolling through the list view, can keep any existing connections connected, and releasing the select button can add (or drop if already selected) another user. On the main display, more elaborate schemes are available, e.g., to drag and drop other parties into a “connected” window, right click on a list view similar to that shown in FIGS. 16 and 17, and so forth.
- As can be seen from the foregoing detailed description, there is provided a real-time communications method and system for handling the switching and transitioning between communications modalities including switching devices, switching communication channels and/or transitioning types of communications, e.g., audio, video and text. The present invention facilitates user communication by blurring the distinction between these various modalities, allowing the user to focus on the communication rather than the mechanisms for accomplishing the communication. The method and system thus provide significant advantages and benefits needed in contemporary computing and communications.
- While the invention is susceptible to various modifications and alternative constructions, certain illustrated embodiments thereof are shown in the drawings and have been described above in detail. It should be understood, however, that there is no intention to limit the invention to the specific forms disclosed, but on the contrary, the intention is to cover all modifications, alternative constructions, and equivalents falling within the spirit and scope of the invention.
Claims (49)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/429,905 US20040240650A1 (en) | 2003-05-05 | 2003-05-05 | Real-time communications architecture and methods for use with a personal computer system |
US11/837,302 US7577429B2 (en) | 2003-05-05 | 2007-08-10 | Real-time communications architecture and methods for use with a personal computer system |
US12/542,506 US20090305695A1 (en) | 2003-05-05 | 2009-08-17 | Real-time communications architecture and methods for use with a personal computer system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/429,905 US20040240650A1 (en) | 2003-05-05 | 2003-05-05 | Real-time communications architecture and methods for use with a personal computer system |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/837,302 Division US7577429B2 (en) | 2003-05-05 | 2007-08-10 | Real-time communications architecture and methods for use with a personal computer system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20040240650A1 true US20040240650A1 (en) | 2004-12-02 |
Family
ID=33449631
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/429,905 Abandoned US20040240650A1 (en) | 2003-05-05 | 2003-05-05 | Real-time communications architecture and methods for use with a personal computer system |
US11/837,302 Expired - Lifetime US7577429B2 (en) | 2003-05-05 | 2007-08-10 | Real-time communications architecture and methods for use with a personal computer system |
US12/542,506 Abandoned US20090305695A1 (en) | 2003-05-05 | 2009-08-17 | Real-time communications architecture and methods for use with a personal computer system |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/837,302 Expired - Lifetime US7577429B2 (en) | 2003-05-05 | 2007-08-10 | Real-time communications architecture and methods for use with a personal computer system |
US12/542,506 Abandoned US20090305695A1 (en) | 2003-05-05 | 2009-08-17 | Real-time communications architecture and methods for use with a personal computer system |
Country Status (1)
Country | Link |
---|---|
US (3) | US20040240650A1 (en) |
Cited By (44)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040222977A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Notification lights, locations and rules for a computer system |
US20040222978A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Control and communications panel for a computer system |
US20050021344A1 (en) * | 2003-07-24 | 2005-01-27 | International Business Machines Corporation | Access to enhanced conferencing services using the tele-chat system |
US20050069101A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | System and method for using telephony controls on a personal computer |
US20060221870A1 (en) * | 2005-03-31 | 2006-10-05 | Goichi Morikawa | Image communication method and communication apparatus |
US20070173314A1 (en) * | 2006-01-26 | 2007-07-26 | Daka Studio Inc. | Sudoku game device with dual control button |
US20070263825A1 (en) * | 2006-04-20 | 2007-11-15 | Cisco Technology, Inc. | Accessing a calendar server to facilitate initiation of a scheduled call |
US20080096591A1 (en) * | 2006-10-19 | 2008-04-24 | Waytena William L | Systems and Methods for Providing Communications Services Using Assigned Codes |
WO2008051778A2 (en) * | 2006-10-19 | 2008-05-02 | Kadoink, Inc. | Systems and methods for providing communications services using assigned codes |
US20080147395A1 (en) * | 2006-12-19 | 2008-06-19 | International Business Machines Corporation | Using an automated speech application environment to automatically provide text exchange services |
US20080144860A1 (en) * | 2006-12-15 | 2008-06-19 | Dennis Haller | Adjustable Resolution Volume Control |
US20090217180A1 (en) * | 2008-02-21 | 2009-08-27 | Shoretel, Inc. | Programmable Buttons for Telephone User Interface |
US20090232291A1 (en) * | 2008-03-14 | 2009-09-17 | Cisco Technology, Inc. | One Button Conference Initiation |
US20090240770A1 (en) * | 2008-03-18 | 2009-09-24 | Cisco Technology, Inc. | Establishing a Remotely Hosted Conference Initiated with One Button Push |
US20090245493A1 (en) * | 2008-03-28 | 2009-10-01 | Avaya Inc. | System and Method for Displaying Call Flows and Call Statistics |
US7711868B2 (en) | 2004-11-23 | 2010-05-04 | Microsoft Corporation | Waking a main computer system to pre-fetch data for an auxiliary computing device |
US7784065B2 (en) | 2005-02-07 | 2010-08-24 | Microsoft Corporation | Interface for consistent program interaction with auxiliary computing devices |
US7827232B2 (en) | 2003-05-05 | 2010-11-02 | Microsoft Corporation | Record button on a computer system |
US7913182B2 (en) | 2003-05-05 | 2011-03-22 | Microsoft Corporation | Method and system for auxiliary display of information for a computing device |
US7986914B1 (en) * | 2007-06-01 | 2011-07-26 | At&T Mobility Ii Llc | Vehicle-based message control using cellular IP |
CN102215216A (en) * | 2010-04-07 | 2011-10-12 | 苹果公司 | Transitioning between circuit switched calls and video calls |
WO2011126506A1 (en) | 2010-04-07 | 2011-10-13 | Apple Inc. | Transitioning between circuit switched calls and video calls |
US8127125B2 (en) | 2003-09-30 | 2012-02-28 | Microsoft Corporation | Method and system for unified audio control on a personal computer |
US8503640B1 (en) * | 2004-09-01 | 2013-08-06 | Shoretel, Inc. | Extension monitoring in a distributed telephony system |
US8583149B2 (en) | 2010-04-07 | 2013-11-12 | Apple Inc. | Registering email addresses for online communication sessions |
US8606306B2 (en) | 2010-04-07 | 2013-12-10 | Apple Inc. | Multiple client computing device invitations for online communication sessions |
US8635554B2 (en) | 2003-05-20 | 2014-01-21 | Microsoft Corporation | Enhanced telephony computer user interface allowing user interaction and control of a telephone using a personal computer |
US20140055401A1 (en) * | 2010-11-05 | 2014-02-27 | Bluespace Corporation | Method and apparatus for controlling contents in realtime fashion |
US8751667B2 (en) | 2010-04-07 | 2014-06-10 | Apple Inc. | Supporting hands-free services via a hands-free device for IP video calls |
US20140198903A1 (en) * | 2008-03-20 | 2014-07-17 | Steve Cha | Method and apparatus for selective silencing of telephone ringing |
US20140256380A1 (en) * | 2013-03-05 | 2014-09-11 | Phillip Ortega | Vehicle mounted cell phone docking station |
US20140256293A1 (en) * | 2003-12-08 | 2014-09-11 | Ipventure, Inc. | Adaptable communication techniques for electronic devices |
US20140297755A1 (en) * | 2013-04-02 | 2014-10-02 | Research In Motion Limited | Method and system for switching between collaborative applications |
US8995688B1 (en) * | 2009-07-23 | 2015-03-31 | Helen Jeanne Chemtob | Portable hearing-assistive sound unit system |
US9078128B2 (en) | 2011-06-03 | 2015-07-07 | Apple Inc. | System and method for secure identity service |
US9183560B2 (en) | 2010-05-28 | 2015-11-10 | Daniel H. Abelow | Reality alternate |
US9191521B2 (en) * | 2005-09-22 | 2015-11-17 | Verizon Patent And Licensing Inc. | Method and system for providing call waiting features in a SIP-based network |
US9344677B1 (en) * | 2013-03-19 | 2016-05-17 | Google Inc. | Content sharing system and method |
US9762623B1 (en) * | 2005-12-22 | 2017-09-12 | Apple Inc. | Automatic call initiation in response to selecting tags in electronic documents and applications |
US20180103277A9 (en) * | 1999-04-23 | 2018-04-12 | Monkeymedia, Inc. | Method and storage device for expanding and contracting continuous play media seamlessly |
US10142810B2 (en) | 2003-12-08 | 2018-11-27 | Ipventure, Inc. | Method and apparatus to manage different options of communication using one user identifier based on internet protocol |
CN110830650A (en) * | 2019-10-30 | 2020-02-21 | 深圳传音控股股份有限公司 | Terminal prompting method, terminal and computer storage medium |
US11431767B2 (en) | 2018-05-29 | 2022-08-30 | Sorenson Ip Holdings, Llc | Changing a communication session |
US12143901B2 (en) | 2023-10-09 | 2024-11-12 | Ingenioshare, Llc | Method and apparatus to manage communication |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060242590A1 (en) * | 2005-04-21 | 2006-10-26 | Microsoft Corporation | Simple content format for auxiliary display devices |
TW200743385A (en) * | 2006-05-05 | 2007-11-16 | Amtran Technology Co Ltd | Method of audio-visual communication using television and television using the same |
US7636426B2 (en) * | 2005-08-10 | 2009-12-22 | Siemens Communications, Inc. | Method and apparatus for automated voice dialing setup |
US8199743B1 (en) * | 2005-11-29 | 2012-06-12 | Rockstar Bidco, LP | Enhanced services for a pots line |
WO2009049394A1 (en) * | 2007-10-17 | 2009-04-23 | Tyco Safety Products Canada Ltd. | Alarm system call handling |
US8649494B2 (en) * | 2008-08-05 | 2014-02-11 | International Business Machines Corporation | Participant alerts during multi-person teleconferences |
US8019903B2 (en) * | 2009-03-27 | 2011-09-13 | Microsoft Corporation | Removable accessory for a computing device |
KR20110056638A (en) * | 2009-11-23 | 2011-05-31 | 삼성전자주식회사 | Apparatus and method for changing call mode in portable terminal |
KR101591954B1 (en) | 2009-12-21 | 2016-02-04 | 엘지이노텍 주식회사 | Mobile phone |
US9253439B2 (en) * | 2014-02-24 | 2016-02-02 | Cellco Partnership | Managing complex video call scenarios in volte calls |
EP3393112B1 (en) | 2014-05-23 | 2020-12-30 | Samsung Electronics Co., Ltd. | System and method of providing voice-message call service |
CN106649036B (en) * | 2016-11-24 | 2019-03-12 | 北京瑞星网安技术股份有限公司 | Linux network access monitoring method and device |
Citations (57)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4860342A (en) * | 1987-04-09 | 1989-08-22 | Danner David L | Computer-telephone interface method and apparatus |
US5568540A (en) * | 1993-09-13 | 1996-10-22 | Active Voice Corporation | Method and apparatus for selecting and playing a voice mail message |
US5675374A (en) * | 1993-11-26 | 1997-10-07 | Fujitsu Limited | Video teleconferencing system |
US5831657A (en) * | 1993-09-22 | 1998-11-03 | Kabushiki Kaisha Toshiba | Image forming system with smoothing pixels of a larger size |
US6052442A (en) * | 1995-11-07 | 2000-04-18 | Internet Magic, Inc. | Internet answering machine |
US6144644A (en) * | 1997-05-21 | 2000-11-07 | Telcordia Technologies, Inc. | System and method for implementing call waiting functions over a network |
US6144363A (en) * | 1996-12-16 | 2000-11-07 | Video Road Digital Inc. | Message status display |
US6172703B1 (en) * | 1997-03-10 | 2001-01-09 | Samsung Electronics Co., Ltd. | Video conference system and control method thereof |
US6208373B1 (en) * | 1999-08-02 | 2001-03-27 | Timothy Lo Fong | Method and apparatus for enabling a videoconferencing participant to appear focused on camera to corresponding users |
US6215420B1 (en) * | 1999-01-06 | 2001-04-10 | Coach Master Int'l Corp. | Keyboard (I) |
US6240168B1 (en) * | 1998-10-29 | 2001-05-29 | Picazo Communications | Method and apparatus for controlling a computer to implement telephone functions with a displayed telephone of variable size |
US6282435B1 (en) * | 1997-09-26 | 2001-08-28 | Sun Microsytems Inc. | Graphical user interface for a portable telephone |
US20010040551A1 (en) * | 1999-07-29 | 2001-11-15 | Interlink Electronics, Inc. | Hand-held remote computer input peripheral with touch pad used for cursor control and text entry on a separate display |
US20020015020A1 (en) * | 2000-07-29 | 2002-02-07 | Farzad Mobin | Radio-style hollow appliance for interactive use with a computer |
US6346934B1 (en) * | 1999-05-17 | 2002-02-12 | Gateway, Inc. | Programmable remote device control apparatus and method |
US6483905B1 (en) * | 1996-08-13 | 2002-11-19 | Lextron Systems, Inc. | Electronic document answering machine |
US6507356B1 (en) * | 2000-10-13 | 2003-01-14 | At&T Corp. | Method for improving video conferencing and video calling |
US20030021290A1 (en) * | 2001-07-25 | 2003-01-30 | Jones Clifton T. | System and method of serving data messages |
US6518957B1 (en) * | 1999-08-13 | 2003-02-11 | Nokia Mobile Phones Limited | Communications device with touch sensitive screen |
US20030037180A1 (en) * | 2001-08-16 | 2003-02-20 | Kedar Madineni | System and method to uniformly access devices |
US20030112325A1 (en) * | 2001-12-13 | 2003-06-19 | Digeo, Inc. | Camera positioning system and method for eye-to-eye communication |
US20030131148A1 (en) * | 2002-01-10 | 2003-07-10 | David Kelley | Cross-platform software development with a software development peripheral |
US6603855B1 (en) * | 1999-10-21 | 2003-08-05 | Agere Systems Inc. | Cordless phone notification of extended off-hook using parallel set detection |
US6628194B1 (en) * | 1999-08-31 | 2003-09-30 | At&T Wireless Services, Inc. | Filtered in-box for voice mail, e-mail, pages, web-based information, and faxes |
US6671743B1 (en) * | 1998-11-13 | 2003-12-30 | Creative Technology, Ltd. | Method and system for exposing proprietary APIs in a privileged device driver to an application |
US6671356B2 (en) * | 2001-09-24 | 2003-12-30 | Teleware, Inc. | Multi-media communication management system with subscriber messaging integration services |
US6731316B2 (en) * | 2000-02-25 | 2004-05-04 | Kargo, Inc. | Graphical layout and keypad response to visually depict and implement device functionality for interactivity with a numbered keypad |
US6741232B1 (en) * | 2002-01-23 | 2004-05-25 | Good Technology, Inc. | User interface for a data processing apparatus |
US20040114032A1 (en) * | 2002-04-15 | 2004-06-17 | Toshiaki Kakii | Videoconference system, terminal equipment included therein and data delivery method |
US6757372B1 (en) * | 2000-01-10 | 2004-06-29 | Cisco Technology, Inc. | User interface for a network-enabled telephone |
US20040141012A1 (en) * | 2003-01-16 | 2004-07-22 | Computer Associates Think, Inc. | System and method for mouseless navigation of web applications |
US20040155956A1 (en) * | 2003-02-03 | 2004-08-12 | Libbey Kent Alexander | System for maintaining eye contract during videoconferencing |
US20040177361A1 (en) * | 2002-11-25 | 2004-09-09 | Sven Bernhard | Generic application program interface for native drivers |
US20040225901A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Method and system for auxiliary processing of information for a computing device |
US20040223061A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Computer camera system and method for reducing parallax |
US20040223599A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Computer system with do not disturb system and method |
US20040222978A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Control and communications panel for a computer system |
US20040222977A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Notification lights, locations and rules for a computer system |
US20040225892A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Method and system for activating a computer system |
US20040225502A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Record button on a computer system |
US20040240167A1 (en) * | 2003-05-05 | 2004-12-02 | Ledbetter Carl J. | Apparatus, systems and methods relating to improved lighting and notifications in a computing system |
US20050071437A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | Method and system for navigation using media transport controls |
US20050071626A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | Method and system for unified audio control on a personal computer |
US20050069101A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | System and method for using telephony controls on a personal computer |
US20050068423A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | Method and system for capturing video on a personal computer |
US6882326B2 (en) * | 2001-06-22 | 2005-04-19 | Pioneer Corporation | Portable information terminal |
US6888562B2 (en) * | 2003-03-26 | 2005-05-03 | Broadcom Corporation | Integral eye-path alignment on telephony and computer video devices using a pinhole image sensing device |
US6892074B2 (en) * | 1997-08-28 | 2005-05-10 | Nokia Mobile Phones Limited | Selective message service to primary and secondary mobile stations |
US6902332B2 (en) * | 2003-07-31 | 2005-06-07 | Microsoft Corporation | Universal remote computer keyboard |
US6912283B2 (en) * | 2001-09-24 | 2005-06-28 | Robert F. Meyerson | Teledata space and docking station with modular and integrated display |
US6970556B2 (en) * | 2001-09-24 | 2005-11-29 | Wall Daniel G | Multi-media communication system having programmable speed dial control indicia |
US6976216B1 (en) * | 2000-11-17 | 2005-12-13 | Streamzap, Inc. | Computer system with remote key press events directed to a first application program and local key press events directed to a second application program |
US6980641B1 (en) * | 1998-10-29 | 2005-12-27 | Intel Corporation | Method and apparatus for controlling a computer to implement telephone functions with an enhanced minidialer function |
US20060007051A1 (en) * | 2003-05-05 | 2006-01-12 | Microsoft Corporation | Method and system for auxiliary display of information for a computing device |
US6996445B1 (en) * | 1999-07-27 | 2006-02-07 | Nec Corporation | Sound volume adjustment system in personal computer and sound volume adjustment method thereof |
US20060130075A1 (en) * | 2004-11-23 | 2006-06-15 | Microsoft Corporation | Method and system for exchanging data between computer systems and auxiliary displays |
US20060164324A1 (en) * | 2004-11-23 | 2006-07-27 | Microsoft Corporation | Sending notifications to auxiliary displays |
Family Cites Families (89)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5159445A (en) * | 1990-12-31 | 1992-10-27 | At&T Bell Laboratories | Teleconferencing video display system for improving eye contact |
JPH05300499A (en) * | 1992-04-17 | 1993-11-12 | Toshiba Corp | Visual telephone system |
US5487181A (en) * | 1992-10-28 | 1996-01-23 | Ericsson Ge Mobile Communications Inc. | Low power architecture for portable and mobile two-way radios |
US5657414A (en) * | 1992-12-01 | 1997-08-12 | Scientific-Atlanta, Inc. | Auxiliary device control for a subscriber terminal |
US5546538A (en) * | 1993-12-14 | 1996-08-13 | Intel Corporation | System for processing handwriting written by user of portable computer by server or processing by the computer when the computer no longer communicate with server |
US5491800A (en) | 1993-12-20 | 1996-02-13 | Taligent, Inc. | Object-oriented remote procedure call networking system |
JP2692563B2 (en) * | 1993-12-28 | 1997-12-17 | 日本電気株式会社 | Semiconductor laser embedded structure |
US5533115A (en) * | 1994-01-31 | 1996-07-02 | Bell Communications Research, Inc. | Network-based telephone system providing coordinated voice and data delivery |
US5519772A (en) | 1994-01-31 | 1996-05-21 | Bell Communications Research, Inc. | Network-based telephone system having interactive capabilities |
US5675810A (en) * | 1994-09-07 | 1997-10-07 | Compaq Computer Corporation | Reducing power usage in a personal computer |
US6545775B1 (en) | 1995-07-21 | 2003-04-08 | Canon Kabushiki Kaisha | Control system and units removably attachable to the same |
US5764901A (en) | 1995-12-21 | 1998-06-09 | Intel Corporation | Record and playback in a data conference |
US5768164A (en) * | 1996-04-15 | 1998-06-16 | Hewlett-Packard Company | Spontaneous use display for a computing system |
US5802305A (en) * | 1996-05-17 | 1998-09-01 | Microsoft Corporation | System for remotely waking a sleeping computer in power down state by comparing incoming packet to the list of packets storing on network interface card |
US5959622A (en) * | 1996-05-31 | 1999-09-28 | Intel Corporation | Still image capture under computer control in response to user-instructed trigger |
US5732216A (en) * | 1996-10-02 | 1998-03-24 | Internet Angles, Inc. | Audio message exchange system |
US5907604A (en) | 1997-03-25 | 1999-05-25 | Sony Corporation | Image icon associated with caller ID |
US6101610A (en) * | 1997-03-28 | 2000-08-08 | International Business Machines Corporation | Computer system having thermal sensing with dual voltage sources for sensor stabilization |
US6006285A (en) * | 1997-04-30 | 1999-12-21 | Compaq Computer Corporation | Computer system capable of playing audio CDs in a CD-ROM drive independent of an operating system |
US5991836A (en) | 1997-05-02 | 1999-11-23 | Network Computing Devices, Inc. | System for communicating real time data between client device and server utilizing the client device estimating data consumption amount by the server |
US6073187A (en) | 1997-06-20 | 2000-06-06 | Compaq Computer Corporation | Controls and indicators available to a user for a secondary operational mode of a portable computer which is open or closed state of the computer case |
US5999613A (en) | 1997-09-25 | 1999-12-07 | U. S. West, Inc. | Method and system for processing incoming calls during calls-in-progress |
US6516356B1 (en) | 1997-09-30 | 2003-02-04 | International Business Machines Corporation | Application interface to a media server and a method of implementing the same |
US6380968B1 (en) * | 1998-01-06 | 2002-04-30 | Intel Corporation | Method and apparatus for controlling a remote video camera in a video conferencing system |
US6390371B1 (en) | 1998-02-13 | 2002-05-21 | Micron Technology, Inc. | Method and system for displaying information uniformly on tethered and remote input devices |
US6362440B1 (en) * | 1998-03-27 | 2002-03-26 | International Business Machines Corporation | Flexibly interfaceable portable computing device |
US6233611B1 (en) | 1998-05-08 | 2001-05-15 | Sony Corporation | Media manager for controlling autonomous media devices within a network environment and managing the flow and format of data between the devices |
US6438585B2 (en) * | 1998-05-29 | 2002-08-20 | Research In Motion Limited | System and method for redirecting message attachments between a host system and a mobile data communication device |
US7209949B2 (en) * | 1998-05-29 | 2007-04-24 | Research In Motion Limited | System and method for synchronizing information between a host system and a mobile data communication device |
US6237846B1 (en) * | 1998-06-29 | 2001-05-29 | Sony Corporation | Body wearable keyboard |
US6438216B1 (en) * | 1998-07-30 | 2002-08-20 | Siemens Information And Communication Networks, Inc. | Nonintrusive call notification method and system using content-specific information |
US6417849B2 (en) * | 1998-07-31 | 2002-07-09 | Hewlett-Packard Company | Single logical screen in X windows with direct hardware access to the frame buffer for 3D rendering |
US6918123B1 (en) | 1998-10-02 | 2005-07-12 | Koninklijke Philips Electronics N.V. | Calls identify scenario for control of software objects via property routes |
US6118856A (en) * | 1998-12-28 | 2000-09-12 | Nortel Networks Corporation | Method and apparatus for automatically forwarding an email message or portion thereof to a remote device |
US6806867B1 (en) | 1998-12-31 | 2004-10-19 | A.T.X. International, Inc. | Palm pad system |
GB9901859D0 (en) | 1999-01-29 | 1999-03-17 | Ridgeway Systems & Software Lt | Audio-video telephony |
US7103167B2 (en) * | 2002-05-20 | 2006-09-05 | Callwave, Inc. | Systems and methods for call screening |
US6519335B1 (en) * | 1999-04-08 | 2003-02-11 | Lucent Technologies Inc. | Apparatus, method and system for personal telecommunication incoming call screening and alerting for call waiting applications |
US7068641B1 (en) * | 1999-05-05 | 2006-06-27 | Nortel Networks Limited | Telephony and data network services at a telephone |
US6484019B1 (en) | 1999-10-18 | 2002-11-19 | Mannix V. Aklian | Combined computer keyboard and radio apparatus |
US6546262B1 (en) * | 1999-11-12 | 2003-04-08 | Altec Lansing Technologies, Inc. | Cellular telephone accessory device for a personal computer system |
US6691233B1 (en) * | 1999-11-18 | 2004-02-10 | Ecrio Inc. | Battery operated ink capture device that operates in a normal power mode during active use and a minimum power mode during absence of active use |
US6513128B1 (en) * | 1999-11-30 | 2003-01-28 | 3Com Corporation | Network interface card accessible during low power consumption mode |
US7000237B1 (en) | 1999-12-21 | 2006-02-14 | Intel Corporation | Method for communicating occurrence of events in a storage medium |
US6816881B1 (en) | 2000-03-13 | 2004-11-09 | International Business Machines Corporation | Method and apparatus for inter-application communication in wireless networks |
US7243130B2 (en) * | 2000-03-16 | 2007-07-10 | Microsoft Corporation | Notification platform architecture |
KR100358370B1 (en) * | 2000-03-24 | 2002-10-25 | 공원일 | Keyboard with the functions of telephone, recorder and burglarproof |
JP2001306440A (en) | 2000-04-24 | 2001-11-02 | Sony Corp | Automatic distribution service system for contents of electronic information, information processor, recording medium, method for automatically distributing contents of electronic information |
US8843590B2 (en) | 2000-05-31 | 2014-09-23 | Ebm/Ip, Llc | Systems, methods and computer program products for facilitating display of content within application programs executing on electronic devices |
US7302637B1 (en) | 2000-07-24 | 2007-11-27 | Research In Motion Limited | System and method for abbreviating information sent to a viewing device |
EP1191424A3 (en) * | 2000-09-06 | 2004-11-10 | Sony Corporation | Information processing apparatus |
US6938174B2 (en) * | 2000-10-06 | 2005-08-30 | International Business Machines Corporation | Method and system with adaptive data transfer policy based on a power state of a computing device |
EP1205843A3 (en) * | 2000-11-13 | 2004-10-20 | Canon Kabushiki Kaisha | User interfaces |
US20020069217A1 (en) * | 2000-12-04 | 2002-06-06 | Hua Chen | Automatic, multi-stage rich-media content creation using a framework based digital workflow - systems, methods and program products |
US7224801B2 (en) * | 2000-12-27 | 2007-05-29 | Logitech Europe S.A. | Wireless secure device |
US20020087225A1 (en) * | 2001-01-03 | 2002-07-04 | Howard Gary M. | Portable computing device having a low power media player |
US6897851B2 (en) * | 2001-01-05 | 2005-05-24 | International Business Machines Corporation | Methods and apparatus for formatted entry of electronic ink |
JP2002247187A (en) * | 2001-02-16 | 2002-08-30 | Soft Front:Kk | Phone system capable of utilizing both phone line network and computer communication network |
US8117313B2 (en) * | 2001-03-19 | 2012-02-14 | International Business Machines Corporation | System and method for adaptive formatting of image information for efficient delivery and presentation |
CN1628450B (en) | 2001-05-01 | 2010-05-26 | Meta4hand公司 | Wireless network computing |
US7475356B2 (en) | 2001-05-11 | 2009-01-06 | Xerox Corporation | System utilizing mixed resolution displays |
US7546540B2 (en) | 2001-05-11 | 2009-06-09 | Xerox Corporation | Methods of using mixed resolution displays |
US6718183B1 (en) * | 2001-06-05 | 2004-04-06 | Bellsouth Intellectual Property Corporation | System and method for reducing data quality degradation due to encoding/decoding |
JP2002366284A (en) * | 2001-06-08 | 2002-12-20 | Alps Electric Co Ltd | Keyboard device for portable electronic equipment and charging equipment |
JP3680774B2 (en) | 2001-08-27 | 2005-08-10 | ヤマハ株式会社 | Display control device for displaying gain setting value by hue |
JP2003075167A (en) * | 2001-09-04 | 2003-03-12 | Sony Corp | Navigation device, method of displaying map and image display device |
US20030074590A1 (en) * | 2001-10-12 | 2003-04-17 | Fogle Steven L. | Computer system with improved entry into powersave and lock modes and method of use therefor |
US7519911B2 (en) * | 2001-11-02 | 2009-04-14 | At&T Intellectual Property Ii, L.P. | Systems and methods for managing and aggregating media formats |
US7636326B2 (en) * | 2001-12-26 | 2009-12-22 | Siemens Communications, Inc. | Private communications network including connected public communications devices and method of operation thereof |
US8010903B2 (en) * | 2001-12-28 | 2011-08-30 | International Business Machines Corporation | System and method for visualizing and navigating dynamic content in a graphical user interface |
US20030146903A1 (en) * | 2002-02-01 | 2003-08-07 | Leland Yi | Wired keyboard with built-in web camera |
US6658095B1 (en) | 2002-03-19 | 2003-12-02 | Nortel Networks Limited | Customized presence information delivery |
US7036110B2 (en) * | 2002-03-21 | 2006-04-25 | Sun Microsystems, Inc. | Mechanism to manage the lifecycle of a resource adapter |
US20030188041A1 (en) * | 2002-04-01 | 2003-10-02 | Fillmore James A. | Distributed event notification system and method |
US20030197685A1 (en) * | 2002-04-23 | 2003-10-23 | Leland Yi | Wireless keyboard with a built-in web camera |
US7272660B1 (en) * | 2002-09-06 | 2007-09-18 | Oracle International Corporation | Architecture for general purpose near real-time business intelligence system and methods therefor |
US20040052341A1 (en) * | 2002-09-18 | 2004-03-18 | I-Hau Yeh | System for automatic notification of caller ID, e-mail identification and short message |
US20040135819A1 (en) * | 2002-10-28 | 2004-07-15 | Shalong Maa | Computer remote control |
US6937950B2 (en) * | 2002-12-26 | 2005-08-30 | International Business Machines Corporation | Animated graphical object notification system |
GB2398199A (en) * | 2003-02-10 | 2004-08-11 | Nokia Corp | A system for transferring content audio and video data from a provider to a personal digital assistant |
EP1602201A2 (en) * | 2003-03-12 | 2005-12-07 | Persona Software, Inc. | Extension of a local area phone system to a wide area network with handoff |
US7231229B1 (en) * | 2003-03-16 | 2007-06-12 | Palm, Inc. | Communication device interface |
US7096391B2 (en) * | 2003-04-29 | 2006-08-22 | Hewlett-Packard Development Company, L.P. | Error message suppression system and method |
US20050182822A1 (en) * | 2004-02-17 | 2005-08-18 | Daniel Stuart W. | Imaging device with memory device interface |
US7395051B2 (en) * | 2004-02-23 | 2008-07-01 | Research In Motion Limited | Cellular communications system for providing non-real time subscription data and related methods |
US20050193396A1 (en) * | 2004-02-27 | 2005-09-01 | Stafford-Fraser James Q. | Computer network architecture and method of providing display data |
US20060048062A1 (en) * | 2004-09-01 | 2006-03-02 | Adamson Dale F | Software and method providing graphic user interface for graphics adapter configuration |
US20060061516A1 (en) * | 2004-09-23 | 2006-03-23 | Campbell Robert G | Connecting multiple monitors to a computer system |
US7853674B2 (en) * | 2005-01-24 | 2010-12-14 | Research In Motion Limited | System and method for provisioning component applications |
-
2003
- 2003-05-05 US US10/429,905 patent/US20040240650A1/en not_active Abandoned
-
2007
- 2007-08-10 US US11/837,302 patent/US7577429B2/en not_active Expired - Lifetime
-
2009
- 2009-08-17 US US12/542,506 patent/US20090305695A1/en not_active Abandoned
Patent Citations (59)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4860342A (en) * | 1987-04-09 | 1989-08-22 | Danner David L | Computer-telephone interface method and apparatus |
US5568540A (en) * | 1993-09-13 | 1996-10-22 | Active Voice Corporation | Method and apparatus for selecting and playing a voice mail message |
US5831657A (en) * | 1993-09-22 | 1998-11-03 | Kabushiki Kaisha Toshiba | Image forming system with smoothing pixels of a larger size |
US5675374A (en) * | 1993-11-26 | 1997-10-07 | Fujitsu Limited | Video teleconferencing system |
US6052442A (en) * | 1995-11-07 | 2000-04-18 | Internet Magic, Inc. | Internet answering machine |
US6973167B2 (en) * | 1996-08-13 | 2005-12-06 | Lextron System, Inc. | Electronic document answering machine |
US6483905B1 (en) * | 1996-08-13 | 2002-11-19 | Lextron Systems, Inc. | Electronic document answering machine |
US6144363A (en) * | 1996-12-16 | 2000-11-07 | Video Road Digital Inc. | Message status display |
US6172703B1 (en) * | 1997-03-10 | 2001-01-09 | Samsung Electronics Co., Ltd. | Video conference system and control method thereof |
US6144644A (en) * | 1997-05-21 | 2000-11-07 | Telcordia Technologies, Inc. | System and method for implementing call waiting functions over a network |
US6892074B2 (en) * | 1997-08-28 | 2005-05-10 | Nokia Mobile Phones Limited | Selective message service to primary and secondary mobile stations |
US6282435B1 (en) * | 1997-09-26 | 2001-08-28 | Sun Microsytems Inc. | Graphical user interface for a portable telephone |
US6240168B1 (en) * | 1998-10-29 | 2001-05-29 | Picazo Communications | Method and apparatus for controlling a computer to implement telephone functions with a displayed telephone of variable size |
US6980641B1 (en) * | 1998-10-29 | 2005-12-27 | Intel Corporation | Method and apparatus for controlling a computer to implement telephone functions with an enhanced minidialer function |
US6671743B1 (en) * | 1998-11-13 | 2003-12-30 | Creative Technology, Ltd. | Method and system for exposing proprietary APIs in a privileged device driver to an application |
US6215420B1 (en) * | 1999-01-06 | 2001-04-10 | Coach Master Int'l Corp. | Keyboard (I) |
US6346934B1 (en) * | 1999-05-17 | 2002-02-12 | Gateway, Inc. | Programmable remote device control apparatus and method |
US6996445B1 (en) * | 1999-07-27 | 2006-02-07 | Nec Corporation | Sound volume adjustment system in personal computer and sound volume adjustment method thereof |
US20010040551A1 (en) * | 1999-07-29 | 2001-11-15 | Interlink Electronics, Inc. | Hand-held remote computer input peripheral with touch pad used for cursor control and text entry on a separate display |
US6208373B1 (en) * | 1999-08-02 | 2001-03-27 | Timothy Lo Fong | Method and apparatus for enabling a videoconferencing participant to appear focused on camera to corresponding users |
US6518957B1 (en) * | 1999-08-13 | 2003-02-11 | Nokia Mobile Phones Limited | Communications device with touch sensitive screen |
US6628194B1 (en) * | 1999-08-31 | 2003-09-30 | At&T Wireless Services, Inc. | Filtered in-box for voice mail, e-mail, pages, web-based information, and faxes |
US6603855B1 (en) * | 1999-10-21 | 2003-08-05 | Agere Systems Inc. | Cordless phone notification of extended off-hook using parallel set detection |
US6757372B1 (en) * | 2000-01-10 | 2004-06-29 | Cisco Technology, Inc. | User interface for a network-enabled telephone |
US6731316B2 (en) * | 2000-02-25 | 2004-05-04 | Kargo, Inc. | Graphical layout and keypad response to visually depict and implement device functionality for interactivity with a numbered keypad |
US20020015020A1 (en) * | 2000-07-29 | 2002-02-07 | Farzad Mobin | Radio-style hollow appliance for interactive use with a computer |
US6507356B1 (en) * | 2000-10-13 | 2003-01-14 | At&T Corp. | Method for improving video conferencing and video calling |
US6976216B1 (en) * | 2000-11-17 | 2005-12-13 | Streamzap, Inc. | Computer system with remote key press events directed to a first application program and local key press events directed to a second application program |
US6882326B2 (en) * | 2001-06-22 | 2005-04-19 | Pioneer Corporation | Portable information terminal |
US20030021290A1 (en) * | 2001-07-25 | 2003-01-30 | Jones Clifton T. | System and method of serving data messages |
US20030037180A1 (en) * | 2001-08-16 | 2003-02-20 | Kedar Madineni | System and method to uniformly access devices |
US6671356B2 (en) * | 2001-09-24 | 2003-12-30 | Teleware, Inc. | Multi-media communication management system with subscriber messaging integration services |
US6970556B2 (en) * | 2001-09-24 | 2005-11-29 | Wall Daniel G | Multi-media communication system having programmable speed dial control indicia |
US6912283B2 (en) * | 2001-09-24 | 2005-06-28 | Robert F. Meyerson | Teledata space and docking station with modular and integrated display |
US20030112325A1 (en) * | 2001-12-13 | 2003-06-19 | Digeo, Inc. | Camera positioning system and method for eye-to-eye communication |
US20030131148A1 (en) * | 2002-01-10 | 2003-07-10 | David Kelley | Cross-platform software development with a software development peripheral |
US6741232B1 (en) * | 2002-01-23 | 2004-05-25 | Good Technology, Inc. | User interface for a data processing apparatus |
US20040114032A1 (en) * | 2002-04-15 | 2004-06-17 | Toshiaki Kakii | Videoconference system, terminal equipment included therein and data delivery method |
US20040177361A1 (en) * | 2002-11-25 | 2004-09-09 | Sven Bernhard | Generic application program interface for native drivers |
US20040141012A1 (en) * | 2003-01-16 | 2004-07-22 | Computer Associates Think, Inc. | System and method for mouseless navigation of web applications |
US20040155956A1 (en) * | 2003-02-03 | 2004-08-12 | Libbey Kent Alexander | System for maintaining eye contract during videoconferencing |
US6888562B2 (en) * | 2003-03-26 | 2005-05-03 | Broadcom Corporation | Integral eye-path alignment on telephony and computer video devices using a pinhole image sensing device |
US20040223599A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Computer system with do not disturb system and method |
US20040225892A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Method and system for activating a computer system |
US20060284787A1 (en) * | 2003-05-05 | 2006-12-21 | Microsoft Corporation | Method and system for auxiliary display of information for a computing device |
US20040222978A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Control and communications panel for a computer system |
US20060007051A1 (en) * | 2003-05-05 | 2006-01-12 | Microsoft Corporation | Method and system for auxiliary display of information for a computing device |
US20040222977A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Notification lights, locations and rules for a computer system |
US20040225502A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Record button on a computer system |
US20040223061A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Computer camera system and method for reducing parallax |
US20040225901A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Method and system for auxiliary processing of information for a computing device |
US20040240167A1 (en) * | 2003-05-05 | 2004-12-02 | Ledbetter Carl J. | Apparatus, systems and methods relating to improved lighting and notifications in a computing system |
US6902332B2 (en) * | 2003-07-31 | 2005-06-07 | Microsoft Corporation | Universal remote computer keyboard |
US20050071437A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | Method and system for navigation using media transport controls |
US20050071626A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | Method and system for unified audio control on a personal computer |
US20050069101A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | System and method for using telephony controls on a personal computer |
US20050068423A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | Method and system for capturing video on a personal computer |
US20060130075A1 (en) * | 2004-11-23 | 2006-06-15 | Microsoft Corporation | Method and system for exchanging data between computer systems and auxiliary displays |
US20060164324A1 (en) * | 2004-11-23 | 2006-07-27 | Microsoft Corporation | Sending notifications to auxiliary displays |
Cited By (86)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180103277A9 (en) * | 1999-04-23 | 2018-04-12 | Monkeymedia, Inc. | Method and storage device for expanding and contracting continuous play media seamlessly |
US10051298B2 (en) * | 1999-04-23 | 2018-08-14 | Monkeymedia, Inc. | Wireless seamless expansion and video advertising player |
US7827232B2 (en) | 2003-05-05 | 2010-11-02 | Microsoft Corporation | Record button on a computer system |
US20040222978A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Control and communications panel for a computer system |
US20040222977A1 (en) * | 2003-05-05 | 2004-11-11 | Bear Eric Gould | Notification lights, locations and rules for a computer system |
US7372371B2 (en) | 2003-05-05 | 2008-05-13 | Microsoft Corporation | Notification lights, locations and rules for a computer system |
US7913182B2 (en) | 2003-05-05 | 2011-03-22 | Microsoft Corporation | Method and system for auxiliary display of information for a computing device |
US9392043B2 (en) | 2003-05-20 | 2016-07-12 | Microsoft Technology Licensing, Llc | Enhanced telephony computer user interface allowing user interaction and control of a telephone using a personal computer |
US8694915B2 (en) | 2003-05-20 | 2014-04-08 | Microsoft Corporation | Enhanced telephony computer user interface allowing user interaction and control of a telephone using a personal computer |
US8635554B2 (en) | 2003-05-20 | 2014-01-21 | Microsoft Corporation | Enhanced telephony computer user interface allowing user interaction and control of a telephone using a personal computer |
US20050021344A1 (en) * | 2003-07-24 | 2005-01-27 | International Business Machines Corporation | Access to enhanced conferencing services using the tele-chat system |
US8166287B2 (en) | 2003-09-30 | 2012-04-24 | Microsoft Corporation | Method and system for unified audio control on a personal computer |
US8443179B2 (en) | 2003-09-30 | 2013-05-14 | Microsoft Corporation | Method and system for unified audio control on a personal computer |
US7440556B2 (en) * | 2003-09-30 | 2008-10-21 | Microsoft Corporation | System and method for using telephony controls on a personal computer |
US8245027B2 (en) | 2003-09-30 | 2012-08-14 | Microsoft Corporation | Method and system for unified audio control on a personal computer |
US8127125B2 (en) | 2003-09-30 | 2012-02-28 | Microsoft Corporation | Method and system for unified audio control on a personal computer |
US8644481B2 (en) | 2003-09-30 | 2014-02-04 | Microsoft Corporation | Method and system for unified audio control on a personal computer |
US20050069101A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | System and method for using telephony controls on a personal computer |
US11711459B2 (en) | 2003-12-08 | 2023-07-25 | Ipventure, Inc. | Adaptable communication techniques for electronic devices |
US11019199B2 (en) * | 2003-12-08 | 2021-05-25 | Ipventure, Inc. | Adaptable communication techniques for electronic devices |
US10492038B2 (en) | 2003-12-08 | 2019-11-26 | Ipventure, Inc. | Method and apparatus to manage messaging providing different communication modes depending on one identifier and not requiring to disclose contact information |
US10142810B2 (en) | 2003-12-08 | 2018-11-27 | Ipventure, Inc. | Method and apparatus to manage different options of communication using one user identifier based on internet protocol |
US20140256293A1 (en) * | 2003-12-08 | 2014-09-11 | Ipventure, Inc. | Adaptable communication techniques for electronic devices |
US11800329B2 (en) | 2003-12-08 | 2023-10-24 | Ingenioshare, Llc | Method and apparatus to manage communication |
US10708727B2 (en) | 2003-12-08 | 2020-07-07 | Ipventure, Inc. | Method and apparatus to manage messaging providing different communication modes using one identifier and not requiring to disclose contact information |
US11792316B2 (en) | 2003-12-08 | 2023-10-17 | Ipventure, Inc. | Adaptable communication techniques for electronic devices |
US8503640B1 (en) * | 2004-09-01 | 2013-08-06 | Shoretel, Inc. | Extension monitoring in a distributed telephony system |
US8948359B1 (en) | 2004-09-01 | 2015-02-03 | Shoretel, Inc. | Extension monitoring in a distributed telephony system |
US7711868B2 (en) | 2004-11-23 | 2010-05-04 | Microsoft Corporation | Waking a main computer system to pre-fetch data for an auxiliary computing device |
US7784065B2 (en) | 2005-02-07 | 2010-08-24 | Microsoft Corporation | Interface for consistent program interaction with auxiliary computing devices |
US20060221870A1 (en) * | 2005-03-31 | 2006-10-05 | Goichi Morikawa | Image communication method and communication apparatus |
US9191521B2 (en) * | 2005-09-22 | 2015-11-17 | Verizon Patent And Licensing Inc. | Method and system for providing call waiting features in a SIP-based network |
US9319530B2 (en) | 2005-09-22 | 2016-04-19 | Verizon Patent And Licensing Inc. | Method and system for providing telemetry, verification and/or other access in a SIP-based network |
US9241074B1 (en) | 2005-09-22 | 2016-01-19 | Verizon Patent And Licensing Inc. | Method and system for providing variable dial pattern provisioning in a SIP-based network |
US10356133B2 (en) * | 2005-12-22 | 2019-07-16 | Apple Inc. | Automatic call initiation in response to selecting tags in electronic documents and applications |
US9762623B1 (en) * | 2005-12-22 | 2017-09-12 | Apple Inc. | Automatic call initiation in response to selecting tags in electronic documents and applications |
US20070173314A1 (en) * | 2006-01-26 | 2007-07-26 | Daka Studio Inc. | Sudoku game device with dual control button |
US20110135079A1 (en) * | 2006-04-20 | 2011-06-09 | Cisco Technology, Inc. | Accessing a calendar server to facilitate initiation of a scheduled call |
US20070263825A1 (en) * | 2006-04-20 | 2007-11-15 | Cisco Technology, Inc. | Accessing a calendar server to facilitate initiation of a scheduled call |
US8767932B2 (en) | 2006-04-20 | 2014-07-01 | Cisco Technology, Inc. | Accessing a calendar server to facilitate initiation of a scheduled call |
US8504081B2 (en) * | 2006-10-19 | 2013-08-06 | Copiamobile, Inc. | Systems and methods for providing communications services using assigned codes |
WO2008051778A2 (en) * | 2006-10-19 | 2008-05-02 | Kadoink, Inc. | Systems and methods for providing communications services using assigned codes |
WO2008051778A3 (en) * | 2006-10-19 | 2008-06-26 | Kadoink Inc | Systems and methods for providing communications services using assigned codes |
US20080096591A1 (en) * | 2006-10-19 | 2008-04-24 | Waytena William L | Systems and Methods for Providing Communications Services Using Assigned Codes |
US20080144860A1 (en) * | 2006-12-15 | 2008-06-19 | Dennis Haller | Adjustable Resolution Volume Control |
US20080147395A1 (en) * | 2006-12-19 | 2008-06-19 | International Business Machines Corporation | Using an automated speech application environment to automatically provide text exchange services |
US8027839B2 (en) | 2006-12-19 | 2011-09-27 | Nuance Communications, Inc. | Using an automated speech application environment to automatically provide text exchange services |
US7986914B1 (en) * | 2007-06-01 | 2011-07-26 | At&T Mobility Ii Llc | Vehicle-based message control using cellular IP |
US9478215B2 (en) | 2007-06-01 | 2016-10-25 | At&T Mobility Ii Llc | Vehicle-based message control using cellular IP |
US8467721B2 (en) | 2007-06-01 | 2013-06-18 | At&T Mobility Ii Llc | Systems and methods for delivering a converted message to a vehicle media system |
US8490020B2 (en) * | 2008-02-21 | 2013-07-16 | Shoretel, Inc. | Programmable buttons for telephone user interface |
US20090217180A1 (en) * | 2008-02-21 | 2009-08-27 | Shoretel, Inc. | Programmable Buttons for Telephone User Interface |
US8831197B2 (en) | 2008-03-14 | 2014-09-09 | Cisco Technology, Inc. | One button conference initiation |
US20090232291A1 (en) * | 2008-03-14 | 2009-09-17 | Cisco Technology, Inc. | One Button Conference Initiation |
US9357164B2 (en) | 2008-03-18 | 2016-05-31 | Cisco Technology, Inc. | Establishing a remotely hosted conference initiated with one button push |
US20090240770A1 (en) * | 2008-03-18 | 2009-09-24 | Cisco Technology, Inc. | Establishing a Remotely Hosted Conference Initiated with One Button Push |
US9338292B2 (en) | 2008-03-20 | 2016-05-10 | Steve Cha | Method and apparatus for selective silencing of telephone ringing |
US20140198903A1 (en) * | 2008-03-20 | 2014-07-17 | Steve Cha | Method and apparatus for selective silencing of telephone ringing |
US9167088B2 (en) * | 2008-03-20 | 2015-10-20 | Steve Cha | Method and apparatus for selective silencing of telephone ringing |
US9749469B2 (en) | 2008-03-20 | 2017-08-29 | Steve Cha | Method and apparatus for selective silencing of telephone ringing |
US9497321B2 (en) | 2008-03-20 | 2016-11-15 | Steve Cha | Method and apparatus for selective silencing of telephone ringing |
US20090245493A1 (en) * | 2008-03-28 | 2009-10-01 | Avaya Inc. | System and Method for Displaying Call Flows and Call Statistics |
US8938059B2 (en) * | 2008-03-28 | 2015-01-20 | Avaya Inc. | System and method for displaying call flows and call statistics |
US8995688B1 (en) * | 2009-07-23 | 2015-03-31 | Helen Jeanne Chemtob | Portable hearing-assistive sound unit system |
GB2495814A (en) * | 2010-04-07 | 2013-04-24 | Apple Inc | Transitioning between circuit switched calls and video calls |
US8606306B2 (en) | 2010-04-07 | 2013-12-10 | Apple Inc. | Multiple client computing device invitations for online communication sessions |
CN102215216A (en) * | 2010-04-07 | 2011-10-12 | 苹果公司 | Transitioning between circuit switched calls and video calls |
WO2011126506A1 (en) | 2010-04-07 | 2011-10-13 | Apple Inc. | Transitioning between circuit switched calls and video calls |
US9577976B2 (en) | 2010-04-07 | 2017-02-21 | Apple Inc. | Registering client computing devices for online communication sessions |
US8948797B2 (en) | 2010-04-07 | 2015-02-03 | Apple Inc. | Registering client computing devices for online communication sessions |
US8751667B2 (en) | 2010-04-07 | 2014-06-10 | Apple Inc. | Supporting hands-free services via a hands-free device for IP video calls |
US8725880B2 (en) | 2010-04-07 | 2014-05-13 | Apple, Inc. | Establishing online communication sessions between client computing devices |
US8704863B2 (en) | 2010-04-07 | 2014-04-22 | Apple Inc. | Transitioning between circuit switched calls and video calls |
GB2495814B (en) * | 2010-04-07 | 2018-09-12 | Apple Inc | Transitioning between circuit switched calls and video calls |
US8423058B2 (en) | 2010-04-07 | 2013-04-16 | Apple Inc. | Registering client computing devices for online communication sessions |
US8583149B2 (en) | 2010-04-07 | 2013-11-12 | Apple Inc. | Registering email addresses for online communication sessions |
US11222298B2 (en) | 2010-05-28 | 2022-01-11 | Daniel H. Abelow | User-controlled digital environment across devices, places, and times with continuous, variable digital boundaries |
US9183560B2 (en) | 2010-05-28 | 2015-11-10 | Daniel H. Abelow | Reality alternate |
US20140055401A1 (en) * | 2010-11-05 | 2014-02-27 | Bluespace Corporation | Method and apparatus for controlling contents in realtime fashion |
US9078128B2 (en) | 2011-06-03 | 2015-07-07 | Apple Inc. | System and method for secure identity service |
US20140256380A1 (en) * | 2013-03-05 | 2014-09-11 | Phillip Ortega | Vehicle mounted cell phone docking station |
US9344677B1 (en) * | 2013-03-19 | 2016-05-17 | Google Inc. | Content sharing system and method |
US20140297755A1 (en) * | 2013-04-02 | 2014-10-02 | Research In Motion Limited | Method and system for switching between collaborative applications |
US11431767B2 (en) | 2018-05-29 | 2022-08-30 | Sorenson Ip Holdings, Llc | Changing a communication session |
CN110830650A (en) * | 2019-10-30 | 2020-02-21 | 深圳传音控股股份有限公司 | Terminal prompting method, terminal and computer storage medium |
US12143901B2 (en) | 2023-10-09 | 2024-11-12 | Ingenioshare, Llc | Method and apparatus to manage communication |
Also Published As
Publication number | Publication date |
---|---|
US20080037741A1 (en) | 2008-02-14 |
US20090305695A1 (en) | 2009-12-10 |
US7577429B2 (en) | 2009-08-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7577429B2 (en) | Real-time communications architecture and methods for use with a personal computer system | |
US7440556B2 (en) | System and method for using telephony controls on a personal computer | |
JP5588014B2 (en) | Telephone hold mechanism | |
US9807578B2 (en) | Dual-mode device for voice communication | |
EP1841192A1 (en) | Presence and preference-enabled push to talk telephony system | |
US8948691B2 (en) | User application initiated telephony | |
US20070243898A1 (en) | Multi-handset cordless voice over IP telephony system | |
US20180316798A1 (en) | Communication system, communication method, and communication adapter | |
EP1527595B1 (en) | Ip telephone apparatus and ip telephone system | |
CN102123214A (en) | Control device and method of three-network integrated phone | |
US7277530B2 (en) | IP telephone apparatus and IP telephone system | |
US20060176875A1 (en) | IP telephone exchange and IP telephone terminal | |
JP2006191675A (en) | Transfer notification method for key telephone system | |
JP4821318B2 (en) | Telephone system that can notify incoming calls during a call | |
JP2006033725A (en) | Telephone communication apparatus | |
JP5062092B2 (en) | Main device and telephone terminal that automatically responds to incoming calls during non-call function operation | |
JP4348911B2 (en) | Call system | |
JP2007228363A (en) | Telephone in which multiple phone numbers can be registered, and ip telephone system | |
JP2005260417A (en) | Ip telephone set | |
JPS63253750A (en) | Telephone set | |
JP2005191729A (en) | Ip telephone device, ip telephone system and communication method | |
JP2004328522A (en) | Transmission system and transmission method of telephone set | |
JPH07212457A (en) | Automatic answering telephone set | |
KR20040090579A (en) | Method of Processing Speaker Phone Mode in Wireless Terminal | |
JP2008252848A (en) | Information communication system and information communication method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MICROSOFT CORPORATION, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BEAR, ERIC GOULD;MAGENDANZ, CHAD;ADAMS, ADITHA MAY;AND OTHERS;REEL/FRAME:014558/0981 Effective date: 20030923 |
|
AS | Assignment |
Owner name: MICROSOFT CORPORATION, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CROSIER, DALE C.;PLANK, ROBERT SCOTT;VAN FLANDERN, MICHAEL W.;AND OTHERS;REEL/FRAME:014856/0859;SIGNING DATES FROM 20040210 TO 20040218 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034766/0001 Effective date: 20141014 |