WO2003071420A2

WO2003071420A2 - A method, a computer system and a computer program product for of sharing an activity between a first user and a second user

Info

Publication number: WO2003071420A2
Application number: PCT/IB2003/000239
Authority: WO
Inventors: Mark H. Verberkt; Elmo M. A. Diederiks; Bartel M. Van De Sluis; Koen H. J. Vrielink; Ramon E. F. Van De Ven
Original assignee: Koninklijke Philips Electronics N.V.
Priority date: 2002-02-22
Filing date: 2003-01-27
Publication date: 2003-08-28
Also published as: WO2003071420A3; AU2003201151A1; AU2003201151A8

Abstract

A method and a system of / for showing and using a media content item among two or more users of an space via a controller unit (1000, 1001), wherein each user (1006) is using a media device (1003) to present the media content item. The media content item can be a video, an image, a text, a drawing, a design, an e-mail, a memo, a movie, a video card, a media album, a video conference, a chat-room, a game, a voice conference, a discussion, a concert or a gathering. The media device can be a TV, a PC, a lap-top, a Web-tablet, a mobile telephone, a personal digital assistant or a screen. sharing an activity between a first user and a second user, the method comprising the steps of: a) representing the activity to the first user through a first user interface; and b) representing the activity to the second user through a second user interface characterized in that the activity further comprises sharing a media content item between the first user and the second user and the method further comprises, c) representing the media content item, a representation of the first user and a representation of the second user to the first user through the first user interface and to the second user through the second user interface, d) synchronizing the second user interface with the first user interface such that the second user interface substantially duplicates the first user interface.

Description

A method, a computer system and a computer program product for of sharing an activity between a first user and a second user

The invention relates to a method of sharing an activity between a first user and a second user, the method comprising the steps of

- representing the activity to the first user through a first user interface; and

- representing the activity to the second user through a second user interface. The invention further relates to a computer system for performing such method.

The invention further relates to a computer program product for performing such method.

US 6,199,116 discloses a method and a system for managing objects shared by multiple instances of a shared application program. When an instance of the application program modifies the shared object, an updated user interface reflects the modification and thereby the users of the shared application program can cooperatively view and modify the data of the shared object. However a user of shared applications is not able to see the other users that are participating in a modification of a shared application.

It is an object of the invention to provide a method according to the preamble that provides feedback of a shared activity in a more improved way. To achieve this object, the method is characterized in that the activity further comprises sharing a media content item between the first user and the second user and the method further comprises

- representing the media content item, a representation of the first user and a representation of the second user to the first user through the first user interface and to the second user through the second user interface

- synchronizing the second user interface with the first user interface such that the second user interface substantially duplicates the first user interface.

By representing the media content item to both the first and the second user, the two users can easily share the media content item between them and join each other in an activity like watching a movie, a TV program, a music track, a memo, a video card or a media album. Since the user interfaces represented to the users substantially look the same, each user shares the same experience of the user interface and because the users are graphically represented on the user interfaces there is a natural feedback to the users of who is participating.

An embodiment of the method is described in claim 2. By synchronizing the user interfaces substantially real-time, all users are immediately informed about changes. For example when two or more users start sharing an activity like a videoconference or other ways of direct communication. The latency between a change into one user interface and synchronizing the other user interfaces to reflect this change can depend upon the kind of communication, like wired or wire-less, used between the user interfaces. A further embodiment of the method is described in claim 3. By moving the representation of the first user to for example the second user, a shared activity, like video conferencing between the first and the second user is started in a natural way. It is also possible to start sharing a media content item, like for example a collection of photographs or a movie between two users in a natural way. A further embodiment of the method is described in claim 4. By visualizing a space, different spaces can comprise different content items and representation of users. Within a space, people can access and activate the available content, communicate with other present persons, and share activities with tern. A space is preferably only accessible for people that are members of a particular social group. Further embodiments of the method are described in claim 5 and 6. By adding a second media content to a space, for example a movie next to the already present photo album, this second content item can also be shared between the persons present within the space. By deleting a media content item from the space, a user can prevent that the other users of the space can share the content. For example when a user no longer wishes to share viewing a photo.

Further embodiments of the method are described in claim 7 and 8. By adding and removing users to and from a space, the presence of members of the space can be visualized and changes into the membership of a user of a space can be visualized.

An embodiment of the method is described in claim 9. By synchronizing all user interfaces of all users to reflect all changes, the visualized social environment creates a sense of being together and enable social interaction of a group of people wherein the interrelationship between the virtual and the physical space is taken into account. The invention will be explained more fully below in connection with preferred embodiments and with reference to the drawings, in which:

Figure 1 shows a system with a controller unit with a database, media devices, a user and the flow of information; Figure 2 shows an image of a display of the media device; and

Figure 3 shows a method of showing and using media content item with users among two or more members of an interest group via a controller unit, wherein each member of the interest group may use a media device to present the content of the media content item.

Figure 1 shows a system with a controller unit with a database, media devices, a user and the flow of information. Reference numeral 1001 may be a controller unit. The controller unit is mainly the controlling part of the system, in that it is meant to have the overview of users of media devices, etc.; however as will be explained in the method of figure 3, each media device may also strongly influence the behavior and the content provided and presented among the users. The controller unit may be implicitly accessed by various media devices as shown by reference numeral 1003. The controller unit comprises an interface for connection to the Internet with the possibility to be accessed simultaneously by various media devices using its service of sharing various activities between the users. The connection to the controller unit can be wired or wireless, using broadband internet, etc. The term controller unit may also be understood as a cluster of media devices. In this sense a media device may either be operated in a primarily stand-alone mode or be operated in a more cooperative mode as part of grouped media devices. In the real world, particular locations facilitate people from a certain social group to meet each other and to engage in joint activities. The home, for instance is a place where one expects to meet family members, whereas at the office one is more likely to meets one's colleagues. Here, asynchronous possibilities such as sharing and exchanging information or content is offered. For example, by means of a pin-board or by leaving a written message on the kitchen table. Network technologies enable social groups to meet each other and to share experiences at a given time while being present at different physical places. In this virtual world people need a clear, continuous context for meeting other people, exchanging content and sharing activities. Such a virtual shared space creates an environment that frames the presence of people and provides mutual awareness into a space. A space enables people from a certain social group to meet each other, to share activities and to share content. A group of people can create a space that is accessible for the whole group, independent of each one's physical location. For example, a family space is accessible for all household members from all over the world. In a similar way, a work space is accessible from any location, facilitating working from home and cooperation between colleagues working at different locations.

The controller unit may have a connection to a database, which is shown by reference numeral 1002. The database may comprise various information such as media content items, the content of media content items, member(s) of interest group(s), available spaces, etc; further the database may comprise symbolic representations of said information. Generally, the database may be used to keep track of what is sent to and received from the media devices. For an example, when one media item is selected on the media device, the controller unit may provide the corresponding information in the form of an executable program, an application or a service with information about users (members) and members of various spaces to the media device. This will be discussed in the method of figure 3.

Reference numeral 1003 may be the media device. The media device may be used as the connection point to a user (of a particular space), reference numeral 1006, using the method of figure 3. There may be more media devices simultaneously accessing the controller unit via the Internet or any other open network, reference numeral 1007. The various media devices are designated by the two rectangles of reference numeral 1003. The media device may be one of a set-top box, a TV, a PC, a lap-top, a Web tablet, a mobile telephone, a personal digital assistant and a screen with Internet access. They can be used in any desirable combination among users, i.e. one user may use a PC, whereas another user may use a mobile telephone. Users can share activities like a real-time video conference or communication, or watching a TV program, a movie a music track, a memo, a video card or a media album.

Reference numeral 1004 may generally represent information of the method of figure 3 sent from the controller unit to the media device by means of reference numeral 1007.

The reference numeral 1005 may generally be information sent in the opposite direction of the method as a response to the information contained in reference numeral 1004. The information is sent from the media device to the controller unit also by means of reference numeral 1007. Reference numeral 1006 may be the user of the media device.

Reference numeral 1000 may be another controller unit. This controller unit - in cooperation with the controller unit of reference numeral 1001 - may comprise the applications, programs, etc accessible from the user(s) 1006. Similar to the fact that more media devices may simultaneously access the said controller units, there may be various controller units more than designated by the two rectangles of the reference numeral 1000 and 1001 to share the access to applications, program, spaces, users etc which may be implicitly requested by the user(s) of the media devices. Reference numeral 1007 may be an open network. The network may be the Internet or any primarily non hard-wired connection to enable communication between media devices and controller units.

Figure 2 shows a user interface of a display of a media device of a user in a schematic way. The user interface represents the space that the user has access to. Here, 2006 and 2007 indicate that three users are having dialogue using real-time video or voice communication. Whereas, 2005 indicates a shared activity consisting of real-time communication between three users in combination with a synchronized experience of the content: for example watching a movie. 2004 indicates that one user is performing an activity without other users and experiences content, for example watching a listening to music. Reference numerals 2002, and 2003 indicate the other users that have access to the space. Reference numeral 2001 indicates a content item, for example a memo that comprises a message. Each user has access to a particular set of spaces. As soon as a user is identified, his icon appears on the user interface. This user identification can be realized either by identifying oneself to the system by fingerprint or by the system recognizing the user's face using computer vision. The view or user interface of a space is synchronized for all those users present. All members see the same content, people and activity items at the same position. People can drag content items as well as their own person icon around within a space. This is visible in real-time to all other present members. Some ways of manipulating icons in spaces are: drag and drop for moving content icons and the user icon within a space. Pick and drop, for copying content icons from one space to another. By moving content items and user icons activities can be started. It is also possible to join an ongoing activity by moving one's user icon to the ongoing activity. The involved people within a shared activity have a synchronized experience of the content. For instance, in a shared music activity, all involved people hear the same content at the same time (depending upon the latency of the used network connection). Everyone involved can control the shared activity, such as, for instance pausing a movie or selecting the next music track. The presentation settings, such as volume, can be controlled locally by each participant. People can also create a picture card together or jointly make a drawing or letter on a piece of virtual paper.

The symbolic representation may generally be performed by use of icons, graphics, text, trademarks, logos and in other ways. To the contrary, it may further also be shown by symbols which member(s) is / are not participating in any items at all, but only for user members which are member of the space.

Figure 3 shows a method of showing and using a media content item among two or more users of an space via a controller unit, wherein each user member of the space may use a media device to present the content of the media content item. In a preferred embodiment of the invention, the method is executed on one or more media devices and a controller unit.

Within step 99, the method is started. Variables, flags, buffers, etc., keeping track of media content items, spaces, users which are sharing and users which are not sharing activities etc. are set to default states on the controller unit(s), and when any media device accesses the controller unit, a similar action will be performed on the media device. When the method is started a second time, only corrupted variables, flags, buffers, registers, etc. are reset to default values.

Within step 100, a first information item jointly representing an space and at least one media content item belonging to the space may be transferring from the media device to the controller unit, the media content item and the space being based on a selection criterion performed by means of a user interface on the media device. Step 100 constitutes a generalization of steps 101, 102 and 103.

Within step 101, a first selection of an space may be received on the media device, wherein the space may be selected from more available (and already established) spaces. The user of the media device may in this step select a space he desires to view. He may choose his particular space among a variety of other available spaces.

Within step 102, a second selection of at least one media content item may be received on the media device. The media content item may be one that is currently being used by the selected space or another media content item, which had previously being used by the selected space of the foregoing step. In other words, in this step - after the selection of the space from the foregoing step - one or more media content items belonging to that space may be selected by the user.

Within step 103, said two selections may then be transferred to the controller unit. The selections of the space and the media content item(s) are here transferred to the controller unit from the media device. In summary, the controller unit now has information about which space the user of the media device has selected.

Within step 200, a second information item may be transferred from the controller unit to the media device, the second information item - which is determined on the controller unit as a response to the first information item - may represent the media content item and users participating in an activity of sharing the media content item. Step 200 constitutes a generalization of steps 201, 202 and 203

Within step 201, a presentation of the media content item presentable on the media device may be determined on the controller unit. It may be the situation that the controller unit has to transfer information to different media devices such as a TV, a PC, a lap-top, a Web-tablet, a mobile telephone, a personal digital assistant or a screen, therefore it may be appropriate to determine a particular presentation of the media content item that is dedicated to the corresponding media device. As an example, a video icon will most likely be presented by means of a low resolution on a small display on the mobile telephone (in step 300), whereas the same video icon will most likely be presented with more details in a higher resolution on the bigger screen on a TV (also in step 300).

Within step 202, users may be determined (of the selected space from step 101), these users are being looked up on the controller unit as members of the space using the media content item. The controller unit has information about various users; the information is compiled each time a user participates in said selected space.

Within step 203, said determinations may be transferring jointly to the media device. In other words, the determined users, i.e. the user himself and other users from step 202 and how to present (from step 201) the media content item in a symbolized form are here transferred to the media device.

Within step 300, a symbolic representation of the media content item and at least one first user of said media content item maybe presented on the display of the media device. This information is based on the transferred second information item from step 200 with sub-steps, which is received on the media device. Here, the user himself (of the media device), one or more other users (using other media device, but the same media content item(s)) and the media content item(s) shared of said user(s) are presented in a symbolic representation on the media device. Thereby the display of the media device - as explained in figure 2 - may present shared activities in the form of symbols, icons, etc. of media content items and users of said activities graphically. As indicated in figure 2, the users will typically be shown close to the activities which they are participants. The symbols, icons or other graphic may represent different content items such as a video, an image, a text, a drawing, a design, an e-mail, a memo, a movie, a video card, a media album and their users. The symbols, icons, etc., may further represent other content items like a chat-room, a game, a voice conference, a discussion, a concert or any another gathering where the members users share the activity without necessarily having to be physically together.

Within step 400, the shared activity is represented on the graphical user , interface of the media device in a schematic way. Step 400 constitutes a generalization of steps 401 through 405.

Generally - as opposed to step 300, which discussed the symbolic presentation of the media content item - the content of the media content item is here - by means of steps 400 through 405 - presented on the media device for all users participating in the activity. For example, the movie is shown to the users participating in the activity of watching a movie.

Within step 401, a modification or a start of the media content item presented may be determined on the media device. The user may modify the content of the media content item that he is using, e.g. he may key in a comment into a text, in an e-mail, in a memo since he may desire that all members of the shared activity of writing messages, should see the typed in comment. Correspondingly, other users sharing the same text may currently be reading and modifying the same text, and subsequently their media device(s) may determine how their content of the same media content item, i.e. in the example the text, was modified. Within this step the user may further decide to start an activity, i.e. to start participation in a communicating or a simply viewing of the content of a media content item, such as a video, an image, a text, a drawing or a design. The user may also decide to start an activity like a video conference, a chat-room, a game, a voice conference or a discussion.

Within step 402, the modification or the start (from the foregoing step) may be sent to the controller unit. Continuing the example from the foregoing step, the characters representing the modified text or the newly started activity is sent to the controller unit. Generally, start(s) and or modification(s) determined in the foregoing step are here reported, i.e. sent from the media device(s) to the controller unit. In particular, the newly started content item just mentioned maybe reflected in step 300, where this item - with its user - also will be shown symbolically on the display on the media device.

Within step 403, a new content of the media content item may be determined on the basis of a present content of the media content item on the controller unit and the received modification (of said content of the media content item). Still continuing the example from the two foregoing steps; the controller unit may have a copy of said text, i.e. the present content of the media content item, and may currently receive various modifications to the text (from media devices). On the basis of the present (previous) content and the received modification(s), the controller unit may then determine the new (updated) content of the media content, i.e. - continuing the example - the text with all (received) modifications.

Within step 404, the new content of the media content item may be transferred to the media device. In order to update media device(s) using and sharing the content of the media content item, these devices may in this step have the new content of the media content transferred to them from the controller unit in real time. Within step 405, the new content of the media content item may be presented on the media device. As a consequence of the received new content of the media content from the foregoing step, this may here be presented on the media device. In the example with various updates of a text from various users, the sum of all these updates, i.e. the new text with all modifications, may here be presented on the media device. Generally, when the wording "presentation of the content of a media content item" or similar wording is used, this is meant to include display of the content of the media content item with playback of sounds, music, speech, etc, if any, on the media device.

Within step 500, a third information item representing an action on the media device may be transferred from the media device to the controller unit. Step 500 constitutes a generalization of steps 501 through 504. One of said steps may be selected as the action.

Within step 501, a media content item and / or a third user may be added to the presentation on the media device. The user of the media device may here - by means of the graphical user interface on his media device - add a new media content, which he desires to be shared by the other users of the space. An example may be a new movie as a new media content, which he desires to share with the users of the space. Correspondingly, he may choose to add a fifth user, e.g. a friend also using his media device to the space. Subsequently these may also be presented on his media device - and by means of step 300 - also on other media devices used by member users of the same space such that the user interfaces on those media devices are synchronized copies of each other.

Within step 502, a media content item and / or a fourth user may be deleted from the presentation on the media device. Correspondingly - like the foregoing step - a media content item and / or a user of the space may here be removed. The removal of the media content item may indicate that this is not used any more by a particular user, however, other users of the space still sharing this media content item may continue their sharing and use of it.

Within step 503, a media content item and / or a fifth user from the presentation on the media device may be moved to a second presentation on a second media device. This step will be commented after step 504,

Within step 504, a media content item and / or a sixth user from the presentation on the media device may be copied to a third presentation of a third media device.

Within steps 503 and 504 - which may be compared to an action of moving and copying an icon on a PC or a Mac graphical user interface - these operations may have a similar effect on what (user(s) and or media content item(s)) is / are subsequently presented in a symbolic form on the media devices.

The controller unit will generally be notified with any action from the steps 501 through 504, and subsequently, the change(s) maybe reflected in steps 300 and 400. Within step 600, a symbolic representation of a level of engagement or activity of a second user participating in the use of the media content item may be presented on the media device. In the context of step 300, - but as an addition to step 300 - the level of engagement or the level of activity of a user (member) may further be shown.

Within step 700, a symbolic representation of a member not participating in any media content item may be presented on the media device. Also, in the context of step 300, - but again as an addition to step 300 - the member(s) not participating in any content item(s) may further be shown on the display of the media device, however, this primarily applies to user member(s) of the space.

Usually, the method will start all over again for as long as the media device controller unit system of figure 1 (where the method is implemented and executed) is powered and is properly exchanging said information with the media device(s). Otherwise, the method may terminate in step 800; however, when the system of the media device(s) and the controller unit is powered again, the method may proceed from step 100 again.

A computer readable medium may be magnetic tape, optical disc, digital video disk (DVD), compact disc (CD record-able or CD write-able), mini-disc, hard disk, floppy disk, smart card, PCMCIA card, etc. The computer readable medium, for example a CD, comprises computer readable software. This software is designed to perform the method according to the invention. This method can be performed upon a general personal computer that comprises at least a general purpose memory, a central processing unit (cpu), and a software bus via which communication between the cpu and the memory is accomplished. Furthermore, the personal computer comprises a CD reader that is designed to read the content of the CD and transfer the content into the general purpose memory of the personal computer such that the method according to the invention can be performed upon request of a user.

Claims

CLAIMS:

1. A method of sharing an activity between a first user and a second user, the method comprising the steps of

- representing the activity to the second user through a second user interface characterized in that the activity further comprises sharing a media content item between the first user and the second user and the method further comprises

- representing the media content item, a representation of the first user and a representation of the second user to the first user through the first user interface and to the second user through the second user interface - synchronizing the second user interface with the first user interface such that the second user interface substantially duplicates the first user interface.

2. A method according to claim 1, wherein the second user interface is synchronized in substantially real-time with the first user interface upon manipulation of the first user interface by the first user.

3. A method according to claim 2, wherein at least one of the media content item and the representation of the first user can be manipulated by the first user to start sharing the activity between the first user and the second user.

4. A method according to claim 3, wherein the media content item, the representation of the first user and the representation of the second user are comprised within a space.

5. A method according to claim 4, the method further comprising adding a second media content item to the space by the first user to enable sharing a second activity between the first user and the second user.

6. A method according to claim 4, the method further comprising deleting the media content item from the space by the first user to disable sharing the activity between the first user and the second user.

7. A method according to claim 4, the method further comprising adding a representation of a third user to the space by a third user through a third user interface.

8. A method according to claim 4, the method further comprising deleting the first user from the space by the first user through the first user interface.

9. A method according to any of the claims 5 to 8, the method further comprising updating the interfaces to represent the space such that the user interfaces are synchronized duplicates of each other.

10. A computer system for performing the method according to any one of claims

1 through 9.

11. A computer program product comprising program code means stored on a computer readable medium for performing the method of any one of claims 1 through 9 for use in a computer system.