EP3785443A1

EP3785443A1 - System and method for rendering stitched video media stream on a display device

Info

Publication number: EP3785443A1
Application number: EP19792506.8A
Authority: EP
Inventors: Narendera Kumar NATARAJAN; Shankar Jayaraman; Bharath Reddy MALLEPALLI
Original assignee: Reliance Jio Infocomm Ltd
Current assignee: Jio Platforms Ltd
Priority date: 2018-04-27
Filing date: 2019-04-25
Publication date: 2021-03-03
Also published as: WO2019207515A1; EP3785443A4

Abstract

A system [100] and method [300] for rendering a stitched video media stream on a first display device [112A] is disclosed. More particularly, the embodiments may disclose a method for establishing a video session between a first user equipment [102A] and a second user equipment [102B] based on a video session request; receiving a first video media stream associated with the first user equipment [102A] and a second video media stream associated with the second user equipment [102B]; receiving a request to render the stitched video media stream on the first display device [112A]; stitching the first video media stream and the second video media stream to form the stitched video media stream; receiving a streaming request to stream the stitched video media stream; and transmitting the stitched video media stream to the first network device [110A] for rendering the stitched video media stream on the first display device [112A].

Description

SYSTEM AND METHOD FOR RENDERING STITCHED VIDEO MEDIA STREAM ON A DISPLAY

DEVICE

TECHNICAL FIELD

Embodiments of the present invention generally relate to wireless communication. In particular, embodiments of the present invention relate to a system and method for stitching video media streams to form a stitched video media stream and rendering the stitched video media stream on display device/s.

BACKGROUND

This section is intended to provide information relating to general state of the art and thus any approach/functionality described herein below should not be assumed to be qualified as a prior art merely by its inclusion in this section.

Currently, the internet speed plays a pivotal role for providing fulfilling and seamless experience to users while availing one or more services such as video calling service. Further, with the advent in technology, the internet speed has been improved immensely for providing the seamless experience to the users by employing advanced technologies like long-term evolution (referred hereinafter as LTE).

In the present scenario, the video calling service has become the most used services availed by the users. Such huge demand for the video calling service results in a requirement of high- quality video calling service which must be provided to the users. Further, the users are demanding spontaneous access to high-definition (referred hereinafter as HD) live video content along with a higher-quality experience and more convergent video calling services than ever before.

Moreover, one or more feature phones and mobile devices are used by the user to avail the video calling services. The feature phones are typically handheld devices having additional functions (such as basic multimedia and internet functions) along with voice calling and text messaging functionalities. Such feature phones employ small display screen, low storage as well as processors and uses proprietary, custom-designed software and have user interface which lack the capabilities of the one or more mobile devices. The mobile devices are smart mobility wireless cellular connectivity devices that allows the users to use the services on 2G, 3G or 4G internet connections with an advanced operating system. Such mobile devices have relatively small display screen and limited memory as well as processing capabilities. With the ever-increasing number of the users availing the video calling service, the biggest challenge is to provide an excellent HD video calling experience due to the limited size of the display screen as well as processing capacity of the feature phones and the mobile devices. Further, using cameras with televisions for availing the video calling service poses challenges ranging from procurement of expensive cameras to reaching a consensus on providing a common application for the best video calling experience to the users.

Even on a technically superior mobile devices, the full experience of the HD video calling service with 720p and 1080p resolutions is incomplete due to the smaller size of the display screens and processing capacity of the mobile devices.

One approach to display video calls on a large screen is to render/render HD high quality resolution video calls from the feature phones/mobile devices to a television or any such display device that supports equivalent resolutions. Such rendering/rendering of video calls on the television changes the whole experience of the HD video calls. However, such approach of rendering/rendering HD videos from the feature phones/mobile devices directly to the television or any such display device possesses their own challenges. Such challenges are (a) introduction of lag/delay in rendering/rendering the HD video calls from the feature phones/mobile devices to the television or any display device, (b) loss of video call quality, and (c) compatibility of both the feature phones/mobile devices as well as the television/display device to support casting or other similar technologies. Due to such challenges, the existing approach of rendering the HD videos calls from the feature phones/mobile devices directly to the television/display device does not provide seamless and fulfilling experience to the users for the HD video calls.

Therefore, in view of above-mentioned drawbacks present in the existing approaches, there is a need for an efficient and effective approach for rendering/rendering video streams of the HD video calls on the television/display device without introducing any delay/lag and without any compatibility issues.

SUMMARY

This section is provided to introduce certain aspects of the present invention in a simplified form that are further described below in the detailed description. This summary is not intended to identify the key features or the scope of the claimed subject matter.

Embodiments of the present invention may relate to a method for rendering a stitched video media stream on a first display device, the method comprising: receiving a video session request to establish a video session between a first user equipment and a second user equipment, wherein the video session request is received from the first user equipment, and the video session is associated with a unique session identifier; establishing the video session between the first user equipment and the second user equipment upon an approval of the video session request by the second user equipment; receiving a first video media stream associated with the first user equipment and a second video media stream associated with the second user equipment, upon the establishment of the video session; receiving a request from the first user equipment to render the stitched video media stream of the video session on the first display device, wherein the request includes the unique session identifier of the video session, and the first user equipment and the first display device are connected to a first network device; stitching the first video media stream and the second video media stream of the video session to form the stitched video media stream based on the unique session identifier; receiving a streaming request from the first network device to stream the stitched video media stream of the video session; and transmitting the stitched video media stream of the video session to the first network device for rendering the stitched video media stream on the first display device.

Embodiments of the present invention may relate to a gateway for rendering a stitched video media stream on a first display device, the gateway comprising: a communication module configured to: receive a video session request to establish a video session between a first user equipment and a second user equipment, wherein the video session request is received from the first user equipment, and the video session is associated with a unique session identifier; establish the video session between the first user equipment and the second user equipment upon an approval of the video session request by the second user equipment; receive a first video media stream associated with the first user equipment and a second video media stream associated with the second user equipment, upon the establishment of the video session; receive a request from the first user equipment to render the stitched video media stream of the video session on the first display device, wherein the request includes the unique session identifier of the video session, and the first user equipment and the first display device are connected to a first network device; and a mixer configured to stitch the first video media stream and the second video media stream of the video session to form the stitched video media stream based on the unique session identifier; and the communication module is further configured to: receive a streaming request from the first network device to stream the stitched video media stream of the video session; and transmit the stitched video media stream of the video session to the first network device for rendering the stitched video media stream on the first display device.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated herein, and constitute a part of this present invention, illustrate exemplary embodiments of the disclosed methods and systems in which like reference numerals refer to the same parts throughout the different drawings. Components in the drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present invention. Also, the embodiments shown in the figures are not to be construed as limiting the invention, but the possible variants of the method and system according to the invention are illustrated herein to highlight the advantages of the invention. It will be appreciated by those skilled in the art that disclosure of such drawings includes disclosure of electrical components or circuitry commonly used to implement such components.

FIG.l illustrates an exemplary system architecture [100] for stitching video media streams to form a stitched video media stream and rendering the stitched video media stream on display device, in accordance with an embodiment of the present invention.

FIG.2 illustrates an exemplary gateway [106], in accordance with an exemplary embodiment of the present invention.

FIG.3 illustrates an exemplary method flow diagram [300] for stitching video media streams to form a stitched video media stream and rendering the stitched video media stream on display device, in accordance with an embodiment of the present invention.

FIG.4 illustrates an exemplary signaling flow diagram [400] for stitching video media streams to form a stitched video media stream and rendering the stitched video media stream on display device, in accordance with an embodiment of the present invention.

DETAILED DESCRIPTION

In the following description, for the purposes of explanation, various specific details are set forth in order to provide a thorough understanding of embodiments of the present invention. It will be apparent, however, that embodiments of the present invention may be practiced without these specific details. Several features described hereafter can each be used independently of one another or with any combination of other features. An individual feature may not address any of the problems discussed above or might address only one of the problems discussed above. Some of the problems discussed above might not be fully addressed by any of the features described herein. Example embodiments of the present invention are described below, as illustrated in various drawings in which like reference numerals refer to the same parts throughout the different drawings.

The present invention encompasses a system and a method for stitching video media streams to form a stitched video media stream and rendering the stitched video media stream on a display device, wherein stitched video media stream is rendered on the display device upon receiving a request from a user equipment. Further, the display device and the user equipment are connected to a network device. Such stitching of the video media streams and rendering the stitched video media stream on the display device is performed by a gateway, wherein the stitched video media stream is rendered on the display device upon receiving a streaming request from the network device.

As used herein, the media stream may refer to one or more streams/packets of a video call session, a conference call session, an interactive content session, an augmented reality session, a virtual reality session, a game play session and any such session that is obvious to a person skilled in the art.

As used herein, the user equipment may refer to any feature phone or mobile device that allows users to avail at least one service (such as video call session, audio call session, interactive content session, augmented reality session, virtual reality session, game play session) on 2G, 3G or 4G cellular/broadband (Wi-Fi access point) internet wireless connections. Further, the user equipment may have a user interface, a transceiver, an antenna, least one processor, music players, camera/s, wireless connectivity functionalities, motion sensor/s, at least one memory storing one or more applications, payment mechanisms and enhanced security features with alarm and alert in emergency situations. Such user equipment may include, but not limited to, a mobile phone, a feature phone, a tablet, a wearable device, a smart band, a wearable augmented device, a phablet, a personal digital assistance and any such equipment that is obvious to a person skilled in the art.

As used herein, the display device may refer to an interactive audio/video media stream delivery medium which provides audio-visual media streams to the users. Specifically, the display device may render/render the audio-visual media streams and thereby, enabling the users to view the media streams on a screen of the display device. Also, the display device may have the capability to connect with the network device. For instance, the display device may have one or more high-definition multimedia interface (FIDMI) slots in which the network device may be plugged-in or may be connected through an RCA cable. Additionally, the display device may also connect with at least one Wi-Fi access point/2G, 3G or 4G mobile for availing the internet. Further, the display device may render broadcasted video and audio media streams on the screen of the display device and may also facilitate the user to interact with the media streams, e.g. to make selections or purchase audio/video media streams etc. Moreover, the display device may have at least one processor, at least one memory, a transceiver connected to an antenna, at least one codec (encoder/decoder), the screen, the HDMI slot/s, at least one RCA connector, one or more slots, tuner/s, and controller/s. Such display device may include, but not limited to, a virtual reality device, an augmented reality device, a television, a computer desktop screen, any such device that is obvious to a person skilled in the art.

As used herein, the network device may refer to a small piece of hardware device that connects with the display device and thereby, providing the network device with additional functionality of media streaming. Further, the network device are meant to plug directly into the FIDMI slot of the display device or may be connected through the RCA cable. Such network devices may be connected to at least one Wi-Fi access point through a wireless router or to at least one home gateway of a wireless Long-term Evolution (LTE)/Global System for Mobile Communication (GSM) cellular network and accessed through/operated using the user equipment. Also, the network device may have the capability to stream and access the video/audio media streams from a gateway and/or a media server. Moreover, the network device may have at least one processor, at least one memory, a transceiver connected to an antenna, and at least one codec (encoder/decoder). The network device may include, but not limited to, a dongle, a data card, an adaptor, a router, a gateway and any such device that is obvious to a person skilled in the art.

As used herein, the gateway communicatively coupled with the media server and may be responsible for receiving the video/audio media streams/packets from the one or more user equipments and transmitting the video/audio media streams to the one or more user equipments. Also, the gateway may route the audio/video media streams from the one or more user equipments to the media server and may transmit the audio/video media streams to the network device based on a streaming request from the network device. Further, the gateway may also be responsible for establishing at least one of the video call session, the audio call session, the conference call session, the interactive content session, the augmented reality session, the virtual reality session, and the game play session between the user equipments. In a preferred embodiment, the gateway may be a media gateway. The structure and responsibilities of the gateway is explained below in greater details. As used herein, the media server may host live or pre-recorded audio/video media streams and may also transmit the audio/video media streams to the network device. Further, the media server may allow two types of audio/video media streaming such as normal streaming and progressive downloading. In normal streaming, the media server may employ some application- level means to control the bit-rate of the transmitted video/audio media streams. The target is to transmit the media stream at a rate that is approximately equal to the playback rate. Some the media server may adjust the video/audio media streams on the fly to meet the available network bandwidth and to avoid network congestion.

As illustrated in FIG.1, the present invention illustrates an exemplary system architecture [100] for stitching video media streams to form a stitched video media stream and rendering the stitched video media stream on display device, in accordance with an embodiment of the present invention. The exemplary system architecture [100] in FIG.l depicts: a first user equipment [102A], a first network device [110A] connected with a first display device [112A], a second user equipment [102B], a second network device [HOB] connected with a second display device [112B], a gateway [106] connected with a media server [108], and a network [104]

When a first user associated with the first user equipment [102A] wishes to establish a video session with a second user associated with the second user equipment [102B], the first user may use the first user equipment [102A] to transmit a video session request to the second user equipment [102B] In particular, the video session request is transmitted from the first user equipment [102A] to the gateway [106] and subsequently, the gateway [106] transmits the video session request to the second user equipment [102B] Any communication between the first user equipment [102A] and the second user equipment [102B] occurs through the gateway [106] and by using the network [104]

Further, the video session comprises one of a video call session, a conference call session, an interactive content session, an augmented reality session, a virtual reality session, and a game play session. Moreover, the video session request may include a unique session identifier associated with the video session and is used for identifying the video session between the first user associated with the first user equipment [102A] and the second user associated with the second user equipment [102B] The video session request may also include at least one of an identifier of the first user, an identifier of the second user, an identifier of the first user equipment [102A], and an identifier of the second user equipment [102B] Such identifiers may be used to identify the first user/the first user equipment [102A] and/or the second user/the second user equipment [102B] for establishing the video session between the first user associated with the first user equipment [102A] and the second user associated with the second user equipment [102B] The identifier of the first user may include, but not limited to, a name, a contact number, an email id and any such identifier associated with the first user. The identifier of the first user equipment [102A] may include, but not limited to, a home/global international mobile subscriber identity (IMSI), a home/global international mobile equipment identity (IMEI), a media access control address (MAC address), and any such identifier associated with the first user equipment [102A] Similarly, the identifier of the second user may include, but not limited to, a name, a contact number, an email id and any such identifier associated with the second user. The identifier of the second user equipment [102B] may include, but not limited to, a home/global international mobile subscriber identity (IMSI), a home/global international mobile equipment identity (IMEI), a media access control address (MAC address), and any such identifier associated with the second user equipment [102B] For an instance, the video session request from the first user equipment [102A] to the second user equipment [102B] may include the contact number of the first user and the contact number of the second user for identifying both the users. In another instance, the video session request may include an email id of the first user and an email id of the second user for identifying both the users.

On receiving the video session request by the second user equipment [102B], the second user may approve/deny the video session request received from the first user equipment [102A] In an event, the second user approves the video session request, the video session is established between the first user associated with the first user equipment [102A] and the second user associated with the second user equipment [102B] through the gateway [106] using the network [104] In an event, the second user deny/rejects the video session request, then video session is not established between the first user associated with the first user equipment [102A] and the second user associated with the second user equipment [102B]

In the event, the second user approves the video session request and subsequently establishing the video session, a first video media stream associated with the first user equipment [102A] is received by the gateway [106] from the first user equipment [102A] using the network [104] Similarly, a second video media stream associated with the second user equipment [102B] is received by the gateway [106] from the second user equipment [102B] using the network [104] The gateway [106] may subsequently transmit the first video media stream to the second user equipment [102B] using the network [104] and then, the first video media stream is rendered on the second user equipment [102B] Likewise, the gateway [106] may also transmit the second video media stream to the first user equipment [102A] using the network [104] and then, the second video media stream is rendered on the first user equipment [102A]

The first network device [110A] and the first user equipment [102A] may be connected with a first Wi-Fi access point (not shown in FIG.1) using wireless connection/s. Alternatively, the first user equipment [102A] may provide cellular network and connect with first network device [110A] when the first user equipment [102A] acts as the first Wi-Fi access point by using hotspot functionality of the first user equipment [102A] Particularly, the first user equipment [102A] may operate and control the first network device [110A] using an application installed and stored in the first user equipment [102A] and if the first network device [110A] and the first user equipment [102A] are connected with the first Wi-Fi access point or through cellular network. Such cellular network may include a wireless GSM network or a wireless LTE network. Additionally, the first network device [110A] may connect with the first display device [112A], wherein the first network device [110A] may be plugged in a FIDMI port of the first display device [112A]

Considering a first exemplary scenario, when the first user may wish to render a stitched video media stream on the first display device [112A] during the video session. Further, the stitched video media of the video session may comprise both of the first video media stream associated with the first user equipment [102A] and the second video media stream associated with the second user equipment [102B] In specific, the first user may wish to render both of the first video media stream and the second video media stream together on the first display device [112A] In order to render the stitched video media stream of the video session on the first display device [112A], the connections between the first user equipment [102A], the first network device [110A], the first display device [112A], and the first Wi-Fi access point are checked to ensure that these devices and/or equipments are connected properly with each other to render the stitched video media stream of the video session.

In such first scenario, the first user may use the first user equipment [102A] to transmit a request to the gateway [106] for rendering the stitched video media stream of the video session on the first display device [112A] Such request may include the unique session identifier of the video session established between the first user equipment [102A] and the second user equipment [102B] On receiving the request from the first user equipment [102A] for rendering the stitched video media stream of the video session, the gateway [106] may identify the unique session identifier associated with the request. Based on the unique session identifier, the gateway [106] may identify the first video media stream and the second video media stream associated with the video session. Once the gateway [106] identify the first video media stream and the second video media stream based on the unique session identifier of the video session, the gateway [106] may stitch the first video media stream and the second video media stream to form the stitched video media stream of the video session. Such stitching of the first video media stream and the second video media stream is based on the unique session identifier of the video session.

Meanwhile, the gateway [106] may generate a means for the video session and may transmit the means to the first user equipment [102A] Such means may be a unique resource link, an Internet Protocol (IP) address, or an identifier, or any other such means that may be used by the first user equipment [102A] to stream the stitched video media stream of the video session from the gateway [106] When the first user equipment [102A] receives the means from the gateway [106], the first user equipment [102A] may transmit/share the means with the first network device [110A] On receiving the means from the first user equipment [102A], the first network device [110A] may transmit a streaming request to the gateway [106] to stream the stitched video media stream of the video session, wherein the streaming request includes the means. When the gateway [106] receives the streaming request from the first network device [110A], the gateway [106] may transmit the stitched video media stream of the video session to the first network device [110A] using the said means. As depicted in FIG.l, the gateway [106] is communicatively coupled with the media server [108] and works in conjunction with the media server [108] Therefore, in an alternative embodiment, the gateway [106] may communicate with the media server [108] for the stitched video media stream of the video session in an event the gateway [106] receives the streaming request from the first network device [110A], wherein the media server [108] host the stitched video media stream of the video session. In response, the media server [108] may provide the stitched video media stream of the video session to the gateway [106] and subsequently, the gateway [106] may transmit the stitched video media stream of the video session to the first network device [110A] using the means. Thereby, the first network device [110A] may communicate with the media server [108] via the gateway [106] for streaming the stitched video media stream of the video session.

On receiving the stitched video media stream of the video session from the gateway [106] using the means, the first network device [110A], connected to the first display device [112A], may render the stitched video media stream of the video session on the first display device [112A] Thereby, the first user equipment [102A] may now view the stitched video media stream associated with the video session on the first display device [112A]

In a preferred embodiment, the gateway [106] may host the stitched video media stream of the video session. In an alternative embodiment, the gateway [106] may transmit the stitched video media stream to the media server [108] and in turn, the first network device [110A] may stream the stitched video media stream using the means from the media server [108] through the gateway [106]

Considering an exemplary second scenario, when the second user may also wish to render the stitched video media stream on the second display device [112B] during the video session. In such second scenario, the second user may use the second user equipment [102B] to transmit a request to the gateway [106] for rendering the stitched video media stream of the video session on the second display device [112B] Such request may include the unique session identifier of the video session established between the first user equipment [102A] and the second user equipment [102B] On receiving the request from the second user equipment [102B], the gateway [106] may identify the first video media stream and the second video media stream associated with the video session based on the unique session identifier. Once the gateway [106] identify the first video media stream and the second video media stream, the gateway [106] may stitch the first video media stream and the second video media stream to form the stitched video media stream of the video session. Such stitching of the first video media stream and the second video media stream is based on the unique session identifier of the video session.

Meanwhile, the gateway [106] may transmit the means of the video session to the second user equipment [102B] When the second user equipment [102B] receives the means from the gateway [106], the second user equipment [102B] may transmit/share the means with the second network device [HOB] On receiving the means from the second user equipment [102B], the second network device [HOB] may transmit a streaming request to the gateway [106] for streaming the stitched video media stream of the video session, wherein the streaming request includes the means. When the gateway [106] receives the streaming request from the second network device [HOB], the gateway [106] may transmit the stitched video media stream of the video session to the second network device [HOB] using the means. On receiving the stitched video media stream of the video session from the gateway [106] using the means, the second network device [HOB], connected to the second display device [112B], may render the stitched video media stream of the video session on the second display device [112B] Thereby, the second user associated with the second user equipment [102B] may now view the stitched video media stream associated with the video session on the second display device [112B]

The connections for the exemplary second scenario are as follows: the second network device [HOB] may connected with the second display device [112B], wherein the second network device [HOB] may be plugged in a HDM I port of the second display device [112B] Moreover, the second network device [110B] and the second user equipment [102B] may be connected with a second Wi-Fi access point (not shown in FIG.l) using wireless connection/s. Alternatively, the second user equipment [102B] may provide cellular network and connect with second network device [110B] when the second user equipment [102B] acts as the second Wi-Fi access point by using hotspot functionality of the second user equipment [102B] Particularly, the second user equipment [102B] may operate and control the second network device [110B] using an application installed and stored in the second user equipment [102B], and if the second network device [110B] and the second user equipment [102B] are connected with the second Wi-Fi access point or through cellular network. In order to render the stitched video media stream of the video session on the second display device [112B], the connections between the second user equipment [102B], the second network device [110B], the second display device [112B], and the second Wi-Fi access point are checked to ensure that these devices and/or equipments are connected properly with each other to render the stitched video media stream of the video session.

As illustrated in FIG.2, the present invention illustrates an exemplary gateway [106], in accordance with an exemplary embodiment of the present invention, the gateway [106] comprising, but not limited to: a communication module [202], a mixer [204], and a processor [206] connected to a memory [208]

The communication module [204] may be configured to communicate with the first user equipment [102A], the second user equipment [102A], the first network device [110A] and the second network device [HOB] Such communication may include, but not limited to, receive the video session request to establish the video session between the first user equipment [102A] and the second user equipment [102B], receive the request from the first user equipment [102A] for rendering the stitched video media stream of the video session on the first display device [112A], receive the request from the second user equipment [102B] for rendering the stitched video media stream of the video session on the second display device

[112B], establish the video session between the first user equipment and the second user equipment [102B], receive the first video media stream associated with the first user equipment [102A] and the second video media stream associated with the second user equipment [102B], transmit the means to the first user equipment [102A], receive streaming request from the first network device [110A] to stream the stitched video media stream of the video session, receive streaming request from the second network device [HOB] to stream the stitched video media stream of the video session, transmit the stitched video media stream of the video session to the first network device [110A], and transmit the stitched video media stream of the video session to the second network device [HOB]

The mixer [204] may be configured to identify the first video media stream and the second video media stream based on the unique session identifier of the video session, stitch the first video media stream and the second video media stream to form the stitched video media stream of the video session, and generate the means for the video session.

The processor [206] may be communicatively coupled with the communication module [202], and the mixer [204], and may be configured to perform one or more operations. The processor [206] as used herein may include, but is not limited to, a processor or set of processors such as a microprocessor, a multi-core microprocessor, a digital signal processor, a collection of electronic circuits, or a combination thereof and may be configured to perform operations /functions.

The memory [208], coupled to the processor [206], may be configured to store and manage multiple data sets including the unique session identifier associated with the video session, the means for the video session etc. The memory [208] may include, but is not limited to, a volatile memory, non-volatile memory, a remote storage, a cloud storage, high-speed random-access memory and/or non-volatile memory, such as one or more magnetic disk storage devices, one or more optical storage devices, and/or flash memory (e.g., NAND, NOR) or a combination thereof.

As used herein, the mixer [204] may provide encoded video media streams. The processor [206] may extract overhead data from the video media streams. Further, a decoder may be provided in the mixer [204] for at least partially decoding the encoded video media streams. For instance, a rate control processor re-encodes the at least partially decoded video media streams at different rates, to produce multiple re-encoded video media streams having different rates. Moreover, the mixer [204] may combine the overhead data with each re encoded video media streams, thereby providing multiple versions of the encoded video media streams at different rates. In a preferred embodiment, the mixer [204] may be a multiplexer/transcoder that simultaneously provides the multiple versions of the encoded video media streams substantially. The encoded video media streams may be compressed video bit stream, with the mixer [204] being located at the media server [108] for simultaneously providing multiple versions of the video media streams to different user equipments, at different rates substantially.

As illustrated in FIG.3, the present invention illustrates an exemplary method flow diagram [300] for stitching video media streams to form the stitched video media stream and rendering the stitched video media stream on the display device, in accordance with an embodiment of the present invention, wherein the method being performed by the gateway [106] The method flow initiates at step 302.

At step 304, the gateway [106] may receive the video session request from the first user equipment [102A] to establish the video session with the second user associated with the second user equipment [102B]

At step 306, the gateway [106] may check if the video session request approved by the second user equipment [102B] or not.

At step 308, the gateway [106] may establish the video session with the second user associated with the second user equipment [102B] if the gateway [106] receive the approval of the video session request from the second user equipment [102B] In an event, the video session request is not approved by the second user equipment [102B], then the video session is not established between the first user associated with the first user equipment [102A] and the second user associated with the second user equipment [102B] by the gateway [106]

At step 310, the gateway [106] may receive the first video media stream from the first user equipment [102A] and the second video media stream from the second user equipment [102B], upon the establishment of the video session.

At step 312, the gateway [106] may receive the request from the first user equipment [102A] for rendering the stitched video media stream of the video session on the first display device [112A], wherein the first user equipment [102A] and the first display device [112A] are connected with the first network device [110A]

At step 314, the gateway [106] may identify the first video media stream and the second video media stream based on the unique session identifier of the video session and may stitch the first video media stream and the second video media stream to form the stitched video media stream of the video session based on the unique session identifier. Further, the gateway [106] may generate the means for the video session and may transmit the means to the first user equipment [102A] Such means may be a unique resource link, an IP address, or an identifier that is used by the first user equipment [102A] to stream the stitched video media stream of the video session from the gateway [106], wherein the stitched video media stream is associated with the video session. Also, the first user equipment [102A] may transmit/share the means with the first network device [110A]

At step 316, the gateway [106] may receive the streaming request from the first network device [110A] to stream the stitched video media stream of the video session. Such streaming request may also include the means.

At step 318, the gateway [106] may transmit the stitched video media stream of the video session to the first network device [110A], wherein the first network device [110A] may render the stitched video media stream of the video session on the first display device [112A] In an alternative embodiment, the gateway [106] may communicate with the media server [108] for the stitched video media stream of the video session. Then, the media server [108] may provide the stitched video media stream of the video session to the gateway [106] in an event the media server [108] hosts the stitched video media stream and subsequently, the gateway [106] may transmit the stitched video media stream of the video session to the first network device [110A] using the means. Thereby, the first network device [110A] may communicate with the media server [108] via the gateway [106] for streaming the stitched video media stream of the video session. Then, the method [300] may end at step 320.

As illustrated in FIG.4, the present invention illustrates an exemplary signaling flow diagram [400] for stitching video media streams to form the stitched video media stream and rendering the stitched video media stream on the display device, in accordance with an embodiment of the present invention.

At step 402, the first user may use the first user equipment [102A] to transmit the request to the gateway [106] for rendering the stitched video media stream of the video session on the first display device [112A]

At step 404, the gateway [106] may transmit the request to the second user equipment [102B] and check if the video session request approved/permitted by the second user equipment [102B] or not.

At step 406, the second user equipment [102B] may approve the video session request and may send the approval to the gateway [106]

At step 408, the gateway [106] may establish the video session between the first user associated with the first user equipment [102A] and the second user associated with the second user equipment [102B] using the network [104], upon approval of the video session request.

At step 410A, the gateway [106] may also receive the first video media stream from the first user equipment [102A] using the network [104] At step 410B, the gateway [106] may also receive the second video media stream from the second user equipment [102B] using the network [104]

At step 412, the first user may use the first user equipment [102A] to transmit the request to the gateway [106] for rendering the stitched video media stream of the video session on the first display device [112A], wherein the first user equipment [102A] and the first display device [112A] are connected with the first network device [110A]

At step 414, the gateway [106] may identify the unique session identifier associated with the request. Based on the unique session identifier, the gateway [106] may identify the first video media stream and the second video media stream associated with the video session.

At step 416, the gateway [106] may stitch the first video media stream and the second video media stream to form the stitched video media stream of the video session. Such stitching of the first video media stream and the second video media stream is based on the unique session identifier of the video session.

At step 418, the gateway [106] may generate the means for the video session and may transmit the means to the first user equipment [102A] Such means may be a unique resource link, an IP address, or an identifier that is used by the first user equipment [102A] to stream the stitched video media stream of the video session from the gateway [106], wherein the stitched video media stream is associated with the video session.

At step 420, the first user equipment [102A] may transmit/share the means with the first network device [110A]

At step 422, the first network device [110A] may transmit the streaming request to the gateway [106] to stream the stitched video media stream of the video session, wherein the streaming request includes the means. In an alternative embodiment, the gateway [106] may communicate with the media server [108] for the stitched video media stream of the video session in an event the gateway [106] receives the streaming request from the first network device [110A], wherein the media server [108] host the stitched video media stream of the video session.

At step 424, the gateway [106] may transmit the stitched video media stream of the video session to the first network device [110A] using the means, when the gateway [106] receives the streaming request from the first network device [110A] Alternatively, the media server [108] may provide the stitched video media stream of the video session to the gateway [106] in an event the media server [108] hosts the stitched video media stream and subsequently, the gateway [106] may transmit the stitched video media stream of the video session to the first network device [110A] using the means. Thereby, the first network device [110A] may communicate with the media server [108] via the gateway [106] for streaming the stitched video media stream of the video session.

At step 426, the first network device [110A], connected to the first display device [112A], may render the stitched video media stream of the video session on the first display device [112A] Thereby, the first user associated with the first user equipment [102A] may now view the stitched video media stream associated with the video session on the first display device [112A]

The present invention provides the following technical advantages over the existing approaches: 1) elimination of lag/delay in rendering/rendering the video media streams to the display devices from the user equipments by directly rendering/rendering the video media streams to the display devices from the network devices, (2) elimination of compatibility of the user equipments and the display devices to support the video calling applications, 3) direct streaming of the video media streams by the network devices from the gateway/media server, 4) direct communication of the network devices and the display devices for rendering/rendering the video media streams thereby maintaining the original video quality as received from the network.

Although, the present invention has been described with respect to the exemplary system architecture [100] where the first user equipment [102A] is connected with the first network device [110A], the first network device [110A] is connected with the first display device [112A], the first user equipment [102A] transmits the video session request, the first user equipment [102A] transmits the request to render the stitched video media stream, and the first network device [110A] transmits the streaming request to stream the stitched video media stream; however, it will be appreciated by those skilled in the art that the any number of user equipments may be connected with any network device, any number of network devices may be connected with the any display device, any user equipment may transmit the video session request, any user equipment may transmit the request to render the stitched video media stream, and any network device may transmit the streaming request to stream the stitched video media stream; and all such scenarios and embodiments shall be encompassed by the present invention.

The units, interfaces, modules, and components depicted in the figures and described herein may be present in the form of a hardware, a software and a combination thereof. Connection/s shown between these the user equipments [102A/102B], the display devices [112A/112B], the network devices [110A/110B], the gateway [106], the media server [108], any other units, components, modules and interfaces in the exemplary system architecture [100], may interact with each other through various logical links and/or physical links. Further, the user equipments [102A/102B], the display devices [112A/112B], the network devices [110A/110B], the gateway [106], the media server [108], any other units, components, modules and interfaces may be connected in other possible ways.

Though a limited number of the user equipments [102A/102B], the display devices [112A/112B], the network devices [110A/110B], the gateway [106], the media server [108], any other units, components, modules and interfaces have been shown in the figures; however, it will be appreciated by those skilled in the art that the exemplary system architecture [100] of the present invention encompasses any number and varied types of the entities/elements such the user equipments [102A/102B], the display devices [112A/112B], the network devices [110A/110B], the gateway [106], the media server [108], any other units, components, modules and interfaces.

While considerable emphasis has been placed herein on the disclosed embodiments, it will be appreciated that many embodiments can be made and that many changes can be made to the embodiments without departing from the principles of the present invention. These and other changes in the embodiments of the present invention will be apparent to those skilled in the art, whereby it is to be understood that the foregoing descriptive matter to be implemented is illustrative and non-limiting.

Claims

We Claim:

1. A method [300] for rendering a stitched video media stream on a first display device

[112A], the method comprising:

receiving a video session request to establish a video session between a first user equipment [102A] and a second user equipment [102B], wherein the video session request is received from the first user equipment [102A], and

the video session is associated with a unique session identifier;

establishing the video session between the first user equipment [102A] and the second user equipment [102B] upon an approval of the video session request by the second user equipment [102B];

receiving a first video media stream associated with the first user equipment

[102A] and a second video media stream associated with the second user equipment [102B], upon the establishment of the video session; receiving a request from the first user equipment [102A] to render the stitched video media stream of the video session on the first display device [112A], wherein

the request includes the unique session identifier of the video session, and

the first user equipment [102A] and the first display device [112A] are connected to a first network device [110A];

stitching the first video media stream and the second video media stream of the video session to form the stitched video media stream based on the unique session identifier;

receiving a streaming request from the first network device [110A] to stream the stitched video media stream of the video session; and

transmitting the stitched video media stream of the video session to the first network device [110A] for rendering the stitched video media stream on the first display device [112A]

2. The method [300] as claimed in Claim 1, further comprising, generating and transmitting a means to the first user equipment [102A] for streaming the stitched video media stream, wherein the first user equipment [102A] transmits the means to the first network device [110A]

3. The method [300] as claimed in Claim 1, further comprising, receiving a second request from the second user equipment [102B] to render the stitched video media stream of the video session on a second display device [112B], wherein

the request includes the unique session identifier of the video session, and the second user equipment [102B] and the second display device [112B] are connected to a second network device [HOB]

4. The method [300] as claimed in Claim 3, further comprising, receiving a streaming request from the second network device [HOB] to stream the stitched video media stream of the video session.

5. The method [300] as claimed in Claim 3, further comprising, transmitting the stitched video media stream of the video session to the second network device [HOB] for rendering the stitched video media stream on the second display device [112B]

6. The method [300] as claimed in Claim 1, further comprising, identifying at least two video media streams associated with the unique session identifier for performing the stitching, wherein the least two video media streams correspond to the first video media stream and the second video media stream.

7. The method [300] as claimed in Claim 1, wherein the video session comprises one of a video call session, a conference call session, an interactive content session, an augmented reality session, a virtual reality session and a game play session.

8. The method [300] as claimed in Claim 1, wherein the first user equipment [102A] and the first network device [110A] are connected to one of a first Wi-Fi access point and a cellular network.

9. The method [300] as claimed in Claim 1, wherein the first network device [110A] is plugged in a high-definition multimedia interface port of the first display device [112A]

10. The method [300] as claimed in Claim 1 and Claim 2, wherein the streaming request includes the means for streaming the stitched video media stream of the video session and the stitched video media stream is transmitted to the first network device [110A] using the means.

11. A gateway [106] for rendering a stitched video media stream on a first display device

[112A], the gateway [106] comprising:

a communication module [202] configured to: receive a video session request to establish a video session between a first user equipment [102A] and a second user equipment [102B], wherein

the video session request is received from the first user equipment [102A], and

the video session is associated with a unique session identifier; establish the video session between the first user equipment [102A] and the second user equipment [102B] upon an approval of the video session request by the second user equipment [102B];

receive a first video media stream associated with the first user equipment [102A] and a second video media stream associated with the second user equipment [102B], upon the establishment of the video session;

receive a request from the first user equipment [102A] to render the stitched video media stream of the video session on the first display device [112A], wherein

the request includes the unique session identifier of the video session, and

the first user equipment [102A] and the first display device [112A] are connected to a first network device [110A]; and

a mixer [204] configured to stitch the first video media stream and the second video media stream of the video session to form the stitched video media stream based on the unique session identifier; and

the communication module [202] is further configured to:

receive a streaming request from the first network device [110A] to stream the stitched video media stream of the video session; and transmit the stitched video media stream of the video session to the first network device [110A] for rendering the stitched video media stream on the first display device [112A]

12. The gateway [106] as claimed in Claim 11, further comprising, the communication module [202] configured to receive a second request from the second user equipment [102B] for rendering the stitched video media stream of the video session on a second display device [112B], wherein the second request includes the unique session identifier of the video session, and

the second user equipment [102B] and the second display device [112B] are connected to a second network device [HOB]

13. The gateway [106] as claimed in Claim 12, further comprising, the communication module [202] configured to receive a streaming request from the second network device [HOB] to stream the stitched video media stream of the video session.

14. The gateway [106] as claimed in Claim 12, further comprising, the communication module [202] configured to transmit the stitched video media stream of the video session to the second network device [HOB] for rendering the stitched video media stream of the video session on the second display device [112B]

15. The gateway [106] as claimed in Claim 11, further comprising, the mixer [204] configured to identify at least two video media streams associated with the unique session identifier for performing the stitching, wherein the least two video media streams correspond to the first video media stream and the second video media stream.

16. The gateway [106] as claimed in Claim 11, further comprising, the mixer [204] configured to generate a means for streaming the stitched video media stream.

17. The gateway [106] as claimed in Claim 11 and Claim 16, further comprising, the communication module [202] configured to transmit the means to the first user equipment [102A] to stream the stitched video media stream, wherein the first user equipment [102A] transmits the means to the first network device [110A]

18. The gateway [106] as claimed in Claim 11, wherein the video session comprises one of a video call session, a conference call session, an interactive content session, an augmented reality session, a virtual reality session, and a game play session.

19. The gateway [106] as claimed in Claim 11, wherein the first user equipment [102A] and the first network device [110A] are connected to one of a first Wi-Fi access point and a cellular network.

20. The gateway [106] as claimed in Claim 11, wherein the first network device [110A] is plugged in a high-definition multimedia interface port of the first display device [112A]

21. The gateway [106] as claimed in Claim 11 and Claim 17, wherein the streaming request includes the means for streaming the stitched video media stream of the video session.

22. The gateway [106] as claimed in Claim 16, wherein the means includes one of a unique resource link (URL), an internet protocol (IP) address, and an identifier.

23. The method [300] as claimed in Claim 2, wherein the means includes one of a unique resource link (URL), an internet protocol (IP) address, and an identifier.