Nothing Special   »   [go: up one dir, main page]

EP1025695A4 - Method for embedding links to a networked resource in a transmission medium - Google Patents

Method for embedding links to a networked resource in a transmission medium

Info

Publication number
EP1025695A4
EP1025695A4 EP98923360A EP98923360A EP1025695A4 EP 1025695 A4 EP1025695 A4 EP 1025695A4 EP 98923360 A EP98923360 A EP 98923360A EP 98923360 A EP98923360 A EP 98923360A EP 1025695 A4 EP1025695 A4 EP 1025695A4
Authority
EP
European Patent Office
Prior art keywords
information
link
access
networked
providing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP98923360A
Other languages
German (de)
French (fr)
Other versions
EP1025695A1 (en
Inventor
Robert T Durst Jr
Kevin Hunter
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Neomedia Technologies Inc
Original Assignee
Neomedia Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Neomedia Technologies Inc filed Critical Neomedia Technologies Inc
Publication of EP1025695A1 publication Critical patent/EP1025695A1/en
Publication of EP1025695A4 publication Critical patent/EP1025695A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H20/00Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/86Arrangements characterised by the broadcast information itself
    • H04H20/93Arrangements characterised by the broadcast information itself which locates resources of other pieces of information, e.g. URL [Uniform Resource Locator]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L61/00Network arrangements, protocols or services for addressing or naming
    • H04L61/30Managing network names, e.g. use of aliases or nicknames
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/08Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
    • H04N7/087Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division with signal insertion during the vertical blanking interval only
    • H04N7/088Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division with signal insertion during the vertical blanking interval only the inserted signal being digital

Definitions

  • This invention relates to a method for providing access to networked resources, and in particular to linking the information content of an audio/video information signal to networked resources via under-utilized resources of A transmission medium.
  • Networked data sources such as those found on the Internet, are a rich and important means of information retrieval and distribution and, increasingly, electronic commerce.
  • search engines such as Yahoo on the World-Wide Web (WWW)
  • WWW World-Wide Web
  • source addresses e.g., Uniform Resource Locators ("URLs")
  • URLs are particularly difficult to manually enter m software programs, such as "web browsers", due to their length and use of complex and unfamiliar symbols. If the characters m an address are not entered exactly, retrieval is prevented or, m a limited number of cases, a legal but incorrect source is accessed. This is especially true when URLs incorporate foreign languages and/or complex query instructions to networked databases, as is increasingly frequent in most web sites. In addition, the inability to type or otherwise manually enter symbolic address information due to either disability or lack of training complicates use of networked information resources such as the Internet for millions of individuals.
  • the so-called web—ready television is a television that can receive and display conventional broadcast television signals, which has means for allowing a user to access the WWW by providing a modem and appropriately programmed microprocessor based control circuitry.
  • a software module such as a web browser is used to allow the user to dial-up an Internet service provider (ISP) and request files from host servers on the Internet.
  • the downloaded Web pages may be displayed via the browser on a portion of the TV screen (i.e. via picture-m-picture (PIP)) .
  • ISP Internet service provider
  • PIP picture-m-picture
  • a set-top converter is used m con unction with a conventional TV to accomplish the same effect; for example, SONY markets such a device as a "WebTV" product.
  • game shows with simultaneous option to participate m a networked version of the same game being conducted m parallel with broadcast version
  • Audio and/or video content such as that found m radio broadcasts, television broadcasts, audio and video tapes, audio/video and interactive compact discs (CD's), and audio and video signals transceived via cable and satellite are often closely related to a wide variety of networked resources.
  • Multiplexed audio such as multiple language simulcasting (MTS) provides yet another means by which a provider may gain valuable information about potential users with which the provider can then tailor those choices of networked resources made available to the user.
  • MTS multiple language simulcasting
  • Such a relationship may be in the form of commercial sales of relevant merchandise, additional sources of complementary information, and a host of networked resources designed to interest a potential listener to the particular audio content .
  • One of the problems faced by providers of networked resources is that they receive little if any feedback from those that access their site.
  • Information which would be useful to a provider includes both demographic data regarding the user as well as viewing and listening data which details the programs watched or listened to, and the time, date and duration (i.e., temporal information) for which this is done.
  • this reference discloses a relatively complex method of two-way communication between a user and an information source, which provides the user with access to such services as the Internet.
  • this method requires that the protocol used to transmit user commands upstream and display information downstream include addressing information that identifies the specific user issuing the command and receiving the display information.
  • the sole connection to the information source is via the headend distribution equipment, complete display information must be transmitted back to the user which is generally continuous and rather lengthy. Therefore, it would be advantageous to provide a simple and efficient means of linking audio/video information with relevant content from an information source such as that found on the Internet without requiring the inclusion of addressing information which identifies the particular user requesting access to the information source.
  • access information enabling the user to link to the information source would not be required to include complete display information which induce delays m the response time perceived by the user to his requests for access.
  • access information enabling the user to link to the information source would not be required to include complete display information which induce delays m the response time perceived by the user to his requests for access.
  • access information enabling the user to link to the information source would not be required to include complete display information which induce delays m the response time perceived by the user to his requests for access.
  • such a system could be adapted for use in broadcast television and/or radio.
  • this technology requires that the user have a separate connection to the Internet.
  • this technology discloses the transmission of complete web pages for display to the user, which adds a significant amount of information to be transmitted within the limited resources of the vertical blanking interval .
  • a method for providing a link between an information signal and networked resources comprising the steps of embedding access information m a transmission medium, the access information adapted to provide access to content of a networked resource relevant to content of the information signal, transmitting the information signal and the access information, receiving the information signal and the access information at a user terminal, extracting the access information from the transmission medium, utilizing the access information to access the networked resource with an access signal, and displaying content of the networked resource on the user terminal corresponding to the access information.
  • the step of embedding the access information may further comprise the step of embedding the access information within a vertical or horizontal blanking interval of the information signal, bandwidth not used by the information signal, a sideband of the information signal, a header of an internet message packet and/or a subcar ⁇ er m the transmission medium.
  • the step of embedding the access information may further comprise the step of overlaying the access information with the information signal
  • the step of transmitting may further comprise the step of transmitting the information signal and access information using spread spectrum transmission techniques
  • the step of receiving may further comprise the step of receiving the information signal and access information using spread spectrum reception techniques.
  • the step of embedding the access information may further comprise the steps of embedding the access information within a channel comprising access information corresponding to a plurality of information signals, and extracting access information from the channel corresponding to the information signal currently being received.
  • the access information may be synchronized to a predetermined portion of the information signal.
  • the information signal may comprise audio and/or video content.
  • the step of displaying the content of the networked resource may further comprise the step of displaying the transmitted networked resource m a picture in a picture (PIP) on the user terminal, and/or the step of displaying indicia indicating availability of the link to the content of the networked resource and displaying the transmitted networked resource to the user m response to selection of the indicia.
  • PIP picture in a picture
  • the method for providing a link between an information signal and networked resources may further comprise the steps of compressing the access information prior to embedding the access information m the transmission medium, decompressing the access information by the user terminal, encoding the access information prior to embedding the access information m the transmission medium, decoding the access information by the user terminal, embedding the user information into the access signal, compressing the user information prior to embedding the access information into the access signal, encrypting the user information prior to embedding the access information into the access signal, embedding access information to additional networked resources m the content of the networked resource, encoding the access information to additional networked resources prior to embedding the access information to additional networked resources m the content of the networked resource, and compressing the access information to additional networked resources prior to embedding the access information to additional networked resources m the content of the networked resource.
  • the method for providing a link between an information signal and networked resources may further comprise the steps of assigning an index corresponding to each of a plurality of networked resources, selecting one of the indices corresponding to the plurality of networked resources, utilizing the index to determine which of the plurality of networked resources to access, and providing a summarized content for the index, the summarized content representative of the content of the corresponding networked resource .
  • the step of embedding the access information may further comprise the step of embedding a link to the networked resource m the transmission medium, or embedding a URL m the transmission medium, and recording the user information and optional temporal information by the networked resource.
  • the step of displaying content may further comprise the step of automatically displaying the content without user intervention, or selectively displaying the content m response to user intervention.
  • the user terminal may be a portable personal computer, personal computer or television, adapted for reception of television signals and/or radio signals, access to the Internet and wireless access to the networked resources.
  • the transmission medium may be free space, a wire, or the Internet.
  • the step of embedding access information may further comprise the step of utilizing user information to determine access to content of the networked resource.
  • the step of utilizing the access information may further comprise the step of transmitting user information to the networked resource.
  • Fig. 1 illustrates one embodiment of an apparatus providing user access to embedded links within an audio/video signal to networked resources of the present invention.
  • Fig.2 is a flowchart illustrating a method for providing an automatic link between the audio/video signal and networked resources of the present invention.
  • Fig.3 is a flowchart illustrating a method for providing a plurality of selectable links between the audio/video signal and a plurality of networked resources of the present invention.
  • Fig. 4 illustrates a relational flowchart illustrating the tasks to be performed by an audio/video signal provider, the networked resource provider and the user .
  • Fig. 5 illustrates the concept of interlaced scanning of the prior art .
  • Fig. 6 illustrates an apparatus for providing both automatic and user selectable links between the audio/video signal and networked resources of the present invention.
  • Fig. 6A illustrates the spectral components of an NTSC signal of the prior art.
  • Fig. 7 illustrates a top level block diagram of a first embodiment of the apparatus for providing both automatic and user selectable links between the audio/video signal and networked resources of the present invention wherein the audio video signal is made available to the user by an entity separate from the networked resource provider.
  • Fig. 8 illustrates a top level block diagram of a second embodiment of the apparatus for providing both automatic and user selectable links between the audio/video signal and networked resources of the present invention wherein the audio video signal is made available to the user by the networked resource provider.
  • Fig.l illustrates one embodiment of an apparatus 10 which is adapted to provide access to embedded links between audio/video signals such as broadcast and cable television and radio signals and networked resources such as the Internet, local databases, remote databases, and other depositaries of information well known in the art.
  • a baseball game is displayed in a primary viewing area 12 of a web-ready television 14.
  • the web-ready television 14 could equivalently be a standard television receiver, cable decoder box, web television transceiver (which comprises a set top plug- in card incorporating television receiver components and Internet access functionality), VCR's or a digital disk (e.g. DVDI) while still being within the scope of the present invention.
  • a user (not shown) is given a choice of networked resources 16 relevant to the baseball game superimposed on the primary viewing area 12 (e.g., such as statistics of the current player, team schedule, and options to purchase team related products) in the lower left corner.
  • the user may access any of the networked or on-line resources 16 by depressing one of a set of buttons on a remote control unit 18 corresponding to an indexing scheme which references the on-screen selection of networked resources 16.
  • a dedicated button i.e., 1, 2, 3
  • Depression of the button or buttons on the remote control unit 18 initiates a transmission of an infrared signal from the remote control unit 18 to the web-ready television 14 by means well known m the art.
  • a web browser within the web-ready television 14 will use decoded information to gam access to a specific site or sites on the networked resource or Internet .
  • Access to the networked resources 16 is then be displayed a picture in a picture (PIP) 20, an auxiliary display or equivalent means by methods well known m the art.
  • Access to the networked resources 16 could also be provided via a logo or other indicia, for instance, overlayed m the corner of the television screen.
  • the logo could read "Active Content Available” or an equivalent phrase indicating that the link was available for accessing the networked resource without displaying the actual content.
  • the content of the networked resource could then be displayed m response to selection of the logo by the viewer either m a PIP or full-screen mode. If a similar logo were provided m the display of the networked resource m full-screen mode then the viewer could toggle between displaying the networked resource and displaying the audio/video signal .
  • the synchronized choice of networked resources 16 could be adapted for dialogue between the information content of the audio/video signal and the selection indicia for a particular networked resource.
  • the user could be given the choice of purchasing the same dress worn by an actress simultaneously appearing on the television screen, or a list of current appearances for a singer simultaneously performing on a radio station.
  • Fig. 2 illustrates a method of the present invention which provides an automatic link between the audio/video signal and networked or on-line resources.
  • a decision is made by the audio/video signal provider as to which networked resources are to be linked to a particular signal and the synchronization and duration of each choice.
  • the producer of a television show may have knowledge of a plurality of Web sites relevant to the content of the program which he may synchronize to particular segments of the audio/video signal.
  • Access information typically a URL
  • pertinent to the chosen networked resources is chosen by the provider and optionally encoded 32 prior to being embedded 34 within the audio/video signal.
  • the audio/video signal provider may use information such as user demographics, viewing and listening data, and data which has been analyzed off-line order to determine the suitability of networked resources to be offered to the user.
  • data may be obtained from the user or third party sources (e.g., clearing houses) via both m-band and out-band 32A techniques (e.g., via cable, modem, satellite, sideband RF, paging channels, etc.) .
  • a particularly useful application of this information would be in obtaining "Neilson Rating" type information which monitors the programs watched and listened to by a large cross-section of users whose demographic information is known and available for cross-correlation. This information could then be used by potential advertisers m determining market shares, efficacy of particular timeslots, and realtime response to a multitude of programming and advertising content .
  • Compression of the encoded information 33 may be advisable due to the quantity of useful data which can be appended to the networked resource access information and the limits imposed by the method used to insert this information into the transmission medium.
  • a method of compression described a co-pending United States Provisional Patent Application Serial Nos. 60/037,988 and 09/023,918 which are hereby incorporated by reference, may be utilized the present invention. Briefly, the method encodes a network address of the target server computer and a target file index pointer as opposed to a more lengthy URL address m providing access information which points to specific networked resources.
  • Alternative methods of compression could be used which are well known the art.
  • the optionally compressed information is embedded 34 during a horizontal and/or vertical blanking interval of the audio/video signal (such as a broadcast or cable television or radio signal) since it is here that there exists a residue of unused resources or bandwidth.
  • U.S. Pat. No. 5,497,187 discloses such a method for insertion of information the vertical blanking interval of television signals, which is hereby incorporated by reference. Such information could also be encoded m sidebands, subcar ⁇ ers or alternative means that utilize unused resources for transferring additional information audio and/or video signals well known to those skilled the art.
  • U.S. Pat. Nos. 5,621,471 and 5,657,088 disclose methods of embedding and recovering additional information within a video signal, which are hereby incorporated by reference.
  • the resulting audio/video signal is then transmitted 36 by the provider and received 38 by the user using means well known the art.
  • Access information is then extracted or separated 40 from the received audio/video signal and decoded 42 and decompressed, if necessary, via means substantially complementary to those used to encode 32 and compress 33 the information.
  • a request for the particular networked resource corresponding to the access information is then transmitted 42A (such as by modem, ISDN link, wireless, TI or other equivalent means well known in the art) to the networked resource provider.
  • the networked resource provider receives the access information 42D and transmits 44 the desired networked resource to the user.
  • the networked resource can optionally record the user demographics, index, viewing/listening data as well as temporal information such as the data and time for future use, resale and/or analysis.
  • the networked resource is then automatically received and displayed 46 by the user's hardware and software without user intervention or input.
  • user demographic information and viewing and listening data may be encrypted 42B by the user, and optionally compressed 42C prior to transmission 42A of both the request for the particular networked resource and the appended user demographic information and viewing and listening data.
  • the provider may encode 42E additional networked resource access information utilizing user demographics, and viewing/listening data, compress 42F the encoded information, and embed 42G the compressed information 42G onto the signal providing the user with the designated networked resource.
  • nesting of accesses to networked resources may be accomplished via under-utilized resources of the transmission medium guided both by the user's prior choice of networked resources as well as user demographics and viewing/listening data.
  • the desired networked resource is transmitted 44 to the user who then receives and displays 46 the networked resource.
  • the user may receive access to the networked resources via a number of techniques including conventional modem, cable modem, satellite, sideband RF, and paging channels.
  • FIG. 3 illustrates a method of the present invention that provides a user selectable link between an audio/video signal and a plurality of networked resources 30A wherein the user is provided a choice of different networked resources to access as shown Figure 1.
  • a decision is made by the audio/video signal provider as to which of the plurality of networked resources will be made available to the user during a specified duration of the audio/video signal using optional additional sources of information such as user demographics, viewing/listening data and data which has been analyzed off-line and obtained via m-band or out- band techniques 32AA.
  • the access information pertinent to the plurality of networked resources chosen is then encoded 32A prior to being embedded 34A withm the audio/video signal.
  • this information may be embedded 34A during a horizontal and/or blanking interval of the audio/video signal, within the sidebands or subcar ⁇ ers of the signal or alternative methods utilizing unused resources for the transfer of additional information m audio and/or video signals well known m the art.
  • the resulting signal is processed using substantially the same steps as the automatic method illustrated m Fig.2, which the exception that following decoding 42AA of the access information, descriptive information or summarized contents of each choice of networked resources available is provided to the user 42AB with indicia corresponding to each choice of networked resource.
  • the user selects 42AC a particular index and transmits 42AD that index.
  • the index is received 42AE and the corresponding networked resource is transmitted 44A using the decoded access information previously extracted from the audio/video signal .
  • the networked resource can optionally record the user demographics, index, viewing/listening data as well as temporal information such as the data and time for future use, resale and/or analysis.
  • the networked resource is then displayed 46A to the user.
  • the user's hardware and/or software may encrypt 42AF the index along with user demographics and viewing/listening data and optionally compress 42AG the encrypted mfromation m order to enable the provider to gam access to further information useful m determining potential additional choices of networked resources to offer the user.
  • the additional choices of networked resources may optionally be encoded 42AH, compressed 42AI and embedded 42AJ onto the audio/video signal comprising access to the networked resource originally chosen by the user prior to being transmitted 44A by the provider and displayed 46A to the user.
  • the steps illustrated m the method of Fig. 3 are listed under the corresponding entity that performs them m Fig. 4.
  • Optional steps are included m Fig. 4 m the order most likely performed, however, this is not intended as a limitation that the steps may be performed in a number of different sequences withm the scope of the present invention.
  • NSC Advanced Systems Committee
  • SECAM Sequential Color with AVEC Memory
  • PAL Phase Alternation each Line
  • HDTV High Definition Television
  • Electronic transmission and reception of visual images m the form of video signals is, like motion pictures, based upon the phenomenon that a series of successive images is seen as a continuous picture due to the persistence of human vision.
  • images can be broadcast per second without providing noticeable flicker.
  • a television transmitter samples segments of the image for brightness with respect to three colors (red, green and blue) and transmits the sampled information sequence.
  • the image is scanned by an electron beam just as an Optical Character Recognition (OCR) reader scans a page of printed type- -character by character and line by line. This results the flow of an electric current with an instantaneous magnitude proportional to the brightness of the segment scanned.
  • OCR Optical Character Recognition
  • a television receiver reproduces each segment of the image transmitted from the broadcast video with its proper position, brightness and color.
  • the picture tube of the receiver is modulated m intensity by the incoming video signal as the beam scans the picture tube synchronism with the scanner of the transmitter.
  • the light is emitted from the photoelectric surface of the picture tube on the viewable side of the picture tube m proportion to the intensity of the electron beam which strikes it. Therefore, the original image scanned is reproduced having its original position, brightness and color.
  • An image is transduced by scanning it according to a fine structure of parallel nearly horizontal lines called scanning rasters .
  • the complete raster is rectangular m shape. Scanning may be done conventionally by starting at the upper left-hand corner along the first line and moving toward the right at constant speed. At the end of the first line a quick return s made to the left-hand side to start the scanning of the second line, again moving towards the right. When all lines have been scanned m this way, from top to bottom, the process is repeated by returning quickly to the upper left-hand corner where the first line is located. If all the lines are scanned m the sequence described above, the process is called sequential scanning.
  • each frame comprises 525 scan or raster lines which in turn comprise several hundred picture elements.
  • Each line is scanned and transmitted to the receiver which enables 30 frames to be received per second.
  • the pickup tube output of the transmitter is blanked during which time the scanning beam is redirected to the next line. This time is commonly referred to as horizontal blanking and is used to transmit synchronizing signals which synchronize the scanning process at the receiver to that of the transmitter.
  • the picture is blanked during that time the electron beam is retraced to the first line of the image, typically referred to as vertical blanking.
  • a process referred to as interlaced scanning represents a variation of sequential scanning and is used to conserve bandwidth in the transmission system without introducing noticeable flicker.
  • Flicker is a function of the raster coverage repetition rate as well as duty cycle, luminance and the decay characteristic of the picture tube.
  • alternate (odd) lines shown as dashed lines m Fig. 5, are scanned first and the remaining (even) lines, shown as solid lines in Fig. 5, are scanned next.
  • the entire raster area is covered or scanned twice. Therefore, the repetition rate for interlaced scanning is twice that of sequential scanning, which is at the same velocity along each line, which results in a corresponding reduction m flicker.
  • the entire raster is covered 30 times per second, thereby permitting the frame to be scanned 60 times per second.
  • the number of raster lines pictured is intended for illustration only and not intended to represent the actual number used in practice.
  • the first raster line 60 begins at the top center of the image.
  • the beam then proceeds for a half line to the right edge.
  • Horizontal retracing (horizontal blanking) to the left occurs, and the third line follows 62.
  • the fifth line 64 and successive odd-numbered lines are scanned for a total of 241.5 lines, ending at the lower right corner. Twenty-one lines elapse during the vertical retrace interval (vertical blanking) during which the scanning beam is moved to the upper left corner, placing it in position to start scanning the second line.
  • This horizontal blanking period requires 16-18% of the total line time, or 10.16-11.43 microseconds. Similarly, 7.5-8% of the vertical blanking period, or 1250-1333 microseconds, is required m vertical blanking to enable the scanning beam to return to the top of the picture. This is the equivalent of about 21 scanning lines. Blanking circuits prevent the transmission of brightness variations during both the horizontal and vertical retrace intervals.
  • Fig. 6 illustrates an apparatus for linking to networked resources embedded withm broadcast or cable television signals 70 of the present invention.
  • National Television System Committee (NTSC) and other broadcast television transmission standards comprise additional bandwidth at the end of each field (m the case of interlaced scanning described above) and frame which is used to reduce screen distortion m receivers with aged or intolerant components.
  • This additional bandwidth is also used to transmit video frame relevant information, generally by means of an error corrected transmission protocol (such as the North American Broadcast Teletext Standard (NABTS) ) for subsequent retrieval and use broadcast enhancing functions, such as data for closed captionmg systems.
  • NABTS North American Broadcast Teletext Standard
  • the present invention seeks to embed access information to networked resources withm an audio/video signal making it possible for devices such as web-ready television, set-top conversion units, cable decoder boxes, WebTV transceivers, VCR's, and digital disks (particularly DVDI) to link to networked resources such as the World Wide Web and access other networked sites relevant to the information content the audio/video signal .
  • devices such as web-ready television, set-top conversion units, cable decoder boxes, WebTV transceivers, VCR's, and digital disks (particularly DVDI) to link to networked resources such as the World Wide Web and access other networked sites relevant to the information content the audio/video signal .
  • the block diagram of a color television receiver 72 receives a video signal from an antenna 74 or cable.
  • the signal could equivalently be provided via conventional modem, cable modem, satellite, sideband RF, paging channels or other equivalent means well known m the art.
  • the video signal is encoded with access information corresponding to networked resources during the vertical blanking and/or horizontal blanking intervals or equivalent means well known m the art as discussed above. It is anticipated that the audio/video signal provider will have made the decision as to which access information will be encoded onto the video signal prior to transmission and that such decisions will be dynamically updated m order to retain synchronization between the choice of networked resources provided to the user and the particular information content of the signal presented to the user. It is also anticipated that the user may optionally be given a choice of networked resources during various segments of the signal.
  • the networked resource access information encoded the vertical and/or horizontal blanking intervals, sidebands, subcarrier or alternative means well known the art will be separated from the detected video signal via a networked resource access information separator 78 by means well known m the art.
  • the networked resource access information is then provided to either a web-ready television, set-top conversion unit, cable decoder box, VCR or equivalent system well known m the art 80.
  • the networked resource access information is also provided to a color cathode ray tube display 82 order to display (e.g., by superimposing on the primary image, on the full -screen, or a Picture withm a Picture (PIP) ) the potential options of networked resources to enable the user to choose amongst them as also shown m Fig. 1.
  • the networked resource access information provided to the color cathode ray tube display 82 may be provided m terms of descriptive summaries of the content of each networked resource option coupled with an index m order to enable the user to input his choice via the remote control unit 18 or other equivalent entry devices (e.g., keyboard) well known m the art.
  • the networked resource access information provided to the video display device 80 typically represents a set of addresses (such as URL's) pointing to networked resources chosen by the audio/video signal provider that correspond to the options provided to the user.
  • a web browser 84 accesses one of the addresses specified by the user through a network interface 86 and provides the user with a display of the networked resource on either the video display device 80, an auxiliary display (not shown) , the full-screen of the display, or a (PIP) on the color cathode ray tube 82.
  • the link or access information to the networked resource could also be embedded withm an unused sideband or subcarrier of the audio/video signal.
  • Each television signal consists of a video signal and an audio signal .
  • the NTSC prescribed signal has a bandwidth of approximately 6.00MHz and is modulated onto a predefined carrier frequency according to the channel to be transmitted on. For instance VHF channel four has channel limits between 61-68Mhz, a video carrier frequency of 62.25MHz and an audio carrier frequency of 67.75MHz. The area between channels reduces interference between channels.
  • the frequency spectrum of the NTSC signal is illustrated m Fig. 6A.
  • the video signal consists of a luminance signal 108 and a chrominance signal 110.
  • the luminance signal 108 provides the signal intensity for both black-and-white and color television signals.
  • the luminance signal 108 has spectral peaks 112 every 15.75kHz, which correspond to the horizontal frequency m the television.
  • the amplitude of the luminance spectral peaks 112 decreases up to 4.2MHz.
  • the video signal is suppressed above 4.20MHz to provide for the audio signal 114, which is modulated with a 4.50MHz carrier.
  • the chrominance signal 110 starts at approximately 2.08MHz m the spectrum and is modulated at a frequency of 3.58MHz.
  • the chrominance signal 110 has spectral peaks 116 , which are also spaced 15.75kHz apart.
  • the access information of the present invention could be modulated on a subcarrier between 4.20MHz and 4.50MHz, or between 4.50MHz and the upper limit of the bandwidth, which is approximately 6.00MHz, by means well known m the art.
  • a subcarrier could be used to provide access information for AM and FM radio broadcast signals by means well known m the art.
  • one sideband of the modulated signal is filtered out to reduce bandwidth requirements, the unused bandwidth could be used to transmit access information by means well known m the art .
  • the World Wide Web is a distributed hypermedia repository of information that is accessed with an interactive browser.
  • a browser displays a page of information and allows the user to move to another page by making a selection using a pointing device such as a mouse.
  • Web documents are written m the Hyper-Text Markup Language (HTML) .
  • HTML Hyper-Text Markup Language
  • a document contains tags that specify document layout and formatting. Some tags cause an immediate change, while others are used m pairs to apply an action to multiple items. Because an HTML document uses a textual representation, images are not included directly in a document. Instead, a tag is placed m the document to specify the place at which an image should be inserted and the source of the image .
  • the anchor tag is used to specify those items in an HTML document which correspond to an external reference. When a browser displays the document, the browser marks the reference to obtain a new document . Because an anchor can include arbitrary items, a selection can correspond to a picture or an icon as easily as to text.
  • External references are given m the form of a Universal Resource Locator (URL) .
  • a browser extracts from the URL the protocol used to access the item, the name of the computer on which the item resides, and the name of the item.
  • a URL that begins with http // specifies that a browser should use the Hyper-Text Transport Protocol (HTTP) to access the item; a browser can also use other services such as File Transfer Protocol (FTP) .
  • HTTP Hyper-Text Transport Protocol
  • FTP File Transfer Protocol
  • HTML includes many features used to describe the contents and format of a document
  • the feature that distinguishes HTML from conventional document formatting languages is its ability to include hypertext references.
  • Each hypertext reference is a passive pointer to another document.
  • the technique used by IntercastTM technology to include hypertext references does not cause an immediate action. Instead, a browser turns the hypertext reference into a selectable item when displaying the document. If the user selects the item, the browser follows the reference, retrieves the document to which it refers, and replaces the current display with the new document .
  • HTML allows any item to be designated as a hypertext reference. Thus, a single word, a phrase, an entire paragraph, or an image can refer to another document.
  • hypertext reference If an entire image is designated as a hypertext reference, the user can select the reference by placing the cursor at any position m the image and clicking a mouse button. Similarly, if an entire paragraph is designated as a hypertext reference, clicking on any character the paragraph causes the browser to follow the reference. Further details regarding hypertext can be found m D. Comer, Computer Networks and Internets (1997) , which is hereby incorporated by reference.
  • a browser consists of a controller, one or more clients used to access documents, and one or more interpreters used to display documents. Each browser must contain an HTML client to retrieve Web pages and an HTML interpreter to display them. In addition, a browser can include clients that permit access to services such as file transfer or electronic mail, and interpreters that display documents that use representations other than HTML.
  • a browser uses caching.
  • the browser places a copy of each document or image that a user views on the local disk.
  • the browser checks that cache before requesting the document from a server on the network.
  • Most browsers allow users to control the length of time documents are kept the cache as well as other controlling parameters .
  • HTTP is straightforward: it allows a browser to request a specific item, which the server then returns .
  • HTTP defines the exact format of requests sent from a browser to a server as well as the format of replies that the server returns .
  • Web servers performs a straightforward task repeatedly: the server waits for a browser to open a connection and requests a specific page. The server then sends a copy of the requested item, closes the connection, and waits for the next connection.
  • a browser handles most of the details of document access and display. Consequently, a browser contains several large software components that work together to provide the illusion of a seamless service.
  • the conceptual organization of the web browser 84 of the prior art is illustrated m Fig. 6. Data paths from clients to interpreters are not shown.
  • the web browser 84 comprises a set of clients, a set of interpreters, and a controller that manages them.
  • a controller 88 forms the central piece of the web browser 84. It interprets inputs from the remote control 18, and calls other components to perform operations specified by a user. For example, when a URL is entered by the networked resource access information separator 78, the controller 88 calls a client to fetch the requested document from the remote server on which it resides, and an interpreter to display the document for the user.
  • Each web browser 84 must contain an HTML interpreter 90 to display documents. Other interpreters are optional. Input to the HTML interpreter 90 consists of a document that conforms to the HTML syntax.
  • the output of the HTML interpreter 90 consists of a formatted version of the document on the color cathode ray tube or user display 82.
  • the HTML interpreter 90 handles layout details by translating HTML specifications into commands that are appropriate for the user's display 82. For example, if it encounter a heading tag m the document, the HTML interpreter 90 changes the size of the text used to display the heading. Similarly, if it encounters a break tag, the HTML interpreter 90 begins a new line of output.
  • Fig. 7 illustrates a top level block diagram showing the embodiment described above wherein the web ready television 14 or equivalent system capable of receiving audio/video signals and accessing networked resources such as the Internet receives the audio/video signal via wired 98 or wireless 100 means from the audio video signal provider 94.
  • the television 14 then extracts and utilizes the access information provided m the transmission medium to access the networked resource via cable, modem, wireless or alternative means well known m the art.
  • This embodiment could be implemented using a personal computer 96 capable of receiving the audio/video signal and accessing networked resources such as the Internet.
  • the personal computer 96 extracts the access information from the transmission medium and uses it to access the networked resource via cable, modem, wireless or alternative means well known the art.
  • the requested resource is then provided to the personal computer 96 or television 14 via wired 101 or wireless 103 means .
  • RDS Radio Data System
  • Radio stations transmit a separate band of information that, with the RDS system, can be adapted using the concepts set forth m the present invention to permit the user to access sites on the Internet.
  • the computer uses links or URL's with the transmitted access information to access specific sites on the Internet. These sites are then displayed to the user either automatically or m response to user intervention and/or selection as a screen saver type of display or alternative means well known in the art.
  • a subset or other modification of the Windows ® 95 operating system such as Window CE ⁇ , currently used in palmtop personal computers, could be used to control operation of the computer m the automobile, thereby reducing the hardware and size requirements of such a computer .
  • the choice of sites could be linked to the content of the audio signal the user is currently tuned to, such as displaying weather maps while the user is listening to the weather on a news channel.
  • the choice of sites could alternatively be linked to the broadcast range or area of the audio signal rather than or m addition to the content of the audio signal, such as providing a site which lists the locations and ratings of restaurants withm the broadcast range of the audio signal.
  • the access information can be transmitted with the audio signal or as a dedicated signal, which carries access information exclusively.
  • Fig. 8 illustrates additional embodiments of the present invention wherein the audio/video signal is provided in digital format by a networked resource or audio/video content provider.
  • the audio/video content provider comprises, for instance, a file server which embeds links such as URL's into a streaming media digital data stream.
  • the web browser within the personal computer 96 or the television 14 then uses the embedded links to access further sites related or unrelated to the content of the audio/video signal.
  • the user selects a requested resource from the embedded links and the requested resource is transmitted to the personal computer 96 or television 14 via wired 101 or wireless 103 means.
  • the television and/or personal computer need only be capable of access to the networked resource since the information or audio/video signal and access information flow to and from networked resources without the need for a distinct audio/video signal provider.
  • Technologies available on the Internet such as streaming media comprising streaming audio and/or streaming video, represent potential implementations for the audio/video signal of these embodiments.
  • Streaming audio differs from downloadable audio files in that you can begin to hear and work with the file before it is completely downloaded to the personal computer.
  • a description of streaming audio technology can be found in C. Shipley and M. Fish, How the World Wide Web Works (1996), which is hereby incorporated by reference.
  • the access information corresponding to audio/video signals transmitted through the air, free space or alternative wireless means well known in the art could be inserted within the vertical and/or horizontal blanking intervals, sidebands, or additional channels dedicated to transmission of access information for one or a plurality of broadcast channels.
  • Such dedicated access information channels could be demultiplexed using the current channel being viewed as a selector to determine the relevant access information , to extract at any given time.
  • the access information could be transmitted as additional digital information in headers and/or auxiliary data packets by means well known in the art. Additional channels dedicated to transmission of access information for one or a plurality of audio/video signals transmitted via hardwired means could also be utilized.
  • access to the networked resource could be made via wired means 102, such as modem, TI , and cable, or wireless means 104 by techniques well known in the art.
  • the access information could be transmitted via a sub carrier channel or using spread spectrum techniques well known in the art. A description of spread spectrum technology is provided in the following references, hereby incorporated by reference:

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Television Systems (AREA)
  • Small-Scale Networks (AREA)

Abstract

A method for providing a link between an information signal (98, 100) (such as a broadcast and cable television and/or radio signals) and networked resources (such as the Internet) comprising the steps of embedding access information in a transmission medium, the access information adapted to provide access to content of the networked resource relevant to content of the information signal, transmitting the information signal and the access information (98, 100), receiving the information signal and the access information at a user terminal, extracting the access information from the transmission medium, utilizing the access information to access the networked resource with an access signal (102, 104), and displaying content of the networked resource on the user terminal corresponding to the access information. Embodiments are provided wherein the information signal (98, 100) is provided by the networked resource provider or a distinct audio/video signal content provider (94) via wired (98) and wireless (100) means.

Description

METHOD FOR EMBEDDING LINKS TO A NETWORKED RESOURCE IN A
TRANSMISSION MEDIUM
CROSS-REFERENCE TO RELATED APPLICATIONS This patent application claims priority of co- pending United States Provisional Application serial no. 60/046,038, which was filed on May 9, 1997 and is hereby incorporated by reference.
TECHNICAL FIELD
This invention relates to a method for providing access to networked resources, and in particular to linking the information content of an audio/video information signal to networked resources via under-utilized resources of A transmission medium.
BACKGROUND ART
Networked data sources, such as those found on the Internet, are a rich and important means of information retrieval and distribution and, increasingly, electronic commerce. However, there are problems finding the information desired m this increasingly complex and changing network of data sources. Recently introduced Internet "search engines" , such as Yahoo on the World-Wide Web (WWW) , help by allowing a user to search networked indices of information sources, and even full source text, for relevant key words and phrases related to their topic of interest, but even carefully structured queries by experienced users often results m hundreds and even thousands of possible "hits" which are not sufficiently specific to preclude further manual search which is both data resource inefficient and time consuming. Because of these inefficiencies, as well as general lack of familiarity with search engines and their syntax, users sometimes rely on broadcast media to identify source addresses (e.g., Uniform Resource Locators ("URLs")) for web sites and other online information of interest.
However, URL's, are particularly difficult to manually enter m software programs, such as "web browsers", due to their length and use of complex and unfamiliar symbols. If the characters m an address are not entered exactly, retrieval is prevented or, m a limited number of cases, a legal but incorrect source is accessed. This is especially true when URLs incorporate foreign languages and/or complex query instructions to networked databases, as is increasingly frequent in most web sites. In addition, the inability to type or otherwise manually enter symbolic address information due to either disability or lack of training complicates use of networked information resources such as the Internet for millions of individuals.
It is widely anticipated that Internet access will increasingly be provided through interactive cable television via web-ready television receivers and set-top boxes used m conjunction with conventional television receivers. The so-called web—ready television is a television that can receive and display conventional broadcast television signals, which has means for allowing a user to access the WWW by providing a modem and appropriately programmed microprocessor based control circuitry. A software module such as a web browser is used to allow the user to dial-up an Internet service provider (ISP) and request files from host servers on the Internet. The downloaded Web pages may be displayed via the browser on a portion of the TV screen (i.e. via picture-m-picture (PIP)) . Thus, the user can both watch TV and "surf the Web", as independent functions, with one piece of equipment. A set-top converter is used m con unction with a conventional TV to accomplish the same effect; for example, SONY markets such a device as a "WebTV" product.
In this home entertainment environment, it is difficult to use keyboards for URL address entry m the Web browser due to both lack of typing skill and the cumbersome placement of these components. Therefore, a method which would eliminate typing and allow users to directly link broadcast media options to electronic information sources by choosing amongst a number of relevant URL's provided by the broadcaster would be highly desirable.
A problem arises during the broadcast of URL's or other links to networked resources within standard broadcast media m that the duration of time m which the link can be displayed is limited to typically 5-10 seconds. Such a short duration does not provide enough time for the viewing audience to copy anything other than the name of the server. This forces advertisers and other content providers to either direct viewers to generic home pages, or to create additional domain names for specific products, which becomes both expensive and time consuming due to the necessity and procedures associated with registration of domain names.
Therefore, it would be advantageous if links to networked resources such as URL's could be displayed to viewers for a sufficient amount of t me to enable them to either copy the entire link or access the link via automatic or selective means. Applications for a direct and efficient link between broadcast media and networked resources are potentially limitless with the following representing only a small sample:
1. sporting events with simultaneous access to networked player statistics, commercial sale of team related goods, books, video recordings of the game, and advance ticket sales;
2. travel shows with simultaneous access to networked details regarding the region discussed, commercial sale of travel arrangements, maps, books, guides, suitable clothing, and luggage;
3. educational shows with simultaneous access to networked primary, high school, and college equivalency courses, tutoring m particular subjects, commercial purchase of books, compact discs, examinations taken networked with real-time results, which is of particular applicability to the handicapped, temporarily injured, gifted or those with special needs;
4. prime time viewing w th simultaneous access to networked schedules of guest appearances of actors and actresses, commercial purchase of books and tapes written by or about the program or players;
5. telethons and publicly supported channels with simultaneous option to make charitable contributions via secure electronic currency; 6. soap operas with simultaneous access to networked prior episodes m summary or detail, background of characters and actors playing each character, contact information regarding fan clubs;
7. game shows with simultaneous option to participate m a networked version of the same game being conducted m parallel with broadcast version;
8. nature shows with simultaneous option to contribute to wildlife/restoration funds using secure electronic currency, and information regarding conservation of and travel to the regions being filmed;
9. movies with the simultaneous ability to purchase relevant books and videos, participate m trivia quizzes, access information regarding special appearances of actors and fan clubs;
10. talk shows with simultaneous ability to reply to and participate m discussions with the audience;
In addition schedule information, and less expensive commercials, which would otherwise occupy costly broadcast time could be relocated to networked resources. Therefore, there is a need for an efficient link between audio and video based media and networked resources which is user friendly to the majority of television users m order to satisfy both commercial and informational enterprises.
Information comprising audio and/or video content such as that found m radio broadcasts, television broadcasts, audio and video tapes, audio/video and interactive compact discs (CD's), and audio and video signals transceived via cable and satellite are often closely related to a wide variety of networked resources. Multiplexed audio such as multiple language simulcasting (MTS) provides yet another means by which a provider may gain valuable information about potential users with which the provider can then tailor those choices of networked resources made available to the user. Such a relationship may be in the form of commercial sales of relevant merchandise, additional sources of complementary information, and a host of networked resources designed to interest a potential listener to the particular audio content .
Therefore, there is a distinct need for a link between media comprising audio content information and pertinent networked resources.
One of the problems faced by providers of networked resources is that they receive little if any feedback from those that access their site. Information which would be useful to a provider includes both demographic data regarding the user as well as viewing and listening data which details the programs watched or listened to, and the time, date and duration (i.e., temporal information) for which this is done.
Therefore, it would be advantageous to provide a means whereby the networked provider could access feedback information comprising user demographics and viewing and listening data either in real-time or subsequent to the broadcast directly or through an intermediary (e.g. clearing house) . It would also be extremely advantageous if such information could be cross-correlated to achieve "Nielsen Ratings" type information.
International Application No. WO 97/38529, submitted under the Patent Cooperation Treaty and hereby incorporated by reference, discloses an interactive system and method for accessing an information source such as the Internet through an existing cable television distribution system and headend distribution equipment m conjunction with a plurality of televisions with settop converters. The user inputs an upstream command intended for the information source via a remote control unit or keyboard. The information source responds by providing display information to the headend distribution equipment, which is then inserted into blank intervals such as the vertical or horizontal blanking intervals of the television transmission on a downstream channel by the headend distribution equipment. The display information represents sequential picture data, which is extracted by the settop converter and displayed to the user on the television. Thus, this reference discloses a relatively complex method of two-way communication between a user and an information source, which provides the user with access to such services as the Internet. However, this method requires that the protocol used to transmit user commands upstream and display information downstream include addressing information that identifies the specific user issuing the command and receiving the display information. In addition, since the sole connection to the information source is via the headend distribution equipment, complete display information must be transmitted back to the user which is generally continuous and rather lengthy. Therefore, it would be advantageous to provide a simple and efficient means of linking audio/video information with relevant content from an information source such as that found on the Internet without requiring the inclusion of addressing information which identifies the particular user requesting access to the information source. In addition, it would be advantageous if access information enabling the user to link to the information source would not be required to include complete display information which induce delays m the response time perceived by the user to his requests for access. In addition, it would be advantageous if such a system could be adapted for use in broadcast television and/or radio.
Another system very similar to that disclosed m the '38529 application is described on the Internet (htt : //connectedpc . co /1awweb/Intercast /whatis/infoOl .htm) and called Intercast""'1 Technology. However, this system uses a personal computer with a video capture card which enables the personal computer to receive and display cable television signals. Web pages which may contain hyperlinks to additional web pages are embedded within the vertical blanking interval of the cable television signal. The personal computer displays a composite picture including the cable television signal, the web page, a list of downloaded web pages, a television channel selection area and a web page selection area. While a particular television channel is displayed the user can select one of a number of related web pages for display m the web page area of the screen as well as selecting another television channel and corresponding related web pages. Unlike the system disclosed m the '38529 patent, this technology requires that the user have a separate connection to the Internet. However, like the '38539 patent this technology discloses the transmission of complete web pages for display to the user, which adds a significant amount of information to be transmitted within the limited resources of the vertical blanking interval .
Therefore, it would be advantageous if a system could provide access to networked resources to the user by only sending a minimal amount of information to link the user to the networked resource.
DISCLOSURE OF THE INVENTION
In accordance with the present invention, a method for providing a link between an information signal and networked resources is provided comprising the steps of embedding access information m a transmission medium, the access information adapted to provide access to content of a networked resource relevant to content of the information signal, transmitting the information signal and the access information, receiving the information signal and the access information at a user terminal, extracting the access information from the transmission medium, utilizing the access information to access the networked resource with an access signal, and displaying content of the networked resource on the user terminal corresponding to the access information. The step of embedding the access information may further comprise the step of embedding the access information within a vertical or horizontal blanking interval of the information signal, bandwidth not used by the information signal, a sideband of the information signal, a header of an internet message packet and/or a subcarπer m the transmission medium. In further accordance with the present invention, the step of embedding the access information may further comprise the step of overlaying the access information with the information signal, the step of transmitting may further comprise the step of transmitting the information signal and access information using spread spectrum transmission techniques, and the step of receiving may further comprise the step of receiving the information signal and access information using spread spectrum reception techniques. The step of embedding the access information may further comprise the steps of embedding the access information within a channel comprising access information corresponding to a plurality of information signals, and extracting access information from the channel corresponding to the information signal currently being received. The access information may be synchronized to a predetermined portion of the information signal.
In still further accordance with the present invention, the information signal may comprise audio and/or video content. The step of displaying the content of the networked resource may further comprise the step of displaying the transmitted networked resource m a picture in a picture (PIP) on the user terminal, and/or the step of displaying indicia indicating availability of the link to the content of the networked resource and displaying the transmitted networked resource to the user m response to selection of the indicia.
In accordance with the present invention, the method for providing a link between an information signal and networked resources may further comprise the steps of compressing the access information prior to embedding the access information m the transmission medium, decompressing the access information by the user terminal, encoding the access information prior to embedding the access information m the transmission medium, decoding the access information by the user terminal, embedding the user information into the access signal, compressing the user information prior to embedding the access information into the access signal, encrypting the user information prior to embedding the access information into the access signal, embedding access information to additional networked resources m the content of the networked resource, encoding the access information to additional networked resources prior to embedding the access information to additional networked resources m the content of the networked resource, and compressing the access information to additional networked resources prior to embedding the access information to additional networked resources m the content of the networked resource.
In further accordance with the present invention, the method for providing a link between an information signal and networked resources may further comprise the steps of assigning an index corresponding to each of a plurality of networked resources, selecting one of the indices corresponding to the plurality of networked resources, utilizing the index to determine which of the plurality of networked resources to access, and providing a summarized content for the index, the summarized content representative of the content of the corresponding networked resource .
In still further accordance with the present invention, the step of embedding the access information may further comprise the step of embedding a link to the networked resource m the transmission medium, or embedding a URL m the transmission medium, and recording the user information and optional temporal information by the networked resource. The step of displaying content may further comprise the step of automatically displaying the content without user intervention, or selectively displaying the content m response to user intervention.
In accordance with the present invention, the user terminal may be a portable personal computer, personal computer or television, adapted for reception of television signals and/or radio signals, access to the Internet and wireless access to the networked resources. The transmission medium may be free space, a wire, or the Internet. The step of embedding access information may further comprise the step of utilizing user information to determine access to content of the networked resource. The step of utilizing the access information may further comprise the step of transmitting user information to the networked resource.
BRIEF DESCRIPTION OF THE DRAWINGS
These and other objects and features of the invention shall now be described m relation to the drawings.
Fig. 1 illustrates one embodiment of an apparatus providing user access to embedded links within an audio/video signal to networked resources of the present invention. Fig.2 is a flowchart illustrating a method for providing an automatic link between the audio/video signal and networked resources of the present invention.
Fig.3 is a flowchart illustrating a method for providing a plurality of selectable links between the audio/video signal and a plurality of networked resources of the present invention.
Fig. 4 illustrates a relational flowchart illustrating the tasks to be performed by an audio/video signal provider, the networked resource provider and the user .
Fig. 5 illustrates the concept of interlaced scanning of the prior art .
Fig. 6 illustrates an apparatus for providing both automatic and user selectable links between the audio/video signal and networked resources of the present invention.
Fig. 6A illustrates the spectral components of an NTSC signal of the prior art.
Fig. 7 illustrates a top level block diagram of a first embodiment of the apparatus for providing both automatic and user selectable links between the audio/video signal and networked resources of the present invention wherein the audio video signal is made available to the user by an entity separate from the networked resource provider.
Fig. 8 illustrates a top level block diagram of a second embodiment of the apparatus for providing both automatic and user selectable links between the audio/video signal and networked resources of the present invention wherein the audio video signal is made available to the user by the networked resource provider.
BEST MODE FOR CARRYING OUT THE INVENTION
Fig.l illustrates one embodiment of an apparatus 10 which is adapted to provide access to embedded links between audio/video signals such as broadcast and cable television and radio signals and networked resources such as the Internet, local databases, remote databases, and other depositaries of information well known in the art. In the example illustrated, a baseball game is displayed in a primary viewing area 12 of a web-ready television 14. The web-ready television 14 could equivalently be a standard television receiver, cable decoder box, web television transceiver (which comprises a set top plug- in card incorporating television receiver components and Internet access functionality), VCR's or a digital disk (e.g. DVDI) while still being within the scope of the present invention.
A user (not shown) is given a choice of networked resources 16 relevant to the baseball game superimposed on the primary viewing area 12 (e.g., such as statistics of the current player, team schedule, and options to purchase team related products) in the lower left corner. The user may access any of the networked or on-line resources 16 by depressing one of a set of buttons on a remote control unit 18 corresponding to an indexing scheme which references the on-screen selection of networked resources 16. In the example illustrated in Fig. 1, a dedicated button (i.e., 1, 2, 3) is provided for each of the networked resources 16 while in practice this could be accomplished by depression of the same button m rapid succession or other means well known to those skilled m the art . Depression of the button or buttons on the remote control unit 18 initiates a transmission of an infrared signal from the remote control unit 18 to the web-ready television 14 by means well known m the art. Upon receipt and decoding of the infrared signal a web browser within the web-ready television 14 will use decoded information to gam access to a specific site or sites on the networked resource or Internet . Access to the networked resources 16 is then be displayed a picture in a picture (PIP) 20, an auxiliary display or equivalent means by methods well known m the art.
Access to the networked resources 16 could also be provided via a logo or other indicia, for instance, overlayed m the corner of the television screen. The logo could read "Active Content Available" or an equivalent phrase indicating that the link was available for accessing the networked resource without displaying the actual content. The content of the networked resource could then be displayed m response to selection of the logo by the viewer either m a PIP or full-screen mode. If a similar logo were provided m the display of the networked resource m full-screen mode then the viewer could toggle between displaying the networked resource and displaying the audio/video signal .
As the content of the audio/video signal changes so might the choice of networked resources 16 offered to the user order to maintain synchronization and relevancy between the networked resources provided to the user and the information content of the audio/video signal . The synchronized choice of networked resources could be adapted for dialogue between the information content of the audio/video signal and the selection indicia for a particular networked resource. For example, the user could be given the choice of purchasing the same dress worn by an actress simultaneously appearing on the television screen, or a list of current appearances for a singer simultaneously performing on a radio station.
Similarly, Fig. 2 illustrates a method of the present invention which provides an automatic link between the audio/video signal and networked or on-line resources. A decision is made by the audio/video signal provider as to which networked resources are to be linked to a particular signal and the synchronization and duration of each choice. For example, the producer of a television show may have knowledge of a plurality of Web sites relevant to the content of the program which he may synchronize to particular segments of the audio/video signal. Access information (typically a URL) pertinent to the chosen networked resources is chosen by the provider and optionally encoded 32 prior to being embedded 34 within the audio/video signal. In the audio/video signal provider may use information such as user demographics, viewing and listening data, and data which has been analyzed off-line order to determine the suitability of networked resources to be offered to the user. Such data may be obtained from the user or third party sources (e.g., clearing houses) via both m-band and out-band 32A techniques (e.g., via cable, modem, satellite, sideband RF, paging channels, etc.) . A particularly useful application of this information would be in obtaining "Neilson Rating" type information which monitors the programs watched and listened to by a large cross-section of users whose demographic information is known and available for cross-correlation. This information could then be used by potential advertisers m determining market shares, efficacy of particular timeslots, and realtime response to a multitude of programming and advertising content .
Compression of the encoded information 33 may be advisable due to the quantity of useful data which can be appended to the networked resource access information and the limits imposed by the method used to insert this information into the transmission medium. A method of compression described a co-pending United States Provisional Patent Application Serial Nos. 60/037,988 and 09/023,918 which are hereby incorporated by reference, may be utilized the present invention. Briefly, the method encodes a network address of the target server computer and a target file index pointer as opposed to a more lengthy URL address m providing access information which points to specific networked resources. Alternative methods of compression could be used which are well known the art.
The optionally compressed information is embedded 34 during a horizontal and/or vertical blanking interval of the audio/video signal (such as a broadcast or cable television or radio signal) since it is here that there exists a residue of unused resources or bandwidth. U.S. Pat. No. 5,497,187 discloses such a method for insertion of information the vertical blanking interval of television signals, which is hereby incorporated by reference. Such information could also be encoded m sidebands, subcarπers or alternative means that utilize unused resources for transferring additional information audio and/or video signals well known to those skilled the art. U.S. Pat. Nos. 5,621,471 and 5,657,088 disclose methods of embedding and recovering additional information within a video signal, which are hereby incorporated by reference.
The resulting audio/video signal is then transmitted 36 by the provider and received 38 by the user using means well known the art. Access information is then extracted or separated 40 from the received audio/video signal and decoded 42 and decompressed, if necessary, via means substantially complementary to those used to encode 32 and compress 33 the information. A request for the particular networked resource corresponding to the access information is then transmitted 42A (such as by modem, ISDN link, wireless, TI or other equivalent means well known in the art) to the networked resource provider. The networked resource provider receives the access information 42D and transmits 44 the desired networked resource to the user. The networked resource can optionally record the user demographics, index, viewing/listening data as well as temporal information such as the data and time for future use, resale and/or analysis. The networked resource is then automatically received and displayed 46 by the user's hardware and software without user intervention or input. Optionally, user demographic information and viewing and listening data may be encrypted 42B by the user, and optionally compressed 42C prior to transmission 42A of both the request for the particular networked resource and the appended user demographic information and viewing and listening data.
Following receipt 42D of the networked resource access information and optional user demographics and viewing/listening data, the provider may encode 42E additional networked resource access information utilizing user demographics, and viewing/listening data, compress 42F the encoded information, and embed 42G the compressed information 42G onto the signal providing the user with the designated networked resource. In this way, nesting of accesses to networked resources may be accomplished via under-utilized resources of the transmission medium guided both by the user's prior choice of networked resources as well as user demographics and viewing/listening data. The desired networked resource is transmitted 44 to the user who then receives and displays 46 the networked resource. The user may receive access to the networked resources via a number of techniques including conventional modem, cable modem, satellite, sideband RF, and paging channels.
A modification of the above method is provided Fig. 3 which illustrates a method of the present invention that provides a user selectable link between an audio/video signal and a plurality of networked resources 30A wherein the user is provided a choice of different networked resources to access as shown Figure 1. This differs from the automatic system of Figure 2 m that the networked resource is not automatically accessed. A decision is made by the audio/video signal provider as to which of the plurality of networked resources will be made available to the user during a specified duration of the audio/video signal using optional additional sources of information such as user demographics, viewing/listening data and data which has been analyzed off-line and obtained via m-band or out- band techniques 32AA. The access information pertinent to the plurality of networked resources chosen is then encoded 32A prior to being embedded 34A withm the audio/video signal. Just as the embodiment illustrated m Fig. 2, this information may be embedded 34A during a horizontal and/or blanking interval of the audio/video signal, within the sidebands or subcarπers of the signal or alternative methods utilizing unused resources for the transfer of additional information m audio and/or video signals well known m the art. The resulting signal is processed using substantially the same steps as the automatic method illustrated m Fig.2, which the exception that following decoding 42AA of the access information, descriptive information or summarized contents of each choice of networked resources available is provided to the user 42AB with indicia corresponding to each choice of networked resource. The user selects 42AC a particular index and transmits 42AD that index. The index is received 42AE and the corresponding networked resource is transmitted 44A using the decoded access information previously extracted from the audio/video signal . The networked resource can optionally record the user demographics, index, viewing/listening data as well as temporal information such as the data and time for future use, resale and/or analysis. The networked resource is then displayed 46A to the user. Alternatively, following selection of the index 42AC the user's hardware and/or software may encrypt 42AF the index along with user demographics and viewing/listening data and optionally compress 42AG the encrypted mfromation m order to enable the provider to gam access to further information useful m determining potential additional choices of networked resources to offer the user. The additional choices of networked resources may optionally be encoded 42AH, compressed 42AI and embedded 42AJ onto the audio/video signal comprising access to the networked resource originally chosen by the user prior to being transmitted 44A by the provider and displayed 46A to the user. The steps illustrated m the method of Fig. 3 are listed under the corresponding entity that performs them m Fig. 4. Optional steps are included m Fig. 4 m the order most likely performed, however, this is not intended as a limitation that the steps may be performed in a number of different sequences withm the scope of the present invention.
The following represents a summary of color television technology provided m order to enhance understanding of the block diagram of an apparatus that performs the present invention which follows. While the following summary primarily describes the functionality of television reception with respect to National Television
Systems Committee (NTSC) standards, the present invention is also intended to be applicable to alternative standards comprising Sequential Color with AVEC Memory (SECAM) , Phase Alternation each Line (PAL) and the various forms of High Definition Television (HDTV) as well. Each of the aforementioned standards are described m detail m K. Benson, The Television Engineering Handbook chapters 21, 23- 24 (1992), which is hereby incorporated by reference.
Electronic transmission and reception of visual images m the form of video signals is, like motion pictures, based upon the phenomenon that a series of successive images is seen as a continuous picture due to the persistence of human vision. Through the use of interlaced scanning 30 images can be broadcast per second without providing noticeable flicker. A television transmitter samples segments of the image for brightness with respect to three colors (red, green and blue) and transmits the sampled information sequence. The image is scanned by an electron beam just as an Optical Character Recognition (OCR) reader scans a page of printed type- -character by character and line by line. This results the flow of an electric current with an instantaneous magnitude proportional to the brightness of the segment scanned. A television receiver reproduces each segment of the image transmitted from the broadcast video with its proper position, brightness and color. An electron beam the picture tube of the receiver is modulated m intensity by the incoming video signal as the beam scans the picture tube synchronism with the scanner of the transmitter. The light is emitted from the photoelectric surface of the picture tube on the viewable side of the picture tube m proportion to the intensity of the electron beam which strikes it. Therefore, the original image scanned is reproduced having its original position, brightness and color.
An image is transduced by scanning it according to a fine structure of parallel nearly horizontal lines called scanning rasters . The complete raster is rectangular m shape. Scanning may be done conventionally by starting at the upper left-hand corner along the first line and moving toward the right at constant speed. At the end of the first line a quick return s made to the left-hand side to start the scanning of the second line, again moving towards the right. When all lines have been scanned m this way, from top to bottom, the process is repeated by returning quickly to the upper left-hand corner where the first line is located. If all the lines are scanned m the sequence described above, the process is called sequential scanning. In accordance with standards in the United States (NTSC) , each frame comprises 525 scan or raster lines which in turn comprise several hundred picture elements. Each line is scanned and transmitted to the receiver which enables 30 frames to be received per second. At the end of each line the pickup tube output of the transmitter is blanked during which time the scanning beam is redirected to the next line. This time is commonly referred to as horizontal blanking and is used to transmit synchronizing signals which synchronize the scanning process at the receiver to that of the transmitter. Similarly, after completion of the last line of the frame the picture is blanked during that time the electron beam is retraced to the first line of the image, typically referred to as vertical blanking. If the output of the electron beam were not suppressed or blanked during the horizontal and vertical blanking intervals there would be objectionable lines on the received image tracing the movement of the electron beam as it retraces. Charge coupled imaging devices do not require complex deflection or blanking circuits since they are scanned by using address accessing and retrieval techniques. Pulse counters, divider chains and memory provide the correct sequential readout of the charge coupled device array so that an image is recovered from the individual outputs of the photodiodes from the charge coupled device without the need to compensate for the retracing of the electron beam.
A process referred to as interlaced scanning represents a variation of sequential scanning and is used to conserve bandwidth in the transmission system without introducing noticeable flicker. Flicker is a function of the raster coverage repetition rate as well as duty cycle, luminance and the decay characteristic of the picture tube. With interlaced scanning, alternate (odd) lines, shown as dashed lines m Fig. 5, are scanned first and the remaining (even) lines, shown as solid lines in Fig. 5, are scanned next. The entire raster area is covered or scanned twice. Therefore, the repetition rate for interlaced scanning is twice that of sequential scanning, which is at the same velocity along each line, which results in a corresponding reduction m flicker. The entire raster is covered 30 times per second, thereby permitting the frame to be scanned 60 times per second.
Interlaced scanning is illustrated in Fig. 5. The number of raster lines pictured is intended for illustration only and not intended to represent the actual number used in practice. The first raster line 60 begins at the top center of the image. The beam then proceeds for a half line to the right edge. Horizontal retracing (horizontal blanking) to the left occurs, and the third line follows 62. At the right end of the third line, one and a half lines have been scanned. The fifth line 64 and successive odd-numbered lines are scanned for a total of 241.5 lines, ending at the lower right corner. Twenty-one lines elapse during the vertical retrace interval (vertical blanking) during which the scanning beam is moved to the upper left corner, placing it in position to start scanning the second line. This completes one full field. Then 241.5 successive even lines are scanned, ending at the middle bottom of the image. Again 21 lines elapse for vertical retrace (vertical blanking) , during which time the scanning beam is returned to the top center of the image. This completes the second field and thus a full frame 66. The sequence then repeats. According to standards m the United States 15,750 lines are required to be scanned per second. With a vertical scanning rate of 30 times per second, there are 525 lines allocated to each frame and 262.5 lines per field. Each line has a duration of 63.49 microseconds. A finite period of time is required to return the scanning electron beam to the left edge of the image for the next line. This horizontal blanking period requires 16-18% of the total line time, or 10.16-11.43 microseconds. Similarly, 7.5-8% of the vertical blanking period, or 1250-1333 microseconds, is required m vertical blanking to enable the scanning beam to return to the top of the picture. This is the equivalent of about 21 scanning lines. Blanking circuits prevent the transmission of brightness variations during both the horizontal and vertical retrace intervals.
Fig. 6 illustrates an apparatus for linking to networked resources embedded withm broadcast or cable television signals 70 of the present invention. National Television System Committee (NTSC) and other broadcast television transmission standards comprise additional bandwidth at the end of each field (m the case of interlaced scanning described above) and frame which is used to reduce screen distortion m receivers with aged or intolerant components. This additional bandwidth is also used to transmit video frame relevant information, generally by means of an error corrected transmission protocol (such as the North American Broadcast Teletext Standard (NABTS) ) for subsequent retrieval and use broadcast enhancing functions, such as data for closed captionmg systems. The present invention seeks to embed access information to networked resources withm an audio/video signal making it possible for devices such as web-ready television, set-top conversion units, cable decoder boxes, WebTV transceivers, VCR's, and digital disks (particularly DVDI) to link to networked resources such as the World Wide Web and access other networked sites relevant to the information content the audio/video signal .
The block diagram of a color television receiver 72, illustrated in Fig. 6, receives a video signal from an antenna 74 or cable. The signal could equivalently be provided via conventional modem, cable modem, satellite, sideband RF, paging channels or other equivalent means well known m the art. The video signal is encoded with access information corresponding to networked resources during the vertical blanking and/or horizontal blanking intervals or equivalent means well known m the art as discussed above. It is anticipated that the audio/video signal provider will have made the decision as to which access information will be encoded onto the video signal prior to transmission and that such decisions will be dynamically updated m order to retain synchronization between the choice of networked resources provided to the user and the particular information content of the signal presented to the user. It is also anticipated that the user may optionally be given a choice of networked resources during various segments of the signal.
Subsequent to the video signal being input and applied to a video detector 76 of the television receiver 72, the networked resource access information encoded the vertical and/or horizontal blanking intervals, sidebands, subcarrier or alternative means well known the art will be separated from the detected video signal via a networked resource access information separator 78 by means well known m the art. The networked resource access information is then provided to either a web-ready television, set-top conversion unit, cable decoder box, VCR or equivalent system well known m the art 80. The networked resource access information is also provided to a color cathode ray tube display 82 order to display (e.g., by superimposing on the primary image, on the full -screen, or a Picture withm a Picture (PIP) ) the potential options of networked resources to enable the user to choose amongst them as also shown m Fig. 1. The networked resource access information provided to the color cathode ray tube display 82 may be provided m terms of descriptive summaries of the content of each networked resource option coupled with an index m order to enable the user to input his choice via the remote control unit 18 or other equivalent entry devices (e.g., keyboard) well known m the art. The networked resource access information provided to the video display device 80 typically represents a set of addresses (such as URL's) pointing to networked resources chosen by the audio/video signal provider that correspond to the options provided to the user. In the case of the Internet being the networked resource, a web browser 84 then accesses one of the addresses specified by the user through a network interface 86 and provides the user with a display of the networked resource on either the video display device 80, an auxiliary display (not shown) , the full-screen of the display, or a (PIP) on the color cathode ray tube 82.
An additional embodiment is possible using the concepts illustrated m Fig. 6 and the method illustrated m Fig. 2, wherein the user is not provided a choice of networked resources but rather a particular networked resource is accessed automatically upon receipt by the web browser 84 of the extracted networked resource access information. The remote control 18 would either be non- essential or its input ignored m this embodiment while the controller 88 would be required to proceed with networked accesses automatically without intervention by the user via the remote control unit 18.
As described above, the link or access information to the networked resource could also be embedded withm an unused sideband or subcarrier of the audio/video signal. Each television signal consists of a video signal and an audio signal . The NTSC prescribed signal has a bandwidth of approximately 6.00MHz and is modulated onto a predefined carrier frequency according to the channel to be transmitted on. For instance VHF channel four has channel limits between 61-68Mhz, a video carrier frequency of 62.25MHz and an audio carrier frequency of 67.75MHz. The area between channels reduces interference between channels.
The frequency spectrum of the NTSC signal is illustrated m Fig. 6A. The video signal consists of a luminance signal 108 and a chrominance signal 110. The luminance signal 108 provides the signal intensity for both black-and-white and color television signals. The luminance signal 108 has spectral peaks 112 every 15.75kHz, which correspond to the horizontal frequency m the television. The amplitude of the luminance spectral peaks 112 decreases up to 4.2MHz. The video signal is suppressed above 4.20MHz to provide for the audio signal 114, which is modulated with a 4.50MHz carrier. The chrominance signal 110 starts at approximately 2.08MHz m the spectrum and is modulated at a frequency of 3.58MHz. The chrominance signal 110 has spectral peaks 116 , which are also spaced 15.75kHz apart. A detailed discussion of these and related concepts is provided m K. Benson, The Television Engineering (1992) , which is hereby incorporated by reference.
The access information of the present invention could be modulated on a subcarrier between 4.20MHz and 4.50MHz, or between 4.50MHz and the upper limit of the bandwidth, which is approximately 6.00MHz, by means well known m the art. Likewise, a subcarrier could be used to provide access information for AM and FM radio broadcast signals by means well known m the art. In addition, since during the modulation of NTSC signals onto the broadcast carrier, one sideband of the modulated signal is filtered out to reduce bandwidth requirements, the unused bandwidth could be used to transmit access information by means well known m the art .
In order to provide an understanding of the Internet and on-line resource concepts used m the present invention a brief discussion of the relevant technology will be provided. The World Wide Web is a distributed hypermedia repository of information that is accessed with an interactive browser. A browser displays a page of information and allows the user to move to another page by making a selection using a pointing device such as a mouse.
Web documents are written m the Hyper-Text Markup Language (HTML) . In addition to text, a document contains tags that specify document layout and formatting. Some tags cause an immediate change, while others are used m pairs to apply an action to multiple items. Because an HTML document uses a textual representation, images are not included directly in a document. Instead, a tag is placed m the document to specify the place at which an image should be inserted and the source of the image .
The anchor tag is used to specify those items in an HTML document which correspond to an external reference. When a browser displays the document, the browser marks the reference to obtain a new document . Because an anchor can include arbitrary items, a selection can correspond to a picture or an icon as easily as to text.
External references are given m the form of a Universal Resource Locator (URL) . A browser extracts from the URL the protocol used to access the item, the name of the computer on which the item resides, and the name of the item. A URL that begins with http : // specifies that a browser should use the Hyper-Text Transport Protocol (HTTP) to access the item; a browser can also use other services such as File Transfer Protocol (FTP) .
Although HTML includes many features used to describe the contents and format of a document, the feature that distinguishes HTML from conventional document formatting languages is its ability to include hypertext references. Each hypertext reference is a passive pointer to another document. Unlike providing the URL directly to the browser, as performed by the present invention, the technique used by Intercast™ technology to include hypertext references does not cause an immediate action. Instead, a browser turns the hypertext reference into a selectable item when displaying the document. If the user selects the item, the browser follows the reference, retrieves the document to which it refers, and replaces the current display with the new document . HTML allows any item to be designated as a hypertext reference. Thus, a single word, a phrase, an entire paragraph, or an image can refer to another document. If an entire image is designated as a hypertext reference, the user can select the reference by placing the cursor at any position m the image and clicking a mouse button. Similarly, if an entire paragraph is designated as a hypertext reference, clicking on any character the paragraph causes the browser to follow the reference. Further details regarding hypertext can be found m D. Comer, Computer Networks and Internets (1997) , which is hereby incorporated by reference.
A browser consists of a controller, one or more clients used to access documents, and one or more interpreters used to display documents. Each browser must contain an HTML client to retrieve Web pages and an HTML interpreter to display them. In addition, a browser can include clients that permit access to services such as file transfer or electronic mail, and interpreters that display documents that use representations other than HTML.
To make document retrieval efficient, a browser uses caching. The browser places a copy of each document or image that a user views on the local disk. Whenever a document is needed, the browser checks that cache before requesting the document from a server on the network. Most browsers allow users to control the length of time documents are kept the cache as well as other controlling parameters . When a browser interacts with a Web server, the two programs follow the HTTP. In principle, HTTP is straightforward: it allows a browser to request a specific item, which the server then returns . To ensure that browsers and servers can mteroperate unambiguously, HTTP defines the exact format of requests sent from a browser to a server as well as the format of replies that the server returns .
Web browsers have a more complex structure than
Web servers . A server performs a straightforward task repeatedly: the server waits for a browser to open a connection and requests a specific page. The server then sends a copy of the requested item, closes the connection, and waits for the next connection. A browser handles most of the details of document access and display. Consequently, a browser contains several large software components that work together to provide the illusion of a seamless service. The conceptual organization of the web browser 84 of the prior art is illustrated m Fig. 6. Data paths from clients to interpreters are not shown.
Conceptually, the web browser 84 comprises a set of clients, a set of interpreters, and a controller that manages them. A controller 88 forms the central piece of the web browser 84. It interprets inputs from the remote control 18, and calls other components to perform operations specified by a user. For example, when a URL is entered by the networked resource access information separator 78, the controller 88 calls a client to fetch the requested document from the remote server on which it resides, and an interpreter to display the document for the user. Each web browser 84 must contain an HTML interpreter 90 to display documents. Other interpreters are optional. Input to the HTML interpreter 90 consists of a document that conforms to the HTML syntax. The output of the HTML interpreter 90 consists of a formatted version of the document on the color cathode ray tube or user display 82. The HTML interpreter 90 handles layout details by translating HTML specifications into commands that are appropriate for the user's display 82. For example, if it encounter a heading tag m the document, the HTML interpreter 90 changes the size of the text used to display the heading. Similarly, if it encounters a break tag, the HTML interpreter 90 begins a new line of output.
A more complete discussion of the Internet and computer network theory is provided m the following references hereby incorporated by reference :
1. D. Comer, The Internet (1995) .
2. D. Comer, Computer Networks and Internets (1997) .
Fig. 7 illustrates a top level block diagram showing the embodiment described above wherein the web ready television 14 or equivalent system capable of receiving audio/video signals and accessing networked resources such as the Internet receives the audio/video signal via wired 98 or wireless 100 means from the audio video signal provider 94. The television 14 then extracts and utilizes the access information provided m the transmission medium to access the networked resource via cable, modem, wireless or alternative means well known m the art. This embodiment could be implemented using a personal computer 96 capable of receiving the audio/video signal and accessing networked resources such as the Internet. The personal computer 96 extracts the access information from the transmission medium and uses it to access the networked resource via cable, modem, wireless or alternative means well known the art. The requested resource is then provided to the personal computer 96 or television 14 via wired 101 or wireless 103 means .
One commercially viable application of the embodiments illustrated m Fig. 7 is realized withm an automobile equipped with a radio receiver, display and computer capable of accessing the Internet via wireless means well known in the art. Access information linking the user to specific sites on the Internet is transmitted with the audio signal or via a dedicated data channel and received by the radio. An implementation for the transmission of auxiliary information to automobile radios, is found m the Radio Data System (RDS) available m the Volvo C70 audio system, the technical specifications and description of which are hereby incorporated by reference.
Radio stations transmit a separate band of information that, with the RDS system, can be adapted using the concepts set forth m the present invention to permit the user to access sites on the Internet. Upon receipt of the signal the computer uses links or URL's with the transmitted access information to access specific sites on the Internet. These sites are then displayed to the user either automatically or m response to user intervention and/or selection as a screen saver type of display or alternative means well known in the art. A subset or other modification of the Windows® 95 operating system such as Window CE^, currently used in palmtop personal computers, could be used to control operation of the computer m the automobile, thereby reducing the hardware and size requirements of such a computer .
Thus, while listening to the radio, the user and/or passengers m the automobile could view a number of sites of interest such as the following:
1. location, representative prices, hours and directions to points of interest including restaurants, historic sites, gas stations, rest stops, airports, bus terminals, lodging accommodations, etc.;
2. advertisements for stores, malls, eating establishments, concerts, etc. (i.e. "Virtual Billboards");
3. roadmaps ;
4. traffic conditions and alternate routes displayed on maps; and
5. weather conditions and snow emergency routes displayed on maps.
The choice of sites could be linked to the content of the audio signal the user is currently tuned to, such as displaying weather maps while the user is listening to the weather on a news channel. The choice of sites could alternatively be linked to the broadcast range or area of the audio signal rather than or m addition to the content of the audio signal, such as providing a site which lists the locations and ratings of restaurants withm the broadcast range of the audio signal. The access information can be transmitted with the audio signal or as a dedicated signal, which carries access information exclusively. Fig. 8 illustrates additional embodiments of the present invention wherein the audio/video signal is provided in digital format by a networked resource or audio/video content provider. The audio/video content provider comprises, for instance, a file server which embeds links such as URL's into a streaming media digital data stream. The web browser within the personal computer 96 or the television 14 then uses the embedded links to access further sites related or unrelated to the content of the audio/video signal. The user selects a requested resource from the embedded links and the requested resource is transmitted to the personal computer 96 or television 14 via wired 101 or wireless 103 means. In these embodiments the television and/or personal computer need only be capable of access to the networked resource since the information or audio/video signal and access information flow to and from networked resources without the need for a distinct audio/video signal provider. Technologies available on the Internet, such as streaming media comprising streaming audio and/or streaming video, represent potential implementations for the audio/video signal of these embodiments.
Advances in streaming audio technology make it possible to listen to any audio recording as the sound file is delivered to the personal computer. Streaming audio differs from downloadable audio files in that you can begin to hear and work with the file before it is completely downloaded to the personal computer. A description of streaming audio technology can be found in C. Shipley and M. Fish, How the World Wide Web Works (1996), which is hereby incorporated by reference. In each of the embodiments described above and illustrated in Figs. 7 and 8, the access information corresponding to audio/video signals transmitted through the air, free space or alternative wireless means well known in the art could be inserted within the vertical and/or horizontal blanking intervals, sidebands, or additional channels dedicated to transmission of access information for one or a plurality of broadcast channels. Such dedicated access information channels could be demultiplexed using the current channel being viewed as a selector to determine the relevant access information , to extract at any given time. For audio/video signals transmitted via cable, modem or alternative hardwired means, the access information could be transmitted as additional digital information in headers and/or auxiliary data packets by means well known in the art. Additional channels dedicated to transmission of access information for one or a plurality of audio/video signals transmitted via hardwired means could also be utilized. In each of the embodiments discussed above, access to the networked resource could be made via wired means 102, such as modem, TI , and cable, or wireless means 104 by techniques well known in the art. In addition, in each of the embodiments described above the access information could be transmitted via a sub carrier channel or using spread spectrum techniques well known in the art. A description of spread spectrum technology is provided in the following references, hereby incorporated by reference:
1. R.E. Ziemer and R.L. Peterson, Digital Communications and Spread Spectrum
Systems (1985) . 2. M.K. Simon, J.K. Omura, R.A. Scholtz, and B.K. Levitt, Spread Spectrum Communications Handbook (1994) .

Claims

CLAIMS ;
1. A method for providing a link between an information signal and networked resources comprising the steps of : embedding access information m a transmission medium, said access information adapted to provide access to content of a networked resource relevant to content of said information signal; transmitting said information signal and said access information; receiving said information signal and said access information at a user terminal; extracting said access information from said transmission medium; utilizing said access information to access said networked resource with an access signal; and displaying content of said networked resource on said user terminal corresponding to said access information.
2. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information withm a vertical blanking interval of said information signal .
3. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information withm a horizontal blanking interval of said information signal .
4. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information within bandwidth not used by said information signal .
5. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information within a sideband of said information signal.
6. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information within a header of an internet message packet.
7. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information within a subcarrier in said transmission medium.
8. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of overlaying said access information with said information signal, said step of transmitting further comprises the step of transmitting said information signal and access information using spread spectrum transmission techniques, and said step of receiving further comprising the step of receiving said information signal and access information using spread spectrum reception techniques .
9. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the steps of embedding said access information within a channel comprising access information corresponding to a plurality of information signals, and extracting access information from said channel corresponding to said information signal currently being received.
10. The method for providing a link between an information signal and networked resources of claim 1, further comprising the step of synchronizing said access information to a predetermined portion of said information signal .
11. The method for providing a link between an information signal and networked resources of claim 1, wherein said information signal further comprises video content .
12. The method for providing a link between an information signal and networked resources of claim 1, wherein said information signal further comprises audio content .
13. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of displaying said content of said networked resource further comprises the step of displaying said transmitted networked resource in a picture in a picture (PIP) on said user terminal.
14. The method for providing a link between an information signal and networked resources of claim 1, further comprising the steps of compressing said access information prior to embedding said access information in said transmission medium, and decompressing said access information by said user terminal .
15. The method for providing a link between an information signal and networked resources of claim 1, further comprising the steps of encoding said access information prior to embedding said access information in said transmission medium, and decoding said access information by said user terminal .
16. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of utilizing said access information further comprises the step of embedding said user information into said access signal.
17. The method for providing a link between an information signal and networked resources of claim 16, further comprising the step of compressing said user information prior to embedding said access information nto said access signal.
18. The method for providing a link between an information signal and networked resources of claim 16, further comprising the step of encrypting said user information prior to embedding said access information into said access signal.
19. The method for providing a link between an information signal and networked resources of claim 1, further comprising the step of embedding access information to additional networked resources m said content of said networked resource.
20. The method for providing a link between an information signal and networked resources of claim 1, further comprising the step of encoding said access information to additional networked resources prior to embedding said access information to additional networked resources said content of said networked resource .
21. The method for providing a link between an information signal and networked resources of claim 1, further comprising the step of compressing said access information to additional networked resources prior to embedding said access information to additional networked resources said content of said networked resource.
22. The method for providing a link between an information signal and networked resources of claim 1 further comprising the steps of: assigning an index corresponding to each of a plurality of networked resources; selecting one of said indices corresponding to said plurality of networked resources; and utilizing said index to determine which of said plurality of networked resources to access.
23. The method for providing a link between an information signal and networked resources of claim 22, further comprising the step of providing a summarized content for said index, said summarized content representative of said content of said corresponding networked resource.
24. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding a link to said networked resource m said transmission medium.
25. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding a URL m said transmission medium.
26. The method for providing a link between an information signal and networked resources of claim 1, further comprising the step of recording said user information and optional temporal information by said networked resource.
27. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of displaying content further comprises the step of automatically displaying said content without user intervention.
28. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of displaying content further comprises the step of selectively displaying said content in response to user intervention.
29. The method for providing a link between an information signal and networked resources of claim 1, wherein said user terminal is a personal computer.
30. The method for providing a link between an information signal and networked resources of claim 29, wherein said personal computer is adapted for reception of television signals.
31. The method for providing a link between an information signal and networked resources of claim 29, wherein said personal computer is adapted for reception of radio signals.
32. The method for providing a link between an information signal and networked resources of claim 1, wherein said user terminal is a television.
33. The method for providing a link between an information signal and networked resources of claim 32, wherein said television is adapted for access to the Internet .
34. The method for providing a link between an information signal and networked resources of claim 32, wherein said television is adapted for reception of radio signals .
35. The method for providing a link between an information signal and networked resources of claim 1, wherein said user terminal is a portable personal computer adapted for wireless access to said networked resources.
36. The method for providing a link between an information signal and networked resources of claim 1, wherein said transmission medium is free space.
37. The method for providing a link between an information signal and networked resources of claim 1, wherein said transmission medium is the Internet.
38. The method for providing a link between and information signal and networked resources of claim 1, wherein said step of embedding access information further comprises the step of utilizing user information to determine access to content of the networked resource.
39. The method for providing a link between and information signal and networked resources of claim 1, wherein said step of utilizing said access information further comprises the step of transmitting user information to said networked resource .
40. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of displaying indicia indicating availability of said link to said content of said networked resource and displaying said transmitted networked resource to said user in response to selection of said indicia.
EP98923360A 1997-05-09 1998-05-07 Method for embedding links to a networked resource in a transmission medium Withdrawn EP1025695A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US4603897P 1997-05-09 1997-05-09
US46038P 1997-05-09
PCT/US1998/009416 WO1998051077A1 (en) 1997-05-09 1998-05-07 Method for embedding links to a networked resource in a transmission medium

Publications (2)

Publication Number Publication Date
EP1025695A1 EP1025695A1 (en) 2000-08-09
EP1025695A4 true EP1025695A4 (en) 2002-11-27

Family

ID=21941244

Family Applications (1)

Application Number Title Priority Date Filing Date
EP98923360A Withdrawn EP1025695A4 (en) 1997-05-09 1998-05-07 Method for embedding links to a networked resource in a transmission medium

Country Status (6)

Country Link
EP (1) EP1025695A4 (en)
JP (1) JP2001527724A (en)
AU (1) AU7566898A (en)
BR (1) BR9809251A (en)
CA (1) CA2286708A1 (en)
WO (1) WO1998051077A1 (en)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6375078B1 (en) 1990-09-11 2002-04-23 Metrologic Instruments, Inc. Universal transaction machine for carrying out information-related transactions using html-encoded documents embodying transaction-enabling java-applets automatically launched and executed in response to reading code symbols
US6988662B2 (en) 1997-06-04 2006-01-24 Metrologic Instruments, Inc. System and method for carrying out information-related transactions using web documents embodying transaction-enabling applets automatically launched and executed in response to reading url-encoded symbols pointing thereto
US6068188A (en) 1993-11-24 2000-05-30 Metrologic Instruments, Inc. System and method for composing menus of URL-encoded bar code symbols while using internet browser program
US5992752A (en) 1993-11-24 1999-11-30 Metrologic Instruments, Inc. Internet-based system for enabling information-related transactions over the internet using Java-enabled internet terminals provided with bar code symbol readers for reading Java-Applet encoded bar code symbols
US6076733A (en) 1993-11-24 2000-06-20 Metrologic Instruments, Inc. Web-based system and method for enabling a viewer to access and display HTML-encoded documents located on the world wide web (WWW) by reading URL-encoded bar code symbols printed on a web-based information resource guide
US5905251A (en) 1993-11-24 1999-05-18 Metrologic Instruments, Inc. Hand-held portable WWW access terminal with visual display panel and GUI-based WWW browser program integrated with bar code symbol reader in a hand-supportable housing
US6942150B2 (en) 1993-11-24 2005-09-13 Metrologic Instruments, Inc. Web-based mobile information access terminal
US5715009A (en) 1994-03-29 1998-02-03 Sony Corporation Picture signal transmitting method and apparatus
US6505776B1 (en) 1995-06-07 2003-01-14 Metrologic Instruments, Inc. System for storing, accessing and displaying html-encoded documents relating to an object being worked upon in a work environment by a human operator wearing a wireless http-enabled client system equipped with a code symbol reader programmed to read a url-encoded symbol on the object, access said html-encoded documents from http-enabled information servers connected to an information network, and display same for review while working said object
KR100543768B1 (en) 1996-10-25 2006-01-23 아이피에프 인코포레이션 System and method for managing and serving consumer product related information over the internet
US6386453B1 (en) 1996-11-25 2002-05-14 Metrologic Instruments, Inc. System and method for carrying out information-related transactions
EP0950226A4 (en) 1996-11-25 2002-09-25 Metrologic Instr Inc System and method for carrying out information-related transactions
US6321992B1 (en) 1997-03-19 2001-11-27 Metrologic Instruments, Inc. Internet-based system and method for tracking objects bearing URL-encoded bar code symbols
US7089199B2 (en) 1997-10-27 2006-08-08 Metrologic Instruments, Inc. System for and method of managing and delivering manufacturer-specified consumer product information to consumers in the marketplace
US6959286B2 (en) 1997-10-27 2005-10-25 Ipf, Inc. Method and system for searching a dynamically updated database of UPN/TM/PD and URL data links
US20030173405A1 (en) 2000-01-12 2003-09-18 Metrologic Instruments, Inc. Bar code symbol driven systems for accessing information resources on the internet
CA2265089C (en) 1998-03-10 2007-07-10 Sony Corporation Transcoding system using encoding history information
EP1069779B1 (en) 1999-02-09 2016-04-13 Sony Corporation Coding system and its method
DE19909032A1 (en) * 1999-03-02 2000-09-14 Rainer Wiedmann Data exchange completion method with on-line services for ordering goods from the internet includes TV set accessing online services by activation key on the remote control
US6400272B1 (en) 1999-04-01 2002-06-04 Presto Technologies, Inc. Wireless transceiver for communicating with tags
US6668378B2 (en) * 1999-06-30 2003-12-23 Webtv Networks, Inc. Interactive television triggers having connected content/disconnected content attribute
JP3694888B2 (en) 1999-12-03 2005-09-14 ソニー株式会社 Decoding device and method, encoding device and method, information processing device and method, and recording medium
GB2361611A (en) * 2000-02-18 2001-10-24 Psion Infomedia Ltd Music purchasing method via DAB receiver
DE10031981A1 (en) * 2000-06-30 2002-01-10 Bosch Gmbh Robert Wireless information transmission method e.g. for vehicle navigation system, involves sending Internet address for acquiring additional information along with actual program
US20020144293A1 (en) * 2001-03-27 2002-10-03 Koninklijke Philips Electronics N.V. Automatic video retriever genie
US20030023981A1 (en) * 2001-07-25 2003-01-30 Thomas Lemmons Method and apparatus for transmission of interactive and enhanced television data
JP4196726B2 (en) 2003-05-14 2008-12-17 ソニー株式会社 Image processing apparatus, image processing method, recording medium, and program
FI120055B (en) 2007-12-12 2009-06-15 Metso Paper Inc Method for Attenuating Vibrations and Vibration Damper in a Paper or Board Machine

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0757485A2 (en) * 1995-07-31 1997-02-05 Kabushiki Kaisha Toshiba Interactive television system
WO1997033434A1 (en) * 1996-03-08 1997-09-12 Actv, Inc. An integrated interactive video and internet system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5781228A (en) * 1995-09-07 1998-07-14 Microsoft Corporation Method and system for displaying an interactive program with intervening informational segments
US5694163A (en) * 1995-09-28 1997-12-02 Intel Corporation Method and apparatus for viewing of on-line information service chat data incorporated in a broadcast television program
US5761606A (en) * 1996-02-08 1998-06-02 Wolzien; Thomas R. Media online services access via address embedded in video or audio program
US5774666A (en) * 1996-10-18 1998-06-30 Silicon Graphics, Inc. System and method for displaying uniform network resource locators embedded in time-based medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0757485A2 (en) * 1995-07-31 1997-02-05 Kabushiki Kaisha Toshiba Interactive television system
WO1997033434A1 (en) * 1996-03-08 1997-09-12 Actv, Inc. An integrated interactive video and internet system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO9851077A1 *

Also Published As

Publication number Publication date
CA2286708A1 (en) 1998-11-12
JP2001527724A (en) 2001-12-25
AU7566898A (en) 1998-11-27
BR9809251A (en) 2000-06-27
WO1998051077A1 (en) 1998-11-12
EP1025695A1 (en) 2000-08-09

Similar Documents

Publication Publication Date Title
WO1998051077A1 (en) Method for embedding links to a networked resource in a transmission medium
EP1110394B1 (en) Simulating two way connectivity for one way data streams for multiple parties
US5818441A (en) System and method for simulating two-way connectivity for one way data streams
US6732373B2 (en) Host apparatus for simulating two way connectivity for one way data streams
EP1053641B1 (en) A hand-held apparatus for simulating two way connectivity for one way data streams
US5778181A (en) Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments
CA2245841C (en) Interactive computer system for providing an interactive presentation with personalized video, audio and graphics responses for multiple viewers
US6249914B1 (en) Simulating two way connectivity for one way data streams for multiple parties including the use of proxy
JP3394388B2 (en) Satellite communication system, satellite communication method, and information center distribution device
US20020083464A1 (en) System and method for unprompted, context-sensitive querying during a televison broadcast
US7516466B2 (en) Method and apparatus for retrieving data from a broadcast signal
Srivastava et al. Interactive TV technology and markets
CN1638456A (en) Full scale video picture with overlaid graphical user interface and reduced image
US20080066097A1 (en) Method Of Realizing Interactive Advertisement Under Digital Braodcasting Environment By Extending Program Associated Data-Broadcasting To Internet Area
JP2004507989A (en) Method and apparatus for hyperlinks in television broadcasting
JP2000504527A (en) Transmission and reception of television programs and additional data services
KR20010096552A (en) Apparatus and method for providing and obtaining goods information through broadcast signal
JP2001258005A (en) Distributor, distribution system and its method
JPH08149452A (en) Still image television broadcasting system
JPH08205101A (en) Teletext receiver
JP2002152692A (en) Method for transmitting/receiving broadcast signal, broadcast receiver and information access method
MXPA99010113A (en) Method for embedding links to a networked resource in a transmission medium
EP1276319A1 (en) Advanced method and system for interactive television
Wilson Introductory scenarios for interactive television
JP2005328120A (en) Additional data feeding method by communication and two-way communication method utilizing subtitles broadcast

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 19991207

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

A4 Supplementary search report drawn up and despatched

Effective date: 20021016

AK Designated contracting states

Kind code of ref document: A4

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

18W Application withdrawn

Withdrawal date: 20021111