WO2001017246A1

WO2001017246A1 - Method and apparatus to link a network of live cameras

Info

Publication number: WO2001017246A1
Application number: PCT/US2000/023294
Authority: WO
Inventors: Karl Alomar; Michael Goldstein; David Lowrie; Greg Stolerman
Original assignee: Nitetime Networks, Inc.
Priority date: 1999-08-27
Filing date: 2000-08-25
Publication date: 2001-03-08

Abstract

An apparatus and method to link a global network of cameras (20) over the Internet to provide live real-time viewing of international nightlife as well as a system for allowing offsite security monitoring and management. Use of a software program will allow for quick access of video images downloaded to user's computer during latent periods of Internet connection. Thus, a user will be given the opportunity to view any location or venue in order to allow for a clearer perspective of the location and the environment. The method involves the development of an international network of cameras (20), hosted by one site (10b) that will supply real-time footage to the general public (40) upon their request.

Description

METHOD AND APPARATUS TO LINK A NETWORK OF LIVE CAMERAS

BACKGROUND OF THE INVENTION

1. Field of the Invention This present invention relates to field of video surveillance. In particular, the present invention relates to linking a network of video cameras through the Internet or other wide area network connection.

2. Related Art The present invention is related to the growing Internet industry. The following definitions will be used in describing the related art.

(1) Internet

A system of linked computer networks, international in scope, that facilitates data communication services such as remote login, file transfer, electronic mail, and newsgroups. The Internet is a way of connecting existing computer networks that greatly extends the reach of each participating system.

Typically, internet written with a lower case "i" usually refers to a group of local area networks (LANs) that have been connected by means of a common communications protocol. Many internets exist besides the Internet, including many TCP/IP based networks that are not linked to the Internet. The present invention does not deaf with LAN connections.

(2) Web Site

A Web site is a home and or location on the World Wide Web, where the Web site is made up of Web pages. These pages can contain graphics, text, audio, video and other dynamic and/or static materials. As with many Internet terms "Web site" is constantly used interchangeably with other terms, like home page and "web page." Therefore, one may refer to their "home page" when in fact they are talking about an entire "Web site." Some even refer to a Web site simply as a "Web page," when in fact a Web page is just a single piece of potentially hundreds of other pages making up the entire "site." Similarly, the home page is more correctly the "front door" or entrance to the "web" of other pages linked to the Web site. The process of moving through a Web site is called navigation. A Web site is also considered to be simply any computer hooked up to the Internet and available via a hostname, domain name or URL.

Like "home page" you will often see Web site used in the one word form like "website". Largely, both are considered correct, but companies, individuals and organizations publishing Web pages usually setup for consistency sake, a style guide which among many other things might state that the term Web site should be used in either the single or two word form.

(3) Portal

A Portal is a Web site that offers a broad array of resources and services such as e- mail, discussion forums, search engines, and on-line shopping malls. The first Web portals were online service providers (for example AOL), but now most of the traditional search sites have transformed themselves into Web portals to attract and retain a larger audience.

Currently, the Internet has been a gateway from the real world to the virtual world and was utilized mainly as a source of information. While building in popularity, the full potential of the limited service had not yet been realized. Therefore, even though the current format of the Internet has developed quickly, the present invention realizes that the future of the Internet may still be developed over time, and envisions the applicability to all future forms of the Internet.

The Internet's popularity has grown in conjunction with its application, and a world community has quickly flourished. A wide range of facilities developed, ranging from adult entertainment to stock trading, online gaming and a medium of communication called chat rooms. In conjunction with these facilities, the new network also offered a development that has modified an international form of communication, e-mail. The Internet is a new method of entertainment that offers an opportunity for the masses to reach a number of unreachable locations and facilities. Currently, e-mail traffic on the web amounts to ten times as much as mail in the U.S. postal office. However, small efforts have been made to supply video information on the real world from an Internet portal. Although some adult entertainment sites have used live video feed to display "shows" on the Internet, there has been no effort to offer the public the opportunity to search the world voyeuristically for nightlife at different establishments. The nightlife industry has never had the opportunity to have a global listing of information for its customers. At best, establishments were able to provide information to potential customers through limited media such as travel magazines, newspaper articles, various advertisements, use of promoters, independent ratings and descriptions like Zagat's Guide, and word of mouth. These establishments can only give perspective customers a glimpse of their entertainment experience by showing highlight pictures of the establishment along with people enjoying themselves. As a result, people who like to go out can obtain little information about new or unknown venues and events.

On the other hand, the present invention is also related to video security. Currently, security and management has been constrained to being onsite. Security cameras can only be monitored on the premises or viewed offsite through the use of videotapes which must be previously recorded. This limits the use of these devices for small establishments. Videotapes are also not viewed often. Unlike large high security places such as casinos, smaller establishments do not have the same ability to hire staff to monitor security cameras.

Until now, there has been no way for establishment owners to remotely manage and monitor their places of business. In addition, the nightlife industry has also had no way of giving their potential customers a method of displaying real-time establishment video producing a true view of the entertainment conditions.

SUMMARY OF THE DISCLOSURE

It is an object of an embodiment of the present invention to provide a network of cameras linked to the Internet, which obviates for practical purposes, the above mentioned deficiencies in the prior art.

According to an embodiment of the present invention, a method for displaying live video information through the Internet allows customers to view establishments, while additionally providing security and offsite management for the establishment owners. In addition, according to another preferred embodiment of the present invention, a portal made up of a network of live cameras allows the public to search in a single web site, information about nightlife around the world. The information can be updated directly by the establishments and rated publicly by registered critics. In addition, software can be setup on individual computers that allow images to be downloaded to the individual computers' hard drives for quick access to the video images during the down time connection with the Internet.

By setting up a global network of cameras to show live real-time streaming video through hosting within one site, a real world interactive voyeuristic portal will be created. A network of static continuous cameras will be hosted and maintained through one entity or group of entities for the purpose of representing one or more industries in public commercial venues for information supplied to the general public. This will give viewers a perspective of live changing conditions in various real world industries.

In addition to cameras that will be shown to the public, additional cameras will be installed to remotely monitor the security and create the ability to manage from an offsite location. These additional cameras would only be accessible to the establishment owner. This gives establishment owners the opportunity to look into the activities of their establishment at any time without physically being there. Establishment owners who own several establishments also have the ability to monitor more than one establishment at a time.

Other aspects of the present invention are directed to a computer program and an apparatus corresponding to the method previously described. In alternative embodiments, software will play a greater role in the ability to access the video information. Rather than downloading the images directly from the web portal, software installed on the user computer will allow video images to be stored on the user computer hard disk during the "dead time" when the Internet connection is not actively transferring data. Thus, video images will be available for viewing from the hard disk, rather than having to be downloaded from the web portal each time. Other features and advantages of the invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings that illustrate, by way of example, various features of embodiments of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

A detailed description of embodiments of the invention will be made with reference to the accompanying drawings, wherein like numerals designate corresponding parts in the several figures.

FIG 1 is an overall system block diagram of a preferred embodiment of the present invention.

FIG. 2 is a block diagram of the camera link from an establishment to the central computers.

FIG. 3 is a block diagram of the general user terminal. FIG. 4 is a block diagram of establishment terminal.

FIG. 5 is an overall view of a multiple server data collection and disbursement process.

FIG. 6 is a block diagram of the central servers. FIG. 7 is a flow diagram of user interaction. FIG. 8 is a flow diagram of establishment data entry and modification.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

A detailed description of the present invention will be explained with respect to the drawings. FIG. 1 is an overall system block diagram of a preferred embodiment of the present invention. In this embodiment, the central servers 10 are linked to at least one establishment camera 20, one user 40, and one establishment 30. The central servers 10 support a Web portal where information about the establishment 30 and real time video feed from the cameras 20 located at the establishment 30 can be accessed by the user 40. Although, for purposes of illustration, the embodiment of Figure 1 shows only one establishment camera 20, one user 40, and one establishment 30, the invention envisions a number of cameras 20 in various establishments 30 such as bars, nightclubs, restaurants, and any other points of interest in reference to international nightlife. Moreover, the users 40 would be international in scope, potentially covering anyone with Internet access. As seen in Figure 1, the images of cameras 20 are sent to central servers 10. The central servers 10 are programmed to serve several functions. First, the central servers 10 supports a Web site portal where the images from cameras 20 can be displayed in an organized format offering the user 40 a new perspective view of a common or even unknown scene. The Web site portal would also have many additional features such as chat, bulletin boards, e-mail service, etc. In addition, as described in more detail below, the central servers 10 provide special access to establishments 30 to update information about the establishment and monitor the premises for security and management purposes. Furthermore, the central servers 10 would work in conjunction with software provided to the users 40 which would allow images to be downloaded to users 40 even while the users 40 are not at the Web site portal.

The link to the central servers 10 does not need to be a hard-wired link. It can be an Internet link as described in a subsequent description or any other link. Information about the establishment 30 is stored on the central servers 10 and is updated by each individual establishment 30. Information inputted by the establishment can include directions, prices, promotions, etc. As explained in more detail below, the establishment 30 can periodically update the information stored on central server 10 by accessing the Web portal. In addition, the establishment cameras 20 are constantly sending updated information to the central servers 10. Thereby, users 40, by navigating to the Web site can access information from establishments 30 and their cameras 20 to gain information about the establishment 30 and its environment. Users 40 also supply information to the central servers 10 about themselves to aid in providing preferred information to the user 40. By gathering the information from the establishment 30 and the user 40, the Web portal supported by the central server 10 brings the user 40 and the establishment 30 together on the Internet. Therefore, the preferred embodiment of the present invention would be designed around a detailed international guide to restaurants, bars, clubs and other nightlife, offering not only real time views of the establishment 30, but also reviews and other information. In alternative embodiments of the present invention, this will include a chat service offered to web site visitors and a network of web sites designed to represent specific subscribed bars, clubs and restaurants. In addition, additional services such as a paging service, bulletin board, auctions site, etc. would also be available. Moreover, the establishment 30 can also use the camera 20 for security and management purposes. The central server 10 will provide the establishment 30 special access to use the camera 20 for addition al monitoring capabilities as discussed below in more detail.

The system depicted in FIG. 1 may be embodied in hardware and software specifically provided to implement the present invention. The links to the system may a be implemented using the existing Internet infrastructure. Many users already have computers and access to the Internet. The central servers 10 can be attached to the Internet to facilitate a link to the users. The establishments 30 may also be directly connected to the servers 10 via the Internet or through any type of existing communication system.

FIG. 2 is a block diagram of the preferred camera system which must be located on or near the establishment 30 premises. The camera system includes a camera 20 that captures images of the establishment 30. The CPU 100 performs the processing functions of the server. It also includes a read only memory (ROM) 130 and a random access memory (RAM) 120. The ROM 130 is used to store at least some of the program instructions that are to be executed by the CPU 100 such as portions of the operating system of BIOS and the RAM 120 is used for temporary storage of data. A clock circuit 140 provides a clock signal that is required by the CPU 100. The use of a CPU 100 in conjunction with ROM 130, RAM 120, and clock circuit 140 is well known to those skilled in the art of CPU 100 based electronic circuit design.

One camera 20 is depicted in FIG. 2 for an establishment, but it is not limited to any number of cameras 20. The camera 20 may be digital or analog and may be connected to other devices including but not limited to video recorders before it is fed to the digital capture port 110 of the computer. More than one computer may be used with an increasing number of cameras 20. In addition, cameras 20 may also be part of the computer itself, where the camera 20 and the computer are not necessarily separate entities.

The establishment computer also includes a communication port 150 which enables the CPU 100 to communicate with devices external to the establishment computer. In particular, the communication port 150 facilitates communication between the modem and the CPU 100, so that information arriving from the modem can be processed by the CPU 100 and the CPU 100 can send information to remote locations via the modem.

While the illustrated embodiment uses a modem to communicate with devices outside the central controller, it should be understood that other methods of communicating with external devices might be used instead of a modem. These other methods include hard-wired connections, radio communications, optical communications, and the like. This communication device may connect to the central servers 10 via the aforementioned communications device where the data will then be delivered to users 40 who request it. It may also be stored in a storage device (not depicted) where it can be delivered directly to requesting users 40.

It should be noted that not all of the cameras 20 are to be used as public cameras. Some cameras 20 may be private cameras and used for security purposes by the establishment owners or other concerned parties. The data from these particular private cameras will not be accessible to the public. The establishment may also use all of the public and private cameras 20 for managerial purposes. Management for the establishment can regularly monitor the images coming from the cameras in order to assess issues such as overcrowding, periods of time with little activity as well as other managerial issues.

FIG. 3 is an embodiment of a preferred user terminal which can be located in a residence, office, or other similar places. Like the camera system described above there can be any number of user terminals accessing the central severs 10. Similar to the camera system described above, the user terminal utilizes a CPU 200, ROM 220, RAM 210, a communications port 250, and a clock circuit 240.

The user terminal also includes an input device 205 to receive input from an operator. Any of a variety of input devices 205 would be suitable for this purpose, including, for example, keyboards, mice, touchscreens, and the like. The input device may interface directly with the CPU 200 as shown in figure 2 or an appropriate interface circuit may be placed between the CPU 200 and the input device 205. It should also be noted that these input devices 205 are not limited to hardwired devices. They may be connected via radio, optical or any other type of connection. The user terminal also includes a video monitor 215 for conveying information to the operator. While the most preferred video monitor 215 is a CRT, other video display devices, including LCD, LED, and thin film transistor panels may be used as well, individual indicators may be used as well. Individual indicators may also be used to convey information to the operator including incandescent and neon lamps, LEDs, and the like. A video driver 210 interfaces the CPU 200 to the video monitor 215 (or to any other type of video display device).

The user terminal also contains a data storage device 260, which is used to hold software instructions 261, user information 262, and user preferences 263. The instructions 261 are used in conjunction with the CPU 200 to produce instructions based on user requests and actions.

As mentioned previously, the user terminal can access the information directly from the Web site portal or have software installed on the user computer to download information directly to the user's data storage device 260. The software recreates the website and adds more functionality which cannot be done on a website at the present time. In order to obtain the software, a user needs to go to the website or obtain it from a distribution CD. The CD can be distributed through mailings, or the establishments that support our product, or any other means by which CD's are given out. There are two different pieces of software in this implementation, the user GUI (graphical user interface), and the establishment GUI.

The user GUI allows the central servers to push data in the background. On average, no data is being transferred nearly 80% of the time a user is online. This time can be put to good use by using a new technology called a soft push. The soft push technology detects when most of the bandwidth is not used and uses the latency to download information directly to the user's data storage device 260. In the present invention, videos are sent to the user GUI which will make it appear that the videos are being streamlined in at a rate of 24 frames/second when in reality the transfer of the videos had been done earlier and the video is instead being played from the user's hard drive. This type of system allows users to view television quality video with any speed connection to the Internet. The software also allows the user to track which establishments he or she has visited and rate each one for future reference, information inputted by each user will be used to track individual user preferences for future suggestions on establishments to visit. General user ratings about each establishment will also be gathered which will enable other users in making decisions about individual establishments.

As in the user GUI, a separate software for establishments is also available to be used with the system shown in Figure 4. For the establishment GUI, the program allows each establishment to view and modify information about their site such as menu items, prices and upcoming events. This GUI also allows the establishment users to manage their establishments more effectively. The establishment GUI will enable the owners to maintain their inventory, keep track of work schedules, put together fliers for their special events and auction equipment to other people who are in the in the industry or planning on entering. This tool will also build a more closely knit community with the use of a bulletin board, which will allow owners within the industry to aid each other.

Both of these pieces of software interact with the server to facilitate real-time information updates and viewing. End users also have the ability to view cameras at the establishments through a connection between the central servers and the cameras.

FIG. 4 is a preferred embodiment of an establishment terminal which can be located in the establishment 30, in a residence, in an office or any other similar location. Similar to the user terminal, the establishment terminal utilizes, a CPU 300, ROM 330, RAM 320, a clock circuit 340, an input device 305, a video monitor 315, and a communications port 350 which links to the central servers 10. Of course, instead of the modem depicted in the figure other ways of communicating can be used as described above for the central controller.

The establishment terminal allows the establishment to access a standardized database of web sites for the nightlife industry, whereby clubs, bars and restaurants have the opportunity to setup their own web sites online. A form will be offered online which will be linked directly to a database program that will format and display subscriber information on a standardized web site format. This will allow for the information to be as up to date as possible. This will then be linked into a network of real world sites and hosted by the real world portal. The establishment terminal serves as a means for the establishments to send and update information to the central servers 10. An additional option for the establishment is periodically send establishment conditions through the establishment terminal.

Establishment terminals may be used for management & security purposes. Information is retrieved directly from the establishment camera system and viewed by establishment management. Management has the ability to view various cameras 20 within a given establishment 30 or at any other establishment 30 where access is permitted.

FIG. 5 is a flow diagram of a possible multiple server system used with the present invention. With a large number of users 40, establishments 30, and cameras 20 sending data to the central server 10, there is a need to spread the load over several computers. Establishments 30 are to be located in cities around the world, which poses a problem for long distance digital data integrity. In order to minimize this problem, secondary servers 10b will be located in various areas to improve connectivity to establishments 30 and users 40 that are geographically further away. The secondary servers 10b would then send all data to the main server 10 and receives new updated data which will be delivered to requesting users 40. Please appreciate that the locations of servers are illustrative and not an exact description of the placements of the secondary servers 10b. For example, multiple secondary servers 10b can exist on one continent, or more than one main central server 10 may exist.

FIG. 6 is a block diagram of a preferred central server 10. Like the camera system, the central server 10 utilizes a CPU 400, RAM 420, ROM 430, a clock circuit 440, a communications port 450 and a data storage device 460. Again, the communications port 450 may be connected to a modem, hardwired to the Internet, or any of the other previously mentioned options.

The CPU 400 can also store information to, and read information from the data storage device 460. This data storage device 460 includes a user database 461, an establishment database 462, and a database 463 of all the data being retrieved from the establishment cameras 20. In addition, it includes transaction processor instructions 464 which can be read by and executed by the CPU 400 thereby enabling the CPU 400 to process transactions. It should be noted that while FIG. 6 depicts one CPU 400 and one data storage device

460, several CPUs 400 and data storage devices 460 may be used. FIG. 6 also shows the user database 461, the establishment database 462, and the camera imaging database 463 as separate databases, they may be one coherent database. Several copies of the configuration depicted in FIG. 6 may be used together as a method of mirroring the data.

FIG. 7 is a flow chart depicting the initiation of a transaction using a user terminal.

The steps of the process shown in FIG. 7 may be implemented in a computer program that may be installed at the user terminal from, for example, a computer readable medium (such as floppy disks of CD-ROMS) which is then stored in a memory, in this case the data storage device.

In the case where the user has not registered, the user is required to produce some required information and is then allowed to query the central servers for desired information such as camera images or establishment conditions.

FIG. 8 is a flow chart depicting the initiation of a transaction using an establishment terminal. Again, this can be accomplished using a computer program that may be installed from a readable computer medium. A new establishment will be required to enter certain key information (subscription) in order to have accessibility to the site's establishment services.

Upon subscription, the establishment has the opportunity to setup and alter its information such as prices or its description and it also has the ability to input establishment conditions for immediate display. In order for possible customers to have the ability to have the most up-to-date information about the environment of the establishment, the establishments may post their environment conditions in a periodic fashion.

If subscription includes a camera/security option then the establishment will have the opportunity to view cameras for security and management purposes as described in FIG. 1.

While the description above refers to particular embodiments of the present invention, it should be understood that many modifications may be made without departing from the spirit thereof. Thus, the accompanying claims are intended to cover these and other modifications as would fall within the true scope and spirit of the present invention.

The presently disclosed embodiments are therefore to be considered in all respects as illustrative and not restrictive. The scope of the invention is therefore indicated by the appended claims, rather than the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.

Claims

WHAT IS CLAIMED IS:

1. A system of networked cameras located at a variety of establishments linked together over a global Internet and viewable through a Web site portal or a specialized viewing software, comprising: a central server to control and display information; a plurality of cameras located in a plurality of establishments in electronic communication with the central server wherein at least one camera provides a real time video data stream from the at least one camera's location to the central server; a webpage for the establishment to display the video data stream received by the central server from the at least one camera, wherein the video data stream can be seen from the webpage dedicated to the establishment; further wherein the camera provides a view of the location for voyeuristic purposes as well as security purposes for an owner of the establishment where the camera is located.

2. A system of networked cameras according to claim 1, further wherein the camera at a particular establishment is connected to an establishment computer, the establishment computer comprising: . a CPU clocked at a certain rate; a digital capture controlled by the CPU which is able to capture images from the camera; and a communications port controlled by the CPU and in communication with the central server; wherein the video data stream from the video camera is sent through the communication port to the server; further wherein the communication port can receive information from the server to remotely control the camera.

3. A system of networked cameras according to claim 1, further wherein more than one camera is located at the establishment.

4. A system of networked cameras according to claim 1 , further wherein the central server comprises: a controller; a data storage device operatively connected to the controller, wherein the data storage device contains information and photo images from the plurality of establishments; and a program stored on the data storage device and run on the controller, wherein the program is adapted to receive information from a user and further adapted to download necessary viewing software to the user computer.

5. A system of networked cameras according to claim 4, the central server further comprises of a second program stored on the data storage device and run on the controller, wherein the second program is adapted to receive information from the establishment and further adapted to allow the information to be updated by the establishment.

6. A system of networked cameras according to claim 5, further wherein the second program allows the establishment to view the camera for security and management purposes.

7. A system of networked cameras according to claim 1, wherein the webpage further comprises additional information about the establishment.

8. A system of networked cameras according to claim 7, further wherein the webpage comprises a chat room or bulletin board to discuss the establishment.

9. A system of networked cameras according to claim 1, wherein the central server is electronically linked to a plurality of local servers.

10. A system of networked cameras located at a variety of establishments linked together over a global Internet, comprising: a plurality of cameras located in a plurality of establishments linked together over the Internet; a central server in electronic communication with the plurality of cameras to control, receive, or display information; wherein information received from the plurality of cameras can be viewed through the means of a specialized viewing software downloaded on a computer's disk storage device and operated on a computer^'s CPU; the software method comprising the steps of: detecting a latency during a connection to the Internet; downloading images to the user's disk storage device during the latency; wherein the software allows the downloaded images to be played from the computer's disk storage device without any speed connection to the Internet.

11. A system of networked cameras according to claim 10, further wherein a subset of the plurality of cameras are restricted to be accessed only by an establishment where the cameras are located, wherein the establishment can use the subset of cameras for security or management purposes.

12. A method of linking network of cameras located at a variety of establishments linked together over a global Internet and viewable through a Web site portal or specialized viewing software, comprising the steps of: establishing a Web site portal serviced by a central server to control and display information on the Web site portal; placing a plurality of cameras in a plurality of establishments which are in electronic communication with the central server wherein at least one camera provides a real time video data stream from the at least one camera's location to the central server; establishing a webpage for the establishment to display the video data stream received by the central server from the at least one camera; navigating to the Web site portal wherein the video data stream can be seen from the webpage dedicated to the establishment; and viewing of the webpage for voyeuristic purposes or monitoring the webpage by the owner for security purposes.

13. A method of linking a network of cameras according to claim 12, further comprising the step of: receiving information from a first-time user accessing the webpage; and displaying information about the establishment.

14. A method of linking a network of cameras according to claim 12, further comprising the step of providing a chat room or bulletin board.