KR20050018317A - Audio/Video device, Apparatus for controlling the Audio/Video device, and method for this - Google Patents

Abstract

PURPOSE: An AV apparatus, an AV apparatus control device and a control method are provided to mount a program for controlling a web browser and an AV apparatus in an apparatus having a user interface for mutually interacting with a user, thereby easily controlling the AV apparatus while easily sensing whether an event is generated in the AV apparatus. CONSTITUTION: A client(200) corresponds to an apparatus for controlling other AV apparatus. A server(210) corresponds to the other AV apparatus controlled by the client(200). The client(200) includes a web browser(220) for controlling the server(210). The web browser(220) consists of an HTML file(230) and a plug-in module(240) loaded by the web browser(220). The server(210) consists of a web server(250) for supplying a web page of the server(210), and a server agent(260) for substantially controlling the AV apparatus. The plug-in module(240) processes various types of data in connection with the web browser(220).

Description

A / V device, Apparatus for controlling the Audio / Video device, and method for this}

The present invention relates to audio / video (AV) device control using a web browser, and more particularly, a web browser in a device having a user interface that can interact with a user, such as a DTV. And a method for controlling an AV device by mounting a program for controlling the AV device.

In general, in order to control AV devices constituting a home network, there is a method of controlling an AV device by attaching a web browser to a device having a user interface such as a DTV or a PDA and connecting to each web server in the AV device. Another AV device control method is a method of controlling an AV device by mounting a separate client / server program for controlling the AV device.

1A illustrates a method of controlling an AV device using a web browser among the above methods. In such a case, a request is received from the client device 100 having a user interface for controlling an AV device such as a DTV or a PDA through the HTTP protocol, the processing thereof is performed, and then the HTTP protocol is used again. A server side web server of the controlled AV device 110 which transmits to the client device 100 and a client side web browser which transmits a request to the web server using the HTTP protocol and receives the response. .

First, the user executes a web browser in the client 100 and accesses the URL of the AV device to be controlled through the web browser. At this time, the web browser directly accesses the web server of the target device 110. The web server of the target device 110 transmits a predetermined homepage to the client 100. The user uses the control service provided by the device 110 from the homepage provided by the target device 110 through a web browser. For example, when the D-VHS is the target device, the "PLAY" command is performed. The web server calls a device-specific function in the CGI, executes a user command, and transmits the result to the client 100. At this time, the result is transmitted in the form of HTML code. The client-side web browser receiving the result provides the result to the user.

 As described above, executing the control command provided by the AV device through the homepage provided by the AV device to be controlled using the web browser has an advantage of controlling the AV device without knowing the details of the device. However, when an event occurs by another client in the AV device or when an event occurs due to a change in the state of the AV device, it is not known whether the event occurs. That is, the homepage of the AV device already loaded in the web browser may not operate normally because the state change due to the occurrence of the event is not reflected. For example, when the target device is called when the homepage of the target device is called, but the target device is changed to the playback state by another client, the target device is actually loaded even if the user clicks the play button on the homepage already loaded in the web browser. Can be paused. In addition, there is no way to maintain the latest data by reloading the homepage of the AV device loaded in the web browser because it is not known whether the event occurs in the target AV device.

FIG. 1B shows another method of controlling an AV device, and shows a method of controlling an AV device using an independent client / server program. In this case, a server-side program that receives a request from the client 120 through its own protocol, performs a request for the request, and then transmits the request to the client 120 using the protocol again. Hereinafter, a request is transmitted to the AV device 130 including the 'server agent' and the AV device 130 through the protocol, and a response to the request is received. It consists of a client 120 that includes a client-side program (hereinafter referred to as a "client agent") that communicates with the user interface module. At this time, when a predetermined event occurs in the server 130, the server agent transmits the content to the client 120. On the other hand, the user interface module is present in the client 120, and interacts with the user to receive the user's input, and provides the user with a result of whether the input is performed.

When using an independent program module between the client and the server as described above, the user executes a menu provided by the user interface module. Then, the user selects a target device to be controlled from the menu and selects a control command of the corresponding device, for example, a "PLAY" command for reproducing AV data when the server 130 is an AV data reproducing apparatus. At this time, the user interface module sends a user request to the client agent module. The client agent module transmits the user's request to the server agent module of the server 130 using its own protocol. The server agent module receives the request from the client, invokes a function to process the request, executes a command, and sends the result to the client agent module using the protocol. The client agent module then receives the results and sends them to the user interface module, which then provides the received results to the user. If an event occurs by another client in the server 130 or by a state change in the server 130, the server agent module transmits the occurrence of the event to the client agent module. The client agent module receives the occurrence of the event and transmits the content to the user interface module, and the user interface module displays an appropriate message to the user according to the received event.

In the case of using an independent program module between the client and the server as described above, if the server agent module and the client agent module are well designed, there is an advantage that it is easy to know whether or not an event has occurred in the controlled device. ), You should be familiar with what is being controlled. Therefore, if there is a new AV device that is not registered in the client agent after each server agent is installed, the control command cannot be executed normally. In other words, it is possible to control the existing AV devices, but it is difficult to cope with a new type of AV device to be released in the future.

The present invention has been made to solve the above problems, in the present invention, it is possible to easily control the AV device in a convenient way without knowing the details of the AV device, and to control when an event occurs in the AV device to be controlled. We propose an easy way to detect whether an event has occurred in the device.

In order to achieve the above object, the AV device control apparatus according to the embodiment of the present invention includes a web browser for receiving a structured document including a script from the AV device and providing it to the user, and a function called by the script, A first program module for transmitting device control command information to an AV device through a protocol defined using the function, the AV device comprising: a web server module for transmitting the structured document to the AV device control device; And a server program module for receiving the device control command information from the client program module through the protocol and controlling the AV device in response thereto.

Preferably, when the event occurs in the AV device, the server program module transmits event information corresponding thereto to the client program module through the protocol, and the client program module transmits the received event information through the web browser. It is characterized by providing to the user. Preferably, the device control command information may include channel control information, volume control information, reproduction control information, and the like.

On the other hand, in order to achieve the above object, the AV device according to the embodiment of the present invention is a device via a web server module for transmitting a structured document including a script to the AV device control device and a protocol defined from the AV device control device And a server program module for receiving control command information and correspondingly controlling the device, wherein the AV device control device comprises a web browser for providing the structured document and a function called by the script, And a client program module for transmitting the device control command information through the protocol.

Preferably, when the event occurs in the AV device, the server program module transmits event information corresponding thereto to the client program module through the protocol, and the client program module transmits the received event information through the web browser. It is characterized by providing to the user. Preferably, the device control command information may include channel control information, volume control information, and reproduction control information.

On the other hand, in order to achieve the above object, the AV device control method according to the embodiment of the present invention is the first step of collecting the respective AV device information from the AV device connected to the network to provide to the user, and When the user selects a specific AV device, a second step of receiving and providing a control item menu for controlling the selected AV device from the AV device, and selecting a control item specified by the user from the menu provided from the second step. If the event occurs in the AV device, and transmitting the device control command information corresponding to the control item to the selected AV device using a predefined protocol, the event related to the event from the AV device. A fourth step of receiving event information using the protocol and processing corresponding to the received event information It is characterized by including a system.

Preferably, in the third step, when the user selects a specific control item from the menu provided from the second step, a script corresponding to the control item calls step 3-1 to call a function for transmitting device control command information. And Step 3-2, wherein the called function transmits the device control command information to the selected AV device using a predefined protocol.

Preferably, the AV device information includes device name information, image information representing a device, device model information, control function information provided by the device, and script information for implementing the function.

Preferably, the device control command information may include channel control information, volume control information, and reproduction control information.

Hereinafter, an apparatus and method for controlling an AV device according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

2 is a diagram illustrating a configuration of an AV device control system according to an exemplary embodiment of the present invention, which corresponds to a client 200 corresponding to a device to control another AV device and an AV device controlled by the client 200. It is composed of a server 210.

In this case, the client 200 includes a web browser 220 for controlling the server 210. The web browser 220 includes an HTML file 230 in which a script such as Javascript is described and the web browser. And a plug-in module 240 loaded by 220. On the other hand, the server 210 is composed of a web server 250 for providing a web page of the server 210 to the web browser 220 and a server agent 260 that substantially controls the AV device. At this time, the plug-in module 240 is a program module which is connected to the web browser 220 to process various types of data and expresses the result, and is automatically recognized by the web browser 220 and the plug-in. The functionality of the in module 240 is also integrated in the HTML file to provide the same effect as running directly in the web browser 220.

3 is a flowchart illustrating an example of a process in which the plug-in module 240 operates in the client 200.

In order for the plug-in module 240 to operate, a plug-in module 240 is first created (S310), and the plug-in module 240 defined as a specific mime type is registered in the web browser 220 (S320). ). Then, the web browser 220 of the client 200 connects to the web server 250 of the AV device (S330), and receives the HTML file 230 from the web server 250. At this time, the web browser that adds the tag and script related to the plug-in module 240 in the HTML file 230 and loads the HTML file 230 on the side of creating the HTML file 230 ( 220 executes the plug-in module 240 according to the script in the HTML file 230 (S350, S360, S370). The plug-in module 240 executed by the web browser 220 interworks with the server agent 260 to perform a predefined task (S380). That is, the HTML file 230 which is connected to the server agent 260 of the server 210, transmits a control command, receives an event message from the server agent 260, and is loaded by the web browser 220. It will work with the scripts in). Meanwhile, when the web browser 220 loads another HTML file by a user's input or other situation, the plug-in module 240 that is already being performed is terminated, and the newly loaded If there are tags and scripts related to the plug-in module 240 in the HTML file, the above control command transmission or event reception from the server agent 260 is performed.

Meanwhile, in order to access general resources without controlling the AV device, the web browser 220 requests a web page from the web server 250, and the web server 250 sends a request to the web browser 220 in response to the request. Provide the web page.

However, in the case of controlling the AV device, the script in the HTML file 230 executes the plug-in module 240. Then, the plug-in module 240 transmits a control message to the server agent 260 in the server 210 using a proprietary protocol, and the server agent 260 calls an internal function to call the AV device. Control. In addition, when the client 200 registers an event with respect to the server agent 260 in the server 210 using the plug-in module 240, the server agent 260 when an event occurs on the server 210 side. Transmits the generated event information to the plug-in module 240.

4 is a flowchart illustrating an exemplary process of connecting a client / server to control an AV device according to an embodiment of the present invention.

The user accesses the initial page by executing a web browser in the client (S410). The initial page includes a list of AV devices connected to a network and may be generated through discovery and description steps of AV devices connected to a network, or may be dynamically generated by a script. For example, the search of the connected AV device may be performed by checking all broadcast ARP packets and collecting a list of IP addresses. On the other hand, the initial page is present in the specified URL of the client. After the search of the connected AV device is completed, the files shown in [Table 1] are taken from the initial URL of each AV device. In this case, "server" represents an IP address of a server and "port" represents a port number of the server. 5A to 5E show examples of the files shown in Table 1 above.

After accessing the initial page, the plug-in module for the initial page is executed (S412). The executed plug-in module accesses the server agent of AV devices connected to the network, and the server agent transmits an event message to the plug-in module when an event occurs in the server (S414). The plug-in module receives the event message and displays the event information on an initial page (S416). If the event does not occur, it may not go through the steps S414 and S416.

The user selects a device to be controlled from the device list displayed on the web browser (S418). The web browser accesses a web server of the selected device, and the web server transmits its initial HTML file to the web browser (S420 and S422). The web browser executes the plug-in module for the AV device installed in the web browser based on the information in the received HTML file. At this time, the plug-in module is executed according to the contents included in the HTML file, and only executed when there is content of the plug-in module (S424 and S426).

The plug-in module that executes contacts the server agent of the server according to the information in the HTML. The event registration task may be completed only by this operation, but event registration may be performed separately. When this operation is completed, the server agent may receive an event generated by the server (S428, S430).

If the user selects a link to another device in the web browser, the web browser goes to step S420 to access the selected device web server. At this time, if the plug-in is executed in the web browser, the execution ends. This operation alone can complete the event deregistration task, but can also perform event deactivation task separately.

If the user does not select another device link, control of the connected device is started.

6 is a flowchart illustrating an embodiment of a process of disconnecting a client / server according to an embodiment of the present invention.

First, when a plug-in module in a client requests an event subscription release to a server agent in a server (S610), the server agent prevents the plug-in module from receiving an event (S615). Then, the device control plug-in module and the initial page plug-in module which have been operated are sequentially terminated, and finally the web browser is terminated (S620, S625, S630).

7 is a flowchart illustrating an embodiment of a process of controlling an AV device according to an embodiment of the present invention.

When the user selects a control command in the web browser, it executes a script associated with the selected control command, and the script communicates with the plug-in module to deliver the control command selected by the user to the plug-in module.

The plug-in module transmits a corresponding control command to a server agent of a server to which the plug-in module is connected (S710). At this time, the format of the control command can be the same as the CEA-931B. The server agent of the server receives the control command (S70), and after performing the corresponding operation, transmits the result of performing the work to the plug-in module of the client again (S730). At this time, the result of performing work may be the same as defined in CEA-931B. The plug-in module of the client receives the result of the command and delivers it to the script in the HTML (S740). At this time, the script in the HTML receives the result of the command and performs the defined action accordingly. For example, you could do something like "reload" to reload a new web page. On the other hand, when an event such as a state change occurs in the server (for example, during playback and stops), the server sends an event message to plug-in modules of all clients connected to its server agent module. Transmit (S750). The plug-in module of the client receiving the event message delivers the event message to the script in the HTML page currently loaded in the web browser (S760). The script in the HTML receives the event message and performs the defined action according to the same as when the command received the result. At this time, if the user selects another device link, the plug-in module terminates if the plug-in module for the AV device is running.

8 is an exemplary view showing source code related to AV device control and event processing according to an embodiment of the present invention.

The client has a web browser and plug-in module installed, and the server has a web server and server agent installed. The client accesses the server to be controlled through the device list found in the device detection step. The server passes the "index.html" page to the client for control. The web browser looks at the EMBED tag in the HTML and loads the plug-in module for the defined type. When the user selects "Play", it executes the JavaScript function "setPlay ()". The JavaScript function "setPlay ()" calls the "sendEvent ()" function of the plug-in module. The plug-in module first checks if "play" is supported on the server using the query command within "sendEvent ()", and if so, sends a "play" command to the server using control commands. Receiving the "play" command, the server uses the internal API function to perform the "play" command and passes the result to the client's plug-in module. The server, whose internal state is changed by the "play" command, sends an event message to all other client's plug-in modules that have registered an event. The plug-in module that receives the event message from the server calls onEvent (), a JavaScript function in HTML that is currently loaded in the web browser. The JavaScript function onEvent () performs the action corresponding to the server's event message delivered by the plug-in module. For example, if it is defined to "reload", it tells the web browser to receive a new web browser's HTML file from the server. As a result, the web browser receives a new HTML file from the server.

9A to 9D are exemplary diagrams illustrating a protocol for communication between a plug-in module and a server agent according to an embodiment of the present invention. FIG. 9A shows a request format for a command support confirmation and control command, and FIG. 9B shows an example of a command format. 9C and 9D show a control command list and an event list according to an embodiment of the present invention.

10A to 10C are exemplary views illustrating a response format for command support confirmation and control commands for communication between a plug-in module and a server agent according to an embodiment of the present invention. The response uses the general response of HTTP, and includes the values shown in FIG. 10 in the HTTP header.

11 is an exemplary view showing an initial page configuration and a user interface of an AV device plug-in module according to an embodiment of the present invention.

The initial page 1110 shows AV devices connected to the client, and receives an event message of the connected AV device, and the web browser is continuously loaded during execution to serve as a page for monitoring the overall status. The user interface 1120 of the plug-in module for an AV device represents a control interface for a specific device selected by a user, and receives an event message of the current AV device.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited to drawing.

According to the present invention made as described above, even if a device that controls other AV devices, such as DTV, do not know the details of the AV device can be easily controlled in a convenient way, a simple command structure for controlling the AV device AV devices that are developed and appearing in the market by using the PSI can easily participate in the network. In addition, the AV device currently controlled by the plug-in module and the script according to the embodiment of the present invention has the effect of recognizing the fact and actively responding to the situation even when the state is changed by other AV devices. have.

1A is an exemplary diagram illustrating a method of controlling an AV device using a web browser.

1B is an exemplary diagram illustrating a method of controlling an AV device using an independent client / server program.

2 is an exemplary view showing a configuration of an AV device control system according to an embodiment of the present invention.

3 is a flowchart illustrating an exemplary process of operating a plug-in module in a client according to an exemplary embodiment of the present invention.

4 is a flowchart illustrating an exemplary process of connecting a client / server to control an AV device according to an embodiment of the present invention.

5A to 5E are exemplary views showing the types of files representing information on AV equipment according to the embodiment of the present invention.

6 is a flowchart illustrating an embodiment of a process of disconnecting a client / server according to an embodiment of the present invention.

7 is a flowchart illustrating an embodiment of a process of controlling an AV device according to an embodiment of the present invention.

8 is an exemplary view showing source code related to AV device control and event processing according to an embodiment of the present invention.

9A to 9D are exemplary diagrams illustrating a protocol for communication between a plug-in module and a server agent according to an embodiment of the present invention.

10A to 10C are exemplary views illustrating a response format for command support confirmation and control commands for communication between a plug-in module and a server agent according to an embodiment of the present invention.

11 is an exemplary view showing an initial page configuration and a user interface of an AV device plug-in module according to an embodiment of the present invention.

* Description of the symbols for the main parts of the drawings *

200: AV device control device

210: AV device

220: web browser

230: HTML document

240: plug-in module

250: web server

260: server agent

Claims (16)

A web browser for receiving a structured document including a script from an AV device and providing the same to a user; And a first program module including a function called by the script and transmitting device control command information to the AV device through a protocol defined using the function. The AV device includes a web server module for transmitting the structured document and a second program module for receiving the device control command information from the first program module through the protocol and controlling the AV device accordingly. AV apparatus control apparatus. The method of claim 1, When the event occurs in the AV device, the second program module transmits event information corresponding to the first program module through the protocol, and the first program module transmits the received event information through the web browser. AV device control apparatus characterized in that provided to the user. The method according to claim 1 or 2, And the device control command information includes channel control information. The method according to claim 1 or 2, And the device control command information includes volume control information. The method according to claim 1 or 2, And the device control command information includes reproduction control information. A web server module for transmitting a structured document including a script to an AV device control device and a first program module for receiving device control command information from the AV device control device through a predefined protocol and controlling the device accordingly; Wherein the AV device control device includes a web browser for providing the structured document to a user and a function called by the script, and transmits the device control command information via the protocol using the function. An AV device comprising two program modules. The method of claim 6, When the event occurs in the AV device, the first program module transmits event information corresponding to the AV program to the second program module through the protocol, and the second program module transmits the received event information through the web browser. AV device, characterized in that provided to the user. The method according to claim 6 or 7, The device control command information includes channel control information. The method according to claim 6 or 7, The device control command information includes volume control information. The method according to claim 6 or 7, And the device control command information includes reproduction control information. A first step of collecting respective AV device information from AV devices connected to a network and providing the same to a user; A second step of receiving and providing a control item menu for controlling the selected AV device from the AV device when the user selects a specific AV device among the provided AV device information; A third step of transmitting a device control command information corresponding to the control item to the selected AV device using a predefined protocol when the user selects a specific control item from the menu provided from the second step; And And when the event occurs in the AV device, receiving event information about the event from the AV device using the protocol and performing a process corresponding to the received event information. How to control AV equipment. The method of claim 11, The third step may include steps 3-1, when a user selects a specific control item from a menu provided from the second step, a script corresponding to the control item calls a function for transmitting device control command information; And And calling step 3-2, wherein the called function transmits the device control command information to the selected AV device using a predefined protocol. The method according to claim 11 or 12, wherein The AV device information includes device name information, image information representing a device, device model information, control function information provided by the device, and script information for implementing the function. The method according to claim 11 or 12, wherein And the device control command information includes channel control information. The method according to claim 11 or 12, wherein And the device control command information includes volume control information. The method according to claim 11 or 12, wherein And the device control command information includes reproduction control information.