KR102112004B1 - Multimedia device for controlling at least two items related to different data type and device type and method for controlling the same - Google Patents

Abstract

Disclosed is a technique for a multimedia device and its control method. A multimedia device for controlling at least two or more items of different data types and device types according to an embodiment of the present invention includes a conversion module for converting a currently executing first item into an image format, and a list of items from an external device. A network interface module to receive, a memory to store the image and the additional information of the first item and the received item list, a memory controller to access the memory, and corresponding to each item in a predetermined area of the screen A display module for displaying an image, an input module for selecting an image corresponding to a specific item, and a controller for controlling to execute the specific item using additional information corresponding to the specific item.

Description

MULTIMEDIA DEVICE FOR CONTROLLING AT LEAST TWO ITEMS RELATED TO DIFFERENT DATA TYPE AND DEVICE TYPE AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to a multimedia device, and more particularly, to a multimedia device and a method for controlling the same, which control at least two or more items of different data types and device types.

Recently, smart TVs have been commercialized, and the product barrier between conventional TVs and mobile devices is broken, and each device tends to be converged. Products that provide various functions are sometimes referred to as multimedia devices.

However, a technique for more quickly accessing dozens or hundreds of functions provided by a multimedia device from a user's perspective is still in the introduction stage. Each of the functions provided by the multimedia device has different product attributes and data types, but if they are separately managed, there is a technical limitation that a data processing speed for access or a user's access speed must be significantly reduced.

The technical problem to be achieved by an embodiment of the present invention is to omit a complicated process (ex: menu consisting of numerous depths) of various functions provided by a multimedia device (for example, a smart TV), and a more convenient and quick interface to a user It is to provide the environment.

The technical problem to be achieved by another embodiment of the present invention is to define a sync flow related to data / communication for managing specific items of heterogeneous devices in one device.

In addition, a technical problem to be achieved by another embodiment of the present invention is to provide a solution that can automatically adjust the amount of data to be transmitted according to the data attribute of the item to be shared.

A control method of a multimedia device that controls at least two or more items of different data types and device types according to an embodiment of the present invention includes converting a running first item into an image format, and Storing the image and the additional information in a memory; converting the second item being executed into an image format (the data type of the second item is different from the data type of the first item); and the second item Storing images and additional information of the memory in the memory; receiving a list of items from an external device via a network; storing the received list of items in the memory; accessing the memory to access the multimedia Display the image corresponding to each item in a preset area of the screen of the device And a step of playing, and when the image corresponding to the specific item is selected, executing the specific item using additional information corresponding to the specific item.

In addition, a multimedia device that controls at least two or more items of different data types and device types according to an embodiment of the present invention includes a conversion module for converting a currently executing first item into an image format, and an item from an external device. A network interface module for receiving a list, a memory for storing the image and the additional information of the first item and the received item list, a memory controller for accessing the memory, and each item in a predetermined area of the screen. It includes a display module for displaying a corresponding image, an input module for selecting an image corresponding to a specific item, and a controller for controlling to execute the specific item using additional information corresponding to the specific item.

According to an embodiment of the present invention, a variety of functions provided by a multimedia device (for example, a smart TV) is omitted by a complicated process (ex: menu consisting of numerous depths), and a more convenient and rapid interface environment is provided to the user. do.

According to another embodiment of the present invention, there is a technical effect of defining a sync flow related to data / communication for managing specific items of heterogeneous devices in one device.

And, according to another embodiment of the present invention, it provides a solution that can automatically adjust the amount of data to be transmitted according to the data attribute of the item to be shared.

Furthermore, not only the above-described effects of the invention, but also the effects of other inventions predicted to those skilled in the art in light of the overall contents of the patent application specification and matters shown in the drawings are expected.

1 schematically shows an entire system including a multimedia device, a mobile device, and a PC according to an embodiment of the present invention.
2 is a block diagram showing internal configuration modules of a multimedia device according to an embodiment of the present invention.
FIG. 3 is a block diagram showing the control unit illustrated in FIG. 2 in more detail.
4 is a block diagram showing internal configuration modules of at least a multimedia device according to another embodiment of the present invention.
5A to 5C illustrate a process in which a multimedia device according to an embodiment of the present invention accesses a smart box for the first time.
6A to 6C illustrate a process in which a multimedia device according to an embodiment of the present invention adds a specific item to a smart box.
7A to 7D illustrate a process in which a multimedia device according to an embodiment of the present invention executes a specific item included in a smart box.
8A to 8C illustrate a process in which a multimedia device according to another embodiment of the present invention accesses a smart box for the first time.
9A to 9C illustrate a process in which a multimedia device according to another embodiment of the present invention adds a specific item to a smart box.
10A to 10C illustrate a process in which a multimedia device according to another embodiment of the present invention executes a specific item included in a smart box.
11 and 12 are diagrams for explaining an embodiment in which a multimedia device according to another embodiment of the present invention uses a smart box while executing an arbitrary item.
13 illustrates a GUI in which items included in a smart box are arranged according to specific criteria.
14 illustrates a data structure used in a process in which a multimedia device according to an embodiment of the present invention shares items obtained from different devices.
15 illustrates a data structure used in a process of sharing a first item by a multimedia device according to an embodiment of the present invention.
16 illustrates a data structure used in a process of sharing a second item by a multimedia device according to an embodiment of the present invention.
17 illustrates a data structure used in a process of sharing a third item by a multimedia device according to an embodiment of the present invention.
18 is a flowchart illustrating a method of controlling an entire system including a multimedia device according to an embodiment of the present invention.
And, Figure 19 is a flow chart showing a control method of a multimedia device according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "modules" and "parts" for components used in the following description are simply given in consideration of the ease of writing this specification, and the "modules" and "parts" may be used interchangeably.

Furthermore, embodiments of the present invention will be described in detail with reference to the accompanying drawings and the contents described in the accompanying drawings, but the present invention is not limited or limited by the embodiments.

The terminology used in the present specification is a general terminology that is currently widely used while considering functions in the present invention, but this may vary according to the intention or custom of a person skilled in the art or the appearance of a new technology. In addition, in certain cases, some terms are arbitrarily selected by the applicant, and in this case, their meaning will be described in the description of the applicable invention. Therefore, it is intended to clarify that the terms used in the present specification are to be interpreted based on the actual meaning of the terms and the contents of the present specification, not simply the names of the terms.

1 schematically shows an entire system including a multimedia device, a mobile device, and a PC according to an embodiment of the present invention. Hereinafter, an entire system including a multimedia device according to an embodiment of the present invention will be schematically described with reference to FIG. 1.

As described above, in the case of a smart TV providing various functions, it takes too much time to find a function directly desired by a user, and a considerable depth related to a menu is requested. One embodiment of the present invention is to solve this problem.

Furthermore, by using a newly defined smart box according to an embodiment of the present invention, a user can bookmark applications, video content, etc. as well as channels, and share the smart box with other heterogeneous devices. Suggest a solution.

First, as shown in FIG. 1, the system according to an embodiment of the present invention includes a multimedia device 100, a mobile device 150, and a PC 170. Of course, the scope of the present invention can be determined by each of the devices and should be determined according to the matters described in the claims.

In addition, the multimedia device 100 is designed to store information related to arbitrary items 111, 112, 113, and 114 in one smart box 110. In particular, the items 111, 112, 113, and 114 are all composed of different types of data. Furthermore, the smart box 110 may provide a favorite function of items corresponding to different types of data, and at the same time may provide a favorite function of items obtained from different devices.

Meanwhile, the mobile device 150 (for example, a smart phone) is also designed to store information related to arbitrary items 161, 162, and 163 in one smart box 160, and the PC 170 (For example, a notebook, tablet PC, desktop, etc.) is also designed to store information related to arbitrary items 181, 182, and 183 in one smart box 180. In addition, with respect to an interface for adding arbitrary items to a smart box and executing a specific item, it will be described later in more detail with reference to FIGS. 5 to 13.

And, for the transmission protocol for data sharing between the smart box 110 of the multimedia device 100, the smart box 160 of the mobile device 150 and the smart box 180 of the PC 170, It will be described in more detail with reference to FIGS. 14 to 18 below.

2 is a block diagram showing internal configuration modules of a multimedia device according to an embodiment of the present invention. Hereinafter, a multimedia device according to an embodiment of the present invention will be described with reference to FIG. 2.

First, as shown in FIG. 2, the multimedia device 200 according to an embodiment of the present invention includes a broadcast receiving module 201, a demodulator 202, a network interface 203, and an external device interface 204. , A memory 205, a control unit 206, a video output unit 207, an audio output unit 208, a power supply unit 209, and a user interface 211. Meanwhile, the multimedia device 200 is designed to perform data communication with the remote controller 210.

The broadcast receiving module 201 may be designed with, for example, an RF tuner or an interface for receiving broadcast data from an external device such as an STB.

The broadcast receiving module 201 may receive, for example, a single carrier RF broadcast signal according to an Advanced Television System Committee (ATSC) method or a multiple carrier RF broadcast signal according to a Digital Video Broadcasting (DVB) method.

The demodulator 202 receives the digital IF signal DIF converted by the broadcast receiving module 201 and performs a demodulation operation. For example, when the digital IF signal output from the broadcast receiving module 201 is ATSC, the demodulator 202 performs 8-VSB (8-Vestigal Side Band) demodulation, for example. Further, the demodulator 202 may perform channel decoding.

The external device interface 204 is an interface that enables data communication between the external device and the multimedia device 200. The external device interface 204 may be wired / wirelessly connected to an external device such as a DVD (Digital Versatile Disk), Blu-ray, game device, camera, camcorder, computer (laptop), or STB. The external device interface 204 transmits a video, audio, or data signal input from the outside through the connected external device to the controller 206. Also, an image, audio, or data signal processed by the control unit 206 may be output to an external device.

The external device interface 204 includes, for example, a USB terminal, a Composite Video Banking Sync (CVBS) terminal, a component terminal, an S-video terminal (analog), a Digital Visual Interface (DVI) terminal, and a High Definition Multimedia Interface (HDMI). Terminal, an RGB terminal, and a D-SUB terminal.

The network interface 203 provides an interface for connecting the multimedia device 200 to a wired / wireless network including an Internet network. The network interface 203 may include, for example, an Ethernet terminal or the like for connection with a wired network, and for connection with a wireless network, for example, a wireless LAN (WLAN) (Wi-Fi) ), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards and the like can be used.

The network interface 203 may transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network.

In the memory 205, a program for processing and controlling each signal in the control unit 206 may be stored, or a signal-processed image, audio, or data signal may be stored. Also, the memory 205 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface 204 or the network interface 203. Further, the memory 205 stores various OSs, middlewares, and platforms, for example.

The user interface 211 transfers a signal input by the user to the control unit 206 or transmits a signal from the control unit 206 to an external device (eg, the remote controller 210). For example, the user interface 211 may include power on / off, channel selection, screen setting, etc. from the remote controller 210 according to various communication methods such as a radio frequency (RF) communication method and an infrared (IR) communication method. It is designed to receive and process control signals or to transmit control signals from the control unit 206 to the remote controller 210.

The control unit 206 may demultiplex an input stream or process demultiplexed signals through the broadcast reception module 201, demodulation unit 202, network interface 203, or external device interface 204. , It can generate and output signals for video or audio output. The control unit 206 will be described later in more detail with reference to FIG. 3.

The video output unit 207 converts a video signal, a data signal, an OSD signal, or a video signal received from the external device interface 204 processed by the control unit 206 into R, G, and B signals, respectively. To generate a drive signal. The video output unit 107 may be a PDP, LCD, OLED, flexible display, 3D display, or the like.

The audio output unit 208 receives a signal processed by the control unit 206, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs the audio. The audio output unit 208 may be implemented with various types of speakers.

Then, the power supply unit 209 supplies the corresponding power throughout the multimedia device 200. In particular, the control unit 206, which can be implemented in the form of a system on chip (SOC), and a video output unit 207 for image display and an audio output unit 208 for audio output are supplied. Can be.

FIG. 3 is a block diagram showing the control unit illustrated in FIG. 2 in more detail. Hereinafter, a controller (control unit) according to an embodiment of the present invention will be described in more detail with reference to FIGS. 2 and 3.

As shown in FIG. 3, the control unit 306 of the multimedia device includes a demultiplexing unit 310, an image processing unit 320, an OSD generation unit 340, a mixer 350, a frame rate conversion unit 355, and And a formatter 360. In addition, designing to further include a voice processing unit (not shown) and a data processing unit (not shown) also belongs to another scope of the present invention.

The demultiplexing unit 310 demultiplexes the input stream. For example, when MPEG-2 TS is input, it can be demultiplexed to separate video, audio, and data signals.

The image processing unit 320 may perform image processing of the demultiplexed image signal. To this end, the image processing unit 320 may include an image decoder 325 and a scaler 335. The video decoder 325 decodes a demultiplexed video signal, and the scaler 335 scales the resolution of the decoded video signal to be output from a video output unit. Then, the video signal decoded by the video processing unit 320 is input to the mixer 350.

The OSD generator 340 generates an OSD signal according to a user input or by itself. Accordingly, the mixer 350 may mix the OSD signal generated by the OSD generating unit 340 and the decoded image signal processed by the image processing unit 320.

The mixed signal is provided to the formatter 360. Because the decoded broadcast video signal or the external input signal and the OSD signal are mixed, the OSD can be displayed overlaid on the broadcast video or the external input video.

The frame rate converter (FRC) 355 may convert the frame rate of the input image. For example, convert a frame rate of 60 Hz to 120 Hz or 240 Hz.

Then, the formatter 360 receives the output signal of the frame rate conversion unit 355, changes the format of the signal to fit the video output unit, and outputs the signal. For example, R, G, and B data signals may be output, and the R, G, and B data signals may be output as low voltage differential signaling (LVDS) or mini-LVDS.

4 is a block diagram showing internal configuration modules of at least a multimedia device according to another embodiment of the present invention. With reference to FIGS. 2 and 3 previously described, it is also possible for a person skilled in the art to supplement and interpret FIG. 4. For example, it is also within the scope of the present invention to implement other embodiments by adding some blocks illustrated in FIGS. 2 and 3 to FIG. 4.

4, the multimedia device 400 includes a conversion module 401, a network interface module 402, a controller 403, an input module 404, a display module 405, a memory 406, and a memory. It comprises a controller 407 and the like. The external device 450 corresponds to the mobile device 150 or the PC 170 shown in FIG. 1.

The conversion module 401 converts the currently executing first item into an image format, and the network interface module 402 is designed to receive a list of items from the external device 450.

The memory 406 stores the image and additional information of the first item and the received item list, and the memory controller 407 is designed to access the memory 406.

The display module 405 is designed to display an image corresponding to each item in a predetermined area of a screen (not shown) of the multimedia device 400.

The input module 404 is designed to select an image corresponding to a specific item, and the controller 403 controls to execute the specific item using additional information corresponding to the specific item. Furthermore, the input module 404 may be a local key button attached to the multimedia device 400 or a module that receives a command from the remote controller 460.

Further, according to another embodiment of the present invention, the conversion module 401 converts the second item being executed into an image format, and the data type of the second item and the data type of the first item are designed differently. have. Therefore, there is an advantage in that items with completely different data types can be managed in one memory address, and there is a technical effect of increasing the access speed for each item. In addition, the memory controller 407 is designed to store the image and additional information of the second item in the memory 406. For example, it is also a feature of the present invention that the device type of the item identified in the item list and the device type of the first item and the second item are set differently.

According to another embodiment of the present invention, the network interface module 402, the multimedia device 400 and the external device 450 is not directly connected to the same network, the multimedia device 400 And accessing a server shared by the external device 450 and receiving the item list through the server, wherein the item list is uploaded to the server by the external device 450. The item list is designed to be transmitted in XML format, for example. Therefore, there is also a technical effect of reducing the load of data transmission.

When the item corresponds to a TV program, the additional information includes, for example, at least one of episode number information of the TV program or current playing time information. In this regard, it will be described later in detail with reference to FIG. 15.

When the item corresponds to a web page, the additional information includes, for example, a URL address of the web page. In this regard, it will be described later in detail with reference to FIG. 16.

When the item provides a plurality of videos, the additional information includes, for example, at least one of thumbnail image information, ID information, or current playing time information. In this regard, it will be described later in detail with reference to FIG. 17.

5A to 5C illustrate a process in which a multimedia device according to an embodiment of the present invention accesses a smart box for the first time. Hereinafter, with reference to FIGS. 5A to 5C, a process of a user watching a specific channel accessing the smart box will be described.

First, as shown in FIG. 5A, the multimedia device 500 according to an embodiment of the present invention outputs the corresponding video data 510 by tuning to an arbitrary broadcast channel. At this time, a remote controller 550 for controlling the multimedia device 500 is used.

The remote controller 550 is equipped with a position sensor, and it is possible to arbitrarily adjust the position of the indicator 520 in the screen. For example, suppose that the indicator 520 is positioned on the left side of the screen as shown in FIG. 5A using the remote controller 550. Of course, if the remote controller 550 is not equipped with a position sensor, an arrow direction key button of the conventional remote controller may be used.

At this time, as shown in FIG. 5B, the multimedia device displays a portion of the smart box 530, and outputs the entire area of the smart box 540 in the screen, as shown in FIG. 5C. That is, it is also a feature of the present invention that the display of the smart box is determined according to the position of the indicator 520. When the user uses the first smart box function, as shown in Fig. 5C, no items are included.

6A to 6C illustrate a process in which a multimedia device according to an embodiment of the present invention adds a specific item to a smart box. After assuming FIGS. 5A to 5C, a solution for adding a specific item to the smart box will be described with reference to FIGS. 6A to 6C.

As shown in FIG. 6A, the multimedia device 600 outputs video data 610 corresponding to a broadcast program of a currently tuned channel. At this time, when the user selects a specific hot key (or OK, OK button) using the remote controller 650, the screen currently being output is captured, and the reduced size image data 630 is output. Furthermore, by designing the position of the indicator 620 to be located within the captured image 630, it is also a technical effect of the present invention to design the user to easily move the captured image to the smart box 640.

At this time, the user is easy to move the captured image 631 in the direction of the smart box 641 by dragging the indicator 621 moving according to the motion of the remote controller, as shown in FIG. 6B.

And, as shown in Figure 6c, when the captured image 632 is perfectly located in the smart box 642, it is designed to be able to add more items by designing it smaller than the size of the first captured image do. Accordingly, there is an advantage in that it is possible to omit all complicated procedures for registering a preferred channel or a preferred broadcast program according to the prior art.

7A to 7D illustrate a process in which a multimedia device according to an embodiment of the present invention executes a specific item included in a smart box. On the premise of FIGS. 5 to 6 previously described, a process of executing an item added to a smart box by the multimedia device according to an embodiment of the present invention will be described with reference to FIGS. 7A to 7D.

First, as illustrated in FIG. 7A, it is assumed that the captured image 740 of a specific item is included in the smart box 730. The multimedia device 700 outputs video data 710 corresponding to a broadcast program of another channel.

At this time, as described above, it is possible to select a specific image 740 in the smart box 730 using the indicator 720 moving according to the motion of the remote controller 750.

For example, as shown in FIG. 7B, while outputting video data 711 corresponding to a broadcast program of another channel, the indicator 721 is positioned on a specific captured image 741 using a remote controller. In the captured image 741, additional information such as channel information or broadcast program information at the time of capture is stored in a memory or a smart box.

As an embodiment executed after FIG. 7B, both can be assumed. When the captured image and the channel at the time of capture are mapped, it is automatically switched to the mapped channel as shown in FIG. 7C. The current screen 712 of the mapped channel is displayed. However, since the user may have intended to capture the concept of the preferred program rather than the preferred channel, a solution related to this will be described in FIG. 7D.

When the captured image and the program information at the time of capture (for example, website information) are mapped, as shown in FIG. 7D, it is moved to a specific website that provides various data related to the broadcast program. If the Internet connection status is OFF, automatic switching to ON is also a feature of the present invention. The screen 713 connected to the specific website also provides a video on demand (VOD) service.

8A to 8C illustrate a process in which a multimedia device according to another embodiment of the present invention accesses a smart box for the first time. Previously, FIGS. 5 to 7 described an embodiment in which the present invention was applied in the process of outputting a broadcast channel, while FIGS. 8 to 10 described below are embodiments in which the present invention was applied in the process of outputting an Internet-related web browser.

First, as shown in FIG. 58, the multimedia device 800 according to an embodiment of the present invention outputs a screen 810 accessed to an arbitrary website. At this time, a remote controller 850 for controlling the multimedia device 800 is used.

The remote controller 850 is equipped with a position sensor, and it is possible to arbitrarily adjust the position of the indicator 820 in the screen. For example, suppose that the indicator 820 is positioned on the left side of the screen as shown in FIG. 8A using the remote controller 850. Of course, when the position sensor is not mounted on the remote controller 850, an arrow direction key button of the conventional remote controller may be used.

At this time, as shown in FIG. 8B, the multimedia device displays a portion of the smart box 831, and as shown in FIG. 5C, outputs the entire area of the smart box 832 in the screen. That is, as illustrated in FIGS. 8A, 8B, and 8C, it is also a feature of the present invention that the display of the smart box is determined according to the position of the indicators 820, 821, and 822.

9A to 9C illustrate a process in which a multimedia device according to another embodiment of the present invention adds a specific item to a smart box.

9A, the multimedia device 900 is outputting any website screen 910 that is currently accessed. At this time, when a user selects a specific hot key (or OK, OK button) using the remote controller 950, the screen currently being output is captured, and the reduced size image data 920 is output. Furthermore, by designing the position of the indicator 930 to be located within the captured image 920, it is also a technical effect of the present invention to design the user to easily move the captured image to the smart box 940.

At this time, the user can easily move the captured image 921 in the direction of the smart box 941 by dragging the indicator 931 moving according to the motion of the remote controller, as shown in FIG. 9B.

And, as shown in Figure 9c, when the captured image 922 is perfectly located in the smart box 942, it is designed to be able to add more items by designing smaller than the size of the first captured image do. Therefore, there is an advantage in that it is possible to visualize a favorite registration of a website according to the prior art.

10A to 10C illustrate a process in which a multimedia device according to another embodiment of the present invention executes a specific item included in a smart box.

First, as illustrated in FIG. 10A, it is assumed that the captured image 1030 of a specific item is included in the smart box 1020. The multimedia device 1000 outputs video data 1010 corresponding to a broadcast program of another channel. Or, instead of outputting the video data 1010, a screen connected to another website is also included in the scope of the present invention.

At this time, as described above, it is possible to select a specific image 1030 in the smart box 1020 using the indicator 1040 moving according to the motion of the remote controller 1050.

For example, as shown in FIG. 10B, while outputting video data 1011 corresponding to a broadcast program of another channel, the indicator is positioned on a specific captured image using a remote controller. In the captured image, URL address information at the time of capture is stored in a memory or a smart box. Furthermore, all of storing the URL address information at the time of capture or recording only the upper address information falls within the scope of the present invention.

Accordingly, a screen 1061 that accesses the corresponding URL address is output along with the video data 1011. The user has the advantage of being able to check both screens simultaneously.

Alternatively, as illustrated in FIG. 10C, a wider screen may be provided by designing that the accessed URL address is automatically accessed to output only the connected screen 1062 and the previous video data 1011 is not output.

11 and 12 are diagrams for explaining an embodiment in which a multimedia device according to another embodiment of the present invention uses a smart box during execution of an arbitrary item. Previously, in FIGS. 5 to 10, it has been assumed that an embodiment of the present invention is applied while a broadcast channel or website is running. On the other hand, FIGS. 11 and 12 will be described when the embodiment of the present invention is applied while executing other functions.

The multimedia device according to an embodiment of the present invention outputs arbitrary video content 1100 as illustrated in FIG. 11. The video content 1100 may be, for example, content pre-stored in the internal memory of the multimedia device or content stored in an external device, memory, or the like.

 At this time, in the manner described above, it is possible to capture the running video content 1100 and store the captured image 1101 in the smart box. Accordingly, when the captured image 1101 is selected, the content previously stored in the memory of the multimedia device may be executed again, or information on the external device / memory may be recorded and a screen connected to the external device / memory is provided. It also belongs to the scope of the present invention.

The multimedia device according to another embodiment of the present invention outputs a screen 1200 on which a specific application for providing a video is executed, as shown in FIG. 12. Unlike the previous descriptions, it is also possible to include the representative image 1201 of a specific application providing a video in the smart box without capturing the currently executed screen 1200. Therefore, when the representative image 1201 is selected, the specific application is automatically executed.

13 illustrates a GUI in which items included in a smart box are arranged according to specific criteria. An embodiment in which a plurality of items are included in the previously described smart box will be described with reference to FIG. 13.

A multimedia device according to an embodiment of the present invention uses a screen automatically divided into two areas. The content currently being executed is displayed in the first area 1340, and a GUI displaying items included in the smart box is displayed in the remaining second area 1350.

The remaining second area 1350 does not simply arrange the items included in the smart box, but automatically sorts and displays the items by data type. The second area 1350 is controlled by the first tab 1310, the second tab 1320, and the third tab 1330.

For example, the second area 1350 of FIG. 13 displays only items belonging to the third tab 1330. The third tab 1330 is used to output only items related to a specific application among items included in the smart box.

Meanwhile, the first tab 1310 is used to output only items related to a broadcast program itself or a channel among items included in a smart box. Also, the second tab 1320 is used to output only items related to a website. That is, the first tab 1310, the second tab 1320, and the third tab 1330 are different from the prior art in that they identify different data types.

Furthermore, although not shown in FIG. 13, it will be said that adding a tab for separately displaying a list of items shared through other devices also belongs to another scope of the present invention.

14 illustrates a data structure used in a process in which a multimedia device according to an embodiment of the present invention shares items obtained from different devices. 1, a multimedia device according to an embodiment of the present invention is designed to share information recorded in smart boxes of different devices.

The data structure illustrated in FIG. 14 is transmitted to different devices in XML format. In particular, by transmitting the device type of the smart box to be shared, there is an advantage that items in the smart box can be managed and checked for each device according to a user's need.

For example, the first information 1410 indicating that the shared smart box is stored in the memory of the TV, and the second information indicating that the shared smart box is stored in the memory of the first specific mobile device. (1420), third information 1430 indicating that the shared smart box is stored in the memory of the PC, and fourth information indicating that the shared smart box is stored in the memory of the second specific mobile device. XML data including (1440) is transmitted between each device.

15 illustrates a data structure used in a process of sharing a first item by a multimedia device according to an embodiment of the present invention. Hereinafter, a data structure used in a process in which a multimedia device according to an embodiment of the present invention shares additional information related to a TV program will be described with reference to FIG. 15.

When video data is captured while outputting a TV program, the additional information included in the smart box is, for example, information about a TV program's turn or time watched.

For example, as illustrated in FIG. 15, first information 1510 indicating a data type and second information 1520 indicating a current viewing time are transmitted in XML format. Particularly, when the second information 1520 is used, there is an advantage in that the subsequent viewing function can be used in other devices.

16 illustrates a data structure used in a process of sharing a second item by a multimedia device according to an embodiment of the present invention. Hereinafter, a data structure used in a process in which a multimedia device according to an embodiment of the present invention shares additional information related to a web page will be described with reference to FIG. 16.

When a multimedia device capable of connecting to the Internet outputs an arbitrary web page and the corresponding web page is captured, the additional information included in the smart box is, for example, URL address information of the web page.

For example, the entire URL address information 1610 shown in FIG. 16 is transmitted in XML format. As another embodiment, it is also within the scope of the present invention that the upper URL address information is briefly displayed and transmitted instead of the entire URL address information. When designed in this way, there is a technical effect to increase the data transmission efficiency.

17 illustrates a data structure used in a process of sharing a third item by a multimedia device according to an embodiment of the present invention. Hereinafter, with reference to FIG. 17, a data structure used in a process in which a multimedia device according to an embodiment of the present invention shares additional information related to a specific application (for example, YouTube) will be described.

When video data is captured after outputting a video after running a specific application, the additional information included in the smart box is, for example, thumbnail information (item ID), YouTube item ID (ID), and time information.

For example, as shown in FIG. 17, the first information 1720 corresponds to ID information for identifying the current video, and the second information 1710 displays a representative thumbnail image corresponding to the current video, and third information (1730) displays the time information watched. The information is transmitted in XML format.

In particular, when the third information 1730 is used, there is an advantage in that the subsequent viewing function can be used in other devices.

18 is a flowchart illustrating a method of controlling an entire system including a multimedia device according to an embodiment of the present invention. The process illustrated in FIG. 18 is an example of the entire system, and the scope of the present invention should be interpreted in principle according to the claims.

First, the multimedia device adds an arbitrary item to the smart box (S1801). In this regard, as described above through FIGS. 5 to 12, the same description will be omitted.

The first external device searches a channel for searching the smart box through, for example, a multicast method (S1802). The smart box is stored in the memory of the multimedia device.

When the multimedia device transmits channel information to the first external device (S1803), the first external device joins a channel that can access the smart box (S1804).

When a sync connection between the multimedia device and the first external device is made (S1805), the first external device adds various additional information related to items stored in the multimedia device to the smart box of the first external device ( S1806).

Furthermore, the second external device searches a channel capable of receiving smart box related information in a multicast method (S1807, S1808). When a sync connection is established between the multimedia device and the first external device (S1809, S1810), the second external device is connected to the smart box using additional information received from the multimedia device and the first external device. Add an item (S1811).

On the contrary, when the second external device is in sync connection with the multimedia device and the first external device (S1812, S1813), the first external device uses additional information received from the second external device or the like. , Add an item to the smart box (S1814).

19 is a flowchart illustrating a method of controlling a multimedia device according to an embodiment of the present invention. Hereinafter, a control method of a multimedia device according to an embodiment of the present invention will be described with reference to FIG. 19. Of course, those skilled in the art can supplementally interpret FIG. 19 with reference to FIG. 18.

According to an embodiment of the present invention, a multimedia device that controls at least two or more items of different data types and device types converts a running first item into an image format (S1910).

The image and the additional information of the first item are stored in a memory (S1920), and the running second item is converted into an image format (S1930). For example, the data type of the second item and the data type of the first item are designed differently.

The image and additional information of the second item are stored in the memory (S1940), and an item list is received from an external device through a network (S1950).

The received item list is stored in the memory (S1960), and the memory is accessed to display an image corresponding to each item in a predetermined area of the screen of the multimedia device (S1970).

Then, when an image corresponding to a specific item is selected, it is controlled to execute the specific item using additional information corresponding to the specific item (S1980). In particular, the above-described steps have been sufficiently described in FIGS. 5 to 10, and those skilled in the art can make supplementary interpretations.

The item list includes, for example, images and additional information corresponding to each item. Also, the difference between the prior art and the other technical effects is that the device type of the item identified in the item list and the device type of the first item and the second item are set differently.

The converting steps (S1910, S1930) include capturing video data of an item currently being executed, changing one or more of location information or size information of the captured data, and the changed location information or size. And generating data corresponding to the information in an image format.

In the receiving (S1950), when the multimedia device and the external device are not directly connected to the same network, accessing the server shared by the multimedia device and the external device and the item list through the server It includes the step of receiving. The item list is uploaded to the server by the external device, for example.

The displaying (S1970) further includes classifying items based on at least one of a data type and a device type, and displaying the images corresponding to the classified items by data type or device type. Includes.

As described above with reference to FIGS. 14 to 17, the item list is designed to be transmitted in an XML format, thereby increasing the data transmission speed and efficiency.

When the item corresponds to a TV program, the additional information includes at least one of episode number information of the TV program or current playing time information. In this regard, in the previous FIG. 15, it has been described that a person skilled in the art can repeatedly perform the same.

When the item corresponds to a web page, the additional information includes the URL address of the web page. In this regard, in the previous FIG. 16, it has been described that a person skilled in the art can repeatedly perform the same.

When the item provides a plurality of videos, the additional information includes at least one of thumbnail image information, ID information, or current playing time information. In this regard, in the previous FIG. 17, it has been described that a person skilled in the art can repeatedly perform the same.

The apparatus and control method according to an embodiment of the present invention may implement other embodiments by combining the above-described drawings with the drawings, or by combining matters obvious to those skilled in the art, and this also belongs to the scope of the present invention.

Meanwhile, the operation method of the electronic device of the present invention can be implemented as a code readable by a processor on a recording medium readable by a processor provided in the electronic device. The processor-readable recording medium includes all kinds of recording devices in which data that can be read by the processor are stored. Examples of the recording medium readable by the processor include a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and also implemented in the form of a carrier wave such as transmission through the Internet. . In addition, the processor readable recording medium may be distributed over network coupled computer systems so that the processor readable code is stored and executed in a distributed fashion.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be implemented by a person having ordinary knowledge in the course, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

400: multimedia device
401: conversion module
402: network interface module
403: controller
404: input module
405: display module
406: memory
407: memory controller

Claims (20)

delete delete delete delete delete delete delete delete delete delete In the multimedia device for controlling at least two or more items of different data types and device types,
A conversion module that converts the currently executed first item into an image format;
A network interface module that receives a list of items from an external device;
A memory for storing the image of the first item, the received item list, and additional information of the items included in the first item and the received item list;
A memory controller accessing the memory;
A display module that displays an image corresponding to each item in a predetermined area of the screen;
An input module for selecting an image corresponding to a specific item; And
And a controller that controls to execute the specific item using additional information corresponding to the specific item,
The additional information includes information on a reproduction time point at the moment of converting the first item to the image format and information on a data type of the items included in the first item and the received item list,
The controller
Based on the information on the data type, the display module is controlled to display a plurality of tabs in a predetermined area of the screen,
The plurality of tabs
Among the items included in the first item and the received item list, a first tab for outputting only items related to a broadcast program, a second tab for outputting only items related to a website, and only items related to a specific application are output. It includes a third tab,
When the controller executes the first item, the multimedia device characterized in that the video content corresponding to the first item is played from the playback time. The method of claim 11,
The conversion module converts the second item being executed into an image format,
A multimedia device in which the data type of the second item and the data type of the first item are designed differently. The method of claim 12,
The memory controller,
A multimedia device designed to store the image and additional information of the second item in the memory. The method of claim 12,
A multimedia device characterized in that the device type of the item identified in the item list and the device type of the first item and the second item are set differently. The method of claim 11,
The network interface module,
When the multimedia device and the external device are not directly connected to the same network,
Access to a server shared by the multimedia device and the external device, and
It is designed to receive the list of items through the server,
The item list is a multimedia device, characterized in that uploaded to the server by the external device. The method of claim 11,
The item list is a multimedia device characterized in that it is designed to be transmitted in XML format. The method of claim 11,
When the item corresponds to a TV program,
The additional information includes multimedia number information of the TV program. The method of claim 11,
When the item corresponds to a web page,
The additional information includes a URL address of the web page. The method of claim 11,
When the item provides a plurality of videos,
The additional information is a multimedia device including at least one of thumbnail image information or ID information. The method of claim 11,
The multimedia device corresponds to a television,
The external device is a mobile device or a multimedia device corresponding to a tablet PC.

Images