KR101781867B1 - Method for controlling at least one of display device located in mart and the display device - Google Patents

Abstract

According to an embodiment of the present invention, a display device located in a mart includes a display module that displays a first mode, a sensor that senses whether any mobile device is positioned within a predetermined distance from the display device, A conversion module for converting the first mode into a second mode when the mobile device is located within a predetermined distance from the display device; a receiving module for receiving a command signal for the specific product; A memory controller for accessing the memory and extracting guide information corresponding to the specific product and a third mode including graphic data for displaying the extracted guide information, To control the display module And a controller.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a control method of a server for controlling at least one display device located within a shopping mall,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to digital devices used in a mart, and more particularly to a method and a device for controlling a server that controls at least one display device located in a mart. The mart is a concept corresponding to, for example, a place where at least one cart capable of loading an object can dynamically move.

In general, there are two options for purchasing a specific item. The first option is to connect to the Internet to purchase a specific item desired by the user, and receive a specific item purchased after a predetermined time elapses. Furthermore, the second option is to visit the traditional markets or marts to purchase the specific item that the user wants and immediately obtain it.

Particularly, the second option described above is advantageous in that the user can directly confirm the actual appearance of the desired item, and can purchase at least one or more items directly in the cart.

However, in the conventional mart environment, there is a problem that only a fixed service is provided regardless of the change of the users located in the mart. In addition, there are a large number of employees guiding the mart, and there is also a disadvantage that considerable costs are incurred in order to manage the mart.

One embodiment of the present invention seeks to provide a solution for automatically adjusting the status of multi-systems in a mart by analyzing users located within the mart.

Further, another embodiment of the present invention is to provide a system for displaying optimized information according to a movement of a user moving within a mart.

Yet another embodiment of the present invention is to define a protocol that allows a customer in a mart to access desired information quickly while minimizing the number of managers in the mart.

A method of controlling a server for controlling at least one display device located in a mart according to an embodiment of the present invention includes receiving information about each user using at least one mobile device located in a first area, , Accessing a memory storing purchase pattern information for each user or each group, generating a command signal for guiding a specific item based on the purchase pattern information, And transmitting, to the device, a command signal guiding the generated specific product.

According to another aspect of the present invention, there is provided a display device including a display module for displaying a first mode, a sensor for sensing whether a certain mobile device is positioned within a predetermined distance from the display device, A conversion module for converting the first mode into a second mode when an arbitrary mobile device is located within a predetermined distance from the display device; a receiving module for receiving a command signal for a specific product; A memory for storing guide information, a memory controller for accessing the memory and extracting guide information corresponding to the specific product, and a third mode including graphic data for displaying the extracted guide information , The display module And a controller for controlling the motor.

According to an embodiment of the present invention, there is provided a solution for automatically adjusting the status of a multi-system in a mart by analyzing users located in the mart.

According to another embodiment of the present invention, there is provided a system for displaying optimized information according to movement of a user moving within a mart.

According to another embodiment of the present invention, a protocol is defined that minimizes the number of administrators in the mart and promptly access information desired by customers in the mart.

The effects of the more specific invention will be described later in detail in the following table.

1 is a diagram illustrating an overall system according to an embodiment of the present invention.
FIG. 2 is a flowchart showing data protocols between respective devices according to an embodiment of the present invention.
3 is a diagram illustrating an example of a data format used by a server for controlling a multi-system according to an embodiment of the present invention.
4 is a diagram showing another example of a data format used by a server for controlling a multi-system according to an embodiment of the present invention.
5 is a view for explaining a first mode in which a multi-system operates according to the number of customers located in a shopping mall.
6 is a diagram for explaining a second mode in which a multi-system operates according to the number of customers located in the mart.
7 is a flowchart illustrating a method of controlling a display device by a server according to an exemplary embodiment of the present invention.
8 is a diagram for explaining data provided by a display device according to a movement path of a specific customer.
FIG. 9 is a database storing purchase pattern-related information per customer according to an embodiment of the present invention.
FIG. 10 is a database storing purchase pattern related information for each group according to an embodiment of the present invention.
11 is a detailed block diagram of the components of a display device according to an embodiment of the present invention.
12 is a diagram illustrating a process of detecting a user located in a shopping mart, according to an embodiment of the present invention.
13 is a view for explaining a process of detecting a user located in a shopping mart, according to another embodiment of the present invention.
14 is a diagram illustrating a method of recognizing a specific customer by a display device according to an embodiment of the present invention.
15A to 15C are views illustrating a process of transmitting and receiving voice information to and from a specific customer according to an exemplary embodiment of the present invention.
16A to 16F are diagrams illustrating a process of changing a graphic according to time according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for ease of description, and the" module "and" part "

Furthermore, the embodiments of the present invention will be described in detail below with reference to the accompanying drawings and the accompanying drawings, but the present invention is not limited to or limited by the embodiments.

As used herein, terms used in the present invention are selected from general terms that are widely used in the present invention while taking into account the functions of the present invention, but these may vary depending on the intention or custom of a person skilled in the art or the emergence of new technologies. In addition, in certain cases, there may be a term arbitrarily selected by the applicant, in which case the meaning thereof will be described in the description of the corresponding invention. Therefore, it is intended that the terminology used herein should be interpreted based on the meaning of the term rather than on the name of the term, and on the entire contents of the specification.

1 is a diagram illustrating an overall system according to an embodiment of the present invention. Hereinafter, an overall system according to an embodiment of the present invention will be described with reference to FIG. On the other hand, the system shown in Fig. 1 is applicable, for example, to a mart that sells various commodities on a display.

1, the mobile device 100, the server 120, the display device 130, the multisystem 140, etc. are connected to each other via the network 110. [ The network 110 corresponds to a wired network or a wireless network, and each of the components 100, 120, 130, and 140 may be connected to one same network or may be connected to another network.

For example, the mobile device 100 may perform data communication with the display device 130 in a Wi-Fi or Bluetooth manner, and the display device 130 may communicate with the server 120 via a wireless Internet or an RF . Further, for example, the server 120 is designed to control the multisystem 140 connected to the PLC.

The mobile device 100 corresponds to, for example, a cart 101 located in a mart or a mobile phone 102 of a user using the cart. When data communication is performed with the cart 101 or the mobile phone 102 and the display device 130, it is possible to grasp the customer information and the like located in the mart. This will be described later in detail with reference to FIG. 12 and FIG.

The server 120 corresponds to, for example, a PC that controls various devices located in the mart. The display device 130 is located, for example, in a certain area in the shopping mall, and is designed to provide advertisement information or guide information for a specific product. The display device 130 may be referred to as a digital signage.

The multi-system 140 corresponds to, for example, an air conditioner, a lighting system, an acoustic system, and the like, which are located in the mart. It is also within the scope of the present invention that the server 120 automatically adjusts the multisystem 140 according to the situation in the shopping mall. This will be described later in detail with reference to FIG. 3 to FIG.

FIG. 2 is a flowchart showing data protocols between respective devices according to an embodiment of the present invention. 2, a flow of data transmitted between the mobile device 200, the server 220, the display device 230, and the multisystem 240 located in the shopping mall will be described below.

The solution to be proposed in the present invention can be roughly classified into three kinds. As a first solution, it is an embodiment that automatically adjusts the multi-system according to the number of customers located in the shopping mall. This will be described later with reference to steps S201 to S204 in FIG.

As a second solution, it is an embodiment of a user interface that promptly and accurately predicts and informs information desired by a customer located in a shopping mall. This will be described later with reference to steps S205 to S207 in FIG.

As a third solution, a group of customers located in a specific region in the Mart is analyzed to provide optimized advertisement information. This will be described later with reference to steps S208 and S209 in FIG.

First, the first solution described above will be described as follows. The mobile device 200 transmits personal information such as an ID to the server 220. Although the process of directly transmitting data to the server 220 is illustrated in FIG. 2, it is also within the scope of the present invention to transmit data via the display device 230.

The server 220 analyzes the total number of customers located in the current shopping mall using the personal information received from the mobile device 200 (S202). Also, the server 220 transmits a command signal according to the total number of customers to the multisystem 240 using a database (DB). The multi-system 240 is designed to control each device based on the command signal received from the server 220 (S204). The above-described steps S201 to S204 will be described in detail with reference to FIGS. 3 to 6. FIG.

Next, the second solution described above will be described as follows. It is assumed that the mobile device 200 and the display device 230 are communicatively connected (S205). The communication connection in step S205 is performed in accordance with, for example, an infrared signal, an RFID signal, Bluetooth or NFC. Also, the mobile device 200 transmits a signal requesting a mode change to the display device 230 (S206). The display device 230 is designed to display the changed mode (S207). Of course, it is also within the scope of the present invention to omit step S206 and design the step S207 to be executed. The above-described steps S205 to S207 will be described in more detail with reference to FIGS. 11 to 16. FIG.

Finally, the third solution described above is as follows. The mobile device 200 transmits personal information such as an ID to the display device 230 (S208). Then, the display device 230 displays an advertisement screen optimized according to personal information (S209). Although only the step S208 is shown in FIG. 2, it is also possible to transmit the personal information to the server 220 via the display device 230 or to design the personal information to be directly received by the server 220 Of the right. The above-described steps S208 and S209 will be described later in detail with reference to FIG. 7 to FIG.

While the above three solutions have been described above, it is also within the scope of the present invention to combine at least two solutions to implement other embodiments.

3 is a diagram illustrating an example of a data format used by a server for controlling a multi-system according to an embodiment of the present invention. Hereinafter, with reference to FIG. 3, an example of a data format used by a server for controlling a multi-system according to an embodiment of the present invention will be described.

First, the server according to an embodiment of the present invention collects the total number of customers located in the mart. In order to collect the total number of persons, for example, a digital card can be attached to a cart. The digital card includes customer ID information. Therefore, the server can estimate the number of distributed digital cards by the number of customers in the mart.

As shown in FIG. 3, the server has information on the mode of the multi-system which varies depending on the total number of persons in the store, as a database. For example, when the total number of people in the mart is calculated as N or more, the air conditioner is set to the first mode, the lighting system is set to the third mode, and the audio system is set to the fifth mode.

On the other hand, when the total number of people in the mart is calculated to be less than N, the air conditioner is set to the second mode, the lighting system to the fourth mode, and the audio system to the sixth mode.

That is, it is a feature of the present invention that the setting state of each device belonging to the multi-system is changed according to the number of customers in the mart estimated by the server. However, a more specific embodiment will be described with reference to Fig.

4 is a diagram showing another example of a data format used by a server for controlling a multi-system according to an embodiment of the present invention. Hereinafter, another example of a data format used by the server for controlling the multi-system according to an embodiment of the present invention will be described with reference to FIG.

If the total number of customers in the store is calculated to be N (for example, 100) or more, the server generates a command signal for setting the condition of the air conditioner to 23 degrees. The server also generates a command signal that changes the color of light emitted by the illumination system to red (RED). Then, the server generates a command signal for setting the music output from the audio system to POP MUSIC. The generated command signals are transmitted to the respective multi-systems. In the case where the number of customers located in the mart is relatively large, it is an embodiment that prompts the customers to move more quickly and purchases more goods.

On the other hand, if the total number of customers in the shopping mart is less than N (for example, 100), the server generates a command signal for setting the air conditioner state to 25 degrees. The server also generates a command signal that changes the color of light emitted by the lighting system to BLUE. Then, the server generates a command signal for setting the music output from the audio system as a classical music (classic). The generated command signals are transmitted to the respective multi-systems. In the case where the number of customers located in the shopping mart is relatively small, it is an embodiment to allow the customers to slowly purchase merchandise while watching the merchandise.

Of course, the numerical values shown in FIG. 4 are one embodiment, and the scope of the present invention should be determined by the claims in principle.

5 is a view for explaining a first mode in which a multi-system operates according to the number of customers located in a shopping mall. Hereinafter, referring to FIG. 5, the first mode in which the multi-system operates according to the number of customers located in the mall will be described.

As shown in FIG. 5 (a), it is assumed that there are customers in the mart 500 having a predetermined number N or more. As described above, the server according to an embodiment of the present invention can estimate the number of customers located in the mart 500 by the number of digital cards distributed to the customer. Also, as shown in FIG. 3 or FIG. 4, the server generates command signals for controlling the respective multisystems and transmits them to the corresponding multisystem.

5B, according to the command signal received from the server, the air conditioner 510, which is an example of the multi-system, enhances the cooling function to lower the temperature. In addition, according to the command signal received from the server, the lighting system 520, which is an example of a multi-system, changes the state so that the color in the mart changes to red. Then, in accordance with the command signal received from the server, the audio system 530, which is an example of a multi-system, changes the state to output a pop song in the mart. There is an advantage that customer circulation can be done more quickly through quick shopping.

Of course, it is also within the scope of the present invention to set different temperatures, different colors, and other music states instead of the setting state shown in FIG. 5 (b).

6 is a diagram for explaining a second mode in which a multi-system operates according to the number of customers located in the mart. Hereinafter, with reference to FIG. 6, a second mode in which the multi-system operates according to the number of customers located in the mall will be described.

As shown in Fig. 6 (a), it is assumed that there are less than a predetermined number N in the mart 600. As described above, the server according to an embodiment of the present invention can estimate the number of customers located in the mart 600 by the number of digital cards distributed to customers. Also, as shown in FIG. 3 or FIG. 4, the server generates command signals for controlling the respective multisystems and transmits them to the corresponding multisystem.

6B, according to the command signal received from the server, the air conditioner 610, which is an example of a multi-system, lowers the cooling function to raise the temperature. In addition, according to the command signal received from the server, the illumination system 620, which is an example of a multi-system, changes the state so that the color in the mart changes to blue. In accordance with the command signal received from the server, the audio system 630, which is an example of a multi-system, changes the state so that the classical music in the mart is output. Therefore, the customers in the mart are psychologically stable and can enjoy shopping more easily. It also maximizes the time that customers in the mart stay and encourages them to sell more products.

Of course, it is also within the scope of the present invention to set different temperatures, different colors, and other music states instead of the setting state shown in FIG. 6 (b).

7 is a flowchart illustrating a method of controlling a display device by a server according to an exemplary embodiment of the present invention. Hereinafter, with reference to FIG. 7, a method of controlling at least one display device located in a shopping mall according to an exemplary embodiment of the present invention will be described.

As shown in FIG. 7, a server according to an embodiment of the present invention receives information about each user using at least one mobile device located in a first area of a shopping mall (S701). Two examples can be considered as embodiments for implementing step S701 described above. As a first embodiment, a digital card containing personal information is mounted on a cart. In addition, an infrared sensor, an RFID sensor, or the like mounted on the cart is designed to communicate with a display device or a server in a shopping mall. This can be more easily understood with reference to FIG. As a second embodiment, it is assumed that the customer's cellular phone using the cart contains personal information. Therefore, it is possible to perform data communication with a cellular phone including the personal information and a display device or server in a shopping mall. This can be more easily understood with reference to FIG.

Further, the server accesses a memory storing purchase pattern information for each user or each group (S702). The memory storing the purchase pattern information will be described later with reference to FIG. 9 or FIG.

Further, the server generates a command signal for guiding the specific article based on the purchase pattern information (S703), and transmits the command signal for guiding the generated specific article to the display device located in the first area (S704). The above-described steps S703 and S704 will be described later with reference to FIG.

According to another embodiment of the present invention, the step S703 may include: extracting a first group by analyzing users located in a first area of the shopping mart, and extracting a specific product corresponding to the extracted first group And generating a guiding command signal. According to another embodiment of the present invention, the step S703 may include the steps of: analyzing users located in the first area of the map to extract a first user having the highest priority; And generating a command signal for guiding the specific commodity corresponding to the commodity.

In addition, in step S704, it is also possible to design both the first graphic data for displaying the specific position information in the mart where the generated specific merchandise is located and the second graphic data for displaying the manual for the specific merchandise, Of the right.

In the case of designing as shown in FIG. 7, there is an advantage that the purchase pattern of the customers in the mart is analyzed and the advertisement of the product preferred by the customer is quickly provided according to the location of the customer. It is also within the scope of the present invention that when there are a plurality of customers, priority is assigned to customers with high purchasing power, or groups of certain customers are displayed to display advertisements for products suitable for the group.

8 is a diagram for explaining data provided by a display device according to a movement path of a specific customer. Hereinafter, with reference to FIG. 8, the user interface displayed by the display device according to the movement path of the specific customer will be described.

As described above, according to the embodiment of the present invention, it is possible to track the location of a customer in a mart using a cart, a cellular phone, or the like. In addition, the tracked customer's location information may be sent directly to the server or may be transmitted to the server via display devices 801, 802, 803, 804, 805. [ It is assumed that the server has a database (DataBase) shown in FIG. 9, for example.

As shown in Fig. 8, it is assumed that the A customer has moved within the shopping mall. In addition, the server according to an embodiment of the present invention has location information about the A customer. Accordingly, the server transmits the advertisement data optimized for the A customer to the display device 801 located in the 6th zone where only the A customer exists. The advertisement data optimized for the customer A may be, for example, an advertisement related to a product that the customer A has most purchased in the past, or an advertisement related to a product in which the customer A has used the most money.

On the other hand, as shown in FIG. 8, it is assumed that the customer C moves within the shopping mart. In addition, the server has location information for the C customer. Accordingly, the server transmits the advertisement data optimized for the C customer to the display device 803 closest to the path where the C customer moves.

On the other hand, the display device 804 located in the second area of the shopping mall and the display device 805 located in the third area are the routes on which both the customer B and the customer C have moved. In addition, the display device 802 located in the fourth area of the shopping mall is a route through which both the customer A and the customer B have moved. When two or more customers stay in an arbitrary area at the same time, the server compares the purchasing power of each customer and gives priority to the customer having the highest purchasing power. Therefore, the advertisement data suitable for the customer with the highest purchasing power is transmitted to the display device of the corresponding area.

According to another embodiment of the present invention, advertisement data that a plurality of customers are all interested in can be displayed on the basis of common information (for example, age, sex, etc.) of customers staying in an area at the same time To the display device.

FIG. 9 is a database storing purchase pattern-related information per customer according to an embodiment of the present invention. Hereinafter, with reference to FIG. 9, a database storing purchase pattern-related information according to an embodiment of the present invention will be described.

To implement FIGS. 7 and 8, the server is designed to be accessible to the database shown in FIG. Of course, it is also within the scope of the present invention that the server includes the DB itself shown in FIG.

As shown in FIG. 9, information on the articles that the respective customers using the mart have purchased in the past is stored in the database. That is, it is also within the scope of the present invention to design the first address of the memory so as to store information on the types and amounts of the products purchased by the respective users (or customers).

For example, customer A has purchased the largest amount of merchandise so far, so it maps to the order of purchasing power. Also, the information on the a-commodities that are purchased the most and the b-commodities that are purchased in the order of the lowest price are mapped and stored together.

On the other hand, since the customer B has purchased the second largest amount of products so far, the purchasing power is mapped to the second order. Also, the information about the most purchased c items and the d items that have been purchased in the lowest order are mapped and stored together.

And, since the customer C has purchased the third largest amount of products to date, the customer C is mapped to the order of purchasing power. Also, the information about the most purchased e-commodities and the commodities that have been purchased in the lowest order are mapped and stored together.

Therefore, when there are a plurality of customers in a certain area as shown in FIG. 8, referring to the database shown in FIG. 9, the advertisement data focused on a specific customer having relatively high purchasing power is outputted through the display device It is possible to do.

FIG. 10 is a database storing purchase pattern related information for each group according to an embodiment of the present invention. Hereinafter, with reference to FIG. 10, a database storing information related to purchase patterns for groups according to an embodiment of the present invention will be described.

To implement FIGS. 7 and 8, the server is designed to be accessible to the database shown in FIG. Of course, it is also within the scope of the present invention that the server includes the DB itself shown in FIG.

As shown in Fig. 10, the information on the articles that the specific group using the mart has purchased in the past is stored in the database. That is, it is also within the scope of the present invention to design the second address of the memory to store information on the type and amount of goods purchased by users belonging to a specific group.

For example, since the X group has purchased the largest amount of merchandise so far, it maps to the order of purchasing power. Also, information about the most purchased m commodities and the n commodities purchased in the order of the lowest price are mapped and stored together.

Meanwhile, since the Y group purchases the second largest amount of goods to date, the purchasing power is mapped to the second group. Also, the information about the most purchased goods and the goods purchased in the order of the lowest price are mapped and stored together.

And, since the third largest amount of commodities are purchased by the Z group to date, the purchasing power is mapped to the third order. Also, the information about the most purchased q items and the r commodities that have been purchased in the first place are mapped and stored together.

11 is a detailed block diagram of the components of a display device according to an embodiment of the present invention. Hereinafter, the components of the display device according to an embodiment of the present invention will be described in detail with reference to FIG. The display device shown in Fig. 11 corresponds to the display device described above in Fig. 1, Fig. 2, and the like. Further, the display device shown in Fig. 11 has an appearance corresponding to the digital signage shown in Figs. 14 to 16, for example.

11, a display device 1100 according to an exemplary embodiment of the present invention includes a sensor 1101, a receiving module 1102, a controller 1103, a display module 1104, a conversion module 1105, A memory 1106, a memory controller 1107, and the like. Of course, the scope of rights of the present invention should, in principle, be determined by the scope of the claims, and it is also possible to delete some of the components shown in FIG. 11 or add some components not shown in FIG. It falls within the scope of the invention.

The display module 1104 is designed to display a first mode. The first mode corresponds to, for example, an arbitrary advertisement screen.

The sensor 1101 senses whether or not any mobile device is located within a predetermined distance from the display device 1100. The mobile device corresponds to a cart or a cellular phone. Of course, it is also within the scope of the present invention to sense the user himself using the mobile device.

The conversion module 1105 is designed to convert the first mode to the second mode when the arbitrary mobile device is located within a predetermined distance from the display device. For example, the second mode includes graphical data indicating that it is ready to answer a query to the customer, as shown in FIG. 16A.

The receiving module 1102 receives a command signal for a specific product. At this time, the command signal is designed in the form of, for example, audio data and voice data.

The memory 1106 stores guide information about at least one product. The memory controller 1107 accesses the memory 1106 to extract guide information corresponding to the specific product. Meanwhile, the guide information may be designed to be received from, for example, a server according to an embodiment of the present invention.

The controller 1103 controls the display module 1104 to display a third mode including graphic data representing the extracted guide information. The third mode includes at least one of graphics data of, for example, Figs. 16B to 16F.

This design minimizes the number of management staff in the store, and allows customers to quickly check information about the products they want. In addition, there is an advantage that more data can be checked in real time.

According to another embodiment of the present invention, the display device 1100 shown in Fig. 11 includes a voice detector for detecting a voice of a user of the mobile device (e.g., a cart) And a voice recognition unit for recognizing the voice. Furthermore, the display device 1100 further includes a voice conversion unit for converting the extracted guide information into audio data, and a voice output unit for outputting the converted audio data.

On the other hand, one embodiment of the present invention may be implemented by using a known speech recognition technique. Acoustic modeling, for example, means defining and learning the basic units of statistical models used in speech recognition. In addition, Key-Word Spotting is a necessary process for voice understanding by extracting words that are key words from a given voice. Other speech recognition techniques may be applied.

The controller 1103 controls the first graphic data to display position information of the specific merchandise in the shopping mall and the second graphic data to display manual information related to the specific merchandise. This can be more easily understood with reference to Fig.

The sensor 1101 corresponds to, for example, an infrared sensor, a radio frequency identification (RFID) sensor, or an NFC (near field communication) sensor. When the sensor 1101 is an infrared sensor, it is also within the scope of the present invention to design infrared communication with a card mounted on the cart.

12 is a diagram illustrating a process of detecting a user located in a shopping mart, according to an embodiment of the present invention. Hereinafter, with reference to FIG. 12, a process of detecting a user located in a shopping mart will be described according to an embodiment of the present invention.

As shown in Fig. 12, at least one shelf 1210 and at least one display device 1220 are located in the first area 1250 in the mart. Unlike the prior art, the shelf 1210 is provided with a detector 1211 capable of sensing an infrared signal. The display device 1220 also includes a detector 1221 capable of sensing an infrared signal.

Therefore, the detectors 1211 and 1221 described above can sense the infrared module 1201 attached to the cart 1200 that can move within the mart. In this case, it is possible to estimate the number of customers located in the first area 1250.

13 is a view for explaining a process of detecting a user located in a shopping mart, according to another embodiment of the present invention. Hereinafter, with reference to FIG. 13, a process of detecting a user located in a shopping mall according to another embodiment of the present invention will be described.

As shown in FIG. 13, at least one shelf 1310 and at least one or more display devices 1320 are located in the first area 1350 in the mart. Also, unlike the prior art, the store 1310 has a network sensor 1311 capable of communicating with a cellular phone. The display device 1320 also includes a network sensor 1321 capable of communicating with a mobile phone. The network sensors described above can be designed using, for example, wifi or a Bluetooth router.

Therefore, the network sensors 1311 and 1321 can perform data communication with the mobile phone 1301 owned by the customer using the cart 1300 movable in the mart. For example, the network sensors 1311 and 1321 collect the personal information stored in the mobile phone 1301 and transmit the personal information to the server.

14 is a diagram illustrating a method of recognizing a specific customer by a display device according to an embodiment of the present invention. Hereinafter, a method of recognizing a specific customer by a display device according to an embodiment of the present invention will be described with reference to FIG.

A sensor capable of recognizing the distance to the user is added to the display device (or digital signage) so that the mode is changed from the first mode to the second mode when the user is adjacent to the display device.

First, as shown in FIG. 14A, a display device 1420 according to an embodiment of the present invention is positioned beside the stand 1410. Of course, the scope of the present invention is not limited to being located beside the shelf 1410.

Also, the display device 1420 has an infrared sensor or the like, so that it can determine whether or not any user is close to a certain distance D or less. Therefore, as shown in FIG. 14 (a), when the in-store customer 1400 is out of the predetermined distance D, a general advertisement screen is displayed.

On the other hand, as shown in FIG. 14 (b), when the customer 1401 in the shop is close to a distance D or less from the display device 1421, the screen is switched to a mode for responding to the customer. A more specific embodiment will be described later with reference to FIG. 15 and FIG.

15A to 15C are views illustrating a process of transmitting and receiving voice information to and from a specific customer according to an exemplary embodiment of the present invention. Hereinafter, a process of transmitting and receiving voice information to and from a specific customer will be described with reference to FIGS. 15A to 15C, according to an embodiment of the present invention.

First, as shown in Fig. 15A, it is assumed that the customer is located in an area where the display device can detect an object or a person. At this time, the display device switches the screen to the customer response mode and automatically outputs the audio data 1510 of "What can I do?".

Further, as shown in FIG. 15B, the customer refers to a keyword 1520 related to a specific product desired by the customer. At this time, the display device is designed to output the recognized keyword to the screen (1530), so that the customer has an advantage that the display device can properly receive the feedback of whether the keyword is intended by the display device.

Finally, as shown in FIG. 15C, the display device displays map information 1550 where a specific item is located, and at the same time, outputs a related explanation as audio data 1540.

Therefore, in the case of designing as shown in FIGS. 15A to 15C, although the store staff does not actually exist, the customer has the effect of feeling as if he / she is in actual conversation with a virtual person.

FIGS. 16A to 16F are views illustrating a process of changing a graphic according to time according to an embodiment of the present invention. Hereinafter, a process of changing a graphic according to time according to an embodiment of the present invention will be described with reference to FIGS. 16A to 16F.

As described above, when an arbitrary customer is sensed by the sensor, the user interfaces shown in Fig. 16 are sequentially displayed. Of course, it is also within the scope of the present invention to appropriately delete and combine the graphic data shown in FIG. 16 to implement other embodiments.

First, when an arbitrary customer is sensed, the display device according to an embodiment of the present invention outputs graphic data welcoming the customer as shown in FIG. 16A. In addition, when the input signal for a specific keyword is received from the customer, as shown in FIG. 16B, graphic data indicating that search is performed with the recognized keyword is output.

Then, as shown in FIG. 16C, graphic data for guiding where the searched product is located in the shopping mall is output. For example, it could be a map user interface.

Further, when there is the input of the user or automatically, as shown in Fig. 16D, graphic data for retrieving a recipe that can be cooked into the corresponding commodity is displayed. Further, as shown in Fig. 16E, graphic data recommending a specific recipe is output.

Then, as shown in FIG. 16F, graphic data recommending a specific product produced by a specific company is output from the products. For example, it is also within the scope of the present invention to automatically design the most popular merchandise currently sold.

Furthermore, although the drawings are shown for convenience of explanation, it is also possible to design a new embodiment to be implemented by merging the embodiments described in each drawing. It is also within the scope of the present invention to design a computer-readable recording medium in which a program for executing the above-described embodiments is recorded according to the needs of those skilled in the art.

The display apparatus and the operation method thereof according to the present invention are not limited to the configuration and method of the embodiments described above but the embodiments can be applied to all or a part of the embodiments so that various modifications can be made. Or may be selectively combined.

Meanwhile, the operation method of the display apparatus of the present invention can be implemented as a code that can be read by a processor in a processor-readable recording medium provided in a display apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention.

In this specification, both the invention and the invention of the method are explained, and the description of the two inventions can be supplementarily applied as necessary.

100: Mobile device
110: Network
120: Server
130: Display device
140: Multi System

Claims (14)

In a display device located within a mart,
A display module for displaying a first mode;
A sensor that senses whether any mobile device is located within a predetermined distance from the display device;
A conversion module for converting the first mode to the second mode when the mobile device is located within a predetermined distance from the display device;
A receiving module for receiving a command signal for a specific product;
A memory for storing guide information on at least one product and purchase pattern information of at least one user;
A memory controller accessing the memory and extracting guide information corresponding to the specific product; And
And a controller for controlling the display module to display a third mode including graphic data representing the extracted guide information,
The controller comprising:
When a digital card including information of a specific user is located within a predetermined distance from the display device,
Collecting information of the specific user from the digital card, accessing the memory, extracting purchase pattern information of the specific user based on the collected information, 1 mode is changed. The method according to claim 1,
A voice detector for detecting a voice of a user of the mobile device; And
A voice recognition unit for analyzing the detected voice,
And a display device. 3. The method of claim 2,
A voice conversion unit for converting the extracted guide information into audio data; And
An audio output unit for outputting the converted audio data,
And a display device. The method according to claim 1,
The controller comprising:
The first graphic data for displaying the position information of the specific merchandise in the mat and the second graphic data for displaying the manual information related to the specific merchandise are displayed. The method according to claim 1,
The sensor includes:
A display device corresponding to any one of an infrared sensor, a radio frequency identification (RFID) sensor, and a near field communication (NFC) sensor. The method according to claim 1,
The sensor includes:
A display device designed for infrared communication with a card mounted on a cart. The method according to claim 1,
Wherein the display device comprises:
And a display device corresponding to the digital signage located in the first area of the mat. delete delete delete delete delete delete delete

Images