KR20180092635A - Method for providing service using location recognization based on visible light and apparatus using the same - Google Patents

Abstract

A method for providing a service using location recognition based on visible light and an apparatus therefor are disclosed. According to an embodiment of the present invention, the method of providing a service includes: a step of allowing a visible light receiver connected to a smart device provided to a customer in a store to receive a visible light signal from a plurality of lights installed in a store; a step of recognizing the location of the customer at predetermined intervals in consideration of at least one of the visible light signal and sensor data collected from a sensor installed in the smart device; and a step of performing a matching service algorithm corresponding to the location of the customer and providing service information generated by the service algorithm to at least one of the customer and a store employee. It is possible to recognize the location information of the customer in the store without installing a separate location information generator.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a service providing method using location information based on visible light,

The present invention relates to a technology for providing services using visible light based position recognition. More particularly, the present invention relates to a technology for providing service information suitable for a customer or a store employee according to a location of a customer by recognizing the location of the customer in the store through visible light wireless communication technology .

Conventional paper menu systems and menu providing methods require separate menus and order forms depending on the language used by visiting visitors, and likewise require the language ability of employees. In addition, when the menu is ordered or called, the staff comes to the customer's place and goes through the menu confirmation process, then goes to the kitchen and delivers the order contents. .

Accordingly, recently, a system for providing electronic menus and order books through a smart device is used to shorten the procedure and the time required for an employee to make an order and a call, thereby improving service quality. Also, there is no restriction according to the language used by the customer as a system having an electronic menu and an order form for each language to be used. However, since there is no way to provide the location of the customer as a kitchen or a counter at the time of order and call due to the absence of staff, the electronic menu system pre-entered with the corresponding table number may be fixed to the table, There is inconvenience such as inputting the corresponding table number or using a separate calling system and apparatus.

In order to solve such inconvenience, an electronic menu system has been developed which provides location information of a guest through RF communication. That is, the system having the electronic menu and the order book including the provision of the user location information shortens the time required for the confirmation and confirmation of the order and the call, thereby improving the service quality to a certain extent. This solves the inconvenience of entering a table number, but incurring installation and maintenance costs of a user location information generator including a separate power supply in the restaurant table. In addition, when the position information is provided using RF communication, the communication range is uncertain, the communication direction is not available, and an area where the position information overlaps may occur, and accurate user position information may not be provided.

Korean Patent Publication No. 10-2014-0042025, April 7, 2014 (name: restaurant service management device)

An object of the present invention is to recognize location information of customers in a store without installing a separate location information generator in the store.

It is also an object of the present invention to provide an electronic menu system capable of saving maintenance costs such as installing additional equipment in a store or a table or periodically replacing a battery.

It is also an object of the present invention to provide accurate location information of a customer based on visible light wireless communication in which directionality is clear and intuitive and the presence or absence of a communication link can be determined.

According to an aspect of the present invention, there is provided a method of providing a service, the method comprising: receiving a visible light signal from a plurality of lights installed in the store; Recognizing the position of the customer at predetermined intervals in consideration of at least one of the visible light signal and sensor data collected from a sensor installed in the smart device; And performing service algorithms matched to the location of the customer and providing service information generated by the service algorithm to at least one of the customer and the store employee.

At this time, the step of providing service information may include determining the position of the customer as one of a table, a counter, and other places, and selecting at least one of a table matching service, a fee for use settlement service, You can do one.

In this case, the step of providing service information may include: recognizing the table number of the customer by performing the table matching service when the location of the customer corresponds to the table; Providing the customer's store usage information to the menu application installed in the smart device and the counter application installed in the counter device by performing the fee adjustment service when the customer's location corresponds to the counter; And performing at least one of the usage fee settlement service, the location change recognition service, and the alarm generation service by determining whether the location of the customer falls within a range of a customer's movement line when the location of the customer corresponds to the other location . ≪ / RTI >

At this time, recognizing the table number may include recognizing the table number based on the valid signal received when the smart device is valid among the plurality of visible light signals received every predetermined period, The controller may determine that the smart device is in a valid state when the acceleration of the smart device is maintained for a preset time while satisfying a predetermined acceleration condition.

The step of recognizing the table number may include measuring a slope of the smart device based on the sensor data when the smart device is in an active state and if the slope is not satisfied with the predetermined slope condition, The effective signal can be corrected and detected by taking into consideration the attitude of the smart device and the visible light illumination map corresponding to the store.

At this time, providing the service information may include: recognizing a change in the location of the customer by performing the location change recognition service when the location of the customer corresponds to the other location but falls within the range of the customer line; And generating an alarm in at least one of the smart device and the counter device by performing the alarm generation service when the position of the customer corresponds to the other location but does not fall within the range of the customer line, And performing the service fee settlement service in consideration of whether or not the table is matched.

At this time, the step of recognizing the customer's position may include determining whether the visible light signal is received or not; If the visible light signal is received, inquiring the illumination ID included in the visible light signal in a visible light illumination map corresponding to the store to recognize the location of the customer; And recognizing the position of the customer by applying the walking information of the customer detected based on the sensor data to the previous position information when the visible light signal is not received.

At this time, the step of recognizing the position of the customer by applying to the previous position may include: determining whether the position change amount measured based on the sensor data is not less than a predetermined threshold value when the walking information is not detected; Recognizing the position of the customer by applying movement information corresponding to the position change amount to the previous position information when the position change amount is greater than or equal to the preset threshold value; And recognizing the position of the customer again after waiting for the predetermined period when the position change amount is less than the predetermined threshold value.

At this time, the step of recognizing the change of the customer's position may include a step of recognizing the positional member of the customer through the counter application installed in the counter device when the visible light signal is not received for a predetermined determination time after performing the positional change recognition service Notification can provide a message.

In this case, the service providing method may further include the step of inputting payment information for the customer and initializing the smart device so that the smart device can be provided to the next customer when the charge for the customer is completed.

According to another aspect of the present invention, there is provided a server comprising: a receiver connected to a visible light receiver and receiving a visible light signal and sensor data for the smart device from a smart device provided to a customer in a store; A processor for recognizing the position of the customer at predetermined intervals in consideration of at least one of the visible light signal and the sensor data; And a controller for performing service algorithms matched to the location of the customer and providing service information generated by the service algorithm to at least one of the customer and the staff of the store.

At this time, the control unit judges the position of the customer as a category of a table, a counter, or another place, and can perform at least one of a table matching service, a fee payment service, and a location change recognition service according to the category have.

At this time, the control unit recognizes the table number of the customer by performing the table matching service when the position of the customer corresponds to the table, and when the position of the customer corresponds to the counter, Provides the customer's store use information to the menu application installed in the smart device and the counter application installed in the counter device, and when the customer's location corresponds to the other location, the customer's location is within the customer's circulation line And can perform at least one of the fee for use settlement service, the location change recognition service, and the alarm generation service.

At this time, the controller recognizes the table number based on the valid signal received when the smart device is valid among the plurality of visible light signals received at the predetermined period, It can be determined that the smart device is in a valid state when the acceleration of the device is maintained for a predetermined time while satisfying the predetermined acceleration condition.

At this time, the control unit recognizes the change of the position of the customer by performing the position change recognition service when the position of the customer corresponds to the other place and falls within the range of the customer's line, And generates an alarm in at least one of the smart device and the counter device by performing the alarm generation service when the user does not fall within the range of the customer line, Settlement service can be performed.

At this time, the processing unit determines whether or not the visible light signal is received, and when the visible light signal is received, the processing unit inquires the illumination ID included in the visible light signal in the visible light illumination map corresponding to the store to recognize the location of the customer And when the visible light signal is not received, the customer's walking information, which is sensed based on the sensor data, is applied to the previous position information to recognize the position of the customer.

At this time, if the visible light signal is not received for a predetermined time after performing the position change recognition service, the control unit may provide a message informing the location of the customer through the counter application installed in the counter device .

According to another aspect of the present invention, there is provided a smart device including: a visible light signal receiver for receiving a visible light signal from a plurality of lights installed in a store based on a visible light receiver; A position recognition unit for recognizing a position of a customer in the store at predetermined intervals in consideration of the visible light signal and sensor data acquired based on at least one sensor; And a service providing unit for performing a service algorithm matched to the location of the customer and providing the service information generated by the service algorithm to at least one of the customer and the staff of the store.

At this time, the service providing unit judges the position of the customer as a category of a table, a counter, and other places, and performs at least one of a table matching service, a fee payment service, and a location change recognition service according to the category .

At this time, the service providing unit recognizes the table number of the customer by performing the table matching service when the position of the customer corresponds to the table, and when the position of the customer corresponds to the counter, And provides the customer's store use information to the menu application installed in the smart device and the counter application installed in the counter device. When the customer's location corresponds to the other location, the customer's location is within the customer's circulation line The location change recognition service, and the alarm generation service based on the determination result.

According to the present invention, the location information of the customers in the store can be recognized without installing the location information generator on each table.

In addition, the present invention can provide an electronic menu system that can save maintenance costs such as installing additional devices in a store or a table or periodically replacing a battery.

In addition, the present invention can provide precise location information of a customer based on visible light wireless communication in which directionality is clear and intuitive and the presence or absence of a communication link can be determined.

FIG. 1 is a diagram illustrating an electronic menu system based on service provision using position information based on visible light according to an exemplary embodiment of the present invention. Referring to FIG.
2 is a flowchart illustrating a method of providing a service using visible light based position recognition according to an exemplary embodiment of the present invention.
3 is a detailed flowchart illustrating a method of providing a service using visible light based position recognition according to an embodiment of the present invention.
FIG. 4 is a flowchart illustrating a location recognition process according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 5 is a flowchart illustrating a table matching process in a service providing method according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 6 is a detailed flowchart illustrating a process of recognizing a location member in a service providing method according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 7 is a diagram illustrating an example of a category for each position according to the present invention.
8 is a block diagram illustrating a server according to an embodiment of the present invention.
9 is a block diagram illustrating a smart device according to an embodiment of the present invention.

The present invention will now be described in detail with reference to the accompanying drawings. Hereinafter, a repeated description, a known function that may obscure the gist of the present invention, and a detailed description of the configuration will be omitted. Embodiments of the present invention are provided to more fully describe the present invention to those skilled in the art. Accordingly, the shapes and sizes of the elements in the drawings and the like can be exaggerated for clarity.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a diagram illustrating an electronic menu system based on service provision using position information based on visible light according to an exemplary embodiment of the present invention. Referring to FIG.

Since the conventional electronic menu system can not obtain the user's location information, the electronic menu board into which the table numbers are inputted is fixed to all the tables. However, this method has a problem that the installation cost of the electronic menu plate is increased, and the user and the employee have to take the inconvenience of inputting the table number directly to the electronic menu board.

In order to solve such a problem, an electronic menu system which receives location information by RF communication has been developed. However, in the process of installing a user location information generator requiring a separate power supply device, problems such as infrastructure installation cost due to additional wiring, Problems and inconveniences caused by fixed wires, and in addition, when the battery is used, maintenance and maintenance are required to periodically change all the batteries, resulting in cost and labor problems. In addition, due to the uncertain communication range and lack of directivity of the RF communication, there is a problem that the location information overlaps and sends erroneous information.

In order to solve the above-mentioned problems, the present invention proposes a service-based electronic menu system using visible light based position recognition. In other words, it is possible to solve the cost problem due to the installation and maintenance of the separate location information generator by adding the visible light communication function to the illumination installed in the ceiling of the store, and the communication direction is clear and intuitive, It is possible to provide accurate position information by using available visible light wireless communication.

Referring to FIG. 1, an electronic menu system based on service provision using visible light based position recognition according to an exemplary embodiment of the present invention includes a server 110, a smart device 120, a visible light receiver 130, a visible light , 142, a kitchen PC 150 and a counter PC 160. [

The server 110 may interact with the smart device 120, the kitchen PC 150, and the counter PC 160 based on a wired or wireless network, the Internet, and store information on stores in a database. For example, customer's order information matched to a table number uniquely assigned to each table, menu information provided at a store, event information, store statistical information such as order details and account settlement can be stored in the database.

The server 110 stores the sender information collected or updated by at least one of the smart device 120, the kitchen PC 150 and the counter PC 160 and transmits the collected information to the smart device 120, the kitchen PC 150, And the counter PC 160 can inquire information stored in the database.

The smart device 120 may correspond to a device provided to a customer visiting the store. The smart device 120 is provided with a menu application that can provide menu information of a store. A visible light receiver 130 is attached to the smart device 120 to receive a visible light signal transmitted from the visible light illuminators 141 and 142 installed in the store can do. For example, the visible light receiver 130 may be connected to the smart device 120 based on micro-USB.

At this time, the visible light illuminators 141 and 142 modulate the VLC ID data into a visible light signal, and transmit the visible light signal to the visible light receiver 130 by demodulating the visible light signal received from the visible light illuminators 141 and 142 into VLC data, (120).

At this time, the visible light illuminations 141 and 142 may correspond to the illumination provided in the store. For example, visible light sources installed directly above a table in a store, and visible light sources installed in a corridor or a passageway may all correspond to visible light.

At this time, since all the visible light illuminations installed in the store transmit the visible light signals including different VLC ID data, the customer having the smart device 120 through the VLC ID of the visible light signal received by the visible light receiver 130 It is possible to judge the location of the data.

At this time, the VLC ID data is inquired from the visible light illumination map for the store based on the menu application installed in the smart device 120, and the table matched with the corresponding illumination can be recognized.

At this time, the visible light illumination map may include a VLC ID, a position, and matched table information for each of a plurality of lights installed in the store.

At this time, the visible light illumination map can be stored in the database of the server 110, and the smart device 120 can inquire the visible light illumination map at the server 110. [

At this time, the visible light wireless communication technology is a communication technology that wirelessly transmits information by using light in a visible light wavelength band (380 nm to 780 nm area) that can be perceived by human eyes. This technology is distinguished from the existing wired optical communication and wireless infrared communication technology that uses the infrared band in terms of utilizing the light of the visible light wavelength band. Unlike RF (Radio Frequency) wireless communication, which is currently widely used, visible light wireless communication technology is excellent in convenience and physical security that can be freely used without being regulated or licensed in terms of frequency use. It has the distinguishing feature that it can be confirmed, and most of all, it is characterized as a fusion technology that performs light source function and communication function at the same time.

Thereafter, the menu application may generate a menu order message or an employee call message by the customer on the basis of the number of the recognized table, and store the menu order message or the staff calling message in the server 110.

For example, when a menu order message is generated, the menu order message may be shared with the kitchen PC 150 and the counter PC 160 based on the server 110 to inform the customer that the menu is ordered. When the reception of the menu ordered by the kitchen application installed in the kitchen PC 150 is confirmed, the menu progress of the smart device 120 can be displayed according to the cooking process in the kitchen.

At this time, the kitchen application installed in the kitchen PC 150 can display the table number, the order time, and the order list based on the menu order message stored in the server 110. Thereafter, when cooking is proceeding in the kitchen, a state button corresponding to the cooking progress state is provided, so that the user can input the menu progress state. Accordingly, the server 110 can update the menu progress status provided through the menu application of the smart device 120 according to the input of the status button corresponding to the cooking progress status, and provide the updated menu progress status to the client.

The counter PC 160 can inquire the menu order message stored in the server 110 through the counter application and display order details, order time and total amount for each table number. For example, a table GUI can be displayed on the screen of the counter PC 160 so that the counter manager can easily check the order, and order details, order time, request message, total order price, and the like can be displayed on each table GUI.

In addition, when the customer has completed the calculation, it can be updated that the calculation of the menu order message of the customer having the smart device 120 is completed through the counter application, and the updated information can be stored in the server 110 .

2 is a flowchart illustrating a method of providing a service using visible light based position recognition according to an exemplary embodiment of the present invention.

Referring to FIG. 2, a method of providing a service using location-aware light based on visible light according to an exemplary embodiment of the present invention includes receiving a visible light signal from a plurality of lights installed in a store, (S210).

At this time, the smart device provided to the customer may be in a state in which the menu application is installed and activated. At this time, the menu selection interface may include menu information registered in the store, an order button for selecting and ordering a menu, and a call button for calling a shop member.

In this case, the plurality of lights installed in the store corresponds to visible light illumination capable of performing visible light communication, and the VLC ID set in each of the plurality of lights can be transmitted to the visible light receiver through visible light transmission illumination.

Accordingly, the visible light receiver detects the VLC ID in the received visible light transmission illumination, and searches for the VLC ID based on the position of the plurality of illuminations and the VLC ID for each of the plurality of lights based on the matched visible light illumination map, It is possible to determine which light source is located in the store.

At this time, the visible light receiver can be connected to or mounted on a smart device based on micro USB.

In addition, the service providing method using the visible light based position recognition according to an embodiment of the present invention recognizes the position of the customer at predetermined intervals in consideration of at least one of the visible light signal and the vertical sensor data from the sensor installed in the smart device (S220).

In this case, a variety of sensors can be installed in the smart device to know the status and location of the smart device. For example, when a customer moves on a walk with a smart device, a walking sensor capable of measuring a walking distance or a walking direction, a GPS sensor capable of detecting the coordinates of the location of the smart device, An acceleration sensor capable of measuring the acceleration and a gyro sensor capable of detecting the position of the smart device through the inclination of the smart device.

In addition, since the position of the customer must be recognized every predetermined period, the visible light signal and the sensor data can be collected at predetermined intervals in the smart device.

Thereafter, an algorithm for recognizing the position of the smart device based on the collected visible light signal and the sensor data, that is, the location of the customer holding the smart device, can be performed as follows.

First, it can be determined whether a visible light signal is received through the visible light receiver of the smart device.

At this time, when the visible light signal is received, the illumination ID included in the visible light signal can be retrieved from the visible light illumination map corresponding to the store to recognize the location of the customer. Thereafter, the client waits for a predetermined period to recognize the location, and then performs an algorithm for recognizing the location of the customer.

At this time, the smart device can inquire the visible light map of the shop from the server and search the visible light illumination map for the received illumination ID of the visible light signal to recognize the customer's location. Alternatively, if the smart device transmits an illumination ID of the received visible light signal to the server, the server may search for the illumination ID in the visible light map of the store to recognize the location of the customer.

At this time, the currently recognized location of the customer can be stored together with the customer information, the smart device information, and the location recognition time.

In addition, when the visible light signal is not received, the position of the customer can be recognized by applying the walking information of the customer detected based on the sensor data to the previous position information.

At this time, the previous position information may correspond to the position of the customer recognized in the previous cycle based on the current time.

For example, if a visible light signal is not received at a time point for recognizing the position of the customer according to a predetermined period, it can be determined whether the current customer is walking by using the walking sensor installed in the smart device. If the customer is moving, the walking direction and the walking distance from the time when the previous position information is recognized through the walking sensor are predicted, and the walking direction and the walking distance are applied from the previous position information, You can calculate where you expect.

At this time, the position calculated by applying the walking information is stored as the location of the customer, and the user waits for the predetermined period again, and then the customer can perform the position recognition algorithm.

At this time, if the walking information is not detected depending on whether or not the walking information is detected, it is possible to determine whether the position variation measured based on the sensor data is equal to or greater than a preset threshold value.

In this case, the position change amount may be a value obtained by changing the position coordinates of the smart device through the same position sensor as the GPS sensor mounted on the smart device. Therefore, by checking the position change amount, it is possible to confirm whether or not the smart device is moving in a situation where no visible light signal is received and walk information is not detected.

At this time, the predetermined threshold value may be set to a level at which it is determined that there is no movement of the smart device. Accordingly, if the position change amount is greater than or equal to a predetermined threshold value, it can be determined that the customer having the smart device is moving.

At this time, when the position change amount is equal to or larger than the predetermined threshold value, the movement information corresponding to the position change amount can be applied to the previous position information to recognize the position of the customer. That is, the position of the customer can be calculated by applying the moving direction and the moving distance according to the position change amount in the place corresponding to the previous position information in a similar manner to the case of applying the walking information.

At this time, the position calculated by applying the movement information is stored as the position of the customer, and the apparatus waits for the predetermined period again, and then the customer can perform the position recognition algorithm.

Also, when the position change amount is less than the preset threshold value, the position of the customer can be recognized again after waiting for a predetermined period. That is, the location change amount is smaller than the predetermined threshold value, and it can be determined that the customer holding the smart device is not moving and can wait for a predetermined period to recognize the location of the customer after the customer moves the location.

According to another aspect of the present invention, there is provided a method of providing a service using a visible light based position recognition, the method comprising: performing a service algorithm matched to a location of a customer; And provides service information (S230).

At this time, it is possible to determine the location of the customer as one of the categories of the table, the counter, and other places, and perform at least one of the table matching service, the fee for use settlement service, and the location change recognition service according to the category.

At this time, other places may correspond to places in the store except tables and counters.

In this case, the visible light signal and the sensor data can be collected at predetermined intervals in order to continuously recognize the customer's position even after each service is performed.

At this time, if the customer's position corresponds to the table, the table matching service can be performed to recognize the table number of the customer. At this time, the table matching service may be the first table matching for the customer, or may be a table matching for moving the customer.

At this time, the table number can be recognized based on the valid signal received when the smart device is valid among the plurality of visible light signals received every predetermined period.

At this time, the validity state may mean a state suitable for recognizing the customer's table. For example, if a customer picks up a table of a customer while holding a smart device and is just passing the table A in the store, the smart device receives a visible light signal from the light installed just above table A, It can be mistaken.

In the case where it is determined that the customer is moving and is not suitable for recognizing the table, even if the visible light signal is received in the smart device, it may not be judged to be an effective signal for recognizing the table. However, it can be used to grasp the customer's travel route through the visible light signal received while moving.

At this time, if the acceleration of the smart device measured based on the sensor data is maintained for a preset time while satisfying the predetermined acceleration condition, it can be determined that the smart device is in the valid state.

For example, an acceleration condition can be set to a level at which it is determined that a customer carrying a smart device is not moving. In addition, a certain time is set for a case where a customer who has a smart device is stopped in the middle of moving in a store or a moving speed is reduced to look for a table to be seated, and then, It can be determined that the device is in the valid state. At this time, the predetermined time can be freely set and changed by the manager of the store according to the characteristics and characteristics of the store.

Accordingly, if the smart device satisfies the predetermined acceleration condition and the mobile device does not move and the predetermined time has elapsed, it is determined that the customer having the smart device is in the valid state in which the smart device is seated and can perform table recognition.

In this case, when the smart device is in the valid state, the slope of the smart device is measured based on the sensor data, and when the slope is not satisfied with the preset slope condition, It is possible to correct and detect the effective signal in consideration of the visible light illumination map.

For example, if a customer has a smart device and is seated at table 1, but the smart device is placed at an angle to the top of table 1, and the visible light signal of visible light installed directly above table 2 next to table 1 . In this case, the electronic menu system may mistake the customer as being seated at table 2.

Therefore, even if the smart device is judged to be in the valid state, it can be determined whether the currently received visible light signal is a valid signal based on the slope of the smart device.

At this time, the table number of the customer can be recognized by using the VLC ID obtained by decoding the valid signal.

At this time, when the customer's position corresponds to the counter, the user can use the menu application installed in the smart device and the counter application installed in the counter device to provide the customer's store use information by performing the fee adjustment service.

For example, in the menu application of the smart device owned by the customer, the screen can be activated so that the menu information and the total amount ordered by the customer are displayed. In the counter application of the counter device viewed by the employee, You can activate the screen so that your order history and total payment amount are displayed. At this time, the store employee can retrieve the smart device from the customer, and compare the activated screen with the activated screen on the smart device and the activated screen, and settle the fee for use.

At this time, if the location of the customer corresponds to another location, it may be determined whether the location of the customer falls within the scope of the customer's circulation, and at least one of the service charge settlement service, the location change recognition service, and the alarm generation service may be performed.

At this time, the range of the customer copper line can be set differently according to the size and the characteristics of the store.

At this time, when the customer's location corresponds to the other location but is within the customer's circulation line, the location change recognition service can be performed to recognize the customer's location change.

That is, it is determined that the customer is moving within the copper line range, and the customer's position change can be recognized until moving to the table or the counter.

At this time, if the visible light signal is not received for a predetermined time after performing the positional change recognition service, the counter application provided in the counter device can provide a message informing the customer about the positional absence.

Alternatively, when the location of the customer corresponds to the other location but does not fall within the range of the customer's line, an alarm is generated to generate an alarm in at least one of the smart device and the counter device, The user can perform the service for settlement of fee for use.

In other words, if the customer moves out of the customer line while holding the smart device, an alarm may be generated to inform the smart device or the counter device of the smart device in order to prevent unauthorized occupation or unauthorized departure of the smart device.

At this time, the alarm may be generated in the smart device and the counter device together or only in the smart device depending on the situation.

For example, if table matching is performed for a customer, and if the customer's position is recognized as outside the range of the customer's circulation while the order details for the matched table are present, So that the employee of the counter can collect the smart device of the customer and settle the fee for use.

In another example, if the customer's location is outside the customer's circulation while the table is not matched to the customer, an alarm may be generated only on the smart device, so that the customer can have a smart device and notify the store have. Therefore, in this case, the employee can only retrieve the smart device.

In addition, although not shown in FIG. 2, a method of providing a service using location-based visible light according to an exemplary embodiment of the present invention includes inputting settlement information for a customer when settlement of usage fee for a customer is completed, It can be initialized to be provided to the next customer.

At this time, the state in which the menu application is activated in the smart device may correspond to the initialized state.

Although not shown in FIG. 2, the method for providing a service using visible light based position recognition according to an exemplary embodiment of the present invention includes receiving visible light signals, sensor data, and information input through a menu application, It can be shared with the kitchen PC of the store and the counter PC of the store by providing it to the server via the network.

In addition, steps S220 and S230 of the service providing method according to the present invention may be performed in at least one of a smart device or a server constituting an electronic menu system based on visible light. At this time, the result of at least one of the smart device or the server may be stored in the server so that other devices can inquire or share it.

In addition, although not shown in FIG. 2, the method of providing a service using the visible light based position recognition according to an embodiment of the present invention may store various information generated in the service providing process described above.

By using such a service providing method, it is possible to provide a location information of a customer based on a light including a visible light wireless communication transmitter that does not require a separate device for providing location information of a customer in a store and simultaneously provides a lighting function and a communication function It is possible to provide a service information system and a method including accurate position information provision using visible light wireless communication capable of accurately providing information and capable of discriminating presence or absence of a communication link intuitively and clearly.

In addition, it is possible to provide an electronic menu system that includes both ordering, calling, interaction and calculation means based on accurate location information of a customer, It is possible to provide a means for automatic ordering, calling, interaction, and calculation using the provided location information without any need to operate the application separately, or to support easy use.

In addition, due to the provision of sufficient interaction means, it is possible to meet the desire of a general user who intends to operate a private space, and to meet the needs of a system provider to prevent unauthorized occupation of components of the system.

3 is a detailed flowchart illustrating a method of providing a service using visible light based position recognition according to an embodiment of the present invention.

Referring to FIG. 3, a method of providing a service using a visible light based position recognition according to an embodiment of the present invention includes receiving a visible light signal through a visible light receiver connected to a smart device, The sensor data may be acquired from at least one sensor installed in the smart device (S304).

Thereafter, the position of the customer holding the smart device can be recognized in consideration of at least one of the visible light signal and the sensor data (S306).

Thereafter, it is checked whether the recognized customer's location is a table (S308), and if it is a table, a table matching service can be performed on the customer (S310).

If it is determined in step S308 that the location of the customer is not a table, it is possible to check whether the recognized location of the customer is a counter (S312).

If the customer's location is a counter as a result of the check in step S312, the user's account information is provided to the smart device and the counter device (S314) (S316).

If it is determined in step S312 that the customer is not in the counter, the customer may determine that the customer is located in another place and may determine whether the customer is located within the customer's circulation line (S318).

As a result of the determination in step S318, if the customer is within the range of the customer's circulation line, the customer's location can be continuously recognized according to the location change recognition service.

If it is determined that the customer is not located within the customer's circulation range, the controller checks whether the table is matched (S320). If the table matching is completed, the alarm generation service is performed (S322) (S314).

At this time, since the table matching is completed, an alarm can be generated in both the smart device and the counter device.

If the table matching is not completed as a result of the determination in step 320, the alarm generating service may be performed to allow the employee to retrieve the smart device from the customer (S324).

At this time, since the table matching is not completed, the alarm can be controlled to occur only in the smart device.

FIG. 4 is a flowchart illustrating a location recognition process according to an exemplary embodiment of the present invention. Referring to FIG.

Referring to FIG. 4, in the service providing method according to an embodiment of the present invention, when a smart device is provided to a customer (S402), the location recognition process first determines whether a visible light signal is received through a visible light receiver connected to the smart device (S404).

If it is determined in step S404 that the visible light signal is received, the illumination ID included in the visible light signal is searched for in the visible light illumination map corresponding to the store in step S406, and the customer's location can be recognized in step S408.

Thereafter, it is determined whether or not it waits for a preset period of time (S410). If the predetermined period has elapsed, a step for recognizing the location of the customer can be performed again.

If it is determined in step S404 that the visible light signal is not received, it is determined whether the walking information of the customer is detected based on the sensor data in step S412.

If it is determined in step S412 that the walking information is detected, the position of the customer is recognized by applying the walking information to the previous position information (S416). After waiting for the predetermined period again, have.

If it is determined that the walking information is not detected in step S412, it may be determined whether the measured positional variation based on the sensor data is equal to or greater than a preset threshold value (S414).

If it is determined in step S414 that the position change amount is greater than or equal to the predetermined threshold value, it is determined that the customer is moving, and the position of the customer is recognized by applying the movement information to the previous position information (S416) And a process for recognizing the location of the customer can be performed.

If it is determined in step S414 that the amount of positional change is less than the predetermined threshold value, it is determined that the customer is not moving. After the customer moves the position, the apparatus waits for a predetermined period The customer's location can be recognized again.

FIG. 5 is a flowchart illustrating a table matching process in a service providing method according to an exemplary embodiment of the present invention. Referring to FIG.

In the process of performing the table matching service according to the embodiment of the present invention, each time a visible light receiver receives a visible light signal from a plurality of lights installed in a store, it transmits visible light data demodulated to the menu application, Such as receiving a visible light signal during a predetermined period of time or receiving a visible light signal by tilting the smart device toward the illumination of another table, may occur.

An algorithm such as that shown in Fig. 5 is needed to distinguish between this ineffective visible light signal and the effective visible light signal of the appropriate situation placed on the table where the smart device is seated by the customer.

Referring to FIG. 5, the stored visible light data variable may be initialized and the timer may be initialized (S502).

Thereafter, upon reception of the visible light signal (S504), the posture (angle or slope) and acceleration of the smart device at this time can be measured (S506).

In this case, the acceleration magnitude? Based on the acceleration magnitude measured through the acceleration sensor installed in the smart device and the gravity acceleration may be compared to determine whether the smart device is moving (S508).

If it is determined in step S508 that the measured acceleration is greater than or equal to the gravitational acceleration, the received visible light data and the timer may be initialized (S502).

If it is determined in step S508 that the measured acceleration is less than the gravitational acceleration and that the smart device is not moving, the orientation measurement using the gyro sensor causes the smart device to detect an appropriate angle range (S510).

If it is determined in step S510 that the inclination angle of the smart device is out of an appropriate angle range, the orientation information is measured through the sensor in the smart device to calculate the orientation of the smart device in which direction it is located (S512) , The calculated attitude value and the received visible light data may be corrected to visible light data of a table where the smart device is actually located through the visible light data map of the in-store illumination and transmitted to the server (S514).

As a result of the determination in step S510, if the tilt angle of the smart device is within an appropriate angle range, the received visible light data can be transmitted to the server without correcting the visible light data.

Thereafter, the server may store the visible light data received from the smart device together with the current time (S516).

After that, it is determined whether or not the state where the smart device has not moved has continued for a predetermined time (S518). If the smart device has not moved for a predetermined time or longer, the most data among the visible light data stored in the server during that time can be selected (S522).

Thereafter, the visible light illumination ID of the store corresponding to the selected visible light data is recognized (S524), and the table number corresponding to the visible light illumination ID recognized by the server is received and recognized as the table number of the customer (S526) .

Thus, by extracting meaningful visible light data by interlocking with the sensor of the smart device, accurate table information of the customer can be provided in the electronic menu system.

FIG. 6 is a detailed flowchart illustrating a process of recognizing a location member in a service providing method according to an exemplary embodiment of the present invention. Referring to FIG.

Referring to FIG. 6, in the service providing method according to an embodiment of the present invention, a location change recognition service is first performed (S610), and a visible light signal is received through a visible light receiver connected to the smart device (S615).

If the visible light signal is received as a result of the determination in step S615, the algorithm for recognizing the position member may be exited.

If the visible light signal is not received as a result of the determination in step S615, whether or not the predetermined determination time has elapsed to determine the positional absence may be confirmed (S625).

For example, when the location change recognition service is executed, the timer can be executed to operate until the visible light signal is received, and it can be checked whether the timer time exceeds the predetermined determination time.

As a result of the determination in step S625, if the predetermined determination time is not exceeded, it is confirmed whether or not the visible light signal is received again.

If it is determined in step S625 that the predetermined determination time has elapsed, the server may store the location absence information (LID reception NOT OK) for the customer. For example, the smart device may transmit a message that the location of the customer can not be known because the illumination ID by the visible light signal is not received by the server, or the server may generate and store the location information by itself.

At this time, the operation state of the visible light receiver connected to the smart device can be tracked through the process of determining the position absence, so that it can be used as a means for managing the visible light communication system.

Thereafter, a warning is issued to the customer through the counter application installed in the counter device according to the absence of the customer, so that the employee can identify the customer or the smart device of the customer.

FIG. 7 is a diagram illustrating an example of a category for each position according to the present invention.

7, the category according to the present invention includes a table and a counter located in the customer's copper line range 710 within the store 700 and a toilet, an entrance, a hall located outside the customer copper line range 710 And other places.

That is, the location of the customer who enters the store 700 and receives the smart device from the employee can be recognized as a table, a counter, or any other place.

For example, it can be assumed that the customer is seated at the table 11 shown in FIG. At this time, the visible light receiver connected to the customer's smart device can receive the visible light signal from the illumination installed on the table 11, and recognize that the customer's position is the 11th table through the illumination ID included in the visible light signal . At this time, it is recognized that the customer is seated on the table, and the menu information corresponding to the store 700 is provided through the menu application installed in the smart device, so that the customer can order the menu.

As another example, if a customer has moved to a counter with a smart device after eating on a table, the visible light receiver of the smart device may receive a visible light signal from the lighting installed above the counter. In this case, it is possible to recognize that the position of the customer is the counter through the illumination ID included in the visible light signal, and to provide a service for the fee calculation.

As another example, when a customer enters the store 700 and receives the smart device, it may forget to return the smart device and may exit through the entrance of the store 700. In this case, the visible light receiver of the smart device may receive the visible light signal from the illumination installed above the doorway and recognize that the customer's location is outside the customer's copper line range 710 as well as at other locations. Accordingly, in such a case, since the table matching is not performed, an alarm is generated through the smart device so that the customer can return the smart device.

7 is an example for convenience of explanation, it is possible to freely set the customer's moving range 710 according to the nature and size of the store or the arrangement of the table or counter in the store have.

8 is a block diagram illustrating a server according to an embodiment of the present invention.

Referring to FIG. 8, a server according to an embodiment of the present invention includes a receiving unit 810, a processing unit 820, a controller 830, and a storage unit 840.

The receiver 810 receives a visible light signal and sensor data for a smart device from a smart device connected to a visible light receiver and provided to a customer in the store.

At this time, the smart device provided to the customer may be in a state in which the menu application is installed and activated. At this time, the menu selection interface may include menu information registered in the store, an order button for selecting and ordering a menu, and a call button for calling a shop member.

In this case, the plurality of lights installed in the store corresponds to visible light illumination capable of performing visible light communication, and the VLC ID set in each of the plurality of lights can be transmitted to the visible light receiver through visible light transmission illumination.

Accordingly, the visible light receiver detects the VLC ID in the received visible light transmission illumination, and searches for the VLC ID based on the position of the plurality of illuminations and the VLC ID for each of the plurality of lights based on the matched visible light illumination map, It is possible to determine which light source is located in the store.

At this time, the visible light receiver can be connected to or mounted on a smart device based on micro USB.

The processor 820 recognizes the position of the customer at predetermined intervals in consideration of at least one of the visible light signal and the sensor data.

In this case, a variety of sensors can be installed in the smart device to know the status and location of the smart device. For example, when a customer moves on a walk with a smart device, a walking sensor capable of measuring a walking distance or a walking direction, a GPS sensor capable of detecting the coordinates of the location of the smart device, An acceleration sensor capable of measuring the acceleration and a gyro sensor capable of detecting the position of the smart device through the inclination of the smart device.

In addition, since the position of the customer must be recognized every predetermined period, the visible light signal and the sensor data can be collected at predetermined intervals in the smart device.

Thereafter, an algorithm for recognizing the position of the smart device based on the collected visible light signal and the sensor data, that is, the location of the customer holding the smart device, can be performed as follows.

First, it can be determined whether a visible light signal is received through the visible light receiver of the smart device.

At this time, when the visible light signal is received, the illumination ID included in the visible light signal can be retrieved from the visible light illumination map corresponding to the store to recognize the location of the customer. Thereafter, the client waits for a predetermined period to recognize the location, and then performs an algorithm for recognizing the location of the customer.

At this time, the smart device can inquire the visible light map of the shop from the server and search the visible light illumination map for the received illumination ID of the visible light signal to recognize the customer's location. Alternatively, if the smart device transmits an illumination ID of the received visible light signal to the server, the server may search for the illumination ID in the visible light map of the store to recognize the location of the customer.

At this time, the currently recognized location of the customer can be stored together with the customer information, the smart device information, and the location recognition time.

In addition, when the visible light signal is not received, the position of the customer can be recognized by applying the walking information of the customer detected based on the sensor data to the previous position information.

At this time, the previous position information may correspond to the position of the customer recognized in the previous cycle based on the current time.

For example, if a visible light signal is not received at a time point for recognizing the position of the customer according to a predetermined period, it can be determined whether the current customer is walking by using the walking sensor installed in the smart device. If the customer is moving, the walking direction and the walking distance from the time when the previous position information is recognized through the walking sensor are predicted, and the walking direction and the walking distance are applied from the previous position information, You can calculate where you expect.

At this time, the position calculated by applying the walking information is stored as the location of the customer, and the user waits for the predetermined period again, and then the customer can perform the position recognition algorithm.

At this time, if the walking information is not detected depending on whether or not the walking information is detected, it is possible to determine whether the position variation measured based on the sensor data is equal to or greater than a preset threshold value.

In this case, the position change amount may be a value obtained by changing the position coordinates of the smart device through the same position sensor as the GPS sensor mounted on the smart device. Therefore, by checking the position change amount, it is possible to confirm whether or not the smart device is moving in a situation where no visible light signal is received and walk information is not detected.

At this time, the predetermined threshold value may be set to a level at which it is determined that there is no movement of the smart device. Accordingly, if the position change amount is greater than or equal to a predetermined threshold value, it can be determined that the customer having the smart device is moving.

At this time, when the position change amount is equal to or larger than the predetermined threshold value, the movement information corresponding to the position change amount can be applied to the previous position information to recognize the position of the customer. That is, the position of the customer can be calculated by applying the moving direction and the moving distance according to the position change amount in the place corresponding to the previous position information in a similar manner to the case of applying the walking information.

At this time, the position calculated by applying the movement information is stored as the position of the customer, and the apparatus waits for the predetermined period again, and then the customer can perform the position recognition algorithm.

Also, when the position change amount is less than the preset threshold value, the position of the customer can be recognized again after waiting for a predetermined period. That is, the location change amount is smaller than the predetermined threshold value, and it can be determined that the customer holding the smart device is not moving and can wait for a predetermined period to recognize the location of the customer after the customer moves the location.

The control unit 830 performs a matching service algorithm corresponding to the location of the customer and provides the service information generated by the service algorithm to at least one of the customer and the staff of the store.

At this time, it is possible to determine the location of the customer as one of the categories of the table, the counter, and other places, and perform at least one of the table matching service, the fee for use settlement service, and the location change recognition service according to the category.

At this time, other places may correspond to places in the store except tables and counters.

In this case, the visible light signal and the sensor data can be collected at predetermined intervals in order to continuously recognize the customer's position even after each service is performed.

At this time, if the customer's position corresponds to the table, the table matching service can be performed to recognize the table number of the customer. At this time, the table matching service may be the first table matching for the customer, or may be a table matching for moving the customer.

At this time, the table number can be recognized based on the valid signal received when the smart device is valid among the plurality of visible light signals received every predetermined period.

At this time, the validity state may mean a state suitable for recognizing the customer's table. For example, if a customer picks up a table of a customer while holding a smart device and is just passing the table A in the store, the smart device receives a visible light signal from the light installed just above table A, It can be mistaken.

In the case where it is determined that the customer is moving and is not suitable for recognizing the table, even if the visible light signal is received in the smart device, it may not be judged to be an effective signal for recognizing the table. However, it can be used to grasp the customer's travel route through the visible light signal received while moving.

At this time, if the acceleration of the smart device measured based on the sensor data is maintained for a preset time while satisfying the predetermined acceleration condition, it can be determined that the smart device is in the valid state.

For example, an acceleration condition can be set to a level at which it is determined that a customer carrying a smart device is not moving. In addition, a certain time is set for a case where a customer who has a smart device is stopped in the middle of moving in a store or a moving speed is reduced to look for a table to be seated, and then, It can be determined that the device is in the valid state. At this time, the predetermined time can be freely set and changed by the manager of the store according to the characteristics and characteristics of the store.

Accordingly, if the smart device satisfies the predetermined acceleration condition and the mobile device does not move and the predetermined time has elapsed, it is determined that the customer having the smart device is in the valid state in which the smart device is seated and can perform table recognition.

In this case, when the smart device is in the valid state, the slope of the smart device is measured based on the sensor data, and when the slope is not satisfied with the preset slope condition, It is possible to correct and detect the effective signal in consideration of the visible light illumination map.

For example, if a customer has a smart device and is seated at table 1, but the smart device is placed at an angle to the top of table 1, and the visible light signal of visible light installed directly above table 2 next to table 1 . In this case, the electronic menu system may mistake the customer as being seated at table 2.

Therefore, even if the smart device is judged to be in the valid state, it can be determined whether the currently received visible light signal is a valid signal based on the slope of the smart device.

At this time, the table number of the customer can be recognized by using the VLC ID obtained by decoding the valid signal.

At this time, when the customer's position corresponds to the counter, the user can use the menu application installed in the smart device and the counter application installed in the counter device to provide the customer's store use information by performing the fee adjustment service.

For example, in the menu application of the smart device owned by the customer, the screen can be activated so that the menu information and the total amount ordered by the customer are displayed. In the counter application of the counter device viewed by the employee, You can activate the screen so that your order history and total payment amount are displayed. At this time, the store employee can retrieve the smart device from the customer, and compare the activated screen with the activated screen on the smart device and the activated screen, and settle the fee for use.

At this time, if the location of the customer corresponds to another location, it may be determined whether the location of the customer falls within the scope of the customer's circulation, and at least one of the service charge settlement service, the location change recognition service, and the alarm generation service may be performed.

At this time, the range of the customer copper line can be set differently according to the size and the characteristics of the store.

At this time, when the customer's location corresponds to the other location but is within the customer's circulation line, the location change recognition service can be performed to recognize the customer's location change.

That is, it is determined that the customer is moving within the copper line range, and the customer's position change can be recognized until moving to the table or the counter.

At this time, if the visible light signal is not received for a predetermined time after performing the positional change recognition service, the counter application provided in the counter device can provide a message informing the customer about the positional absence.

Alternatively, when the location of the customer corresponds to the other location but does not fall within the range of the customer's line, an alarm is generated to generate an alarm in at least one of the smart device and the counter device, The user can perform the service for settlement of fee for use.

In other words, if the customer moves out of the customer line while holding the smart device, an alarm may be generated to inform the smart device or the counter device of the smart device in order to prevent unauthorized occupation or unauthorized departure of the smart device.

At this time, the alarm may be generated in the smart device and the counter device together or only in the smart device depending on the situation.

For example, if table matching is performed for a customer, and if the customer's position is recognized as outside the range of the customer's circulation while the order details for the matched table are present, So that the employee of the counter can collect the smart device of the customer and settle the fee for use.

In another example, if the customer's location is outside the customer's circulation while the table is not matched to the customer, an alarm may be generated only on the smart device, so that the customer can have a smart device and notify the store have. Therefore, in this case, the employee can only retrieve the smart device.

In addition, when the fee for use accounting for the customer is completed, the payment information for the customer can be input and the smart device can be initialized so that it can be provided to the next customer.

At this time, the state in which the menu application is activated in the smart device may correspond to the initialized state.

At this time, the server can share the visible light signal collected on the basis of the smart device, the sensor data, and the information input through the menu application through the network to the kitchen PC of the store and the counter PC of the store.

The storage unit 840 may store various information generated in the server according to an exemplary embodiment of the present invention as described above.

According to an embodiment, the storage unit 840 may be configured independently of the server to support functions for providing services. At this time, the storage unit 840 may operate as a separate mass storage and may include a control function for performing operations.

9 is a block diagram illustrating a smart device according to an embodiment of the present invention.

9, a smart device according to an exemplary embodiment of the present invention includes a visible light signal receiving unit 910, a location recognizing unit 920, a service providing unit 930, and a storage unit 940.

The visible light signal receiving unit 910 receives the visible light signal from the plurality of lights installed in the store based on the visible light receiver.

At this time, the smart device provided to the customer may be in a state in which the menu application is installed and activated. At this time, the menu selection interface may include menu information registered in the store, an order button for selecting and ordering a menu, and a call button for calling a shop member.

In this case, the plurality of lights installed in the store corresponds to visible light illumination capable of performing visible light communication, and the VLC ID set in each of the plurality of lights can be transmitted to the visible light receiver through visible light transmission illumination.

Accordingly, the visible light receiver detects the VLC ID in the received visible light transmission illumination, and searches for the VLC ID based on the position of the plurality of illuminations and the VLC ID for each of the plurality of lights based on the matched visible light illumination map, It is possible to determine which light source is located in the store.

At this time, the visible light receiver can be connected to or mounted on a smart device based on micro USB.

The position recognition unit 920 recognizes the position of the customer in the store at predetermined intervals in consideration of the visible light signal and the sensor data acquired based on the at least one sensor.

In this case, a variety of sensors can be installed in the smart device to know the status and location of the smart device. For example, when a customer moves on a walk with a smart device, a walking sensor capable of measuring a walking distance or a walking direction, a GPS sensor capable of detecting the coordinates of the location of the smart device, An acceleration sensor capable of measuring the acceleration and a gyro sensor capable of detecting the position of the smart device through the inclination of the smart device.

In addition, since the position of the customer must be recognized every predetermined period, the visible light signal and the sensor data can be collected at predetermined intervals in the smart device.

Thereafter, an algorithm for recognizing the position of the smart device based on the collected visible light signal and the sensor data, that is, the location of the customer holding the smart device, can be performed as follows.

First, it can be determined whether a visible light signal is received through the visible light receiver of the smart device.

At this time, when the visible light signal is received, the illumination ID included in the visible light signal can be retrieved from the visible light illumination map corresponding to the store to recognize the location of the customer. Thereafter, the client waits for a predetermined period to recognize the location, and then performs an algorithm for recognizing the location of the customer.

At this time, the smart device can inquire the visible light map of the shop from the server and search the visible light illumination map for the received illumination ID of the visible light signal to recognize the customer's location. Alternatively, if the smart device transmits an illumination ID of the received visible light signal to the server, the server may search for the illumination ID in the visible light map of the store to recognize the location of the customer.

At this time, the currently recognized location of the customer can be stored together with the customer information, the smart device information, and the location recognition time.

In addition, when the visible light signal is not received, the position of the customer can be recognized by applying the walking information of the customer detected based on the sensor data to the previous position information.

At this time, the previous position information may correspond to the position of the customer recognized in the previous cycle based on the current time.

For example, if a visible light signal is not received at a time point for recognizing the position of the customer according to a predetermined period, it can be determined whether the current customer is walking by using the walking sensor installed in the smart device. If the customer is moving, the walking direction and the walking distance from the time when the previous position information is recognized through the walking sensor are predicted, and the walking direction and the walking distance are applied from the previous position information, You can calculate where you expect.

At this time, the position calculated by applying the walking information is stored as the location of the customer, and the user waits for the predetermined period again, and then the customer can perform the position recognition algorithm.

At this time, if the walking information is not detected depending on whether or not the walking information is detected, it is possible to determine whether the position variation measured based on the sensor data is equal to or greater than a preset threshold value.

In this case, the position change amount may be a value obtained by changing the position coordinates of the smart device through the same position sensor as the GPS sensor mounted on the smart device. Therefore, by checking the position change amount, it is possible to confirm whether or not the smart device is moving in a situation where no visible light signal is received and walk information is not detected.

At this time, the predetermined threshold value may be set to a level at which it is determined that there is no movement of the smart device. Accordingly, if the position change amount is greater than or equal to a predetermined threshold value, it can be determined that the customer having the smart device is moving.

At this time, when the position change amount is equal to or larger than the predetermined threshold value, the movement information corresponding to the position change amount can be applied to the previous position information to recognize the position of the customer. That is, the position of the customer can be calculated by applying the moving direction and the moving distance according to the position change amount in the place corresponding to the previous position information in a similar manner to the case of applying the walking information.

At this time, the position calculated by applying the movement information is stored as the position of the customer, and the apparatus waits for the predetermined period again, and then the customer can perform the position recognition algorithm.

Also, when the position change amount is less than the preset threshold value, the position of the customer can be recognized again after waiting for a predetermined period. That is, the location change amount is smaller than the predetermined threshold value, and it can be determined that the customer holding the smart device is not moving and can wait for a predetermined period to recognize the location of the customer after the customer moves the location.

The service provider 930 performs service algorithms matched to the customer's location and provides service information generated by the service algorithm to at least one of the customer and the store's staff.

At this time, it is possible to determine the location of the customer as one of the categories of the table, the counter, and other places, and perform at least one of the table matching service, the fee for use settlement service, and the location change recognition service according to the category.

At this time, other places may correspond to places in the store except tables and counters.

In this case, the visible light signal and the sensor data can be collected at predetermined intervals in order to continuously recognize the customer's position even after each service is performed.

At this time, if the customer's position corresponds to the table, the table matching service can be performed to recognize the table number of the customer. At this time, the table matching service may be the first table matching for the customer, or may be a table matching for moving the customer.

At this time, the table number can be recognized based on the valid signal received when the smart device is valid among the plurality of visible light signals received every predetermined period.

At this time, the validity state may mean a state suitable for recognizing the customer's table. For example, if a customer picks up a table of a customer while holding a smart device and is just passing the table A in the store, the smart device receives a visible light signal from the light installed just above table A, It can be mistaken.

In the case where it is determined that the customer is moving and is not suitable for recognizing the table, even if the visible light signal is received in the smart device, it may not be judged to be an effective signal for recognizing the table. However, it can be used to grasp the customer's travel route through the visible light signal received while moving.

At this time, if the acceleration of the smart device measured based on the sensor data is maintained for a preset time while satisfying the predetermined acceleration condition, it can be determined that the smart device is in the valid state.

For example, an acceleration condition can be set to a level at which it is determined that a customer carrying a smart device is not moving. In addition, a certain time is set for a case where a customer who has a smart device is stopped in the middle of moving in a store or a moving speed is reduced to look for a table to be seated, and then, It can be determined that the device is in the valid state. At this time, the predetermined time can be freely set and changed by the manager of the store according to the characteristics and characteristics of the store.

Accordingly, if the smart device satisfies the predetermined acceleration condition and the mobile device does not move and the predetermined time has elapsed, it is determined that the customer having the smart device is in the valid state in which the smart device is seated and can perform table recognition.

In this case, when the smart device is in the valid state, the slope of the smart device is measured based on the sensor data, and when the slope is not satisfied with the preset slope condition, It is possible to correct and detect the effective signal in consideration of the visible light illumination map.

For example, if a customer has a smart device and is seated at table 1, but the smart device is placed at an angle to the top of table 1, and the visible light signal of visible light installed directly above table 2 next to table 1 . In this case, the electronic menu system may mistake the customer as being seated at table 2.

Therefore, even if the smart device is judged to be in the valid state, it can be determined whether the currently received visible light signal is a valid signal based on the slope of the smart device.

At this time, the table number of the customer can be recognized by using the VLC ID obtained by decoding the valid signal.

At this time, when the customer's position corresponds to the counter, the user can use the menu application installed in the smart device and the counter application installed in the counter device to provide the customer's store use information by performing the fee adjustment service.

For example, in the menu application of the smart device owned by the customer, the screen can be activated so that the menu information and the total amount ordered by the customer are displayed. In the counter application of the counter device viewed by the employee, You can activate the screen so that your order history and total payment amount are displayed. At this time, the store employee can retrieve the smart device from the customer, and compare the activated screen with the activated screen on the smart device and the activated screen, and settle the fee for use.

At this time, if the location of the customer corresponds to another location, it may be determined whether the location of the customer falls within the scope of the customer's circulation, and at least one of the service charge settlement service, the location change recognition service, and the alarm generation service may be performed.

At this time, the range of the customer copper line can be set differently according to the size and the characteristics of the store.

At this time, when the customer's location corresponds to the other location but is within the customer's circulation line, the location change recognition service can be performed to recognize the customer's location change.

That is, it is determined that the customer is moving within the copper line range, and the customer's position change can be recognized until moving to the table or the counter.

At this time, if the visible light signal is not received for a predetermined time after performing the positional change recognition service, the counter application provided in the counter device can provide a message informing the customer about the positional absence.

Alternatively, when the location of the customer corresponds to the other location but does not fall within the range of the customer's line, an alarm is generated to generate an alarm in at least one of the smart device and the counter device, The user can perform the service for settlement of fee for use.

In other words, if the customer moves out of the customer line while holding the smart device, an alarm may be generated to inform the smart device or the counter device of the smart device in order to prevent unauthorized occupation or unauthorized departure of the smart device.

At this time, the alarm may be generated in the smart device and the counter device together or only in the smart device depending on the situation.

For example, if table matching is performed for a customer, and if the customer's position is recognized as outside the range of the customer's circulation while the order details for the matched table are present, So that the employee of the counter can collect the smart device of the customer and settle the fee for use.

In another example, if the customer's location is outside the customer's circulation while the table is not matched to the customer, an alarm may be generated only on the smart device, so that the customer can have a smart device and notify the store have. Therefore, in this case, the employee can only retrieve the smart device.

In addition, when the fee for use accounting for the customer is completed, the payment information for the customer can be input and the smart device can be initialized so that it can be provided to the next customer.

At this time, the state in which the menu application is activated in the smart device may correspond to the initialized state.

At this time, the information input through the menu application and the visible light signal collected on the basis of the smart device can be shared with the kitchen PC of the store and the counter PC of the store by providing the information to the server through the network.

The storage unit 940 may store various information generated in the smart device according to an embodiment of the present invention as described above.

As described above, the method and apparatus for providing a service using visible light based position recognition according to the present invention are not limited to the configuration and method of the embodiments described above, All or some of the embodiments may be selectively combined.

110: server 120: smart device
130: visible light receiver 141, 142: visible light
150: Kitchen PC 160: Counter PC
700: Store 710: Customer Coverage
810: Receiving unit 820:
820: Controls 830 and 940:
910: visible light signal receiving unit 920:
930: Service Offering

Claims (20)

Receiving a visible light signal from a plurality of lights installed in the store, the visible light receiver connected to a smart device provided to a customer in the store;
Recognizing the position of the customer at predetermined intervals in consideration of at least one of the visible light signal and sensor data collected from a sensor installed in the smart device; And
Performing a service algorithm matched to the location of the customer and providing service information generated by the service algorithm to at least one of the customer and the store employee
Wherein the location information includes at least one of location information and location information. The method according to claim 1,
The step of providing the service information
Wherein the location information includes at least one of a table matching service, a usage fee settlement service, and a location change recognition service according to the type of the category, A method for providing a service using position recognition of a service. The method of claim 2,
The step of providing the service information
If the location of the customer corresponds to the table, performing the table matching service to recognize the table number of the customer;
Providing the customer's store usage information to the menu application installed in the smart device and the counter application installed in the counter device by performing the fee adjustment service when the customer's location corresponds to the counter; And
Performing at least one of the fee for use settlement service, the location change recognition service, and the alarm generating service by determining whether the location of the customer falls within a customer's movement range when the location of the customer corresponds to the other location
Wherein the location information includes at least one of location information and location information. The method of claim 3,
The step of recognizing the table number
Wherein the smart device recognizes the table number based on the valid signal received when the smart device is valid among the plurality of visible light signals received every predetermined period, Wherein the determining unit determines that the smart device is in a valid state when the mobile terminal is maintained for a preset time while satisfying the set acceleration condition. The method of claim 4,
The step of recognizing the table number
Wherein the smart device measures the slope of the smart device based on the sensor data when the smart device is in an active state, and when the slope is not satisfied with the preset slope condition, And correcting and detecting the valid signal in consideration of a visible light illumination map corresponding to the store. The method of claim 3,
The step of providing the service information
Recognizing a change in the location of the customer by performing the location change recognition service when the location of the customer corresponds to the other location and falls within the range of the customer line; And
Generating alarms in at least one of the smart device and the counter device by performing the alarm generation service when the location of the customer corresponds to the other location but does not fall within the range of the customer line, And performing the service charge settlement service in consideration of matching or not. The method of claim 2,
The step of recognizing the location of the customer
Determining whether the visible light signal is received;
If the visible light signal is received, inquiring the illumination ID included in the visible light signal in a visible light illumination map corresponding to the store to recognize the location of the customer; And
And recognizing the location of the customer by applying the walk information of the customer detected based on the sensor data to the previous location information when the visible light signal is not received. A method of providing a service. The method of claim 7,
The step of recognizing the position of the customer by applying to the previous position
Determining whether the measured positional variation based on the sensor data is greater than or equal to a predetermined threshold value when the walking information is not sensed;
Recognizing the position of the customer by applying movement information corresponding to the position change amount to the previous position information when the position change amount is greater than or equal to the preset threshold value; And
And recognizing the location of the customer again after waiting for the predetermined period if the position change amount is less than the preset threshold value. The method of claim 6,
The step of recognizing the customer's location change
Wherein when the visible light signal is not received for a predetermined period of time after performing the positional change recognition service, a message informing of the position of the customer is provided through the counter application installed in the counter device A service providing method using location recognition. The method of claim 2,
The service providing method includes:
Further comprising the step of inputting payment information for the customer and initializing the smart device to be provided to a next customer when the fee for use accounting for the customer is completed, Delivery method. A receiver connected to a visible light receiver and receiving a visible light signal and sensor data for the smart device from a smart device provided to a customer in a store;
A processor for recognizing the position of the customer at predetermined intervals in consideration of at least one of the visible light signal and the sensor data; And
Performing a service algorithm matched to the location of the customer and providing service information generated by the service algorithm to at least one of the customer and the store employee,
Lt; / RTI > The method of claim 11,
The control unit
Wherein the server determines at least one of a table, a counter, and other locations based on the location of the customer, and performs at least one of a table matching service, a usage fee settlement service, and a location change recognition service according to the category. The method of claim 12,
The control unit
When the location of the customer corresponds to the table, performs the table matching service to recognize the table number of the customer, and when the position of the customer corresponds to the counter, And provides a counter application installed in the counter device to the customer's store use information. If the customer's location corresponds to the other location, it is determined whether the customer's location is within the customer's circulation line The service change settlement service, the location change recognition service, and the alarm generation service. 14. The method of claim 13,
The control unit
Wherein the smart device recognizes the table number based on the valid signal received when the smart device is valid among the plurality of visible light signals received every predetermined period, Wherein the controller determines that the smart device is in a valid state when it is maintained for a preset time while satisfying the set acceleration condition. 14. The method of claim 13,
The control unit
Recognizing a change in the location of the customer by performing the location change recognition service when the location of the customer corresponds to the other location but falls within the range of the customer's moving line and the location of the customer corresponds to the other location, Generating alarms in at least one of the smart device and the counter device by performing the alarm generation service when the user does not fall within the range of the customer line, and performing the fee adjustment service in consideration of table matching of the customer Lt; / RTI > The method of claim 12,
The processing unit
Wherein the controller determines whether the visible light signal is received and recognizes the position of the customer by inquiring an illumination ID included in the visible light signal in a visible light illumination map corresponding to the store when the visible light signal is received, Wherein the server is configured to recognize the location of the customer by applying the walk information of the customer detected based on the sensor data to the previous location information if not received. 16. The method of claim 15,
The control unit
Wherein when the visible light signal is not received for a predetermined time after performing the positional change recognition service, the server provides a message informing of the location of the customer through the counter application installed in the counter device. A visible light signal receiver for receiving a visible light signal from a plurality of lights installed in a store based on a visible light receiver;
A position recognition unit for recognizing a position of a customer in the store at predetermined intervals in consideration of the visible light signal and sensor data acquired based on at least one sensor; And
Performing service algorithms matched to the location of the customer and providing service information generated by the service algorithm to at least one of the customer and the staff of the store,
And the smart device. 19. The method of claim 18,
The service providing unit
Wherein the at least one of the table matching service, the fee settlement service, and the location change recognition service is performed according to the type of the category, . The method of claim 19,
The service providing unit
When the location of the customer corresponds to the table, performs the table matching service to recognize the table number of the customer, and when the position of the customer corresponds to the counter, And provides a counter application installed in the counter device to the customer's store use information. If the customer's location corresponds to the other location, it is determined whether the customer's location is within the customer's circulation line The location change recognition service, and the alarm generation service.

Images