KR102287150B1 - Method of providing electrical dart service using augmented reality type HMD and Computer program for the same - Google Patents

Abstract

The present invention relates to a method of providing an electronic dart service using an augmented reality HMD and a computer program therefor.
According to one aspect of the present invention, as an electronic dart service providing method executed using an augmented reality HMD (head-mounted display), 1) the augmented reality HMD is augmented reality using optical information of an optical recognition means. synchronizing the spatial coordinates between the space and the real space where the electronic dart is located, wherein the optical recognition means is integrally attached to the augmented reality HMD; and 2) providing, by the augmented reality HMD, a pre-stored virtual object for an electronic dart service based on the synchronized spatial coordinates in augmented reality at a preset position in the front of the electronic dart - the virtual object is a dart throwing posture Disclosed is an electronic dart service providing method using an augmented reality HMD configured to include;

Description

{Method of providing electrical dart service using augmented reality type HMD and Computer program for the same}

The present invention relates to a method for providing an electronic dart service using an augmented reality HMD and a computer program for the same, and more particularly, to an electronic dart and an augmented reality head mounted display for automatically recognizing a part where a dart is hit and calculating a score. It relates to a method of providing an electronic dart service using an augmented reality HMD configured in conjunction and a computer program therefor.

Darts is an indoor sport where you score points according to the parts you hit on a dart board with small arrow-shaped darts.

Dart boards are 1, 18, 4, 13, 6, 10, 15, 2, 17, 3, 19, 7, 16, 8, 11, 14, 9, 12, clockwise from the center to the top 20. The numbers of 5 are arranged, which corresponds to the score obtained when the dart is hit in a relatively wide general area of the numbered part of each dart board. The relatively narrow area formed like a band on the peripheral side of the general area is multiplied by 2, and the area formed narrower like a band at the center side is multiplied by 3 to calculate the score. It is divided into regions and the score is calculated as 50 each, or 50 at the center and 25 at the periphery.

In a game using darts, a person generally throws a dart three times and counts as one score, and depending on the game-specific settings, each person makes approximately 5 to 15 or more attempts to calculate the total score, and a higher score is obtained or Whoever gets the preset score wins.

In the conventional game using darts, the exact location of the part where the dart tip is inserted cannot be determined, so there are many cases in which disputes regarding scores occur between users.

In order to improve this, a number of electronic darts have been developed that electronically and automatically recognize the position where the dart tip is inserted.

Korean Patent Registration No. 10-1598455 registered by the present applicant proposes an electronic dart that uses an LED to display the score of a portion corresponding to the area in which the dart is heated, but to variably display the LED by an electronic control method. did.

However, the conventionally proposed electronic darts have only a basic image providing function such as a score display function using an LED or a guide or advertisement using a display, and thus have a limiting factor in satisfying the needs of various users.

Meanwhile, Korean Patent Registration No. 10-1627261 has proposed an electronic dart providing a dart game lesson mode. In the prior art, a configuration for providing a dart lesson image based on an image photographed using a camera arranged to photograph at least a portion of a dart game player has been proposed.

However, in the case of the prior art, the user is a three-dimensional real thing, whereas the lesson materials are all two-dimensional screen data, so there is a problem that the realism is lowered and the understanding of the actual user is difficult.

In particular, in order to provide a lesson function, the conventionally proposed electronic dart provides a lesson in the form of showing a play image of an expert (model) on a display screen or taking a user's play image and showing it. Since it is a lesson conducted at the level of doing three-dimensional movements, there was a problem that the effect of the lesson was not very high because it was impossible to learn the three-dimensional movements by looking at the two-dimensional information.

In addition, the conventionally proposed electronic dart, for example, transmits and shows the opponent's play image captured by the camera through the display device during an online dart match using a dart server, so that the sense of realism and vitality of playing together is felt. There was a limit to the delivery.

In addition, in the conventional electronic darts, it is difficult to produce various effects corresponding to various game events, and due to the limitations of the flat display and the interface, there is a limitation in that the contents are mainly provided in the traditional method of proceeding the game.

Republic of Korea Patent No. 10-1598455 (registered on February 23, 2016) Republic of Korea Patent No. 10-1627261 (registered on May 30, 2016)

The present invention has been devised in view of the above problems, and an electronic dart using an augmented reality HMD configured by interlocking an augmented reality head mounted display with an electronic dart that automatically recognizes the part where the dart is hit and calculates a score. Its purpose is to provide a service provision method and a computer program for the same.

According to one aspect of the present invention for achieving the above object, as a method for providing an electronic dart service executed using an augmented reality HMD (head-mounted display)-, 1) the augmented reality HMD is an electronic dart and synchronizing the spatial coordinates between the augmented reality space and the real space in which the electronic dart is located by using the optical information of the optical recognition means obtained for the vicinity of the electronic dart - The optical recognition means is integrally attached to the augmented reality HMD and the spatial coordinate synchronization is achieved by recognizing a preset specific point as a reference coordinate point based on the optical information; and 2) providing, by the augmented reality HMD, a pre-stored virtual object for an electronic dart service based on the synchronized spatial coordinates in an augmented reality display at a preset position of the electronic dart front located in the real space - the virtual An object is an object for displaying at least any one of information about a dart throwing posture and information about a dart game progress; a method for providing an electronic dart service using an augmented reality HMD configured including the is disclosed.

Preferably, the 1) step, 11) the augmented reality HMD at a preset position around the electronic dart through the optical recognition means to obtain the electronic dart and optical information around the electronic dart; 12) recognizing a preset specific point as a reference coordinate point based on the obtained optical information; and 13) synchronizing the spatial coordinates of the augmented reality space of the augmented reality HMD with the actual spatial coordinates of the electronic dart based on the reference coordinate point.

Preferably, it is characterized in that the display provides the dart throwing posture of the 3D model as the virtual object.

Preferably, the preset position of the front part of the electronic dart is a throw line displayed at a preset position of the front part of the electronic dart.

Preferably, the 3D model is provided with a plurality of models having different body conditions, and is provided so that a user can select it.

Preferably, the 3D model is provided with a plurality of models having different body conditions, and automatic selection of the 3D model is performed based on the user's body condition data obtained on spatial coordinates through another optical recognition means provided in the electronic dart. characterized by being done.

Preferably, the 3D model is a 3D lesson model that provides lesson information of the dart throwing posture.

Preferably, the posture data for displaying the dart throwing posture of the 3D lesson model is obtained and stored in advance through 3D motion capture of the dart throwing posture of the actual dart thrower, and the head of the 3D lesson model displaying the dart throwing posture , characterized in that it includes information about one or more of the movement position, movement direction, and movement speed of the body, arm, leg and hand.

Preferably, the posture data for displaying the dart throwing posture of the 3D lesson model is obtained and stored in advance through three-dimensional motion capture of the dart throwing posture of the actual dart thrower, and the 3D lesson model is the size of the actual dart thrower. The augmented reality image is displayed, and the augmented reality image is displayed so as to throw the dart from a preset position around the electronic dart toward the target position of the actual electronic dart.

Preferably, the present invention 3) the augmented reality HMD is synchronized with the dart throwing posture of the 3D user model generated based on the user's throwing posture data obtained by another optical recognition means provided in the electronic dart It is configured to further include; providing a display in augmented reality based on spatial coordinates.

Preferably, the augmented reality HMD is characterized in that the dart throwing posture of the 3D user model is displayed in augmented reality based on data received through communication with an electronic dart or a dart server.

Preferably, a plurality of the electronic darts are arranged in different spaces, are network-connected to a dart server, and are configured to interwork with the augmented reality HMD, and the electronic dart service is configured to individually operate the plurality of electronic darts and the augmented reality HMD. It is a fighting game service that is executed by a plurality of users participating in a competition method, and the 3D model is a virtual character of a user of the other side of the competition game.

Preferably, the virtual character, on the display of the augmented reality HMD, is provided in the form of a three-dimensional hologram image of a virtual character selected by the other user who is playing a game in a space different from the user's throw line coordinates to be played. characterized by being

Preferably, when a preset event occurs in connection with the progress of the dart game, a screen of a space direction effect stored in advance in response to the event is displayed and provided as the virtual object.

Preferably, the preset event is the hitting of a dart made by the other user's dart throwing in an online battle game executed by the user and the other user at a remote location, and the space effect screen is displayed by the other user in the user's dart throwing order. It is characterized in that it is a fighting game directing effect screen configured to induce the throwing of darts to the dart target location necessary to obtain a score greater than or equal to the score obtained by the .

Preferably, the spatial direction effect screen is a game direction effect screen configured to induce dart throwing to a dart target position presented by a corresponding event within a preset processing time.

Preferably, it is characterized in that it is configured to give a penalty event to the user when the dart cannot be hit within a preset processing time to the dart target position induced by the game directing effect screen.

Preferably, it is characterized in that the display provides a pre-stored lesson guide display for the throwing posture as the virtual object.

Preferably, the lesson guide display includes the position of the foot in the 3D space based on the user's throw line position coordinates, the height of the arm, and the dart release position to be used as a reference for the movement of the foot or arm when the user throws the dart. It is characterized in that it is a guide display that can be

Preferably, the lesson guide display comprises at least one of a leader line, a direction line, and a figure displayed in a three-dimensional space.

Preferably, the present invention 30) the augmented reality HMD, based on the synchronized spatial coordinates, a lesson guide display generated based on the user's throwing posture data obtained by another optical recognition means provided in the electronic dart to provide a display in augmented reality; is configured to further include.

According to another aspect of the present invention, a computer program stored in a recording medium is disclosed in combination with hardware to execute an electronic dart service providing method using the augmented reality HMD.

According to another aspect of the present invention, there is disclosed a computer-readable recording medium in which a computer program for executing the method for providing an electronic dart service using the augmented reality HMD is recorded on a computer.

The present invention has the advantage of providing an electronic dart service providing method using an augmented reality HMD configured by interlocking an electronic dart that automatically recognizes a part where the dart is hit and calculates a score and an augmented reality head mounted display. there is.

In particular, by displaying the expert's 3D lesson model as a hologram and proceeding with the lesson, the user can follow the motion while comparing the posture right next to him, and the user can perform the throwing motion of himself and the expert model in three-dimensional detail from a third person's point of view. It has the advantage of increasing the effectiveness of the lesson because it is possible to improve posture by comparing and analyzing it.

In addition, by calling the opponent from a remote location to the coordinates of the throw line of the dart machine where the user is located, and showing the play status, it provides the same effect as actually playing a match in the same place.

In addition, a function of displaying a virtual character designated by the opposing player instead of shooting data of the opposing player may be provided in three dimensions.

In addition, according to the present invention, by utilizing the three-dimensional hologram effect to provide the visual effect of the dart game, the external directing of the electronic dart, and the directing effect of the space itself around the electronic dart, it is possible to solve the spatial constraints for various visual expressions. can

In addition, dynamic and fun play is possible by converting and outputting various result values or effects produced in the game in three dimensions, and by improving the scalability of the display, it is possible to overcome the limitations of directing and implementing various types of game contents. there is.

In addition, by using the hologram technology to perform a game presentation method in the dart game device in a method specific to the dart game, it is possible to increase the use efficiency of the device.

In addition, by providing a guide display for the user's play posture through the holographic image, and dart play practice according to the guide display, it is possible to correct the actual posture and improve the ability.

1 is a perspective view of an electronic dart according to an embodiment of the present invention.
2 is a control block diagram of an electronic dart according to an embodiment of the present invention.
3 is a control block diagram of an augmented reality HMD according to an embodiment of the present invention.
4 is a schematic side view for explaining a method for providing an electronic dart service according to an embodiment of the present invention.
5 is another side schematic view for explaining a method of providing an electronic dart service according to an embodiment of the present invention.
6 is another side schematic view for explaining a method of providing an electronic dart service according to an embodiment of the present invention.
7 is a front schematic view for explaining a method of providing an electronic dart service according to another embodiment of the present invention.
8 is a schematic diagram of an effect directing effect by an electronic dart service providing method according to another embodiment of the present invention.
9 is a schematic front view for explaining a method for providing an electronic dart service according to another embodiment of the present invention.
10 is another front schematic view for explaining an electronic dart service providing method according to another embodiment of the present invention.
11 is a schematic front view for explaining a method of providing an electronic dart service according to another embodiment of the present invention.
12 is a perspective view for explaining a method of providing an electronic dart service according to another embodiment of the present invention.
13 and 14 are exemplary screens of an augmented reality image displayed on an augmented reality HMD by an electronic dart service providing method according to another embodiment of the present invention.

The present invention may be embodied in various other forms without departing from its technical spirit or main characteristics. Accordingly, the embodiments of the present invention are merely illustrative in all respects and should not be construed as limiting.

The terms 1st, 2nd, etc. are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but another component may exist in between.

As used herein, the singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as "comprise" or "comprising", "have" and the like are intended to represent the presence of elements or combinations thereof described in the specification, and the possibility that other elements or features may be present or added. It is not precluded.

In the description of the present invention, if it is determined that a detailed description of a related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a perspective view of an electronic dart according to an embodiment of the present invention. 2 is a control block diagram of an electronic dart according to an embodiment of the present invention.

The electronic dart 10 according to an embodiment of the present invention includes a dart target unit 100 , an LED display unit 200 , and a control unit 300 . The control unit 300 controls the LED display unit 200 to display the score for the heating area, and when the dart 110 is hit by the dart target unit 100, the control unit 300 automatically recognizes it and the heating result ( yes, score).

The dart board (not shown) including the dart target unit 100 and the LED display unit 200 may be configured to include, for example, the control unit 300 therein.

The dart target unit 100 may have a board shape in which a plurality of target areas are divided, and for example, may be formed to have a circular front shape.

The plurality of target areas may obtain a specific number of points displayed on the dart board outside the heating area when the dart 110 is heated.

A plurality of tip holes (not shown) through which the dart tip 112 formed at one end of the dart 110 may be inserted may be formed in the target area of the dart target part 100 .

The dart target unit 100 according to an embodiment of the present invention includes a sensor means 140 for detecting the position of the target area in which the dart 110 is heated.

The LED display unit 200 according to an embodiment of the present invention, along the periphery of the dart target unit 100 is made to include an LED module 280 respectively disposed at a position corresponding to each outermost target area. .

The LED display unit 200 may display a reference score of each target area. As another example, the LED module 280 may be set by the controller 300 to display various expressions other than the display of the reference score.

A plurality of LEDs 290 for lighting may be disposed adjacent to the LED module 280 . The lighting LED 290 may be used as a lighting to express various situations such as the start of a game, score acquisition, whether the game wins or loses, and the end of the game.

The control unit 300 according to this embodiment controls the output display of the LED module 280 by a preset control logic, and determines the position of the target area where the dart 110 is hit by the sensor means 140 . Through the recognition, the output display of the LED module 280 and the location of the target area in which the dart 110 is hit are correlated to calculate the dart heating result.

For example, according to the interconnection, the control unit 300 stores the number (or event display) displayed by the output display control of the LED module 280, and the dart ( 110) receives the location information of the hit target area, and gives a score according to the dart hitting result using the received location information of the target area hit by the dart 110 and the stored number (or event display) information and/or whether or not the event has been achieved may be determined in conjunction.

The control unit 300 may be understood as, for example, an embedded computer, a PC, or a microcomputer (Micom Controller) installed inside the electronic dart 10, and may include a communication module (not shown) for network communication. .

The control unit 300 may further include an LED control board (not shown) for controlling the lighting of the LED module 280 .

The electronic dart 10 according to an embodiment of the present invention includes a display means 500 for displaying the dart heating result calculated by the control unit 300 .

The display means 500 may use a variety of known display panels, and the current score, accumulated score, game rule violation or not, event information (eg, event execution notification, event type and Various information such as content description, event success notification) can be displayed.

The electronic dart 10 according to an embodiment of the present invention is configured to further include an input means 400 for inputting a control command. The control command input by the input means 400 may be understood as an example, a game start command, an event request command, etc., and includes a user ID, an access password, etc. by the input means 400 in addition to the control command input of user identification information may be performed.

As the input means 400, various well-known input means 400 such as a keyboard, a mouse, a touch pad, and near field communication (NFC) using a mobile terminal may be used, and a face, an iris and/or a face for user identification It may further include an additional input module such as fingerprint recognition.

The electronic dart 10 may include, for example, a touch screen in which the display means 500 and the input means 400 are combined in a single module form.

The electronic dart 100 according to an embodiment of the present invention further comprises a power supply unit 800 for supplying power to the LED display unit 200 and the control unit 300, and the power supply unit 800 is a control unit Power may be supplied to the LED display unit 200 through 300 . The power supply unit 800 may include a power conversion device such as an SMPS depending on the type of the control unit 300 and whether a DC LED is used or the like.

The electronic dart 10 according to an embodiment of the present invention may include a proximity sensor 148, and the proximity sensor 148 detects a throwing position at which a user throws a dart, or a front portion of the dart. By detecting whether the dart is effectively inserted, it is possible to determine whether the user has effectively hit the dart. For example, as the proximity sensor 148 , a known sensor such as an infrared sensor or an ultrasonic sensor may be used.

The electronic dart 10 according to an embodiment of the present invention may include a camera 145 as an optical recognition means, and the camera 145 takes a posture in which a user throws a dart and shows it to the user or During the online battle through the dart server 20, each user can enjoy the dart game while looking at each other. In addition, the camera 145 may function as an optical recognition means for recognizing the shape, position, and/or motion of the user based on the electronic dart 10 . In this case, the controller 300 analyzes the image captured by the camera 145 by a known image recognition method based on the preset camera coordinate system to recognize the user's shape, position, and/or motion on the spatial coordinate data. .

The electronic dart 10 may be provided with a depth camera (Kinect camera) capable of recognizing the position or spatial coordinates of a subject as an optical recognition means, or may be provided with two or more cameras or depth cameras.

The electronic dart 10 according to an embodiment of the present invention may be connected to the dart server 20 through a communication network, and the dart server 20 includes each user's cumulative score, number of times, win/loss, level and/or manage personal information. The dart server 20 may be configured to enable an online dart game between users in a remote location by interconnecting a plurality of electronic darts 10 .

The user may use the terminal 40 to access the network to the dart server 20 or the electronic dart 10, and to authenticate the user, check his/her score and personal information, check the publicly available information of other users, and the ability between users. Comparison, event result confirmation, event product (eg, mobile coupon) receipt, and the like may be performed. For example, the terminal may be understood as a mobile device such as a smart phone, PDA, tablet, etc. or a PC on which an electronic dart use application is installed. The terminal 40 may be network-linked directly with the electronic dart 10 through a short-range communication network, or may be network-linked with the electronic dart 10 through the dart server 20 based on a communication network such as the Internet. As another example, the terminal 40 may be network-linked with the dart server 20 via the electronic dart 10 .

The electronic dart 10 of this embodiment may be directly communicatively connected to the augmented reality HMD 30 through short-distance communication, or may be communicatively connected via the dart server 20 . A detailed description of the augmented reality HMD 30 will be described later.

As an example, the augmented reality image rendered and displayed in the augmented reality HMD 30 is implemented based on data previously stored in the nonvolatile memory of the augmented reality HMD 30 , or the dart server 20 or the electronic dart 10 ) can be implemented based on data received through real-time communication with

As another example, a part of the augmented reality image data uses data previously stored in the nonvolatile memory of the augmented reality HMD 30 , and the other part of the data uses real-time communication with the dart server 20 or the electronic dart 10 . The augmented reality image may be implemented by using the data received through it.

3 is a control block diagram of an augmented reality HMD according to an embodiment of the present invention.

For example, in the present embodiment, the augmented reality head-mounted display (HMD) 30 interlocking with the electronic dart 10 is a see-through HMD (see-through HMD) that the user wears on the head in a shape similar to glasses. It can be understood as a form of electronic device.

In addition, the augmented reality HMD 30 of the present embodiment is implemented in the form of a mobile device that communicates with the dart server 20 and/or the electronic dart 10 .

The augmented reality HMD 30 of this embodiment includes a communication module 32 performing a communication function with the dart server 20 or the electronic dart 10, a CPU 33 performing control input/output and augmented reality rendering processing, A memory 34 for volatile and/or non-volatile storing data and programs for control input/output and augmented reality rendering, a camera 31 for obtaining a color image and/or a depth image of the user's surrounding environment, an augmented reality HMD ( 30) including a sensor 35 for detecting the moving position and direction, moving speed, etc., a power module 36 for charging and supplying power, and a spectacled display 37 for providing an augmented reality image to the user's field of view can do.

For example, the augmented reality HMD 30 is a commercial product such as Microsoft's HoloLens, Meta's Meta1/Meta2 Glass, Google's Google Glass, or Canon's MD-10, or the same A dedicated HMD device providing similar functions may be used.

The configuration related to head movement tracking of the augmented reality HMD can be understood through a number of known technologies including WO2014209709 (2014.12.31).

The augmented reality HMD 30 of the present embodiment may be a see-through HMD such as Microsoft's HoloLens, but is not necessarily limited to the see-through HMD type.

As another example, it is also possible to use an augmented reality HMD in which an image of the user's surrounding environment captured by a camera attached to the HMD and an augmented reality image are synthesized and rendered and displayed.

For example, the augmented reality HMD 30 of this embodiment may receive and store data for control input/output and augmented reality rendering processing through mutual communication with the dart server 20 and/or the electronic dart 10, and some Data receives real-time input and some data can utilize data stored in memory. In addition, the augmented reality HMD 30 of this embodiment uses the sensing data obtained from the sensor 35 or the image data measured from the camera 31 to move the position and direction of the augmented reality HMD 30, and the moving speed It can be detected and used as basic data for input/output control. For example, the sensor 35 may be a 3-axis acceleration sensor or 3-axis gyro sensor capable of detecting the moving position, direction, and speed of the augmented reality HMD 30 . The augmented reality HMD 30 of the present embodiment may further include a gaze (eye) recognition sensor (not shown) in order to accurately recognize the direction of the wearer's gaze to increase the accuracy of spatial coordinate recognition or augmented reality display.

The augmented reality HMD 30 of this embodiment is a specific point of the electronic dart 10 (eg, bullseye centered on the target board) in order to obtain information about the moving position and direction, moving speed, etc. of the augmented reality HMD 30 ) or a specific point around the electronic dart 10 (eg, a throw line displayed on the floor in advance) may be recognized as a reference coordinate point for setting spatial coordinates.

As an example, the augmented reality HMD 30 of this embodiment is a camera 31 attached to the augmented reality HMD 30 in a state in which the user stands on the throw line 11 displayed at a preset position while wearing it. ) through the method of photographing a specific point of the electronic dart 10, for example, the bull's eye in the center of the target board, and image recognition as a reference point of spatial coordinates, the augmented reality space displayed on the augmented reality HMD 30 It is possible to synchronize the spatial coordinates between the and the real space in which the electronic dart 10 is located. Through this spatial coordinate synchronization, a user wearing the augmented reality HMD 30 can render a 3D holographic image rendered based on the 3D coordinates preset based on the reference point of the spatial coordinates of the augmented reality HMD 30 . It can be viewed using the display 37 . The throw line 11 is irradiated with light at a preset position by installing a line member at a preset position on the bottom of the front part of the electronic dart 10, or by installing a linear illumination or laser irradiation part on the front part of the electronic dart 10 It can be implemented in the form of

As another example, the augmented reality HMD 30 of this embodiment is located in the throw line 11 displayed at a preset position in a state of being worn by the user, and the electronic dart 10 is located around the electronic dart 10 through the camera 31 . By recognizing a specific point, for example, a specific point of the throw line 11 as a reference point of spatial coordinates, it is possible to synchronize the spatial coordinates between the augmented reality HMD 30 and the electronic dart 10. .

The control input/output of the augmented reality HMD 30 of this embodiment is an image captured by a user operating a control input means (not shown) provided in the augmented reality HMD 30 , or by a camera of the augmented reality HMD 30 . This can be done in a way that a preset control input operation (eg, finger movement) is executed using the user's body within the system and image recognition is performed.

4 is a schematic side view for explaining an electronic dart service providing method according to an embodiment of the present invention, FIG. 5 is another side schematic view for explaining an electronic dart service providing method according to an embodiment of the present invention, FIG. 6 is another side schematic diagram for explaining a method of providing an electronic dart service according to an embodiment of the present invention.

When the user designates the dart play progress mode as the 3D hologram mode, the electronic dart service mode is started based on the spatial coordinates in which the augmented reality space of the augmented reality HMD 30 and the real space where the electronic dart 10 is located are synchronized. get ready to do it Designation of the 3D hologram mode may be made based on a user input through the electronic dart 10 or the augmented reality HMD 30 .

To this end, in step S1, the augmented reality HMD 30 synchronizes the spatial coordinates between the augmented reality space and the real space where the electronic dart 10 is located by using the recognition information of the optical recognition means. Preferably, the optical recognition means may be a camera 31 integrally attached to the augmented reality HMD 30 .

The augmented reality HMD 30 obtains HMD movement information of at least one of a moving position, a moving direction, and a moving speed of the augmented reality HMD 30 based on the spatial coordinates synchronized in step S1.

Preferably, the step S1 is configured in detail as follows.

In step S11 , the augmented reality HMD 30 at a preset position around the electronic dart 10 obtains the electronic dart 10 or optical information around the electronic dart 10 through the optical recognition means.

In step S12 , the augmented reality HMD 30 recognizes a preset specific point as a reference coordinate point based on the obtained optical information. For example, the preset specific point may be a specific mark (eg, bull's eye) that is optically distinguished and recognized on the front surface of the electronic dart 10 .

In step S13 , the augmented reality HMD 30 synchronizes the spatial coordinates of the augmented reality display space of the augmented reality HMD 30 with the actual spatial coordinates of the electronic dart 10 based on the reference coordinate point.

As an example, this spatial coordinate synchronization recognizes the bull's eye of the electronic dart 10 as a reference coordinate point through the camera 31 integrally attached to the augmented reality HMD 30, and the augmented reality HMD 30 By recognizing the position and/or direction of the electronic dart 10 located in the real space within the camera coordinate system (xyz coordinate system in FIG. 1) of It may be understood that the display is displayed in synchronization with (or matching) the position and/or direction of the electronic dart 10 .

To this end, the camera 31 attached to the augmented reality HMD 30 uses a depth camera (kinetic camera) capable of recognizing the position and/or direction of the photographed real object, or 2 so as to know the depth difference. The above cameras may be used, or a separate depth recognition sensor (not shown) may be used.

The recognition of the bullseye included in the captured image of the camera 31 of the augmented reality HMD 30 may be performed by an automatic recognition operation by a pre-stored image recognition process or by a user's manipulation.

After step S1, when the user selects the hologram electronic dart service mode, each service (eg, dart lesson, dart battle game, space production effect for dart game progress, dart lesson guide) described later in the hologram electronic dart service mode As each virtual object according to the display) is displayed, the user is provided with a three-dimensional electronic dart service.

To this end, in step S2, the augmented reality HMD 30 displays the virtual object for the electronic dart service stored in advance based on the synchronized spatial coordinates at a preset position in the front of the electronic dart 10 in augmented reality. do.

The virtual object is an object for displaying at least one of information about a dart throwing posture and information about a dart game progress, for example, information about a posture in which a virtual 3D model throws a dart or information about a dart game. It may be understood as information on effects (eg, congratulations, warnings, next order notification, etc.) according to the score obtained by the user by throwing the dart.

As shown in FIGS. 5 and 6 , the electronic dart service providing method according to an embodiment of the present invention provides a display of the dart throwing posture of the 3D model 2, 3, P as the virtual object.

For example, the preset position of the front part of the electronic dart 10 may be understood as a throw line 11 displayed at a preset position of the front part of the electronic dart 10, and the augmented reality HMD 30 is the 3D Models (2, 3, P) provide a display of the throwing posture of the dart at the throw line (11).

For example, the 3D models 2 , 3 , and P may be provided with a plurality of models having different physical conditions according to gender or age, and may be provided to allow user selection. That is, the user may select a model most similar to his or her body condition through the manipulation interface.

As another example, the 3D model (2, 3, P) is provided with a plurality of models with different body conditions, the user's body obtained in spatial coordinates through another optical recognition means provided in the electronic dart (10) It may be configured to automatically select the 3D model (2, 3, P) based on the condition data.

In this case, the body condition data may be generated based on the user's image data input through the camera 145 provided in the electronic dart 10 . For example, the data generation may be performed by analyzing image data captured by the camera 145 provided in the electronic dart 10 to analyze the user's physical condition in software.

As another example, the augmented reality HMD 30 worn by the user among the images captured by the camera 145 of the electronic dart 10 is used as a marker for identifying the height condition of the user, and the height value of the user is used as spatial coordinates. It can also be calculated with the concept of the height value on the top. To this end, a marker for facilitating image recognition may be further attached to the front portion of the augmented reality HMD 30 .

For example, the camera may take a picture from the front direction of the user, and a side picture may be taken by additionally mounting a camera in another direction.

To enable image recognition through the camera 145 provided in the electronic dart 10, the user goes through a process of throwing the actual dart a certain number of times or more, and at this time, the user through the camera 145 provided in the electronic dart 10 to shoot the actual dart throwing process.

Based on the photographed posture data of the user, the 3D model 2, 3, P having the most similar body condition to the user (eg, height, arm length, etc.) is searched, and the 3D model 2 implemented based on the retrieved data , 3, P) may be converted into a 3D hologram on the actual dart throw line and displayed.

Meanwhile, the 3D model according to an embodiment of the present invention may be a 3D lesson model 2 that provides lesson information of a dart throwing posture, as shown in FIG. 5 .

For example, the electronic dart service mode includes a hologram dart lesson tutorial mode.

The hologram lesson tutorial mode displays the dart throwing posture of the 3D model so that the user learns darts, for example, when the user selects the hologram dart lesson tutorial mode as the electronic dart service mode and starts the lesson mode , the hologram of the 3D lesson model 2 generated based on the actual motion of the expert is located in the throw line coordinates to show the posture of throwing the dart, and the user can check and learn it in a 360-degree range.

To this end, in the step S2, the augmented reality HMD 30 sets the dart throwing posture of the 3D lesson model 2 stored in advance based on the synchronized spatial coordinates to a preset position of the front part of the electronic dart 10 ( Yes, the throw line 11) provides a display in augmented reality.

The augmented reality HMD 30 determines the position and direction of the 3D lesson model 2 in step S2 based on the obtained HMD movement information and provides a display.

Preferably, the posture data for displaying the dart throwing posture of the 3D lesson model 2 may be stored by obtaining the dart throwing posture of the actual dart thrower in advance through three-dimensional motion capture.

In addition, the posture data for displaying the dart throwing posture of the 3D lesson model 2 includes movement positions, movement directions, and movement directions of the head, torso, arms, legs and hands of the 3D lesson model 2 for displaying the dart throwing posture. It contains information about one or more of movement speed.

As an example, a 3D lesson model is created through 3D motion capture by modeling a real expert about the basic dart throwing posture and the dart throwing posture related to the throwing motion, the elbow angle, the position of the hand, the dart throwing speed, etc. The 3D lesson model data may present a model most similar to the user's body condition by providing various models through gender classification, height classification, body size classification, and the like.

The three-dimensional motion capture can be produced in a known way, for example, by attaching a sensor or marker to each joint of a skilled person and obtaining three-dimensional coordinate data of an actual throwing motion with a camera.

Preferably, the 3D lesson model 2 displays an augmented reality image in the size of an actual dart thrower, and throws the dart from a preset position around the electronic dart 10 toward the target position of the actual electronic dart 10. An augmented reality image may be displayed.

The 3D lesson model 2 is provided with a plurality of models, so that user selection or automatic selection based on the user's body condition data can be made, and since it can be set in the same/similar form as the above-described 3D model, redundant description is omitted. .

The 3D model data of the skilled person similar to the user may be, for example, body type, height, and gender as basic data.

On the other hand, the electronic dart service providing method according to an embodiment of the present invention, the step S3 of providing a display of the user's throwing posture in augmented reality may be further provided.

In step S3, the augmented reality HMD 30 is a 3D user model generated based on the user's throwing posture data obtained by another optical recognition means (eg, camera 145) provided in the electronic dart 10 (P) provides a display by rendering the dart throwing posture in augmented reality based on the synchronized spatial coordinates.

To this end, image data of the user's throwing posture photographed by the camera 145 provided in the electronic dart 10 (eg, the user's body position data on spatial coordinates) is transmitted to the dart server 20 , and the user designated Alternatively, by selecting a 3D model having a body condition similar to that of the user, the selected 3D model is displayed on the augmented reality HMD 30 based on the image data of the user.

This 3D model can be viewed as a 3D user model (P) by distinguishing it from the 3D lesson model (2).

In order to accurately obtain the three-dimensional posture coordinates of the 3D user model P, two or more cameras installed at different angles may be installed in or around the electronic dart 10, and a known depth for spatial coordinate data measurement A camera (Kinect camera) may be installed.

At this time, the 3D lesson model 2 and the 3D user model P implemented for the lesson may be selectively displayed by input manipulation, and in the form of a 3D hologram on the actual dart throw line as shown in FIG. 5 . They may be displayed at the same time. When the 3D lesson model (2) and the 3D user model (P) are displayed at the same time, the user compares the two 3D holograms in the augmented reality state and his or her 3D user who does not match the lesson posture of the 3D lesson model (2) You can check the operation part of the model (P) and correct the dart throwing posture.

In particular, the user can determine the similarity between his or her throwing motion and the throwing motion of the 3D lesson model for a lesson by comparing the angle of the arm and the position of the hand in the throwing motion, and correct the posture.

For the augmented reality implementation of the above-described 3D user model P, the world based on the camera coordinate system (xyz coordinate system in FIG. 1) of the camera 31 attached to the augmented reality HMD 30 and the electronic dart 10 Synchronization of spatial coordinates of the coordinate system (XYZ coordinate system in FIG. 1) is required.

As an example, such spatial coordinate synchronization may be performed as follows.

The user stands on the throw line 11 of the front part of the electronic dart 10 while wearing the augmented reality HMD 30 and recognizes the bull's eye of the electronic dart 10 as a reference coordinate point through the camera 31 . The augmented reality HMD 30 recognizes the position and/or direction of the electronic dart 10 located in the real space within the camera coordinate system (x-y-z coordinate system of FIG. 1 ) of the augmented reality type HMD 30 .

In addition, the electronic dart 10 determines the position and/or direction of the user or the augmented reality HMD 30 worn by the user within the world coordinate system (XYZ coordinate system of FIG. 1) based on the electronic dart 10. Recognize.

Thereafter, information about the position and/or direction of the electronic dart 10 within the camera coordinate system (xyz coordinate system of FIG. 1) of the augmented reality HMD 30 and the world coordinate system based on the electronic dart 10 ( In the XYZ coordinate system of FIG. 1 ), spatial coordinate synchronization may be performed by mutually synchronizing information about the location and/or direction of the user or the augmented reality HMD 30 worn by the user.

To this end, as the camera 145 attached to the electronic dart 10, a depth camera (kinetic camera) capable of recognizing the position and/or direction of the photographed real object is used, or two or more cameras to know the depth difference. can be used.

Meanwhile, as described above, the augmented reality HMD 30 may display the augmented reality based on data received through communication with the electronic dart 10 .

In particular, the augmented reality HMD 30 may display the dart throwing posture of the 3D user model P in augmented reality based on data received through communication with the electronic dart 10 .

In this case, the augmented reality HMD 30 may receive data transmission based on the electronic dart 10 and the short-range communication network, store it in the memory 34 as volatile and/or non-volatile, and render the augmented reality screen.

As another example, the augmented reality HMD 30 may display the augmented reality based on data received through communication with the dart server 20 .

In particular, the augmented reality HMD 30 may display the dart throwing posture of the 3D user model P in augmented reality based on data received through communication with the dart server 20 .

In this case, the augmented reality HMD 30 may receive data transmission based on a communication network such as the dart server 20 and the Internet, store it in the memory 34 as volatile and/or non-volatile, and render the augmented reality screen. there is.

As another example, data for providing rendering of the augmented reality screen may be non-volatile and stored in advance in the memory 34 of the augmented reality HMD 30 without real-time interworking with the electronic dart 10 or the dart server 20 . .

On the other hand, the electronic dart service according to another embodiment of the present invention provides a fighting game service in which a plurality of users individually using the plurality of electronic darts 10 and the augmented reality HMD 30 participate in a competition method. can provide

To this end, a plurality of the electronic darts 10 are arranged in different spaces, are network-connected to the dart server 20 , and are configured to work individually with the augmented reality HMD 30 .

The electronic dart service providing method according to the present embodiment, as shown in FIG. 6 , provides a display of the dart throwing posture of the 3D model 3 as the virtual object, and as an example, the 3D model 3 is charged It may be a virtual character of a game opponent user.

For example, the electronic dart service mode includes a hologram battle game mode.

The hologram battle game mode is to display the dart throwing posture of the 3D model 3 , which is a virtual character of the other user in another space, as augmented reality, so that a three-dimensional dart battle game is performed between remote users.

For example, when the user selects the hologram battle game mode in the electronic dart service mode and starts the game, the 3D model 3 which is the virtual character of the other user generated based on the actual dart throwing motion at the throw line coordinates The hologram is positioned to show the posture of throwing the dart, and the user can obtain the effect of playing a fighting game with the other user located in the same space while checking it in a 360-degree range.

To this end, the augmented reality HMD 30 synchronizes the spatial coordinates between the augmented reality space and the real space where the electronic dart 10 is located by using the optical information of the optical recognition means (step S101), and the synchronized Based on the spatial coordinates, the dart throwing posture of the virtual character 3 of the user of the opponent of the fighting game stored in advance is displayed in augmented reality at a preset position (eg, throw line 11) in the front part of the electronic dart 10 ( step S102).

The step S101 may be understood to be similar to the step S1, and a detailed description of the synchronization of spatial coordinates will be omitted.

Preferably, the virtual character 3 is a three-dimensional hologram of the virtual character 3 selected by the other user who is playing the game in a space different from the user's throw line coordinates on the display of the augmented reality HMD 30 . It is output as a video and provided in the form of play.

The virtual character 3 is provided in plurality so that selection of the other user or automatic selection based on the physical condition data of the other user can be made, and since it can be set in the same/similar form as the above-described 3D model, a redundant description will be omitted. .

As an example, in the battle game service according to the present embodiment, each user who wants to play a dart game using a plurality of electronic darts 10 located in a remote place wears the augmented reality HMD 30 and darts. When selecting an online dart battle game through interworking with the server 20, a hologram battle game mode is selected. As another example, each user may first select a hologram match-up game mode and then select an online dart match-up game.

For example, in the hologram battle game mode, before the user starts the game, coordinate information on the position of the dart throw line 11 is generated and transmitted to the dart server 20 and stored.

Next, each user located at a remote location selects his/her virtual character 3 in the battle game start setting. At this time, the information of the virtual character 3 set and stored in the member information on the dart server 20 of each user may be automatically designated, and this may be changed when starting the fighting game.

During the battle game using the electronic dart 10, when the opponent user's play order is in progress using another electronic dart at a remote location, the electronic dart located by the user on the display of the augmented reality HMD 30 ( 10) A virtual character (3) determined by the other user at a remote location on the coordinates of the throw line (11) on the front part is output as a three-dimensional hologram image to show how to play.

For example, the virtual character of the other user may be implemented such that the virtual character operates in a preset general throwing motion.

For example, the preset general throwing operation may be an operation in which an average dart thrower having an average body type (eg, average height, average weight, etc.) generally throws a dart. The electronic dart 10 or the dart server 20 may be configured to store in advance the motion of the average dart thrower generally throwing the dart, and each virtual character operates in the same form according to the pre-stored motion.

For example, the virtual character of the other user may be set to have a unique preset throwing motion that is distinguished from other characters for each character, and in this case, each virtual character operates according to a unique preset throwing motion to be different from other characters. It can be implemented to operate differently from the character.

As another example, as for the virtual character 3 of the other user, the camera 145 provided in the electronic dart 10 used by the other user recognizes the motion of the other user in 3D coordinates, and based on the recognized 3D motion data Thus, the virtual character 3 of the other user may be implemented to operate.

To this end, image data (eg, body position data of the other user on spatial coordinates) of the motion (eg, throwing posture) of the other user captured by the camera 145 provided in the electronic dart 10 of the other user is transferred to the dart server. is sent to (20).

Next, the 3D model 3 , which is a virtual character selected by the other user, is displayed on the augmented reality HMD 30 based on the image data of the other user.

In order to accurately obtain the three-dimensional posture coordinates of the other user, which is the basis of the operation of the 3D model 3, two or more cameras installed at different angles may be installed in or around the electronic dart 10 of the other user. , a known depth camera (Kinect camera) may be installed for spatial coordinate data measurement.

On the other hand, in a state in which a hologram battle game with the other user in a remote location is made, various reactions of the virtual character 3 of the other user according to the progress of the game may be further expressed.

As an example, the reaction that the other user can see according to the high and low of the score obtained by the user or the opponent user is displayed and provided in the form of a reaction of the virtual character 3 of the other user, and the reaction is, for example, the user It can be implemented with various motions or poses of the virtual character 3 according to the hit score situation of .

To this end, after step S102, the reaction of the virtual character 3 of the other user according to the progress of the game is displayed in augmented reality at a preset position (eg, around the throw line 11) in the front part of the electronic dart 10 may be provided (step S103).

For example, when the user hits a high-scoring target compared to the other user in the user's play order during the game, the virtual character of the other user moves his arm at the surrounding position created based on the throw line (11) coordinates. Reactions such as pinching or bowing can be expressed in augmented reality.

At this time, each virtual character 3 may be configured to provide a unique pose, motion, and response according to the result value, thereby providing fun in the selection of the virtual character 3 and adding a new virtual character It can stimulate the desire to buy.

The original poses and motions for each virtual character 3 may be set in advance so that the preset motions for each character are modified to fit a specific situation, and the motion data may be pre-stored in the electronic dart 10 and/or the dart server 20 . can be

7 is a front schematic diagram for explaining a method of providing an electronic dart service according to another embodiment of the present invention, FIG. 8 is a schematic diagram of an effect directing effect by an electronic dart service providing method according to another embodiment of the present invention 13 and 14 are exemplary screens of an augmented reality image displayed on an augmented reality HMD by an electronic dart service providing method according to another embodiment of the present invention.

In the electronic dart service providing method according to another embodiment of the present invention, when a preset event occurs in connection with the progress of a dart game, a pre-stored space production effect screen in response to the event is displayed as the virtual object.

For example, the dart game may be an online competition game executed with a remote user, and may be a competition game executed with a virtual opponent (eg, a computer) or a game played solely by the user.

For example, the preset event may be any one of a user's play start, a user's play order arrival (refer to FIG. 14 ), a play order change, a play end, and a score obtained according to dart hitting. The event related to the acquired score is, for example, the acquisition of a preset score (eg, 50 points), the recapture of the first place in the fighting game according to the acquisition of a specific score, the score according to throwing a dart at a specific location or mis-throwing a dart It can be understood as non-acquisition, etc. For example, when the event is the acquisition (eg, high ton) of a specific score range in the user's play order, as shown in FIG. 13 , a pre-stored spatial direction effect screen may be displayed when the event occurs. .

For example, the electronic dart service mode includes a hologram space rendering effect screen mode.

The holographic space directing effect screen mode provides various directing effect screens around the electronic dart 10 so that the user can more concentrate on the dart game.

For example, as shown in FIG. 14 , a game booth for playing a dart game may be displayed in augmented reality when the user starts playing as the space direction effect.

The game booth includes the exterior and/or surrounding interior of the electronic dart, and may be pre-stored in various forms and selected according to a user's preference.

For example, after the user selects the hologram battle game mode in the electronic dart service mode, the game starts, and as the space direction effect, as shown in FIG. 8, various A directing effect may be displayed around the electronic dart 10 .

For example, the space directing effect screen may be a fighting game directing effect screen configured to induce the throwing of darts to a dart target location necessary to obtain a score equal to or greater than the score obtained by the other user in the user's dart throwing order.

For example, as the spatial directing effect, when the other user throws a dart and hits a specific score, as shown in FIG. 7 , the same score (eg, 9 points) as that of the other user in the user dart throwing order is obtained. The dart hitting positions (eg, 3 triples, 9 in/out singles) necessary to acquire may be displayed in augmented reality on the electronic dart 10 . In addition, all dart hitting positions necessary to obtain a score (eg, 10 or more) higher than the score (eg, 9) obtained by the other user may be displayed on the electronic dart 10 in augmented reality. As another example, in the case of a game in which a specific target score must be accurately hit according to a game rule, the dart hitting position required to accurately obtain the target score in the current state may be displayed in augmented reality on the electronic dart 10 .

To this end, the augmented reality HMD 30 synchronizes the spatial coordinates between the augmented reality space and the real space where the electronic dart 10 is located by using the optical information of the optical recognition means (step S201), and the synchronized When a pre-stored event occurs based on spatial coordinates, a pre-stored spatial effect screen corresponding to the event is displayed at a preset location (eg, between the throw line 11 and the electronic dart 10) in the front of the electronic dart 10 ) to provide a display in augmented reality (step S202).

Step S201 may be understood to be similar to step S1, and a detailed description of the synchronization of spatial coordinates will be omitted.

For example, the preset position of the front part of the electronic dart 10 may be between the throw line 11 displayed at the preset position of the front part of the electronic dart 10 and the front part of the electronic dart 10 .

For example, when a dart game is started, progress information and a manipulation interface of the dart game are provided to a specific position based on the throw line 11 displayed at a preset position in the front part of the electronic dart 10 .

At this time, in the augmented reality HMD 30, the dart play space according to the space direction data specified by the user or the dart server 20 is implemented through a hologram, and each progress such as the user's play start, play order change, play end, etc. Various three-dimensional space rendering effects (E) using holograms are provided on the set three-dimensional space coordinates according to stages or points obtained.

The spatial direction effect (E) can provide a responsive directing effect that responds by determining when the dart hits the target, and can also provide a directing effect in a form that responds to the game's background music or sound effect. .

This directing effect may be implemented within a range of 360 degrees up, down, left and right with the throw line 11 as a reference coordinate.

Meanwhile, the space direction effect screen may be a game direction effect screen configured to induce throwing of darts to a dart target position presented by a corresponding event within a preset processing time.

9 is a schematic front view for explaining a method for providing an electronic dart service according to another embodiment of the present invention, and FIG. 10 is another front view for explaining a method for providing an electronic dart service according to another embodiment of the present invention. It is a schematic diagram

As an example, when the user wears the augmented reality HMD 30 and selects the hologram battle game mode as the electronic dart service mode and then starts the game, Attack directing proceeds, and the user throws darts to neutralize or solve the attack.

In this case, the attack direction of the opponent virtual characters or the opponent virtual character may be configured to be displayed and provided when a preset event (eg, scoring more than a preset score, throwing to a specific target) occurs.

As the game progresses, for example, an attack direction of the opponent (enemy) virtual character or the opponent (enemy) virtual character recognizes the specified throw line 11 position coordinate as the maximum approach position, so that the user can In the process of playing the game, it is possible to maintain maximum tension and to be immersed in the game.

For example, it is possible to produce a method in which a virtual character protrudes from the screen and gathers while gradually advancing to the throw line where the user is located.

As another example, it is possible to produce a grenade or an attack weapon thrown by the opponent (enemy) virtual character flying toward the throw line 11 where the user is located and exploding.

In addition, the attack direction of the opponent (enemy) virtual character or the opponent (enemy) virtual character may be displayed as augmented reality in various forms.

On the other hand, if the dart is not hit within a preset processing time to the dart target position induced by the game directing effect screen, a penalty event is given to the user.

The penalty event may be understood as that the user takes damage (eg, a decrease in the energy level given to the user in augmented reality), a score is reduced, a penalty point is given, the game ends, etc., to the user Various types of adverse penalties are possible.

For example, in the space effect screen attacked by the virtual character of the other user, if the appropriate score required to defend the attack is not met within the appropriate time, a penalty is given in which the score the player (user) has scored so far is reduced can be

For example, in the case of FIG. 9 , the time bomb B installed by the other user at a point in the target plate (target area) of the electronic dart 10 is visually displayed, and the time bomb location is set as a dart within a certain time. If it does not match, as shown in FIG. 10 , an effect BE of exploding a time bomb can be produced.

Meanwhile, in the electronic dart service providing method, a pre-stored lesson guide display for a dart throwing posture may be displayed and provided as the virtual object.

11 is a schematic front view for explaining a method for providing an electronic dart service according to another embodiment of the present invention, and FIG. 12 is a perspective view for explaining a method for providing an electronic dart service according to another embodiment of the present invention.

For example, the electronic dart service mode includes a hologram dart lesson guide display mode.

The hologram dart lesson guide display mode is to display a guide display for throwing a dart at a location desired by the user, so that the user can practice a dart throwing operation suitable for him/her.

For example, the preset position of the front part of the electronic dart 10 is around the throw line 11 displayed at the preset position of the front part of the electronic dart 10 and the front part of the throw line 11 and the electronic dart 10 . can be between

For example, if the user selects the hologram dart lesson guide display mode as the electronic dart service mode and then starts practicing, the guide display generated based on the user's actual motion in three-dimensional coordinates on the throw line 11 is displayed. The hologram is positioned to show the position of the dart-throwing arm, and the user can check and practice it in a 360-degree range.

To this end, the augmented reality HMD 30 synchronizes the spatial coordinates between the augmented reality space and the real space where the electronic dart 10 is located by using the optical information of the optical recognition means (step S301), and the synchronized Based on the spatial coordinates, the pre-stored lesson guide display for the dart throwing posture is provided as augmented reality display at a preset position (eg, around the throw line 11) in the front part of the electronic dart 10 (step S302).

In the holographic dart lesson guide display mode, the electronic dart 10 captures and analyzes the user's actual throwing motion through the camera 145 and provides a guide display through the augmented reality HMD 30 to correct the user's posture It provides the ability to

For example, the lesson guide display is displayed based on the lesson guide data set and stored in advance through the result of the user throwing the dart several times at the request of the electronic dart 10, and the lesson guide data is displayed using the camera 145. It is data for posture correction obtained by analyzing the user's dart throwing posture obtained through the user based on the score recorded by the user.

For example, when the user selects the lesson guide display mode, the electronic dart 10 requests the user to throw the dart.

In this case, the electronic dart 10 may request to throw the dart by designating a specific location (eg, Bull, 20 out single, etc.) of the target.

The user throws the dart a predetermined number of times or more according to the request of the electronic dart 10, and the electronic dart 10 uses the camera 145 to photograph the user's play posture for each dart throw, and transmits the image to the dart server ( 20) is sent.

The dart server 20 generates lesson guide data by reflecting the vertical deviation of the dart hit position based on the transmitted play image and the recorded score.

The lesson guide data is, for example, using the display function of the electronic dart 10 to induce the user to throw the dart toward a specific target (eg, Bull), and then the hit position hit by the electronic dart 10 Analyze (eg, single with 17 players) to calculate vertical and horizontal deviations (eg, vertical and horizontal distances between the induced position and the hit position).

That is, the elbow position information and the hit position information of the target when the first dart is thrown toward a specific target are stored, and the elbow position information and the hit position information of the target when the next dart is thrown toward the same target are stored. Comparison (analysis) calculates the vertical deviation of the position information hit according to the elbow position.

Next, the lesson guide data can be obtained in such a way that the guide data is generated so as to move the elbow to some extent or to the left or right in the user's posture in order to accurately hit a specific target.

The lesson guide data created in this way is transmitted to the augmented reality HMD 30 , and a lesson guide display based on the lesson guide data is displayed in augmented reality in the augmented reality HMD 30 .

For example, as shown in FIGS. 11 and 12 , the lesson guide display based on the lesson guide data is the position of the foot in 3D space based on the user's throw line 11 position coordinates, the height of the arm. , a dart release position, and the like, and is a guide mark (VS, VA) that a user can use as a standard for throwing a foot or arm when throwing a dart.

The augmented reality HMD 30 displays the guide marks VS and VA as a hologram on real coordinates, and the user practices according to the guide.

For example, the lesson guide display includes at least one of a leader line, a direction line, and a figure displayed in a three-dimensional space.

The lesson guide display may be provided, for example, by using a function of the augmented reality HMD 30 to display a leader line, a direction line, a figure, etc. in a three-dimensional space.

For example, as shown in FIG. 11 , the leader line may be displayed in the form of a vertical line (VS) based on the user's dart throwing arm and a direction line (or arrow, VA) connecting the arm and the target point. .

For example, in the lesson guide display, as shown in FIG. 12 , the elbow position and the throwing direction of the dart when the dart is thrown before correction toward a specific target are vertical lines (VS1) and direction lines (VA1), respectively. Displayed and provided to the user for accurate hitting of a specific target, the elbow position and the throwing direction of the dart are displayed at the same time as another vertical line (VS2) and direction line (VA2), respectively, so that the throwing is performed while comparing with the throwing before correction. can be set.

For example, the lesson guide display may be provided to display various figures such as a circle, a rectangle, etc. in association with a leader line or a direction line or separately.

By repeating this process several times, the user can correct his or her posture.

The user's final result data is stored in the dart server 20, and when the user selects the lesson guide display mode at the next opportunity and proceeds to the lesson mode, the data can be continuously utilized by using the previous data retrieval function.

On the other hand, after the step S302, a step S303 of providing a display of the lesson guide generated based on the user's throwing posture data in augmented reality may be further provided.

In step S303, the augmented reality HMD 30 displays a lesson guide display generated based on the user's throwing posture data obtained by another optical recognition means provided in the electronic dart 10 in the synchronized spatial coordinates. Based on the augmented reality display is provided.

At this time, the lesson guide display provided in step S303 obtains the user's throwing posture data by another optical recognition means provided in the electronic dart 10, and based on the obtained data, the position of the user's foot or arm It is a guide mark indicating height, etc.

For example, in the state in which the pre-stored lesson guide display presented to the user to hit a specific target in step S302 is made, the lesson guide display generated based on the user's throwing posture data obtained while the user throws the dart may be simultaneously displayed in augmented reality.

In this case, the user can visually determine whether the throwing posture of the actually thrown dart is the same as the pre-stored lesson guide display according to the pre-stored lesson guide display provided on the display in step S302. can be obtained

Meanwhile, embodiments of the present invention include program instructions for performing various computer-implemented operations and computer-readable media including the same. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The media may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include hard disks, magnetic media such as floppy disks and magnetic tapes, optical recording media such as CD-ROMs, DVDs, and USB drives, magneto-optical media such as floppy disks, and ROM, RAM, Included are hardware devices specially configured to store and execute program instructions, such as flash memory and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

2, 3, P: 3D Model 2: 3D Lesson Model
3: Virtual Character 10: Electronic Darts
11: throw line 20: dart server
30: augmented reality HMD 31: camera
37: display 40: terminal
100: dart target unit 110: dart
145: camera 200: LED indicator
300: control unit 400: input means
500: display means E: space effect
VA, VS: Guide display P: 3D user model

Claims (23)

As a method of providing an electronic dart service executed using an augmented reality HMD (head-mounted display) -,
1) Synchronizing, by the augmented reality HMD, the spatial coordinates between the augmented reality space and the real space in which the electronic dart is located - the optical recognition by using the optical information of the optical recognition means obtained for the electronic dart and the periphery of the electronic dart means is a camera integrally attached to the augmented reality HMD, the optical information is an image captured by the camera, and the spatial coordinate synchronization is achieved by recognizing a preset specific point as a reference coordinate point based on the optical information, The reference coordinate point is any one of a specific point of the electronic dart or a specific point around the electronic dart, and the recognition of the reference coordinate point is at a specific point of the electronic dart or around the electronic dart through a camera attached to the augmented reality HMD. This is done by photographing any one of a specific point and recognizing the image as a reference point of spatial coordinates-; and
2) providing, by the augmented reality HMD, a virtual object for the electronic dart service stored in advance based on the synchronized spatial coordinates in augmented reality at a preset position in the front of the electronic dart located in the real space - the virtual object is an object for displaying at least one of information on a dart throwing posture and information on a dart game progress;
According to claim 1,
Step 1) is,
A method of providing an electronic dart service using an augmented reality HMD, characterized in that the augmented reality HMD obtains the electronic dart and optical information around the electronic dart through the optical recognition means at a preset position around the electronic dart.
According to claim 1,
Electronic dart service using augmented reality HMD, characterized in that the augmented reality HMD displays, in augmented reality, the dart throwing posture of the 3D model as the virtual object at a preset position of the front part of the electronic dart located in the real space. How to provide.
According to claim 1,
When a preset event occurs in connection with the progress of the dart game, the augmented reality HMD augments the pre-stored space rendering effect screen in response to the event as the virtual object at a preset position of the electronic dart front part located in the real space. An electronic dart service providing method using an augmented reality HMD, characterized in that the display is provided in reality.
According to claim 1,
Using the augmented reality HMD, characterized in that the augmented reality HMD displays a lesson guide display for the dart throwing posture stored in advance as the virtual object in an augmented reality at a preset position of the electronic dart front part located in the real space. How to provide electronic dart service.
A computer program stored in a computer-readable recording medium in combination with hardware to execute the electronic dart service providing method using the augmented reality HMD according to claim 1. delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images