KR20190116654A - Augmented Reality Companion Content Service System and Method - Google Patents

Abstract

In order to provide a virtual companion service more realistically, a virtual companion service method and a system thereof generate and display a virtual companion in a condition with the virtual companion and perform the contact event/delivery of the virtual companion in a condition away from the virtual companion. According to an embodiment of the present invention, a virtual companion service method comprises: a step of generating a virtual companion; a step of displaying the generated companion on the first device of a user; a step of generating the contact event of the virtual companion for the user; and a step of delivering the generated contact event to the second device of the user. As a result, in the age of single household and aging, it is possible to provide a virtual companion service more realistically. It is possible to produce virtual companions and provide on-demand services according to personal taste and personality.

Description

Augmented Reality Companion Content Service System and Method

The present invention relates to a realistic content service technology, and more particularly to a system and method for providing a service using augmented reality content.

The Naolos refer to people who like to eat alone, drink coffee, read books, and enjoy themselves alone. There is a growing tendency for the Naolos to spend their days alone, such as young people who spend their time alone in their daily lives outside of work and bereaved seniors.

However, the Naolos are not always satisfied with their lives alone, and sometimes they feel inclined to be with their companions. Therefore, the search for a solution to solve this problem is requested.

In particular, there is a need to seek ways to provide realistic services by combining 3D content technology with IT technology, which has shown remarkable growth in recent years.

The present invention has been made to solve the above problems, an object of the present invention is to provide a virtual companion service more realistically, under the conditions with the virtual companion to create and display a virtual companion, virtual The present invention provides a virtual companion service method and system for communicating / delivering a virtual companion in a condition that is away from the companion.

According to an embodiment of the present invention, a virtual companion service method includes: creating a virtual companion; Displaying the generated companion on a first device of the user; Generating a contact event of the virtual companion for the user; Delivering the generated contact event to a second device of the user.

The first device may be a device used by the user indoors, and the second device may be a device used by the user both indoors and outdoors.

The first device may be a wearable device, and the second device may be a mobile device.

The contact event may include at least one of a phone call, a message, and an email.

The displaying step may be to display the generated companion as augmented reality.

The generating step may be to generate a virtual companion using an image file and a voice file provided by the user.

The virtual companion service method according to the present invention may further include personalizing the personality of the virtual companion to the user's personality.

Virtual companion service method according to the present invention comprises the steps of collecting the context information of the user; Analyzing the collected context information to determine the nature of the user; may further include.

The initial personality of the virtual companion may be set by the user.

On the other hand, according to another embodiment of the present invention, a virtual companion service system includes a first platform for creating a virtual companion; A first device of a user displaying the created companion; A second platform for generating a contact event of a virtual companion for a user; And a second device of the user receiving the generated contact event.

On the other hand, according to another embodiment of the present invention, the virtual companion service method comprises the steps of creating a virtual companion; Providing the created companion to a first device of a user; Generating a contact event of the virtual companion for the user; Delivering the generated contact event to a second device of the user.

On the other hand, according to another embodiment of the present invention, a system for providing a virtual companion service includes a first platform for creating a virtual companion and providing the generated companion to a first device of a user; And a second platform for generating a virtual companion's contact event for the user and delivering the generated contact event to a user's second device.

As described above, according to the embodiments of the present invention, in the age of single-person households, aging, it is possible to provide a virtual companion service in a more complete and realistic manner, the virtual companion to suit the personal taste as well as personality Custom made and service available.

In addition, according to the embodiments of the present invention, in the condition with the virtual companion to create and display the virtual companion, in the condition away from the virtual companion contact event / delivery of the virtual companion, more realistic feelings for the virtual companion service You can strengthen it.

In addition, according to embodiments of the present invention, it is possible to provide a convergence service through linkage with the AI platform, and contribute to the spread of the diffusion of the augmented reality device.

1 is a conceptual diagram of an augmented reality companion content service system according to an embodiment of the present invention;
FIG. 2 is a detailed block diagram of the VCS provider shown in FIG. 1;
3 is a conceptual diagram of augmented reality companion content service method according to another embodiment of the present invention, and
4 is a detailed block diagram of the augmented reality device shown in FIG.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

1 is a conceptual diagram of an augmented reality companion content service system according to an embodiment of the present invention. Augmented reality companion content service system according to an embodiment of the present invention, when the user returns home wearing the augmented reality device, through this provides a virtual companion.

The virtual companion can author what the user ordered or customized, and is personalized to the user's personality.

Augmented reality companion content service system according to an embodiment of the present invention, which performs such a function, VCS (Virtual Companion Service) provider 100 and augmented reality devices (200-1, 200-2, ..., ... 200-n) are constructed to be connected to each other via the Internet.

The augmented reality devices 200-1, 200-2,..., 200-n refer to smart glasses worn by home users, and head mounted devices (HMDs). In the embodiment of the present invention, augmented reality devices (200-1, 200-2, ..., 200-n) is assumed to be used in the home, it can be used outdoors, even in such a case the technical idea of the present invention Of course this can be applied.

The augmented reality devices 200-1, 200-2,..., 200-n display the virtual companion of the user with a 3D display function, and the voice of the virtual companion is realized with the text-to-speech function. do.

The VCS provider 100 generates a 3D image of the user's virtual companion and a conversation content of the virtual companion as text and transmits the text to the augmented reality devices 200-1, 200-2, ..., 200-n. System.

FIG. 2 is a detailed block diagram of the VCS provider 100 shown in FIG. 1. The VCS provider 100 is built including a VCS platform 110, a content authoring platform 120, a content database 130 and an AI service platform 140, as shown in FIG. 2.

The VCS platform 110 is a server system for providing virtual companion content to Naolo users. The VCS platform 110 is also responsible for the service subscription / application, certification, order, billing, termination / withdrawal associated with service provision.

The content authoring platform 120 is a server system for authoring 3D content for a virtual companion. The virtual companion generated by the content authoring platform 120 may author the appearance and voice of the virtual companion on a personal or custom basis.

For personal on-demand or custom authoring, the content authoring platform 120 may use image (photo, video) and audio files provided by Naolo users, and recruit real people (celebrities, associates, the public, etc.) By shooting, you can author the appearance and voice of the virtual companion.

The content database 130 stores the virtual companion content of the user authored by the content authoring platform 120.

The artificial intelligence service platform 140 personalizes the personality of the virtual companion authored by the content authoring platform 120 according to the personality of the user. To this end, the AI service platform 140 collects, stores, and analyzes user's context information (user's conversation, reaction, movement, emotion, etc.) to grasp the user's personality.

The context information is analyzed by using artificial intelligence (deep learning, etc.). The context information is periodically performed after the virtual companion service is provided to adapt the personality of the virtual companion to the user's personality. The initial personality is set by the user's order.

3 is a conceptual diagram of augmented reality companion content service method according to another embodiment of the present invention.

As shown in FIG. 3, for the augmented reality companion content service, the VCS platform 110 of the VCS provider 100 and the augmented reality devices 200-1, 200-2,. In conjunction, (1) subscription / service application, (2) authentication / account assignment, (3) virtual companion order / selection and voice / personality setting process are performed.

Accordingly, the content authoring platform 120 creates a virtual companion according to a user setting and stores it in the content database 130 (4), and the VCS platform 110 includes the augmented reality devices 200-1, 200-2, 200-n) to provide the app to start the service (5).

After that, the augmented reality devices 200-1, 200-2,..., 200-n collect the user's context information (user's conversation, reaction, movement, emotion, etc.) and provide them to the VCS platform 110. (6).

Then, the AI service platform 140 analyzes the collected context information of the user to determine the personality of the user and personalizes the personality of the virtual companion according to the identified personality (7).

On the other hand, through the augmented reality devices (200-1, 200-2, ..., 200-n), if there is a service cancellation / withdrawal request (8), the content authoring platform 120 is the content database 130 The virtual companion content of the user is deleted (9).

FIG. 4 is a detailed block diagram of the augmented reality devices 200-1, 200-2,..., 200-n shown in FIG. 1. Since the augmented reality devices 200-1, 200-2,..., 200-n may be implemented in the same configuration, only one of them is shown in FIG.

As shown in FIG. 4, the augmented reality device 200 includes a communication unit 210, a display 220, a processor 230, a speaker / microphone 240, and a storage unit 250.

The communication unit 210 communicates with the VCS platform 110 to receive a VCS provided by the VCS provider 100. Specifically, the content and dialogue text of the virtual companion produced by the content authoring platform 120 is received.

The display 220 displays a virtual companion received through the communication unit 210, and the processor 230 converts the conversation text received through the communication unit 210 into voice and outputs the voice through the speaker 240. The user voice input through the 240 is converted into text and transmitted to the VCS platform 110 through the communication unit 210.

The storage unit 250 is a storage medium that stores information / data received from the communication unit 210 and provides a storage space necessary for the processor 230 to operate.

So far, the augmented reality companion content service system and method have been described in detail with reference to a preferred embodiment.

In the above embodiment, the companion content service may be provided even when the user does not wear the augmented reality devices 200-1, 200-2,..., 200-n. For example, if the user is outdoors and not outdoors, the virtual companion can have the user contact the smartphone.

To this end, the VCS platform 110 generates a virtual companion's contact event for the user, and delivers the generated contact event to the user's smartphone. Here, the contact event includes a phone call, message transmission via SMS, message transmission via messenger, email, and the like.

This is useful when the augmented reality devices 200-1, 200-2,..., 200-n are devices that the user can use only in the home, such as HMD. Smartphones are referred to as a type of mobile device that users can use both indoors and outdoors. Of course, it can be replaced by another kind of mobile device.

On the other hand, if the augmented reality devices (200-1, 200-2, ..., 200-n) is a device of the type that can be used outdoors, for example, in the case of smart glasses, the service to go out with the virtual companion May be provided.

Augmented reality companion content service system and method according to an embodiment of the present invention, a user-customized augmented reality content service method, by introducing a virtual companion content concept to provide a service provided by augmented reality.

Augmented reality companion content service system and method according to an embodiment of the present invention, by creating and servicing personalized augmented reality content for the age of single household, aging, can contribute to the development of a healthy society.

Furthermore, the augmented reality companion content service system and method according to an embodiment of the present invention provides a convergence service through linkage with an artificial intelligence platform and contributes to the spread of augmented reality devices.

Meanwhile, in the above embodiment, it is assumed that the artificial intelligence service platform 140 is provided in the VCS provider 100. However, this is an example of description and implementation, and it is also possible to use the AI service platform 140 as an API provided by another service provider.

On the other hand, the technical idea of the present invention can be applied to a computer-readable recording medium containing a computer program for performing the functions of the apparatus and method according to the present embodiment. In addition, the technical idea according to various embodiments of the present disclosure may be implemented in the form of computer readable codes recorded on a computer readable recording medium. The computer-readable recording medium can be any data storage device that can be read by a computer and can store data. For example, the computer-readable recording medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical disk, a hard disk drive, or the like. In addition, the computer-readable code or program stored in the computer-readable recording medium may be transmitted through a network connected between the computers.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the specific embodiments described above, but the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

100: VCS (Virtual Companion Service) provider
110: VCS platform
120: content authoring platform
130: content database
140: AI service platform
200-1, 200-2, ..., 200-n: augmented reality device

Claims (12)

Creating a virtual companion;
Displaying the generated companion on a first device of the user;
Generating a contact event of the virtual companion for the user;
Delivering the generated contact event to a second device of the user.
The method according to claim 1,
The first device,
Is the device the user is using at home,
The second device,
The virtual companion service method, characterized in that the user is a device used in both indoors and outdoors.
The method according to claim 2,
The first device,
Wearable device,
The second device,
Virtual companion service method, characterized in that the mobile device.
The method according to claim 3,
Contact event,
Virtual companion service method comprising at least one of a phone call, a message, an email.
The method according to claim 1,
The display step is
Virtual companion service method characterized in that to display the created companion to augmented reality.
The method according to claim 1,
Generating step,
The virtual companion service method, characterized by generating a virtual companion using the image file and the audio file provided by the user.
The method according to claim 6,
Personalizing the personality of the virtual companion according to the personality of the user of the user; Virtual companion service method further comprising.
The method according to claim 1,
Collecting context information of the user;
Analyzing the collected context information, to determine the personality of the user; virtual companion service method further comprising.
The method according to claim 8,
The initial personality of the virtual companion,
Virtual companion service method, characterized in that set by the user.
A first platform for creating a virtual companion;
A first device of a user displaying the created companion;
A second platform for generating a contact event of a virtual companion for a user;
And a second device of a user to receive the generated contact event.
Creating a virtual companion;
Providing the created companion to a first device of a user;
Generating a contact event of the virtual companion for the user;
Delivering the generated contact event to a second device of the user.
A first platform for creating a virtual companion and providing the generated companion to a first device of a user;
And a second platform for generating a contact event of the virtual companion for the user and delivering the generated contact event to a second device of the user.

Images