KR20230138633A - Automatic frame creation system for 2d artwork image in 3d virtual gallery space - Google Patents

Abstract

The present invention relates to a system for automatically generating a frame of a 2D artwork image. According to one aspect of the present invention, the system for automatically generating a frame of a 2D artwork image in a 3D virtual gallery space, comprises a user terminal for user access and a server for providing a 3D virtual gallery space for a user. The user terminal performs an operation of uploading a 2D artwork image to be exhibited to the server and selecting a virtual exhibition space of a 3D virtual gallery to be exhibited. The server performs the operations of: receiving the 2D artwork image to be exhibited among uploaded 2D artwork images and an installation location in the virtual exhibition space of the 2D artwork image, from the user terminal; automatically generating a 3D frame artwork model including the 2D artwork image to be exhibited and a frame; and placing the created 3D frame artwork model at the installation location within the virtual exhibition space. Therefore, various art contents can be promoted and shared online.

Description

Automatic frame creation system for 2D work images in 3D virtual gallery space {AUTOMATIC FRAME CREATION SYSTEM FOR 2D ARTWORK IMAGE IN 3D VIRTUAL GALLERY SPACE}

The present invention relates to an automatic frame generation system for 2D work images, and more specifically, to an automatic frame generation system for 2D work images in a 3D virtual gallery space.

For galleries operated offline, the organizer incurs costs such as finding a location, interior design, and publicity; the exhibitor incurs costs of transporting, installing, and managing exhibits; and from the viewer's perspective, the gallery incurs costs. There is a problem that you have to make time to go to the gallery during opening hours to view the exhibits.

Recently, the introduction of online technology in the field of art exhibition and sales is rapidly occurring due to the influence of NFT and COVID-19. In particular, interest in virtual exhibition technology, which allows art exhibitions to be held without renting a physical location such as an exhibition hall, is increasing, and the proportion of online sales in total global art sales has increased significantly from 13% in 2019 to 39% in 2020. It was found that

Virtual exhibition technology is a method of displaying works in a 3D virtual space. Exhibition costs are dramatically reduced because there is no need to rent an exhibition hall, transport, install, or remove works, and viewing the exhibition is not restricted by time and place. It has several advantages over existing offline exhibition methods.

However, one of the biggest technical challenges in virtual exhibitions is increasing the realism of the exhibition hall. Artists and visitors who are accustomed to existing offline exhibitions often hesitate to introduce virtual exhibition technology because the realism of virtual exhibitions is somewhat lacking. In particular, works can be framed and expressed in a realistic 3D space as in a real exhibition hall. Customer demands are increasing.

Republic of Korea Patent Publication No. 10-2020-0063526 (published on June 5, 2020)

The present invention automatically creates a 3D frame model with the frame shape and shadow applied based on the 2D image provided by the user and installs it in the virtual space selected by the user, so that the image of the work to be displayed can be realistically displayed in the virtual exhibition space. The purpose is to express it.

According to one aspect of the present invention in order to solve the above-described problem, an automatic frame generation system for a 2D work image in a 3D virtual gallery space is provided, and the system includes a user terminal for user access and a 3D virtual gallery space for the user. Includes a server that provides,

The user terminal uploads an image of a 2D work to be displayed to the server and selects a virtual exhibition space of a 3D virtual gallery to be displayed,

The server receiving from the user terminal a 2D work image to be displayed among uploaded 2D work images and an installation location of the 2D work image to be displayed in a virtual exhibition space; An operation of automatically generating a 3D frame work model including the image of the 2D work to be displayed and the frame; and to perform an operation of placing the generated 3D frame work model at an installation location within the virtual exhibition space.

In the above-described aspect, the operation of automatically generating a 3D framed work model includes automatically creating a frame frame around the selected work image, and generating a 2D work image to which the frame frame is added.

In addition, in any of the above-described aspects, the operation of automatically generating the 3D framed work model includes, after the operation of generating a 2D work image to which a frame frame has been added, a 3D work image having the same bottom as the 2D work image to which the frame frame has been added. It further includes an operation to create a cuboid model.

Additionally, in any of the above-described aspects, the operation of generating the 3D cuboid model further includes receiving the thickness of the cuboid model from the user terminal.

In addition, in any of the above-described aspects, the operation of automatically generating a 3D framed work model includes generating a 3D cuboid model and then texturing a 2D work image to which a frame frame is added to the upper surface of the generated 3D cuboid model, The method further includes generating a 3D frame work model by adding a shadow image to the lower surface of the generated 3D rectangular parallelepiped model.

Additionally, in any of the above-described aspects, the server may include an operation of receiving an installation location within a virtual exhibition space from a user terminal and then calculating a normal vector at the installation location; And further performing the operation of calculating the normal vector of the generated 3D frame work model,

The operation of placing the generated 3D framed work model at the installation location within the virtual exhibition space involves calculating the rotation matrix of the 3D framed work model using the normal vector at the installation location and the normal vector of the 3D framed work model, and calculating the rotation matrix calculated. It is configured to apply the matrix to the 3D frame work model, rotate it, and then place it at the installation location in the virtual space.

According to the present invention, the image of the work can be expressed realistically in the virtual exhibition space by selecting the position of the work in 3D space, creating a 3D frame model, and combining the 3D frame model with the image of the work and placing it in the virtual space. You can.

In addition, according to the present invention, artists, photographers, art enthusiasts, art students, etc. can create highly realistic virtual exhibitions online at a low cost without renting an exhibition hall, and visitors can feel as if they are visiting a real gallery. You can view the works in the exhibition hall.

Additionally, according to the present invention, anyone can hold a personal exhibition and share it online, thereby promoting and sharing various art contents lying dormant in the artist's studio online.

1 is a diagram illustrating an example of an automatic frame generation system for a 2D work image in a 3D virtual gallery space according to the present invention;
Figure 2 is an explanatory diagram illustrating the operation process of the 3D virtual gallery providing server;
Figure 3 is a block diagram schematically showing the main functions of the 3D virtual gallery providing server;
Figure 4 is an explanatory diagram for explaining spatial information of a virtual gallery;
Figure 5 is a block diagram schematically showing the main functions of the picture frame creation unit;
Figure 6 is a flowchart for explaining the process of creating a 3D framed work model and placing it in virtual space;
Figure 7 is a diagram illustrating modeling a 2D work image into a 3D framed work;
FIG. 8 is a diagram illustrating the arrangement of the 3D frame work model created in FIG. 7 within the space of a 3D virtual gallery.

The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and will be implemented in various different forms.

The examples herein are provided to make the disclosure of the present invention complete and to fully inform those skilled in the art of the scope of the invention. And the present invention is only defined by the scope of the claims. Accordingly, in some embodiments, well-known components, well-known operations and well-known techniques are not specifically described in order to avoid ambiguous interpretation of the present invention.

Like reference numerals refer to like elements throughout the specification. Also, the terms used (mentioned) in this specification are for describing embodiments and are not intended to limit the present invention. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context. Additionally, components and operations referred to as 'including (or, including)' do not exclude the presence or addition of one or more other components and operations.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings that can be commonly understood by those skilled in the art to which the present invention pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless they are defined.

Hereinafter, embodiments of the present invention will be described with reference to the attached drawings. 1 is a diagram showing an example of a system that provides a 3D virtual gallery according to the present invention. As shown in Figure 1, the 3D virtual gallery providing server 100 of the present invention is connected to one or more user terminals through a network, and provides the user with the functions necessary for a 3D virtual gallery on a web page according to the request of the user terminal. It is designed to provide

The user connects to the 3D virtual gallery providing server 100 through the network using the user terminal. The user terminal selects one of several 3D virtual gallery spaces provided by the 3D virtual gallery providing server 100, uploads images of the user's work to the selected 3D virtual gallery space, and stores each of the uploaded work images in the 3D gallery space. It is a computing device that can be placed anywhere in the computer, especially a smartphone or smart phone capable of running web browsers such as Internet Explorer, Firefox, and Chrome, which can perform video editing services provided based on a web browser. A pad, personal computer, laptop, or workstation may be used.

Therefore, the user terminal may be equipped with a computing device, a storage device, an input device, an output device, etc., and the user terminal may execute the functional tool provided by the web browser to display images of the user's work in an online 3D virtual gallery space. It is operated to execute or command the server.

Here, the network is a concept that includes not only short-range wireless communication networks such as WiFi and Zigbee, but also long-distance wireless communication networks such as CDMA, WCDMA, Wibro, 3G, and LTE, and may be the same or separate networks.

As shown in FIG. 2, the 3D virtual gallery providing server 100 searches the 3D virtual gallery from the database based on the command input from each user terminal, stores the work images received from the user, and arranges the work images. information about the work is stored, a picture frame model added to the work images is provided to the user's terminal, the picture frame selected by the user is synthesized and stored in the user's work image, and the work image synthesized in the picture frame is stored in a 3D virtual gallery. It functions to be placed in space and displayed on the user's screen.

Specifically, Figure 3 is a functional block diagram showing main functions provided by the 3D virtual gallery providing server 100. As shown in FIG. 3, the 3D gallery providing server 100 includes a user information storage unit 110, a user work storage unit 120, a work-location matching unit 130, a gallery information storage unit 140, and spatial information. It includes a storage unit 150, a picture frame creation unit 160, and a work display unit 170.

The user information storage unit 110 includes the user's basic personal information, ID information, and password information. In order for a user to use the caustic gallery exhibition service of the 3D virtual gallery providing server 100, the user accesses the 3D virtual gallery providing server 100, performs a membership registration operation through a predetermined membership registration procedure, and uses the ID and ID generated at this time. By using the password, various functions provided by the 3D virtual gallery providing server 100 can be provided.

After the user registers as a member, the user work storage unit 120 uploads the image of the work the user wants to exhibit or the work to be exhibited using the file upload function provided by the 3D virtual gallery providing server 100, and stores the user work. Unit 120 stores the image of the work uploaded by the user in the data space provided in the user's account. Meanwhile, in the case of a work image uploaded by a user, size information is included. This can be saved by directly entering the horizontal and vertical sizes when the user uploads the work image, and the work storage is stored based on the size information included in the work image. It can also be automatically calculated and stored at (120). The horizontal and vertical sizes of the work image can be used to create a frame in the frame creation unit 160.

When placing an image of one of several works uploaded by a user at a random location in the virtual space of the gallery, the work-location matching unit 130 uses the corresponding work image or the identification number of the corresponding work and the location of the virtual space. Information is matched and stored. This work-location matching information is maintained until the virtual exhibition ends, so it is continuously maintained as long as the user does not change the location of the work within the virtual space. Meanwhile, when the user changes the location of the work within the virtual space, the work-location matching unit changes and stores the location information within the virtual space for the corresponding work image, and the work placement unit 170 is based on the changed work-location matching information. The work is then displayed again in 3D space.

The gallery storage unit 140 is configured to replicate and store the exterior and overall internal structure of an existing gallery that has collaborated with or is approved for use with the 3D virtual gallery providing service of the present invention. The user selects the gallery he or she wants to use by referring to the appearance and internal structure of the galleries provided on the screen of the user terminal. The gallery or exhibition hall selected by the user is stored in the user gallery storage unit 145, and the user accesses the gallery selected by the user to determine the arrangement of the work image.

In the above description, it is explained that the gallery stored in the gallery storage unit 140 is a currently existing gallery, but the present invention is not limited to this, and a gallery produced by the company providing the 3D gallery service can be used. It may be possible.

The spatial information storage unit 150 includes three-dimensional layout information of galleries stored in the gallery storage unit 140 described above. The 3D layout information includes hierarchical layout information such as a plurality of floor structures included in the actual internal structure of the gallery as described above, the exhibition hall structure for each floor structure, the wall structure of the exhibition hall structure, the passage structure, the lighting structure, and the interior structure. Contains.

When the user selects one gallery among several galleries stored in the gallery storage, the spatial information storage unit 150 of the server 100 provides spatial information for the corresponding gallery, and the user uses the spatial information of the provided gallery. You can select the exhibition hall you want to visit or select only a part of the exhibition space. Figure 4 is a diagram illustrating spatial information provided to the user. When the user selects a gallery, the user is provided with floor-by-floor layout information for the gallery. After the user selects a floor, the user is provided with exhibition hall information on the corresponding floor, and the user selects the exhibition hall he or she wants to use through the provided exhibition hall information. You can select one or more. After the user selects the exhibition room he or she wants to use, the user space storage unit 155 stores the exhibition room information selected by the user and the related wall structure, passage structure, lighting structure, and interior structure in the user space storage unit 155. .

After the user selects the user space he/she wants to use, the 3D virtual gallery providing server 100 displays an exhibition space image depicting the exhibition space selected by the user in three dimensions on the user's screen. In order to place his or her work within the exhibition space image screen, the user selects one of the work images he or she has uploaded and places the selected work image on one of the several exhibition walls on the exhibition space image using a drag and drop method. .

When a user drags and drops a work image on the exhibition space image screen, the frame creation unit 160 retrieves information about the dropped work image from the user work storage unit 120, calculates the size of the work, and calculates the size of the work. A frame is created accordingly.

Specifically, as shown in FIG. 5, the frame generator 160 includes a frame model storage unit 161, a frame frame generator 162, a frame texturing unit 163, a shadow generator 164, and a work-frame. Includes a 3D modeling unit 165.

The frame model storage unit 161 stores a basic frame model provided by the 3D virtual gallery providing server 100. When the user selects a frame model to use through the screen provided by the frame model storage unit 161, the work-frame modeling unit generates a frame using the selected frame model (picture frame creation unit 162), and Texturing (frame texturing unit 163), creating a frame shadow (shadow creation unit 164), and modeling the work and the frame (work-frame modeling unit 165).

As shown in FIG. 6, the operation of the picture frame creation unit can be largely divided into three stages and may include the following.

Step 1: Selection of work and installation location

Step 2: 3D frame model creation step

Step 3: Installing the 3D frame model in virtual space

In the first step, selecting the work and selecting the installation location, the user first selects the image of the work to be displayed using the tool provided on the screen. At this time, the work image may be a 2D image file or video file uploaded to the server by the user. Next, the user selects a surface in the virtual exhibition space where the image of the work will be installed. After the user selects the point of the surface and the work, the frame creation unit extracts the installation location and normal vector based on the selected surface information of the virtual exhibition space. Here, the surface information can be obtained through a database or spatial information storage unit.

For example, the user's work selection and installation location selection steps can be performed by selecting one of the work images uploaded by the user and dragging and dropping the selected work image onto any wall in the virtual exhibition space displayed on the screen. . After the user performs drag and drop, the frame creation unit can identify the installation point on the wall through the position of the mouse or pointing device and extract the normal vector at the corresponding installation location (point).

After selecting the work and selecting the installation location in step 1, step 2 is performed, which involves creating a 3D frame model. In step 2, a picture frame is created around the image of the work selected in step 1. The picture frame may be automatically created by the picture frame creation unit, and the frame desired by the user can be selected from frames provided through items such as menus. It can also be created by selection. The picture frame creation unit creates a 2D image with added frames either automatically or manually.

In the next step, the frame creation unit creates a 3D rectangular parallelepiped model with the same bottom as the 2D work image to which the frame is applied. At this time, the thickness of the rectangular parallelepiped may be input by the user or a predefined constant value may be used.

In the next step, the frame texturing unit of the frame creation unit textures the 2D frame work image on the front of the 3D rectangular parallelepiped model. Subsequently, a 2D shadow image is created on the back of the textured 2D work image to provide more realism. Through this process of creating a frame model, the 2D work image is changed into a 3D frame work model with a frame, as shown in FIG. 7.

In the final third step, the work display unit 170 calculates the rotation matrix of the 3D frame work model by mutually calculating the normal vector of the installation surface of the virtual space extracted in step 1 and the normal vector of the 3D frame model generated in step 2, and displays it in 3D It is applied to the framed work model, rotated, and placed on the installation surface in virtual space as shown in FIG. 8.

In the above-described embodiment, it was explained that the user places one work image at a specific location in the virtual space, but the present invention is not limited to this, and one or more work images can be placed at an installation location in the virtual space in the same manner. In order to place one or more work images, the user selects one or more works and then drags and drops them. The frame creation unit creates a 3D frame work model in the same way for each object, and the work display unit 170 uses the drag and drop mouse. One or more works can be placed on the exhibition surface of the virtual space using the position of as the midpoint.

In addition, in the above description, the size of the 3D work model placed in the exhibition space is automatically determined based on the ratio of the actual size of the work image uploaded by the user and the actual size of the exhibition surface of the virtual space, but the present invention is limited to this. However, based on the user's command, one or more work images placed on the display surface may perform one or more of the following operations: movement, rotation, enlargement, and reduction.

According to the present invention described above, the image of the work is displayed realistically in the virtual exhibition space by selecting the position of the work in 3D space, creating a 3D frame model, and combining the 3D frame model with the work image to place it in the virtual space. You can do it. In addition, according to the present invention, artists, photographers, art enthusiasts, art students, etc. can create highly realistic virtual exhibitions online at a low cost without renting an exhibition hall, and visitors can feel as if they are visiting a real gallery. You can view the works in the exhibition hall. Additionally, according to the present invention, anyone can hold a personal exhibition and share it online, thereby promoting and sharing various art contents lying dormant in the artist's studio online.

The device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general-purpose or special-purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may execute an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include a plurality of processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used by any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Although the embodiments have been described with limited drawings as described above, various modifications and variations can be made by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the claims described below.

100: 3D virtual exhibition hall providing server 110: User information storage unit
120: User work storage unit 130: Work-location matching unit
140: Gallery storage unit 150: Spatial information storage unit
160: Frame creation unit 170: Work display unit

Claims (6)

In an automatic frame generation system for 2D work images in a 3D virtual gallery space,
It includes a user terminal for user access and a server that provides a 3D virtual gallery space to the user,
The user terminal uploads an image of a 2D work to be displayed to the server and selects a virtual exhibition space of a 3D virtual gallery to be displayed,
The server is
An operation of receiving from a user terminal an image of a 2D work to be displayed among uploaded 2D work images and an installation location of the 2D work image to be displayed in a virtual exhibition space;
An operation of automatically generating a 3D frame work model including the image of the 2D work to be displayed and the frame;
An automatic frame generation system for 2D work images in a 3D virtual gallery space, characterized in that it is configured to perform an operation of placing the generated 3D frame work model at an installation location in the virtual exhibition space.
According to paragraph 1,
The operation of automatically generating the 3D framed work model is,
An automatic frame creation system for 2D work images in a 3D virtual gallery space, comprising the operation of automatically creating a picture frame around the selected work image to create a 2D work image with the frame frame added.
According to paragraph 2,
The operation of automatically generating the 3D framed work model is,
2D in a 3D virtual gallery space, further comprising generating a 3D rectangular parallelepiped model having the same bottom as the 2D work image to which the picture frame has been added, after the operation of generating the 2D work image to which the picture frame has been added. Automatic frame creation system for artwork images.
According to paragraph 3,
An automatic frame creation system for 2D work images in a 3D virtual gallery space, wherein the operation of generating the 3D cuboid model further includes receiving an input of the thickness of the cuboid model from the user terminal.
According to paragraph 3,
The operation of automatically generating the 3D framed work model is,
After creating a 3D cuboid model, a 2D work image with a picture frame added to the upper surface of the generated 3D cuboid model is textured, and a shadow image is added to the lower surface of the generated 3D cuboid model to create a 3D framed work model. An automatic frame generation system for 2D artwork images in a 3D virtual gallery space that further includes motion.
According to clause 5,
The server is,
After receiving an installation location within the virtual exhibition space from a user terminal, calculating a normal vector at the installation location; And further performing the operation of calculating the normal vector of the generated 3D frame work model,
The operation of placing the generated 3D framed work model at the installation location within the virtual exhibition space is calculated by calculating the rotation matrix of the 3D framed work model using the normal vector at the installation location and the normal vector of the 3D framed work model. An automatic frame generation system for 2D work images in a 3D virtual gallery space, characterized by applying a rotation matrix to a 3D frame work model, rotating it, and then placing it at an installation location in the virtual space.