TWI832459B - Method, processing device, and display system for information display - Google Patents

Abstract

A method, a processing device, and a system for information display are proposed, and the system includes multiple light transmissive displays. The light transmissive displays include a first light transmissive display and a second light transmissive display which are arranged adjacent to each other. Multiple sensing information capturing devices capture the position information and posture information of at least one user and capture the position information of at least one target object. A processing device is configured to: determine the user number of the at least one user located in front of the first light transmissive display and the second light transmissive display; determine display position information of a virtual object associated with the user according to the user number, the position information and posture information of the user and the position information of the target object; and control at least one of the first transmissive display and the second transmissive display to display the virtual object corresponding to the target object according to the display position information

Description

Information display method, processing device and information display system

This disclosure relates to an information display technology.

With the development of image processing technology and spatial positioning technology, the application of transparent displays has gradually attracted attention. This type of technology allows the display to be matched with physical objects, supplemented by virtual related information, and generate an interactive experience according to the user's needs, allowing the information to be presented in a more intuitive way.

Furthermore, virtual objects associated with physical objects can be displayed at specific positions on the transparent display, allowing users to simultaneously view the physical objects and the virtual objects superimposed on or on one side of the physical objects through the transparent display. For example, by setting up a transparent display on an observation deck, viewers can view the landscape and the landscape information provided by the transparent display at the same time. However, in some large-scale application scenarios, it may be necessary to provide virtual and real information display services through a combination of multiple transparent displays. Therefore, how to control multiple transparent displays to provide virtual and real integrated information display services that meet the needs of various application scenarios is an important issue.

The present disclosure provides an information display method, a processing device thereof, and an information display system.

In an exemplary embodiment of the present disclosure, the above-mentioned information display system includes a plurality of light-transmissive displays, a plurality of sensory information acquisition devices and a processing device. These light-transmissive displays include a first light-transmissive display and a second light-transmissive display, and the first light-transmissive display is disposed adjacent to the second light-transmissive display. The sensing information acquisition device is used to acquire position information and posture information of at least one user and to acquire position information of at least one target object. The processing device is connected to the light-transmissive display and the perceptual information acquisition device, and is configured to: determine the number of users located in front of the first light-transmissive display and the second light-transmissible display; based on the number of users, at least one user's The position information and posture information and the position information of at least one target object are used to determine the display position information of at least one virtual object associated with at least one user, and the first light-transmissive display and the second light-transmissive display are controlled according to the display position information. At least one of them displays at least one virtual object corresponding to at least one target object.

In an exemplary embodiment of the present disclosure, the above information display method is applicable to an information display system including a plurality of light-transmissive displays, a plurality of sensory information acquisition devices and a processing device. The light-transmissive display includes a first light-transmissive display and a second light-transmissive display, and the first light-transmissive display is disposed adjacent to the second light-transmissive display. The method includes the following steps: using a perceptual information acquisition device to acquire position information and posture information of at least one user; using the perceptual information acquisition device to acquire position information of at least one target object; determining whether the first light-transmissive display is located and the number of users in front of the second light-transmissible display; determining the number of at least one virtual object associated with at least one user based on the number of users, position information and posture information of at least one user, and position information of at least one target object. Display position information, and control at least one of the first light-transmissive display and the second light-transmissible display to display at least one virtual object corresponding to at least one target object according to the displayed position information.

In an exemplary embodiment of the present disclosure, the above-mentioned processing device is connected to a plurality of light-transmissive displays and a plurality of sensory information acquisition devices. The processing device includes a memory and a processor connected to the memory. The memory is used to store data, and the processor is configured to perform the following steps: obtain the position information and posture information of at least one user from the sensing information acquisition device; obtain the position information of at least one target object from the sensing information acquisition device; Determine the number of users located in front of the first light-transmissible display and the second light-transmissible display; determine the number of users associated with at least one target based on the number of users, the position information and posture information of at least one user, and the position information of at least one target object. Display position information of at least one virtual object of the user, and control at least one of the first light-transmissive display and the second light-transmissible display to display at least one virtual object corresponding to the target object according to the display position information.

In order to make the present disclosure more obvious and understandable, embodiments are given below and described in detail with reference to the attached drawings.

Some exemplary embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. The component symbols cited in the following description will be regarded as the same or similar components when the same component symbols appear in different drawings. These exemplary embodiments are only part of the disclosure and do not disclose all possible implementations of the disclosure. Rather, these exemplary embodiments are only examples of methods, devices, and systems within the scope of the patent application of the present disclosure.

FIG. 1A is a block diagram of an information display system according to an exemplary embodiment of the present disclosure. First, Figure 1A first introduces the various components and configuration relationships in the system. Detailed functions will be disclosed together with the flow charts of subsequent exemplary embodiments.

Referring to FIG. 1A , the information display system 10 in this exemplary embodiment may include a plurality of light-transmissive displays 110_1, 110_2, 110_3,..., 110_N, a plurality of sensory information acquisition devices 120_1, 120_2, 120_3,..., 120_N, and Processing device 130. The processing device 130 may be wirelessly, wired or electrically connected to the light-transmissive displays 110_1˜110_N and the sensory information acquisition devices 120_1˜120_N.

The light-transmissive displays 110_1 to 110_N may be used to display information, which may be composed of a single or multiple display devices. The display device may be, for example, a liquid crystal display (LCD) or a field sequential color display. Transmissive light-transmissive displays such as liquid crystal displays, light emitting diode (LED) displays, electrowetting displays, or projection-type light-transmissive displays. It should be noted that these light-transmissive displays 110_1 to 110_N can be arranged adjacently in a coplanar or non-coplanar manner. In some embodiments, the light-transmissive displays 110_1 to 110_N can be configured as multiple window screens of a mobile vehicle (such as a cable car, a car, a tour bus, a ship or an airplane, etc.), so that the user can travel on the mobile vehicle. During the process of viewing external scene objects and virtual objects displayed by the light-transmissive displays 110_1˜110_N.

The sensing information acquisition devices 120_1˜120_N can be used to acquire the user's position information and posture information. The sensing information capturing devices 120_1˜120_N include sensing devices used to capture user information. In some embodiments, the perceptual information capturing devices 120_1 to 120_N may include at least one image sensor or at least one image sensor coupled with at least one depth sensor or electromagnetic sensing device to face the light-transmissive display. The user on the front side of 110_1~110_N captures image data to perform image recognition and positioning of the user. The aforementioned image sensor may be a visible light sensor or a non-visible light sensor such as an infrared sensor. In addition, the sensing information acquisition devices 120_1 to 120_N may also include optical positioners/electromagnetic sensing devices to perform optical/electromagnetic field spatial positioning on the user. In some embodiments, the perceptual information acquisition devices 120_1˜120_N can also identify the postures of the user's limbs, torso and/or head through various human posture recognition technologies. For example, the perceptual information acquisition devices 120_1 to 120_N can identify the human skeleton, human body feature points, etc. based on the image data, thereby identifying the user's posture. As long as it is a device or a combination thereof that can locate the user's location information and identify the user's posture information, it belongs to the category of perceptual information acquisition devices 120_1 to 120_N.

On the other hand, the sensing information acquisition devices 120_1˜120_N can be used to acquire position information of target objects in the physical scene. The sensing information acquisition devices 120_1˜120_N include sensing devices used to acquire target object information. In some embodiments, the perceptual information capturing devices 120_1 to 120_N may include at least one image sensor or at least one image sensor and at least one depth sensor to face the rear side of the displays 110_1 to 110_N (relative to The target object on the other side of the user captures image data to perform image recognition and positioning of the target object. The aforementioned image sensor may be a visible light sensor or a non-visible light sensor such as an infrared sensor. Or, the detection and positioning of space objects can be carried out by inducing changes in electric or magnetic fields. As long as it is a device or a combination thereof that can locate the location information of the target object, it belongs to the category of sensing information acquisition devices 120_1 to 120_N.

In the embodiment of the present disclosure, the above-mentioned image sensor may be used to capture images and may include a camera lens having a lens and a photosensitive element. The above-mentioned depth sensor can be used to detect depth information, which can be implemented using active depth sensing technology or passive depth sensing technology. Active depth sensing technology can calculate depth information by actively emitting light sources, infrared, ultrasound, laser, etc. as signals together with time-lag ranging technology. Passive depth sensing technology can use two image sensors to capture two images in front of them from different viewing angles to calculate depth information using the parallax of the two images.

In some embodiments, the sensing information capturing devices 120_1˜120_N may also include sensors for sensing scene information of the physical scene. For example, the sensory information acquisition devices 120_1 to 120_N may include a global positioning system (GPS) device, an electronic compass, an electromagnetic induction device or a gravity sensor, etc., to provide a mobile carrier with a light-transmissive display 110_1 to 110_N. The GPS information, orientation information, tilt information, etc. of the vehicle are provided to the processing device 130 .

In some embodiments, the sensing information capturing devices 120_1 to 120_N can transmit information to the processing device 130 through their respective communication interfaces in a wired or wireless manner. In some embodiments, the perceptual information acquisition devices 120_1 to 120_N have a processor and a memory, and have computing capabilities that can perform object recognition and object tracking based on image data.

The processing device 130 is used to control the operation of the information display system 10 . In some embodiments, the processing device 130 may be a combination of one or more computer devices, and the present disclosure is not limited thereto. When the processing device 130 is implemented as multiple computer devices, these computer devices can be connected and communicate with each other through multiple gateway devices. The aforementioned gateway devices support wireless transmission protocols or wired transmission protocols, and this disclosure is not limited thereto.

In some embodiments, the processing device 130 includes a memory 131 and a processor 132 . The memory 131 can be, for example, any type of fixed or removable random access memory (random access memory, RAM), read-only memory (read-only memory, ROM), flash memory (flash memory), Hard disk or other similar device, integrated circuit, or combination thereof. The processor 142 may be, for example, a central processing unit (CPU), an application processor (AP), or other programmable general-purpose or special-purpose microprocessor, digital signal processing digital signal processor (DSP), image signal processor (ISP), graphics processing unit (GPU) or other similar devices, integrated circuits or combinations thereof. In the following exemplary embodiments, the details of the process of the information display method performed by the processing device 130 will be explained in conjunction with each component of the information display system 10 .

FIG. 1B is a schematic diagram of an information display system according to an exemplary embodiment of the present disclosure. For convenience and clear explanation, FIG. 1B uses three light-transmissive displays 110_1 to 110_3 and three sensing information acquisition devices 120_1 to 120_3 as an example for illustration, but the present disclosure is not limited thereto. Please refer to FIG. 1B , the light-transmissive display 110_1 is arranged adjacent to the light-transmissive display 110_2, and the light-transmissive display 110_2 is arranged adjacent to the light-transmissive display 110_3. The user U1 and the target Obj1 are respectively located on the front side and the back side of the light-transmissive displays 110_1˜110_3.

In the example of FIG. 1B , based on the line of sight information and position information of the user U1, the user U1 can view the physical scene of the virtual object Vf1 superimposed with the target object Obj1 through the light-transmissive display 110_3. The virtual object Vf1 can be regarded as augmented reality content amplified based on the target object Obj1. That is to say, the processing device 130 can determine the display position information of the virtual object Vf1 on the light-transmissive display 110_3 based on the position information and posture information of the user U1 and the position information of the target Obj1. Thereby, the processing device 130 can control the light-transmissive display 110_3 to display the virtual object Vf1 corresponding to the target object Obj1 according to the display position information, so that the user U1 can see the virtual object located near the target object Obj1 through the light-transmissive display 110_3 Vf1.

However, FIG. 1B is only an exemplary illustration, and the number of users may not be limited to one. In some embodiments, the number of users may be more than 1, and the processing device 130 may determine the display mode of the virtual object according to the number of users. In addition, it should be noted that in some embodiments, the processing device 130 can use more than one light-transmissive display 110_1 to 110_3 to display virtual objects for one or more users to view, so as to realize a cross-screen display function.

FIG. 2 is a flowchart of an information display method according to an exemplary embodiment of the present disclosure. Please refer to FIG. 1A and FIG. 2 at the same time, and the method flow of FIG. 2 can be implemented by the information display system 10 of FIG. 1A.

In step S210, the processing device 130 uses the sensing information acquisition devices 120_1˜120_N to acquire the position information and posture information of at least one user. In step S220, the processing device 130 uses the sensing information acquisition devices 120_1˜120_N to acquire the position information of at least one target object. As mentioned above, the sensory information acquisition devices 120_1 to 120_N are, for example, image sensors, depth sensors or combinations thereof that can locate the location of at least one user and at least one target object.

In step S230, the processing device 130 determines the number of users located in front of the first light-transmissible display and the second light-transmissible display, wherein the first light-transmissive display and the second light-transmissible display are arranged adjacent to each other. Taking FIG. 1B as an example, the processing device 130 can respectively determine the number of users in front of the adjacent light-transmissive displays 110_1 and 110_2. Alternatively, the processing device 130 may respectively determine the number of users in front of the adjacent light-transmissive displays 110_2 and 110_3. Alternatively, the processing device 130 can respectively determine the number of users in front of the adjacent light-transmissive displays 110_1 to 110_3. The processing device 130 can respectively determine the number of users in front of each of the light-transmissive displays 110_1 to 110_3 by sensing the image data captured by the information capturing devices 120_1 to 120_3. Based on the number of users in front of adjacent light-transmissive displays, the processing device 130 may determine whether it is a single-person viewing situation or a multi-person viewing situation.

In step S240, the processing device 130 determines display location information of at least one virtual object associated with at least one user based on the number of users, location information and posture information of at least one user, and location information of at least one target object. Specifically, in some embodiments, the processing device 130 can determine the permissions of each user to view virtual objects through each light-transmissive display based on the number of users in front of multiple adjacent light-transmissive displays, so as to further Virtual objects should be displayed on a suitable light-transmissive display.

In some embodiments, when the number of users in front of multiple adjacent light-transmissive displays is equal to 1, a single user may have permission to view virtual objects through multiple light-transmissive displays. In some embodiments, when the number of users in front of multiple adjacent light-transmissive displays is greater than 1, the processing device 130 may decide that these users share multiple light-transmissive displays, so that multiple users can simultaneously have access to multiple devices via multiple light-transmissive displays. The platform can view virtual objects on a light-transmissive display. Alternatively, in some embodiments, when the number of users in front of multiple adjacent light-transmissive displays is greater than 1, the processing device 130 may decide that these users do not share the multiple light-transmissive displays, so that each user can only have Permission to view the virtual object through the nearest light-transmissive display.

In some embodiments, when a user has the authority to view virtual objects through multiple light-transmissive displays, the processing device 130 can splice the user images captured by part of the sensory information capturing devices 120_1˜120_N. . The processing device 130 can locate the user based on the above-mentioned spliced image, and perform coordinate conversion based on the user's position information and posture information as well as the position information of the target object, so as to calculate the virtual object of the target object viewed by the user. Display location information on one or more light-transmissible displays. In some embodiments, the processing device 130 can obtain the display position information according to the size and resolution of the light-transmissive displays 110_1˜110_N, and the display position information includes pixel coordinates under the pixel coordinate system of the displays 110_1˜110_N.

In step S250, the processing device 130 controls at least one of the first light-transmissive display and the second light-transmissive display to display at least one virtual object corresponding to at least one target object according to the display position information. In some embodiments, the processing device 130 can display a single virtual object through the first light-transmissive display and the second light-transmissive display at the same time, or the processing device 130 can successively display the first light-transmissive display and the second light-transmissive display. Light display to display a single virtual object. In each of the above situations, the display position information of the virtual object may include display position information corresponding to the first light-transmissive display and display position information corresponding to the second light-transmissive display.

The following will enumerate embodiments with the information display system 10 to illustrate the implementation of the present disclosure in different application scenarios.

3A and 3B are flowcharts of an information display method according to an exemplary embodiment of the present disclosure. 3C and 3D are schematic diagrams of an application scenario of an information display system according to an exemplary embodiment of the present disclosure. Please refer to Figure 3A, Figure 3B, Figure 3C and Figure 3D at the same time. For convenience and clear explanation, the embodiments of FIGS. 3A to 3D will be described using three light-transmissive displays 110_1 to 110_3 and three sensory information acquisition devices 120_1 to 120_3 as examples, but the present disclosure is not limited thereto.

The sensing information acquisition device 120_2 can acquire the position information and posture information of the user U1 (step S302), and transmit the position information and posture information of the user U1 to the processing device 130. One or more of the sensing information acquisition devices 120_1 to 120_3 may acquire the position information of the target object Obj1 (step S304), and transmit the position information of the target object Obj1 to the processing device 130.

The processing device 130 determines whether the number of users in front of the adjacent light-transmissive display 110_2 (ie, the first light-transmissive display) and the adjacent light-transmissive display 110_3 (ie, the second light-transmissive display) is equal to 1 (step S306). When the number of users is equal to 1, the processing device 130 determines that at least one user U1 is associated with the light-transmissive display 110_2 and the light-transmissive display 110_3 based on the posture information of the at least one user U1 (step S308). Specifically, if the determination in step S306 is yes, it means that the user U1 has the authority to use multiple light-transmissive displays. Therefore, the processing device 130 can determine the viewing field of view or line of sight information of at least one user U1 based on the posture information of at least one user U1, so as to select at least one user U1 who is more likely to be currently based on the viewing field of view or line of sight information of at least one user U1. The light-transmissive display 110_2 and the light-transmissive display 110_3 are viewed. In addition, when the number of users is greater than 1, in this embodiment, the processing device 130 can determine that each user uses one of the plurality of light-transmissive displays 110_1 to 120_3 (step S316), that is, each user only has the ability to use Permissions for a single light-transmissive display.

Next, the processing device 130 determines at least one virtual object Vf1 to be displayed on a spliced display plane of the light-transmissive display 110_2 and the light-transmissive display 110_3 based on the position information and posture information of at least one user U1 and the position information of at least one target Obj1 fused location information on (step S310). More specifically, when the number of users is equal to 1, the processing device 130 can splice multiple user images captured by the perceptual data acquisition device 110_2 and the perceptual data acquisition device 110_3 (step S3101). Next, the processing device 130 can calculate the user coordinates of the user U1 based on the stitched image (step S3102). In addition, when the number of users is greater than 1, the processing device 130 can separately calculate the user coordinates of each user based on the user images captured by the sensory data acquisition devices 110_1 to 110_3 (step S3106). Taking FIG. 3C as an example, the user coordinates of user U2 are generated based on the user image captured by the perceptual data acquisition device 110_1.

On the other hand, the processing device 130 may calculate the relative orientation of the target Obj1 relative to the sensing information acquisition device 120_3 (step S3103). In some embodiments, based on the target object image captured by the sensory information acquisition device 120_3 and the GPS position information of the target Obj1, the processing device 130 can identify the relative orientation of the target Obj1 relative to the sensory information acquisition device 120_3. For example, the target Obj1 may be a mobile vehicle equipped with an automatic identification system (Automatic Identification System, AIS), such as a ship equipped with an AIS. The automatic identification system of the target Obj1 can provide the GPS position information, vehicle identification code or other information of the target Obj1 to other mobile vehicles that are also equipped with AIS, that is, mobile vehicles equipped with the information display system 100, so as to process The device 130 can obtain the GPS location information of the target Obj1. Alternatively, the target Obj1 may be a building on land. The processing device 130 can obtain the GPS location information of the target Obj1 according to the map information. Therefore, based on the GPS location information of the location of the information display system 100 and the target Obj1, the processing device 130 can calculate the distance and relative direction between the location of the information display system 100 and the target Obj1 to identify the relative direction of the target Obj1. The relative position of the sensing information acquisition device 120_3. Alternatively, in some embodiments, the processing device 130 can perform object recognition based on the target object image captured by the sensory information acquisition device 120_3, based on the preset size corresponding to the object recognition result and the pixels of the target object Obj1 on the target image. The data is used to estimate the distance and relative orientation between the target Obj1 and the sensing information acquisition device 120_3.

Next, the processing device 130 may calculate the target coordinates of the target Obj1 according to the relative orientation of the target Obj1 (step S3104). The processing device 130 can establish a connection between the user coordinates and the target object coordinates based on the line of sight information, so as to intersect the connection between the user coordinates and the target object coordinates to splice the light-transmissive display 110_2 and the light-transmissive display 110_3 Display the intersection position of the plane to obtain the fusion position information (step S3105).

Then, the processing device 130 can determine at least one virtual object Vf1 to be placed on at least one of the light-transmissive display 110_2 and the light-transmissive display 110_3 based on the display range of the light-transmissive display 110_2, the display range of the light-transmissive display 110_3, and the fusion position information. Display location information on the user (step S312). In more detail, based on the display range of the light-transmissive display 110_2, the display range of the light-transmissive display 110_3, and the fusion position information generated based on the calculation of the spliced display plane, the processing device 130 can determine where the virtual object Vf1 should be displayed. Part of the virtual objects can be displayed simultaneously on one light-transmissive display or on two displays.

Therefore, the processing device 130 determines whether at least one virtual object Vf1 is simultaneously located in the display range of the light-transmissive display 110_2 and the light-transmissive display according to the display range of the light-transmissive display 110_2, the display range of the light-transmissive display 110_3, and the fusion position information. within the display range of 110_3 (step S3121).

If the determination in step S3121 is negative, in the example of FIG. 3C , in response to at least one virtual object Vf1 being located within the display range of the light-transmissive display 110_3 , the processing device 130 will calculate the position of the virtual object on the light-transmissive display 110_3 based on the fused position information. Display position information on the display (step S3122) to obtain the pixel coordinates of the virtual object Vf1 on the light-transmissive display 110_3.

On the other hand, if step S3121 determines yes, in the example of FIG. 3D , in response to at least one virtual object Vf1 being simultaneously located within the display range of the light-transmissive display 110_2 and the display range of the light-transmissive display 110_3 , the processing device 130 Cut at least one virtual object Vf1 into a first sub-virtual object Vf1_1 corresponding to the light-transmissive display 110_2 and a second sub-virtual object Vf1_2 corresponding to the light-transmissive display 110_3 (step S3123). That is to say, when the virtual object is located at the splicing junction of the light-transmissive display 110_2 and the light-transmissive display 110_3, the processing device 130 can control the light-transmissive display 110_2 and the light-transmissive display 110_3 to respectively display a part of the virtual object Vf1. Then, the first display position information of the first sub-virtual object Vf1_1 on the light-transmissive display 110_2 is calculated based on the fused position information, and the second display position information of the second sub-virtual object Vf1_2 on the light-transmissive display 110_3 is calculated based on the fused position information. Location information (step S3124). That is to say, the processing device 130 can convert the spatial position coordinates of the first sub-virtual object Vf1_1 on the splicing display plane into pixel coordinates on the light-transmissive display 110_2, and convert the second sub-virtual object Vf1_2 on the splicing display plane. The spatial position coordinates are converted into pixel coordinates on the light-transmissive display 110_3.

Afterwards, the processing device 130 may control at least one of the light-transmissive display 110_2 and the light-transmissive display 110_3 to display at least one virtual object Vf1 corresponding to at least one target object Obj1 according to the display position information (step S314). As shown in FIG. 3C , the light-transmissive display 110_3 will display the virtual object Vf1 corresponding to the target object Obj1 for the user U1. As shown in FIG. 3D , the light-transmissive display 110_2 and the light-transmissive display 110_3 will respectively display a part of the virtual object Vf1 corresponding to the target object Obj1 for the user U1.

It should be noted that when the same character in a virtual object is cut and displayed on different light-transmissive displays, it is easy to cause reading difficulties due to character damage. Therefore, in some embodiments, when processing the cutting process of the virtual object, the processing device 130 can further adjust the display position of the virtual object to ensure that the sub-virtual object obtained after cutting does not have incomplete characters.

For example, FIG. 4 is a schematic diagram of translating a virtual object according to an exemplary embodiment of the present disclosure. Referring to FIG. 4 , in some embodiments, the virtual object Vf2 may include multiple characters. After obtaining the fusion position information of the virtual object Vf2 on the splicing display plane PL1, the processing device 130 can determine whether the character C1 of at least one virtual object Vf2 is located in the display range Z1 of the first light-transmissive display and the second light-transmissive display at the same time. Within the display range Z2 of the monitor. In response to the fact that the character C1 of at least one virtual object Vf2 is simultaneously located within the display range Z1 of the first light-transmissive display and the display range Z2 of the second light-transmissive display, the processing device 130 calculates a translation amount Δd1 based on the character C1, And translate at least one virtual object Vf2 according to the translation amount Δd1. As shown in Figure 4, the virtual object Vf2 can be translated to the left by Δd1. Therefore, the processing device 130 can cut the translated at least one virtual object Vf2 along the display boundary L1 into a first sub-virtual object Vf2_1 corresponding to the first light-transmissive display and a second sub-virtual object Vf2_1 corresponding to the second light-transmissive display. Virtual object Vf2_2. In this way, the character C1 can be completely displayed by the first light-transmissive display without being damaged.

5A and 5B are flowcharts of an information display method according to an exemplary embodiment of the present disclosure. FIG. 5C is a schematic diagram of an application scenario of an information display system according to an exemplary embodiment of the present disclosure. Please refer to Figure 5A, Figure 5B and Figure 5C at the same time. For convenience and clear explanation, the embodiments of FIGS. 5A to 5C will be described using three light-transmissive displays 110_1 to 110_3 and three sensing information acquisition devices 120_1 to 120_3 as an example, but the present disclosure is not limited thereto.

The perceptual information acquisition device 120_1 and the perceptual information acquisition device 120_2 respectively acquire the position information and attitude information of the user U3 and the user U4 (step S502), and transmit the position information and attitude information of the user U3 and the user U4. to the processing device 130. One or more of the sensing information acquisition devices 120_1 to 120_3 may acquire the position information of the target object Obj2 (step S504), and transmit the position information of the target object Obj2 to the processing device 130.

The processing device 130 determines whether the number of users in front of the adjacent light-transmissive display 110_1 (ie, the first light-transmissive display) and the adjacent light-transmissive display 110_2 (ie, the second light-transmissive display) is equal to 1 (step S506). Although not shown in FIG. 5C , based on the foregoing embodiments, it can be seen that when the number of users in front of the light-transmissive display 110_1 and the light-transmissive display 110_2 is equal to 1, the processing device 130 determines the user's location based on the user's posture information. Associated with the light-transmissive display 110_1 and the light-transmissive display 110_2 (step S508).

When the number of users in front of the light-transmissive display 110_1 and the light-transmissive display 110_2 is greater than 1, in the implementation example of FIG. 5C , the processing device 130 can determine the association of each user U3 and U4 based on the posture information of the multiple users U3 and U4. In the light-transmissive display 110_1 and the light-transmissive display 110_2 (step S516). That is, multiple users U3 and U4 can share the light-transmissive display 110_1 and the light-transmissive display 110_2. Specifically, when the number of users in front of the light-transmissive display 110_1 and the light-transmissive display 110_2 is greater than 1, the processing device 130 may decide to associate the user U3 (ie, the first user) with the light-transmissive display 110_1 and the light-transmissive display 110_2. light display 110_2, and determines to associate the user U4 (ie, the second user) with the light-transmissive display 110_1 and the light-transmissive display 110_2.

Next, the processing device 130 determines a splicing of at least one virtual object Vf5 on the light-transmissive display 110_1 and the light-transmissive display 110_2 based on the position information and posture information of at least one user U3, U4 and the position information of at least one target Obj2. Display the fused position information on the plane (step S510).

In detail, the detailed operations of steps S5101 to S5105 can be referred to the foregoing embodiments, and will not be described again here. It should be noted that when multiple users U3 and U4 share adjacent light-transmissive displays 110_1 and 120_2, the processing device 130 will splice the images captured by the perceptual information acquisition device 120_1 and the perceptual information acquisition device 120_2 respectively. Multiple user images (step S5106). Next, the processing device 130 will calculate the line of sight information of the users U3 and U4 based on the stitched image (step S5107). The processing device 130 determines whether the sight information of users U3 and U4 intersects on a common light-transmissive display (step S5108).

In response to the line of sight information of user U3 and the line of sight information of user U4 intersecting on the common light-transmissive display (that is, the light-transmissive display 110_1), the processing device 130 determines at least one virtual object Vf5 on the common light-transmissive display based on the spliced image. Display location information on. The stitched image includes a first user image with user U3 and a second user image with user U4. In more detail, if the determination in step S5108 is yes, the processing device 130 will calculate the user coordinates of the users U3 and U4 based on the stitched image (step S5102). In addition, if the determination in step S5108 is negative, the processing device 130 will respectively calculate the user coordinates of the users U3 and U4 based on the unstitched user images (step S5109). Finally, the processing device 130 may determine the fusion position information of at least one virtual object Vf5 on the spliced display plane (step S5105).

Then, the processing device 130 can determine at least one virtual object Vf5 to be placed on at least one of the light-transmissive display 110_1 and the light-transmissive display 110_2 according to the display range of the light-transmissive display 110_1, the display range of the light-transmissive display 110_2 and the fusion position information. Display location information on the user (step S512). Afterwards, the processing device 130 controls at least one of the light-transmissive display 110_1 and the light-transmissive display 110_2 to display at least one virtual object Vf5 corresponding to at least one target object Obj2 according to the display position information (step S514).

As shown in FIG. 5C , when it is determined that users U3 and U4 are viewing the same target Obj2, the processing device 130 may display the virtual object Vf5 associated with the users U3 and U4 and corresponding to the target Obj2 on the light-transmissive display 110_1. In addition, the processing device 130 can mark the information indication lines G1 and G2 respectively corresponding to the users U3 and U4 according to the sight points P1 and P2 of the users U3 and U4 respectively. The information indication line G2 will span the light-transmissive display 110_1 and the light-transmissive display 110_2. However, in other embodiments, the processing device 130 may also display two virtual objects corresponding to the target Obj2 on the light-transmissive display 110_1 and the light-transmissive display 110_2 respectively.

In some embodiments, the processing device 130 can track the user's movement status. Since the processing device 130 can continuously update the display position information of the virtual object based on the user's tracking results, the virtual object can move correspondingly in response to the user's movement, so as to achieve the visual effect of the virtual object following the movement of the user. For example, when the user moves from in front of the first light-transmissive display to the second light-transmissible display, the same virtual object corresponding to the same target object can also move from the first light-transmissive display to the second light-transmissible display. superior. An example will be listed below for illustration.

FIG. 6A is a flowchart of an information display method according to an exemplary embodiment of the present disclosure. FIG. 6B is a schematic diagram of an application scenario of an information display system according to an exemplary embodiment of the present disclosure. For convenience and clear explanation, the embodiments of FIG. 6 and FIG. 6B will be described using three light-transmissive displays 110_1 to 110_3 and three sensing information acquisition devices 120_1 to 120_3 as an example, but the present disclosure is not limited thereto.

It should be noted that in the example of FIG. 6B , the user U6 will move from the front of the light-transmissive display 110_1 to the front of the light-transmissive display 110_2.

Please refer to Figure 6A and Figure 6B at the same time. The sensing information acquisition device 120_1 can acquire the position information and posture information of the user U6 (step S602), and transmit the position information and posture information of the user U6 to the processing device 130. One or more of the sensing information acquisition devices 120_1 to 120_3 may acquire the position information of the target object Obj3 (step S604), and transmit the position information of the target object Obj3 to the processing device 130. The processing device 130 determines the number of users located in front of the light-transmissive display 110_1 and the light-transmissive display 110_2 (step S606). The processing device 130 determines the display position information of at least one virtual object Vf6 associated with at least one user U6 based on the number of users, the position information and posture information of at least one user U6, and the position information of at least one target Obj3 (step S608 ). For detailed implementation of steps S602 to S608, reference may be made to the foregoing embodiments and will not be described again here. It should be noted that in the example of FIG. 6B , the processing device 130 may first control the light-transmissive display 110_1 to display at least one virtual object Vf6 corresponding to at least one target Obj3 based on the display position information of the virtual object Vf6 (step S610) .

Afterwards, the processing device 130 will locate and track the user U6 based on the user image captured by the sensing information capturing device 120_1 (step S612). Furthermore, the user U6 can be assigned a specific user ID by the processing device 130 to facilitate tracking of the user. During the movement of user U6, the processing device 130 can calculate the visual field change of user U6 based on the position information and posture information of user U6 (step S614), and the processing device 130 will determine at least one target object based on the visual line deviation. Whether Obj3 falls within the field of view of the user U6 viewing the light-transmissive display 110_1 (step S616). In other words, the processing device 130 will determine whether the user U6 can still see the target Obj3 through the light-transmissive display 110_1 according to the change in the visual field of the user U6.

If the determination in step S616 is yes, the processing device 130 will update the display position information of the virtual object on the light-transmissive display 110_1 based on the current position information and posture information of the user U6 and the position information of the target Obj3 (step S620). Otherwise, if the determination in step S616 is negative, in response to the fact that at least one target Obj3 does not fall within the field of view of the user U6 viewing the light-transmissive display 110_1, the processing device 130 determines the position information and posture information of the user U6 and the at least one target. The position information of the object Obj3 determines the display position information of the virtual object Vf6 on the light-transmissive display 110_2 (step S618). Afterwards, the processing device 130 may control the light-transmissive display 110_1 or the light-transmissive display 110_2 to display at least one virtual object corresponding to at least one target object according to the display position information (step S622).

As shown in FIG. 6B , the user U6 will move from the front of the light-transmissive display 110_1 to the front of the light-transmissive display 110_2. When the user U6 gradually moves away from the light-transmissive display 110_1, the user U6 will not be able to see the target Obj3 through the light-transmissive display 110_1. Therefore, the virtual object Vf6 of the target Obj3 can be switched to be displayed by the light-transmissive display 110_2. Thereby, the virtual object of the target Obj3 can move correspondingly as the user moves, so as to achieve the visual effect of the virtual object following the movement of the user.

It should be noted that in some situations, there may be another user U7 who originally viewed the target Obj3 through the light-transmissive display 110_2. Therefore, in some embodiments, in response to the fact that at least one target Obj3 does not fall within the field of view of the user U6 viewing the light-transmissive display 110_1, the processing device 130 can be based on the position information and posture information of the user U6, the user U7 The position information and attitude information and the position information of the target object Obj3 determine the display position information of the virtual object Vf6 on the light-transmissive display 110_2. That is, when the virtual object of the target Obj3 is switched to the light-transmissive display 110_2 for display, the processing device 130 can consider the position information and posture information of the user U6 and the user U7 to determine whether the virtual object Vf6 is transparent. The display position on the light display 110_2.

In addition, the plurality of light-transmissive displays in the aforementioned embodiments are arranged coplanarly. However, in some embodiments, these light-transmissive displays may be arranged non-coplanarly. For example, when the first light-transmitting display and the second light-transmitting display are viewing windows facing different directions on the cable car, the display plane of the first light-transmitting display and the display plane of the second light-transmitting display There can be an included angle between them. Examples will be listed below to illustrate the implementation of this application scenario.

7A and 7B are flowcharts of an information display method according to an exemplary embodiment of the present disclosure. FIG. 7C is a schematic diagram of an application scenario of the information display system according to an exemplary embodiment of the present disclosure. Please refer to Figure 7A, Figure 7B and Figure 7C at the same time.

As shown in FIG. 7C , there may be an included angle between the display plane of the light-transmissive display 110_1 and the display plane of the light-transmissive display 110_2. The sensing information acquisition devices 110_1 and 110_2 can acquire the position information and attitude information of the user U8 (step S702), and transmit the position information and attitude information of the user U8 to the processing device 130. One or more of the sensing information acquisition devices 120_1 to 120_3 may acquire the position information of the target object (step S704), and transmit the position information of the target object to the processing device 130.

The processing device 130 determines whether the number of users in front of the adjacent light-transmissive display 110_1 (ie, the first light-transmissive display) and the adjacent light-transmissive display 110_2 (ie, the second light-transmissive display) is equal to 1 (step S706). When the number of users is equal to 1, the processing device 130 determines that at least one user U8 is associated with the light-transmissive display 110_1 and the light-transmissive display 110_2 based on the posture information of the at least one user U8 (step S708). In addition, when the number of users is greater than 1, in this embodiment, the processing device 130 can determine that each user uses one of the plurality of light-transmissive displays 110_1 to 110_3 (step S716), that is, each user only has the ability to use Permissions for a single light-transmissive display.

Next, the processing device 130 determines the display position information of at least one virtual object associated with at least one user U8 based on the position information and posture information of a user U8 and the position information of the target object (step S710). More specifically, when the number of users is greater than 1, the processing device 130 can calculate the user coordinates of each user based on the user images captured by the sensory data acquisition devices 110_1 to 110_3 (step S7107).

In addition, when the number of users is equal to 1, the processing device 130 can identify the head rotation of the user U8 (step S7101), and the processing device 130 can select the light-transmissive display 110_1 according to the head rotation of the user U8 and use or image (step S7102). Specifically, although the user U8 has the authority to view virtual objects through the light-transmissive display 110_1 and the light-transmissive display 110_2, the processing device 130 may decide to use the light-transmissive display 110_1 to display the virtual object according to the head rotation of the user U8. The object is viewed by user U8. In addition, the processing device 130 may select the user image captured by the sensory information capturing device 120_1 to calculate the user coordinates (step S7106). In other embodiments, the processing device 130 can further identify the line of sight direction of the user U8 to select the light-transmissive display 110_1 and the user image according to the line of sight direction of the user U8.

On the other hand, the processing device 130 may calculate the relative orientation of the target object (step S7103). Next, the processing device 130 may calculate the target coordinates of the target according to the relative orientation of the target (step S7104). Then, the processing device 130 can obtain the fused position information according to the user coordinates and the target object coordinates (step S7105). Then, the processing device 130 can determine at least one virtual object to be placed in at least one of the light-transmissive display 110_1 and the light-transmissive display 110_2 according to the display range of the light-transmissive display 110_1, the display range of the light-transmissive display 110_2, and the fusion position information. Display location information on (step S712). Afterwards, the processing device 130 controls at least one of the light-transmissive display 110_1 and the light-transmissive display 110_2 to display at least one virtual object corresponding to at least one target object according to the display position information (step S714).

The information display method, its processing device, and the information display system proposed in the exemplary embodiments of the present disclosure can determine whether it is a single-person viewing situation or a multi-person viewing situation based on the number of users in front of adjacent light-transmissive displays. When operating in a single-person viewing situation, the multi-screen display function can be provided through multiple light-transmissive displays. When operating in a multi-person viewing situation, multiple light-transmissive displays can be used to provide cross-screen display functions according to different application situations. The disclosed embodiment can calculate the display position information of virtual objects in real time based on the user's position and the target object's position. In this way, virtual objects can be displayed across monitors in real time following the target object or the user, thereby enhancing the user's viewing experience. In addition, the embodiments of the present disclosure can prevent characters in virtual objects from being damaged and displayed on different light-transmissive displays, thereby improving the viewing comfort of virtual objects.

Although the disclosure has been disclosed above in the form of exemplary embodiments, this is not intended to limit the disclosure. Anyone with ordinary knowledge in the relevant technical field may make slight changes and modifications without departing from the spirit and scope of the disclosure. Therefore, the protection scope of this disclosure shall be determined by the appended patent application scope and its equivalent scope.

100:Information display system 110_1～110_N: Translucent display 120_1～120_N: Perceptual information acquisition device 130: Processing device 131:Memory 132: Processor Vf1, Vf2, Vf5, Vf6: virtual objects Vf1_1, Vf1_2, Vf2_1, Vf2_2: child virtual objects U1, U2, U3, U4, U6, U7, U8: User Obj1, Obj2, Obj3: target object C1:Character Z1, Z2: display range PL1: splicing display plane P1, P2: sight point G1, G2: Information indicator line S210～S250, S302～S316, S3101～S3106, S3121～S3124, S502～S516, S5101～S5109, S602～S622, S702～S716, S7101～S7107: Steps

FIG. 1A is a block diagram of an information display system according to an exemplary embodiment of the present disclosure. FIG. 1B is a schematic diagram of an information display system according to an exemplary embodiment of the present disclosure. FIG. 2 is a flowchart of an information display method according to an exemplary embodiment of the present disclosure. 3A and 3B are flowcharts of an information display method according to an exemplary embodiment of the present disclosure. 3C and 3D are schematic diagrams of an application scenario of an information display system according to an exemplary embodiment of the present disclosure. FIG. 4 is a schematic diagram of translating a virtual object according to an exemplary embodiment of the present disclosure. 5A and 5B are flowcharts of an information display method according to an exemplary embodiment of the present disclosure. FIG. 5C is a schematic diagram of an application scenario of an information display system according to an exemplary embodiment of the present disclosure. FIG. 6A is a flowchart of an information display method according to an exemplary embodiment of the present disclosure. FIG. 6B is a schematic diagram of an application scenario of an information display system according to an exemplary embodiment of the present disclosure. 7A and 7B are flowcharts of an information display method according to an exemplary embodiment of the present disclosure. FIG. 7C is a schematic diagram of an application scenario of the information display system according to an exemplary embodiment of the present disclosure.

S210~S250: steps

Claims (17)

An information display system, including: a plurality of light-transmissive displays, wherein the light-transmissive displays include a first light-transmissive display and a second light-transmissive display, and the first light-transmissive displays are arranged adjacent to each other. In the second light-transmissive display; a plurality of sensing information acquisition devices are used to acquire position information and attitude information of at least one user and position information of at least one target object; a processing device is connected to The light-transmissible display and the sensory information acquisition device are configured to: determine that the number of users located in front of the first light-transmissive display and the second light-transmissive display is equal to 1 or greater than 1; according to The number of users, the position information and posture information of the at least one user, and the position information of the at least one target determine the display position information of at least one virtual object associated with the at least one user; and based on The display position information controls at least one of the first light-transmissive display and the second light-transmissible display to display the at least one virtual object corresponding to the at least one target object. The information display system of claim 1, wherein the processing device is configured to: when the number of users is equal to 1, determine whether the at least one user is associated with the at least one user based on the posture information of the at least one user. a first light-transmissive display and the second light-transmissible display; Determine the position of the at least one virtual object on the first light-transmissive display and the second light-transmissive display based on the position information and posture information of the at least one user and the position information of the at least one target object. Fusion position information on a spliced display plane; and determining where the at least one virtual object is based on the display range of the first light-transmissive display, the display range of the second light-transmissive display, and the fusion position information. Display position information on at least one of the first light-transmissive display and the second light-transmissive display. The information display system of claim 2, wherein the processing device is configured to: based on the display range of the first light-transmissive display, the display range of the second light-transmissive display and the fused position information , determine whether the at least one virtual object is located within the display range of the first light-transmissive display and the display range of the second light-transmissive display at the same time; in response to the at least one virtual object being located at the third light-transmissive display at the same time Within the display range of a light-transmissive display and the display range of the second light-transmissive display, the at least one virtual object is cut into a first sub-virtual object corresponding to the first light-transmissive display and a corresponding a second sub-virtual object on the second light-transmissive display; and calculating the first display position information of the first sub-virtual object on the first light-transmissive display based on the fused position information, and based on The fused position information calculates the second display position information of the second sub-virtual object on the second light-transmissive display. The information display system of claim 3, wherein the processing device is configured to: determine whether a character of the at least one virtual object is located in the display range of the first light-transmissive display and the second light-transmissive display at the same time. Within the display range of the light-transmissive display; the characters reflected in the at least one virtual object are simultaneously within the display range of the first light-transmissive display and the display range of the second light-transmissive display, based on The characters calculate a translation amount, and translate the at least one virtual object according to the translation amount; and cut the translated at least one virtual object into a first sub-section corresponding to the first light-transmissive display. A virtual object and a second sub-virtual object corresponding to the second light-transmissive display. The information display system of claim 1, wherein the processing device is configured to: when the number of users is greater than 1, and the at least one user includes a first user and a second user, decide to The first user is associated with the first light-transmissible display and the second light-transmissible display, and decides to associate the second user with the first light-transmissible display and the second light-transmissible display. a light-transmissive display; and reflecting that the sight information of the first user and the sight information of the second user intersect in a common light-transmissive display, the at least one virtual object is determined based on a spliced image. Display location information on a common light-transmissive display, where The stitched image includes a first user image with the first user and a second user image with the second user. The information display system of claim 1, wherein the at least one user includes a first user, and the processing device is configured to: respond to movement of the first user, calculate the field of view of the first user Change; determine whether the at least one target object falls within the field of view of the first user viewing the first light-transmissive display according to the change in the field of view; and react when the at least one target object does not fall within the field of view of the first user. Within the field of view of the first user viewing the first light-transmissive display, the position of the at least one virtual object is determined based on the position information and posture information of the first user and the position information of the at least one target object. Display position information on the second light-transmissible display. The information display system of claim 6, wherein the at least one user further includes a second user, and the processing device is configured to: react when the at least one target object does not fall within the first user's view The field of view of the first light-transmissive display is determined based on the position information and attitude information of the first user, the position information and attitude information of the second user, and the position information of the at least one target object. Display position information of the at least one virtual object on the second light-transmissive display. The information display system of claim 1, wherein there is an included angle between the display plane of the first light-transmissive display and the display plane of the second light-transmissive display, and the processing device is configured to: When the number of users is equal to 1, the at least one user is determined to be associated with the first light-transmissive display and the second light-transmissive display based on the posture information of the at least one user; A user's head turns to select the first light-transmissive display; and based on the position information and posture information of the at least one user, and the position information of the at least one target object, determine the location information associated with the at least one target object. Display position information of at least one virtual object of the user on the first light-transmissible display. An information display method, suitable for an information display system having multiple light-transmissive displays, multiple sensing information acquisition devices and processing devices, wherein the light-transmissive display includes a first light-transmissive display and a second light-transmissible display A light-transmitting display, and the first light-transmitting display is disposed adjacent to the second light-transmitting display, and the method includes: using the sensing information acquisition device to acquire position information of at least one user and Posture information; using the sensing information acquisition device to acquire position information of at least one target object; determining that the number of users located in front of the first light-transmissive display and the second light-transmissive display is equal to 1 or greater than 1 ; Determine the display position information of at least one virtual object associated with the at least one user based on the number of users, the position information and posture information of the at least one user, and the position information of the at least one target object ; and controlling the first light-transmissive display and the third light-transmitting display according to the display position information. At least one of the two light-transmissive displays displays the at least one virtual object corresponding to the at least one target object. The information display method according to claim 9, wherein the method associated with the at least one user is determined based on the number of users, the location information and posture information of the at least one user, and the location information of the at least one target. The step of displaying position information of at least one virtual object of users includes: when the number of users is equal to 1, determining that the at least one user is associated with the first light-transmissive display based on the posture information of the at least one user. and the second light-transmissive display; determining the position of the at least one virtual object on the first light-transmissive display based on the position information and posture information of the at least one user and the position information of the at least one target object. Fusion position information on a spliced display plane with the second light-transmissive display; and according to the display range of the first light-transmissive display, the display range of the second light-transmissive display, and the fusion The position information determines the display position information of the at least one virtual object on at least one of the first light-transmissive display and the second light-transmissive display. The information display method according to claim 10, wherein the at least one virtual object is determined based on the display range of the first light-transmissive display, the display range of the second light-transmissive display and the fusion position information. The step of displaying position information on at least one of the first light-transmissible display and the second light-transmissible display includes: According to the display range of the first light-transmissive display, the display range of the second light-transmissive display and the fusion position information, it is determined whether the at least one virtual object is located on the first light-transmissive display at the same time. Within the display range and the display range of the second light-transmissive display; in response to the fact that the at least one virtual object is simultaneously located in the display range of the first light-transmissive display and the display range of the second light-transmissive display Within, cutting the at least one virtual object into a first sub-virtual object corresponding to the first light-transmissive display and a second sub-virtual object corresponding to the second light-transmissive display; and based on the Fusion of position information calculates the first display position information of the first sub-virtual object on the first light-transmissive display, and calculates the position information of the second sub-virtual object on the second translucent display based on the fused position information. Secondary display of location information on the optical display. The information display method according to claim 11, wherein in response to the at least one virtual object being located within the display range of the first light-transmissive display and the display range of the second light-transmissive display, the The step of cutting the at least one virtual object into the first sub-virtual object corresponding to the first light-transmissive display and the second sub-virtual object corresponding to the second light-transmissive display includes: determining the Whether a character of the at least one virtual object is located within the display range of the first light-transmissive display and the display range of the second light-transmissive display at the same time; in response to the character of the at least one virtual object being at the same time Located on the first light-transmissible Within the display range of the display and the display range of the second light-transmissive display, calculate a translation amount based on the character, and translate the at least one virtual object according to the translation amount; and transfer the translated At least one virtual object is cut into a first sub-virtual object corresponding to the first light-transmissive display and a second sub-virtual object corresponding to the second light-transmissive display. The information display method according to claim 9, wherein the method associated with the at least one user is determined based on the number of users, the location information and posture information of the at least one user, and the location information of the at least one target. The step of displaying location information of at least one virtual object of a user includes: when the number of users is greater than 1, where the at least one user includes a first user and a second user, deciding to associate the first user on the first light-transmissible display and the second light-transmissible display, and deciding to associate the second user with the first light-transmissible display and the second light-transmissible display; and react When the line of sight information of the first user and the line of sight information of the second user intersect on a common light-transmissive display, the at least one virtual object is determined on the common light-transmissive display based on a spliced image. Display location information, wherein the spliced image includes a first user image with the first user and a second user image with the second user. The information display method of claim 9, wherein the at least one user includes a first user, and the method further includes: In response to the movement of the first user, calculate the change of the first user's field of view; determine whether the at least one target object falls on the first light-transmissible object when the first user views it according to the change of the field of view. Within the field of view of the display; and in response to the at least one target object not falling within the field of view of the first user viewing the first light-transmissive display, based on the position information and posture of the first user The information and the position information of the at least one target object determine the display position information of the at least one virtual object on the second light-transmissive display. The information display method of claim 14, wherein the at least one user includes a second user, and in response to the at least one target object not falling on the first user viewing the first light-transmissive display Within the field of view, the display position information of the at least one virtual object on the second light-transmissive display is determined based on the position information and posture information of the first user and the position information of the at least one target object. The step includes: responding to the fact that the at least one target object does not fall within the field of view of the first user viewing the first light-transmissive display, based on the position information and posture information of the first user, the The position information and posture information of the second user and the position information of the at least one target determine the display position information of the at least one virtual object on the second light-transmissive display. The information display method as claimed in claim 9, wherein there is an included angle between the display plane of the first light-transmissive display and the display plane of the second light-transmissive display. The location of at least one user The position information and posture information and the position information of the at least one target object are determined. The step of determining the display position information of the at least one virtual object associated with the at least one user includes: when the number of users is equal to 1, according to the The posture information of at least one user determines that the at least one user is associated with the first light-transmissive display and the second light-transmissible display; and the first light-transmissive display is selected according to the head rotation of the at least one user. A light-transmissive display; and determining at least one virtual object associated with the at least one user in the first visible light based on the position information and posture information of the at least one user and the position information of the at least one target object. Display location information on a translucent display. A processing device connected to a plurality of light-transmissive displays and a plurality of sensory information acquisition devices, wherein the light-transmissive display includes a first light-transmissive display and a second light-transmissive display, and the first light-transmissive display The light-transmissive display is disposed adjacent to the second light-transmissive display. The processing device includes: a memory for storing data; and a processor connected to the memory and configured to retrieve the sensing information. The device obtains the position information and posture information of the at least one user; obtains the position information of the at least one target object from the sensing information acquisition device; and determines whether the location between the first light-transmissive display and the second light-transmissive display is Translucent display The number of users in front is equal to 1 or greater than 1; based on the number of users, the location information and posture information of the at least one user, and the location information of the at least one target, determine the relationship with the at least one user Display position information of at least one virtual object; and controlling at least one of the first light-transmissive display and the second light-transmissible display to display the at least one corresponding to the target object according to the display position information. A virtual object.

Images