KR102065515B1 - Display apparatus for only displaying valid images of augmented reality and method for only displaying valid images of augmented reality - Google Patents

Abstract

According to an embodiment of the present invention, a display device for augmented reality device for only outputting a valid image may comprise: a display panel displaying an input image; a control unit generating valid data bit map for storing binary data in units of pixels constituting the input image for identifying a valid image from the input image and a valid line bit map storing a binary value for each line identified according to whether the binary data values included in each line constituting the valid data bit map is all 0; and a drive circuit unit outputting a drive signal for displaying the valid image on the display panel based on the valid data bit map and valid line bit map.

Description

DISPLAY APPARATUS FOR ONLY DISPLAYING VALID IMAGES OF AUGMENTED REALITY AND METHOD FOR ONLY DISPLAYING VALID IMAGES OF AUGMENTED REALITY}

The present invention relates to a display device for augmented reality device for outputting only the effective image and a method for outputting only an effective image from the display device for augmented reality device, and more specifically, to generate and input an effective data bitmap and an effective line bitmap. Effective in display device for augmented reality devices and display device for augmented reality devices to output only the effective picture, which is intended to reduce the power consumption and memory while simultaneously outputting only the effective picture among images. The present invention relates to a method of outputting only an image.

Augmented Reality (AR) is a kind of Mixed Reality that is the realm between real and virtual. It combines a virtual object or information with the information of reality to make it look like an object in the original environment. or

This means overlapping the information in the image. To this end, augmented reality recognizes a specific object, generates a 3D image of the recognized object, and overlays the captured image.

On the other hand, when the AR content is output to the augmented reality device, there is a need to reduce the power consumption, memory and at the same time to process the image quickly.

To this end, it may be assumed that the random access method used in the general memory to display only the partial image on the general flat panel display. This can be said to be quite effective because it can update only the necessary effective video parts. Particularly, it can be effective when there are not many partial pictures. However, as the number of partial pictures increases, partial image position extraction becomes more complicated. The amount of addresses increases, and the burden of transmitting these addresses together with the video is increased. In particular, when the number and the number of the effective images increase, the address capacity also increases, rather, the image and address transmission time and the pixel array driving time are further increased, and the pixel array driving circuit is complicated.

The present invention has been made in consideration of the above-described problems. When AR content is output to an augmented reality device, it is necessary to further reduce power consumption, memory, and fast image processing. It is an object of the present invention to provide another effective video output method that enables to output only.

By driving only the effective image and eliminating unnecessary driving, the driving time can be shortened and the life of the elements constituting the device can be extended.

The display device for augmented reality device for outputting only the effective image according to an embodiment of the present invention, a display panel for displaying an input image, binary in units of pixels constituting the input image to identify the effective image of the input image; A valid line bitmap for storing a binarization value for each line identified according to whether a valid data bitmap for storing data and the binary data value included in each line constituting the valid data bitmap are all zeros; And a driving circuit unit for outputting a driving signal for displaying only the valid image on the display panel based on the generated control unit and the valid data bitmap and the valid line bitmap.

According to another embodiment of the present invention, a method for outputting only an effective image in a display device for an augmented reality device includes: valid data bits for storing binary data in units of pixels constituting the input image to identify an effective image among input images; Generating a valid line bitmap storing a binarization value for each line identified according to whether a binary data value included in a map and each line constituting the valid data bitmap is '0' and the valid data And outputting a driving signal for displaying only the valid image on a display panel based on a bitmap and the valid line bitmap.

According to an embodiment, the driving signal outputting step may include selecting a line for driving only a predetermined line selected from each of the lines constituting the valid data bitmap based on the binarization value of each line stored in the valid line bitmap. Outputting a signal, and based on the line selection signal and the valid data bitmap, only the remaining valid lines except for lines in which the binary data values included in each line constituting the valid data bitmap are all '0' And generating a valid data bitmap for output.

In the outputting valid data bitmap generation step, when the binary data value of the valid data bitmap for output is '1', only the valid image corresponding to the corresponding binary data value is output, and the binary data of the valid data bitmap for output is output. When the value is '0', the remaining part of the input image corresponding to the corresponding binary data value may be excluded from the output.

According to another embodiment, the method may further include receiving coordinate information of the valid image on the input image from an external processor.

According to another embodiment, the method may further include pre-storing only the valid image of the input image on a frame buffer based on the valid data bitmap and the valid line bitmap.

When AR content is output to an AR device, power consumption, memory reduction, and fast image processing are further required. Therefore, by outputting only an effective image to a miniaturized display device, it is possible to meet the above-mentioned needs. Will be.

Since only the effective image can be driven and unnecessary driving can be excluded, the driving time is shortened, and as a result, the life of the elements constituting the device is long.

Since only the effective image is output, the screen scanning time is reduced, thereby reducing tearing defects occurring in a fast-moving subject and bringing a time warp effect to cope with rapid movement of the image.

By reducing the sequential scanning time of the flat panel display, it is possible to minimize the image quality difference between the beginning and the end of the screen, and to minimize the color separation and flicker caused by the field sequential color method (FSC). have.

Minimizing the effective image capacity minimizes the latency stored and read in the display's frame buffer.

By using WRITING and / or READING only on valid data excluding BLACK pixels using the frame buffer, the storage capacity of the frame buffer can be reduced, and the time for writing to or reading from the frame buffer can be reduced.

Since the external processor can transmit only the valid image and the coordinates of the valid image, and generate the valid data bitmap and the valid line bitmap by referring to the coordinate information in the integrated circuit of the display panel, this means that the operation of the external processor is integrated with the display panel. In the circuit, the external processor has less work load.

1 and 2 are views illustrating an augmented reality device and a display device for augmented reality device for outputting only an effective image according to an embodiment of the present invention.
3 is a block diagram of a display device for augmented reality device for outputting only an effective image according to an embodiment of the present invention.
4 is an illustration of a bitmap generated in accordance with an embodiment of the present invention.
FIG. 5 is a view comparing image data input forms of a conventional flat panel display with sequential image data input forms of a display apparatus for outputting only an effective image according to an exemplary embodiment of the present invention.
6 is a block diagram and a flowchart referred to for describing the operation of the image region extraction unit.
7 is a block diagram referred to for explaining the processing of the noise filter unit.
8 is a view referred to for describing the operation of the line selection signal driver.
9 is a diagram referred to describe the operation of the data driver.
10 to 12 are views for explaining a display device for augmented reality device for outputting only an effective image according to a second embodiment of the present invention.
FIG. 13 is a diagram referred to describe a display device for augmented reality device for outputting only an effective image according to a third embodiment of the present invention.
FIG. 14 is a diagram referred to for comparing display driving time when a conventional flat panel display driving is performed according to another embodiment of the present invention.
15 and 16 are diagrams for explaining an improved effect in terms of time warp, which may correspond to tearing defects or rapid movement of an image, according to an embodiment of the present invention. .

DETAILED DESCRIPTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein may be embodied in other embodiments without departing from the spirit and scope of the invention with respect to one embodiment. In addition, it is to be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the invention. The following detailed description, therefore, is not to be taken in a limiting sense, and the scope of the present invention, if properly described, is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled. Like reference numerals in the drawings refer to the same or similar functions throughout the several aspects.

1 and 2, a display device 1 for augmented reality devices for outputting only an effective image according to an exemplary embodiment of the present invention will be described.

1 and 2, in the marker-based augmented reality technology, after identifying a pattern of a marker, a process of visualizing previously stored images or animations is performed. In detail, in the marker-based augmented reality technology, the AR apparatus 1000 for providing AR content recognizes a marker and visualizes the 3D object image on the photographed image based on the recognized marker.

That is, the calculation of the position matrix (X, Y, Z) is performed on the display device 1, the 3D model rendering by the matrix is performed, and the already stored augmented reality content may be loaded.

The augmented reality device 1000 of FIG. 1 may include, for example, a wearable device such as a head-mounted display (HMD).

As illustrated in FIG. 2, an input image may be output through the display device 1. The input image may include an effective image portion (A, B, C, D, E, F) and an invalid image portion (the remaining portions of the entire screen except for the effective image portion). The effective video portion is a portion where the AR content is output, and the invalid image portion is a transparent blank area where the AR content is not actually output.

The display device 1 of the AR Augmented Reality (AR) device 1000 as shown in FIG. 1 displays the necessary image only on a part of the screen while the user can see the front of the screen so that the background of the screen is transparent. Communicate informative The display device 1 of the augmented reality device 1000 used in the form of being close to the eye requires a transparent background of 50% or more for high transparency and high openness for the user's convenience as shown in FIG. Rather, place it on the top, bottom, left, or right side of the screen.

The transparent background screen provided to the user by the augmented reality device 1000 is an invalid image portion described above and has a value of '0' expressed in black (BLACK) among the images input to the display apparatus 1, and the effective image portion is In general, when 8-bit brightness is expressed, each color has a brightness value of '1 to 255'.

A general display device does not recognize a value of image data and continuously displays an image of the entire screen without distinguishing whether an input pixel value is '0' or '1 to 255'.

On the other hand, except for the pixel of '0', which is the background of the image displayed on the transmission-type near to eye augmented reality device 1000, only a valid partial image is displayed and the entire screen data is scanned. Compared with updating, it is expected to have favorable performance such as power consumption reduction and frame rate improvement.

In particular, when AR content is output to the miniaturized augmented reality device 1000 compared to a large electronic device, since power consumption, memory reduction, and fast processing of images are needed, the miniaturized display device 1 By outputting only the valid image, it is possible to further meet the above-described needs (needs).

In addition, the transmissive eye proximity augmented reality device 1000, when the wearer moves the eyeball or head quickly, the internal image should respond quickly, but general augmented reality device is a fast response to the data transmission and scanning time separately from the pixel response speed Since the image movement may not be reflected, the screen (subject) tearing, flickering, color separation, and the like as shown in FIGS. 15 and 16 may occur.

As a result, the video display technology for properly expressing the teleportation screen necessary for market expansion and usability expansion of the augmented reality device 1000 and the disadvantages of the video data transmission and driving method of the general flat panel display for the image display device implementing the same There is a need for a new driving technology and an image display device with improved performance.

Therefore, hereinafter, the display device 1 for augmented reality devices for outputting only an effective image and a method of outputting an effective image in the apparatus will be described.

3 is a block diagram of a display device 1 for augmented reality devices for outputting only an effective image according to an embodiment of the present invention.

The display device 1 for augmented reality devices for outputting only an effective image according to an exemplary embodiment of the present invention may be a micro display device using a silicon driving substrate and a liquid crystal having a structure suitable for a small display device. However, the scope of the present invention is not limited thereto, and may be applied to large display devices such as micro OLEDs, micro LEDs, LCDs, and OLEDs.

As shown in FIG. 3, the display apparatus 1 for augmented reality devices for outputting only an effective image according to an exemplary embodiment of the present invention includes a control unit 100, a display panel 200, a data driver 300, and a line. The selection signal driver 400 may be included. For reference, in the present specification, the data driver 300 and the line selection signal driver 400 may be defined as a driving circuit unit.

In the display panel 200, a plurality of gate lines GL and a plurality of data lines DL may be disposed, and pixels may be disposed in an area where the gate lines GL and the data lines DL intersect. Such a pixel may include a micro display device and a semiconductor device such as a transistor for driving the same. The input image may be displayed through the display panel 200.

The line selection signal driver 400 is controlled by the controller 100 and sequentially controls the driving timing of the plurality of pixels by sequentially outputting scan signals to the plurality of gate lines GL disposed on the display panel 200.

The line selection signal driver 400 may include one or more gate driver integrated circuits (GDICs), and may be located only on one side or both sides of the display panel 200 according to a driving scheme. It may be. Alternatively, the line selection signal driver 400 may be located on the back of the display panel 200.

The data driver 300 may receive image data from the controller 100 and convert the image data into an analog data voltage. In addition, the data voltage is output to each data line DL according to a timing at which a scan signal is applied through the gate line GL so that each pixel constituting the display panel 200 represents brightness according to image data. do.

The data driver 300 may include one or more source driver integrated circuits (SDICs).

The line selection signal driver 400 and the data driver 300 may be integrated together with the display panel 200 in one chip.

The controller 100 supplies various control signals to the line selection signal driver 400 and the data driver 300, and controls the operation of the line selection signal driver 400 and the data driver 300.

The controller 100 causes the line selection signal driver 400 to output a scan signal according to the timing implemented in each frame constituting the image, and the data used by the data driver 300 to use the image data received from the external device. The converted image data is converted into a signal format and output to the data driver 300.

The controller 100 may externally output various timing signals including a vertical synchronization signal Vsync, a horizontal synchronization signal Hsync, an input data enable signal DE, a data enable signal, and a clock signal CLK together with the image data. Received from a processor (for example, a main processor (CPU) or an application processor (AP)).

The controller 100 may generate various control signals using various timing signals received from an external processor (not shown) and output the various control signals to the line selection signal driver 400 and the data driver 300.

For example, the controller 100 controls the line selection signal driver 400 to include a gate start pulse (GSP), a gate shift clock (GSC), and a gate output enable signal (GOE). Outputs various gate control signals, including Gate Output Enable).

Here, the gate start pulse GSP controls the operation start timing of one or more gate driver integrated circuits constituting the line selection signal driver 400. The gate shift clock GSC is a clock signal commonly input to one or more gate driver integrated circuits, and controls a timing of shifting a scan signal. The gate output enable signal GOE specifies timing information of one or more gate driver integrated circuits.

In addition, the controller 100 controls the data driver 300 to control the data driver 300, a source start pulse (SSP), a source sampling clock (SSC), and a source output enable signal (SOE). Outputs various data control signals including "

Here, the source start pulse SSP controls the data sampling start timing of one or more source driver integrated circuits constituting the data driver 300. The source sampling clock SSC is a clock signal that controls the sampling timing of data in each of the source driver integrated circuits. The source output enable signal SOE controls the output timing of the data driver 300.

In particular, the control unit 100 according to an embodiment of the present invention may include an image input unit 110, an image region extraction unit 120, and a display control signal generator 130.

The controller 100 may generate a bitmap for identifying a valid image among input images input through the image input unit 110. For example, an effective data bitmap for storing binary data for identifying whether an image data value is '0' or '1 to 255' in units of pixels constituting the input image through the image region extracting unit 120 and the An effective line bitmap for storing the binarization value for each line identified according to whether all the binary data values included in each line constituting the valid data bitmap is '0' may be generated.

The valid data bitmap and the valid line bitmap generated by the image region extractor 120 may be transmitted to the data driver 300 and the line selection signal driver 400 to be used to generate the valid data bitmap for output. While the valid data bitmap and the valid line bitmap are generated by the image region extractor 120, the brightness of the screen may be controlled by the display control signal generator 130. For example, the scanning time changes every frame due to the number of valid data and the number of valid lines that change every frame according to the input image, so that the same brightness can be output even if the screen scanning time changes. Time, brightness of the light source, and the like are controlled.

The driving circuit unit including the data driver 300 and the line selection signal driver 400 may receive the valid data bitmap and the valid line bitmap generated by the controller 100 to generate an output valid data bitmap. The valid image data may be output according to the output valid data bitmap information through the data driver 300, and thus only the valid image may be output on the display panel 200.

The display control signal generator 130 may generate a control signal for controlling the display panel 200 and transmit the generated control signal to the image area extractor 120, the data driver 300, and the line selection signal driver 400. The image region extractor 120 may extract an effective image using the control signal generated by the display control signal generator 130.

Hereinafter, the configuration of an apparatus for outputting only an effective image of the input image according to the first embodiment of the present invention will be described in detail with reference to FIGS. 4 to 9 in addition to FIG. 3.

As shown in FIG. 6A, the image region extracting unit 120 includes a noise filter 121, an effective image discriminating unit 122, a valid data bitmap storage unit 123 for each line, and an effective line bitmap storage unit. 124 may include. As illustrated in FIG. 3, the data driver 300 may include an output valid data bitmap storage unit 310, an image data storage unit 320, a line data storage unit 330, and a data output unit 340. It may include. In addition, the line selection signal driver 400 may include an effective line bitmap storage unit 410, a line selection signal generator 420, and a line selection signal output unit 430. The function and connection operation of each of these components will be described in detail below.

4 is an illustration of a bitmap generated in accordance with an embodiment of the present invention.

In general, a pixel having a brightness value of 8 bits is represented by 1 bit indicating only a meaningful value, and an array is formed to represent a position by the number of pixels of an image. In the case of the display panel 200 having M horizontal pixels and N vertical lines, (M + 1) x N x 1-bit bitmap indicates whether the pixel is BLACK or not for the display panel 200 of M x N x 8-bit. It is.

As illustrated in FIG. 4, the valid data bitmap A and the valid line bitmap B may be generated through the valid image discriminating unit 122. The generated valid data bitmap A may be stored in the valid data bitmap 123 for each line, and the valid line bitmap B may be stored in the valid line bitmap storage 124. The output valid data bitmap C may be generated through the data driver 300, and the generated output valid data bitmap C may be stored in the output valid data bitmap storage 310.

The output valid data bitmap C may be generated with reference to the valid line bitmap B information and the valid data bitmap information A.

First, a valid data bitmap A storing binary data for identifying whether image data values of each pixel constituting the input image is '0' or '1 to 255' is generated. However, this is only an example, and the valid data bitmap A may be generated by other methods. In FIG. 4, an area stored as '1' may be defined as an effective image, and an area stored as '0' may be defined as an invalid image.

The valid line bitmap B is generated by referring to the binary data of the valid data bitmap A. Specifically, all of the binary data values included in each line constituting the valid data bit map A are '0'. The binarization value for each line identified according to whether or not it can be stored can be stored. For example, as shown in FIG. 4, when all binary data values of pixels included in a specific line are '0', the binarization value for the corresponding line may be stored as '0'. If the binary data value of the pixel included in the specific line includes at least one '1', the binarization value for the corresponding line may be stored as '1'. Since a line '0' is excluded from the selection signal transmitted to the display panel 200 through the generated valid line bitmap B information, the corresponding line may be excluded from driving. Therefore, since unnecessary driving can be eliminated, the driving time is shortened and consequently the life of the device is also long.

The generated valid line bitmap B is transferred to the line selection signal driver 400. The line selection signal driver 400 supplies a line selection signal for driving only a predetermined line selected from the lines constituting the valid data bitmap A based on the binarization value for each line stored in the valid line bitmap B. FIG. Will print. As shown in FIG. 4, it can be seen that only 14 lines of the total 18 lines are selected on the display panel 200 and four lines (lines stored as '0' in the bitmap) are excluded from the selection signal. The driving signal is not applied to the line stored as '0' in the bitmap, and the driving signal is sequentially applied to the line stored as '1'.

Valid data for output from the data driver 300 by referring to the valid data bitmap A stored in the image region extraction unit 120 and the valid line bitmap B stored in the line selection signal driver 400. The bitmap C may be generated. The valid data bitmap (C) for output is the remaining valid lines except the lines stored as '0' in the valid line bitmap (B) of all the lines constituting the valid data bitmap (A) in the valid data bitmap (A). Can be defined as a configured bitmap. Each line constituting the valid data bitmap C for output is sequentially generated, and binary data may be sequentially stored for each line. Here, each line constituting the valid data bitmap C for output may be generated by moving data stored in the image area extracting unit 120 and moving in line units. The generated output valid data bitmap C is stored in the output valid data bitmap storage unit 310 and the binary data value of the output valid data bitmap is '1' through the image data storage unit 320. In this case, only the valid image corresponding to the binary data value is output, and when the binary data value of the valid data bitmap for output is '0', the remaining part of the input image corresponding to the binary data value (invalid image). ) Can be excluded from the output. As a result, an effective image is output to the display panel 200 as shown in FIG. 4.

5 is a view comparing the image data input form of a conventional flat panel display with the sequential image data input form of the display apparatus 1 for outputting only an effective image according to an exemplary embodiment of the present invention.

As shown in FIG. 5A, a conventional flat panel display transmits and displays a black pixel value, which becomes a transparent background, together with the effective image pixel value to the display panel 200 according to a predetermined timing rule. Since only black pixel values cannot be excluded from transmission and driving, no matter how many '0' pixel values exist, all lines must be scanned and all pixel data must be updated.

On the other hand, in the case of the display apparatus 1 of FIG. 5B, unlike the operation time of the conventional flat panel display as shown in FIG. 5A, the display apparatus 1 has a time for transmitting the valid line bitmap and the valid data bitmap before transmitting the image data. That is, the time for transmitting each line data of each frame may include up to a time T2 for transmitting a valid data bitmap, and up to a time T1 for transmitting a valid line bitmap before a new frame starts. have.

1. At the beginning of an arbitrary frame, as shown in FIG. 14 (c), a time T1 is transmitted to the line selection signal driver 400 with the effective line bitmap as the highest priority prior to the screen scanning.

2. Prior to any line data transmission, as shown in FIG. 5B, the valid data bitmap of the corresponding line has a time T2 of transferring the data driver 300 to the data driver 300 with the highest priority.

3. After inputting a valid data bitmap corresponding to an arbitrary line, horizontal line data having only valid images except for BLACK pixels is transferred to the data driver 300.

At this time, the number of input clocks is determined by reflecting the number of effective pixels and the number of parallel data lines.

6 is a block diagram and a flowchart referred to for describing the operation of the image region extractor 120.

As shown in FIG. 6, the image region extracting unit 120 includes a noise filter 121, an effective image discriminating unit 122, a valid data bitmap storage unit 123 for each line, and an effective line bitmap storage unit. 124 may include. As shown in FIG. 7A, the noise filter unit 121 may include a determination window generating unit 121a and a window discrimination processing unit 121b.

The noise filter 121 is positioned before the effective image discriminating unit 122 and removes unnecessary partial images. The input image data includes unwanted noise pixels, transmission noise, and camera noise pixels through dithering, compression / decompression, and scaling. These noise pixels can reduce the transparency of the background on the screen of the augmented reality device, so they can be removed through a noise filter. The cause of inefficiency in the method of extracting only a valid valid image as in the present invention is removed before the valid image discriminating unit 122.

In an embodiment, the input image data RGB is divided into a plurality of block data consisting of a plurality of pixel data. Here, the block data may be composed of 2 × 4, 3 × 3, or 4 × 4 pixel data. The pixel data larger than the average value among the pixel data included in the block data may be stored as '1', and the pixel data smaller than or equal to the average value may be stored as '0'.

Each pixel data output from the noise filter unit 121 is transferred to the valid image discriminating unit 122 and referred to to generate the valid data bitmap A. FIG.

In order to accurately determine the noise pixel as shown in FIG. 7B, a discrimination window w such as 3x3 or 5x5 is configured to determine whether the noise pixel is a noise pixel. By using the pipeline method, it is possible to input sequentially and discriminate sequentially with only one or two line time delays. The larger the discrimination window w, the better discrimination conditions can be provided. However, since the capacity of the line buffer becomes larger and the delay time becomes longer, the determination is made in comparison with the performance. The window discrimination processing unit 121b compares the pattern between the center pixel value and the neighboring pixel value and maintains the center pixel value smaller than the neighboring pixel value or converts it to '0'.

The effective image discriminating unit 122 constituting the image region extracting unit 120 may perform a function of determining the transparent pixel BLACK in the input image as shown in FIG. 6B.

For example, by sequentially evaluating inputted pixel values, it is possible to determine whether BLACK is available, add the effective data number for each pixel line, and calculate the effective line number for each frame.

Specifically, by sequentially checking the pixel values input, if the number of valid data is not 'BLACK', the number of valid data is increased by 1, and the corresponding position <m> bit of the valid data bitmap of the corresponding line <n> is mapped to '1'. If the pixel value is 'BLACK', the corresponding position <m> bit of the valid data bitmap is mapped to '0'. The process is continuously repeated until the input for any line data is completed.

When the input of the arbitrary line data is completed, if the valid data number is 0, the entire line is recognized as BLACK, and the corresponding bit <n> value of the valid line bitmap is designated as '0'. On the other hand, if the number of valid data is not 0, the corresponding bit <n> value of the valid line bitmap is designated as '1'.

By repeating this process from one line to N lines for an arbitrary frame, the valid data bitmap [N] [M] of MxN bits, the valid line bitmap [N] of N bits, and the number of valid data per line [N] Is stored in the valid data bitmap storage unit [N] [M] and the valid line bitmap storage unit [N], and then moved to the display driving circuit unit in synchronization with the display control signal.

The display control signal generator 130 of FIG. 6A compares the number of valid data and the number of valid lines with the amount of original frame data, calculates a reduced scanning time for displaying an effective image, and determines whether to apply an effective image display function. When the display function is applied, a signal controlling each line time and the entire frame for displaying an effective image is made according to the effective image. If there is a possibility that the brightness may vary due to the scanning time that varies with the input image every frame, as shown in FIG. 14 (c), the synchronization time T3 may be added after the addressing time and the holding time, or the same brightness may be output. The brightness of the light source, the pixel value, and the like can be controlled.

8 is a diagram referred to describe the operation of the line selection signal driver 400.

As described above with reference to FIG. 3, the line selection signal driver 400 may include an effective line bitmap storage unit 410, a line selection signal generation unit 420, and a line selection signal output unit 430.

The valid line bitmap LB indicating the horizontal line on which the image is located is sequentially input and stored in the valid line bitmap storage LBM [N] 410. In the case of an M (horizontal) x N (vertical) screen, the effective line bitmap is N bit (= 1 bit x N line) capacity.

Each bit stored in the valid line bitmap storage (LBM [N]) 410 is used to determine whether to output a selection signal to a corresponding line. The line selection signal generator (DLS [N]) 420 performs a function of sequentially generating the line selection signal by using the start signal of the frame and the line period clock. According to the output, it outputs a selection signal to the corresponding line. That is, if the display bit LBM [n] is '0', the line selection signal is not output to the <n> line. If the display bit LBM [n] is '1', the line selection signal is applied to the <n> line. Output

According to the effective line bitmap, the number of line selection signals varies, and the selection time for which each line selection signal is held also varies according to the number of valid data. The line select signal output unit LSO [N] 430 converts the line select signal to a signal level suitable for the pixel array circuit of the display panel 200 and outputs a driving signal for each line.

9 is a diagram referred to describe the operation of the data driver 300.

As described above in FIG. 3, the data driver 300 includes an output valid data bitmap storage 310, an image data storage 320, a line data storage 330, and a data output 340. .

The output valid data bitmap storage unit DBM [M] 310 stores the valid data bitmap DB sequentially input for each line time before line data is input for each line. In the case of an M (horizontal) x N (vertical) screen, the effective data bitmap is M bit (= 1 bit x M data) capacity.

The valid data bitmap for output is generated based on the valid line bitmap information and the valid data bitmap information. Each bit information stored in the valid data bitmap for output receives and stores only the bit values of the remaining valid image parts except the bit line when the valid line bitmap binary value is '0'.

Each of the bits stored in the output valid data bitmap storage unit DBM [M] 310 has image data storage unit DSDR [M] of image data P [m] of any [n] lines sequentially input. ]) 320 to determine if it is stored in each corresponding location. In the image data, only valid pixels are input except for the BLACK pixel.

That is, when the display bit DB [m] is '0', the image data P [m] is not stored in the corresponding position DSDR [m] of the image data storage unit 320, and the display bit DB [ m]) is '1', the image data P [m] is stored in the corresponding position DSDR [m] of the image data storage 320. The image data storage 320 stores the input image according to the output of the valid data bitmap storage 310 for output.

The line data storage unit DLA [M] 330 receives the image data of the image data storage unit DSDR 320 and stores the image data for an image data input time. For example, while image data of the line [n] is sequentially stored in the image data storage unit 320 in pixel units, the line data storage unit 330 stores and outputs the previous line [n-1] data. The output of the output unit 340 is maintained for the line time. Since the number of valid data in each line data may be different each time, each line time varies with the number of valid data.

The data output unit 340 receives the output of the line data storage unit 330 and outputs each data signal to each data line of the pixel array of the display panel 200. DACs, amplifiers, and so on, can be provided to convert to the appropriate signal type and increase the output.

Meanwhile, according to the first exemplary embodiment described above, the controller 100 is implemented on the display panel integrated circuit together with the driving circuit unit. According to another exemplary embodiment, the controller 100 includes the display panel integrated with the driving circuit unit. It may be implemented in a separate external processor (eg AP or separate controller) rather than circuitry.

Hereinafter, an augmented reality device display apparatus 1 for outputting only an effective image according to a second embodiment of the present invention will be described.

10 and 11, according to the second exemplary embodiment, the controller 100 may further include a frame buffer processor 140 in addition to the components of the first exemplary embodiment. The frame buffer processor 140 may include a frame buffer address generator 141, a frame buffer 142, and a valid image output unit 143. In the second embodiment, the operations of the other components except for the frame buffer processor 140 described in the first embodiment may be applied in the same or similar manner.

The valid data bitmap and the valid line bitmap information generated by the image region extractor 120 may be referred to by the frame buffer processor 140. The frame buffer 142 may store only the valid image of the input image in advance based on the referenced valid data bitmap and the valid line bitmap. In this case, the frame buffer address generator 141 may use the referenced valid data bitmap information, valid line bitmap information, valid data number, and valid number of lines to generate the address of the frame buffer 142. The frame buffer address generator 141 may determine a horizontal address according to the valid line bitmap information, and determine a vertical address according to the valid data bitmap information. At this time, each time data is recorded on the frame buffer 142, the frame buffer address generator 141 may sequentially generate the horizontal address and the vertical address. The valid image may be transmitted to the data driver 300 through the valid image output unit 143. Even when reading the data recorded on the frame buffer 142, the frame buffer address generator 141 may sequentially generate the horizontal address and the vertical address.

The display control signal generator 130 refers to the address information of the frame buffer 142 through the frame buffer address generator 141 to match signals for controlling each line time for the valid image display and the entire frame to the valid image. Make it up

The valid data bitmap information and the valid line bitmap information may be transmitted to the data driver 300 and the line selection signal driver 400.

The line selection signal driver 400 may output a line selection signal for driving only a predetermined line selected from each line constituting the valid data bitmap based on the binarization value of each line stored in the valid line bitmap. This is as described above in Example 1.

The data driver 300 outputs valid data including only valid lines except for lines having binary values of '0' included in each line constituting the valid data bitmap based on the line selection signal and the valid data bitmap. You can create bitmaps. Specifically, when the binary data value of the valid data bitmap for output is '1', only the valid image on the frame buffer 142 corresponding to the binary data value may be output, whereas the binary data of the valid data bitmap for output is output. If the value is '0', the rest of the input image (not recorded on the frame buffer 142) corresponding to the binary data value may be excluded from the output.

According to the second exemplary embodiment, the storage capacity of the frame buffer 142 may be reduced by performing WRITING and / or READING only on valid data except for the BLACK pixel using the frame buffer 142, and the frame may be reduced. The time for writing to or reading from the buffer 142 can be reduced. For reference, FIG. 12 illustrates the effective image arrangement (A) according to the first embodiment and the effective image arrangement (B) according to the second embodiment, and the embodiment to output the effective image as shown in (C). In the first embodiment, the image is stored in the memory in the form of (A). In the second embodiment, the image is stored in the frame buffer 142 in the compressed form as in the (B).

In FIG. 10, the frame buffer processor 140 is illustrated on the display controller 100, but according to another exemplary embodiment, an external controller (for example, a separate controller from the integrated circuit in which the display controller 100 is implemented) is illustrated. May be implemented in an AP).

Hereinafter, a display apparatus 1 for augmented reality devices for outputting only an effective image according to a third embodiment of the present invention will be described.

As shown in FIG. 13, according to the third embodiment, the controller 100 may further include an effective image coordinate analyzer 150 in addition to the components of the first embodiment. According to the third embodiment, except that the effective image coordinate analyzer 150 is further included, operations of the remaining components may be applied in the same / similar manner as described in the first embodiment.

The valid image coordinate analyzer 150 may receive coordinate information of the valid image disposed among the input images from an external processor (for example, an AP or a controller) and analyze the corresponding coordinate information. The image region extractor 120 may generate the valid data bitmap and the valid line bitmap by referring to the coordinate information of the analyzed valid image.

According to the third embodiment, since the external processor transmits only the coordinates of the valid image and the valid image, and generates the valid data bitmap and the valid line bitmap by referring to the coordinate information in the integrated circuit of the display panel, The task of the processor is to share the display panel integrated circuit, so that the external processor has a reduced work load.

Features, structures, effects, etc. described in the above embodiments are included in one embodiment of the present invention, and are not necessarily limited to one embodiment. Furthermore, the features, structures, effects, and the like illustrated in the embodiments may be combined or modified with respect to other embodiments by those skilled in the art to which the embodiments belong. Therefore, contents related to such combinations and modifications should be construed as being included in the scope of the present invention.

In addition, the above description has been made with reference to the embodiment, which is merely an example, and is not intended to limit the present invention. Those skilled in the art to which the present invention pertains will be illustrated as above without departing from the essential characteristics of the present embodiment. It will be appreciated that various modifications and applications are possible. For example, each component specifically shown in the embodiment can be modified. And differences relating to such modifications and applications will be construed as being included in the scope of the invention defined in the appended claims.

Claims (15)

A display panel for displaying an input image;
A valid data bitmap for storing binary data in units of pixels constituting the input image to identify a valid image among the input images and the binary data values included in each line constituting the valid data bitmap are all '0'. A controller configured to generate a valid line bitmap that stores binarization values for each line identified according to whether the information is recognized or not; And
And a driving circuit unit outputting a driving signal for displaying only the valid image on the display panel based on the valid data bitmap and the valid line bitmap.
Display device for augmented reality device for outputting only the effective image. The method of claim 1,
The driving circuit unit,
A line selection signal driver for outputting a line selection signal for driving only a predetermined line selected from each of the lines constituting the valid data bitmap based on the binarization value of each line stored in the valid line bitmap; And
Valid data bits for output including only valid lines except for lines in which all of the binary data values included in each line constituting the valid data bitmap are '0' based on the line selection signal and the valid data bitmap It includes; Data driver for generating a map;
Display device for augmented reality device for outputting only the effective image. The method of claim 2,
The data driver,
Outputting only the valid image corresponding to the binary data value when the binary data value of the valid data bitmap for output is '1',
When the binary data value of the valid data bitmap for output is '0', the remaining part of the input image corresponding to the corresponding binary data value is excluded from the output.
Display device for augmented reality device for outputting only the effective image. The method of claim 1,
The driving circuit unit is implemented on a display panel integrated circuit driving the display panel, and the controller is disposed on an external processor implemented separately from the display panel integrated circuit.
Display device for augmented reality device for outputting only the effective image. The method of claim 1,
The controller may further include a coordinate analyzer configured to receive coordinate information of the valid image on the input image from an external processor.
The controller generates the valid data bitmap and the valid line bitmap with reference to the coordinate information.
Display device for augmented reality device for outputting only the effective image. The method of claim 1,
The controller may further include a frame buffer configured to previously store only the valid image among the input images based on the valid data bitmap and the valid line bitmap.
The driving circuit unit controls to output only the valid image on the frame buffer based on the valid data bitmap and the valid line bitmap.
Display device for augmented reality device for outputting only the effective image. The method of claim 6,
The driving circuit unit,
A line selection signal driver for outputting a line selection signal for driving only a predetermined line selected from each of the lines constituting the valid data bitmap based on the binarization value of each line stored in the valid line bitmap; And
Valid data bits for output including only valid lines except for lines in which all of the binary data values included in each line constituting the valid data bitmap are '0' based on the line selection signal and the valid data bitmap It includes; Data driver for generating a map;
Display device for augmented reality device for outputting only the effective image. The method of claim 7, wherein
The data driver,
Outputting only the valid image on the frame buffer corresponding to the binary data value when the binary data value of the valid data bitmap for output is '1',
When the binary data value of the valid data bitmap for output is '0', the remaining part of the input image corresponding to the corresponding binary data value is excluded from the output.
Display device for augmented reality device for outputting only the effective image. A valid data bitmap for storing binary data in units of pixels constituting the input image and a binary data value included in each line constituting the valid data bitmap are all '0' to identify an effective image among the input images. A bitmap generation step of generating a valid line bitmap that stores binarization values for each line identified according to whether the image is recognized or not; And
And a driving signal outputting step of outputting a driving signal for displaying only the valid image on a display panel based on the valid data bitmap and the valid line bitmap.
Method of outputting only the effective image in the display device for augmented reality device. The method of claim 9,
The driving signal output step,
Outputting a line selection signal for driving only a predetermined line selected from each of the lines constituting the valid data bitmap based on the binarization value of each line stored in the valid line bitmap; And
Valid data bits for output including only valid lines except for lines in which all of the binary data values included in each line constituting the valid data bitmap are '0' based on the line selection signal and the valid data bitmap Generating a map; comprising;
Method of outputting only the effective image in the display device for augmented reality device. The method of claim 10,
The outputting valid data bitmap generation step may include:
Outputting only the valid image corresponding to the binary data value when the binary data value of the valid data bitmap for output is '1',
When the binary data value of the valid data bitmap for output is '0', the remaining part of the input image corresponding to the corresponding binary data value is excluded from the output.
Method of outputting only the effective image in the display device for augmented reality device. The method of claim 9,
Receiving coordinate information of the valid image on the input image from an external processor;
The bitmap generation step,
Generating the valid data bitmap and the valid line bitmap with reference to the coordinate information;
Method of outputting only the effective image in the display device for augmented reality device. The method of claim 9,
Storing only the valid image among the input images in a frame buffer based on the valid data bitmap and the valid line bitmap;
The driving signal output step,
Outputting a driving signal for displaying only the valid image on the frame buffer based on the valid data bitmap and the valid line bitmap;
Method of outputting only the effective image in the display device for augmented reality device. The method of claim 13,
The driving signal output step,
Outputting a line selection signal for driving only a predetermined line selected from each of the lines constituting the valid data bitmap based on the binarization value of each line stored in the valid line bitmap; And
Valid data bits for output including only valid lines except for lines in which all of the binary data values included in each line constituting the valid data bitmap are '0' based on the line selection signal and the valid data bitmap Generating a map; comprising;
Method of outputting only the effective image in the display device for augmented reality device. The method of claim 14,
The outputting valid data bitmap generation step may include:
When the binary data value of the valid data bitmap for output is '1', only the valid image on the frame buffer corresponding to the binary data value is output, and the binary data value of the valid data bitmap for output is '0'. In this case, the remaining part of the input image corresponding to the corresponding binary data value is excluded from the output.
Method of outputting only the effective image in the display device for augmented reality device.

Images