KR102561509B1 - Image display apparatus having weighted thumbnail - Google Patents

Abstract

The present invention relates to an image display device for displaying thumbnails on a single screen by varying the size of thumbnails according to their importance, comprising: a receiving unit for receiving an original image obtained by at least one camera; an importance determiner determining an image importance for a region of interest among the received original images; a thumbnail generator configured to determine a size of a thumbnail image of the region of interest according to the determined image importance, and to generate a thumbnail image according to the determined size; And by including a screen unit for displaying the generated thumbnail images on a single screen after collecting them, it is possible to easily monitor multiple images on one screen.

Description

Image display apparatus having weighted thumbnail according to importance

The present invention relates to a video display device that outputs thumbnails, and more particularly, to a video display device that displays thumbnails on a single screen by changing the size of thumbnails according to their importance.

In general, surveillance systems are widely used in various places including banks, department stores, and general residential areas. Such a monitoring system may be used for crime prevention and security purposes, but recently it is also used to monitor indoor pets or children in real time. And the system most commonly used as such a surveillance system is installed in an appropriate location so that the camera can film the area you want to monitor, and the user can monitor the video captured by the camera. Closed Circuit Television: CCTV) system.

Conventionally, a method of displaying images taken by each camera on the screen of a monitoring device of a monitoring system connected to such multiple cameras, displaying the names of individual cameras in small sizes on a portion of a thumbnail image and listing them has been used. However, when using this method, there is a problem that all thumbnail images are not displayed on a single screen when the number of thumbnail images exceeds the acceptable range for one screen, and some thumbnail images are displayed only when the user directly scrolls or turns the page. There was a problem with being able to check the .

In addition, there is a difference in importance or priority felt by individual users for each thumbnail image, such as that some images require more frequent confirmation or more detailed observation. Nevertheless, there was a problem of not helping the user's convenience in monitoring because it was not visualized.

Japanese Patent Registration No. 4325541

An object to be solved by the present invention is to provide a video display device that displays thumbnail images of different importance on a single screen with different sizes.

The tasks of the present invention are not limited to the tasks mentioned above, and other tasks not mentioned will be clearly understood by those skilled in the art from the following description.

An image display device according to an embodiment of the present invention for solving the above problems includes a receiving unit for receiving an original image obtained by at least one camera; a thumbnail generator configured to determine a size of a thumbnail image of the original image according to the number of the at least one camera, and to generate a thumbnail image according to the determined size; and a screen unit that collects the generated thumbnail images and displays them on a single screen, wherein when the number of the at least one camera is changed, the thumbnail generation unit displays the original image according to the changed number of the at least one camera. A size of the changed thumbnail image may be determined, and a changed thumbnail image according to the changed size may be generated.

The video display device according to an embodiment of the present invention further includes an importance determination unit for determining an image importance for a region of interest among the original images, and the thumbnail generator determines a size of a thumbnail image of the region of interest according to the determined image importance. may be determined, and a thumbnail image according to the determined size may be generated.

The image importance may be determined by the number of accesses to the original video, the monitoring time for the original video, or the frequency of event occurrence of the original video.

The region of interest may be a region in which movement of an object occurs in the corresponding original image.

The thumbnail image may be an image obtained by dewarping the region of interest when a camera that has obtained the corresponding original image is a fisheye camera.

The screen unit may update the single screen at regular update intervals.

Other specific details of the invention are included in the detailed description and drawings.

According to embodiments of the present invention, at least the following effects are provided.

Since it is possible to check thumbnails obtained from multiple cameras on one screen, simultaneous monitoring is possible.

It is possible to easily monitor by changing the thumbnail size according to the importance of the thumbnail and changing the location of the region of interest extraction.

Effects according to the present invention are not limited by the contents exemplified above, and more various effects are included in the present specification. Other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

1 is a block diagram showing the configuration of an image display device according to an embodiment of the present invention.
2A to 2E are diagrams illustrating a layout displayed on a screen unit by dividing a screen according to the number of cameras in an image display device according to an embodiment of the present invention.
3A to 3C are diagrams showing a layout displayed on a screen unit by varying the size of thumbnails according to importance in the video display device according to an embodiment of the present invention.
4 is a diagram illustrating a state in which an image display device according to an embodiment of the present invention sets a region of interest and converts it into a thumbnail.
5 is a diagram illustrating a state in which an image display device according to an embodiment of the present invention dwarfs an image captured by a fisheye camera and turns it into a thumbnail.
6 is a flowchart illustrating a process of configuring a final layout by an image display device according to an embodiment of the present invention.
1 is a block diagram showing the configuration of an image display device according to an embodiment of the present invention.
2A to 2E are diagrams illustrating a layout displayed on a screen unit by dividing a screen according to the number of cameras in an image display device according to an embodiment of the present invention.
3A to 3C are diagrams showing a layout displayed on a screen unit by varying the size of thumbnails according to importance in the video display device according to an embodiment of the present invention.
4 is a diagram illustrating a state in which an image display device according to an embodiment of the present invention sets a region of interest and converts it into a thumbnail.
5 is a diagram illustrating a state in which an image display device according to an embodiment of the present invention dwarfs an image captured by a fisheye camera and turns it into a thumbnail.
6 is a flowchart illustrating a process of configuring a final layout by an image display device according to an embodiment of the present invention.

Advantages and features of the present invention, and methods of achieving them, will become clear with reference to the detailed description of the following embodiments taken in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only these embodiments make the disclosure of the present invention complete, and common knowledge in the art to which the present invention belongs. It is provided to completely inform the person who has the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numbers designate like elements throughout the specification.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used in a meaning commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless explicitly specifically defined.

Terminology used herein is for describing the embodiments and is not intended to limit the present invention. In this specification, singular forms also include plural forms unless specifically stated otherwise in a phrase. As used herein, "comprises" and/or "comprising" does not exclude the presence or addition of one or more other elements other than the recited elements.

In addition, the embodiments described in this specification will be described with reference to cross-sectional views and/or schematic views, which are ideal exemplary views of the present invention. Accordingly, the shape of the illustrative drawings may be modified due to manufacturing techniques and/or tolerances. In addition, in each drawing shown in the present invention, each component may be shown somewhat enlarged or reduced in consideration of convenience of explanation. Like reference numbers designate like elements throughout the specification, and “and/or” includes each and every combination of one or more of the recited items.

Spatially relative terms should be understood as including different orientations of elements in use or operation in addition to the orientations shown in the drawings. Elements may also be oriented in other orientations, and thus spatially relative terms may be interpreted according to orientation.

Hereinafter, the configuration of a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing the configuration of an image display device 1 according to an embodiment of the present invention.

An image display device 1 according to an embodiment of the present invention is connected to at least one camera 2 or 3 that acquires an image by photographing a specific area. The cameras 2 and 3 and the video display device 1 are wired or wirelessly connected to each other, so that when the cameras 2 and 3 transmit image data or signals, the video display device 1 can receive the signals. there is.

Various types of cameras 2 and 3 such as a zoom type camera, a dome type camera, a PTZ camera, and an IR camera can be used as the cameras 2 and 3 connected to the video display device 1 according to an embodiment of the present invention. there is.

An image display device 1 according to an embodiment of the present invention receives and displays images acquired by at least one camera 2 or 3 . The video display device 1 of the present invention may display at least one thumbnail image of an original video received from at least one camera 2 or 3 and a user interface for user convenience. The image display device 1 may be a device that is easy to carry and move, such as a smartphone, a tablet PC, and a laptop, but is not limited thereto, and is not limited thereto, such as a desktop, a video wall, and the like. It may be a device that is not easy to move, such as a wall).

As can be seen in FIG. 1, the image display device 1 according to an embodiment of the present invention includes a receiving unit 12 for receiving images from cameras 2 and 3, and an importance determining unit for determining the importance of the received images. (13), a thumbnail generator 14 for determining the size of the thumbnail image of the original video according to the importance determined by the importance determination unit 13 and generating a thumbnail image of the determined size, and combining the generated thumbnail images into a single screen It includes a screen unit 11 to display on.

The image display device 1 according to an embodiment of the present invention may not provide a touch function, and in this case, an input means is provided separately. In general, the most commonly used input means include a mouse, keyboard, joystick, remote control, and the like. If a touch function is provided, the screen unit 11 may include a touch sensor. The touch sensor is integrally mounted with the screen unit 11, detects a touch generated on the screen unit 11, detects the coordinates of the area where the touch occurred, the number and intensity of the touch, etc., and displays the detected result. It is transmitted to the importance determination unit 13. Even if the monitoring system provides a touch function, if the screen unit 11 does not include a touch sensor, a separate touch pad may be provided. Further, the touch may be performed using a finger, but is not limited thereto, and may be performed using a stylus pen equipped with a tip through which a microcurrent may flow. Such user input is made through the screen unit 11 .

The receiving unit 12 receives signals and data from at least one of the cameras 2 and 3 wired or wirelessly. For example, the receiving unit 12 frequency downconverts and demodulates data received from the cameras 2 and 3 and provides the data to the importance determining unit 13 . Through this process, the receiver 12 can receive image data from the cameras 2 and 3 . However, data that the receiver 12 can receive from the cameras 2 and 3 is not limited to image data, and when the cameras 2 and 3 include a sensor, a sensor signal may be further received. In addition, since the type of the connected cameras 2 and 3 affects the setting of the region of interest, the image processing device according to an embodiment of the present invention determines which camera 2 or 3 the connected cameras 2 and 3 are. The receiving unit 12 may further accept information about.

The importance determiner 13 determines the image importance of each ROI of the original image in consideration of various factors. The importance determiner 13 receives the original video from the receiver 12, extracts a region of interest to be made into a thumbnail image from the original image according to a predetermined standard, and determines the image importance of each individual region of interest in consideration of various factors. do. A region of interest may be one for each original image, but a plurality of regions of interest may be extracted from one original image.

Here, the criteria for extracting the region of interest may include whether the object is moving, the quality of the original image, the type of cameras 2 and 3 that have acquired the original image, and the like.

For example, if the quality of the original video is high quality, it is too much load on the entire video device including the communication network, the thumbnail generator 14, and the receiver 12 to thumbnail the entire video and continuously observe it on the screen unit 11. There is a problem with getting stuck. In this case, a specific partial region such as a central region of the original image may be cut out and set as a region of interest. In this way, when at least a partial region of the high-quality image is set as the region of interest, continuous monitoring is possible by setting the desired portion as the region of interest without excessive degradation of image quality and excessive load on the entire image display device 1 .

As for the region of interest, there may be a method in which the user directly selects the region of interest from the original image.

Criteria for extracting other regions of interest will be described with reference to each figure in the description of FIGS. 4 and 5 .

Factors determining the image importance may include the number of cameras 2 and 3 connected to the video display device 1, the number of event detections, the number of times the user accesses the thumbnail image, the time the user monitored the image, and the like. However, the factor determining the image importance is not limited thereto.

For example, the importance determination unit 13 may determine the image importance according to the number of event detections of the original image. Here, the event refers to a situation in which a significant change to be observed occurs in an original image to be observed. Accordingly, an event situation such as moving an object to be observed or a rapid change in an image may be assumed, but is not limited thereto. Other event situations may be assumed if the situation is known to a person skilled in the art and may be of interest to the user.

In order to detect this event, the cameras 2 and 3 connected to the video display device 1 according to an embodiment of the present invention may further include a sensor. The sensor may include, for example, a fire detection sensor for detecting occurrence of fire, a smoke detection sensor for detecting occurrence of smoke, and a heat or infrared detection sensor for detecting the presence or absence of people or animals. The sensor is not limited thereto, and various types of sensors may be used as long as they can detect any type of event.

Even without using a sensor, the image processing device according to an embodiment of the present invention may detect an object and determine that an event has occurred when the movement amount of the object in the image exceeds a predetermined standard.

Accordingly, the importance determining unit 13 may detect the number of event detections of the region of interest and assign a higher image importance to the region of interest in which the number of events detected is relatively greater. Here, the image importance is a variable representing the characteristics of each region of interest. The importance determiner 13 may assign an image importance in proportion to the number of event detections of each region of interest. However, the product of the weight and the number of event detections may be used as the image importance by assigning weights according to settings, and the value may be added to the image importance previously determined by other factors. A method of reflecting the number of event detections in the image importance may be set differently according to how much the user is interested in the number of event detections.

As another example, the importance determiner 13 may determine the image importance according to the number of times the user accesses the corresponding original image or the region of interest by selecting a thumbnail image obtained by thumbnailing the region of interest.

The thumbnail generator 14 and the screen unit 11 will be described in detail later, but after setting a region of interest and determining an image importance, the thumbnail generator 14 creates a thumbnail image of the region of interest. When the thumbnail image is generated in this way, the thumbnail image is displayed on the screen unit 11, and the user can select it through a click or a touch. By selecting a thumbnail image, the original image is accessed. An original image or a region of interest corresponding to the selected thumbnail image may be displayed on the entire screen.

If the user is interested in the original image, the corresponding thumbnail image will be selected more often to observe the corresponding image. Therefore, by selecting a thumbnail image and comparing the number of accesses to the corresponding original image or region of interest, it is possible to determine which original image or region of interest the user considers more important.

Accordingly, the importance determiner 13 collects the number of times the user selects a thumbnail image and accesses the corresponding original image or region of interest, and sets the image importance higher for the original image or region of interest with a relatively greater number of approaches. can be granted Here, the image importance is a variable representing the characteristics of each region of interest. The importance determiner 13 may assign an image importance in proportion to the number of times the user accesses each thumbnail image. However, the product of the weight and the number of accesses may be the image importance by assigning a weight according to a setting, and the value may be added to the image importance previously determined by other factors. A method of reflecting the number of accesses to the thumbnail image in the image importance may be set differently depending on how much the user is interested in the number of accesses to the thumbnail image.

As another example, the importance determination unit 13 may determine the image importance according to the time that the user monitors the original image or the region of interest.

Although the thumbnail generation unit 14 and the screen unit 11 will be described in detail later, selecting a thumbnail image by the user is an action intended to observe the original image or region of interest corresponding to the selected thumbnail image in more detail. Accordingly, when the user selects a thumbnail image, the screen unit 11 displays the corresponding original image or the image of the region of interest on the entire screen so that the user can observe the larger image.

The screen unit 11 may display a corresponding original image or an image of interest so as to occupy the center of the screen and display a separate thumbnail image in the surrounding blank space. In addition, the screen unit 11 displays an 'x'-shaped button or a toggle button at the corner of the original image or the image of the region of interest displayed on the entire screen, and when selected, returns to the screen listing the thumbnail images. In addition, any method that allows the user to better observe the corresponding original image or the image of the region of interest can be used.

The importance determining unit 13 may further include a timer for measuring the monitoring time after the user selects the thumbnail image, and may measure the monitoring time for the original image or the region of interest by the user using the timer. If the user stays on the original video or the screen monitoring the region of interest for a long time, it means that the user is interested in the corresponding image, so it can be seen that the importance of the image of the region of interest is related to the duration of the stay.

Accordingly, the importance determination unit 13 may assign a higher image importance to an original image or a region of interest for which the user has monitored the region of interest for a relatively longer time. Here, the image importance is a variable representing the characteristics of each region of interest. The importance determination unit 13 may assign an image importance in proportion to the time the user monitors the original image or the region of interest. However, the product of the weight and the monitoring time may be the image importance by assigning a weight according to a setting, and the value may be added to the image importance previously determined by other factors. A method of reflecting the monitoring time in the image importance may be set differently according to how much the user is interested in the monitoring time.

The thumbnail generator 14 receives information about the image importance and the region of interest after determining the importance of the image for each region of interest from the importance determiner 13 . The size of the thumbnail image is determined according to the importance of the received image, and the region of interest is converted into a thumbnail image of the determined size. As will be described later, the thumbnail generator 14 may determine the size of the thumbnail image according to the number of connected cameras 2 and 3, and update the size of the thumbnail image whenever the number of connected cameras 2 and 3 changes. can Accordingly, a thumbnail image according to the updated size may be generated. As described above, since a plurality of regions of interest may be extracted from one original image, a plurality of thumbnail images corresponding to the number of regions of interest may also be generated from one original image. Thumbnail images are generally smaller in size than the original region of interest or region of interest, but larger thumbnail images than the original region of interest or original image may be generated according to the importance of the image of the corresponding region of interest. Details of how the thumbnail generator 14 determines the thumbnail image size and generates the thumbnail image will be described later in detail in the description of FIGS. 2A to 3C .

The screen unit 11 collects thumbnail images generated by the thumbnail generator 14 and displays them on a single screen. If the user cannot check all the thumbnail images on a single screen and has to monitor through scrolling or turning pages, it is inconvenient, so all thumbnail images must be displayed on a single screen. Therefore, when the thumbnail generator 14 determines the size of the thumbnail image, this situation is taken into consideration so that when all the thumbnail images are collected, they can be entered into a single screen, and the screen unit 11 displays the thumbnail image on a single screen do.

In addition, the screen unit 11 may not immediately reflect the difference in the number and size of thumbnail images to be displayed. Therefore, the screen unit 11 can be configured to be updated at regular update intervals. The screen unit 11 may be updated at a set predetermined update period, but if the number of connected cameras 2 and 3 is different or the type of connected cameras 2 and 3 is different, the size, number and layout of the thumbnail images are also changed. Since it is to be changed, the screen unit 11 may be updated when the number or type of the connected cameras 2 and 3 is changed.

Hereinafter, a process of determining the thumbnail image size by the thumbnail generator 14 according to the number of cameras 2 and 3 will be described with reference to FIGS. 2A to 2E.

2a to 2e show layouts 40, 41, 42, 43, 44 displayed by dividing the screen according to the number of cameras 2 and 3 by the video display device 1 according to an embodiment of the present invention. it is a drawing

At least one camera 2 or 3 may be connected to the image display device 1 according to an embodiment of the present invention. Accordingly, when the plurality of cameras 2 and 3 are connected, the number of thumbnail images 400 to 440 to be displayed on the screen unit 11 also increases.

In FIGS. 2A to 2E , a layout of a single screen is assumed assuming that the plurality of cameras 2 and 3 connected to the image display device 1 according to an embodiment of the present invention are of the same type and have the same image importance. (40, 41, 42, 43, 44) is shown.

When two cameras 2 and 3 are connected to the video display device 1, the screen unit 11 divides the single screen into two as shown in FIG. A corresponding thumbnail image 400 may be arranged. The thumbnail generator 14 determines the size of the thumbnail image 400 so that the thumbnail image 400 can fit in a place where a single screen is divided into two halves. Although FIG. 2A shows the layout 40 in which the thumbnail images 400 are arranged left and right, the thumbnail images 400 may be arranged by dividing a single screen into two halves up and down.

Similarly, when 4 cameras 2 and 3 are connected to the video display device 1 (FIG. 2B), 6 cameras are connected (FIG. 2C), 9 cameras are connected (FIG. 2D), 16 cameras are connected. Layouts in the case of being connected (FIG. 2E) (41, 42, 43, 44) can be configured. The screen unit 11 divides a single screen into the number of connected cameras 2 and 3 to arrange thumbnail images 400 to 440, and the thumbnail generator 14 divides the divided layouts 40, 41, 42, The size of the thumbnail images 400 to 440 is determined so that the thumbnail images 400 to 440 can fit in 43 and 44 .

In this way, the process of determining the size and number of thumbnail images according to the number of connected cameras 2 and 3 and configuring the layout is a new process whenever the number of connected cameras 2 and 3 is changed due to connection or disconnection. It can be done. Therefore, whenever the number of connected cameras 2 and 3 is changed, the size and number of thumbnail images and the configuration of layout in which thumbnail images are arranged are dynamically changed.

3A to 3C are diagrams showing layouts 50, 51, and 52 displayed on the screen unit 11 by varying the size of thumbnails according to the importance of the video by the video display device 1 according to an embodiment of the present invention. .

Referring to FIG. 3A , the first thumbnail image 501 occupies a larger area than the second thumbnail image 502 . This is because the region of interest corresponding to the first thumbnail image 501 of FIG. 3A has a higher importance than the region of interest corresponding to the second thumbnail image 502 given by the importance determiner 13 .

As described above, the image importance of the region of interest is quantitatively calculated from various factors and transmitted to the thumbnail generator 14 . The thumbnail generator 14 determines the size of the thumbnail images 501 and 502 to be created by converting the region of interest according to the importance of the received image. At this time, the size of the thumbnail images 501 and 502 should be adjusted according to the ratio of the image importance while ensuring that the sum of the sizes of the thumbnail images 501 and 502 does not exceed the size of the entire screen. 3A shows a layout 50 in which thumbnail images 501 and 502 are arranged left and right, but a layout 50 in which thumbnail images 501 and 502 are arranged by dividing a single screen into two up and down directions is also possible.

Referring to FIG. 3B, a layout is formed in which first to fourth thumbnail images 511 to 514 are disproportionately divided into 4 quarters of a single screen and arranged (51), and each thumbnail image 511 to 514 has a different size. formation can be confirmed. This is because regions of interest corresponding to the thumbnail images 511 to 514 of FIG. 3B have different image importance levels assigned by the importance determination unit 13 .

As described above, the image importance of the region of interest is quantitatively calculated from various factors and transmitted to the thumbnail generator 14 . The thumbnail generator 14 determines the size of the thumbnail images 511 to 514 to be created by transforming the region of interest according to the importance of the received image. At this time, the size of the thumbnail images 511 to 514 must be adjusted according to the ratio of image importance so that the sum of the sizes of the thumbnail images 511 to 514 does not exceed the size of the entire screen. Although FIG. 3B shows a case of arranging a total of four thumbnail images 511 to 514 in up, down, left, and right directions, various methods are possible, such as arranging thumbnail images 511 to 514 by dividing a single screen into four up and down or left and right directions. do.

In the case of FIG. 3C, as in the case of FIGS. 3A to 3B, for a total of five thumbnail images 521 to 525, the size of the thumbnail images 521 to 525 is determined according to the difference in image importance of the corresponding region of interest. , a layout 52 is configured to display all of them on a single screen. In the method of arranging a total of five thumbnail images 521 to 525, a method of dividing the screen in a method different from that of FIG. 3C can also be used if the layout 52 that can be expressed in a single screen can be configured.

As described above, the video display device 1 according to an embodiment of the present invention has layouts (40, 41, 42, 43, 44, 50, 40, 44, 50, Sizes of the thumbnail images 400 to 525 may be determined and arranged according to 51 and 52. Therefore, the thumbnail generation unit 14 has layouts (40, 41, 42, 43, 44, 50, 51 , 52) may further include information about.

In FIGS. 3A to 3C , a method of arranging thumbnail images 501 to 525 according to a predetermined screen arrangement method according to the number of cameras 2 and 3 is described. However, there is also a method of dividing the region in which the thumbnail images 501 to 525 are arranged by dividing the image importance level of the corresponding region of interest, and arranging the thumbnail images 501 to 525 to occupy an area of the same size within the corresponding region. can be used For example, thumbnail images 501 to 525 corresponding to a region of interest having high image importance are disposed in an area from the leftmost side of a single screen to the center vertical line of the screen unit 11, and from the center vertical line to the rightmost center vertical line. Thumbnail images 501 to 525 corresponding to a region of interest having a low image importance may be disposed in the region. Thumbnail images 501 to 525 of a uniform size similar to the shape of FIGS. 2A to 2E can be arranged in the corresponding area.

Hereinafter, a method of setting a region of interest will be described in detail with reference to FIGS. 4 and 5 .

4 is a diagram illustrating a state in which the image display device 1 according to an embodiment of the present invention sets the regions of interest 620 and 621 and converts them into thumbnails.

Referring to FIG. 4 , it can be confirmed that the original image 61 is an image obtained from the fixed surveillance cameras 2 and 3 capturing a residential area with parking lots, driveways, and stairs. In the images of the monitoring cameras 2 and 3, the area that the user mainly wants to observe is not a house area where there is no movement, but a parking lot and driveway area where vehicles frequently come and go. In addition, a stair area where pedestrians mainly come and go and there is a risk of an accident may be an area that the user wants to mainly observe.

As such, in the original image 61 captured by the general fixed surveillance cameras 2 and 3 , a region in which a lot of movement occurs is often set as the region of interest 620 and 621 . Accordingly, the importance determining unit 13 may designate a region in which a motion of an object such as a vehicle or a pedestrian is detected by a certain amount or more as the region of interest 620 or 621 .

In FIG. 4 , a parking lot area where vehicles frequently move is cut out and set as an area of interest 620 , and a stair area where pedestrians move frequently is cut out and placed as another area of interest 621 . The importance determination unit 13 determines the importance of the image for these regions of interest 620 and 621, and the thumbnail generator 14 converts them into different thumbnail images 630 and 631 and transmits them to the screen unit 11 to create two Thumbnail images 630 and 631 are arranged according to the layout 60 of the screen unit 11 in the case of being present.

FIG. 5 is a diagram showing how the image display device 1 according to an embodiment of the present invention dwarfs an image captured by a fisheye camera and turns it into a thumbnail.

Referring to FIG. 5 , the original image obtained by the cameras 2 and 3 and transmitted to the receiving unit 12 and received by the receiving unit 12 is a fisheye image 71 . Therefore, even if the original image is displayed as it is, it is possible to check whether there is any shape, but since distortion occurs, it will be easier to observe if it is displayed after being corrected.

Correcting the distorted fisheye image 71 formed by the fisheye camera in this way is usually referred to as 'Distortion Calibration' or 'Dewarp'. Accordingly, it is performed through an appropriate formula using parameters such as the focal length of the fisheye lens or the position of the optical center.

The most common method for linear distortion-free mapping of cameras 2 and 3 is perspective projection ( ) method. This is a method of finding and mapping the position of a point in a perspective image captured by the general cameras 2 and 3. And as the simplest mapping function for a fisheye lens, a linear-scaled projection ( ) way. This is a method of finding the radial position of a point in the original image taken through a fisheye lens. In order to correct the distorted fisheye image 71, the actual fisheye image 71 must be transformed and mapped like a perspective image. Therefore, by solving the two simultaneous equations defining the above perspective mapping and fisheye mapping, and The distorted fisheye image 71 may be corrected by finding the relationship of .

In FIG. 5, the area that the user wants to observe is a place where each building is located. Accordingly, the importance determiner 13 may designate the corresponding region as the region of interest 712 , 713 , and 714 . However, regions in which the above-described object moves frequently may be designated as the regions of interest 712 , 713 , and 714 , but this is not limited to the above description.

The size of the regions set as the regions of interest 712 , 713 , and 714 is determined by the thumbnail generator 14 . However, since the regions of interest 712 , 713 , and 714 of the fisheye image 71 captured by the fisheye camera are captured by the fisheye camera, thumbnail images 72 , 73 , and 74 are generated by dwarfing them so that the user can easily observe them. Reference numerals 72, 73, and 74 denote thumbnail images formed by dwarfing the respective regions of interest 712, 713, and 714.

6 is a flowchart illustrating a process of configuring final layouts 40 , 41 , 42 , 43 , 44 , 50 , 51 , 52 , and 60 by the video display device 1 according to an embodiment of the present invention.

When the image display device 1 according to an embodiment of the present invention starts operating, it first performs a step of receiving an original image (S100). As described above, data that can be received is not limited to image data, and when the cameras 2 and 3 include a sensor, a sensor signal may be further received. In addition, since the ROI setting is affected by the type of the connected cameras 2 and 3, the receiver 12 further accepts information about which camera 2 and 3 the connected cameras 2 and 3 are.

After receiving the original video and related information, the corresponding information is transferred to the importance determining unit 13 to designate a region of interest (S200). In order to designate a region of interest, the types of cameras 2 and 3 are first determined. In the case of the medium and low resolution cameras 2 and 3, even if the entire original image is designated as the region of interest and observed as a thumbnail image, the entire image display device 1 is not burdened, so the entire original image is designated as the region of interest (S201). . In the case of the high-resolution cameras 2 and 3, by setting an area where the movement amount of the object is equal to or greater than a certain amount as the area of interest, the enlarged area of interest can be confirmed without excessive load on the image display device 1 (S202). In this flowchart, the method of setting the region of interest is determined based on the resolution of the cameras 2 and 3, but it is not limited thereto, and various methods such as a method of directly designating by a user or fixing to a certain region may be used.

After the region of interest is set, the importance determiner 13 determines the importance of the image for the region of interest and determines the size of the thumbnail image (S300). The factors determining the importance of the image are the number of cameras 2 and 3 connected to the video display device 1, the number of event detections, the number of times the user accesses the corresponding original video or region of interest by selecting a thumbnail video, and the user There may be monitoring time, etc. However, the factor determining the image importance is not limited thereto.

In addition, elements that are difficult to understand in a situation where the image processing device of the present invention has just started to operate, such as the number of times the user selects a thumbnail image and accesses the corresponding original image or region of interest, and the time the user has monitored the corresponding image, the image processing device It is a factor that can be reflected if you are still using it, and it is not something that needs to be considered from the beginning. Initially, the image importance contributions by corresponding factors will be the same for all regions of interest.

The size of the thumbnail image varies according to the image importance of the corresponding region of interest, and the layout (40, 41, 42, 43, 44, 50, 51, 52 , 60) must be adjusted so that the sum of the sizes of all thumbnail images is not greater than the size of the entire screen.

The region of interest generally appears in a rectangular shape, but there are cases where the region of interest extracted from the fisheye image 71 captured by the fisheye camera does not have a rectangular shape. Accordingly, it is checked whether the cameras 2 and 3 that have acquired the original image are fisheye cameras (S400), and if the fisheye cameras are correct, the region of interest is dwarfed to fit the rectangular frame (S401).

When the size of the thumbnail image is determined, the thumbnail generator 14 generates a thumbnail image according to the size of the region of interest (S500).

When the thumbnail image is generated, the screen unit 11 collects the thumbnail image and configures and displays the final layout (40, 41, 42, 43, 44, 50, 51, 52, 60) that can be displayed on a single screen. (S600).

Since the importance of the image of the region of interest and the portion that becomes the region of interest can be changed by various factors, the process shown in this flowchart can be repeated while the screen unit 11 is updated at regular intervals. Alternatively, when the number of connected cameras 2 and 3 is changed or the type of cameras 2 and 3 is changed, the display unit 11 may be updated and repeated.

Those skilled in the art to which the present invention pertains will understand that the present invention can be embodied in other specific forms without changing its technical spirit or essential features. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. The scope of the present invention is indicated by the following claims rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts should be interpreted as being included in the scope of the present invention. do.

Although the present invention has been described with respect to the preferred embodiments mentioned above, various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the scope of the appended claims will include such modifications and variations as long as they fall within the gist of the present invention.

1: Video display device
2, 3 : Camera
11: screen part
12: receiver
13: importance determining unit
14: Thumbnail generation unit
40, 41, 42, 43, 44, 50, 51, 52, 60: layout
61: original video
71: fisheye video
72, 73, 74, 400, 410, 420, 430, 440, 501, 502, 511, 512, 513, 514, 521, 522, 523, 524, 525, 630, 631: Thumbnail video
620, 621, 712, 713, 714: region of interest

Claims (6)

a receiving unit for receiving an original image acquired by at least one camera;
an importance determination unit determining an importance of the received original video;
a thumbnail generation unit that dynamically determines individual sizes of each thumbnail image of the original video according to the number of the at least one camera and the determined importance, and generates thumbnail images according to the determined individual sizes; and
A screen unit for collecting the generated thumbnail images and displaying them on a single screen,
When the number of the at least one camera is changed, the thumbnail generation unit dynamically determines the size of the changed thumbnail image of the original video according to the changed number of the at least one camera, and generates a changed thumbnail image according to the changed size Video display device that generates. According to claim 1,
The importance determiner determines an image importance for a region of interest among the original images;
The thumbnail generating unit determines a size of a thumbnail image of the region of interest according to the determined image importance, and generates a thumbnail image according to the determined size. According to claim 2,
The video display device of claim 1 , wherein the image importance is determined by a number of accesses to the original video, a monitoring time for the original video, or an event occurrence frequency of the original video. According to claim 2,
The region of interest is a region in which movement of an object occurs in the corresponding original image. According to claim 2,
The thumbnail image is an image obtained by dewarping the region of interest when a camera that has acquired the corresponding original image is a fisheye camera. According to claim 2,
The screen unit updates the single screen at regular update intervals.

Images