CN114786064B - Method and device for playing back video, electronic equipment and storage medium - Google Patents
Method and device for playing back video, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114786064B CN114786064B CN202210247261.8A CN202210247261A CN114786064B CN 114786064 B CN114786064 B CN 114786064B CN 202210247261 A CN202210247261 A CN 202210247261A CN 114786064 B CN114786064 B CN 114786064B
- Authority
- CN
- China
- Prior art keywords
- image
- frame
- window
- region
- tracking object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 32
- 238000012544 monitoring process Methods 0.000 claims abstract description 51
- 238000012545 processing Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 9
- 238000009432 framing Methods 0.000 claims 1
- 230000008859 change Effects 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 9
- 230000002159 abnormal effect Effects 0.000 description 6
- 230000001360 synchronised effect Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The embodiment of the application provides a method, a device, electronic equipment and a storage medium for playing back video, wherein the method determines a second image from a first image, the second image comprises a tracking object, and according to the second image and/or the tracking object, the interested region of each frame of image is determined from multiple frames of images of a monitoring video, the interested region of each frame of image is amplified and displayed, and a user can more clearly observe the picture change of a designated region under the same picture size, so that the user can focus the interested region change of the multiple frames of images, and the user can quickly judge and position a playback time point by comparing the interested regions of each frame of image.
Description
Technical Field
The application belongs to the technical field of video monitoring, and particularly relates to a method and device for playing back video, electronic equipment and a storage medium.
Background
Monitoring devices have become a common device in people's lives, and in many public or private places, in order to prevent various possible abnormal situations, people often arrange monitoring cameras in different places. The monitoring camera can capture video and store the video so that subsequent people can review the abnormal situation occurrence process through playing back the video.
It is generally possible to locate a point in time corresponding to an abnormal situation by browsing the entire video, such as fast playing video, but browsing the entire video is time consuming. In order to save time, thumbnails at different time points can be displayed simultaneously, and the time point corresponding to the abnormal situation is located by looking at the thumbnail, but displaying multiple thumbnails simultaneously may result in that the image is too small to clearly observe the image content.
Disclosure of Invention
In view of the above technical problems, embodiments of the present application provide a method, an apparatus, an electronic device, and a storage medium for playing back video, which can clearly observe image content when a time point corresponding to an abnormal situation is located in a thumbnail manner.
In a first aspect, an embodiment of the present application provides a method for playing back video, the method including:
Displaying a first image, wherein the first image is a frame of image in the monitoring video;
detecting a first operation, and determining a second image from the first image based on the first operation, the second image having a size smaller than that of the first image, the second image including a tracking object;
According to the second image and/or the tracking object, determining an interested area of each frame of image from multiple frames of images of the monitoring video;
Amplifying and displaying a region of interest of each frame of image;
Detecting a second operation, and determining a playing time point of the monitoring video based on the second operation, wherein the second operation is an operation of selecting the region of interest by a user, and the playing time point of the monitoring video is a time point corresponding to the region of interest selected by the user.
With reference to the first aspect, in certain implementation manners of the first aspect, determining, from the second image, a region of interest of each frame of image from multiple frames of images of the surveillance video includes: and determining the region of interest of each frame of image according to the position of the second image in the first image, wherein the position of the region of interest of each frame of image in each frame of image is the same as the position of the second image in the first image.
With reference to the first aspect, in certain implementation manners of the first aspect, determining, according to a tracking object, a region of interest of each frame of image from multiple frames of images of a surveillance video includes: and determining a region of interest of each frame of image according to the position of the tracking object in each frame of image, wherein the region of interest comprises the tracking object.
With reference to the first aspect, in certain implementation manners of the first aspect, determining, from the second image and the tracking object, a region of interest of each frame of image from multiple frames of images of the surveillance video includes: and determining a region of interest of each frame of image according to the position of the tracking object in each frame of image and the size of the second image, wherein the region of interest comprises the tracking object, and the size of the region of interest is the same as that of the second image.
With reference to the first aspect and the foregoing implementation manner, in some implementation manners of the first aspect, the first image is selected by a user from multiple frame images of the surveillance video.
With reference to the first aspect and the foregoing implementation manners, in some implementation manners of the first aspect, the first image may also be determined according to a default setting.
With reference to the first aspect and the foregoing implementation manners, in some implementation manners of the first aspect, a size of a region of interest of each frame of the enlarged image is the same as an original size of each frame of the image.
In a second aspect, an embodiment of the present application provides an apparatus for playing back video, the apparatus comprising:
the first display module is used for displaying a first image, wherein the first image is a frame of image in the monitoring video;
A first processing module configured to detect a first operation, determine a second image from the first image based on the first operation, the second image having a size smaller than a size of the first image, the second image including a tracking object; according to the second image and/or the tracking object, determining an interested area of each frame of image from multiple frames of images of the monitoring video;
the second display module is used for magnifying and displaying the interested area of each frame of image;
the second processing module is used for detecting a second operation, determining a playing time point of the monitoring video based on the second operation, wherein the second operation is an operation of selecting the region of interest by a user, and the playing time point of the monitoring video is a time point corresponding to the region of interest selected by the user.
In a third aspect, an embodiment of the present application further provides an electronic device, including a memory and a processor, where the memory stores a computer program, and the processor implements the method for playing back video according to the first aspect when executing the computer program.
In a fourth aspect, embodiments of the present application also provide a computer readable storage medium storing computer instructions that, when run on a computer, cause the computer to perform a method of playing back video as described in the first aspect.
In a fifth aspect, embodiments of the present application also provide a computer program product comprising a computer program for implementing a method of playing back video as described in the first aspect when the computer program product is run on a computer.
According to the method for playing back the video, provided by the embodiment of the application, the second image is determined from the first image, the second image comprises the tracking object, the interested region of each frame of image is determined from the multi-frame image of the monitoring video according to the second image and/or the tracking object, and the interested region of each frame of image is enlarged and displayed, so that a user can focus on the interested region change of the multi-frame image, the user can more clearly observe the picture change of the appointed region under the same picture size, and the user can rapidly judge and position the playback time point by comparing the interested region of each frame of image.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of a method 100 for playing back video according to an embodiment of the present application;
FIG. 2 is a schematic diagram of displaying an image grid pattern according to an embodiment of the present application;
FIG. 3 is a schematic view of a window area and a navigator according to an embodiment of the present application;
Fig. 4 (a) is a schematic display diagram of a window area and a navigator before a user performs a frame selection operation according to an embodiment of the present application;
fig. 4 (b) is a schematic display diagram of a window area and a navigator after a user performs a frame selection operation according to an embodiment of the present application;
fig. 5 (a) is a schematic display diagram of a window area and a navigator before a user performs a frame selection operation according to an embodiment of the present application;
Fig. 5 (b) is a schematic view showing a window area and a navigator after a user performs a frame selection operation according to an embodiment of the present application;
FIG. 6 is a schematic diagram of an apparatus 600 according to an embodiment of the present application;
Fig. 7 is a schematic structural diagram of an electronic device 700 according to an embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present application more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
The terms "first" and "second" are used below for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the embodiments of the present application, unless otherwise indicated, the meaning of "a plurality" means two or more, and "at least one", "one or more" means one, two or more.
Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.
The method for playing back the video is suitable for monitoring the playback scene of the video, for example, the playback scene of the video is checked in a picture thumbnail mode, particularly the playback scene with a relatively large monitoring view angle and a relatively small monitoring target occupation ratio in the monitoring range.
As shown in fig. 1, an embodiment of the present application provides a method 100 for playing back video, where the method 100 includes at least the following steps:
s101, displaying a first image, wherein the first image is a frame of image in the monitoring video.
S102, detecting the first operation, and determining a second image from the first image based on the first operation, wherein the size of the second image is smaller than that of the first image, and the second image comprises a tracking object.
S103, according to the second image and/or the tracking object, determining the interested area of each frame of image from the multi-frame images of the monitoring video.
S104, amplifying and displaying the interested area of each frame of image.
S105, detecting a second operation, and determining a playing time point of the monitoring video based on the second operation, wherein the second operation is an operation of selecting the region of interest by a user, and the playing time point of the monitoring video is a time point corresponding to the region of interest selected by the user.
In the embodiment of the application, firstly, the video is monitored, namely, the video stored by the monitoring equipment. The monitoring video may be obtained locally from the device, or may be obtained from a cloud server, or may be obtained by other means, which is not limited in this application.
And when the monitoring playback video is checked, extracting multi-frame images from the monitoring video according to a certain time interval, and displaying the extracted multi-frame images on the electronic equipment according to a certain sequence. In one implementation, an image grid mode may be selected to display a multi-frame image, where the image grid mode is to divide a display area of the electronic device into a plurality of windows for displaying images, and the windows are arranged in a left-to-right, top-to-bottom order, with each window displaying a thumbnail of one frame of image. Therefore, the user can view the thumbnails at different time points, quickly check the video clips to be played back through the picture content of each frame of displayed image, and locate the time point of playback.
For example, as shown in fig. 2, in the display schematic diagram of an image grid mode provided in the embodiment of the present application, it is assumed that the number of windows in a display area of an electronic device is 9, 9 frames of images are extracted from a surveillance video, a time interval between each frame of images is 60 minutes, a starting time is 12:00:00, a window in a first row and a first column of the display area of the electronic device is a first window, the first frame of images is displayed in the first window, a time point corresponding to the first frame of images is 12:00:00, a window in a first row and a second column of images is a second window, the second frame of images is displayed in the second window, a time point corresponding to the second frame of images is 13:00:00, and so on. Thus, each frame of image may correspond to a time point, and the user may locate a time point, and then the electronic device starts playing the monitoring video from the time point, for example, the user clicks on the first frame of image, so that the electronic device starts playing back the monitoring video from 12:00:00, where the region included in the thumbnail displayed in each window may be the entire monitoring region.
When the monitoring video is viewed in the image grid mode, the display area of each window is smaller than the entire display area, and thus the image frame is small, the content of the image may not be clearly observed, relative to displaying one image on the entire display area of the electronic device. In particular, the monitoring view angle is relatively large, the proportion of a monitoring target to be positioned in the monitoring range is relatively small, and the change of the target is mainly concentrated in a local scene. If the image changes locally, the thumbnails at a plurality of time points may look substantially identical to each other, and the local feature changes may not be clearly represented in the image grid mode, the positioning time points where the thumbnails cannot be directional may be difficult for the user to quickly position through the image grid mode.
In the embodiment of the application, the interested area of each frame of image in the multi-frame image can be determined, the interested area comprises a tracking object, wherein the tracking object is a main body with abnormal conditions, and the monitoring video is played back to check the change state of the tracking object, for example, if a vehicle collides with a roadside guard rail, the vehicle is the tracking object, for example, if two pedestrians collide at the roadside, the two pedestrians are the tracking object. The size of the region of interest is smaller than the original size of the image, i.e. the region of interest per frame of image is a local region per frame of image.
And amplifying and displaying the region of interest of each frame of image, for example, amplifying the region of interest to the same size as the original image, updating the image displayed by each window to the region of interest of the image, for example, displaying a first frame of image in a first window, amplifying and displaying the region of interest of the first frame of image in the first window, so that the first window displays the region of interest of the first frame of image, and in the same window, the region of interest occupies a larger proportion in the same picture size, a user can easily pay attention to local region changes, and can clearly observe the changes of the tracking object, and further, the playback time point of the monitoring video can be rapidly determined according to the amplified region of interest of each frame of image, and further, the monitoring video can be played back from the playback time point.
In the embodiment of the application, the display area of the electronic equipment is divided into two parts, the first part is a window area, the multi-frame image is displayed in an image grid mode, the second part is a navigator, the navigator can provide selectable operation for a user, and the operation of the user is detected to determine the interested area selected by the user. As shown in fig. 3, the navigator portion is composed of two modules, a bottom module representing an original video image frame and a top module representing a display range of a thumbnail of a window area with respect to the original video image by a rectangular frame, and the user can set the display range of the thumbnail by controlling the position and size of the rectangular frame with respect to the bottom module.
The original video image displayed by the bottom module may be an image determined according to a default setting, for example, an image displayed by a window of a first row and a first column of the window area is defaulted to an image displayed by the navigator bottom module. Or the original video image displayed by the bottom module may be one frame of image selected by the user from multiple frames of images of the monitoring video in the window area, for example, after the user observes the multiple frames of images of the window area, dragging the image of the second row and the second column to the navigator, and then displaying the image of the second row and the second column by the navigator bottom module. The bottom module may not display an actual image, but is only used for comparing with the top window, and controlling the size and position of the display area.
The electronic device may first display a window area and the user may perform an operation to turn on the navigator, such as clicking a navigator button, which the electronic device detects, and then display the navigator portion. After the navigator is opened, the rectangular selection frame can be displayed by default, or after the frame selection operation of the user is detected, the rectangular selection frame is displayed, wherein the frame selection operation of the user corresponds to the first operation. The original video image displayed by the bottom module is recorded as a first image, a user selects a certain part of area on the first image in a frame mode, the electronic equipment detects the frame selection operation of the user, the certain part of area selected by the user, namely the area corresponding to the rectangular frame selection, is determined to be a second image, the size of the second image is smaller than that of the first image, and the second image comprises a tracking object.
When the user is not satisfied with the display content of the second image after one frame selection operation, the position and size of the rectangular frame may be adjusted. For example, the user may move the mouse to the position of the rectangular box, click and drag the rectangular box, and move the rectangular box within the range of the bottom first image, so as to adjust the area selected by the rectangular box. For example, the user may adjust the size of the rectangular box by an edge or corner of the rectangular box, such as clicking on a corner and dragging a mouse, moving inward to reduce the size of the rectangular box, or moving outward to expand the size of the rectangular box. In the embodiment of the application, when scaling, the rectangular selection frames are scaled according to equal proportion, and the aspect ratio of the top rectangular selection frame is consistent with the aspect ratio of the bottom image.
After the second image is determined, the electronic device determines an interested area of each frame of image in the window area multi-frame image according to the information of the second image, and uniformly adjusts the display area of the thumbnail of the window area multi-frame image to be the interested area, wherein the information of the second image comprises the size of the second image, the position of the second image in the first image and the content of the second image, and the content of the second image is a tracking object. And when the user adjusts the position and the size of the rectangular selection frame each time, the electronic equipment synchronously adjusts the display area of the thumbnail of the window area, so that the user can conveniently check the adjustment effect.
In one implementation, the electronic device determines, according to the position of the second image in the first image, a region of interest of each frame of image in the window area multi-frame image, where the position of the region of interest of each frame of image in each frame of image is the same as the position of the second image in the first image. The region of interest of each frame of image is then enlarged to the same size as the original image, and the image displayed by the thumbnail of each window is updated to the region of interest of the image.
For example, as shown in (a) of fig. 4, before the user performs the frame selection operation, the default rectangular frame is the same as the size of the bottom image, the window area displays the original size of each frame of image, after the user performs the frame selection operation, as shown in (b) of fig. 4, the position of the second image in the first image is the range in which the lower left rectangular frame 1-2 is located, the region of interest of each frame of image is the range in which the lower left rectangular frame 1-2 is located, the region of interest is enlarged to the same as the original size of the image, and the region of interest in each frame of image is displayed in the window area.
In another implementation, the electronic device determines a region of interest for each frame of image based on a position of the tracking object in each frame of image, the region of interest including the tracking object. After determining the second image, the electronic device detects the tracked object in the second image and marks the tracked object. The electronic equipment detects whether a tracking object exists in each frame of image of the window area, when the tracking object exists in the image of the window area, the electronic equipment takes the position of the tracking object as the center, expands a preset range outwards, and determines an interested area of the image. When no tracking object exists in the image of the window area, the interested area of the image is determined according to the position of the second image in the first image. At this time, the positions of the regions of interest of each frame of the image may be different, and the sizes of the regions of interest may also be different.
Furthermore, the size of the region of interest may be determined from the size of the second image. For example, the electronic device detects whether or not a tracking object exists in each frame of image of the window area, and when the tracking object exists in the image of the window area, the electronic device determines the region of interest of the image by taking the position of the tracking object as the center and taking the size of the second image as the size of the region of interest.
For example, as shown in (a) of fig. 5, there is no tracking object in the three frames of images of the first line, there is a tracking object in the other images, and the positions of the tracking objects are respectively in the upper left corner, the lower right corner and the middle of the images, and after the user performs the frame selection operation, the region of interest of each frame of image determined by the electronic device is shown in (b) of fig. 5, where the region of interest of the three frames of images of the first line is the same as the position of the second image. The size of the region of interest of the other image is the same as the size of the second image but the location may not be.
After adjusting the display area of the thumbnail of the window area to the region of interest, the user may observe the image content displayed by each window and determine a playback time point, for example, the user may determine to play back the monitoring video from the image of the first column of the second row, at this time, the user may perform an operation of clicking the image of the first column of the second row, corresponding to the second operation, the electronic device detects the second operation, determines, based on the second operation, the time point corresponding to the image of the first column of the second row as the play time point of the monitoring video, and then the electronic device starts playing the monitoring video from the time point corresponding to the image of the first column of the second row.
Through the steps, when the monitoring video is played back, the electronic equipment can display the thumbnails of the multi-frame images at the same time, the display range of the thumbnails of the multi-frame images is updated to the region of interest in a unified way through determining the region of interest of each frame of image, so that the local display space of the thumbnails is larger, a user can pay more attention to the change of the tracking object in the local region, and therefore the time point of playing back is determined quickly.
In addition, after determining the playback time point, when the electronic device plays the monitoring video, if necessary, the user can select a new region of interest again through the image grid mode according to the method, at this time, before the user performs the frame selection operation, the rectangular frame of the navigator can be displayed by default based on the previous operation, the user can position the playback time point according to the new region of interest range selected by the frame, the time is further saved, and the time point range is reduced, so that the method provided by the application can be used more flexibly.
In addition, the method provided by the embodiment of the application can enlarge the single thumbnail at the navigator part, so that the display size of Shan Zhangsu thumbnail is larger, and the user can more easily see the details of the image; the method provided by the embodiment of the application can be matched with a screen with larger resolution and physical size, so that the physical size of the picture thumbnail is larger, and the aim of checking details can be achieved.
In summary, by determining the region of interest and displaying the region of interest in an enlarged manner, the method provided by the embodiment of the application enables the user to focus on the local region change of the monitoring image, and the user can more clearly observe the image change of the designated region under the same image size, so that the user can rapidly judge and position the playback time point by comparing the thumbnails of different time points.
The method for playing back video provided by the embodiment of the application is described above, and the device and the electronic equipment provided by the embodiment of the application are described below.
Fig. 6 is a schematic diagram of an apparatus 600 for playing back video according to an embodiment of the present application, where the apparatus 600 includes a first display module 601, a first processing module 602, a second display module 603, and a second processing module 604.
The first display module 601 is configured to display a first image, where the first image is a frame of image in the monitoring video;
A first processing module 602, configured to detect a first operation, determine a second image from the first image based on the first operation, where a size of the second image is smaller than a size of the first image, and the second image includes a tracking object; according to the second image and/or the tracking object, determining an interested area of each frame of image from multiple frames of images of the monitoring video;
a second display module 603 for magnifying and displaying a region of interest of each frame of image;
The second processing module 604 is configured to detect a second operation, determine a playing time point of the surveillance video based on the second operation, where the second operation is an operation of selecting the region of interest by the user, and the playing time point of the surveillance video is a time point corresponding to the region of interest selected by the user.
In some implementations, the first processing module 602 is further configured to determine a region of interest of each frame of image according to a position of the second image in the first image, where the position of the region of interest of each frame of image in each frame of image is the same as the position of the second image in the first image.
In some implementations, the first processing module 602 is further configured to determine a region of interest of each frame of image according to a position of the tracking object in each frame of image, where the region of interest includes the tracking object.
In some implementations, the first processing module 602 is further configured to determine a region of interest of each frame of image based on a position of the tracking object in each frame of image and a size of the second image, where the region of interest includes the tracking object, and the size of the region of interest is the same as the size of the second image.
Wherein the first image is selected by a user from a plurality of frame images of the surveillance video.
The size of the region of interest of each frame of the enlarged image is the same as the original size of each frame of the image.
It should be appreciated that the apparatus 600 of embodiments of the present application may be implemented by an application-specific integrated circuit (ASIC), a programmable logic device (programmable logic device, PLD), which may be a complex program logic device (complex programmable logical device, CPLD), a field-programmable gate array (FPGA) GATE ARRAY, a generic array logic (GENERIC ARRAY logic, GAL), or any combination thereof. The method for playing back video shown in fig. 1 may also be implemented by software, and when the method for playing back video shown in fig. 1 is implemented by software, the apparatus 600 and its respective modules may also be software modules.
Fig. 7 is a schematic structural diagram of an electronic device 700 according to an embodiment of the present application. As shown in fig. 7, the device 700 includes a processor 701, a memory 702, a communication interface 703, and a bus 704. The processor 701, the memory 702, and the communication interface 703 communicate via the bus 704, or may communicate via other means such as wireless transmission. The memory 702 is used for storing instructions, and the processor 701 is used for executing the instructions stored by the memory 702. The memory 702 stores program code 7021, and the processor 701 can call the program code 7021 stored in the memory 702 to execute the method of playing back video shown in fig. 1.
It should be appreciated that in embodiments of the present application, the processor 701 may be a CPU, and the processor 701 may also be other general purpose processors, digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or any conventional processor or the like.
The memory 702 may include read only memory and random access memory and provides instructions and data to the processor 701. The memory 702 may also include non-volatile random access memory. The memory 702 may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an erasable programmable ROM (erasable PROM), an electrically erasable programmable EPROM (EEPROM), or a flash memory. The volatile memory may be random access memory (random access memory, RAM) which acts as external cache memory. By way of example, and not limitation, many forms of RAM are available, such as static random access memory (STATIC RAM, SRAM), dynamic Random Access Memory (DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate synchronous dynamic random access memory (double DATA DATE SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (ENHANCED SDRAM, ESDRAM), synchronous link dynamic random access memory (SYNCHLINK DRAM, SLDRAM), and direct memory bus random access memory (direct rambus RAM, DR RAM).
The bus 704 may include a power bus, a control bus, a status signal bus, and the like in addition to a data bus. But for clarity of illustration, the various buses are labeled as bus 704 in fig. 7.
The above embodiments may be implemented in whole or in part by software, hardware, firmware, or any other combination. When implemented in software, the above-described embodiments may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded or executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more sets of available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. The semiconductor medium may be a Solid State Disk (SSD) STATE DRIVE.
The above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.
Claims (5)
1. A method of playing back video, applied to an electronic device, characterized in that a display area of the electronic device is divided into two parts, a first part is a window area, multiple frame images extracted from a monitoring video at a certain time interval are displayed in an image grid mode, the image grid mode is to divide the window area of the electronic device into a plurality of windows for displaying images, each window displays a thumbnail of a frame of image, a second part is a navigator, the navigator part is composed of a bottom module and a top module, the bottom module represents an original video image picture, the top module represents a display range of an interested area of an image in a window selected by a user relative to the original video image by using a rectangular selection frame, and the user sets the display range of the interested area by controlling the position and the size of the rectangular selection frame relative to the bottom module, the method comprising:
A user selects one frame of image from multiple frames of images of a monitoring video in a window area, and the selected one frame of image is displayed on a bottom module of a navigator to be used as a first image;
Detecting a first operation of selecting a frame on a first image by a user based on the rectangular frame, and determining a second image from the first image based on the first operation, wherein the size of the second image is smaller than that of the first image, and the second image comprises a tracking object;
Determining an interested area of each frame of image from the multi-frame images displayed in the window area according to the second image and/or the tracking object; detecting whether the tracking object exists in the image displayed by each window, and when the tracking object exists in the image displayed by each window, taking the position of the tracking object as the center, expanding a preset range outwards and determining an interested area of the image; when the tracking object is not in the images displayed by the window, determining a region of interest of the images according to the position of the second image in the first image;
The interested area of each frame of image displayed by the window is enlarged and displayed, specifically: amplifying the region of interest to the same size as the original video image, and updating the image displayed by each window into the amplified region of interest of the image;
detecting a second operation, and determining a playing time point of the monitoring video based on the second operation, wherein the second operation is an operation of selecting one frame of image in a plurality of frames of images in a window area by a user, and the playing time point of the monitoring video is a time point corresponding to the one frame of image selected by the user.
2. The method of claim 1, wherein determining the region of interest of each frame of image from the plurality of frames of images displayed in the window region based on the second image and the tracking object comprises:
And determining a region of interest of each frame of image according to the position of the tracking object in each frame of image and the size of the second image, wherein the region of interest comprises the tracking object, and the size of the region of interest is the same as the size of the second image.
3. An apparatus for playing back video for implementing the method for playing back video according to claim 1 or 2, characterized in that the apparatus comprises:
The first display module is used for selecting one frame of image from the multi-frame images of the monitoring video in the window area by a user, and displaying the selected one frame of image on the bottom module of the navigator to serve as a first image;
The first processing module is used for detecting a first operation of framing a user on a first image based on the rectangular frame, and determining a second image from the first image based on the first operation, wherein the size of the second image is smaller than that of the first image, and the second image comprises a tracking object; determining an interested area of each frame of image from the multi-frame images displayed in the window area according to the second image and/or the tracking object; detecting whether the tracking object exists in the image displayed by each window, and when the tracking object exists in the image displayed by each window, taking the position of the tracking object as the center, expanding a preset range outwards and determining an interested area of the image; when the tracking object is not in the images displayed by the window, determining a region of interest of the images according to the position of the second image in the first image;
The second display module is used for magnifying and displaying the interested area of each frame of image displayed by the window, and specifically comprises the following steps: amplifying the region of interest to the same size as the original video image, and updating the image displayed by each window into the amplified region of interest of the image;
The second processing module is used for detecting a second operation, and determining a playing time point of the monitoring video based on the second operation, wherein the second operation is an operation of selecting one frame of image in a plurality of frames of images in a window area by a user, and the playing time point of the monitoring video is a time point corresponding to the one frame of image selected by the user.
4. An electronic device, comprising: a memory storing a computer program and a processor implementing the method according to claim 1 or 2 when the processor executes the computer program.
5. A computer readable storage medium storing computer instructions which, when run on an electronic device, cause the electronic device to perform the method of claim 1 or 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210247261.8A CN114786064B (en) | 2022-03-14 | 2022-03-14 | Method and device for playing back video, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210247261.8A CN114786064B (en) | 2022-03-14 | 2022-03-14 | Method and device for playing back video, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114786064A CN114786064A (en) | 2022-07-22 |
| CN114786064B true CN114786064B (en) | 2024-08-13 |
Family
ID=82422933
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210247261.8A Active CN114786064B (en) | 2022-03-14 | 2022-03-14 | Method and device for playing back video, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114786064B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112752127A (en) * | 2019-10-30 | 2021-05-04 | 腾讯科技（深圳）有限公司 | Method and device for positioning video playing position, storage medium and electronic device |
| WO2021236296A1 (en) * | 2020-05-20 | 2021-11-25 | Qualcomm Incorporated | Maintaining fixed sizes for target objects in frames |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7594177B2 (en) * | 2004-12-08 | 2009-09-22 | Microsoft Corporation | System and method for video browsing using a cluster index |
| US10645344B2 (en) * | 2010-09-10 | 2020-05-05 | Avigilion Analytics Corporation | Video system with intelligent visual display |
| TWI578798B (en) * | 2015-11-12 | 2017-04-11 | 晶睿通訊股份有限公司 | Method of displaying surveillance video and computer program product therefor |
| US20170244959A1 (en) * | 2016-02-19 | 2017-08-24 | Adobe Systems Incorporated | Selecting a View of a Multi-View Video |
| CN109121000A (en) * | 2018-08-27 | 2019-01-01 | 北京优酷科技有限公司 | A kind of method for processing video frequency and client |
| EP3894995A2 (en) * | 2018-12-14 | 2021-10-20 | Apple Inc. | Gaze-driven recording of video |
| CN111818312B (en) * | 2020-08-25 | 2021-06-04 | 北京中联合超高清协同技术中心有限公司 | Ultra-high-definition video monitoring conversion device and system with variable vision field |
| CN112162683A (en) * | 2020-09-25 | 2021-01-01 | 珠海格力电器股份有限公司 | Image amplification method and device and storage medium |
| CN112866817B (en) * | 2021-01-06 | 2022-10-14 | 浙江大华技术股份有限公司 | Video playback method, device, electronic device and storage medium |
| CN114117120A (en) * | 2021-11-23 | 2022-03-01 | 上海赛连信息科技有限公司 | Video file intelligent index generation system and method based on content analysis |
-
2022
- 2022-03-14 CN CN202210247261.8A patent/CN114786064B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112752127A (en) * | 2019-10-30 | 2021-05-04 | 腾讯科技（深圳）有限公司 | Method and device for positioning video playing position, storage medium and electronic device |
| WO2021236296A1 (en) * | 2020-05-20 | 2021-11-25 | Qualcomm Incorporated | Maintaining fixed sizes for target objects in frames |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114786064A (en) | 2022-07-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8570347B2 (en) | Electronic device and method for image editing | |
| US20150341563A1 (en) | Method for generating thumbnail image and electronic device thereof | |
| WO2021243788A1 (en) | Screenshot method and apparatus | |
| CN106709063A (en) | Method for viewing pictures and mobile terminal | |
| US20070201833A1 (en) | Interface for defining aperture | |
| CN112308859A (en) | Method and device for generating thumbnail, camera and storage medium | |
| US11127141B2 (en) | Image processing apparatus, image processing method, and a non-transitory computer readable storage medium | |
| CN113259742B (en) | Video bullet screen display method and device, readable storage medium and computer equipment | |
| CN112911152A (en) | Preview image generation method, device, equipment and storage medium | |
| US10304232B2 (en) | Image animation in a presentation document | |
| CN110443772B (en) | Picture processing method and device, computer equipment and storage medium | |
| CN114786064B (en) | Method and device for playing back video, electronic equipment and storage medium | |
| US10534505B2 (en) | Technique for preventing unnecessary overlap of user interfaces | |
| CN113891040B (en) | Video processing method, device, computer equipment and storage medium | |
| CN113312949A (en) | Video data processing method, video data processing device and electronic equipment | |
| US10965858B2 (en) | Image processing apparatus, control method thereof, and non-transitory computer-readable storage medium for detecting moving object in captured image | |
| CN113112495A (en) | Abnormal image processing method and device, thermal imaging equipment and storage medium | |
| CN112820232A (en) | Data processing method and device | |
| US11361797B2 (en) | Moving image reproduction apparatus, moving image reproduction method, moving image reproduction system, and storage medium | |
| CN114710618A (en) | Method and device for previewing spliced image and electronic equipment | |
| US20230018368A1 (en) | Method for improving display of components or types of components within surveillance videos, electronic device employing method, and computer readable storage medium | |
| CN112584217A (en) | Picture identification method, device and system | |
| US9384527B2 (en) | Electronic device and image displaying method | |
| CN116431050B (en) | View display method and device and electronic equipment | |
| WO2018059453A1 (en) | Image quality rating method, device and terminal apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |