CN116820286B

CN116820286B - Control method and system of multi-window display

Info

Publication number: CN116820286B
Application number: CN202311072585.3A
Authority: CN
Inventors: 陆长虹; 王聪
Original assignee: Shenzhen Jld Display Expert Co ltd
Current assignee: Shenzhen Jld Display Expert Co ltd
Priority date: 2023-08-24
Filing date: 2023-08-24
Publication date: 2024-01-19
Anticipated expiration: 2043-08-24
Also published as: CN116820286A

Abstract

A method of manipulating a multi-window display, comprising: the object window control method F comprises a multi-window display control data structure ST_MOD, a display window marking control method SF and a multi-window menu area position self-adaption method Sp based on the ST_MOD structure, wherein the OSD object display window self-adaption method is used for switching main object windows by moving a main control OSD by taking a display window as a unit, the OSD position is self-adaptive along with the main object windows, in a non-association window mode, only the main object window of the main control OSD menu can respond to the adjustment of display attributes, the visual effect that the OSD is interacted and controlled on a window is realized when the OSD is arranged in a certain window, and in an association window mode, the main object and the association object window respond to the adjustment of the display attributes through the main control OSD, so that the adjustment and the control of the display attributes of the windows are more visual and humanized.

Description

Control method and system of multi-window display

Technical Field

The invention relates to a control method and a system of a multi-window display, in particular to an interactive technology for the multi-window partition same-screen display based on self-adapting of the position of a window operated by a menu interface, and the configuration of window display attributes of certain specific windows based on window object marks.

Background

The conventional display is in a single window mode or a multi-window mode, when the display attribute of the display is regulated through a menu, either all display windows on the display can be integrally regulated or configured, or related object windows can be designated for single regulation, but the user needs to enter a menu page item first, jump into corresponding options after a plurality of operations to select a target window, and then regulate the display related attribute. Obviously, the two modes are very inconvenient for the display of the multi-window display in the window control application, are not intuitive in the interactive operation, and do not have the display information or state of the windows simultaneously displayed by the multiple OSD partitions under the multiple windows. For example, the default position of the OSD of the conventional display is set in a certain area of the screen, and the actual display attribute to be adjusted can be a sub-display window located in other areas on the display screen, so that when the related display attribute of the different area display window is adjusted by the OSD, the interactive control intuitiveness is not strong, and the operation flow and steps for selecting the target window are relatively complicated. In addition, if the display attributes of some windows in the multiple windows are required to be copied or exchanged, the display attributes can be realized through a series of repeated UI operations, so that the design of the more flexible and visual multiple-window operation technology based on the OSD interaction interface has the necessity.

In summary, the present invention provides a method and a system for controlling a multi-window display to solve the above-mentioned problems.

Disclosure of Invention

The invention aims to overcome the defects of the prior art and provide a control method of a multi-window display.

In order to solve the technical problems, the invention adopts the basic conception of the technical scheme that:

a control method and system of a multi-window display comprises an object window control method F, wherein the object window control method F comprises a multi-window display control data structure ST_MOD, a display window mark control method SF based on the ST_MOD structure and a multi-window menu area position self-adaption method Sp.

Further, the data structure st_mod includes a display window location information structure group member g_st_ DisplayWinPosi, OSD location control data structure group member g_st_pdwing, a display window attribute structure group member g_st_displaywort, a display child window number member, an input operation code member Cop, a system control state variable member v_cs, a main object window mapping sequence number member v_wm, a main control OSD engine sequence number member osdm_idx, a sub object window mapping sequence number member v_ws, an associated object window mapping group member v_wr1-v_ Wrk, a main object mark display state member Pm, a sub object mark display state variable member Ps, an associated object mark display state variable member pr_1-pr_k, an associated object cursor Cur mapping member v_cur, and a state maintenance timer t_tm;

The display window marking operation method SF comprises a flow transition behavior s and a static window judging method fg of a system among an idle state OS_IDEL, a main object marking operation state OS_SC1, a sub object marking operation state OS_SC2, an associated marking operation state OS_SC3, a main object window display attribute configuration state OS_ADJ0, a main object window configuration state OS_ADJ1, a main associated object window configuration state OS_ADJ2, a multi-window display prompt state OS_ATT, the window serial numbers of V_Wm, V_Ws and V_Wr1-V_ Wrk are respectively mapped to a main object window Am, a sub object window As and associated object windows Ar_1-Ar_k on a display, the main object window Am is attached with a main object mark Fm and a mark value Pm representing the display state of Fm, the sub object window As is attached with a sub object mark Fs and a mark value Ps representing the display state of Fs, the associated object windows Ar_1-Ar_k are respectively attached with associated object marks Fr_1-Fr_k and a mark value Pr_1-Pr_k representing the display state of Fr_1-Fr_k, and the associated object cursor Cur indicates a sub display window acted by an association operation.

Further, in the single window display mode with the k value of 1, only one main object window Am exists in the display device, when the display device is in the multi-window display mode with k sub-windows in the same screen partition, the Am can be switched to any sub-window, in the main object mark manipulation state os_sc1, a sub-object window As or n associated object windows ar_1 to ar_n can be configured through one input manipulation, window authority attributes of the Am, as, ar_1 to ar_n are mutually exclusive, that is, any sub-display window cannot be used As Am and can be used As or Ar at the same time, in the os_sc2 state, in the os_sc3 state, an associated state of any sub-window other than Am can be configured, and the sub-object window As and the associated object window ar_1 to ar_n do not coexist. The display window capable of responding to one of configuration, copying and interchange of the window display attribute is called a movable object window, otherwise is called a static window, the Am, as, ar_1-ar_n belong to the movable object window, the display window capable of responding to configuration of the display attribute through interactive operation of an OSD menu is called a configuration object window, the display window capable of responding to copying or interchange of the window display attribute through interactive operation of the window mark is called an operation object window, and the flow conversion behavior specifically comprises the following steps:

s1: under the idle state OS_IDEL, the value of the system control state identifier V_cs is OS_IDEL, each sub-window of the display only displays respective video signal pictures, no window object mark is displayed, the main object mark Fm, the auxiliary object mark Fs and the associated object are all in a hidden state, and the values of Pm, ps and Pr_1-Pr_k are all 0;

s2: under the control state of the main object mark OS_SC1, the main object mark is presented on the main object window Am, if the current value of V_Wm is 1, the main object window Am is the 1 st sub-window, and the display device presents the main object mark Fm on the 1 st sub-window so as to represent the sub-window zone bit of the main object window Am currently mapped by the V_Wm;

s3: under the auxiliary object mark control state OS_SC2, the Ps is set to be 1, the display device can acquire a first static window As an auxiliary object window As through the static window judging method fg, and a auxiliary object mark Fm is presented on the edge of the As window to represent the sub-window zone position of the auxiliary object window As mapped currently by the V_Ws;

s4: under the related object mark control state OS_SC3, acquiring an initial value of the related cursor mapping value V_cur according to the static window judging method fg, acquiring a first static window sequence number, taking the first static window sequence number as a 1 st related object window Ar1, setting an object mark value Pr1 of the window, and displaying the object mark Fr1 and the related cursor Cur on the sub-window picture;

s5: under the main object window display attribute configuration state OS_ADJ0, after acquiring an OSD display position through the multi-window menu region position self-adaption method Sp, displaying the main control menu OSDm on the current main object window Am, wherein other object marks are all in a hidden state;

s6: under the main object window display attribute configuration state OS_ADJ1, after acquiring an OSD display position through the multi-window menu region position self-adaptive method Sp, the main control object OSDm and the main object mark Fm are simultaneously displayed on a main object window Am;

s7: under the synchronous configuration state OS_ADJ2 of the display attributes of the main object and the associated object windows, after the OSD display position is acquired through the multi-window menu region position self-adaptive method Sp, the main control OSDm is displayed on the main object window Am, the main object mark Fm is displayed on the main object window Am, and all the associated object marks Fr 1-Frk of the main object mark Fm are respectively displayed on the associated object windows;

s8: under the multi-window display prompt state OS_ATT, respectively acquiring display positions of window state menus OSDa_1-OSDa_k according to the multi-window menu area position self-adaption method Sp, and respectively displaying the window state menus OSDa_1-OSDa_k in each sub-window DW_1-DW_k.

Further, in step s1, in the state of os_idel, by detecting the input manipulation Cop value and t_timerout event, the following steps are executed:

s11: setting Pm to 1 through a main object marking operation OP400, enabling the display device to enter a main object marking control state os_sc1, and mapping a main object window Am into a sub-display window with a window sequence number v_wm;

s12: calling out a main control menu OSDm through a main control menu calling operation with the Cop value of OP200, and entering the main object window display attribute configuration state OS_ADJ0;

s13: through a window information state prompt control with the Cop value of OP300, the display device enters the multi-window display prompt state OS_ATT;

in step s2, in the state of os_sc1, by detecting the input control Cop value and the event t_timerout, the following steps are executed:

s21: if the number n of the display windows is greater than 1, the main object mark Fm can be respectively moved up, down, left and right from the current sub-window by an object mark moving operation with Cop values of OP404, OP405, OP406 and OP407, and is switched to another state of Ax on the sub-window of the static window, the main object mark Fm is moved to the new sub-window Ax to be displayed, the main object mark value v_wm is updated to mx, ax becomes the new main object window Am, and the original main object window is changed to the static window.

s22: setting the value of the display V_cs to be OS_SC2 through a pair of object marking operation with the Cop value of OP401, and enabling the display device to enter a pair of object marking operation state;

s23: setting the value of the display V_cs to be OS_SC3 through an associated object marking operation with the Cop value of OP402, and entering the associated mark control state;

s24: entering a main object window display attribute configuration state OS_ADJ1 through a main control menu call operation with the Cop value of OP 200;

s25: resetting the value of the main object mark state Pm through a menu retirement operation OP201 with the Cop value of OP201, keeping the value of V_Wm unchanged, wherein the main object mark Fm retires, and the display device returns to an OS_IDEL state;

s26: triggering a T_TimerOut event and returning to an OS_IDEL state when the display device has no input manipulation behavior any more within the preset time of the state maintaining timer T_tm;

in the S3 step, under the state of OS_SC2, the following steps are executed by detecting the input control Cop value and the T_Timerout event;

s31: when the number n of the display windows is greater than 2, the sub-object marks Fs can be shifted up, down, left and right from the current sub-window by the object mark shifting operation with Cop values OP404, OP405, OP406 and OP407, and switched to another state of sub-window Ax of the static window (x is an ordinal number between 1~t), so as to change the sub-window mapped by the sub-object mark.

s32: the method comprises the steps that through auxiliary object mark control with Cop value of OP401, an object mark control state is exited, only the V_Wm value is kept unchanged, the mapping relation of a current auxiliary object window As is cancelled, the auxiliary object window mapping value V_Ws, the main object mark state value Pm and the auxiliary object mark state value Ps are cleared, the main object mark Fm and the auxiliary object mark Fs are cleared, and the system returns to an OS_IDEL state;

s33: the display attribute of the main object window Am can be cloned to the auxiliary object window As through an attribute copying operation with the Cop value of OP 408;

s34: enabling a main object window through an attribute exchange manipulation with Cop value OP409

The display attribute of Am and the display attribute of the auxiliary object window As are interchanged;

s35: triggering a T_TimerOut event and returning to an OS_IDEL state when the display device has no input manipulation behavior any more within the preset time of the state maintaining timer T_tm;

in step S4, in the os_sc3 state, by detecting the input control Cop value and the t_timerout event, the following steps are executed:

s41: when the number n of the display windows is more than 2, the number n can be represented by the Cop value OP404,

Object marker movement operations of OP405, OP406, OP407 move the association stream

Mark Cur, tour all non-main object windows;

s42: each sub-window in the s41 tour process can be made to be an associated object window through the associated object marking operation with the Cop value of OP402, the object marking value Pr_x of the sub-window is set, the object marking Fr_x is displayed on the corresponding sub-window, if k sub-windows except the main object window Am are associated object windows Ar_1-Ar_k on the display, each associated object window presents an associated object marking Fr_1-Fr_k so as to represent the sub-window zone position of each associated object window Ar_1-Ar_k mapped by V_Wr1-V_ Wrk;

s43: the associated state of each sub-window in the s41 tour process can be canceled through an associated object cancel operation with Cop value of OP403, the object mark value Pr_x of the sub-window is cleared, the V_Wrx mapping value is cleared, and the object mark Fr_x displayed on the sub-window mapped by Ar_x is retired; when all the associated objects are complemented and revoked, the system returns to the OS_IDEL state;

s44: the display attribute of the main object window Am can be copied to all the associated object windows through the attribute copying operation with the Cop value of OP 408;

s45: enabling the display device to enter a main object and related object window display attribute synchronous configuration state OS_ADJ2 through a main control menu call operation with Cop value of OP 200;

s46: triggering a T_TimerOut event and returning to an OS_IDEL state when the display device has no input manipulation behavior any more within the preset time of the state maintaining timer T_tm;

in step S5, in the state of os_adj0, by detecting the input manipulation Cop value and the event of t_timerout, the following steps are executed:

s51: through object mark moving operations OP 404-OP 407, the OSDm can be jumped and moved to other static windows by taking a window as a unit, so that the switching of the sub-display window mapped by the main object window Am is realized, the main object mark Fm is kept hidden, and the V_Wm is implicitly changed;

s52: through a series of menu interaction operations OP 202-OP 2xx, OSDm interface based processing is performed

The interactive operation can configure the display attribute of the main object window Am, the display attribute on the sub display window DW_m corresponding to the main object window Am follows the change, other static windows do not respond, a main control menu OSDm is arranged on which sub window, and the display attribute change generated by the interactive operation acts on the intuitiveness of which window;

s53: through a menu recession operation OP201, the OSDm interface can disappear from the main object window Am, and the display device returns to the OS_IDEL state;

s54: triggering a T_TimerOut event and returning to an OS_IDEL state when the display device has no input manipulation behavior any more within the preset time of the state maintaining timer T_tm;

In step s6, in the state of os_adj1, by detecting the input manipulation Cop value and the event t_timerout, the following steps are executed:

s61: through object mark moving operations OP 404-OP 407, the OSDm can be jumped and moved to other static windows by taking a window as a unit, so that the switching of the sub-display window mapped by the main object window Am is realized, the main object mark Fm is displayed along with the Am switching window, and V_Wm is synchronously changed;

s62: through a series of menu interaction operations OP 202-OP 2xx, OSDm interface based processing is performed

The interactive operation can configure the display attribute of the main object window Am, the display attribute on the sub display window DW_m corresponding to the main object window Am follows the change, and other static windows do not respond;

s63: the OSDm interface can disappear from the main object window Am through a menu retirement operation OP201, the main object mark disappears synchronously, the Pm state is cleared, and the display device returns to the OS_IDEL state;

s64: triggering a T_TimerOut event and returning to an OS_IDEL state when the display device has no input manipulation behavior any more within the preset time of the state maintaining timer T_tm;

in step S7, in the state of os_adj2, by detecting the input manipulation Cop value and the event t_timerout, the following steps are executed:

s71: through a series of menu interactive control OP 202-OP 2xx, interactive operation is performed based on an OSDm interface, so that the display attribute of a main object window Am can be configured, and the display attribute on a sub-display window corresponding to the main object window Am and all related object windows Ar 1-Ark synchronously follows the change;

s72: the OSDm interface can disappear from the main object window Am through a menu retirement operation OP201, the main object marks and all the related object marks disappear synchronously, the values of V_Wr1-V_ Wrk are cleared, the states of Pm and Pr1-Prk are cleared, and the display device returns to the OS_IDEL state;

s73: triggering a T_TimerOut event and returning to an OS_IDEL state when the display device has no input manipulation behavior any more within the preset time of the state maintaining timer T_tm;

in step S8, in the state of os_adj1, by detecting the input control Cop value and the event t_timerout, the following steps are executed:

s81: through a menu recession operation OP201, the interfaces of the state menus OSDa_1-OSDa_k of each window can be respectively disappeared from each sub-window, and the display device returns to the OS_IDEL state;

s82: in a predetermined time of the state maintenance timer t_tm, the display device has no input manipulation behavior any more, triggers a t_timerout event, and returns to the os_idel state.

Further, the display window location information structure group g_st_displaywnposi includes T numbers of the display window location information structure members st_displaywompasi_1 to st_displaywnposi_t, and any one of the display window location information structure members st_displaywnposi_m (where M is a window ordinal number between 1~k) includes a window horizontal start value dw_ M.x corresponding to an origin position of the display screen, a window vertical start value dw_ M.y corresponding to the origin position of the display screen, a display window horizontal pixel length value dw_ M.h, and a display window vertical pixel length dw_ M.v;

the OSD region bit control data structure group g_st_pdwing includes T numbers of OSD region bit control data structure members st_osdwin_1 to st_osdwin_t, any one of the OSD region bit control data structure member variables st_osdwin_m includes a pointer to an OSDM data buffer region needle ow_m.ptr, an OSDM relative display window horizontal start offset coefficient and vertical start offset coefficients ow_orm.x, ow_orm.y, and OSDM horizontal and vertical pixel values ow_ M.h, ow_ M.v;

the display window attribute structure group G_st_DisplayWinAttr comprises T number of the display window attribute structure component quantities st_DisplayWinAttr_1-st_DisplayWinAttr_T, and any one of the display window attribute structure component variables st_DisplayWinAttr_M comprises a group of window display attribute members, wherein the window display attribute members comprise but are not limited to picture signal sources, contrast, color temperatures and gamma curves displayed by a display window.

Further, the multi-window menu location adaptive method Sp includes the following steps:

a: in the states of the os_adj0, the os_adj1 and the os_adj2, the display device retrieves the position information structure member st_displaywonsi_am of the main object window dw_m corresponding to the v_wm value from the display window position information structure group g_st_displaywnponsi according to the main control display window identification value v_wm, and obtains a window horizontal direction starting value and a window vertical direction starting value dw_m.xdw_ m.y of the current main object window relative to the display screen origin position, and horizontal direction and length direction pixel length values dw_ m.h and dw_ m.v as a calculation reference value of the position of the OSDm position. Searching an OSD region position control data structure body member st_OSDWin_m corresponding to the OSDm_Idx from an OSD region position control data structure body group G_st_pOSDWin according to the main control OSD engine number OSDm_Idx, obtaining OSDm interface relative display window horizontal initial offset coefficient OW_ORm.x and vertical initial offset coefficient OW_ORm.y values, OSDm interface horizontal pixel value OW_ m.h and vertical pixel value OW_ m.v, obtaining absolute coordinates OW_ m.x and OW_ m.y of an interface of the main control OSDm menu relative to a display screen coordinate origin (0, 0) through a relative region position calculation method fc, and using OW_ m.x and OW_ m.y in the menu content data buffer zone_Buf_m as initial coordinates, using OW_ m.h and OW_ m.v as initial coordinates to be loaded on a main control screen window of a main control OSDm size and be conveyed to an OSD terminal display window of the main control OSDm display screen in a main display window of the main control display screen, and conveying the main control OSDm menu to the main display window to a main display screen display window of the main display screen just to be just above the main display window 20;

b: under the OS_ATT state, the display device is in a multi-window multi-OSD partition state prompt mode, if the display window number display child window number Dnum is set as t, one OSD 1-OSDt with t OSD are loaded and presented on the images of the child display windows DW 1-DWt respectively according to the relative region positions. Specifically, the display device obtains the location information structure members of the t number of windows from the display window location information structure group g_st_displaywonsi, wherein the location information structure members comprise window horizontal direction starting values and vertical direction starting values dw_ t.x and dw_ t.y (t is the number between 1-dnum) of the display window relative to the origin position of the display screen, and horizontal direction and length direction pixel length values dw_ t.h and dw_ t.v, and serve as a calculation reference value of the location of an OSD 1-OSDt position. And, the OSD region position control data structure members st_OSDWin_1-st_OSDWin_t corresponding to the OSD 1-OSDt are obtained from the OSD region position control data structure group G_st_pOSDWin, the horizontal initial offset coefficients OW_OR1. X-OW_ORt. X and the vertical initial offset coefficients OW_OR1. Y-OW_ORt. Y values of the OSD 1-OSDt interface relative to the display windows DW_1-DW_t are respectively extracted, and the horizontal pixel values OW_1. H-OW_t.h and the vertical pixel values OW_1. V-OW_t.v of the OSD 1-OSDt interface are respectively passed through the relative region position calculation method fc, and obtaining t absolute coordinate values OW_1. X-OW_t.x and OW_1. Y-OW_t.y of the OSD 1-OSDt menu interface relative to a display screen coordinate origin (0, 0), and loading the OSD 1-OSDt interface contents in the menu content data buffer regions OSD_DWBuf_1-OSD_DWBuf_t on video picture signals of the sub-display windows DW_1-DW_t by using OW_1. X-OW_t.x and OW_1. Y-OW_t.y as initial coordinates and using OW_1. H-OW_t.h and OW_1. V-OW_t.v as sizes by the drive output module, and synchronously conveying the video picture signals to a terminal display screen for display.

Further, the relative location calculation method fc includes: the display window DW_t and the OSD interface have the values of a horizontal start bit OW_ t.x and a vertical start bit OW_ t.y of the OSD interface, wherein the values of the horizontal start bit OW_ t.x and the vertical start bit OW_ t.y are respectively:

OW_t.x=DW_t.x+（OW_OR.x*（DW_K.h-OW_t.h+50）/100）；

OW_t.y=DW_t.y+（OW_OR.y*（DW_K.v-OW_t.v+50）/100）。

further, the static window acquisition method fg includes: the total number of sub-windows is t (t)[2，T]) In the multi-window display mode, a window serial number to be identified is used as an input parameter InPara1, the system compares the acquired InPara1 with the main object window serial number mapping value V_Wm according to the window display authority mutual exclusion principle, if InPara1 is not equal to V_Wm, inPara1 is directly returned to be used as a static window acquisition serial number, if InPara1 is equal to V_Wm and InPara1+1 is not greater than t, inPara1+1 is returned, and if InPara1 is equal to V_Wm and InPara1+1 is greater than t, 1 is returned. When the first static window is acquired, the system takes '1' as an input parameter, when V_Wm is 1, that is, am is DW_1, fg returns to 2, DW_2 is acquired as the first static window, and when V_Wm is>And 1, returning to 1 by fg, and obtaining DW_1 as a first static window.

A manipulation system for a multi-window display comprising a plurality of OSD engines and an integrated display driver D10 for a plurality of display window markers, said integrated display driver D10 including, but not limited to: a display window management module and an OSD group engine module;

The integrated display driving controller D10 is also integrated with a microprocessor, a multi-signal source receiving module, a storage module and a display driving output module;

the multi-source signal receiving module can simultaneously receive multiple independent video signals;

the window display management and image signal processing module manages each sub display window to respectively select and receive a video signal source from the multi-source signal processing module and perform corresponding image processing to form a terminal window image picture, and the terminal window image picture and the OSD menu interface are output to a display screen terminal for display through the display drive output module;

the microprocessor is responsible for receiving control signals or commands from the input control module, and simultaneously responsible for the flow of the self-adaptive method of the OSD position relative to the display window and the running of programs of other modules of the display device;

the storage module is responsible for storing program execution codes and related data and information in running;

the window management module is integrated with a multi-window mark co-processing module, supports control of display states of window marks F of at most T sub-display windows DW_1-DW_T, any sub-display window DW_k can be configured with a window mark Fk to be loaded on a display window picture independently of display window video content, and the k value is a natural number between 1~T.

Further, the relative location calculation method fc includes: the OSD group engine module comprises T independent OSD engines, each OSD engine is provided with an independent menu content data buffer OSD_DWBuf, and the display device can generate one or more independent OSD according to the requirement.

Further, the window management and image signal processing module may be configured into multiple multi-window partition on-screen display modes according to display requirements, including but not limited to a single window, P2P, P3P, P P, after the display is switched to a multi-window partition on-screen display mode, the main object window Am is restored to the first display window dw_1 by default, the v_wm value is 1, the number of display sub-windows Dnum, the data of each region information structure member in the display window region information structure group g_st_displaywoposi may be changed in time, and in the new multi-window partition on-screen display mode, the main control menu OSDm in the state of os_adj0, os_adj1, os_adj2, and the display window state prompt menu OSD1 to osd_t in the state of os_att may also be adapted to each sub-display window position.

After the technical scheme is adopted, compared with the prior art, the invention has the following beneficial effects, and of course, any product for implementing the invention does not necessarily need to achieve all the following advantages at the same time:

A multi-window display based on a window mark with multiple OSD engines and controllable display state is disclosed, which comprises an object mark operation method and an OSD area position relative display window self-adapting method, in each multi-window mode, the main object window, the auxiliary object window or each related object window can be selected by the object mark operation method, and the display attribute of the related display window can be copied or exchanged, the OSD object display window self-adapting method moves the main control OSD by taking the display window as a unit to switch the main object window, the OSD position is self-adapted with the main object window, in the non-related window mode, only the main object window of the main control OSD menu can respond to the adjustment of the display attribute, the interactive control is applied to the window when the OSD is positioned in a certain window, in the related window mode, the main object window and the related object window respond to the adjustment of the display attribute by the main control OSD, so that the adjustment and control of the display attribute of each window are more visual, convenient and humanized.

The following describes the embodiments of the present invention in further detail with reference to the accompanying drawings.

Drawings

The drawings in the following description are only examples of embodiments and other drawings may be obtained from these drawings by those of ordinary skill in the art without undue burden. In the drawings:

FIG. 1 is a hardware block diagram of a method and system for operating a multi-window display according to the present invention;

FIG. 2 is a schematic diagram of a data structure of an ST_MOD of a method and a system for controlling a multi-window display according to the present invention;

FIG. 3 is a schematic diagram showing SF state transition relationship of a display window mark manipulation method of a multi-window display manipulation method and system according to the present invention;

fig. 4 to 11 are flowcharts of a system initialization into an idle state os_idel, a main object flag handling state os_sc1, a sub object flag handling state os_sc1, an associated object flag handling state os_sc1, a main object window display attribute configuration state os_adj0, a main object window display attribute configuration state os_adj1, a main object and associated object window display attribute configuration state os_adj2, and a multi-window display prompting state os_att, respectively, of the method and system for handling a multi-window display of the present invention;

fig. 12 to fig. 30 are schematic diagrams showing display attribute, object mark state and menu state changes of each display window of the display according to the control method and system of the multi-window display according to the present invention triggered by different input control or commands in each system state;

it should be noted that these drawings and the written description are not intended to limit the scope of the inventive concept in any way, but to illustrate the inventive concept to those skilled in the art by referring to the specific embodiments.

Detailed Description

The invention will now be described in further detail with reference to the accompanying drawings.

Referring to fig. 1 to 30, in this embodiment, a method for controlling a multi-window display is provided, which includes an object window control method F, wherein the object window control method F includes a multi-window display control data structure st_mod, a display window mark control method SF based on the st_mod structure, and a multi-window menu region self-adaptation method Sp.

In this embodiment, the data structure st_mod includes a display window location information structure group member g_st_ DisplayWinPosi, OSD location control data structure group member g_st_pdwing, a display window attribute structure group member g_st_displaywort, a display child window number member, an input operation code member Cop, a system control state variable member v_cs, a main object window mapping sequence number member v_wm, a main OSD engine sequence number member osdm_idx, a sub object window mapping sequence number member v_ws, an associated object window mapping group member v_wr1 to v_ Wrk, a main object mark display state member Pm, a sub object mark display state variable Ps, an associated object mark display state variable member pr_1 to pr_k, an associated object cursor Cur mapping member v_cur, and a state maintenance timer t_tm;

In this embodiment, in the single-window display mode with the k value of 1, only one main object window Am exists in the display device, when the display device is in the multi-window display mode with k sub-windows in the same-screen partition, the Am can be switched to any sub-window, in the main object mark manipulation state os_sc1, a sub-object window As or n associated object windows ar_1 to ar_n can be configured through one input manipulation, window authority attributes of the Am, as, ar_1 to ar_n are mutually exclusive, that is, any sub-display window cannot be used As Am and can be used As or Ar at the same time, in the os_sc2 state, in the as_sc2 state, an associated state of any non-Am sub-window can be configured, and the sub-object window As and the associated object windows ar_1 to ar_n do not coexist. The display window capable of responding to one of configuration, copying and interchange of the window display attribute is called a movable object window, otherwise is called a static window, the Am, as, ar_1-ar_n belong to the movable object window, the display window capable of responding to configuration of the display attribute through interactive operation of an OSD menu is called a configuration object window, the display window capable of responding to copying or interchange of the window display attribute through interactive operation of the window mark is called an operation object window, and the flow conversion behavior specifically comprises the following steps:

s1: in the idle state os_idel, the value of the system control state identifier v_cs is os_idel, each sub-window of the display only displays respective video signal images, but does not display any window object mark, the main object mark Fm, the sub-object mark Fs and the associated objects are all in a hidden state, the values of Pm, ps, pr_1-pr_k are all 0, in the idle state, the display only displays video signal images, and does not display any window object mark, so that a user can concentrate more on watching video content, the watching experience of the user is improved, and the energy consumption is reduced: hiding the main object mark, the auxiliary object mark and the associated objects, and setting the values of Pm, ps and Pr_1-Pr_k to 0, so that the energy consumption of a system can be reduced, and the battery life of equipment can be prolonged;

s2: under the main object mark control state OS_SC1, the main object mark is presented on the main object window Am, if the current value of V_Wm is 1, the main object window Am is the 1 st sub-window, the display device presents the main object mark Fm on the 1 st sub-window to represent the sub-window zone where the main object window Am mapped by V_Wm is located, and by displaying the main object mark Fm on the main object window Am, a user can clearly know that the content displayed at present is the content corresponding to the main object window Am. Therefore, the understanding and operation accuracy of the user to the interface can be improved, the use experience of the user is further improved, and the main object mark Fm is displayed on the main object window Am, so that the interface is clearer. The user can clearly distinguish different windows and objects, so that confusion and misoperation possibility are reduced;

s3: under the auxiliary object mark control state OS_SC2, the Ps is set to be 1, the display device can acquire a first static window As an auxiliary object window As through the static window judging method fg, and presents an auxiliary object mark Fm on the edge of the As window so As to represent the sub-window zone position of the auxiliary object window As currently mapped by the V_Ws, and the auxiliary object mark Fm is presented on the edge of the auxiliary object window As so As to improve the navigation capability of a user, facilitate operation and switching and improve the visibility and readability;

s4: under the related object mark control state OS_SC3, acquiring an initial value of the related cursor mapping value V_cur according to the static window judging method fg, acquiring a first static window sequence number, taking the first static window sequence number as a 1 st related object window Ar1, setting an object mark value Pr1 of the window, displaying the object mark Fr1 and the related cursor Cur on the sub-window picture, and displaying the object mark value Pr1 and the related cursor Cur to enable a user to operate and switch more conveniently. The user can intuitively see the positions of the object mark value Pr1 and the associated cursor Cur, so that the operation and the switching to the associated object window Ar can be more accurately performed;

s5: under the main object window display attribute configuration state OS_ADJ0, after the OSD display position is obtained through the multi-window menu location self-adaption method Sp, the main control menu OSDm is displayed on the current main object window Am, other object marks are all in a hidden state, and the main control menu OSDm is displayed on the current main object window Am, so that a user can operate more conveniently. The user can directly operate in the main object window Am without switching to other windows or menus, so that the operation efficiency and convenience are improved;

s6: after the OSD display position is obtained through the multi-window menu location self-adaption method Sp in the main object window display attribute configuration state OS_ADJ1, the main control object OSDm and the main object mark Fm are simultaneously displayed on the main object window Am, and after the OSD display position is obtained through the multi-window menu location self-adaption method Sp in the attribute configuration state OS_ADJ1, the main control object OSDm and the main object mark Fm are simultaneously displayed on the main object window Am, so that the operation efficiency is improved, the operation and the switching are convenient, the user experience is improved, and the interface confusion is reduced;

In the embodiment, in step s1, in the state of os_idel, by detecting the input manipulation Cop value and t_timer event, the following steps are executed:

s11: the Pm is set to be 1 through a main object marking operation OP400, the display device enters the main object marking control state OS_SC1, the main object window Am is mapped into a sub-display window with a window sequence number of V_Wm, and through the steps, a user can finish a plurality of operations in one window without frequently switching the windows, so that the satisfaction degree and the use experience of the user are improved;

s12: and calling out a main control menu OSDm through a main control menu calling operation with the Cop value of OP200, entering the main object window display attribute configuration state OS_ADJ0, and after entering the main object window display attribute configuration state OS_ADJ0, configuring the display attribute of the main object window according to own requirements and preferences by a user. The user can adjust the size, position, transparency and other attributes of the window to meet the working habit and the operation habit of the user;

s21: if the number n of the display windows is greater than 1, the main object mark Fm can be respectively moved up, down, left and right from the current sub-window by an object mark moving operation with Cop values of OP404, OP405, OP406 and OP407, and is switched to another state of Ax on the sub-window of the static window, the main object mark Fm is moved to the new sub-window Ax to be displayed, the main object mark value v_wm is updated to mx, ax becomes the new main object window Am, the original main object window is changed to the static window, and the sub-window which is most suitable for the user can be selected as the main object window according to the requirement and preference of the user through the steps, so that the satisfaction and comfort of the user can be improved.

s25: the main object mark state Pm value is cleared by a menu retirement operation OP201 with the Cop value of OP201, the V_Wm value is kept unchanged, the main object mark Fm is retired, the display device returns to an OS_IDEL state, the main object mark state is cleared by the menu retirement operation, the V_Wm value is kept unchanged, the main object mark Fm is retired, and the OS_IDLE state is returned to simplify the operation flow, keep the current state, improve the user experience and prepare for the subsequent operation;

Mark Cur, tour all non-main object windows;

s44: the display attribute of the main object window Am can be copied to all the associated object windows through the attribute copying operation with the Cop value of OP 408.

In this embodiment, the display window location information structure group g_st_displaywnposi includes T numbers of the display window location information structure members st_displaywnposi_1 to st_displaywnposi_t, and any one of the display window location information structure members st_displaywnposi_m (where M is a window ordinal number between 1~k) includes a window horizontal direction start value dw_ M.x corresponding to an origin position of the display screen, a window vertical direction start value dw_ M.y corresponding to the origin position of the display screen, a display window horizontal direction pixel length value dw_ M.h, and a display window vertical direction pixel length dw_ M.v;

the OSD area bit control data structure group G_st_pOSDWin comprises T number of the OSD area bit control data structure members st_OSDWin_1-st_OSDWin_T, any one of the OSD area bit control data structure member variables st_OSDWin_M comprises a pointing OSDM data buffer area needle OW_M.ptr, an OSDM relative display window horizontal initial offset coefficient and vertical initial offset coefficients OW_ORM.x and OW_ORM.y, and OSDM horizontal direction and vertical direction pixel values OW_ M.h and OW_ M.v, the position and the size of the OSD can be controlled by setting the member variables of the OSD area bit control data structure group G_st_pOSDWin, a richer user interface is provided, and meanwhile, the display effect and the user experience are improved;

The display window attribute structure group G_st_DisplayWinAttr comprises T number of the display window attribute structure component quantities st_DisplayWinAttr_1-st_DisplayWinAttr_T, any one of the display window attribute structure component variables st_DisplayWinAttr_M comprises a group of window display attribute components, the window display attribute components comprise but are not limited to a picture signal source, a contrast, a color temperature and a gamma curve displayed by a display window, and by setting the picture signal source, the contrast, the color temperature, the gamma curve and other attribute components in the display window attribute structure, multi-picture display can be realized, the contrast, the color temperature and the gamma curve of a picture can be adjusted, so that the display effect and the user experience are improved.

In this embodiment, the multi-window menu location adaptive method Sp includes the following steps:

In this embodiment, the relative location calculation method fc includes: the display window DW_t and the OSD interface have the values of a horizontal start bit OW_ t.x and a vertical start bit OW_ t.y of the OSD interface, wherein the values of the horizontal start bit OW_ t.x and the vertical start bit OW_ t.y are respectively:

OW_t.x=DW_t.x+（OW_OR.x*（DW_K.h-OW_t.h+50）/100）；

OW_t.y=DW_t.y+（OW_OR.y*（DW_K.v-OW_t.v+50）/100）。

in this embodiment, the static window acquisition method fg includes: the total number of sub-windows is t (t)[2，T]) In the multi-window display mode, a window serial number to be identified is used as an input parameter InPara1, the system compares the acquired InPara1 with the main object window serial number mapping value V_Wm according to the window display authority mutual exclusion principle, if InPara1 is not equal to V_Wm, inPara1 is directly returned to be used as a static window acquisition serial number, if InPara1 is equal to V_Wm and InPara1+1 is not greater than t, inPara1+1 is returned, and if InPara1 is equal to V_Wm and InPara1+1 is greater than t, 1 is returned. When the first static window is acquired, the system takes '1' as an input parameter, when V_Wm is 1, that is, am is DW_1, fg returns to 2, DW_2 is acquired as the first static window, and when V_Wm is>And 1, returning to 1 by fg, and obtaining DW_1 as a first static window.

A system for a manipulation technique for a multi-window display, comprising a plurality of OSD engines and a plurality of display window markers, an integrated display driver D10, said integrated display driver D10 including, but not limited to: a display window management module and an OSD group engine module;

In this embodiment, the relative location calculation method fc includes: the OSD group engine module comprises T independent OSD engines, each OSD engine is provided with an independent menu content data buffer OSD_DWBuf, and the display device can generate one or more independent OSD according to the requirement.

In this embodiment, the window management and image signal processing module may be configured into multiple multi-window partition on-screen display modes according to display requirements, including but not limited to a single window, P2P, P3P, P P, after the display is switched to the multi-window partition on-screen display mode, the main object window Am is restored to the first display window dw_1 by default, the v_wm value is 1, the number of display sub-windows Dnum, the data of each region information structure member in the display window region information structure group g_st_displaypaposi may be changed in time, and in the new multi-window partition on-screen display mode, the main control menu OSDm in the state of os_adj0, os_adj1, and the display window state prompt menu OSD 1-osd_t in the state of os_att may also be adapted to each sub-display window position.

The state transition relationships and operation control flows shown in fig. 4 to 30 include:

f1: as shown in fig. 12, the four-split-screen 4 paths of signals are simultaneously displayed, each sub-window of the display only displays respective video signal pictures, but does not display any window object mark, the main object mark Fm, the auxiliary object mark Fs and the associated object are all in a hidden state, the values of Pm, ps, pr_1-pr_4 are all 0, no menu interface or window mark is displayed, and the color temperatures in the dw_1dw_2, dw_3 and dw_4 sub-window display attributes are respectively CT1, CT2, CT3 and CT4.

F2: as shown in fig. 13, based on the os_idel state shown in F1, if the value of v_wm is 1, the main object flag Fm is presented on the dw_1 window by a main object flag manipulation OP400, the main object flag state value Pm is set to 1, and the system enters the os_sc1 state where dw_1 is the main object window Am.

F3: referring to fig. 14, based on the state of os_sc1 shown in F2, am moves to the right through an OP405 to make the main object flag Fm move to the right on the dw_2 sub-window, the value v_wm becomes 2, am maps to the dw_2 sub-window, dw_1 is restored to the static sub-window, at this time, if the system acquires the first static window dw_1 through a static window determination method fg through an OP401 operation, the sub-object flag Fs is presented on dw_1, as is dw_1, fm and Fs are simultaneously displayed on the respective mapped sub-windows Am, as, and the system enters the state of os_sc2.

F4: as shown in fig. 15, based on the os_sc2 state shown in F3, the display attribute on the second sub-window dw_2 mapped by the main object window Am is copied to the first sub-window mapped by the sub-object As by an OP408 attribute copying operation, the display attribute of the dw_1 display window is the same As the display attribute on dw_2, and the color temperature in the display attribute becomes CT2.

And F5: as shown in fig. 16, based on the state of os_sc2 shown in F4, the sub-object flag Fs is moved from the first sub-window dw_1 of the current mapping to the fourth sub-window dw_4 by a down-shift and a right-shift operation of an OP407 and an OP404, respectively, the v_ws value is changed to 4, dw_4 is the sub-object window As, dw_1 is restored to the static window, and the state of the main object window Am remains unchanged.

F6: as shown in fig. 17, based on the os_sc2 state shown in F5, the display attribute on the second sub-window dw_2 mapped by the main object window Am is exchanged with the display attribute of the fourth sub-window dw_4 mapped by the sub-object As through an OP409 attribute exchange manipulation, the color temperature of the dw_2 display window becomes CT4, and the color temperature of the dw_4 display window becomes CT2.

F7: as shown in fig. 18, based on the os_sc2 state shown in F6, the object flag control state is exited by an OP401 sub object flag control, the v_wm value remains unchanged, am maintains the mapping dw_2 window, the mapping relation of the current sub object window As is cancelled, the v_ws is cleared, the main object flag Fm and the sub object flag Fs are both cleared, the Pm and Ps values are both cleared, and the system returns to the os_idel state.

F8: as shown in fig. 19, in the os_idel state with v_wm value of 2 indicated by F7, the operation OP400 is operated by a main object flag, the main object flag Fm is presented on the dw_2 window, the main object flag state value Pm is set to 1, and the system enters the os_sc1 state with dw_2 as the main object window Am.

F9: as shown in fig. 20, in the state of os_sc1 with the v_wm value of 2 indicated by F8, the operation OP402 is operated by an associated object flag, the system acquires the first static window dw_1 by the static window determining method fg, the associated cursor mapping value v_cur is 1, the first associated object window ar_1 mapping value v_wr1 is set to 1, the associated cursor Cur and the first associated object flag fr_1 are presented on the first static sub-window dw_1 window, and the system enters the associated object flag operating state os_sc3.

F10: as shown in fig. 21, in the state of os_sc3 shown in F9, by means of an OP404 right-shift operation, in order to shift the associated cursor Cur to the right from the dw_1 window mapped by the current associated object window ar_1, according to the authority attribute mutual exclusion principle, since dw_2 on the right is the main object window As, the next static window is actually dw_3 obtained through calculation by the static window determination method Fg, the display sub-window mapped by the associated object window ar_2 is dw_3, the associated cursor mapping value v_cur is updated to 3, the associated cursor Cur falls on the dw_3 sub-window, and while fr_1 and Fm remain presented on the dw_1 and dw_2 windows, respectively, the second associated object mark fr_2 is presented on the dw_3 window.

F11: as shown in fig. 22, in the state of os_sc3 shown in F10, the display attribute color temperature CT4 of the main object window Am is copied to the sub-windows dw_1, dw_3 mapped by all the associated object windows ar_1, ar_2 by an OP408 attribute copying operation, so that the display attribute color temperatures of the dw_1, dw_3 windows are both CT4.

F12: as shown in fig. 23, based on the state of osdm_sc3 shown in F11, through an OP200 main control menu call operation, the OSDm display start positions ow_ m.x and ow_ m.y are obtained by the multi-window menu area location adaptive method Sp, the driving output module loads OSDm interface contents in the main control menu content data buffer osd_dwbuf_m to the video picture signal of the main object window Am for display with the starting points ow_ m.x and ow_ m.y and with the sizes of ow_ m.h and ow_ m.v, and the system enters the main object and associated object window display attribute synchronous configuration state os_adj2.

F13: as shown in fig. 24, in the state of os_adj2 indicated by F12, the color temperature of the main object window Am is adjusted to CT6 by a main control menu interactive operation OP210 to OP216, the color temperature values of the display properties of the associated object windows dw_1, dw_3 mapped by ar_1, ar_2 are changed from the same time with the main object window to CT6, and the 4 th sub-display window is not affected because it is not associated.

F14: as shown in fig. 25, based on the state of os_adj2 shown in F13, the object mark manipulation state is exited by an OP201 retirement manipulation, the v_wm value keeps 2, the Am keeps mapping dw_2 window, the mapping relationship between all the associated object windows ar_1, ar_2 is cancelled, the main object mark state value Pm, the associated object mark state values pr_1, pr_2, the associated cursor map value v_vur, the associated object values v_wr1, v_wr2 mapped by the associated object windows ar_1 and Ar2 are cleared, and the main object mark Fm, the associated cursor Cur, the associated object marks fr_1, fr_2 are all disappeared, and the system returns to the os_idel state.

F15: as shown in fig. 26, based on the os_idel state shown in F14, an OP200 is used to control the menu call operation, the OSDm display start positions ow_ m.x and ow_ m.y are obtained by the multi-window menu area location adaptive method Sp, the driving output module loads the OSDm interface contents in the main control menu content data buffer osd_dwbuf_m to the video picture signals of the main object window Am for display with the starting points ow_ m.x and ow_ m.y and with the sizes ow_ m.h and ow_ m.v as the sizes, and the system enters the main object window display attribute synchronous configuration state os_adj0.

And F16: as shown in fig. 27, in the state of os_adj0 shown in F15, the main object window Am mapping value v_wm is calculated to be 3 by increasing 1 through an OP404 shift operation, am is mapped to the dw_3 sub-display window, a new OSDm starting position 'ow_ m.x, ow_ m.y' is obtained through the multi-window menu area location adaptive method Sp, and the driving output module loads OSDm interface content in the main control menu content data buffer osd_dwbuf_m to the video picture signal of dw_3 for display with the starting point of 'ow_ m.x, ow_ m.y' and the size of 'ow_ m.h, ow_ m.v'.

F17: as shown in fig. 28, based on the os_adj0 state shown in F16, through a main menu interactive operation OP220 to OP226, the screen ratio display attribute of the display window dw_3 mapped by the current landing window of OSDm, i.e. the main object window Am, is set to 4:3, while all the remaining static windows dw_1, dw_2, dw_4 are unaffected.

F18: as shown in fig. 29, in the state of os_adj0 indicated by F17, the main control menu OSDm exits through a menu hide operation OP201, dw_3 is still the main object window, and the mapping value v_wm of the main object window Am remains unchanged. If the system receives a window information state prompt control command, respectively acquiring the display positions of the 4 sub-display window state menus OSDa_1-OSDa_4 according to the multi-window menu area position self-adaption method Sp, and respectively displaying the window state menus OSDa_1-OSDa_4 in the sub-windows DW_1-DW-4.

F19: as shown in fig. 30, all the display window state menus osda_1 to osda_4 are retired by a menu retirement operation OP201 or a t_timer event triggered based on the os_att state shown in F18. The system returns to the osidel idle state.

The present invention is not limited to the above embodiments, and any person who can learn the structural changes made under the teaching of the present invention can fall within the scope of the present invention if the present invention has the same or similar technical solutions. The technology, shape, and construction parts of the present invention, which are not described in detail, are known in the art.

Claims

1. A method for manipulating a multi-window display, comprising: the object window control method F comprises a multi-window display control data structure ST_MOD, a display window mark control method SF based on the ST_MOD structure and a multi-window menu area position self-adaption method Sp;

the data structure st_mod comprises a display window location information structure body group member g_st_ DisplayWinPosi, OSD location control data structure body group member g_st_posdwin, a display window attribute structure body group member g_st_displaywort, a display child window number member, an input operation code member Cop, a system control state variable member v_cs, a main object window mapping sequence number member v_wm, a main control OSD engine sequence number member osdm_idx, a sub object window mapping sequence number member v_ws, an associated object window mapping group member v_wr1-v_ Wrk, a main object mark display state member Pm, a sub object mark display state variable member Ps, an associated object mark display state variable member pr_1-pr_k, an associated object cursor Cur mapping member v_cur, and a state maintenance timer t_tm;

the display window mark manipulation method SF includes a flow transition behavior s and a static window judgment method fg between an idle state OS_IDEL, a main object mark manipulation state OS_SC1, a sub object mark manipulation state OS_SC2, an associated mark manipulation state OS_SC3, a main object window display attribute configuration state OS_ADJ0, a main object window configuration state OS_ADJ1, a main associated object window configuration state OS_ADJ2, a multi-window display prompt state OS_ATT, the sequence numbers of the V_Wm, V_Ws and V_Wr1-V_ Wrk windows are respectively mapped to a main object window Am, a subsidiary object window As and associated object windows Ar_1-Ar_k on a display, the main object window Am is attached with a main object mark Fm and a mark value Pm representing the display state of Fm, the subsidiary object window As is attached with a subsidiary object mark Fs and a mark value Ps representing the display state of Fs, the associated object windows Ar_1-Ar_k are respectively attached with associated object marks Fr_1-Fr_k and a mark value Pr_1-Pr_k representing the display state of Fr_1-Fr_k, and the associated object cursor Cur indicates a sub-display window acted by an association operation;

The display window mark manipulation method SF further comprises a main control menu OSDm, in a single window display mode with a k value of 1, a display device only has a main object window Am, when the display device is in a multi-window display mode with k sub-windows in the same screen partition, the Am can be switched to any sub-window, in the main object mark manipulation state os_sc1, a sub-object window As or n associated object windows ar_1 to ar_n can be configured through input manipulation, window authority attributes of the Am, as and ar_1 to ar_n are mutually exclusive, namely, any sub-display window cannot be used As Am and simultaneously can be used As or Ar, in the sub-object mark manipulation state os_sc2, the association state of any sub-window which is not Am can be configured on any sub-window which is not in the state of the association mark manipulation state os_sc3 can be configured, and the sub-object window As and the associated object windows ar_1 to ar_n do not coexist; the display window capable of responding to one of configuration, copying and interchange of the window display attribute is called a movable object window, otherwise is called a static window, the Am, as, ar_1-ar_n belong to the movable object window, the display window capable of responding to configuration of the display attribute through interactive operation of an OSD menu is called a configuration object window, the display window capable of responding to copying or interchange of the window display attribute through interactive operation of the window mark is called an operation object window, and the flow conversion behavior specifically comprises the following steps:

s1: under the idle state OS_IDEL, the identification value of the system control state variable member V_cs is OS_IDEL, each sub-window of the display only displays respective video signal pictures, no window object mark is displayed, the main object mark Fm, the auxiliary object mark Fs and the related objects are all in a hidden state, and the values of Pm, ps and Pr_1-Pr_k are all 0;

s3: under the auxiliary object mark control state OS_SC2, the Ps is set to be 1, the display device can acquire a first static window As an auxiliary object window As through the static window judging method fg, and a auxiliary object mark Fs is presented on the edge of the As window to represent the sub-window zone position of the auxiliary object window As mapped currently by the V_Ws;

s4: under the related object mark control state OS_SC3, acquiring an initial value of a V_cur mapping value of a related object cursor Cur mapping member according to the static window judging method fg, acquiring a first static window sequence number, taking the first static window sequence number as a 1 st related object window Ar1, setting an object mark value Pr1 of the window, and displaying the object mark Fr1 and the related cursor Cur on a sub-window picture;

s6: under the main object window display attribute configuration state OS_ADJ1, after acquiring an OSD display position through the multi-window menu region position self-adaption method Sp, the main control menu OSDm and the main object mark Fm are simultaneously displayed on a main object window Am;

2. The method according to claim 1, wherein in step s1, in the state of os_idel, by detecting the input control Cop value and t_timerout event, the following steps are performed:

s21: if the number n of the display windows is greater than 1, the main object mark Fm can be respectively moved up, down, left and right from the current sub-window by an object mark moving operation with Cop values of OP404, OP405, OP406 and OP407, and is switched to another state of Ax on the sub-window of the static window, the main object mark Fm is moved to the new sub-window Ax for display, v_wm is updated to mx, ax becomes the new main object window Am, and the original main object window is changed to the static window;

s31: when the number n of the display windows is greater than 2, the sub-object marks Fs can be moved up, down, left and right from the current sub-window by the object mark moving operation with Cop values of OP404, OP405, OP406 and OP407, and the sub-window whose state is that x is 1~t on the sub-window Ax of the static window is switched to another state so as to change the sub-window mapped by the sub-object mark;

Mark Cur, tour all non-main object windows;

3. The method according to claim 2, wherein the display window location information structure group g_st_displaywnposi comprises T number of the display window location information structure members st_displaywompasi_1 to st_displaywnposi_t, any one of the display window location information structure members st_displaywnposi_m, the M is a window ordinal number between 1~k, and comprises a window horizontal start value dw_ M.x relative to a display screen origin position, a window vertical start value dw_ M.y relative to a display screen origin position, a display window horizontal pixel length value dw_ M.h, and a display window vertical pixel length dw_ M.v;

4. The method for operating a multi-window display according to claim 1, wherein the multi-window menu location adaptation method Sp comprises the steps of:

a: in the main object window display attribute configuration state os_adj0, the main object window configuration state os_adj1, and the main associated object window configuration state os_adj2, the display device retrieves, from the display window location information structure member g_st_displaywonsi, a location information structure member st_displaywonsi_am of the main object window Am corresponding to the main object window mapping sequence number member v_wm according to the main object window mapping sequence number member v_wm, and obtains a window horizontal direction start value and a vertical direction start value dw_m.xdw_ m.y of the current main object window relative to the display screen origin position, and horizontal direction and length direction pixel length values dw_ m.h, dw_ m.v, as a reference value of the location calculation reference of the main control menu OSDm position; searching an OSD region position control data structure body member st_OSDWin_m corresponding to the OSDm_Idx from an OSD region position control data structure body group G_st_pOSDWin according to the main control OSD engine sequence number member OSDm_Idx, obtaining OSDm interface relative display window horizontal initial offset coefficient OW_ORm.x and vertical initial offset coefficient OW_ORm.y values, and OSDm interface horizontal pixel value OW_ m.h and vertical pixel value OW_ m.v, obtaining absolute coordinates OW_ m.x and OW_ m.y of an interface of the main control menu OSDm relative to a display screen coordinate origin (0, 0) through a relative region position calculation method fc, and driving an output module to transmit OSDm interface contents in the menu content data buffer region_DWF_m to a main control menu display window of a main control menu D in a main control menu D just above the main control menu D by taking OW_ m.x and OW_ m.y as initial coordinates, and OW_ m.h and OW_ m.v as main control window sizes;

b: in the multi-window display prompting state OS_ATT state, the display device is in a multi-window multi-OSD partition prompting mode, if the display window number display child window number Dnum is set to be t, one OSD 1-OSDt with t OSD are loaded and presented on the images of the child display windows DW 1-DWt respectively according to the relative region positions; specifically, the display device obtains t number of window location information structure members from the display window location information structure group G_st_displayWinPosi, wherein the window location information structure members comprise window horizontal direction starting values and vertical direction starting values DW_ t.x and DW_ t.y of all sub display windows relative to the display screen origin position, t is the number of sequences between 1 and Dnum, and the horizontal direction and length direction pixel length values DW_ t.h and DW_ t.v are used as a calculation reference value of a location of an OSD 1-OSDt position; and, the OSD region position control data structure members st_OSDWin_1-st_OSDWin_t corresponding to the OSD 1-OSDt are obtained from the OSD region position control data structure group G_st_pOSDWin, the horizontal initial offset coefficients OW_OR1. X-OW_ORt. X and the vertical initial offset coefficients OW_OR1. Y-OW_ORt. Y values of the OSD 1-OSDt interface relative to the display windows DW_1-DW_t are respectively extracted, and the horizontal pixel values OW_1. H-OW_t.h and the vertical pixel values OW_1. V-OW_t.v of the OSD 1-OSDt interface are respectively passed through the relative region position calculation method fc, and obtaining t absolute coordinate values OW_1. X-OW_t.x and OW_1. Y-OW_t.y of the OSD 1-OSDt menu interface relative to a display screen coordinate origin (0, 0), and loading the OSD 1-OSDt interface contents in the menu content data buffer regions OSD_DWBuf_1-OSD_DWBuf_t on video picture signals of the sub-display windows DW_1-DW_t by using OW_1. X-OW_t.x and OW_1. Y-OW_t.y as initial coordinates and using OW_1. H-OW_t.h and OW_1. V-OW_t.v as sizes by the drive output module, and synchronously conveying the video picture signals to a terminal display screen for display.

5. The method for operating a multi-window display according to claim 4, wherein the relative location calculation method fc is as follows: the display window DW_t and the OSD interface have the values of a horizontal start bit OW_ t.x and a vertical start bit OW_ t.y of the OSD interface, wherein the values of the horizontal start bit OW_ t.x and the vertical start bit OW_ t.y are respectively:

OW_t.x=DW_t.x+（OW_OR.x*（DW_K.h-OW_t.h+50）/100）；

OW_t.y=DW_t.y+（OW_OR.y*（DW_K.v-OW_t.v+50）/100）。

6. the method for controlling a multi-window display according to claim 1, wherein the static window acquisition method fg comprises: in a multi-window display mode in which the total number of display sub-windows is r, r[2，R]The system compares the acquired InPara1 with the mapping value of the main object window mapping sequence number member V_Wm according to the window display authority mutual exclusion principle, if InPara1 is not equal to V_Wm, inPara1 is directly returned to serve as a static window acquisition sequence number, if InPara1 is equal to V_Wm and InPara1+1 is not greater than t, inPara1+1 is returned, and if InPara1 is equal to V_Wm and InPara1+1 is greater than t, then 1 is returned; when the first static window is acquired, the system takes '1' as an input parameter, and when V_Wm is 1, i.e. Am is DW/uWhen 1, fg returns to 2, and DW_2 is obtained as a first static window, when V_Wm >And 1, returning to 1 by fg, and obtaining DW_1 as a first static window.