CN118656067A

CN118656067A - Operation method, device, equipment, medium and product of visual programming interface

Info

Publication number: CN118656067A
Application number: CN202411010084.7A
Authority: CN
Inventors: 王炼
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2024-07-25
Filing date: 2024-07-25
Publication date: 2024-09-17

Abstract

The application discloses an operation method, device, equipment, medium and product of a visual programming interface, and relates to the field of man-machine interaction. The method comprises the following steps: displaying a first working area; and responding to the split screen display operation, displaying a first working area and a building block association area, wherein the building block association area comprises second programming building blocks, a program construction relation exists between the second programming building blocks and the first programming building blocks, and the program construction relation is used for representing the content of a program constructed by the second programming building blocks and the first programming building blocks. Through the mode, the building block association area and the first working area can be simultaneously operated in visual programming, the visual programming flow is optimized, the working efficiency is improved, and the man-machine interaction efficiency is improved. The application can be applied to various scenes such as programming enlightenment scenes, product development scenes and the like.

Description

Operation method, device, equipment, medium and product of visual programming interface

Technical Field

The embodiment of the application relates to the field of man-machine interaction, in particular to an operation method, a device, equipment, a medium and a product of a visual programming interface.

Background

With the development of computer technology, more and more people learn basic knowledge of programming to improve the competitiveness and creativity of people in the technical field, and the programming capability gradually becomes an important skill in various industries; to facilitate beginners to learn programming knowledge more intuitively and fun, web-based visual programming environments have evolved, in which building block building programs are commonly used.

In the related art, a visual programming environment includes a work area through which programming bricks can be combined to construct program content, thereby helping to better learn programming in a visual manner using objects.

In general, more programming blocks are used when program contents are built in a working area, and different programming blocks used generally represent different meanings, sometimes programming blocks in different positions in the working area may need to be compared, and at the moment, the programming blocks need to be searched back and forth in the working area to achieve the purpose of comparison, so that the efficiency of searching the programming blocks by using objects is low, the editing efficiency of the programming blocks is low, the interest level of learning programming by using objects through a visual programming mode is reduced, and the man-machine interaction efficiency is low.

Disclosure of Invention

The embodiment of the application provides an operation method, an operation device, an operation medium and an operation product of a visual programming interface, which can simultaneously operate a building block association area and a first working area in visual programming, optimize a visual programming flow, improve the working efficiency and improve the man-machine interaction efficiency. The technical scheme is as follows.

In one aspect, a method of operating a visual programming interface is provided, the method comprising:

Displaying a first working area, wherein the first working area is used for constructing program content in a visual form based on programming building blocks, the programming building blocks are basic units used for representing programming logic in visual programming, and the first working area comprises first programming building blocks;

Receiving split screen display operation aiming at the first working area;

And responding to the split screen display operation, displaying the first working area and the building block association area, wherein the building block association area comprises second programming building blocks, a program construction relation exists between the second programming building blocks and the first programming building blocks, and the program construction relation is used for representing the second programming building blocks to cooperate with the first programming building blocks to construct the program content.

In another aspect, there is provided an operating device for visualizing a programming interface, the device comprising:

The display module is used for displaying a first working area, the first working area is used for constructing program content in a visual form based on programming building blocks, the programming building blocks are basic units used for representing programming logic in visual programming, and the first working area comprises first programming building blocks;

the receiving module is used for receiving split screen display operation aiming at the first working area;

the display module is further used for responding to the split screen display operation to display the first working area and the building block association area, the building block association area comprises second programming building blocks, a program construction relation exists between the second programming building blocks and the first programming building blocks, and the program construction relation is used for representing that the second programming building blocks cooperate with the first programming building blocks to construct the program content.

In an optional embodiment, the display module is further configured to display, in response to the split-screen display operation, the first working area and a second working area, where the first working area is used to construct first program content, and the second working area is the building block association area used to construct second program content in a visual form based on the programmed building blocks; wherein the second program content and the first program content together constitute the program content, the program content being logic code for running a program.

In an alternative embodiment, the display module is further configured to display a plurality of trigger groups in response to receiving a group view operation for a first working area, the trigger groups being contents composed of at least one trigger, the triggers being combined by at least one programming building block, the plurality of trigger groups each corresponding to a working area, the working areas being configured to construct the program contents based on the programming building blocks in the trigger groups; and receiving the split screen display operation aiming at a first trigger group in the trigger groups, wherein the first trigger group corresponds to the second working area.

In an optional embodiment, the receiving module is further configured to receive a selection operation for the first trigger set as the split screen display operation;

The display module is further configured to display the first working area in response to the selection operation for the trigger group identification, and to locate a first programming building block in the second working area that displays the first trigger group.

In an optional embodiment, the receiving module is further configured to display event programming blocks corresponding to a plurality of triggers in the first trigger set, where the triggers are used to represent a programming block set obtained by combining the event programming blocks as starting programming blocks, and the event programming blocks are used to represent programming blocks of an event type; and receiving a building block triggering operation of a first event programming building block in a plurality of event programming building blocks as the split screen display operation, wherein the building block triggering operation is used for positioning to the first event programming building block when the second working area is displayed.

In an alternative embodiment, the display module is further configured to display, in response to the split screen display operation, the first working area and a building block definition area for acquiring the second programmed building block in the program build relationship with the first programmed building block.

In an optional embodiment, the display module is further configured to display a building block definition control in response to receiving a building block selection operation for the first programming building block in the first working area, where the building block definition control is configured to customize a building block parameter based on maintaining a logic function of the first programming building block to obtain the second programming building block, and the building block parameter is configured to determine a logic implementation manner while performing a logic function corresponding to the programming building block; and receiving control triggering operation aiming at the building block definition control as the split screen display operation.

In an alternative embodiment, the receiving module is further configured to display a plurality of custom programming bricks for application within a work area, the work area including the first work area; receiving a selection operation aiming at a first custom programming building block in the custom programming building blocks, and displaying a plurality of editing options; and receiving an option triggering operation for a defined option in the plurality of editing options as the split screen display operation.

In an alternative embodiment, the display module is further configured to receive a region sizing operation for a boundary touch spring, the boundary touch spring being a trigger bar connecting the first working region and the building block-associated region, the region sizing operation being configured to adjust a region relative duty cycle between the first working region and the building block-associated region; and displaying a size adjustment result in response to the area size adjustment operation, wherein the size adjustment result comprises at least one of an adjusted first working area and an adjusted building block association area.

In an alternative embodiment, the display module is further configured to receive a region swap operation for a boundary trigger spring, the first working region being displayed at a first position, the building block associated region being displayed at a second position, the region swap operation being configured to swap display positions of the first working region and the building block associated region; in response to the zone swap operation, the building block associated zone at the first location and the first work zone at the second location are displayed.

In an optional embodiment, the display module is further configured to display an area control, where the area control is configured to adjust a display state of the first working area and the building block association area; and in response to receiving a first trigger operation for the area control, reserving and displaying a focus area in the first working area and the building block association area, and canceling and displaying a non-focus area, wherein the focus area is used for representing an area for which the last operation is performed.

In an alternative embodiment, the display module is further configured to point to a first display position in response to the split screen display operation, display the building block association area at the first display position, and display the first work area.

In an alternative embodiment, the display module is further configured to display the first working area at a second display position, where the second display position is different from the first display position, and the first working area and the building block association area are independent from each other.

In an optional embodiment, the display module is further configured to display the building block associated area at a third location in response to the split screen display operation indication, and display the building block associated area of a first size and the first working area of a second size, the second size being determined based on an interface display size and the first size; displaying the building block association area at a fourth position in response to the split screen display operation indication, displaying a third size of the building block association area and a fourth size of the first working area, the fourth size being determined based on the interface display size and the third size; wherein the third position and the fourth position are different, and the first size and the third size are different.

In an optional embodiment, the display module is further configured to display a split screen prompt message in response to the number of blocks of the programmed blocks used in the first working area reaching a preset threshold, where the split screen prompt message is configured to prompt a new third working area and display the third working area through the split screen display operation.

In an optional embodiment, the display module is further configured to display the first working area and the building block association area of the first style in response to the operation object pointed by the split-screen display operation being a first split-screen object; responding to the operation object pointed by the split screen display operation as a second split screen object, and displaying the first working area and the building block association area of a second style; the first split-screen object and the second split-screen object are different, and the first style and the second style are different.

In another aspect, a computer device is provided, the computer device including a processor and a memory, where the memory stores at least one instruction, at least one program, a set of codes, or a set of instructions, the at least one instruction, the at least one program, the set of codes, or the set of instructions being loaded and executed by the processor to implement a method of operating a visual programming interface as described in any one of the embodiments of the application.

In another aspect, a computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions loaded and executed by a processor to implement a method of operating a visual programming interface as described in any of the embodiments of the present application.

In another aspect, a computer program product or computer program is provided, the computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method of operating a visual programming interface as described in any of the above embodiments.

The technical scheme provided by the embodiment of the application has the beneficial effects that at least:

And simultaneously displaying the first working area and the building block association area based on split screen display operation of the first working area, wherein a program construction relationship exists between the first programming building blocks in the first working area and the second programming building blocks in the building block association area, so that program contents are constructed by the second programming building blocks in cooperation with the first programming building blocks. The split screen display operation allows the user to simultaneously view and operate a plurality of areas on a single display device, so that the high-efficiency interaction between areas is realized by simultaneously operating building block association areas and first working areas in visual programming, the first programming building blocks in the first working areas are also subjected to finer analysis through the building block association areas, the difference and correlation between the areas are conveniently compared while the visual programming efficiency is improved, the area interaction experience in the visual programming is enhanced, the requirements on the plurality of display devices are reduced, the working efficiency is improved while the visual programming flow is optimized, and the man-machine interaction efficiency is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a block diagram of an operating system provided by an exemplary embodiment of the present application;

FIG. 2 is a flowchart of a method of operation of visual programming provided by an exemplary embodiment of the present application;

FIG. 3 is a flowchart of a method of operation of visual programming provided by another exemplary embodiment of the present application;

FIG. 4 is an interface schematic of a first work area provided by an exemplary embodiment of the present application;

FIG. 5 is a schematic diagram of an interface of a plurality of triggers under a trigger set provided in an exemplary embodiment of the present application;

FIG. 6 is a schematic diagram of an interface for displaying a first work area in a single column mode according to an exemplary embodiment of the present application;

FIG. 7 is a schematic diagram of an interface for displaying a plurality of trigger sets according to an exemplary embodiment of the present application;

FIG. 8 is a schematic diagram of an interface showing a plurality of event programming bricks provided in accordance with an exemplary embodiment of the present application;

FIG. 9 is a process for displaying a first work area and a second work area based on a split screen display operation provided by an exemplary embodiment of the present application;

FIG. 10 is a schematic diagram of an interface for triggering the display of history programming blocks using controls provided by an exemplary embodiment of the present application;

FIG. 11 is a flowchart of a method of operation of visual programming provided by yet another exemplary embodiment of the present application;

FIG. 12 is a schematic diagram of an interface for split screen display operation for a building block definition control provided in an exemplary embodiment of the present application;

FIG. 13 is a diagram of an interface for split screen display operation for definition options provided by an exemplary embodiment of the present application;

FIG. 14 is a schematic view of a split screen interface displayed after an option trigger based operation provided in accordance with yet another exemplary embodiment of the present application;

FIG. 15 is a flowchart of a method of operation of visual programming provided by yet another exemplary embodiment of the present application;

FIG. 16 is an interface schematic of a tool area provided by an exemplary embodiment of the present application;

FIG. 17 is a schematic diagram of a split-screen display based operation side-by-side display area provided in accordance with yet another exemplary embodiment of the present application;

FIG. 18 is a schematic view of an interface for performing a region resizing operation based on a boundary touch spring, provided in an exemplary embodiment of the present application;

FIG. 19 is a schematic view of an interface for displaying building block related areas provided in an exemplary embodiment of the present application;

FIG. 20 is a schematic diagram of an interface for displaying hints information provided in an exemplary embodiment of the application;

FIG. 21 is a simplified project architecture diagram provided by an exemplary embodiment of the present application;

FIG. 22 is a schematic illustration of a single programming brick enclosed by an bounding box provided by an exemplary embodiment of the present application;

FIG. 23 is a schematic illustration of a monolith surrounded by a bounding box provided by an exemplary embodiment of the present application;

FIG. 24 is a schematic diagram of a canvas corresponding to a set of switch triggers provided by one exemplary embodiment of the present application;

FIG. 25 is a flowchart illustrating the manner in which one trigger is moved to another trigger group in accordance with the related art provided by an exemplary embodiment of the present application;

FIG. 26 is a flow chart of a replicated programming building block provided by an exemplary embodiment of the present application;

FIG. 27 is a flow chart of rendering in a single column mode as well as in a double column mode provided by an exemplary embodiment of the present application;

FIG. 28 is a schematic illustration of a zone control provided by an exemplary embodiment of the present application;

FIG. 29 is a background flow chart for opening a new trigger set provided by an exemplary embodiment of the present application;

FIG. 30 is a schematic diagram of an interface for displaying programming bricks provided in accordance with an exemplary embodiment of the present application;

FIG. 31 is a flow chart illustrating a building block definition area provided by an exemplary embodiment of the present application;

FIG. 32 is a block diagram of a visually programmed operation device provided in an exemplary embodiment of the present application;

fig. 33 is a block diagram of a terminal according to an exemplary embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the embodiments of the present application will be described in further detail with reference to the accompanying drawings.

First, a brief description will be given of terms involved in the embodiments of the present application.

Visual programming: visual programming is intended to help a developer create a graphical programming editor by providing an intuitive interface that allows a user to build programs by dragging and connecting various blocks (bricks); each building block represents a programming concept or operation, such as: loops, conditional statements, mathematical operations, etc. Visual programming typically supports multiple programming languages, such as JavaScript, python, lua, etc. This means that the user can create programs in different languages using the same graphical editor and convert them into the corresponding source code.

Tool area: a visual programming module contains all available programming blocks, and different programming blocks can be organized according to different block categories. The user can drag the desired programming blocks from the tool area to the work area for programming. The tool area can be customized according to actual requirements and a specific set of programmed building blocks is displayed.

Work space (Workspace): the user can construct the program content by dragging and combining programmed blocks in the working area. The working area provides various operations on the programmed building blocks, such as deleting, modifying, copying, pasting and the like.

In the related art, the use of objects can be aided by the work area to better learn programming in a visual manner. However, more programmed blocks are usually used in the working area, and different programmed blocks usually represent different meanings, if there is a need to compare programmed blocks in different positions in the working area, the compared programmed blocks need to be searched back and forth in the working area, so that the searching efficiency of the programmed blocks is low, the editing efficiency of the programmed blocks is low, the interest level of a user in learning programming by a visual programming mode is easily reduced, and the man-machine interaction efficiency is low.

In the embodiment of the application, an operation method of visual programming is introduced, which can simultaneously operate a building block association area and a first working area in visual programming, optimize visual programming flow, improve working efficiency and improve man-machine interaction efficiency. The operation method of visual programming provided by the embodiment of the application can be applied to various use scenes such as a programming enlightenment scene, a product development scene, a business process automation scene, a robot programming scene, an audio synthesis scene, a game development scene and the like, and the embodiment of the application is not limited to the above.

In an alternative embodiment, the following description is given taking an example that the operation method of visual programming is applied to a programming enlightenment scene.

Illustratively, a company pushes out a visual programming application for a programming beginner, and the use object can use or download the visual programming application online. Taking downloading the visual programming application program by using the object A through a terminal as an example, after opening the visual programming application program by using the object A after downloading, displaying a first working area, wherein the first working area is used for representing the construction process of program contents in a visual form based on programming building blocks; and then when the terminal receives the split screen display operation aiming at the first working area, the first working area and the building block association area are simultaneously displayed on the terminal interface, and a program construction relation exists between the second programming building blocks included in the building block association area and the first programming building blocks in the first working area so as to cooperate with the first programming building blocks to construct program contents through the second programming building blocks. Therefore, the use object can check and operate at least two areas simultaneously in visual programming, the use frequency of the programming building blocks is improved, the use threshold of a beginner in visual programming is reduced, the problem that programming and learning are difficult due to the fact that the use object cannot remember related programming building blocks is avoided, and the man-machine interaction efficiency is improved.

In an alternative embodiment, the following description is given taking an example that the operation method of visual programming is applied to a game development scenario.

Schematically, complicated program content needs to be built in the game development process, and if a visual programming mode is adopted, the method is beneficial to simplifying the development flow and reducing programming errors. And the developer can display a first working area for constructing program contents in a visual form in the visual programming process, if the developer performs split-screen display operation on the first working area, the first working area and a building block association area are simultaneously displayed on a terminal interface, and a program construction relation exists between second programming building blocks included in the building block association area and the first programming building blocks in the first working area so as to cooperate with the first programming building blocks to construct program contents through the second programming building blocks. When a developer needs to view or operate the content on different areas at the same time, the display of the building block association area is beneficial to the developer to carry out visual programming more efficiently, improves the working efficiency of the developer in visual programming, is beneficial to developing interdisciplinary cooperation of the developer and team members of other non-programming backgrounds, enriches the application scene of visual programming, and improves the man-machine interaction efficiency.

It should be noted that, before and during the process of collecting the relevant data of the user, the present application may display a prompt interface, a popup window or output voice prompt information, where the prompt interface, popup window or voice prompt information is used to prompt the user to collect the relevant data currently, so that the present application only starts to execute the relevant step of obtaining the relevant data of the user after obtaining the confirmation operation of the user to the prompt interface or popup window, otherwise (i.e. when the confirmation operation of the user to the prompt interface or popup window is not obtained), the relevant step of obtaining the relevant data of the user is finished, i.e. the relevant data of the user is not obtained. In other words, all user data collected by the present application is collected with the consent and authorization of the user, and the collection, use and processing of relevant user data requires compliance with relevant laws and regulations and standards of the relevant region.

Secondly, an operation system related to the embodiment of the present application is described, and the operation method of visual programming provided in the embodiment of the present application may be implemented by a terminal alone, or may be implemented by a server, or implemented by the terminal and the server through data interaction, which is not limited in the embodiment of the present application. Alternatively, an operation method in which the terminal and the server interactively perform visual programming is described as an example.

Referring to fig. 1, the operating system includes a terminal 110 and a server 120, and the terminal 110 and the server 120 are connected through a communication network 130.

In some embodiments, terminal 110 has visual programming functionality. Illustratively, the terminal 110 itself has a visual programming function; or the terminal 110 has a visual programming function based on the downloaded visual programming application, etc.

Optionally, the visual programming is a function built into an application, such as a game application provided with user-generated content (User Generated Content, UGC) editors that enable creation, adjustment, sharing of custom content (e.g., virtual maps, virtual scenes, virtual characters, etc.) using objects. Illustratively, after the UGC editor is opened, a visual programming interface is displayed, and a player can build a virtual map, set Non-player character (Non-PLAYER CHARACTER) behaviors, set virtual prop positions, set virtual object moving speeds and other processes through the visual programming interface. By means of UGC editor, it is helpful to lower authoring threshold while maintaining high quality output; the UGC editor has a visual programming function which can effectively help the user object of the game application program to create a graphical programming editor, so that the user object is prompted through an intuitive programming interface to build program content through programming building blocks.

Illustratively, the visual programming function is implemented through a programming interface, which includes a plurality of interactive functions, and the visual programming process is performed through the interactive functions using the object. The interactive function includes at least one of a plurality of functions such as a selection function, an enlargement function, a reduction function, a deletion function, a movement function, etc., the user can select the programming building blocks in the programming interface through the selection function, can adjust the sizes of the programming building blocks through the enlargement function, the reduction function, etc., and can adjust the states of the programming building blocks in the programming interface through the deletion function, the movement function, etc., and the interactive function is not limited.

In some embodiments, terminal 110 displays the first working area while performing the visual programming process.

The first working area is used for constructing program content in a visual form based on programming building blocks, and the programming building blocks are basic units used for representing programming logic in visual programming.

Illustratively, the programming building blocks can be applied singly or in combination through the first working area to realize the logic functions and the like corresponding to the programming building blocks.

Wherein the first working area comprises a first programming building block. Illustratively, the first programming brick is a programming brick applied in the first working area, and the first programming brick may be any programming brick in the first working area, or may be a specific programming brick in the first working area.

In some embodiments, terminal 110 receives a split screen display operation for the first work area.

Illustratively, the first working area has a split screen display function for simultaneously viewing and operating interface contents such as a plurality of independent windows or application programs on the screen of the terminal 110, where the split screen display function is very helpful for improving the efficiency of multitasking in a visual programming environment, and can easily interact between different tasks without switching full screen applications.

Optionally, the operation based on triggering the split screen display function in the first working area is regarded as a split screen display operation. The split screen display function is schematically realized through a split screen display control, and the triggering operation aiming at the split screen display control is taken as the split screen display operation.

In some embodiments, terminal 110 displays the first work area and the building block associated area in response to a split screen display operation.

Illustratively, the first working area is an area where the building blocks are programmed, and the building block association area can be displayed while the first working area is displayed on the interface of the terminal 110 based on split screen display operation; the building block association area is an area for assisting the first work area in co-building program content.

The building block association area comprises second programming building blocks, a program construction relation exists between the second programming building blocks and the first programming building blocks, and the program construction relation is used for representing program contents of the second programming building blocks cooperated with the first programming building blocks.

Illustratively, the second programmed building blocks in the building block association area are building block definition introduction of the first programmed building blocks in the first work area, such as in the second programmed building blocks based on the first programmed building blocks, illustrating a plurality of other programmed building blocks affiliated with the first programmed building blocks and corresponding definition information; or the second programming building block in the building block association area is a building block supplement to the first programming building block in the first working area, for example, the second programming building block is different from the first programming building block, and the second programming building block and the first programming building block can jointly construct program content and the like.

Optionally, the terminal 110 determines the split screen content corresponding to the building block association area to be displayed by itself based on the split screen display operation, so that the split screen content is rendered and displayed on the screen of the terminal 110, and the purpose of simultaneously displaying the first working area and the building block association area is achieved.

Optionally, the terminal 110 generates a query request based on the split screen display operation and sends the query request to the server 120 through the communication network 130, so as to query the split screen content corresponding to the building block association area to be displayed currently by means of the server 120; the server 120 may feed back the queried split screen content to the terminal 110, so as to render and display the split screen content on the screen of the terminal 110, thereby achieving the purpose of simultaneously displaying the first working area and the building block association area.

It should be noted that the above-mentioned terminals include, but are not limited to, mobile terminals such as mobile phones, tablet computers, portable laptop computers, intelligent voice interaction devices, intelligent home appliances, vehicle-mounted terminals, and the like, and may also be implemented as desktop computers and the like; the server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server.

The operation method of the visual programming provided by the present application will be described with reference to the above noun introduction and application scenario, and the method is applied to a terminal as an example, as shown in fig. 2, and the method includes the following steps 210 to 230.

Step 210, displaying a first working area.

Illustratively, the first working area is used for carrying programming building blocks which are selectively applied in visual programming by using the objects, so that the layout adjustment operations such as drag and drop, combination, configuration and the like can be carried out on the programming building blocks in the working area by using the objects. Optionally, the first working area is implemented as a blank canvas area; or the work area is implemented as a grid-like canvas area, etc.

Schematically, the programming building blocks are graphical elements in visual programming, and different programming building blocks represent different concepts and operations in programming respectively and are used for realizing different logic functions.

In some embodiments, the plurality of programmed bricks correspond to respective brick types, i.e., types of logical functions implemented in the visual programming.

Alternatively, the programming blocks are understood as data blocks that encapsulate data execution logic, and the process of applying the programming blocks in the first working area is the process of adapting the data execution logic.

Schematically, the building blocks corresponding to the programming building blocks are the logic function types corresponding to the data execution logic, such as: the mathematical operation logic function corresponds to the mathematical operation type programming building blocks, the condition judgment logic function corresponds to the condition judgment type programming building blocks, the character string operation logic function corresponds to the character string operation type programming building blocks and the like.

Optionally, the building block type can be a type set by the platform side, or a type customized in a programming interface by using an object. For example: the platform side sets basic data types such as numerical value types, character string types and the like by itself; the object attribute type (such as the object level, the object name and the like of the virtual object in the game scene) can be added before the visual programming, and the building block type and the like can also be added in the visual programming process, which is not limited herein.

Optionally, programmed building blocks corresponding to the building block types are displayed in the programming interface for different application scenes respectively, and the building block types displayed in different application scenes may be the same or different. Illustratively, when the visual programming is performed for the game scene, the building block type of the displayed programming building block is content related to the game programming; when the visual programming is performed for the text programming scene, the building block type of the displayed programming building block is content related to text programming, and the like.

Illustratively, the types of building blocks set by the platform side displayed when the game scene is visually programmed are taken as an example. When the programming process of the game program is required to be carried out through the programming interface, the building block types of the plurality of programming building blocks displayed by the programming interface comprise various types such as event type, control type, action type, condition type, value type, function type, variable type and the like. Event types are used to represent implementation specific events (e.g., start game, abort game, etc.); the control type is used for controlling the trend of logic (such as continuous execution, repeated execution and the like); the action type is used for controlling the action gesture of the virtual object in the game; the condition type is used for setting conditions in the game process (such as eliminating virtual objects when blood volume reaches 0, etc.); the value type is used for inputting relevant numerical information (such as 45 degrees of left rotation and the like); the function type is used for determining an execution mode (such as mathematical operation, character string processing and the like) in the logic execution process based on the input numerical value information; the variable types are used to assist in adjusting, modifying the logic execution process, etc.

Optionally, the player may also customize the building block type of the programmed building blocks when visually programming within the play scene. Schematically, the object targeted by the player user-defined programming is a virtual object a, and the virtual object a corresponds to a plurality of building block types and comprises a plurality of categories such as an object name, an object level, an object life value, an object legal value, a camping to which the object belongs, and the like.

In some embodiments, the purpose of applying the programmed building blocks to the first work area is achieved based on a drag operation that drags the programmed building blocks to the first work area; or display a plurality of programming bricks based on the area triggering operation of the first working area, realize the purpose of applying the programming bricks to the first working area based on the selection operation of the programming bricks, and the like.

Wherein the first working area comprises a first programming building block.

Illustratively, the first programming brick is a programming brick applied to the first working area, and the first programming brick is any programming brick in the first working area, and may also be a specific programming brick in the first working area.

Optionally, taking the example that the first programming building block is a specific programming building block in the first working area, the first working area includes a plurality of programming building blocks, a selected programming building block is regarded as the first programming building block, for example, the programming building block is regarded as being selected after being clicked, and the programming building block is regarded as the first programming building block.

Step 220, receiving a split screen display operation for the first working area.

Illustratively, the split-screen display operation is an operation for implementing a split-screen display function, which is a function provided by the first working area, for simultaneously viewing and operating a plurality of independent areas (may also be referred to as independent windows), and enabling easy interaction between different tasks without switching full-screen applications.

Optionally, a split screen display control exists in the first working area, a split screen display function is triggered based on the triggering operation of the split screen display control, and the triggering operation aiming at the split screen display control is used as the split screen display operation.

Optionally, the environmental voice is received in the process of displaying the first working area, and the split screen display function is automatically triggered when the split screen instruction is received, namely the split screen instruction is used as the split screen display operation aiming at the first working area.

Optionally, the first working area includes area identifiers corresponding to other areas respectively, and the dragging operation based on dragging the area identifiers to the designated position is used as a split screen display operation to display the area corresponding to the dragged area identifier.

In step 230, the first working area and the building block association area are displayed in response to the split screen display operation.

The terminal receives the split screen display operation, and then simultaneously displays the first working area and the building block association area, so that the split screen display purpose of displaying the first working area and other areas is achieved.

The building block association area is an area displayed based on split screen display operation and is used for assisting the first working area to construct program content together; the purpose of the split-screen display operation is to display at least two areas simultaneously, so that the split-screen display operation can additionally display the building block association area determined based on the split-screen display operation on the basis of remaining display of the first working area.

The building block association area comprises second programming building blocks, and a program construction relation exists between the second programming building blocks and the first programming building blocks.

Illustratively, the second programmed building block is a programmed building block displayed in the building block association area, and the program build relationship between the second programmed building block and the first programmed building block in the first work area is used to characterize the program content of the second programmed building block in cooperation with the first programmed building block.

Optionally, the second programming building block and the first programming building block are different programming building blocks for building program content. For example: in visual programming of a game, a first programmed building block in a first working area is "when a player enters the game", a building block associated area is another working area displayed based on a split screen display operation, a second programmed building block in the building block associated area is "when the game starts", the first programmed building block and the second programmed building block are programmed building blocks which are in different working areas and are used for jointly constructing program contents, wherein the first programmed building block is used for covering a logic implementation condition when the player enters the game, the second programmed building block is used for covering a logic implementation condition when the game starts, and the like. Namely: the second programming brick may assist the first programming brick in building program content by encompassing a plurality of execution logics.

Alternatively, considering that multiple implementations may be involved in program construction, such as both mode 1 and mode 2 may be performed in state 1, modes 1 and 2 are two implementations in state 1, so the same programming building block may be employed in the construction of program content, such as the second programming building block and the first programming building block being the same programming building block used to construct program content. For example: in the visual programming of the game, a first programming building block in a first working area is a game-in-player, a building block association area is another working area displayed based on a split screen display operation, a second programming building block in the building block association area is a game-in-player, the first programming building block and the second programming building block are the same programming building blocks which are positioned in different working areas and have the same logic function and are used for jointly constructing program contents, wherein the first programming building block is used for covering one logic implementation condition (such as starting the game) when the game-in-player is started, and the second programming building block is used for covering another logic implementation condition (such as viewing a virtual store) when the game-in-player is started, and the like. Namely: the same programming blocks may be repeatedly applied during the construction of the program content and the second programming block may assist the first programming block in constructing the program content through a process that encompasses a variety of implementations.

Optionally, the second programmed building block is a programmed building block determined by building block definition of the first programmed building block, the building block definition being used to customize building block parameters in the programmed building block, the second programmed building block having fixed building block parameters being obtainable by the building block definition. Wherein the building block parameters are used for determining logic implementation modes while playing logic functions corresponding to the programming building blocks, for example: the programming toy 1 is used for controlling the orientation of the virtual object in the virtual environment, and if the toy parameters of the programming toy 1 are adjusted to be 45 degrees in the x-axis direction and 45 degrees in the y-axis direction, the virtual object is substantially fixed to be oriented in the northeast direction in the virtual environment, and the like. Namely: the second programming building block can assist the first programming building block in constructing program content and the like by means of custom building block parameters.

In an alternative embodiment, the first working area and the building block association area are displayed based on the operation object pointed to by the split screen display operation.

Schematically, the split screen display operation displays different building block association areas aiming at different operation objects; namely: the building block association area is an area determined based on the split screen display operation.

The operation object is used for representing an object aimed at by the split screen display operation, and the operation object can be an independent programming building block, a building block combination obtained by a plurality of programming building block combinations, an area identifier corresponding to different working areas respectively, a function identifier of a plurality of programming functions in a first working area and the like, and is not limited herein.

It should be noted that the above is only an illustrative example, and the embodiments of the present application are not limited thereto.

In summary, the first working area and the building block association area are simultaneously displayed based on the split screen display operation of the first working area, wherein a program construction relationship exists between the first programming building block in the first working area and the second programming building block in the building block association area, so that the program content is constructed by the second programming building block in cooperation with the first programming building block. The split screen display operation allows the user to simultaneously view and operate a plurality of areas on a single display device, so that the high-efficiency interaction between areas is realized by simultaneously operating building block association areas and first working areas in visual programming, the first programming building blocks in the first working areas are also subjected to finer analysis through the building block association areas, the difference and correlation between the areas are conveniently compared while the visual programming efficiency is improved, the area interaction experience in the visual programming is enhanced, the requirements on the plurality of display devices are reduced, the working efficiency is improved while the visual programming flow is optimized, and the man-machine interaction efficiency is improved.

In an alternative embodiment, the building block association area displayed based on the split screen display operation is a second work area, and the second work area is another work area for building program content in a visual form based on programming building blocks. Illustratively, as shown in fig. 3, the embodiment shown in fig. 2 described above may also be implemented as steps 310 through 330 as follows; wherein step 230 may be implemented as follows step 330.

Step 310, displaying a first working area.

The first working area is used for constructing program content in a visual form based on programming building blocks, the programming building blocks are basic units used for representing programming logic in visual programming, and the first working area comprises the first programming building blocks.

In some embodiments, the first working area is a working area displayed within a programming interface, the programming interface being an interface that enables visual programming. Optionally, the visual programming is implemented through a web page, and the programming interface is a web page interface, and accordingly, the first working area is a working area displayed on the web page; or the visual programming is implemented by the application program, the programming interface is a built-in interface of the application program, and correspondingly, the first working area is a working area displayed in the application program, and the like.

The visual programming is a programming mode which allows the use of objects to create and edit the program through graphical elements and visual layout, is different from a traditional text code editing mode, ensures that the logic and flow of the program content are more visual and understandable, and is helpful for quickly understanding the program structure.

In some embodiments, the programming interface may implement a tool area in addition to the first work area, where the first work area and the tool area are separate areas from each other, or where the tool area is located within the first work area, etc.

Optionally, the tool area is used for displaying a plurality of programming blocks, and when the programming blocks are applied in the first working area, the application purpose of the programming blocks is achieved by dragging the programming blocks in the tool area to the first working area.

In some embodiments, the programming interface may implement an edit area in addition to the first work area, where the first work area and the edit area are separate areas from each other, or where the edit area is located within the first work area, etc.

Optionally, the edit field is used to display a plurality of edit functions including a copy function (e.g., copying a programmed block in the first work area, a programmed block group, etc.), a clone function (e.g., after cloning a programmed block, when the programmed block changes, the cloned programmed block changes), a delete function (e.g., deleting a programmed block), an annotate function (e.g., annotating a programmed block), a disable function (e.g., disabling a programmed block), an insert function (e.g., inserting a programmed block into a programmed block group), a eject function (e.g., removing a programmed block from a programmed block group), etc. In addition, other editing functions such as enlarging, reducing and the like can be performed on the programming building blocks through the first working area, and the editing functions are not limited herein.

In some embodiments, the partially programmed bricks have parameter editing functionality for adjusting parameter information corresponding to the programmed bricks when the programmed bricks are applied to determine the implementation of the logic while exerting the logic functions corresponding to the programmed bricks.

Optionally, displaying parameter filling frames corresponding to the programmed building blocks in the first working area; a parameter filling operation for a parameter filling box is received.

The parameter filling frame is used for filling building block parameter information; the parameter filling operation is used for determining a logic implementation mode based on the building block parameter information while playing the logic function corresponding to the programming building block.

Illustratively, the parameter editing function of the programming building block is implemented through at least one parameter filling frame, and at least one parameter information can be filled based on filling operation of the parameter filling frame, so that the logic implementation mode is determined based on the parameter information while the logic function corresponding to the programming building block is exerted. For example: the programming building block 1 comprises two parameter filling boxes which are respectively used for filling offset angles of the x-axis direction and the y-axis direction so as to position the orientation of the virtual object in the virtual environment, if the filling x-axis direction is 45 degrees and the y-axis direction is 45 degrees, the virtual object is approximately determined to be oriented in the northeast direction in the virtual environment, and the like.

FIG. 4 is a schematic diagram of an interface showing a first working area. The first working area 410 includes a programmed building block group obtained by combining a plurality of programmed building blocks, and the first working area 410 further includes an editing area 420 including a plurality of editing functions such as a copy function and a clone function; in addition, a tool area 430 exists adjacent to the first work area 410, including a plurality of building block types such as event type, control type, action type, condition type, value type, function type, variable type, etc., each building block type including at least one programming building block belonging to the building block type and applicable to the first work area 410, etc.

Step 320, receiving a split screen display operation for a first work area.

Illustratively, the split screen display operation is used for realizing a split screen display function, and the split screen display function is used for simultaneously viewing and operating a plurality of independent areas, so that interaction between different tasks can be easily performed without switching full screen applications.

Optionally, the split screen display operation is realized by a triggering operation of a split screen display control; or the split screen display operation is realized through the selection operation of the programming building blocks; or the split screen display operation is realized through the selection operation of the programming building block group; or the split screen display operation is realized by triggering operation of a programming function, etc.

In an alternative embodiment, a plurality of trigger sets are displayed in response to receiving a group view operation for the first work area.

Illustratively, the set of triggers is content comprised of at least one trigger, the trigger being derived from at least one programmed building block combination. Optionally, the trigger is used to represent a programmed set of blocks that is composed of programmed blocks that start with the programmed blocks of the event type.

Schematically, the programming building block group is obtained by combining a plurality of programming building blocks, and the plurality of programming building blocks can be regarded as a whole after being combined, namely the programming building block group; the plurality of programming blocks can also be regarded as an independent individual, i.e. the programming blocks comprise a plurality of programming blocks in a programming block set.

Optionally, when the plurality of programming blocks are combined to obtain the programming block group, a logic sequence relationship exists among the plurality of programming blocks, such as the programming block 1 is in front, the programming block 2 is in back, and the like; because the different programming blocks respectively have corresponding block types, the programming blocks of event type are used for representing the code logic blocks which begin to be executed when the event condition is met, so the programming blocks of event type are used as the programming blocks of the initial programming blocks, represent the code logic contents which begin to be executed when the event condition is met, have the event triggering effect, and therefore the programming blocks which are formed by taking the programming blocks of event type as the initial programming blocks are called as triggers and can also be called as event programming blocks, and are not limited herein.

Schematically, as shown in fig. 5, an interface diagram of a plurality of triggers under the trigger group is shown. Wherein the plurality of trigger sets includes trigger set 510, trigger set 520, and trigger set 530; the trigger set 510 includes a trigger 511 that initiates programming of a block with an event type of programming block "when play begins" and a trigger 512 that initiates programming of a block with an event type of programming block "when signal received".

Wherein, the trigger 511 is represented as a programming building block group 541 in the working area 540, and a plurality of programming building blocks in the programming building block group 541 are programming building blocks belonging to the trigger 511; in addition, the trigger 512 is shown as a set of programming bricks 542 in the working area 540, and a plurality of programming bricks in the set of programming bricks 542 are programming bricks belonging to the trigger 512.

Wherein, a plurality of triggers respectively correspond to a working area.

Optionally, in order to better organize and manage the respective components of the program content, so as to better improve the usability of the program content, reduce the complexity of the program content, multiple working areas may be involved in the process of constructing the program content, different working areas are used for constructing different parts in the program content, and the sub-program content constructed by combining the multiple working areas respectively can obtain the program content with clearer logic.

Illustratively, each trigger group corresponds to one working area, and thus each working area comprises at least one trigger in the trigger group, i.e. a plurality of programming blocks respectively corresponding to the at least one trigger.

Wherein the working area is used to build program content based on programmed building blocks in the trigger set.

Schematically, the trigger group a corresponds to the working area 1, the trigger group a includes a trigger A1 and a trigger A2, wherein the trigger A1 is a programmed building block group obtained by using event type programmed building blocks 1, namely "when a player enters a game", as a starting programmed building block, the trigger A1 includes programmed building blocks, namely "when the player enters the game", and further includes programmed building blocks "send a custom signal" and the programmed building blocks "play an animation special effect beside a virtual object of a trigger event", namely, the trigger A1 is a programmed building block group obtained by combining 3 programmed building blocks; the trigger A2 is a programming building block group obtained by taking an event type programming building block 2, namely 'when a game starts', as a starting programming building block, the trigger A2 comprises programming building blocks, namely 'when the game starts', and also comprises programming building blocks for 'sending a custom signal', namely the trigger A2 is the programming building block group obtained by combining 2 programming building blocks; the trigger group a corresponding to the working area 1 includes the trigger A1 and the trigger A2, so that when the working area 1 is displayed, 3 programming blocks subordinate to the trigger A1 and 2 programming blocks subordinate to the trigger A2 are displayed.

In an alternative embodiment, a split screen display operation is received for a first trigger group of a plurality of trigger groups.

The first trigger group corresponds to the second working area.

Illustratively, the first trigger set is any one of a plurality of trigger sets, and based on the determination of the first trigger set, a second working area corresponding to the first trigger set may be determined, where the second working area is a working area where at least one programming building block in the first trigger set is applied.

In some embodiments, a selection operation for a first trigger group is received as a split screen display operation.

Illustratively, the selection operation includes various operation forms of a single click operation, a double click operation, a long press operation, a slide operation, and the like on the first trigger group. For example: after the plurality of first trigger groups are displayed, if the second working area corresponding to the first trigger groups is desired to be unfolded and displayed, clicking operation can be performed on the first trigger groups to select the first trigger groups, and the clicking operation is used as split screen display operation.

Alternatively, the selection operation may be an operation of selecting a trigger group identifier for the first trigger group. For example: the plurality of trigger groups respectively correspond to one trigger group identifier, and the trigger group identifier of the first trigger group is selected, namely the split screen display operation of the first trigger group can be regarded.

Optionally, receiving a configuration operation for the first trigger group, and displaying a plurality of configuration options corresponding to the first trigger group; and receiving triggering operation aiming at the split screen display options in the configuration options as split screen display operation.

Optionally, each of the plurality of triggers corresponds to a group configuration control, the operation for the group configuration control is regarded as the configuration operation for the trigger group, the group configuration control for the first trigger group in the plurality of trigger groups is triggered, a plurality of configuration options corresponding to the first trigger group can be displayed, and different configuration options provide different configuration functions.

The configuration options comprise a split screen display option which is used for displaying the working area corresponding to the trigger group on the interface in a split screen mode. Therefore, the triggering operation is performed on the split screen display options corresponding to the first trigger group, so that the split screen display operation is performed on the second working area split screen corresponding to the first trigger group, and the purpose of receiving the split screen display operation is achieved.

FIG. 6 is a schematic diagram of an interface showing a first working area in a single column mode, wherein the interface includes two programming building blocks, programming building block 610 and programming building block 620; also included in the first workspace is a trigger group control 630 that enables group view operations to display multiple trigger groups based on the triggering of the trigger group control 630.

FIG. 7 is a schematic diagram of an interface showing a plurality of trigger sets. Including flip-flop group 710, flip-flop group 720, and flip-flop group 730; each trigger is respectively corresponding to a name editing control and a group configuration control, wherein the name editing control is used for editing the name of the trigger group, and the group configuration control is used for carrying out the configuration process on the trigger group.

Illustratively, the trigger group 710 corresponds to a group configuration control 711; triggering for group configuration control 711 displays a number of configuration options such as: "right open", "clone", and "delete", where "right open" is used to indicate that the work area corresponding to the trigger group 710 is displayed in the right area, "clone" is used to indicate that the trigger group 710 is subjected to a clone operation to create one trigger group identical to the trigger group 710 among the trigger groups, and "delete" is used to indicate that the trigger group 710 is removed from the trigger groups, and so on. The configuration options herein are merely illustrative examples, and the plurality of configuration options may further include a plurality of configuration functions such as "left open", "top open", "move", "change style", etc., which are not limited herein.

In some embodiments, an event programming building block is displayed for each of a plurality of triggers in the first trigger set.

The trigger is used for representing a programming building block group obtained by taking an event programming building block as a starting programming building block combination, and the event programming building block is used for representing the programming building block of the event type; therefore, the event programming blocks respectively correspond to a trigger, and the trigger corresponding to the event programming blocks is used for representing the programming block group which takes the event programming blocks as the initial programming block group.

Optionally, after displaying the first trigger set, displaying a plurality of event programming bricks belonging to the first trigger set, the plurality of event programming bricks being programming bricks that construct program content in a second working area corresponding to the first trigger set.

Optionally, in the case that each event programming building block is a starting programming building block, other programming building blocks may be combined under different event programming building blocks, such as a combination action type programming building block, a condition type programming building block, etc., that is, the trigger corresponding to the event programming building block includes a plurality of programming building blocks; other programming blocks may not be combined under the event programming blocks, that is, the trigger corresponding to the event programming blocks only comprises the event programming blocks, which is not limited herein.

In some embodiments, a block trigger operation of programming a block for a first event of the plurality of events is received as a split screen display operation.

Wherein the building block is operative to be positioned to the first event programming building block when the second working area is displayed.

Illustratively, the first event programming brick is a selected event programming brick of a plurality of event programming bricks, and may be implemented as any one of the plurality of event programming bricks.

Optionally, the building block triggering operation includes operations in various triggering forms, such as a single click operation, a double click operation, a long press operation, a sliding operation, and the like. For example: after displaying the event programming building blocks, if the first event programming building blocks in the first trigger group are desired to be positioned and displayed while the second working area corresponding to the first trigger group is unfolded and displayed, the first event programming building blocks belonging to the first trigger group can be selected through the building block triggering operation under the first trigger group, so that the purpose of positioning and displaying the first event programming building blocks while the split-screen display operation is realized.

In some embodiments, a configuration operation for a first event programming building block is received, and a plurality of configuration options corresponding to the first event programming building block are displayed; and receiving building block triggering operation aiming at a split screen display option in a plurality of configuration options as split screen display operation.

Optionally, the plurality of trigger groups respectively include at least one event programming building block, each event programming building block corresponds to one building block configuration control, the operation of the building block configuration control is regarded as the configuration operation of the event programming building block, the building block configuration control of the first event programming building block is triggered, a plurality of configuration options corresponding to the first event programming building block can be displayed, and different configuration options provide different configuration functions.

The configuration options comprise split screen display options, wherein the split screen display options are used for positioning and displaying event programming building blocks when the working areas corresponding to the trigger groups are displayed on the interface in a split screen mode. Therefore, triggering operation is performed on the split screen display options corresponding to the first event programming building blocks, so that the split screen display operation is performed on the second working area corresponding to the first trigger group to which the first event programming building blocks belong while the first event programming building blocks are positioned and displayed on the interface, and the purpose of receiving the split screen display operation is achieved.

FIG. 8 is a schematic diagram of an interface showing a plurality of event programmed bricks. Including flip-flop group 810, flip-flop group 820, and flip-flop group 830; taking a plurality of event programming blocks under the trigger set 810 as an example, the plurality of event programming blocks respectively correspond to a name editing control and a block configuration control, wherein the name editing control is used for adjusting the name of the event programming blocks, and the block configuration control is used for carrying out a configuration process on the event programming blocks.

Illustratively, event programming block 811 corresponds to block configuration control 812; triggering for the building block configuration control 812 displays a plurality of configuration options, such as: "right open", "clone", and "delete", where "right open" is used to indicate that the corresponding working area of trigger set 810 is displayed in the right area and the display is positioned "when a signal is received" (i.e., the event programming block 811 is positioned), and "clone" is used to indicate that the event programming block 811 is subjected to a cloning operation to create one of the plurality of event programming blocks that is identical to event programming block 811, and "delete" is used to indicate that event programming block 811 is removed from the plurality of event programming blocks, etc. The configuration options herein are merely illustrative examples, and the plurality of configuration options may further include a plurality of configuration functions such as "left open", "top open", "move", "change style", etc., which are not limited herein.

And 330, displaying the first working area and the second working area in response to the split screen display operation.

Schematically, when the split-screen display operation is based on the operation of triggering the trigger group, the second working area corresponding to the split-screen display operation can be displayed while the first working area is reserved and displayed on the interface according to the working area corresponding to the selected trigger group under the condition that the split-screen display operation is received.

The first working area is used for constructing first program content, the second working area is a building block association area for constructing second program content in a visual mode based on programming building blocks, the second program content and the first program content form program content together, and the program content is logic codes for running programs.

Illustratively, the first working area is used for constructing first program content, and the first program content is sub-program content of the program content, such as the first program content is used for realizing part of functions in the program content; the second work area is used to construct second program content, which is another sub-program content of the program content, different from the first program content, for realizing other functions in the program content, and the like.

Optionally, if the program content is obtained by constructing two working areas, the first program content and the second program content are summarized to obtain the program content; if the program contents are constructed by more work areas, the program contents are obtained by aggregating a plurality of program contents including the first program contents and the second program contents.

In an alternative embodiment, the first programming brick in the first trigger set is positioned and displayed in the second working area corresponding to the first trigger set in response to the split screen display operation pointing to the first trigger set.

Schematically, the first trigger group is an operation object pointed by split-screen display operation, and then the second working area corresponding to the first trigger group is displayed as a building block association area based on the split-screen display operation; in the process of simultaneously displaying the first working area and the second working area, if the split screen display operation does not point to the specific programming building blocks in the first trigger group, positioning and displaying the first programming building blocks in the first trigger group in the second working area.

Optionally, the first programming building block is a programming building block arranged in the first position in the first trigger group; or the first programming building block is the first programming building block applied to the second working area in the first trigger group; or the first programming building block is the programming building block with the largest application frequency, etc.

Illustratively, based on a trigger operation of "right open" (split screen display option) of the configuration option under the group configuration control 711 in fig. 7, an interface diagram as shown in fig. 9 is displayed for representing a process of displaying the first work area and the second work area based on the split screen display operation.

Including a first working area 910 displayed on the left side and a second working area 920 displayed on the right side; the first working area 910 is a working area displayed on the interface in advance, the second working area 920 is a working area displayed on the interface in a split screen after the first trigger group is subjected to a split screen display operation, and the programming building blocks in the second working area 920 are a plurality of triggers belonging to the first trigger group, wherein the triggers 921 of the programming building blocks with event type programming building blocks as the start of the game are included, and the triggers 922 of the programming building blocks with event type programming building blocks as the start of the change of the sky environment are included, and other triggers which are not shown are also included.

Illustratively, if the first programmed building block in the first trigger set is "when play begins", then the "when play begins" is positioned and displayed in the second work area 920, and the other programmed building blocks are sequentially displayed, as shown in the second work area 920.

In an alternative embodiment, responsive to a split screen display operation directed to a first event programming brick in a first trigger set, the first event programming brick is positioned and displayed in a second work area corresponding to the first trigger set.

Illustratively, the first event programming brick is an event programming brick belonging to the first trigger set, based on selection of the first event programming brick, i.e., as if both the first trigger set and the first event programming brick were selected; therefore, based on the condition that the split screen display operation points to the first event programming building block, the condition that the second working area corresponding to the first trigger is displayed is determined, and the condition that the first time programming building block is positioned and displayed is also determined. Namely: the first event programming brick is displayed while the first work area is reserved for display based on the split screen display operation, and the second work area is displayed and the first event programming brick is positioned and displayed in the second work area.

Illustratively, based on the triggering operation of the configuration option "right open" (split screen display option) under the building block configuration control 812 in fig. 8, an interface schematic diagram as shown in fig. 10 is displayed for representing a process of displaying the first working area and the second working area based on the split screen display operation.

Including a first work area 1010 displayed on the left side and a second work area 1020 displayed on the right side; the first working area 1010 is a working area displayed on the interface in advance, the second working area 1020 is a working area displayed on the interface in a split screen after the split screen display operation is performed on the first event programming building blocks in the first trigger group, and the programming building blocks in the second working area 1020 belong to a plurality of triggers in the first trigger group.

Illustratively, when the first event programming block is "when a signal" is received (event programming block 811) as shown in fig. 8, the first event programming block 1021 is positioned and displayed, or the trigger 1022 of the first event programming block is positioned and displayed as the starting programming block when the second working area 1020 corresponding to the first trigger group is displayed; in addition, since the second working area 1020 represents the working area corresponding to the first trigger group, the second working area 1020 further includes a trigger 1023 for programming the building blocks with "when the environment of the sky changes" as an initial trigger, and other triggers not shown, which are not limited herein.

In the above, the second working area is regarded as a working area displayed after the trigger group in the first working area is triggered, the second working area is used as a type of split screen display area, wherein the second programming building blocks can be implemented as any programming building blocks in the second working area, and the first programming building blocks in the first working area are implemented as any programming building blocks in the first working area; because the second working area and the first working area are commonly used for constructing program contents, a program construction relationship exists between any programming building block in the second working area and any programming building block in the first working area so as to represent the program contents of the second programming building block and the first programming building block.

In summary, by means of the split-screen display operation, the plurality of areas are allowed to be checked and operated simultaneously by using the object on the single display device, so that efficient interaction between the areas is facilitated by simultaneously operating the building block association area and the first working area in visual programming, more detailed analysis of the first programming building blocks in the first working area through the building block association area is also facilitated, difference and correlation between the areas are conveniently compared while visual programming efficiency is improved, area interaction experience in visual programming is enhanced, requirements on the plurality of display devices are reduced, working efficiency is improved while visual programming flow is optimized, and man-machine interaction efficiency is improved.

In the embodiment of the application, the content of the building block association area which is the second working area is introduced. When the operation object pointed by the split-screen display operation is a trigger group or a trigger, the content representing the split-screen display is required to be the trigger group or the working area corresponding to the trigger, so that the second working area is displayed while the first working area is displayed, different programming parts in the process of program content construction are effectively processed through a plurality of working areas, the program construction process is accelerated through a parallel editing mode, the programming building blocks used in the different working areas are also more easily compared and contrasted, the flexibility of the workflow is greatly improved, potential errors are reduced due to simultaneous operation, the readability and the definition of codes are improved, and the user experience of visual programming of the application object is greatly improved.

In an alternative embodiment, the building block associated area displayed based on the split screen display operation is a building block definition area. Illustratively, as shown in fig. 11, the embodiment shown in fig. 2 described above may also be implemented as follows steps 1110 to 1130; wherein step 230 may be implemented as follows step 1130.

Step 1110, displaying a first working area.

Step 1120, receiving a split screen display operation for the first work area.

In an alternative embodiment, the building block definition control is displayed in response to receiving a building block selection operation for a first programmed building block in the first work area.

Optionally, the building block selecting operation includes operations of a plurality of trigger modes, such as a single click operation, a double click operation, a long press operation, and the like, on the first programmed building block; after the first working area is displayed, if the first programming building block is subjected to building block selection operation, the building block information corresponding to the first programming building block is further checked, or editing processing and the like are performed on the first programming building block.

The building block definition control is used for carrying out custom adjustment on building block parameters on the basis of maintaining the logic function of the first programming building block to obtain a second programming building block, and the building block parameters are used for determining a logic implementation mode while playing the logic function corresponding to the programming building block.

Schematically, if the first programming building block is subjected to the building block selection operation, building block definition controls corresponding to the first programming building block are displayed in the first working area, and the first programming building block can be subjected to finer operation by means of the building block definition controls. For example: the first programming building block is a programming building block with a parameter editing function, and a building block definition control can be displayed based on the selection operation of the first programming building block so as to adjust building block parameters corresponding to the first programming building block and fix the building block parameters to obtain a new second programming building block, wherein the second programming building block and the first programming building block can realize the same programming function, but have different programming effects due to the difference of the building block parameters. Such as: the first programming building block is a function 1, the numerical value of the function 1 is 0, the Boolean value (which belongs to a logic data type, and the Boolean value has only two values, namely true and false or is expressed by 0 and 1) is 1, wherein the numerical value and the Boolean value are building block parameters of the first programming building block; if the second programming building block is obtained by adjusting the building block parameters, the numerical value of the function 1' is 1, the boolean value is 0, the first programming building block and the second programming building block can realize the same programming function (namely, the programming function corresponding to the function 1), but have different programming effects, such as correct indication result based on the first programming building block, incorrect indication result of the second programming building block, and the like.

In some embodiments, a building block edit bar is displayed based on a building block selection operation for the first programmed building block.

The building block editing column comprises a building block definition control, and the building block editing column is used for adjusting programming building blocks in the first working area.

Illustratively, the building block editing column includes a plurality of building block definition controls for implementing different building block editing functions, and the selected first programming building block can be subjected to diversified editing processes through the building block editing column. For example: copying the first programming building blocks through a copy control so as to be pasted to other positions of the current working area or to other working areas; other programming bricks can be selected at the same time as the first programming brick through the multi-selection control; the programmed building blocks can be deleted from the work area through a delete control; custom functions may be created by "definition" controls (building block definition controls) to repeatedly apply custom functions, etc.

In an alternative embodiment, a control trigger operation for a building block definition control is received as a split screen display operation.

Illustratively, the control triggering operation includes operations of a plurality of triggering forms such as a single click operation, a double click operation, a long press operation, a dragging operation and the like of the building block definition control. For example: taking the clicking operation of the building block definition control as a split-screen display operation aiming at the first working area; or the long-press operation of the building block definition control is used as split-screen display operation aiming at the first working area; or dragging the building block definition control to other positions as a split screen display operation for the first working area, such as dragging the building block definition control to a right side area, so as to realize the split screen display operation for the first working area.

FIG. 12 is a schematic diagram of an interface for split screen display operation for building block definition controls. In the first working area 1210, a plurality of programmed blocks are displayed, taking the programmed block 1211 as the first programmed block as an example, if a block selection operation for the first programmed block is received, a block definition control 1220 is displayed, for example, the block definition control 1220 is a control displayed in the block edit field 1230. Thereafter, a control trigger operation for the building block definition control 1220 may be received as a split screen display operation to display a building block association interface associated with the first programmed building block while displaying the first work area 1210, the associated content being introduced in step 1130.

In an alternative embodiment, a plurality of custom programmed bricks for application within a work area are displayed; receiving a selection operation aiming at a first custom programming building block in a plurality of custom programming building blocks, and displaying a plurality of editing options; an option trigger operation for a defined option of the plurality of editing options is received as a split screen display operation.

Wherein the working area comprises a first working area. In addition, the working area may also include a second working area or other working area, so the working area is a generic term for an area where program content is built using programming bricks.

The custom programming building blocks are used for representing the programming building blocks with adjustable building block parameters. For example: the custom programming building blocks are programming building blocks with adjustable orientation angles; or the custom programming building blocks are programming building blocks capable of adjusting judgment conditions; or the custom programming building blocks are programming building blocks capable of adjusting the moving speed, and the like.

Illustratively, the plurality of custom programming bricks are programming bricks that can be applied within the work area, such as applying at least one programming brick of the plurality of custom programming bricks within the first work area, and so on.

Optionally, a plurality of custom programming bricks are pre-displayed in the first working area; or a plurality of custom programming building blocks are displayed in the tool area outside the first working area in advance; or after triggering specific building block display controls, displaying a plurality of custom programming building blocks, such as displaying a plurality of custom programming building blocks after triggering function type controls.

Illustratively, the first custom programming block is any one of a plurality of custom programming blocks; the selecting operation includes at least one of clicking operation, long-press operation, sliding operation, dragging operation and other operation modes of the first custom programming building block, and if the selecting operation is performed on the first custom programming building block, a plurality of editing options corresponding to the first custom programming building block are displayed.

Optionally, the plurality of editing options respectively correspond to one editing function for adjusting the building block state of the first custom programming building block. For example: the "edit" option is used to adjust the parameter configuration of the current first custom programming building block, the "define" option is used to generate a second programming building block with a new parameter configuration based on the first custom programming building block, and the "delete" option is used to remove the first custom programming building block from the plurality of custom programming building blocks.

Illustratively, the plurality of editing options includes a definition option for generating a second programmed building block by adjusting building block parameters of the first custom programmed building block. Optionally, the option triggering operation is performed for the definition option as a split screen display operation, so that the building block parameters of the first custom programming building block are more comprehensively adjusted through the building block association interface displayed by the split screen, and the second programming building block is obtained.

As shown in fig. 13, an interface diagram of a split screen display operation for defining options is shown. Wherein a plurality of programmed bricks are displayed in the first work area 1310, and a plurality of custom programmed bricks 1320 for application within the work area are also displayed in the interface (e.g., the plurality of custom programmed bricks 1320 are displayed triggered for function type controls in the tool area 1330); taking the custom programming block 1321 as the first custom programming block as an example, if a selection operation for the first custom programming block is received, displaying a plurality of editing options 1340, where the plurality of editing options 1340 includes a definition option 1341; an option trigger operation for definition option 1341 may then be received as a split screen display operation to display a building block association interface associated with the first custom programmed building block while displaying first working area 1310 to obtain a second programmed building block in the building block association interface, the associated content being introduced in step 1130.

In step 1130, the first working area and the building block definition area are displayed in response to the split screen display operation.

The building block definition area is used for acquiring a second programming building block which has program construction relation with the first programming building block.

Illustratively, building block definition generally refers to the process of creating custom programmed building blocks that allow a set of operations or logic to be packaged using objects so that it can be reused in multiple places of visual programming; the process of creating custom programming building blocks is realized by means of the building block definition area, so that modularization and reusability of codes are improved, and the structure of program content is clearer and more organized.

The building block definition area is an area for realizing a building block definition process, and can be used for adjusting building block parameters on the basis of a first programming building block to obtain a second programming building block, and can be used for adjusting building block parameters on the basis of a custom programming building block to obtain a second programming building block capable of assisting the first programming building block in building program content.

FIG. 12 is a schematic diagram of an interface for split screen display operation for building block definition controls. Wherein the control trigger operation for the block definition control 1220 is received as a split screen display operation, such that the block definition area 1230 associated with the first programmed block 1211 is displayed as a block association interface while the first working area 1210 is displayed, the block definition area 1230 including the second programmed block 1231 in program build relationship with the first programmed block 1210. Optionally, the second programming block 1231 is configured to display definition information related to the first programming block 1211, such as a refinement of the implementation of the block parameters of the first programming block 1211, where the value 1 parameter is set to 0 and the boolean value 1 is set to "True"; in addition, the usage object may also adjust the block parameters of the second programming block 1231 based on the block definition area 1230, such as setting the value 1 parameter to 1, setting the Boolean value 1 to "False", etc. Namely: the effect of defining the area for the building blocks and the second programmed building blocks is not limited.

As shown in fig. 14, a schematic view of a split screen interface displayed after an option triggering operation is performed on the definition option 1341 shown in fig. 13. On the basis of reserving and displaying the first working area 1410, a building block definition area 1420 corresponding to the first custom programming building block (custom programming building block 1321-homemade code 1) is displayed in a split screen mode, the building block definition area 1420 is used for displaying the homemade code 1 in a finer mode, and meanwhile building block parameters (such as a numerical value 1, advancing and the like) in the building block definition area 1420 can be modified and adjusted, so that the purpose of acquiring the second programming building block in the building block definition area 1420 is achieved. The second programming brick may be applied to the first working area 1410, but may also be applied to other working areas, not limited herein.

In the embodiment of the application, the content of the building block association area which is the building block definition area is introduced. Program content can be constructed in a visual mode through the first working area, programming building blocks can be modified and created through the building block definition area, so that real-time performance of the programming building blocks can be conveniently and intuitively seen by a user, testing and adjustment can be efficiently performed in the working area, rapid iterative design of new programming building blocks can be facilitated when the programming building blocks are defined and used, the organization of the working area can be maintained through separation of the working area and the building block definition area, the program construction result is clearer, independent application and repeated application of the new programming building blocks created in the building block definition area are facilitated, and the code readability and definition are improved while the visual flow is optimized.

In an alternative embodiment, when the first working area and the building block related area are displayed based on the split screen display operation, the first working area and the building block related area are connected through the boundary trigger bar; the state between the first working area and the building block association area can be adjusted through the boundary touch spring, so that the interface is more flexible to present. Illustratively, as shown in fig. 15, the embodiment shown in fig. 2 described above may also be implemented as steps 1510 through 1570 below.

At step 1510, a first working area is displayed.

In some embodiments, the first working area is a working area displayed on a programming interface, the programming interface being an interface for implementing visual programming. Alternatively, the programming interface may implement a tool area in addition to the first working area, where the first working area and the tool area are independent areas from each other, or where the tool area is located within the first working area, etc.

Optionally, the tool area includes a plurality of building block types, each building block type including a programming building block belonging to the building block type; or each building block type comprises a plurality of building block sub-types, each building block sub-type comprises programming building blocks belonging to the building block sub-type, and the like.

As shown in fig. 16, an interface diagram of the tool area is shown. Including a plurality of building block types such as: event type, control type, action type 1610, condition type, value type, function type, and variable type; taking action type 1610 as an example, the action type 1610 further comprises a plurality of building block sub-types subordinate to the action type 1610, such as assignment sub-type 1620, array sub-type, global sub-type and the like; if assignment subtype 1620 is selected, then a plurality of programming blocks belonging to assignment subtype 1620, such as "set variable", "set array variable", etc., are displayed.

In an alternative embodiment, a split screen prompt is displayed in response to the number of programmed bricks used in the first work area reaching a preset threshold.

The split screen prompt message is used for prompting the newly-built third working area and displaying the third working area through split screen display operation.

Schematically, the number of blocks programmed in the first working area is detected in real time, if the number of blocks reaches a preset threshold (for example, 100 blocks, 500 blocks, etc.), split screen prompt information can be displayed on the interface to prompt a user to newly establish a third working area so as to share the storage pressure when the first working area builds program content, and then the third working area can be displayed in a split screen mode, so that the program content can be more comprehensively built in a mode of simultaneously displaying the first working area and the third working area, and higher overall performance is achieved.

Step 1520, a split screen display operation for the first work area is received.

Illustratively, the split screen display operation is an operation for implementing a split screen display function, which is a function provided by the first working area for simultaneously viewing and operating a plurality of independent areas, and can easily interact between different tasks without switching full screen applications. For example: and displaying the first working area based on split screen display operation, wherein the building block association areas are different independent areas.

Optionally, at least two independent areas are displayed based on a split screen display operation. Namely: under the split screen display operation, not only two independent areas can be displayed on the interface at the same time, but also more independent areas such as three independent areas, four independent areas and the like can be displayed on the interface at the same time, and the number of split screen displays is not limited.

In some embodiments, the split screen display operation is an operation performed with respect to a first programmed building block in the first work area; or the split screen display operation is an operation performed on the trigger group in the first working area; or the split screen display operation is an operation performed on the custom programming building blocks applied to the first working area; or the split screen display operation is an operation for an editing function within the first work area.

The first working area includes a plurality of functional controls for realizing different editing functions, the functional controls are dragged to a specific area on the interface, the editing area corresponding to the functional controls can be displayed as a building block association area for split screen display, so that programming building blocks in the first working area can be subjected to more macroscopic adjustment and the like, and an operation object pointed by the split screen display operation is not limited.

Step 1530, in response to the split screen display operation, displaying the first working area and the building block association area.

In some embodiments, the split-screen display operation corresponds to an operation attribute, where the operation attribute includes at least one of a plurality of attributes including an operation position, an operation direction, an operation size, an operation time, and the like, and the operation attribute is used to set an operation state implemented by the split-screen display operation.

Illustratively, the operation position is used for setting the position displayed by the area (the first working area and/or the building block association area) after the split screen display operation, such as: the operation position of the split screen display operation is used for representing the position condition of the newly added building block association area displayed in the interface; the operation direction is used for setting the relative direction between the areas (the first working area and/or the building block association area) after the split screen display operation, such as: the operation direction of the split screen display operation is used for indicating that the newly added building block association area is displayed on the right side of the interface, and the first working area is displayed on the left side of the interface relatively; the operation size is used for setting the relative size between the areas (the first working area and/or the building block association area) after the split screen display operation, such as: the operation size of the split screen display operation is used for indicating that the area size of the newly added building block association area is the same as that of the first working area, or the newly added building block association area occupies 80% of the interface, the first working area occupies 20% of the interface and the like; the operation time sets the time when the split screen display operation triggers the split screen display, for example: the current time is 12:56, the operation time of the split screen display operation is 13:30, and the first working area and the building block association area can be displayed at the same time only when the constraint is 13:30 based on the operation time, namely, the split screen display process can be displayed in a delayed mode based on the operation time.

In some embodiments, the first work area and the building block association area are displayed based on an operation attribute corresponding to the split screen display operation.

Optionally, if the operation attribute corresponding to the split screen display operation indicates that the first working area and the building block association area are arranged in parallel and occupy half of the interface, the first working area and the building block association area with the same area size of the parallel display area are displayed on the interface.

As shown in fig. 17, a schematic diagram of the parallel display area is operated based on the split screen display. Wherein first working area 1710 and building block associated area 1720 are displayed side-by-side on the interface and each occupy the same area size of the interface.

Optionally, if the operation attribute corresponding to the split screen display operation indicates that the first working area is displayed on the left side of the interface, the building block association area is displayed on the right side of the interface, and each of the first working area and the building block association area occupies half of the interface, the first working area and the building block association area with the same area size are sequentially displayed from left to right on the interface.

Optionally, if the operation attribute corresponding to the split screen display operation indicates that the first working area is displayed above the interface, the building block related area is displayed below the interface, the first working area occupies 60% of the interface, and the building block related area occupies 40% of the interface, the first working area with the area occupation ratio of 60% and the building block related area with the area occupation ratio of 40% are sequentially displayed on the interface from top to bottom.

In some embodiments, responsive to a split screen display operation pointing to a first display location, a building block associated region is displayed at the first display location, and a first work area is displayed.

The first display position is an operation attribute corresponding to the split-screen display operation, and when the split-screen display operation points to the first display position, the building block association area needs to be displayed at the first display position.

Optionally, the first working area is displayed at the second display position.

The second display position is different from the first display position, and the first working area and the building block association area are mutually independent. Illustratively, based on the building block association area being displayed at the first display position, other display positions than the first display position may be taken as the second display position, and the first working area may be displayed at the second display position.

It should be noted that the above operation attribute corresponding to the split-screen display operation is merely an illustrative example, which is not limited in the embodiment of the present application.

In some embodiments, the block-associated region is displayed in a third position in response to the split screen display operation indication, displaying the block-associated region of the first size and the first working region of the second size; and displaying the building block association area at a fourth position in response to the split screen display operation instruction, and displaying the building block association area with the third size and the first working area with the fourth size.

Wherein the third position is different from the fourth position and the first size is different from the third size. Namely: when the display positions of the building block association areas indicated by the split screen display operation are different, the building block association areas with different sizes are displayed.

Optionally, the first size and the second size are the same; or the first and second dimensions are different. Illustratively, the second size is a size determined based on the interface display size and the first size. Such as: the second size is the difference between the interface display size and the first size.

Optionally, the third dimension and the fourth dimension are the same; or the third and fourth dimensions are different. Illustratively, the fourth size is a size determined based on the interface display size and the third size. Such as: the fourth size is a difference between the interface display size and the third size, and so on.

In an alternative embodiment, the area control is displayed with the first work area and the building block associated area displayed; and responding to a first triggering operation aiming at the area control, reserving and displaying the first working area and the focal area in the building block association area, and canceling and displaying the non-focal area.

The area control is used for reserving a display focus area and canceling a display non-focus area.

Illustratively, the focal area is a first work area or a building block associated area, the focal area being used to represent the area for which the last operation was directed.

Optionally, if the last operation is an operation of opening the building block association area, the focal area is the building block association area; if the last operation is to apply a new programming building block on the first working area, the focal area is the first working area; if the last operation is a click operation on a programmed block in the block related area, the focus area is the block related area, etc.

Namely: the focus area is an operation that flexibly changes along with an operation performed on the area.

Optionally, the area control is displayed in a case where the first working area and the building block association area are displayed, so that a plurality of areas displayed by the split screen can be more quickly managed through the area control.

Schematically, if the focal area is the first working area, performing a first triggering operation on the area control, reserving and displaying the first working area, and canceling and displaying the building block association area; and if the focal area is the first working area, performing a first triggering operation on the area control, reserving and displaying the building block association area, canceling and displaying the first working area and the like.

Optionally, the first trigger operation includes at least one of a plurality of trigger forms of a single click operation, a double click operation, and the like.

In some embodiments, the display positions of the first work area and the building block associated area are swapped in response to a second trigger operation for the area control.

The second trigger operation is a trigger operation different from the first trigger operation. Such as: the first trigger operation is a trigger operation in a click form, the second trigger operation is a trigger operation in a long press form, and the like.

In an optional embodiment, the operation object pointed by the split-screen display operation is a first split-screen object, and the first working area and the building block association area of the first style are displayed; and responding to the operation object pointed by the split screen display operation as a second split screen object, and displaying the first working area and the building block association area of the second style.

The first split-screen object and the second split-screen object are different, and the first style and the second style are different. Namely: when the operation objects pointed by the split-screen display operation are different, building block association areas with different styles are displayed. The patterns include various patterns of colors, borders, coarseness, etc., and are not limited herein.

For example: when the operation object pointed by the split-screen display operation is a trigger group, displaying a rectangular second working area as a building block association area; when the operation object pointed by the split screen display operation is a definition option, a circular building block definition area is displayed as a building block association area and the like.

Or when the operation object pointed by the split-screen display operation is the trigger group 1, displaying an orange second working area as a building block association area; when the operation object pointed by the split-screen display operation is the trigger group 2, the second green working area is displayed as the building block association area and the like.

Step 1540 receives a region sizing operation for the boundary touch spring.

The boundary touch spring is a touch spring connecting the first working area and the building block association area. Optionally, the boundary trigger spring is a line segment between the first working area and the building block association area; or the boundary touch spring is a narrow strip area between the first working area and the building block association area; or the boundary spring is a circular adjustment control between the first working area and the building block association area, etc., and the implementation form of the boundary spring is not limited herein.

Wherein the zone sizing operation is used to adjust the relative zone duty cycle between the first working zone and the building block associated zone.

Schematically, in the default state, the first working area and the building block association area have the same area size on the interface, and when the user needs to adjust the display size of any area on the interface, the dragging operation can be performed on the boundary touch spring to realize the area size adjustment operation.

Optionally, in the split screen state, the display size corresponding to the adjustment area may affect the display size of other areas. For example: two areas exist in the split screen state, and if the display size of the area 1 is increased, the display size of the corresponding area 2 is reduced; similarly, if the display size of the region 1 is reduced, the display size of the corresponding region 2 is enlarged.

Optionally, in the split screen state, adjusting the display size corresponding to a certain area may affect the display size of a partial area, and may not affect the display size of another partial area. For example: for example: in the split screen state, there are three areas, and if the display size of the area 1 is increased, the display size of the area 2 is reduced, but the display size of the area 3 is unchanged.

Fig. 18 is a schematic view of an interface for performing a region resizing operation based on a boundary touch spring. Wherein a boundary trigger spring 1830 is connected between first working area 1810 and building block associated area 1820; if the boundary trigger bar 1830 is dragged leftwards, the area size of the building block related area 1820 is enlarged, and the area size of the first working area 1810 is correspondingly reduced, that is, the purpose of adjusting the relative area ratio between the first working area and the building block related area based on the area size adjustment operation is achieved; similarly, when the boundary trigger spring 1830 is dragged rightward, the area of the building block related area 1820 is reduced, and the area of the first working area 1810 is correspondingly enlarged.

Step 1550, in response to the region resizing operation, displays the resizing result.

Wherein the resizing result is a display result obtained based on the region resizing operation. The sizing result includes at least one of the adjusted first working area and the adjusted building block association area.

Optionally, if the area size adjustment result is used to reduce or enlarge a certain area, the size adjustment result displayed based on the area size adjustment operation includes the adjusted first working area and the adjusted building block related area.

Illustratively, if the area-based resizing operation is to reduce or enlarge a certain area, displaying the resized first working area and the resized building block-associated area on the interface so as to operate on the resized first working area by the user object; or to use the object to operate on the resized building block association area, etc.

Fig. 18 is a schematic view of an interface for performing a region resizing operation based on a boundary touch spring. Wherein a boundary trigger spring 1830 is connected between first working area 1810 and building block associated area 1820; if the drag operation is performed to the left by the boundary trigger bar 1830, the area size of the building block association area 1820 is enlarged, and the area size of the first working area 1810 is correspondingly reduced.

Alternatively, if the area size adjustment result is used to cancel displaying a certain area, the size adjustment result displayed based on the area size adjustment operation is the adjusted first working area (cancel displaying the building block related area), or the size adjustment result is the adjusted building block related area (cancel displaying the first working area).

Illustratively, continuing to drag the boundary touch spring 1830 to the left on the basis of fig. 18 until the first working area 1810 is not displayed on the interface, the interface schematic as shown in fig. 19 is displayed. Where the first working area is not displayed on the interface, building block association area 1910 occupies the entire interface.

Step 1560, a region swap operation for a boundary touch spring is received.

Wherein the first working area is displayed at a first location and the brick association area is displayed at a second location, and the area swapping operation is used to swap the display locations of the first working area and the brick association area.

Optionally, the area exchanging operation includes at least one of a plurality of trigger forms of a long press operation, a double click operation, etc. of the boundary touch spring. For example: the first working area is displayed on the left side (first position), the building block related area is displayed on the right side (second position), and a double click operation for the boundary touch spring is received as an area exchanging operation so as to exchange the first working area and the building block related area.

Step 1570, responsive to a zone swap operation, a building block association zone at a first location and a first working zone at a second location are displayed.

Optionally, displaying a prompt message in response to the region exchange operation; the building block association area at the first location and the first work area at the second location are displayed based on a confirmation operation of the hint information.

Illustratively, as shown in FIG. 20, a prompt 2010 is displayed in response to a zone swap operation for a boundary touch spring to prompt a user whether to swap left and right canvas (i.e., first work zone 2020 on the left and building block associated zone 2030 on the right); if the triggering operation of the confirmation control 2011 in the prompt 2010 by using the object is regarded as the confirmation operation of the prompt, the building block related area 2030 on the left side, the first work area 2020 on the right side, and the like are correspondingly displayed.

In the embodiment of the application, the content of adjusting the display states of the first working area and the building block association area through the boundary trigger bar is introduced. The relative area ratio of the first working area and the building block association area can be adjusted through the boundary trigger bar, and any area can be canceled from being displayed, so that the interface display is more flexible; in addition, the display positions of the first working area and the building block association area can be exchanged through the boundary trigger bar, so that the split screen display effect in visual programming is enriched, and the man-machine interaction efficiency is improved.

In an alternative embodiment, taking the example of displaying two columns of areas by split-screen display operation, the operation method of the visual programming interface is called as an editor double-column method of visual programming, and the visual programming process can be run on a device supporting a Web browser, such as a personal computer, a tablet computer, a smart phone and the like, or can access an application program providing a visual function through the device.

Considering that the program content is complex, a large number of programming blocks are usually used for constructing the program content, so that partial programming blocks can be respectively used by different canvases, and the number of programming blocks in a working area is simplified; the programming building block group taking the event type as the starting programming building block can be called as a trigger, the trigger group comprises at least one trigger, different triggers respectively correspond to one working area, and the working area can also be called as canvas and represents the working area where the programming building block is positioned; the visual programming interface is usually displayed with a working area, and the working areas corresponding to the trigger groups are hidden by the trigger group control.

Illustratively, describing the data structure in the canvas, the trigger can be created by dragging the programming blocks in the visual programming interface using the object, and the function type programming blocks can be customized. The process can generate corresponding json files at the bottom layer of the platform for storage, when an object is used for submitting constructed program content, the terminal can store the json files to the background, when the object is used for opening the project again at the programming interface next time, the client can download the project json files from the background, generate programming building blocks displayed on the programming interface after analysis, and display the programming building blocks on the canvas.

In an actual project, there are multiple canvases, multiple triggers and corresponding auxiliary data, and there is also a multi-level relationship between the project and the programming building blocks, as shown in fig. 21, which is a simplified project structure diagram, wherein the overall hierarchical division of the project structure is shown, and the outer ring and the inner ring are in one-to-many relationship.

For example: item 2110 is an abbreviation for the program content of the build, item 2110 includes a plurality of trigger sets 2120, one trigger set 2120 including a plurality of blocks 2130 (programming blocks), one block 2130 including a plurality of programming blocks 2140.

Illustratively, the programming building block 2140 is represented by attribute parameters such as a building block type (category), a building block content (type), and the like, wherein the building block type comprises a plurality of event types, control types, action types, value types, function definition types, and the like; the building block content comprises 'when a game starts', 'set variable', and the like; in addition, the building block identification, the position and size of the building block, the actual data in the building block (building block parameters) and the like are included, which are not limited herein.

The position and the size of the building blocks are represented by bounding boxes, and the bounding boxes are rectangular and comprise x-axis coordinates, y-axis coordinates, building block widths, building block heights and the like.

As shown in fig. 22, a schematic diagram is shown of a single programming block enclosed by an bounding box, where bounding box 2210 is rectangular and programming block 2220 is irregularly shaped like a rectangle.

Illustratively, a block is used to describe a combination of a plurality of programming blocks, i.e., the programming block set described above; the monolith has a monolithic representation and also has a monolithic bounding box.

As shown in FIG. 23, a schematic diagram of a monolith enclosed by a bounding box is shown, wherein monolith 2310 is rectangular and monolith 2320 is an irregularly programmed set of a plurality of programmed block combinations.

Alternatively, the entire bounding box is calculated from the union of the bounding boxes of each programming building block inside.

If the block starts with an event type programming block (i.e., starts with an event programming block), the block is a Trigger (Trigger) that is triggered by an event, such as block 2330 in fig. 23 is a Trigger that starts with an event type programming block "when a player enters a game".

If a block begins programming blocks with a function type of programming block, the block is a "function defined" block. Alternatively, in other cases the whole block may not be called, i.e. garbage whole block, i.e. a whole block that is not useful in visual programming.

If one programming block is not connected to any other programming block, such as programming block 2340 on the lower right of FIG. 23, then it forms a block itself, i.e., a block may include at least one programming block.

Thus, the trigger set is intuitively all programming blocks in a canvas, and non-triggers, not event type programming blocks, that are initiating programming blocks are also included in the trigger set.

Optionally, the trigger group also has a trigger group identifier, and also includes the name of the trigger group, and may also include at least one bounding box corresponding to at least one whole block in the trigger group, and all programming blocks connected therein, which are not limited herein.

One of the items may contain multiple sets of triggers, as shown in FIG. 24, a schematic diagram of a canvas corresponding to a set of switching triggers is presented, wherein multiple sets of triggers 2410 are included, and different sets of triggers may be switched by the set of triggers panel 2420.

In the related art, when entering a programming interface, the canvas 1 corresponding to the trigger group a is displayed by default, the canvases corresponding to the plurality of trigger groups are displayed based on the triggering of the trigger group control, if the canvas 2 corresponding to the trigger group B is selected, the canvas 2 is displayed on the programming interface and the canvas 1 is canceled, and then all programming blocks subordinate to the trigger B are loaded on the canvas 2, namely: the working area in the visual programming is displayed in a single column form in the related art.

Schematically, the operation of moving one trigger to another trigger group in the related art is shown in fig. 25.

At step 2510, the source trigger set is opened.

The source trigger group is used for indicating the trigger group where the trigger to be moved is located, the trigger group opposite to the source trigger group is the target trigger group, and the target trigger group is used for indicating the trigger group where the trigger to be moved is located after being moved. Illustratively, if it is desired to move the trigger in the source trigger set to another trigger set, the moved trigger set is the target trigger set.

The trigger may be moved to be present in the source trigger set, or may be removed from the source trigger set, which is not limited herein.

Illustratively, when the source trigger set is opened, the canvas corresponding to the source trigger set is displayed.

Step 2520, scroll the canvas to the specified triggers.

Illustratively, the designated trigger is the trigger in the source trigger group that needs to be moved; after the canvas corresponding to the source trigger set is displayed, the canvas is scrolled to the designated trigger.

Step 2530, whether there are programmed bricks that need to be duplicated.

Illustratively, each trigger includes at least one programming building block, after scrolling the canvas to the designated trigger, if there are programming building blocks in the designated trigger that need to be copied, then executing the following step 2540; if the programming building blocks which need to be copied do not exist in the designated trigger, the execution of the process is finished.

Step 2540, select the programming blocks.

Illustratively, the programmed building blocks are selected by way of a single click operation, a double click operation, a long press operation, etc. for the programmed building blocks.

In step 2550, the lower toolbar clicks copy.

Optionally, based on the selection process of the programmed building blocks, a toolbar (i.e., the building block editing bar described above) is displayed below, and a copy control is included in the toolbar to indicate copying of the selected programmed building blocks.

In step 2560, the target trigger set is opened.

Schematically, the target trigger group, i.e. the trigger group to be pasted by the copied programming building blocks, is opened, i.e. the canvas corresponding to the target trigger group is displayed, and is in a single-column display state based on the related technology, so that the canvas corresponding to the source trigger group is canceled.

In step 2570, paste is clicked.

Illustratively, a paste is clicked in a toolbar below the canvas to which the target trigger set corresponds to paste the copied programming blocks into the current canvas.

Step 2580, drag the programming building blocks to the designated positions.

Illustratively, the programming blocks copied and pasted to the corresponding canvas of the target trigger set are dragged to the designated locations to apply the programming blocks at the designated locations.

If it is desired to copy a new programming block from the source trigger set (either the source trigger set or the new source trigger set) to the target trigger set, then execution again from step 2510 is desired. Namely: the number of operations is approximately: the number of programmed blocks to be duplicated is 7.

In an alternative embodiment, the contents of the canvas of the source trigger set and the canvas of the target trigger set are simultaneously displayed in a double-column display manner as shown in fig. 26, and the embodiment shown in fig. 2 may be further implemented as the following steps 2610 to 2650, compared to the manner in which the working area (canvas) is displayed in a single column.

In step 2610, the source trigger set is opened.

Step 2620 scrolls the canvas to the specified trigger.

Step 2630, open the set of target triggers to the right.

Schematically, the target trigger group, i.e. the trigger group to be pasted by the copied programming building blocks, is opened, i.e. the canvas corresponding to the target trigger group is displayed, and the operation method of the visual programming interface introduced based on the embodiment is shown as a double-row display state, so that the canvas corresponding to the target trigger group is displayed while the canvas corresponding to the source trigger group is reserved.

Optionally, taking the example of reserving the canvas corresponding to the display source trigger group on the left side of the picture and reserving the canvas corresponding to the display target trigger group on the right side of the picture.

At step 2640, the right canvas is scrolled to the specified trigger.

Illustratively, taking the canvas corresponding to the right display target trigger group as an example, scrolling the right canvas to a designated trigger, where the designated trigger is a trigger to be pasted by the copied programming building block.

Step 2650, drag programming bricks.

Illustratively, the process of dragging the programmed building blocks in the source trigger set to the specified triggers corresponding to the target trigger set is regarded as the process of copying the programmed building blocks in the source trigger set to the target trigger set by finding the programmed building blocks which need to be dragged and copied to the specified triggers in the target trigger set from the canvas corresponding to the source trigger set.

Namely: the number of operations for copying the programming blocks to the target trigger set in the above-described dual display mode is approximately: the number of programmed blocks to be duplicated +4 greatly improves the efficiency of duplicating programmed blocks in different trigger sets.

In an alternative embodiment, as shown in fig. 27, a rendering flow in a single-column manner and a double-column manner is described.

Step 2710, load project json file and parse.

Illustratively, after the json file is saved in the background, if the project content needs to be loaded, the project json file needs to be loaded and parsed.

Step 2720, whether or not there are two columns.

Judging whether the display condition is double-row display or not; if not, step 2731 is performed, and if yes, step 2741 is performed.

Step 2731, retrieving the corresponding trigger group data from the json file.

Illustratively, if a single column display is provided, the corresponding trigger group data is fetched from the json file for subsequent rendering.

Step 2732, traversing renders each programmed building block.

Illustratively, a plurality of programming bricks are displayed therein based on json file rendering.

Step 2741, fetch left trigger set data from json file.

Illustratively, if a double-row display is present, the left trigger set data is retrieved from the json file.

Step 2742, render each programmed building block in the left half.

Illustratively, the programmed bricks that should be displayed on the left are rendered and displayed in the left area, and if the left area is the first work area, the programmed bricks in the first work area are rendered and displayed.

Step 2743, fetch right trigger set data from json file.

Illustratively, in the case of a dual display, the right trigger set data is retrieved from the json file.

Step 2744, render each programmed building block in the right half.

Illustratively, the programmed bricks that should be displayed on the right are rendered and displayed in the right area, and if the right area is a brick association area, the programmed bricks in the brick association area are rendered and displayed.

Step 2745, render the partitions.

Illustratively, it is also necessary to render a separate area in the middle of the left and right areas, such as rendering a display border spring.

Step 2750, rendering the toolbar and other panels.

Illustratively, a toolbar and other panel content also need to be rendered.

Optionally, when the project json file is loaded into the running environment, only the trigger group currently displayed in the foreground will be concerned, and the data structure in the memory is as follows:

the single column mode (normal mode) takes the following values:

Illustratively, TRIGGERSLIST represents a trigger set list, when a single column is displayed, i.e., the data of the currently open trigger set; columnNum represents the number of columns, and the value under a single column is 1; focusIndex represents the representation of the focus area, and the single column value is 0.

The values of the double-row mode are as follows:

TRIGGERSLIST have two terms, such as two trigger sets on the left and right; columnNum takes a value of 2 in double columns; when the focal region is on the left side, focusIndex takes on a value of 0, and when the focal region is on the right side, focusIndex takes on a value of 1. The number of areas can be extended to 3 columns and 4 columns, which is described above as supporting two columns.

Illustratively, as shown in FIG. 28, when columnNum takes on a value of 1, the zone control is represented as icon 2810; when columnNum has a value of 2 and the focus index has a value of 0, the area control is represented as an icon 2820, and the representative focus area is a right area; when columnNum has a value of 2 and the focusindex has a value of 1, the region control is represented as an icon 2830, representing that the focus region is the left region, and the like, which is not limited herein.

In an alternative embodiment, a background flow for opening a new trigger set is described as shown in FIG. 29.

Step 2910, adding the identity of the newly opened trigger group to the interface space.

Schematically, the interface space identifier corresponding to the interface displayed on the terminal is WorkspaceData, if the new trigger group is opened, the identifier of the trigger group is added into the interface space, so that the canvas corresponding to the new trigger group is displayed on the interface corresponding to the interface space.

Step 2920, the number of columns becomes 2; the focal point becomes 1.

Schematically, if the number of columns is 2 for double-column display, the focal area defaults to a newly opened area, and the focal value is 1.

Step 2930, rendering the canvas in a double-column manner.

Illustratively, the two-sided canvas is rendered in a double-column manner.

Step 2940, whether a trigger is specified.

Illustratively, if the specified trigger is selected, then step 2950 is performed; if the trigger is not designated, the process is ended.

In step 2950, the right half canvas movement specifies that the trigger is uppermost.

Illustratively, if the specified trigger is selected, the specified trigger is moved to be displayed on the right half canvas, such as by displaying the specified trigger on the uppermost side.

As shown in fig. 30, when the identifier 3010 corresponding to the trigger group is clicked, which represents that the selected trigger group needs to be designated at this time, instead of selecting the designated trigger in the trigger group, a plurality of programming blocks may be displayed starting from the first programming block corresponding to the trigger group (if the solid arrow in fig. 30 indicates that, taking the custom function 1 as the first programming block as an example, a plurality of programming blocks in the trigger group are displayed starting from the custom function 1 based on the selection of the trigger group); when the identifier 3020 corresponding to a certain trigger in the trigger group is clicked, which represents a specific trigger designated to the trigger group at this time, at least one programming building block in the trigger (for example, the dashed arrow in fig. 30 indicates the content, and if the designated trigger is selected as "when game starts", the programming building block in the trigger "when game starts") can be positioned and displayed.

In some embodiments, the block-related area displayed based on the split-screen display operation is exemplified as a block definition area, and as shown in fig. 31, a procedure of displaying the block definition area is explained, taking the block definition area displayed on the right side as an example.

Step 3110, query function definition building blocks in the project json file according to the function identification.

Illustratively, the programmed building blocks of the selected function type are determined, and the programmed building blocks of the function type are queried in the project json according to the building block identification of the programmed building blocks, namely, the custom programmed building blocks are searched.

Step 3120, whether double columns are currently present.

Schematically, whether the current display form is double-row or not is judged; if step 3131 is not performed, step 3141 is performed if so.

In step 3131, the data memory of the right canvas is freed.

Illustratively, if the current display is not double-lined, the data memory of the right canvas is released, i.e., the content in the right region is not displayed.

In step 3132, the right frame drawing function defines a building block.

Illustratively, the programmed bricks associated with the function definition are displayed in the right region, which is the communication region in the case of a single column display.

In step 3141, the original image is reduced by half.

Illustratively, the original image is reduced to the left region, leaving a separate right region on the right.

At step 3142, the two-sided canvas area is rendered.

Illustratively, json file-based queries should be rendered to the content of the two-sided region.

Step 3143, render the partition.

Step 3150, render the toolbar and other panels.

Illustratively, a toolbar and other panel content also need to be rendered.

In some embodiments, the two non-drawings may be resized by dragging the divider and re-rendering the interface content; the rendering takes care of the spatial and separation of the canvas and other flows remain unchanged.

In some embodiments, when the double-column canvas is closed, the screen data that does not belong to the focal region will be cleaned up and then re-rendered.

In some embodiments, the left and right regions may be interchanged, with memory data being valid and not requiring destruction or reconstruction. For example: for interface space WorkspaceData, only two data exchanges in TRIGGERSIDLIST are needed, the focus is changed from 0 to 1 or from 1 to 0, and then the whole canvas is re-rendered.

In the embodiment of the application, the operation flow of copying the programming building blocks is simplified, a plurality of trigger groups can be edited by the use object at the same time through the double-row mode, the operation of frequently switching the trigger groups is avoided, the steps of copying and pasting are simplified, and the intuitiveness and convenience of operation are improved; in addition, the working area and the building block definition area can be displayed in a two-column mode, so that the number of building blocks in a single trigger group is reduced, the loading time is shortened, the frequent reloading and destroying of the trigger group are avoided, the response speed of the system is improved, the widths of the two columns can be manually adjusted by using the object, different editing requirements are met, and better interaction feedback is provided.

FIG. 32 is a block diagram of a visually programmed operating device according to an exemplary embodiment of the present application, as shown in FIG. 32, comprising the following:

a display module 3210, configured to display a first working area, where the first working area is configured to construct program content in a visual form based on programming blocks, where the programming blocks are basic units used to represent programming logic in visual programming, and the first working area includes a first programming block;

a receiving module 3220, configured to receive a split screen display operation for the first working area;

The display module 3210 is further configured to display the first working area and a building block association area in response to the split screen display operation, where the building block association area includes a second programming building block, a program construction relationship exists between the second programming building block and the first programming building block, and the program construction relationship is used to characterize that the second programming building block cooperates with the first programming building block to construct the program content.

In an alternative embodiment, the display module 3210 is further configured to display, in response to the split-screen display operation, the first working area and the second working area, where the first working area is used to construct a first program content, and the second working area is the building block association area used to construct a second program content in a visual form based on the programmed building blocks; wherein the second program content and the first program content together constitute the program content, the program content being logic code for running a program.

In an alternative embodiment, the display module 3210 is further configured to display a plurality of trigger groups in response to receiving a group view operation for a first working area, the trigger groups being contents composed of at least one trigger, the triggers being composed of at least one programmed building block, the plurality of trigger groups each corresponding to a working area, the working area being configured to construct the program contents based on the programmed building blocks in the trigger groups; and receiving the split screen display operation aiming at a first trigger group in the trigger groups, wherein the first trigger group corresponds to the second working area.

In an alternative embodiment, the receiving module 3220 is further configured to receive a selection operation for the first trigger set as the split screen display operation;

the display module 3210 is further configured to display the first working area in response to the selection operation for the trigger set identification, and to locate a first programmed building block in the second working area that displays the first trigger set.

In an optional embodiment, the receiving module 3220 is further configured to display event programming blocks corresponding to a plurality of triggers in the first trigger set, where the triggers are used to represent a programming block set obtained by combining the event programming blocks as starting programming blocks, and the event programming blocks are used to represent programming blocks of an event type; and receiving a building block triggering operation of a first event programming building block in a plurality of event programming building blocks as the split screen display operation, wherein the building block triggering operation is used for positioning to the first event programming building block when the second working area is displayed.

In an alternative embodiment, said display module 3210 is further configured to display said first working area and a building block definition area for retrieving said second programmed building block in said program build relationship with said first programmed building block in response to said split screen display operation.

In an alternative embodiment, the display module 3210 is further configured to display, in response to receiving a block selection operation for the first programmed block in the first working area, a block definition control for custom adjusting a block parameter based on maintaining a logical function of the first programmed block to obtain the second programmed block, the block parameter being used to determine a logical implementation while exerting a logical function corresponding to the programmed block; and receiving control triggering operation aiming at the building block definition control as the split screen display operation.

In an alternative embodiment, the receiving module 3220 is further configured to display a plurality of custom programming bricks for application within a work area, the work area including the first work area; receiving a selection operation aiming at a first custom programming building block in the custom programming building blocks, and displaying a plurality of editing options; and receiving an option triggering operation for a defined option in the plurality of editing options as the split screen display operation.

In an alternative embodiment, the display module 3210 is further configured to receive a region sizing operation for a boundary touch spring, the boundary touch spring being a trigger bar connecting the first working region and the building block-associated region, the region sizing operation being configured to adjust a region relative duty cycle between the first working region and the building block-associated region; and displaying a size adjustment result in response to the area size adjustment operation, wherein the size adjustment result comprises at least one of an adjusted first working area and an adjusted building block association area.

In an alternative embodiment, the display module 3210 is further configured to receive a region swap operation for the boundary trigger spring, the first working region being displayed at a first position, the building block associated region being displayed at a second position, the region swap operation being configured to swap display positions of the first working region and the building block associated region; in response to the zone swap operation, the building block associated zone at the first location and the first work zone at the second location are displayed.

In an alternative embodiment, the display module 3210 is further configured to display an area control, where the area control is configured to adjust a display state of the first working area and the building block association area; and in response to receiving a first trigger operation for the area control, reserving and displaying a focus area in the first working area and the building block association area, and canceling and displaying a non-focus area, wherein the focus area is used for representing an area for which the last operation is performed.

In an alternative embodiment, the display module 3210 is further configured to point to a first display location in response to the split-screen display operation, display the building block association area at the first display location, and display the first work area.

In an alternative embodiment, the display module 3210 is further configured to display the first working area at a second display location, where the second display location is different from the first display location, and the first working area and the building block association area are independent from each other.

In an alternative embodiment, the display module 3210 is further configured to display the building block associated area at a third location in response to the split screen display operation indication, display the building block associated area of a first size and the first working area of a second size, the second size being determined based on an interface display size and the first size; displaying the building block association area at a fourth position in response to the split screen display operation indication, displaying a third size of the building block association area and a fourth size of the first working area, the fourth size being determined based on the interface display size and the third size; wherein the third position and the fourth position are different, and the first size and the third size are different.

In an alternative embodiment, the display module 3210 is further configured to display a split-screen prompt message in response to the number of blocks of the programmed blocks used in the first working area reaching a preset threshold, where the split-screen prompt message is configured to prompt a new third working area and display the third working area through the split-screen display operation.

In an optional embodiment, the display module 3210 is further configured to display the first working area and the building block association area of the first style in response to the operation object pointed by the split-screen display operation being a first split-screen object; responding to the operation object pointed by the split screen display operation as a second split screen object, and displaying the first working area and the building block association area of a second style; the first split-screen object and the second split-screen object are different, and the first style and the second style are different.

It should be noted that: the operation device for visual programming provided in the above embodiment is only exemplified by the division of the above functional modules, and in practical application, the above functional allocation may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to perform all or part of the functions described above. In addition, the operation device for visual programming provided in the above embodiment and the operation method embodiment for visual programming belong to the same concept, and detailed implementation processes of the operation device for visual programming are detailed in the method embodiment, which is not described herein again.

Fig. 33 shows a block diagram of an electronic device 3300 provided by an exemplary embodiment of the application. The electronic device 3300 may be a portable mobile terminal, such as: smart phones, car terminals, tablet computers, MP3 players (Moving Picture Experts Group Audio Layer III, dynamic video expert compression standard audio plane 3), MP4 (Moving Picture Experts Group Audio Layer IV, dynamic video expert compression standard audio plane 4) players, notebook computers or desktop computers. Electronic device 3300 may also be referred to by other names of user devices, portable terminals, laptop terminals, desktop terminals, and the like.

Generally, the electronic device 3300 includes: a processor 3301 and a memory 3302.

Processor 3301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 3301 may be implemented in at least one hardware form of DSP (DIGITAL SIGNAL Processing), FPGA (Field-Programmable gate array), PLA (Programmable Logic Array ). The processor 3301 may also include a main processor and a coprocessor, where the main processor is a processor for processing data in an awake state, and is also called a CPU (Central Processing Unit ); a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 3301 may be integrated with a GPU (Graphics Processing Unit, image processor) that is responsible for rendering and drawing of the content that the display screen is required to display. In some embodiments, the processor 3301 may also include an AI (ARTIFICIAL INTELLIGENCE ) processor for processing computing operations related to machine learning.

Memory 3302 may include one or more computer-readable storage media, which may be non-transitory. Memory 3302 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 3302 is used to store at least one instruction for execution by processor 3301 to implement the method of operation of visual programming provided by method embodiments of the present application.

In some embodiments, the electronic device 3300 also includes one or more sensors. The one or more sensors include, but are not limited to: proximity sensor, gyro sensor, pressure sensor.

A proximity sensor, also called a distance sensor, is typically provided on the front panel of the electronic device 3300. The proximity sensor is used to capture the distance between the user and the front of the electronic device 3300.

The gyro sensor may detect a body direction and a rotation angle of the electronic device 3300, and the gyro sensor may collect 3D actions of the user on the electronic device 3300 in cooperation with the acceleration sensor. The processor 3301 may implement the following functions based on the data collected by the gyro sensor: motion sensing (e.g., changing UI according to a tilting operation by a user), image stabilization at shooting, game control, and inertial navigation.

The pressure sensor may be disposed at a side frame of the electronic device 3300 and/or at an underlying layer of the display screen. When the pressure sensor is disposed on the side frame of the electronic device 3300, a grip signal of the user on the electronic device 3300 may be detected, and the processor 3301 performs left-right hand recognition or quick operation according to the grip signal collected by the pressure sensor. When the pressure sensor is disposed at the lower layer of the display screen, the processor 3301 controls the operability control on the UI interface according to the pressure operation of the user on the display screen. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

In some embodiments, electronic device 3300 also includes other component parts, and those skilled in the art will appreciate that the structure shown in FIG. 33 is not limiting of electronic device 3300 and may include more or fewer components than shown, or may combine certain components, or may employ a different arrangement of components.

The embodiment of the application also provides a computer device which can be implemented as a terminal or a server as shown in fig. 1. The computer device includes a processor and a memory having at least one instruction, at least one program, code set, or instruction set stored therein, the at least one instruction, at least one program, code set, or instruction set being loaded and executed by the processor to implement the method of operation of visual programming provided by the method embodiments described above.

Embodiments of the present application also provide a computer readable storage medium having stored thereon at least one instruction, at least one program, a set of codes, or a set of instructions, at least one instruction, at least one program, a set of codes, or a set of instructions loaded and executed by a processor to implement the method of operation of visual programming provided by the above method embodiments.

Embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method of operation of visual programming as described in any of the above embodiments.

Alternatively, the computer-readable storage medium may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), solid state disk (SSD, solid STATE DRIVES), or optical disk, etc. The random access memory may include resistive random access memory (ReRAM, RESISTANCE RANDOM ACCESS MEMORY) and dynamic random access memory (DRAM, dynamic Random Access Memory), among others. The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, where the program may be stored in a computer readable storage medium, and the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc. The foregoing description of the preferred embodiments of the present application is not intended to limit the application, but rather, the application is to be construed as limited to the appended claims.

Claims

1. A method of operating a visual programming interface, the method comprising:

Receiving split screen display operation aiming at the first working area;

2. The method of claim 1, wherein displaying the first work area and the building block associated area in response to the split screen display operation comprises:

Responding to the split screen display operation, displaying a first working area and a second working area, wherein the first working area is used for constructing first program content, and the second working area is the building block association area for constructing second program content in a visual form based on the programming building blocks;

Wherein the second program content and the first program content together constitute the program content, the program content being logic code for running a program.

3. The method of claim 2, wherein the receiving a split screen display operation for the first work area comprises:

In response to receiving a group review operation for a first working area, displaying a plurality of trigger groups, the trigger groups being content composed of at least one trigger, the trigger being composed of at least one programming building block, the plurality of trigger groups each corresponding to a working area for building the program content based on the programming building blocks in the trigger groups;

And receiving the split screen display operation aiming at a first trigger group in the trigger groups, wherein the first trigger group corresponds to the second working area.

4. The method of claim 3, wherein the receiving the split screen display operation for a first trigger group of the plurality of trigger groups comprises:

receiving a selection operation for the first trigger group as the split screen display operation;

The response to the split screen display operation displays the first working area and the building block association area, including:

In response to the selection operation for the trigger set identification, the first working area is displayed, and a first programming building block of the first trigger set is positioned and displayed in the second working area.

5. The method of claim 3, wherein the receiving the split screen display operation for a first trigger group of the plurality of trigger groups comprises:

Displaying event programming building blocks respectively corresponding to a plurality of triggers in the first trigger group, wherein the triggers are used for representing the programming building blocks obtained by taking the event programming building blocks as initial programming building block combinations, and the event programming building blocks are used for representing the programming building blocks of event types;

and receiving a building block triggering operation of a first event programming building block in a plurality of event programming building blocks as the split screen display operation, wherein the building block triggering operation is used for positioning to the first event programming building block when the second working area is displayed.

6. The method of any one of claims 1 to 5, wherein displaying the first work area and the building block association area in response to the split screen display operation comprises:

and responding to the split screen display operation, displaying the first working area and a building block definition area, wherein the building block definition area is used for acquiring the second programming building block which has the program construction relation with the first programming building block.

7. The method of claim 6, wherein the receiving a split screen display operation for the first work area comprises:

In response to receiving a building block selection operation for the first programming building block in the first working area, displaying a building block definition control, wherein the building block definition control is used for carrying out custom adjustment on building block parameters on the basis of maintaining logic functions of the first programming building block to obtain the second programming building block, and the building block parameters are used for determining a logic implementation mode while playing the logic functions corresponding to the programming building block;

and receiving control triggering operation aiming at the building block definition control as the split screen display operation.

8. The method of claim 6, wherein the receiving a split screen display operation for the first work area comprises:

Displaying a plurality of custom programming bricks for application within a work area, the work area comprising the first work area;

Receiving a selection operation aiming at a first custom programming building block in the custom programming building blocks, and displaying a plurality of editing options;

And receiving an option triggering operation for a defined option in the plurality of editing options as the split screen display operation.

9. The method of any one of claims 1 to 5, wherein after displaying the first work area and the building block association area in response to the split screen display operation, further comprising:

receiving an area size adjustment operation for a boundary trigger spring, wherein the boundary trigger spring is a trigger bar for connecting the first working area and the building block related area, and the area size adjustment operation is used for adjusting the area relative duty ratio between the first working area and the building block related area;

And displaying a size adjustment result in response to the area size adjustment operation, wherein the size adjustment result comprises at least one of an adjusted first working area and an adjusted building block association area.

10. The method of any one of claims 1 to 5, wherein after displaying the first work area and the building block association area in response to the split screen display operation, further comprising:

Receiving an area exchanging operation for a boundary trigger spring, wherein the first working area is displayed at a first position, the building block related area is displayed at a second position, and the area exchanging operation is used for exchanging the display positions of the first working area and the building block related area;

In response to the zone swap operation, the building block associated zone at the first location and the first work zone at the second location are displayed.

11. The method of any one of claims 1 to 5, wherein after displaying the first work area and the building block association area in response to the split screen display operation, further comprising:

the area control is used for adjusting the display states of the first working area and the building block association area;

and in response to receiving a first trigger operation for the area control, reserving and displaying a focus area in the first working area and the building block association area, and canceling and displaying a non-focus area, wherein the focus area is used for representing an area for which the last operation is performed.

12. The method of any one of claims 1 to 5, wherein displaying the first work area and the building block association area in response to the split screen display operation comprises:

and responding to the split screen display operation to point to a first display position, displaying the building block association area at the first display position, and displaying the first working area.

13. The method of claim 12, wherein the displaying the first work area comprises:

and displaying the first working area at a second display position, wherein the second display position is different from the first display position, and the first working area and the building block association area are mutually independent.

14. The method according to any one of claims 1 to 5, further comprising:

Displaying the building block association area at a third position in response to the split screen display operation indication, displaying the building block association area of a first size and the first working area of a second size, the second size being determined based on an interface display size and the first size;

Displaying the building block association area at a fourth position in response to the split screen display operation indication, displaying a third size of the building block association area and a fourth size of the first working area, the fourth size being determined based on the interface display size and the third size;

Wherein the third position and the fourth position are different, and the first size and the third size are different.

15. The method according to any one of claims 1 to 5, further comprising:

And responding to the fact that the number of the blocks used in the first working area reaches a preset threshold, displaying split-screen prompt information, wherein the split-screen prompt information is used for prompting a newly-built third working area and displaying the third working area through split-screen display operation.

16. The method according to any one of claims 1 to 5, further comprising:

responding to the operation object pointed by the split screen display operation as a first split screen object, and displaying the first working area and the building block association area of a first style;

Responding to the operation object pointed by the split screen display operation as a second split screen object, and displaying the first working area and the building block association area of a second style; the first split-screen object and the second split-screen object are different, and the first style and the second style are different.

17. An operating device for visualizing a programming interface, the device comprising:

18. A computer device comprising a processor and a memory, wherein the memory has stored therein at least one program that is loaded and executed by the processor to implement a method of operation of a visual programming interface as claimed in any one of claims 1 to 16.

19. A computer readable storage medium having stored therein at least one program loaded and executed by a processor to implement a method of operating a visual programming interface as claimed in any one of claims 1 to 16.

20. A computer program product comprising computer instructions which, when executed by a processor, implement a method of operating a visual programming interface as claimed in any one of claims 1 to 16.