CN113254469A

CN113254469A - Data screening method and device, equipment and medium

Info

Publication number: CN113254469A
Application number: CN202110560633.8A
Authority: CN
Inventors: 耿少真; 张军
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2021-05-21
Filing date: 2021-05-21
Publication date: 2021-08-13
Anticipated expiration: 2041-05-21
Also published as: CN113254469B

Abstract

The disclosure provides a data screening method, a data screening device, data screening equipment and a data screening medium, and relates to the technical field of artificial intelligence, in particular to the technical field of big data. The implementation scheme is as follows: expanding the first filtering condition to determine a second filtering condition; screening data from a database based on the second filtering condition, and determining intermediate screening data; creating a sub-table corresponding to the second filtering condition based on the intermediate filtering data; and inquiring in the sub-table based on the first filtering condition to obtain final screening data.

Description

Data screening method and device, equipment and medium

Technical Field

The present disclosure relates to the field of artificial intelligence technologies, and in particular, to the field of big data technologies, and in particular, to a data screening method and apparatus, an electronic device, a computer-readable storage medium, and a computer program product.

Background

Artificial intelligence is the subject of research that makes computers simulate some human mental processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), both at the hardware level and at the software level. The artificial intelligence hardware technology generally comprises technologies such as a sensor, a special artificial intelligence chip, cloud computing, distributed storage, big data processing and the like, and the artificial intelligence software technology mainly comprises a computer vision technology, a voice recognition technology, a natural language processing technology, machine learning/deep learning, a big data processing technology, a knowledge graph technology and the like.

The filtering of data in a relevant database according to a data screening device is one of the basic technologies for applications such as business intelligence systems, data analysis platforms, data visualization systems, and the like.

The approaches described in this section are not necessarily approaches that have been previously conceived or pursued. Unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section. Similarly, unless otherwise indicated, the problems mentioned in this section should not be considered as having been acknowledged in any prior art.

Disclosure of Invention

The disclosure provides a data screening method and apparatus, an electronic device, a computer-readable storage medium, and a computer program product.

According to an aspect of the present disclosure, there is provided a data screening method, including: expanding the first filtering condition to determine a second filtering condition; screening data from a database based on the second filtering condition to obtain intermediate screening data; creating a sub-table corresponding to the second filtering condition based on the intermediate filtering data; and inquiring in the sub-table based on the first filtering condition to obtain final screening data.

According to another aspect of the present disclosure, there is provided a data screening apparatus including: an expansion unit configured to expand the first filtering condition to determine a second filtering condition; a determining unit configured to screen data from a database based on the second filtering condition, determine intermediate screening data; a creating unit configured to create a sub-table corresponding to the second filtering condition based on the intermediate filtering data; and the query unit is configured to query the sub-table based on the first filtering condition to obtain final screening data.

According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data screening method described above.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method according to the above.

According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein the computer program realizes the above data screening method when executed by a processor.

In accordance with one or more embodiments of the present disclosure, the received first filtering criteria may be expanded to determine second filtering criteria, and intermediate filtering data is filtered from the database based on the second filtering criteria to create corresponding sub-tables. The data may be filtered in the corresponding sub-table based on the first filtering condition to obtain final filtered data. Therefore, by introducing the form of sub-table query, data screening can be performed on the basis of the intermediate screening data of the primary screening, the query speed can be increased, and particularly when a large database is queried, the query speed can be remarkably increased.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the embodiments and, together with the description, serve to explain the exemplary implementations of the embodiments. The illustrated embodiments are for purposes of illustration only and do not limit the scope of the claims. Throughout the drawings, identical reference numbers designate similar, but not necessarily identical, elements.

FIG. 1 shows a schematic diagram of an exemplary system in which various methods described herein may be implemented, according to an embodiment of the present disclosure;

FIG. 2 shows a flow diagram of a data screening method according to an embodiment of the present disclosure;

FIG. 3 shows a screening type diagram of a data screening method according to an embodiment of the present disclosure;

FIG. 4 shows a user interface schematic of a data screening method according to an embodiment of the present disclosure;

FIG. 5 illustrates a code diagram written in a structured query language in a data screening method according to an embodiment of the present disclosure;

FIG. 6 shows a flow diagram of a data screening method according to an embodiment of the present disclosure;

FIG. 7 shows a block diagram of a data screening apparatus according to an embodiment of the present disclosure;

FIG. 8 illustrates a block diagram of an exemplary electronic device that can be used to implement embodiments of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In the present disclosure, unless otherwise specified, the use of the terms "first", "second", etc. to describe various elements is not intended to limit the positional relationship, timing relationship, or importance relationship of the elements, and such terms are used only to distinguish one element from another. In some examples, a first element and a second element may refer to the same instance of the element, and in some cases, based on the context, they may also refer to different instances.

The terminology used in the description of the various described examples in this disclosure is for the purpose of describing particular examples only and is not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, the elements may be one or more. Furthermore, the term "and/or" as used in this disclosure is intended to encompass any and all possible combinations of the listed items.

In the related technology, the traditional data screening is single and simple, and only comprises a data screening condition of one layer by adopting a linear mode. For one layer of screening conditions, the connection relation between each condition and other conditions can be clearly understood, but when complex data screening is needed, because the connection relation between the conditions is complex, errors are likely to occur when a Structured Query Language database (hereinafter abbreviated as "SQL") is written, and the relations among a plurality of layers are not easily understood, so that the SQL is difficult to write, read and maintain, professional SQL ability and clear thinking need to be mastered, and for some persons with weak SQL ability or without SQL ability, entry can be formed, and when the quantity of data is large, the SQL conditions for direct Query can form performance problems, so that the Query speed is slow, and the like.

To address the above, the present disclosure extends the received first filter criteria to determine second filter criteria, and screens intermediate screening data from the database based on the second filter criteria to create corresponding sub-tables. The data can be filtered in the corresponding sub-table based on the first filtering condition to obtain the final filtered data. Therefore, by introducing the form of sub-table query, data screening can be performed on the basis of the intermediate screening data of the primary screening, the query speed can be increased, and particularly when a large database is queried, the query speed can be remarkably increased.

Fig. 1 illustrates a schematic diagram of an example system 100 in which various methods and apparatus described herein may be implemented in accordance with embodiments of the present disclosure. Referring to fig. 1, the system 100 includes one or

more client devices

101, 102, 103, 104, 105, and 106, a server 120, and one or more communication networks 110 coupling the one or more client devices to the server 120.

Client devices

101, 102, 103, 104, 105, and 106 may be configured to execute one or more applications.

In embodiments of the present disclosure, the server 120 may run one or more services or software applications that enable the method of data screening to be performed.

In some embodiments, the server 120 may also provide other services or software applications that may include non-virtual environments and virtual environments. In some embodiments, these services may be provided as web-based services or cloud services, such as provided to users of

client devices

101, 102, 103, 104, 105, and/or 106 under a software as a service (SaaS) model.

In the configuration shown in fig. 1, server 120 may include one or more components that implement the functions performed by server 120. These components may include software components, hardware components, or a combination thereof, which may be executed by one or more processors. A user operating a

client device

101, 102, 103, 104, 105, and/or 106 may, in turn, utilize one or more client applications to interact with the server 120 to take advantage of the services provided by these components. It should be understood that a variety of different system configurations are possible, which may differ from system 100. Accordingly, fig. 1 is one example of a system for implementing the various methods described herein and is not intended to be limiting.

The user may use

client devices

101, 102, 103, 104, 105, and/or 106 to send the first filter criteria. The client device may provide an interface that enables a user of the client device to interact with the client device. The client device may also output information to the user via the interface. Although fig. 1 depicts only six client devices, those skilled in the art will appreciate that any number of client devices may be supported by the present disclosure.

Client devices

101, 102, 103, 104, 105, and/or 106 may include various types of computer devices, such as portable handheld devices, general purpose computers (such as personal computers and laptop computers), workstation computers, wearable devices, gaming systems, thin clients, various messaging devices, sensors or other sensing devices, and so forth. These computer devices may run various types and versions of software applications and operating systems, such as Microsoft Windows, Apple iOS, UNIX-like operating systems, Linux, or Linux-like operating systems (e.g., Google Chrome OS); or include various Mobile operating systems, such as Microsoft Windows Mobile OS, iOS, Windows Phone, Android. Portable handheld devices may include cellular phones, smart phones, tablets, Personal Digital Assistants (PDAs), and the like. Wearable devices may include head mounted displays and other devices. The gaming system may include a variety of handheld gaming devices, internet-enabled gaming devices, and the like. The client device is capable of executing a variety of different applications, such as various Internet-related applications, communication applications (e.g., email applications), Short Message Service (SMS) applications, and may use a variety of communication protocols.

Network 110 may be any type of network known to those skilled in the art that may support data communications using any of a variety of available protocols, including but not limited to TCP/IP, SNA, IPX, etc. By way of example only, one or more networks 110 may be a Local Area Network (LAN), an ethernet-based network, a token ring, a Wide Area Network (WAN), the internet, a virtual network, a Virtual Private Network (VPN), an intranet, an extranet, a Public Switched Telephone Network (PSTN), an infrared network, a wireless network (e.g., bluetooth, WIFI), and/or any combination of these and/or other networks.

The server 120 may include one or more general purpose computers, special purpose server computers (e.g., PC (personal computer) servers, UNIX servers, mid-end servers), blade servers, mainframe computers, server clusters, or any other suitable arrangement and/or combination. The server 120 may include one or more virtual machines running a virtual operating system, or other computing architecture involving virtualization (e.g., one or more flexible pools of logical storage that may be virtualized to maintain virtual storage for the server). In various embodiments, the server 120 may run one or more services or software applications that provide the functionality described below.

The computing units in server 120 may run one or more operating systems including any of the operating systems described above, as well as any commercially available server operating systems. The server 120 may also run any of a variety of additional server applications and/or middle tier applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, and the like.

In some implementations, the server 120 can include one or more applications to analyze and consolidate data feeds and/or event updates received from users of the

client devices

101, 102, 103, 104, 105, and 106. Server 120 may also include one or more applications to display data feeds and/or real-time events via one or more display devices of

client devices

101, 102, 103, 104, 105, and 106.

In some embodiments, the server 120 may be a server of a distributed system, or a server incorporating a blockchain. The server 120 may also be a cloud server, or a smart cloud computing server or a smart cloud host with artificial intelligence technology. The cloud Server is a host product in a cloud computing service system, and is used for solving the defects of high management difficulty and weak service expansibility in the traditional physical host and Virtual Private Server (VPS) service.

The system 100 may also include one or more databases 130. In some embodiments, these databases may be used to store data and other information. For example, one or more of the databases 130 may be used to store information such as audio files and video files. The data store 130 may reside in various locations. For example, the data store used by the server 120 may be local to the server 120, or may be remote from the server 120 and may communicate with the server 120 via a network-based or dedicated connection. The data store 130 may be of different types. In certain embodiments, the data store used by the server 120 may be a database, such as a relational database. One or more of these databases may store, update, and retrieve data to and from the database in response to the command.

In some embodiments, one or more of the databases 130 may also be used by applications to store application data. The databases used by the application may be different types of databases, such as key-value stores, object stores, or conventional stores supported by a file system.

The system 100 of fig. 1 may be configured and operated in various ways to enable application of the various methods and apparatus described in accordance with the present disclosure.

Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

According to an aspect of the present disclosure, a data screening method is provided. As shown in fig. 2, the data screening method may include: step S201, expanding the first filtering condition to determine a second filtering condition; s202, screening data from a database based on the second filtering condition, and determining intermediate screening data; step S203, based on the intermediate screening data, creating a sub-table corresponding to the second filtering condition; and step S204, inquiring in the sub-table based on the first filtering condition to obtain final screening data. Therefore, by introducing the form of sub-table query, data screening can be performed on the basis of the intermediate screening data of primary screening, the query speed can be increased, and particularly when a large database is queried, the query speed can be remarkably increased.

The first filter condition may include a plurality of first sub-filter conditions, and the plurality of first sub-filter conditions may be combined in a preset combination logical relationship. Likewise, the second filtering condition may also include a plurality of second sub-filtering conditions, and the plurality of second sub-filtering conditions may be combined in a preset combination logical relationship.

It should be noted that the "preset combinational logic relationship" in the embodiment of the present disclosure is not limited to a specific combinational logic relationship, and different preset combinational logic relationships may be set according to different requirements.

In some embodiments, for a certain filter condition, the combinational logic relationship of the sub-filter conditions included in the certain filter condition may include both AND OR connection forms. As shown in fig. 3, a single sub-filter condition may include, for example, "measure/dimension" (i.e., filter rule) and "filter content. The dimension mainly comprises filtering of character types, time types and the like. Metrics are primarily numerical types, including numerical magnitude. Through two connection forms of AND AND OR, the multiple sub-filtering conditions can be combined AND connected to form a filtering condition combination, so that the multiple sub-filtering conditions can be combined according to the individual requirements of users to screen data. According to some embodiments, the sub-filter conditions may include fields, filter rules, and filter content. In the example illustrated in fig. 4, said fields correspond for example to "product name", the filtering rules correspond for example to "start yes", and the filtering contents correspond for example to "Acc".

According to some embodiments, the data screening method may further include: and graphically displaying the plurality of sub-filtering conditions and the combined relation among the plurality of sub-filtering conditions in a tree structure. Therefore, the relation between the data screening conditions can be clearly combed through the graphical display of the tree structure, a user can conveniently and clearly select the screening conditions, various combination modes can be formed by supporting the combination, condition and sub-table modes, and the logic combination visualization mode is simplified through the graphical display of the complex SQL sentences.

According to some embodiments, the first filtering condition in step S201 may include at least one primary filtering condition combination, and the sub-filtering conditions in each primary filtering condition combination are combined in a preset combination logic relationship. In some embodiments, through two connection forms of AND OR, multiple sub-filtering conditions can be combined AND connected to form a primary filtering condition combination, so that multiple filtering conditions can be combined according to individual requirements of users to filter data. The combination connection mode of the sub-filtering conditions is not limited, AND nested combination of the sub-filtering conditions through 'AND' AND/OR 'OR' is supported.

For example, as shown in fig. 4, two sub-filter conditions with fields "producer" and "delegator" are connected by a user-selected combinational logic relationship "OR" to form a primary filter condition combination.

According to some embodiments, at least one of the primary filtering conditions in step S201 may include a secondary filtering condition combination, and the sub-filtering conditions in the secondary filtering condition combination are combined in a preset combination logic relationship. Thus, the received first filter condition comprises a nested combination form of the combinations. The present disclosure is not limited to the connection mode between the target filtering conditions in the nested combination form in the combination.

In some embodiments, support for nested combination of one OR more sub-filter conditions by "AND" AND/OR "OR". Still taking the example illustrated in fig. 4 as an example, the sub-filter condition with the field "producing area" can be connected with the newly added other sub-filter conditions through the user-selected combination logical relationship "AND" to form a two-level filter condition combination.

In some embodiments, the first filtering condition may be expanded according to a preset rule to determine the second filtering condition. For example, according to one of the first filtering conditions in fig. 4: the "product name is initially Acc", and it may be determined that the second filtering condition is "product name contains Acc" to perform primary screening to create a sub-table, and perform secondary screening based on the first filtering condition combination in the sub-table, thereby improving the screening efficiency. It is to be understood that the second filtering condition is only illustrated and not limited to determining the second filtering condition in this way. For example, in a case where the first filtering condition includes a plurality of sub-filtering conditions combined in a preset combinational logic relationship, it is also possible to determine only a combination of a part of the sub-filtering conditions among the plurality of sub-filtering conditions as the second filtering condition, that is, the second filtering condition includes a part of the sub-filtering conditions among the first filtering condition and a combination relationship thereof.

After determining the second filtering condition, step S202 may be executed to screen data from the database based on the second filtering condition, and determine intermediate screening data to create a corresponding sub-table.

According to some embodiments, step S202 may comprise: screening data from a database based on the second filtering condition, and determining primary screening data; and determining the intermediate screening data from the primary screening data according to a preset expansion rule, so that the data volume of the created sub-table can be further reduced, and the query speed is improved.

In the example illustrated in fig. 5, in the SQL written code, for example, the second filtering condition is "classid ═ 1", where the field corresponds to "classid", the filtering rule corresponds to "=", and the filtering content corresponds to "1". The expansion rule may be "select top 90000 userid". The second filter condition used to create the sub-table may include one or more sub-filter conditions, and the intermediate filter data may be determined from the result of the query based on the second filter condition by an extended rule such as "select top 90000 userid". In other words, an expansion rule may be added in the data filtering process for creating the sub-table, and intermediate filtering data may be determined from the query result based on the second filtering condition, so that the subsequent query range may be further narrowed based on the intermediate filtering data.

As shown in FIG. 3, the sub-tables that are the result of the intermediate query may include data tables, fields, and filter content to facilitate a second quick query in the sub-tables. The data table may be a collection of intermediate screening data. The fields and filter contents may correspond to the fields and filter contents of the second filter condition that created the sub-table.

In some embodiments, the first filter term comprises a plurality of sub-filter terms combined in a predetermined combinational logical relationship, and in the face of complex combinational logical relationships, sub-tables may be nested in the combination. Therefore, preliminary screening can be performed based on part of the sub-filtering conditions in the first filtering conditions to create the sub-table, so that some data can be excluded according to the required data, and the efficiency of data screening can be improved.

For example, referring to fig. 4, two sub-filtering conditions with fields of "producer" and "consignor" are connected through "OR" to form a filtering condition combination, for which the second filtering condition of "producer equals to C1" may be determined to perform primary screening to create a sub-table, and perform secondary screening based on the first filtering condition in the sub-table, thereby improving the screening efficiency. Two sub-filtering conditions with fields of 'product name' AND 'manufacturer' are connected through 'AND' to form a filtering condition combination, aiming at the filtering condition combination, the second filtering condition can be determined to be 'product name containing Acc', so that a sub-table is created through primary screening, secondary screening is conducted on the sub-table based on the first filtering condition, AND screening efficiency is improved. That is, the second filtering condition may be at least a part of the sub-filtering conditions in the first filtering condition or may be obtained by expanding at least a part of the sub-filtering conditions in the first filtering condition.

In other embodiments, the sub-table may be nested in a single sub-filtering condition, so that the screening may be performed in the sub-table based on the first filtering condition, thereby improving the screening efficiency.

For example, the second filtering condition may be determined by expanding one sub-filtering condition of the first filtering condition according to a preset rule. For example, according to one of the sub-filtering conditions in fig. 4: the product name is Acc at the beginning, the second filtering condition can be determined as product name containing Acc, so that a sub-table is created through primary screening, secondary screening is conducted on the basis of the first filtering condition in the sub-table, and the screening efficiency is improved.

According to some embodiments, as shown in fig. 6, the data screening method may further include: step S601, receiving an operation instruction; step S602, based on the operation instruction, executing a corresponding operation on the first filtering condition. The receiving of the operation instruction is to receive a first filtering condition.

According to some embodiments, the operation instruction in step S601 may include an addition instruction and an adjustment instruction, and a new sub-filter condition or a new filter condition combination may be added based on the addition instruction, and in a case where the first filter condition includes a plurality of sub-filter conditions, a positional relationship between the plurality of sub-filter conditions may be adjusted based on the adjustment instruction. The adjustment instruction may include two sub-filter conditions to be adjusted. Therefore, the positions of the sub-filtering conditions can be adjusted, and the user can clearly know the relationship among the data screening.

In some embodiments, further filtering may be performed by adding a new sub-filter condition or a new combination of filter conditions by clicking on an "add new" button, as shown in FIG. 4.

As an exemplary embodiment, the received first filtering condition may include a plurality of sub-filtering conditions combined in a preset combination logical relationship, in which case, the plurality of sub-filtering conditions and the combination relationship between the plurality of sub-filtering conditions are graphically displayed in a tree structure, and the filtering order may be adjusted by dragging, for example. Each combination, condition and sub-table can be used as one layer of the screening tree, each layer can be dragged to adjust the screening sequence, the hierarchical relation and the dependency relation among different screening conditions can be clearly seen, and the complex SQL statements can be imaged. It is to be understood that this is by way of example only and that the present disclosure is not limited to the manner in which the data is screened.

For example, as shown in fig. 4, according to the requirement of the user for data filtering, the position between two sub-filter conditions with fields of "producer" and "consignor" in the same layer may be adjusted by a dragging manner, OR the position between a sub-filter condition with a field of "product name" in a different layer and a combination of two sub-filter conditions with fields of "producer" and "consignor" connected by "OR" may be adjusted by a dragging manner.

According to another aspect of the present disclosure, a data screening apparatus is also provided. As shown in fig. 7, the data filtering apparatus 700 may include: an expansion unit 701 configured to expand the first filtering condition to determine a second filtering condition; a determining unit 702 configured to filter data from a database based on the second filtering condition, determine intermediate filtered data; a creating unit 703 configured to create a sub-table corresponding to the second filtering condition based on the intermediate filtering data; and a query unit 704 configured to perform a query in the sub-table based on the first filtering condition to obtain final filtering data.

In some embodiments, the first filtering condition may include a plurality of sub-filtering conditions, the plurality of sub-filtering conditions includes at least one primary filtering condition combination, and the sub-filtering conditions in each primary filtering condition combination are combined in a preset combination logical relationship.

In some embodiments, at least one of the primary filter condition combinations comprises a secondary filter condition combination, and the sub-filter conditions in the secondary filter condition combination are combined in a preset combination logical relationship.

In some embodiments, the determining unit 702 may include: a first determining subunit, configured to screen data from a database based on the second filtering condition, and determine primary screening data; and the second determining subunit is configured to determine the intermediate screening data from the primary screening data according to a preset expansion rule.

In some embodiments, the data screening apparatus 700 may further include: a receiving unit configured to receive an operation instruction; and the execution unit is configured to execute corresponding operation on the first filtering condition based on the operation instruction.

In some embodiments, the operation instruction comprises a new addition instruction and/or an adjustment instruction, and the execution unit comprises: an adding subunit configured to add a new sub-filter condition or a new combination of filter conditions based on the new adding instruction; and an adjusting subunit configured to, in a case where the first filter condition includes a plurality of sub-filter conditions, adjust a positional relationship between the plurality of sub-filter conditions based on the adjustment instruction.

In some embodiments, in the case that the first filtering condition includes a plurality of sub-filtering conditions, the data filtering apparatus 700 may further include: a display unit configured to graphically display the plurality of sub-filter conditions and a combined relationship between the plurality of sub-filter conditions in a tree structure.

There is also provided, in accordance with an embodiment of the present disclosure, an electronic device, a readable storage medium, and a computer program product.

Referring to fig. 8, a block diagram of a structure of an electronic device 800, which may be a server or a client of the present disclosure, which is an example of a hardware device that may be applied to aspects of the present disclosure, will now be described. Electronic device is intended to represent various forms of digital electronic computer devices, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 8, the apparatus 800 includes a computing unit 801 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 802 or a computer program loaded from a storage unit 808 into a Random Access Memory (RAM) 803. In the RAM803, various programs and data required for the operation of the device 800 can also be stored. The calculation unit 801, the ROM 802, and the RAM803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.

A number of components in the device 800 are connected to the I/O interface 805, including: an input unit 806, an output unit 807, a storage unit 808, and a communication unit 809. The input unit 806 may be any type of device capable of inputting information to the device 800, and the input unit 806 may receive input numeric or character information and generate key signal inputs related to user settings and/or function controls of the electronic device, and may include, but is not limited to, a mouse, a keyboard, a touch screen, a track pad, a track ball, a joystick, a microphone, and/or a remote control. Output unit 807 can be any type of device capable of presenting information and can include, but is not limited to, a display, speakers, a video/audio output terminal, a vibrator, and/or a printer. The storage unit 808 may include, but is not limited to, a magnetic disk, an optical disk. The communication unit 809 allows the device 800 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunications networks, and may include, but is not limited to, modems, network cards, infrared communication devices, wireless communication transceivers and/or chipsets, such as bluetooth (TM) devices, 1302.11 devices, WiFi devices, WiMax devices, cellular communication devices, and/or the like.

Computing unit 801 may be a variety of general and/or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and the like. The calculation unit 801 executes the respective methods and processes described above, such as the data filtering method. For example, in some embodiments, the data screening method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 808. In some embodiments, some or all of the computer program may be loaded and/or installed onto device 800 via ROM 802 and/or communications unit 809. When the computer program is loaded into RAM803 and executed by computing unit 901, one or more steps of the data filtering method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the data screening method by any other suitable means (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.

Although embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it is to be understood that the above-described methods, systems and apparatus are merely exemplary embodiments or examples and that the scope of the present invention is not limited by these embodiments or examples, but only by the claims as issued and their equivalents. Various elements in the embodiments or examples may be omitted or may be replaced with equivalents thereof. Further, the steps may be performed in an order different from that described in the present disclosure. Further, various elements in the embodiments or examples may be combined in various ways. It is important that as technology evolves, many of the elements described herein may be replaced with equivalent elements that appear after the present disclosure.

Claims

1. A method of data screening, comprising:

expanding the first filtering condition to determine a second filtering condition;

screening data from a database based on the second filtering condition, and determining intermediate screening data;

creating a sub-table corresponding to the second filtering condition based on the intermediate filtering data; and

and inquiring in the sub-table based on the first filtering condition to obtain final screening data.

2. The method of claim 1, wherein screening data from a database based on the second filtering condition, determining intermediate screening data comprises:

screening data from a database based on the second filtering condition, and determining primary screening data; and

and determining the intermediate screening data from the primary screening data according to a preset expansion rule.

3. The method of claim 1, wherein the first filter condition comprises a plurality of sub-filter conditions,

the first filtering condition comprises at least one primary filtering condition combination, and the sub-filtering conditions in each primary filtering condition combination are combined in a preset combination logic relationship.

4. The method of claim 3, wherein at least one of the primary filter condition combinations comprises a secondary filter condition combination, and the sub-filter conditions in the secondary filter condition combination are combined in a preset combination logical relationship.

5. The method of any of claims 1-4, further comprising:

receiving an operation instruction; and

and executing corresponding operation on the first filtering condition based on the operation instruction.

6. The method according to claim 5, wherein the operation instruction includes an addition instruction and an adjustment instruction, and a new sub-filter condition or a new filter condition combination can be added based on the addition instruction, and in a case where the first filter condition includes a plurality of sub-filter conditions, a positional relationship between the plurality of sub-filter conditions can be adjusted based on the adjustment instruction.

7. The method according to any one of claims 1-6, in case the first filtering condition comprises a plurality of sub-filtering conditions, the method further comprising:

and graphically displaying the plurality of sub-filtering conditions and the combined relation among the plurality of sub-filtering conditions in a tree structure.

8. A data screening apparatus comprising:

an expansion unit configured to expand the first filtering condition to determine a second filtering condition;

a determining unit configured to screen data from a database based on the second filtering condition, determine intermediate screening data;

a creating unit configured to create a sub-table corresponding to the second filtering condition based on the intermediate filtering data; and

and the query unit is configured to query the sub-table based on the first filtering condition to obtain final screening data.

9. The apparatus of claim 8, wherein the determining unit comprises:

a first determining subunit, configured to screen data from a database based on the second filtering condition, and determine primary screening data; and

and the second determining subunit is configured to determine the intermediate screening data from the primary screening data according to a preset expansion rule.

10. The apparatus of claim 8, wherein the first filtering condition comprises a plurality of sub-filtering conditions,

the sub-filtering conditions comprise at least one primary filtering condition combination, and the sub-filtering conditions in each primary filtering condition combination are combined in a preset combination logic relationship.

11. The apparatus of claim 10, wherein at least one of the primary filter condition combinations comprises a secondary filter condition combination, and the sub-filter conditions in the secondary filter condition combination are combined in a preset combination logic relationship.

12. The apparatus of any of claims 9-11, further comprising:

a receiving unit configured to receive an operation instruction; and

and the execution unit is configured to execute corresponding operation on the first filtering condition based on the operation instruction.

13. The apparatus of claim 12, wherein the operation instruction comprises a new addition instruction and/or an adjustment instruction, and the execution unit comprises:

an addition subunit configured to add a new sub-filter condition or a new filter condition combination based on the addition instruction; and

an adjusting subunit configured to, in a case where the first filter condition includes a plurality of sub-filter conditions, adjust a positional relationship between the plurality of sub-filter conditions based on the adjustment instruction.

14. The apparatus according to any one of claims 9-13, in case the first filtering condition comprises a plurality of sub-filtering conditions, the apparatus further comprising:

a display unit configured to graphically display the plurality of sub-filter conditions and a combined relationship between the plurality of sub-filter conditions in a tree structure.

15. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.

16. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-7.

17. A computer program product comprising a computer program, wherein the computer program realizes the method of any one of claims 1-7 when executed by a processor.