Nothing Special   »   [go: up one dir, main page]

CN111428117A - Data acquisition method and device for application program - Google Patents

Data acquisition method and device for application program Download PDF

Info

Publication number
CN111428117A
CN111428117A CN201910020223.7A CN201910020223A CN111428117A CN 111428117 A CN111428117 A CN 111428117A CN 201910020223 A CN201910020223 A CN 201910020223A CN 111428117 A CN111428117 A CN 111428117A
Authority
CN
China
Prior art keywords
data
application program
application
statistical
management platform
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910020223.7A
Other languages
Chinese (zh)
Other versions
CN111428117B (en
Inventor
马立
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201910020223.7A priority Critical patent/CN111428117B/en
Publication of CN111428117A publication Critical patent/CN111428117A/en
Application granted granted Critical
Publication of CN111428117B publication Critical patent/CN111428117B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Stored Programmes (AREA)

Abstract

The application provides a data acquisition method and device for an application program, wherein the method comprises the following steps: the data query condition is obtained, the terminal equipment with the equipment attribute matched with the data query condition is determined according to the data query condition, and the application program management platform is accessed through the terminal equipment, so that the application program data which are counted by the application program management platform and accord with the data query condition are obtained. According to the method, the application management platform is accessed in the terminal equipment matched with the data query condition to obtain the application program data meeting the data query condition, and the technical problems of low working efficiency, high error rate, long data update period and the like caused by manually obtaining the application program data counted by the application management platform in the prior art are solved, so that a large amount of labor cost is reduced, and the working efficiency is greatly improved.

Description

Data acquisition method and device for application program
Technical Field
The present application relates to the field of internet technologies, and in particular, to a method and an apparatus for acquiring data of an application program.
Background
With the development of intelligent terminal technology, the use of mobile terminal devices (such as smart phones, tablet computers, and the like) is becoming more and more popular. More and more users download Application programs (APPs) through an Application management platform of the mobile terminal device to perform entertainment activities, learning, life and the like. Therefore, when the application is popularized and released in the market, the company operator needs to know various data of each application in the application management platform, such as a ranking list, a download list, a search ranking, and the like.
At present, in an application management platform, when an operator checks application data, the operator needs to install each application management platform first, open each application management platform in sequence, check each list, search ranking and the like, and the whole process is complicated in operation steps and consumes a large amount of time and energy.
Disclosure of Invention
The application provides a data acquisition method and device for application programs, which are used for solving the technical problems of low working efficiency, high error rate, long data update period and the like caused by manually acquiring data of each application program counted by an application management platform in the prior art, and realizing automatic acquisition of application program data, thereby reducing labor cost and improving working efficiency.
An embodiment of a first aspect of the present application provides a data obtaining method for an application program, including:
acquiring a data query condition;
determining terminal equipment with equipment attributes matched with the data query conditions according to the data query conditions; the equipment attribute comprises at least one of the area where the equipment is located, the type of an equipment operating system and the version of the equipment operating system;
and accessing an application program management platform through the terminal equipment to obtain the application program data which is counted by the application program management platform and accords with the data query condition.
As a first possible implementation manner of the present application, accessing, by the terminal device, an application management platform to obtain application data that meets the data query condition and is counted by the application management platform includes:
accessing the application program management platform through the terminal equipment to obtain a management page;
according to the data query condition, performing simulated click on the management page so that the application program management platform provides a statistical page matched with the data query condition; the statistical page is obtained by the application program management platform performing behavior statistics on each user terminal having the same device attribute as the currently accessed terminal device;
and crawling statistical data on the statistical page to obtain the application program data.
As a second possible implementation manner of the present application, crawling the statistical data of the statistical page to obtain the application data further includes:
filtering the application program data according to a preset screening condition; and the screening condition is used for screening the picture information in the application program data.
As a third possible implementation manner of the present application, after the accessing, by the terminal device, an application management platform to obtain application data that meets the data query condition and is counted by the application management platform, the method further includes:
storing the application data in a database.
As a fourth possible implementation manner of the present application, the storing the application data in a database includes:
inquiring the priority of each group of statistical data according to the statistical dimension of each group of statistical data in the application program data;
and storing each group of statistical data into a database according to the priority order.
As a fifth possible implementation manner of the present application, the storing each group of statistical data into the database according to the priority order includes:
storing the statistical data with low priority into a temporary repository;
storing the statistical data with high priority into a database;
and synchronizing the statistical data stored in the temporary resource library to the database at the interval of data processing on the database.
As a sixth possible implementation manner of the present application, after the storing the application data in the database, the method further includes:
and performing predictive analysis on the application program data stored in the database according to a time series analysis method.
As a seventh possible implementation manner of the present application, the application data includes ranking and/or comment information of each application on the application management platform.
According to the data acquisition method of the application program, the terminal equipment with the equipment attribute matched with the data query condition is determined according to the data query condition by acquiring the data query condition; the equipment attribute comprises at least one of the area where the equipment is located, the type of an equipment operating system and the version of the equipment operating system; and accessing the application program management platform through the terminal equipment to obtain the application program data which are counted by the application program management platform and meet the data query condition. According to the method, the application management platform is accessed in the terminal equipment matched with the data query condition to obtain the application program data meeting the data query condition, and the technical problems of low working efficiency, high error rate, long data update period and the like caused by manually obtaining the application program data counted by the application management platform in the prior art are solved, so that a large amount of labor cost is reduced, and the working efficiency is greatly improved.
An embodiment of a second aspect of the present application provides a data acquisition apparatus for an application program, including:
the acquisition module is used for acquiring data query conditions;
the determining module is used for determining the terminal equipment with the equipment attribute matched with the data query condition according to the data query condition; the equipment attribute comprises at least one of the area where the equipment is located, the type of an equipment operating system and the version of the equipment operating system;
and the processing module is used for accessing the application program management platform through the terminal equipment so as to obtain the application program data which is counted by the application program management platform and accords with the data query condition.
The data acquisition device of the application program of the embodiment of the application program acquires the data query condition and determines the terminal equipment with the equipment attribute matched with the data query condition according to the data query condition; the equipment attribute comprises at least one of the area where the equipment is located, the type of an equipment operating system and the version of the equipment operating system; and accessing the application program management platform through the terminal equipment to obtain the application program data which are counted by the application program management platform and meet the data query condition. According to the method, the application management platform is accessed in the terminal equipment matched with the data query condition to obtain the application program data meeting the data query condition, and the technical problems of low working efficiency, high error rate, long data update period and the like caused by manually obtaining the application program data counted by the application management platform in the prior art are solved, so that a large amount of labor cost is reduced, and the working efficiency is greatly improved.
An embodiment of a third aspect of the present application provides a computer device, including: the data acquisition method comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the processor executes the program, the data acquisition method as the data acquisition method provided by the embodiment of the application is realized.
A fourth aspect of the present application provides a non-transitory computer-readable storage medium, on which a computer program is stored, wherein the computer program is configured to, when executed by a processor, implement a data acquisition method as set forth in the above-mentioned embodiments of the present application.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic flowchart of a data acquisition method for an application according to an embodiment of the present disclosure;
fig. 2 is a schematic flowchart of another data acquisition method for an application according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a data acquisition apparatus for an application according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a data acquisition device of another application provided in an embodiment of the present application;
FIG. 5 illustrates a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
In the prior art, a company operator obtains various information of each application management platform, for example, information such as a ranking list, a recommendation list, a search ranking and the like of an application program, and still at a stage of manual obtaining, by preparing a plurality of machines or installing a plurality of application management platforms, each application management platform is opened in sequence, each list and the search ranking are checked, then the lists and the search ranking are manually entered into a database, and the lists and the search ranking are sent to a popularization worker in a mail form after being sorted, so that the whole process is long in time consumption, low in efficiency and high in error rate.
In order to solve the technical problems in the prior art, an embodiment of the present application provides a data acquisition method and apparatus for an application program, where a terminal device whose device attribute matches a data query condition is determined according to the data query condition by acquiring the data query condition; the equipment attribute comprises at least one of the area where the equipment is located, the type of an equipment operating system and the version of the equipment operating system; and accessing the application program management platform through the terminal equipment to obtain the application program data which are counted by the application program management platform and meet the data query condition.
A data acquisition method and apparatus of an application program according to an embodiment of the present application are described below with reference to the drawings.
Fig. 1 is a schematic flowchart of a data acquisition method of an application according to an embodiment of the present application.
As shown in fig. 1, the data acquisition method of the application program may include the steps of:
step 101, obtaining data query conditions.
The data query condition is set according to the requirement of an operator, for example, the data query condition may be set to a download rank, a search rank, and the like of each application in the application management platform, and a statistical range of the corresponding rank.
In the embodiment of the application, after detecting the data query condition input by the user, the computer device triggers the operation of acquiring the data query condition, so that the data query condition is acquired.
Step 102, determining terminal equipment with equipment attributes matched with the data query conditions according to the data query conditions; the device attribute comprises at least one of a region where the device is located, a device operating system type and a device operating system version.
The terminal device may be a Personal Computer (PC), a cloud device, a mobile device, and the like, and the mobile device may be a hardware device having various operating systems, touch screens, and/or display screens, such as a mobile phone, a tablet Computer, a Personal digital assistant, a wearable device, and an in-vehicle device.
In the embodiment of the application, because users in different regions use different applications with different heat, data of the applications required by operators are different, but the application management platform often returns corresponding statistical data according to the region where the terminal device accessing the platform is located or the system condition, for example, when the terminal device in shanghai accesses, the statistical data in the shanghai range is returned to the terminal device in the shanghai range. In order to meet the comprehensiveness of statistical data, the operator sets different data query conditions in different queries. Accordingly, the number of terminal devices for accessing the application management platform is multiple, specifically, multiple terminal devices are arranged in different regions, and the types and versions of the operating systems configured for the terminal devices are not completely the same, so that the terminal devices matching the data query conditions are determined according to the data query conditions.
For example, 20 pieces of terminal equipment are configured in each of beijing and nanjing, and the terminal equipment with the equipment attribute matched with the data query condition is determined from the 40 pieces of terminal equipment according to the acquired data query condition. For example, the data query condition is a search ranking of each application program in the application management platform in the terminal device for querying brand a of Nanjing. According to the query condition, a terminal device whose device attribute matches the data query condition can be determined from 20 terminal devices in Nanjing.
And 103, accessing the application management platform through the terminal equipment to obtain the application data which is counted by the application management platform and meets the data query condition.
The application management platform refers to a platform for managing each application.
In the embodiment of the application, after the terminal device matched with the data query condition is determined, the application management platform is accessed through the terminal device, so that the management page of the application management platform is obtained, and further, the application program data which are counted by the application management platform and accord with the data query condition are obtained through simulating clicking operation.
The application data includes ranking and/or comment information of each application on the application management platform, and may further include forwarding amount, collection amount, and the like of each application. The content specifically included in the application data may be determined according to the query condition set in the data query condition, and is not limited herein.
As a possible implementation manner, the daily operation of an operator can be simulated through an automatic simulation system pre-deployed in the terminal device, and application program data which is counted by an application management platform in the terminal device and meets the data query condition is periodically acquired without a real-person click operation. Therefore, the labor cost and the time period for updating the data are reduced, and the accuracy of the data is improved.
According to the data acquisition method of the application program, the terminal equipment with the equipment attribute matched with the data query condition is determined according to the data query condition by acquiring the data query condition; the equipment attribute comprises at least one of the area where the equipment is located, the type of an equipment operating system and the version of the equipment operating system; and accessing the application program management platform through the terminal equipment to obtain the application program data which are counted by the application program management platform and meet the data query condition. According to the method, the application management platform is accessed in the terminal equipment matched with the data query condition to obtain the application program data meeting the data query condition, and the technical problems of low working efficiency, high error rate, long data update period and the like caused by manually obtaining the application program data counted by the application management platform in the prior art are solved, so that a large amount of labor cost is reduced, and the working efficiency is greatly improved.
For clarity of the above embodiment, the present embodiment provides another data acquisition method for an application, and fig. 2 provides another data acquisition method for an application for the present embodiment.
As shown in fig. 2, the data acquisition method of the application program may include the steps of:
step 201, obtaining data query conditions.
Step 202, according to the data query condition, determining the terminal device whose device attribute matches with the data query condition.
In the embodiment of the present application, the implementation processes of step 201 and step 202 may refer to the implementation processes described in step 101 and step 102 in the foregoing embodiment, and are not described herein again.
Step 203, accessing the application management platform through the terminal device to obtain a management page.
The management page of the application program management platform is used for displaying information of ranking, popular ranking, searching ranking and the like of each application program in the management platform.
In the embodiment of the application, after the terminal equipment with the equipment attribute matched with the data query condition is determined according to the data query condition, the application management platform is accessed through the terminal equipment, so that the management page of the application program is obtained.
As an example, if the data query condition is to obtain the download amount of the application C in the application management platform B in the area a, after determining the terminal device whose device attribute matches the data query condition, accessing the application management platform through the terminal device to obtain a management page for managing the application.
And step 204, performing simulated clicking on the management page according to the data query condition so that the application program management platform provides a statistical page matched with the data query condition.
In the embodiment of the application, the terminal device matched with the data query condition accesses the application management platform to obtain the management page, the simulation user click operation is continuously performed on the management page according to the data query condition, and the statistical page matched with the data query condition and provided by the application program management platform is entered. The statistical page is obtained by the application program management platform performing behavior statistics on each user terminal having the same device attribute as the currently accessed terminal device.
The simulated click operation is an operation sequence set in the application program management platform according to the data query condition.
Continuing with the above example as an example, if the data query condition is to obtain the download amount of the application program C in the application program management platform B in the area a, after determining the terminal device whose device attribute matches the data query condition, accessing the application management platform through the terminal device to obtain a management page for managing the application program, and simulating the operation of clicking to view the statistical page by the user on the management page of the application program to obtain the statistical page of the download amount of the application program C provided by the application program management platform.
And step 205, crawling statistical data of the statistical page to obtain application program data.
The data crawling refers to downloading content on a page.
In the embodiment of the present application, data of an application program in the application program management platform is continuously updated, and meanwhile, a developer may continuously upload a new application program to the application program management platform, which requires that data of the application program stored in the database is continuously updated. Therefore, data crawling can be performed on the statistical page periodically to obtain application program data.
As a possible implementation manner, an operation path for acquiring data of an application program can be simulated through a Selenium tool, and the data of all the application programs in the application program management platform is captured periodically and summarized into a database, so that the data in the database can be updated regularly.
Among them, Selenium is an automated testing tool for web applications. The system can be directly operated in a browser, simulates the click operation of a person, and can extract a Document Object Model (DOM) in a web page for processing such as copying, modifying, deleting and the like. And it supports multiple browsers, only needs to install a specific browser driver to run in the browser.
And step 206, filtering the application program data according to preset screening conditions.
In the embodiment of the application, the statistical data crawl is performed on the statistical page, useless information such as icons of all application programs and picture information in the basic brief introduction in the application program data is obtained, at the moment, the application program data crawled from the statistical page needs to be filtered, some useless information is filtered, only useful data are reserved, and therefore storage space is saved.
Specifically, the application program data crawled from the statistical page is filtered by using a filtering tool according to preset filtering conditions. The screening condition may be information such as a picture and an icon in the data to be screened out, and the specific screening condition is determined according to a requirement of a user and is not specifically limited herein.
As an example, the MitmProxy tool may be used to filter application data according to the filtering conditions, thereby filtering out useless information and retaining only useful information.
MitmProxy is an open source packet capture tool, and provides a console interface for dynamically intercepting and editing HTTP packets.
Step 207, inquiring the priority of each group of statistical data according to the statistical dimension of each group of statistical data in the application data.
The statistical dimension refers to application program data based on multi-directional statistics, such as loading capacity, search ranking, heat ranking, and the like.
In the embodiment of the application, the obtained application program is divided into a plurality of groups of statistical data according to the statistical dimension, and each group of statistical data corresponds to one priority, so that the priority of each group of statistical data can be inquired according to the statistical dimension of each group of statistical data in the application program data.
And step 208, storing each group of statistical data into a database according to the priority order.
The database is used for storing data of each application program of the application program management platform, and summarizing the data for querying, comparing and the like of later data.
In the embodiment of the application, the statistical data with low priority are stored in the temporary resource library according to the priority of each group of statistical data obtained by query, so that the performance of the application data acquisition system is optimized, the system is faster, and the running speed of the system is increased. And the statistical data with high priority is stored in the database to process the data in the database, and the statistical data stored in the temporary resource library is synchronized to the database at the interval of data processing on the database, so that the data storage time is saved.
For example, the download amount and the search ranking of each application program are obtained from the application program management platform statistical page, and if the priority of the download amount is higher than the priority of the search ranking, the statistical data corresponding to the download amount is stored in the database, the statistical data corresponding to the search ranking is stored in the temporary resource library, and after all the data corresponding to the download amount are stored in the database, the statistical data corresponding to the search ranking is stored in the database at intervals of data processing.
Further, the application data is stored in the database and then processed, and the application data is dynamically displayed in the form of a report, for example, a table, a histogram, a pie chart, and the like. After the data report forms are used for displaying the application program data, the data report forms are sent to operators according to a preset time period, so that the operators can know the change trend of the data more visually, and the product release work and release strategies of the operators are adjusted. For example, it may be sent by mail to expose the application data to the operator. If the acquired application program data is less, for example, only one histogram is available, the data can be sent by a short message.
As a possible scenario, the application data stored in the database may be subjected to predictive analysis according to a time series analysis method. The time series analysis method is that the application program data stored in the database are arranged according to time sequence to form statistical time series, and then a certain digital method is applied to extend the statistical time series outwards, the development and change trend of the market is predicted, and the market prediction value is determined. The time series analysis method is mainly characterized in that the market demand trend is predicted by time lapse research and is not influenced by other external factors.
Furthermore, the result of the predictive analysis of the application data in the database is also displayed in the form of a data report, and the data report is sent to the operator, and also sent in the form of a mail to display the application data to the operator.
According to the data acquisition method of the application program, the data query condition is obtained, the terminal device with the device attribute matched with the data query condition is determined according to the data query condition, the application program management platform is accessed through the terminal device to obtain the management page, the management page is subjected to simulated clicking according to the data query condition, so that the application program management platform provides the statistical page matched with the data query condition, the statistical data crawling is carried out on the statistical page to obtain the application program data, the application program data are filtered according to the preset screening condition, the priority of each group of statistical data is inquired according to the statistical dimension of each group of statistical data in the application program data, and each group of statistical data is stored into the database according to the priority sequence. According to the method, data crawling is carried out in the statistical page matched with the data query conditions and provided by the application program management platform, application program data are obtained, and further, all groups of statistical data are stored in the database according to the priority sequence, so that the accuracy of data acquisition is improved, the data updating period is shortened, and the working efficiency is greatly improved.
In order to implement the above embodiments, the present application further provides a data acquisition apparatus for an application program.
Fig. 3 is a schematic structural diagram of a data acquisition device of an application according to an embodiment of the present disclosure.
As shown in fig. 3, the data acquisition apparatus 100 of the application includes: an acquisition module 110, a determination module 120, and a processing module 130.
The obtaining module 110 is configured to obtain a data query condition.
A determining module 120, configured to determine, according to the data query condition, a terminal device whose device attribute matches the data query condition; the device attribute comprises at least one of a region where the device is located, a device operating system type and a device operating system version.
The processing module 130 is configured to access the application management platform through the terminal device to obtain application data that meets the data query condition and is counted by the application management platform.
As a possible implementation manner, the processing module 130 is specifically configured to access the application management platform through the terminal device to obtain a management page, and perform simulated clicking on the management page according to the data query condition, so that the application management platform provides a statistical page matched with the data query condition; the statistical page is obtained by the application program management platform performing behavior statistics on each user terminal having the same device attribute as the currently accessed terminal device, and the statistical page is subjected to statistical data crawling to obtain application program data.
As another possible implementation manner, the processing module 130 may be further configured to filter the application data according to a preset filtering condition; and the screening condition is used for screening the picture information in the application program data.
As another possible implementation manner, referring to fig. 4, the data acquisition apparatus 100 of the application program may further include:
the storage module 140 is used for storing the application program data into the database.
As another possible implementation, referring to fig. 4, the storage module 140 may further include:
the query unit 141 is configured to query the priority of each group of statistical data according to the statistical dimension of each group of statistical data in the application data.
And a storage unit 142, configured to store each group of statistical data in the database according to the priority order.
As another possible implementation manner, the storage unit 142 is specifically configured to store the statistical data with low priority into the temporary repository, store the statistical data with high priority into the database, and synchronize the statistical data stored in the temporary repository to the database during the data processing interval of the database.
As another possible implementation manner, referring to fig. 4, the data acquisition apparatus 100 of the application program may further include:
and the prediction module 150 is used for performing prediction analysis on the application program data stored in the database according to a time series analysis method.
As another possible implementation, the application data includes ranking and/or comment information of the applications on the application management platform.
The data acquisition device of the application program of the embodiment of the application program acquires the data query condition and determines the terminal equipment with the equipment attribute matched with the data query condition according to the data query condition; the equipment attribute comprises at least one of the area where the equipment is located, the type of an equipment operating system and the version of the equipment operating system; and accessing the application program management platform through the terminal equipment to obtain the application program data which are counted by the application program management platform and meet the data query condition. According to the method, the application management platform is accessed in the terminal equipment matched with the data query condition to obtain the application program data meeting the data query condition, and the technical problems of low working efficiency, high error rate, long data update period and the like caused by manually obtaining the application program data counted by the application management platform in the prior art are solved, so that a large amount of labor cost is reduced, and the working efficiency is greatly improved.
In order to implement the foregoing embodiments, the present application also provides a computer device, including: the data acquisition method comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the processor executes the program, the data acquisition method of the application program is realized.
In order to implement the above embodiments, the present application also proposes a non-transitory computer-readable storage medium on which a computer program is stored, which, when executed by a processor, implements the data acquisition method of an application program as proposed by the above embodiments of the present application.
FIG. 5 illustrates a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present application. The computer device 12 shown in fig. 5 is only an example and should not bring any limitation to the function and scope of use of the embodiments of the present application.
As shown in FIG. 5, computer device 12 is in the form of a general purpose computing device. The components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. These architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus, to name a few.
Computer device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
Memory 28 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 30 and/or cache Memory 32. Computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 5, and commonly referred to as a "hard drive"). Although not shown in FIG. 5, a disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk Read Only memory (CD-ROM), a Digital versatile disk Read Only memory (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the application.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally perform the functions and/or methodologies of the embodiments described herein.
Computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), and may also communicate with one or more devices that enable a user to interact with the computer device 12, and/or with any devices (e.g., Network card, modem, etc.) that enable the computer device 12 to communicate with one or more other computing devices, such communication may occur via input/output (I/O) interfaces 22. moreover, computer device 12 may also communicate with one or more networks (e.g., local Area Network (L Area Network; L AN) Wide Area Network (WAN; WAN) and/or a public Network such as the WAN) via Network adapter 20. As shown, Network adapter 20 communicates with other modules of computer device 12 via bus 18. it should be understood that, although not shown, other hardware and/or software modules may be used in connection with computer device 12, including, but not limited to, microcode, a microcode processing device, a redundant array drive, a disk drive system, a RAID storage system, and the like.
The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, implementing the data acquisition method of the application program mentioned in the foregoing embodiment.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims (18)

1. A method for data acquisition of an application, the method comprising the steps of:
acquiring a data query condition;
determining terminal equipment with equipment attributes matched with the data query conditions according to the data query conditions; the equipment attribute comprises at least one of the area where the equipment is located, the type of an equipment operating system and the version of the equipment operating system;
and accessing an application program management platform through the terminal equipment to obtain the application program data which is counted by the application program management platform and accords with the data query condition.
2. The method for acquiring data of an application program according to claim 1, wherein the accessing, by the terminal device, an application program management platform to obtain application program data that is counted by the application program management platform and meets the data query condition includes:
accessing the application program management platform through the terminal equipment to obtain a management page;
according to the data query condition, performing simulated click on the management page so that the application program management platform provides a statistical page matched with the data query condition; the statistical page is obtained by the application program management platform performing behavior statistics on each user terminal having the same device attribute as the currently accessed terminal device;
and crawling statistical data on the statistical page to obtain the application program data.
3. The method for acquiring data of an application program according to claim 2, wherein after the crawling of the statistical data on the statistical page to obtain the data of the application program, the method further comprises:
filtering the application program data according to a preset screening condition; and the screening condition is used for screening the picture information in the application program data.
4. The method for acquiring data of an application program according to claim 1, wherein after the accessing, by the terminal device, an application program management platform to obtain application program data that meets the data query condition and is counted by the application program management platform, the method further comprises:
storing the application data in a database.
5. The method for acquiring data of an application program according to claim 4, wherein the storing the application program data in a database comprises:
inquiring the priority of each group of statistical data according to the statistical dimension of each group of statistical data in the application program data;
and storing each group of statistical data into a database according to the priority order.
6. The method for acquiring data of an application program according to claim 5, wherein the storing the sets of statistical data into the database according to the priority order comprises:
storing the statistical data with low priority into a temporary repository;
storing the statistical data with high priority into a database;
and synchronizing the statistical data stored in the temporary resource library to the database at the interval of data processing on the database.
7. The method for acquiring data of an application program according to claim 4, further comprising, after storing the application program data in a database:
and performing predictive analysis on the application program data stored in the database according to a time series analysis method.
8. The data acquisition method for the application programs according to any one of claims 1 to 7, wherein the application program data comprises ranking and/or comment information of each application program on an application program management platform.
9. An apparatus for data acquisition of an application, the apparatus comprising:
the acquisition module is used for acquiring data query conditions;
the determining module is used for determining the terminal equipment with the equipment attribute matched with the data query condition according to the data query condition; the equipment attribute comprises at least one of the area where the equipment is located, the type of an equipment operating system and the version of the equipment operating system;
and the processing module is used for accessing the application program management platform through the terminal equipment so as to obtain the application program data which is counted by the application program management platform and accords with the data query condition.
10. The data acquisition device of the application program according to claim 9, wherein the processing module is specifically configured to:
accessing the application program management platform through the terminal equipment to obtain a management page;
according to the data query condition, performing simulated click on the management page so that the application program management platform provides a statistical page matched with the data query condition; the statistical page is obtained by the application program management platform performing behavior statistics on each user terminal having the same device attribute as the currently accessed terminal device;
and crawling statistical data on the statistical page to obtain the application program data.
11. The application data acquisition device of claim 10, wherein the processing module is further specifically configured to:
filtering the application program data according to a preset screening condition; the screening condition is to screen out picture information in the application program data.
12. The data acquisition apparatus for an application program according to claim 9, further comprising:
and the storage module is used for storing the application program data into a database.
13. The data acquisition device of claim 12, wherein the storage module further comprises:
the query unit is used for querying the priority of each group of statistical data according to the statistical dimension of each group of statistical data in the application program data;
and the storage unit is used for storing each group of statistical data into the database according to the priority order.
14. The data acquisition apparatus of the application program according to claim 13, wherein the storage unit is specifically configured to:
storing the statistical data with low priority into a temporary repository;
storing the statistical data with high priority into a database;
and synchronizing the statistical data stored in the temporary resource library to the database at the interval of data processing on the database.
15. The data acquisition apparatus for an application program according to claim 12, further comprising:
and the prediction module is used for performing prediction analysis on the application program data stored in the database according to a time series analysis method.
16. The apparatus according to any one of claims 9 to 15, wherein the application data includes ranking and/or comment information of each application on an application management platform.
17. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing a data acquisition method as claimed in any one of claims 1 to 8 when executing the program.
18. A non-transitory computer-readable storage medium having stored thereon a computer program, wherein the program, when executed by a processor, implements the data acquisition method of any one of claims 1-8.
CN201910020223.7A 2019-01-09 2019-01-09 Application program data acquisition method and device Active CN111428117B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910020223.7A CN111428117B (en) 2019-01-09 2019-01-09 Application program data acquisition method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910020223.7A CN111428117B (en) 2019-01-09 2019-01-09 Application program data acquisition method and device

Publications (2)

Publication Number Publication Date
CN111428117A true CN111428117A (en) 2020-07-17
CN111428117B CN111428117B (en) 2023-05-16

Family

ID=71545645

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910020223.7A Active CN111428117B (en) 2019-01-09 2019-01-09 Application program data acquisition method and device

Country Status (1)

Country Link
CN (1) CN111428117B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111741030A (en) * 2020-08-26 2020-10-02 北京赛宁网安科技有限公司 Website security detection system and method combining Web automation and agent interception
CN113010208A (en) * 2021-04-28 2021-06-22 数字广东网络建设有限公司 Version information generation method, version information generation device, version information generation equipment and storage medium

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102571160A (en) * 2012-01-16 2012-07-11 华为终端有限公司 Bluetooth searching method and equipment
CN103164505A (en) * 2012-09-20 2013-06-19 深圳市金立通信设备有限公司 System and method for conducting ranking on internet applications based on actual use frequency
CN103605754A (en) * 2013-11-22 2014-02-26 北京飞流九天科技有限公司 Method and device for ranking applications
CN103677899A (en) * 2013-11-15 2014-03-26 小米科技有限责任公司 Method and device for installing application programs
CN104735041A (en) * 2013-12-24 2015-06-24 华为终端有限公司 Method and device for having access to offline resources
CN104966245A (en) * 2015-06-30 2015-10-07 国网天津市电力公司 Visualized power supply scheme auxiliary compilation method based on power grid GIS (Gas Insulated Switchgear)
CN105589873A (en) * 2014-10-22 2016-05-18 腾讯科技(深圳)有限公司 Data searching method, terminal and server
CN106067894A (en) * 2016-05-25 2016-11-02 努比亚技术有限公司 A kind of information getting method and electronic equipment
US20170093643A1 (en) * 2011-11-16 2017-03-30 Autoconnect Holdings Llc Vehicle middleware
CN107463581A (en) * 2016-06-02 2017-12-12 广州泰尔智信科技有限公司 Using download acquisition methods, device and terminal device
CN107463578A (en) * 2016-06-06 2017-12-12 工业和信息化部电信研究院 Using download statistics De-weight method, device and terminal device
CN107798028A (en) * 2017-02-16 2018-03-13 平安科技(深圳)有限公司 One kind applies download statistics method and apparatus
CN108280093A (en) * 2017-01-06 2018-07-13 工业和信息化部电信研究院 Application message acquisition methods and device

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170093643A1 (en) * 2011-11-16 2017-03-30 Autoconnect Holdings Llc Vehicle middleware
CN102571160A (en) * 2012-01-16 2012-07-11 华为终端有限公司 Bluetooth searching method and equipment
CN103164505A (en) * 2012-09-20 2013-06-19 深圳市金立通信设备有限公司 System and method for conducting ranking on internet applications based on actual use frequency
CN103677899A (en) * 2013-11-15 2014-03-26 小米科技有限责任公司 Method and device for installing application programs
CN103605754A (en) * 2013-11-22 2014-02-26 北京飞流九天科技有限公司 Method and device for ranking applications
CN104735041A (en) * 2013-12-24 2015-06-24 华为终端有限公司 Method and device for having access to offline resources
CN105589873A (en) * 2014-10-22 2016-05-18 腾讯科技(深圳)有限公司 Data searching method, terminal and server
CN104966245A (en) * 2015-06-30 2015-10-07 国网天津市电力公司 Visualized power supply scheme auxiliary compilation method based on power grid GIS (Gas Insulated Switchgear)
CN106067894A (en) * 2016-05-25 2016-11-02 努比亚技术有限公司 A kind of information getting method and electronic equipment
CN107463581A (en) * 2016-06-02 2017-12-12 广州泰尔智信科技有限公司 Using download acquisition methods, device and terminal device
CN107463578A (en) * 2016-06-06 2017-12-12 工业和信息化部电信研究院 Using download statistics De-weight method, device and terminal device
CN108280093A (en) * 2017-01-06 2018-07-13 工业和信息化部电信研究院 Application message acquisition methods and device
CN107798028A (en) * 2017-02-16 2018-03-13 平安科技(深圳)有限公司 One kind applies download statistics method and apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
陈春成,杨懿涵,: ""基于IFIX的铁路客运车站设备管理系统的设计"", 《科技与创新》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111741030A (en) * 2020-08-26 2020-10-02 北京赛宁网安科技有限公司 Website security detection system and method combining Web automation and agent interception
CN111741030B (en) * 2020-08-26 2020-12-04 北京赛宁网安科技有限公司 Website security detection system and method combining Web automation and agent interception
CN113010208A (en) * 2021-04-28 2021-06-22 数字广东网络建设有限公司 Version information generation method, version information generation device, version information generation equipment and storage medium
CN113010208B (en) * 2021-04-28 2023-12-19 数字广东网络建设有限公司 Version information generation method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN111428117B (en) 2023-05-16

Similar Documents

Publication Publication Date Title
CN108874289B (en) Application history record viewing method and device and electronic equipment
US10275355B2 (en) Method and apparatus for cleaning files in a mobile terminal and associated mobile terminal
RU2608668C2 (en) System and method for control and organisation of web-browser cache for offline browsing
CN110515912A (en) Log processing method, device, computer installation and computer readable storage medium
CN104951340A (en) Information processing method and device
WO2016005826A1 (en) Managing and organizing web browser cache
CN110928739B (en) Process monitoring method and device and computing equipment
CN105224614A (en) Application program classification display method and device
CN111400361A (en) Data real-time storage method and device, computer equipment and storage medium
CN103699534A (en) Display method and device for data object in system directory
CN111428117B (en) Application program data acquisition method and device
CN114356166A (en) Application icon display method and related equipment
CN111177078A (en) Log processing method and device and electronic equipment
CN108234758B (en) Application display method and device, storage medium and electronic equipment
CN112559913B (en) Data processing method, device, computing equipment and readable storage medium
CN111125226B (en) Configuration data acquisition method and device
CN103809915B (en) The reading/writing method of a kind of disk file and device
CN114564856B (en) Data sharing method based on FMEA and electronic equipment
CN115454827B (en) Compatibility detection method, system, equipment and medium
CN111459411B (en) Data migration method, device, equipment and storage medium
CN115004667B (en) Information pushing method, device, electronic equipment and computer readable medium
CN112394856B (en) Information statistics method, device, electronic equipment and storage medium
CN115202643A (en) Icon resource deleting method and device, electronic equipment and medium
CN110297757B (en) Test case management method, device, equipment and computer readable storage medium
CN114741594A (en) Information pushing method and device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant