US20230032874A1 - Realtime event detection - Google Patents
Realtime event detection Download PDFInfo
- Publication number
- US20230032874A1 US20230032874A1 US17/965,075 US202217965075A US2023032874A1 US 20230032874 A1 US20230032874 A1 US 20230032874A1 US 202217965075 A US202217965075 A US 202217965075A US 2023032874 A1 US2023032874 A1 US 2023032874A1
- Authority
- US
- United States
- Prior art keywords
- event
- events
- endpoint
- facility
- sequence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 97
- 238000012544 monitoring process Methods 0.000 claims abstract description 68
- 238000000034 method Methods 0.000 claims description 209
- 230000008569 process Effects 0.000 claims description 94
- 230000015654 memory Effects 0.000 claims description 50
- 230000001364 causal effect Effects 0.000 claims description 36
- 238000004891 communication Methods 0.000 claims description 34
- 230000002093 peripheral effect Effects 0.000 claims description 20
- 230000004044 response Effects 0.000 claims description 18
- 238000005067 remediation Methods 0.000 claims description 16
- 230000001010 compromised effect Effects 0.000 claims description 15
- 230000002441 reversible effect Effects 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 11
- 239000003795 chemical substances by application Substances 0.000 claims description 9
- 238000002347 injection Methods 0.000 claims description 7
- 239000007924 injection Substances 0.000 claims description 7
- 230000001419 dependent effect Effects 0.000 claims description 6
- 230000007704 transition Effects 0.000 claims description 5
- 238000012545 processing Methods 0.000 abstract description 25
- 238000013459 approach Methods 0.000 abstract description 9
- 238000007726 management method Methods 0.000 description 146
- 238000004458 analytical method Methods 0.000 description 73
- 230000009471 action Effects 0.000 description 48
- 230000000694 effects Effects 0.000 description 38
- 230000003993 interaction Effects 0.000 description 23
- 238000011156 evaluation Methods 0.000 description 18
- 238000001914 filtration Methods 0.000 description 18
- 230000006399 behavior Effects 0.000 description 15
- 230000006870 function Effects 0.000 description 15
- 241000700605 Viruses Species 0.000 description 14
- 238000004374 forensic analysis Methods 0.000 description 14
- 230000000246 remedial effect Effects 0.000 description 14
- 238000012360 testing method Methods 0.000 description 13
- 230000002085 persistent effect Effects 0.000 description 11
- 238000003860 storage Methods 0.000 description 11
- 230000003542 behavioural effect Effects 0.000 description 9
- 230000008901 benefit Effects 0.000 description 8
- 230000001413 cellular effect Effects 0.000 description 8
- 230000002265 prevention Effects 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 230000002688 persistence Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000000903 blocking effect Effects 0.000 description 4
- 230000000670 limiting effect Effects 0.000 description 4
- 238000011160 research Methods 0.000 description 4
- 230000003068 static effect Effects 0.000 description 4
- 238000007792 addition Methods 0.000 description 3
- 230000032683 aging Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 238000002372 labelling Methods 0.000 description 3
- 230000007774 longterm Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008520 organization Effects 0.000 description 3
- 230000000737 periodic effect Effects 0.000 description 3
- 239000000243 solution Substances 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 244000035744 Hura crepitans Species 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000002955 isolation Methods 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 238000005096 rolling process Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 241000256251 Spodoptera frugiperda Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000002155 anti-virotic effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000011157 data evaluation Methods 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- ZXQYGBMAQZUVMI-GCMPRSNUSA-N gamma-cyhalothrin Chemical compound CC1(C)[C@@H](\C=C(/Cl)C(F)(F)F)[C@H]1C(=O)O[C@H](C#N)C1=CC=CC(OC=2C=CC=CC=2)=C1 ZXQYGBMAQZUVMI-GCMPRSNUSA-N 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 208000015181 infectious disease Diseases 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000011068 loading method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 229920001690 polydopamine Polymers 0.000 description 1
- 238000013138 pruning Methods 0.000 description 1
- 238000010926 purge Methods 0.000 description 1
- 230000002829 reductive effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000003362 replicative effect Effects 0.000 description 1
- 238000012502 risk assessment Methods 0.000 description 1
- 239000010979 ruby Substances 0.000 description 1
- 229910001750 ruby Inorganic materials 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000000153 supplemental effect Effects 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000036962 time dependent Effects 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/14—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
- H04L63/1408—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic by monitoring network traffic
- H04L63/1416—Event detection, e.g. attack signature detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
- G06F16/9024—Graphs; Linked lists
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
- G06F21/55—Detecting local intrusion or implementing counter-measures
- G06F21/552—Detecting local intrusion or implementing counter-measures involving long-term monitoring or reporting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
- G06F21/55—Detecting local intrusion or implementing counter-measures
- G06F21/554—Detecting local intrusion or implementing counter-measures involving event detection and direct action
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
- G06F21/55—Detecting local intrusion or implementing counter-measures
- G06F21/56—Computer malware detection or handling, e.g. anti-virus arrangements
- G06F21/562—Static detection
- G06F21/565—Static detection by checking file integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/542—Event management; Broadcasting; Multicasting; Notifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/02—Network architectures or network communication protocols for network security for separating internal from external traffic, e.g. firewalls
- H04L63/0227—Filtering policies
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/10—Network architectures or network communication protocols for network security for controlling access to devices or network resources
- H04L63/101—Access control lists [ACL]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/14—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
- H04L63/1441—Countermeasures against malicious traffic
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
- G06F21/55—Detecting local intrusion or implementing counter-measures
- G06F21/56—Computer malware detection or handling, e.g. anti-virus arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/02—Network architectures or network communication protocols for network security for separating internal from external traffic, e.g. firewalls
- H04L63/0272—Virtual private networks
Definitions
- This application relates to event detection, and more particularly to an event handler for real time, event-based detection of the presence of malware or other context, conditions or uses of an endpoint.
- An event handler implements a state machine or similar construct for processing of complex event chains as incremental events are detected. This approach advantageously limits processing to monitoring for and responding to a next event in a sequence of events, and supports complex event detection in a manner that scales efficiently in time and computation.
- FIG. 1 illustrates an environment for threat management.
- FIG. 2 illustrates a computer system
- FIG. 3 illustrates a system for forensic analysis for computer processes.
- FIG. 4 is a flowchart of a method for forensic analysis for computer processes.
- FIG. 5 illustrates an event graph
- FIG. 6 shows a method for malware detection using an event graph.
- FIG. 7 shows a malware detection system including an event handler on an endpoint.
- FIG. 8 shows a method for real time event detection.
- FIG. 1 illustrates an environment for threat management.
- FIG. 1 depicts a block diagram of a threat management system providing protection to an enterprise against a plurality of threats—a context in which the following techniques may usefully be deployed.
- One aspect relates to corporate policy management and implementation through a unified threat management facility 100 .
- a threat management facility 100 may be used to protect computer assets from many threats, both computer-generated threats and user-generated threats.
- the threat management facility 100 may be multi-dimensional in that it may be designed to protect corporate assets from a variety of threats and it may be adapted to learn about threats in one dimension (e.g. worm detection) and apply the knowledge in another dimension (e.g. spam detection).
- Policy management is one of the dimensions for which the threat management facility can provide a control capability.
- a corporation or other entity may institute a policy that prevents certain people (e.g. employees, groups of employees, types of employees, guest of the corporation, etc.) from accessing certain types of computer programs.
- the corporation may elect to prevent its accounting department from using a particular version of an instant messaging service or all such services.
- the policy management facility 112 may be used to update the policies of all corporate computing assets with a proper policy control facility or it may update a select few.
- the threat management facility 100 may take care of updating all of the other corporate computing assets.
- the threat management facility 100 may provide multiple services, and policy management may be offered as one of the services. We will now turn to a description of certain capabilities and components of the threat management system 100 .
- malware has become a major problem across the Internet 154 .
- the categorization of a specific threat type is becoming reduced in significance.
- the threat no matter how it is categorized, may need to be stopped at various points of a networked computing environment, such as one of an enterprise facility 102 , including at one or more laptops, desktops, servers, gateways, communication ports, handheld or mobile devices, firewalls, and the like.
- a networked computing environment such as one of an enterprise facility 102 , including at one or more laptops, desktops, servers, gateways, communication ports, handheld or mobile devices, firewalls, and the like.
- a consolidated threat management facility 100 may need to apply a similar set of technologies and capabilities for all threats.
- the threat management facility 100 may provide a single agent on the desktop, and a single scan of any suspect file. This approach may eliminate the inevitable overlaps and gaps in protection caused by treating viruses and spyware as separate problems, while simultaneously simplifying administration and minimizing desktop load.
- the level of connectivity available to all IT users may have led to a rapid increase in the speed at which threats may move.
- an unprotected PC connected to the Internet 154 may be infected quickly (perhaps within 10 minutes) which may require acceleration for the delivery of threat protection.
- the threat management facility 100 may automatically and seamlessly update its product set against spam and virus threats quickly, for instance, every five minutes, every minute, continuously, or the like. Analysis and testing may be increasingly automated, and also may be performed more frequently; for instance, it may be completed in 15 minutes, and may do so without compromising quality.
- the threat management facility 100 may also extend techniques that may have been developed for virus and malware protection, and provide them to enterprise facility 102 network administrators to better control their environments. In addition to stopping malicious code, the threat management facility 100 may provide policy management that may be able to control legitimate applications, such as VoIP, instant messaging, peer-to-peer file-sharing, and the like, that may undermine productivity and network performance within the enterprise facility 102 .
- the threat management facility 100 may provide an enterprise facility 102 protection from computer-based malware, including viruses, spyware, adware, Trojans, intrusion, spam, policy abuse, uncontrolled access, and the like, where the enterprise facility 102 may be any entity with a networked computer-based infrastructure.
- FIG. 1 may depict a block diagram of the threat management facility 100 providing protection to an enterprise against a plurality of threats.
- the enterprise facility 102 may be corporate, commercial, educational, governmental, or the like, and the enterprise facility's 102 computer network may be distributed amongst a plurality of facilities, and in a plurality of geographical locations, and may include administration 134 , a firewall 138 A, an appliance 140 A, server 142 A, network devices 148 A-B, clients 144 A-D, such as protected by computer security facilities 152 , and the like. It will be understood that any reference herein to client facilities may include the clients 144 A-D shown in FIG. 1 and vice-versa.
- the threat management facility 100 may include a plurality of functions, such as security management facility 122 , policy management facility 112 , update facility 120 , definitions facility 114 , network access rules facility 124 , remedial action facility 128 , detection techniques facility 130 , testing facility 118 , threat research facility 132 , and the like.
- the threat protection provided by the threat management facility 100 may extend beyond the network boundaries of the enterprise facility 102 to include clients 144 D (or client facilities) that have moved into network connectivity not directly associated or controlled by the enterprise facility 102 .
- Threats to client facilities may come from a plurality of sources, such as from network threats 104 , physical proximity threats 110 , secondary location threats 108 , and the like.
- Clients 144 A-D may be protected from threats even when the client 144 A-D is not located in association with the enterprise 102 , such as when a client 144 E-F moves in and out of the enterprise facility 102 , for example when interfacing with an unprotected server 142 C through the Internet 154 , when a client 144 F is moving into a secondary location threat 108 such as interfacing with components 140 B, 142 B, 148 C, 148 D that are not protected, and the like.
- the threat management facility 100 may provide an enterprise facility 102 protection from a plurality of threats to multiplatform computer resources in a plurality of locations and network configurations, with an integrated system approach.
- the threat management facility 100 may be provided as a stand-alone solution. In other embodiments, the threat management facility 100 may be integrated into a third-party product.
- An application programming interface e.g. a source code interface
- the threat management facility 100 may be stand-alone in that it provides direct threat protection to an enterprise or computer resource, where protection is subscribed to directly 100 .
- the threat management facility 100 may offer protection indirectly, through a third-party product, where an enterprise may subscribe to services through the third-party product, and threat protection to the enterprise may be provided by the threat management facility 100 through the third-party product.
- the security management facility 122 may include a plurality of elements that provide protection from malware to enterprise facility 102 computer resources, including endpoint security and control, email security and control, web security and control, reputation-based filtering, control of unauthorized users, control of guest and non-compliant computers, and the like.
- the security management facility 122 may be a software application that may provide malicious code and malicious application protection to a client facility computing resource.
- the security management facility 122 may have the ability to scan the client facility files for malicious code, remove or quarantine certain applications and files, prevent certain actions, perform remedial actions and perform other security measures.
- scanning the client facility may include scanning some or all of the files stored to the client facility on a periodic basis, scanning an application when the application is executed, scanning files as the files are transmitted to or from the client facility, or the like.
- the scanning of the applications and files may be performed to detect known malicious code or known unwanted applications.
- new malicious code and unwanted applications may be continually developed and distributed, and updates to the known code database may be provided on a periodic basis, on a demand basis, on an alert basis, or the like.
- the security management facility 122 may provide email security and control, where security management may help to eliminate spam, viruses, spyware and phishing, control of email content, and the like.
- the security management facility's 122 email security and control may protect against inbound and outbound threats, protect email infrastructure, prevent data leakage, provide spam filtering, and the like.
- security management facility 122 may provide for web security and control, where security management may help to detect or block viruses, spyware, malware, unwanted applications, help control web browsing, and the like, which may provide comprehensive web access control enabling safe, productive web browsing.
- Web security and control may provide Internet use policies, reporting on suspect devices, security and content filtering, active monitoring of network traffic, URI filtering, and the like.
- the security management facility 122 may provide for network access control, which may provide control over network connections.
- Network control may stop unauthorized, guest, or non-compliant systems from accessing networks, and may control network traffic that may not be bypassed from the client level.
- network access control may control access to virtual private networks (VPN), where VPNs may be a communications network tunneled through another network, establishing a logical connection acting as a virtual network.
- VPN virtual private networks
- a VPN may be treated in the same manner as a physical network.
- the security management facility 122 may provide host intrusion prevention through behavioral based protection, which may guard against unknown threats by analyzing behavior before software code executes. Behavioral based protection may monitor code when it runs and intervene if the code is deemed to be suspicious or malicious. Advantages of behavioral based protection over runtime protection may include code being prevented from running. Whereas runtime protection may only interrupt code that has already partly executed, behavioral protection can identify malicious code at the gateway or on the file servers and delete the code before it can reach endpoint computers and the like.
- the security management facility 122 may provide reputation filtering, which may target or identify sources of known malware.
- reputation filtering may include lists of URIs of known sources of malware or known suspicious IP addresses, or domains, say for spam, that when detected may invoke an action by the threat management facility 100 , such as dropping them immediately. By dropping the source before any interaction can initiate, potential threat sources may be thwarted before any exchange of data can be made.
- information may be sent from the enterprise back to a third party, a vendor, or the like, which may lead to improved performance of the threat management facility 100 .
- the types, times, and number of virus interactions that a client experiences may provide useful information for the preventions of future virus threats.
- This type of feedback may be useful for any aspect of threat detection.
- Feedback of information may also be associated with behaviors of individuals within the enterprise, such as being associated with most common violations of policy, network access, unauthorized application loading, unauthorized external device use, and the like.
- this type of information feedback may enable the evaluation or profiling of client actions that are violations of policy that may provide a predictive model for the improvement of enterprise policies.
- the security management facility 122 may support overall security of the enterprise facility 102 network or set of enterprise facility 102 networks, e.g., by providing updates of malicious code information to the enterprise facility 102 network and associated client facilities.
- the updates may include a planned update, an update in reaction to a threat notice, an update in reaction to a request for an update, an update based on a search of known malicious code information, or the like.
- the administration facility 134 may provide control over the security management facility 122 when updates are performed.
- the updates may be automatically transmitted without an administration facility's 134 direct control, manually transmitted by the administration facility 134 , or otherwise distributed.
- the security management facility 122 may manage the receipt of malicious code descriptions from a provider, distribution of the malicious code descriptions to enterprise facility 102 networks, distribution of the malicious code descriptions to client facilities, and so forth.
- the threat management facility 100 may provide a policy management facility 112 that may be able to block non-malicious applications, such as VoIP, instant messaging, peer-to-peer file-sharing, and the like, that may undermine productivity and network performance within the enterprise facility 102 .
- the policy management facility 112 may be a set of rules or policies that may indicate enterprise facility 102 access permissions for the client facility, such as access permissions associated with the network, applications, external computer devices, and the like.
- the policy management facility 112 may include a database, a text file, a combination of databases and text files, or the like.
- a policy database may be a block list, a black list, an allowed list, a white list, or the like that may provide a list of enterprise facility 102 external network locations/applications that may or may not be accessed by the client facility.
- the policy management facility 112 may include rules that may be interpreted with respect to an enterprise facility 102 network access request to determine if the request should be allowed.
- the rules may provide a generic rule for the type of access that may be granted.
- the rules may be related to the policies of an enterprise facility 102 for access rights for the enterprise facility's 102 client facility. For example, there may be a rule that does not permit access to sporting websites.
- a security facility may access the rules within a policy facility to determine if the requested access is related to a sporting website.
- the security facility may analyze the requested website to determine if the website matches with any of the policy facility rules.
- the policy management facility 112 may be similar to the security management facility 122 but with the addition of enterprise facility 102 wide access rules and policies that may be distributed to maintain control of client facility access to enterprise facility 102 network resources.
- the policies may be defined for application type, subset of application capabilities, organization hierarchy, computer facility type, user type, network location, time of day, connection type, or the like.
- Policies may be maintained by the administration facility 134 , through the threat management facility 100 , in association with a third party, or the like. For example, a policy may restrict IM activity to only support personnel for communicating with customers. This may allow communication for departments requiring access, but may maintain the network bandwidth for other activities by restricting the use of IM to only the personnel that need access to instant messaging (IM) in support of the enterprise facility 102 .
- the policy management facility 112 may be a stand-alone application, may be part of the network server facility 142 , may be part of the enterprise facility 102 network, may be part of the client facility, or the like.
- the threat management facility 100 may provide configuration management, which may be similar to policy management, but may specifically examine the configuration set of applications, operating systems, hardware, and the like, and manage changes to their configurations. Assessment of a configuration may be made against a standard configuration policy, detection of configuration changes, remediation of improper configuration, application of new configurations, and the like.
- An enterprise may keep a set of standard configuration rules and policies which may represent the desired state of the device. For example, a client firewall may be running and installed, but in the disabled state, where remediation may be to enable the firewall. In another example, the enterprise may set a rule that disallows the use of USB disks, and sends a configuration change to all clients, which turns off USB drive access via a registry.
- the threat management facility 100 may also provide for the removal of applications that potentially interfere with the operation of the threat management facility 100 , such as competitor products that may also be attempting similar threat management functions.
- the removal of such products may be initiated automatically whenever such products are detected.
- the application may be suspended until action is taken to remove or disable the third-party product's protection facility.
- Threat management against a quickly evolving malware environment may require timely updates, and thus an update management facility 120 may be provided by the threat management facility 100 .
- a policy management facility 112 may also require update management (e.g., as provided by the update facility 120 herein described).
- the update management for the security facility 122 and policy management facility 112 may be provided directly by the threat management facility 100 , such as by a hosted system or in conjunction with the administration facility 134 .
- the threat management facility 100 may provide for patch management, where a patch may be an update to an operating system, an application, a system tool, or the like, where one of the reasons for the patch is to reduce vulnerability to threats.
- the security facility 122 and policy management facility 112 may push information to the enterprise facility 102 network and/or client facility.
- the enterprise facility 102 network and/or client facility may also or instead pull information from the security facility 122 and policy management facility 112 network server facilities 142 , or there may be a combination of pushing and pulling of information between the security facility 122 and the policy management facility 112 network servers 142 , enterprise facility 102 network, and client facilities, or the like.
- the enterprise facility 102 network and/or client facility may pull information from the security facility 122 and policy management facility 112 network server facility 142 may request the information using the security facility 122 and policy management facility 112 update module; the request may be based on a certain time period, by a certain time, by a date, on demand, or the like.
- the security facility 122 and policy management facility 112 network servers 142 may push the information to the enterprise facility's 102 network and/or client facility by providing notification that there are updates available for download and then transmitting the information.
- the combination of the security management 122 network server facility 142 and security update module may function substantially the same as the policy management facility 112 network server and policy update module by providing information to the enterprise facility 102 network and the client facility in a push or pull method.
- the policy management facility 112 and the security facility 122 management update modules may work in concert to provide information to the enterprise facility's 102 network and/or client facility for control of application execution.
- the policy update module and security update module may be combined into a single update module.
- the threat management facility 100 may create definition updates that may be used to allow the threat management facility 100 to detect and remediate the latest malicious software, unwanted applications, configuration and policy changes, and the like.
- the threat definition facility 114 may contain threat identification updates, also referred to as definition files.
- a definition file may be a virus identity file that may include definitions of known or potential malicious code.
- the virus identity (IDE) definition files may provide information that may identify malicious code within files, applications, or the like.
- the definition files may be accessed by security management facility 122 when scanning files or applications within the client facility for the determination of malicious code that may be within the file or application.
- the definition files may contain a number of commands, definitions, or instructions, to be parsed and acted upon, or the like.
- the client facility may be updated with new definition files periodically to provide the client facility with the most recent malicious code definitions; the updating may be performed on a set time period, may be updated on demand from the client facility, may be updated on demand from the network, may be updated on a received malicious code alert, or the like.
- the client facility may request an update to the definition files from an update facility 120 within the network, may request updated definition files from a computing facility external to the network, updated definition files may be provided to the client facility 114 from within the network, definition files may be provided to the client facility from an external computing facility from an external network, or the like.
- a definition management facility 114 may provide timely updates of definition files information to the network, client facilities, and the like. New and altered malicious code and malicious applications may be continually created and distributed to networks worldwide.
- the definition files that maintain the definitions of the malicious code and malicious application information for the protection of the networks and client facilities may need continual updating to provide continual defense of the network and client facility from the malicious code and malicious applications.
- the definition files management may provide for automatic and manual methods of updating the definition files.
- the network may receive definition files and distribute the definition files to the network client facilities, the client facilities may receive the definition files directly, or the network and client facilities may both receive the definition files, or the like.
- the definition files may be updated on a fixed periodic basis, on demand by the network and/or the client facility, as a result of an alert of a new malicious code or malicious application, or the like.
- the definition files may be released as a supplemental file to an existing definition files to provide for rapid updating of the definition files.
- the security management facility 122 may be used to scan an outgoing file and verify that the outgoing file is permitted to be transmitted per the enterprise facility 102 rules and policies. By checking outgoing files, the security management facility 122 may be able discover malicious code infected files that were not detected as incoming files as a result of the client facility having been updated with either new definition files or policy management facility 112 information.
- the definition files may discover the malicious code infected file by having received updates of developing malicious code from the administration facility 134 , updates from a definition files provider, or the like.
- the policy management facility 112 may discover the malicious code infected file by having received new updates from the administration facility 134 , from a rules provider, or the like.
- the threat management facility 100 may provide controlled access to the enterprise facility 102 networks. For instance, a manager of the enterprise facility 102 may want to restrict access to certain applications, networks, files, printers, servers, databases, or the like. In addition, the manager of the enterprise facility 102 may want to restrict user access based on certain criteria, such as the user's location, usage history, need to know, job position, connection type, time of day, method of authentication, client-system configuration, or the like. Network access rules may be developed for the enterprise facility 102 , or pre-packaged by a supplier, and managed by the threat management facility 100 in conjunction with the administration facility 134 .
- a network access rules facility 124 may be responsible for determining if a client facility application should be granted access to a requested network location.
- the network location may be on the same network as the facility or may be on another network.
- the network access rules facility 124 may verify access rights for client facilities from within the network or may verify access rights of computer facilities from external networks.
- the network access rules facility 124 may send an information file to the client facility containing.
- the information sent by the network access rules facility 124 may be a data file.
- the data file may contain a number of commands, definitions, instructions, or the like to be parsed and acted upon through the remedial action facility 128 , or the like.
- the information sent by the network access facility rules facility 124 may be a command or command file that the remedial action facility 128 may access and take action upon.
- the network access rules facility 124 may include databases such as a block list, a black list, an allowed list, a white list, an unacceptable network site database, an acceptable network site database, a network site reputation database, or the like of network access locations that may or may not be accessed by the client facility. Additionally, the network access rules facility 124 may incorporate rule evaluation; the rule evaluation may parse network access requests and apply the parsed information to network access rules.
- the network access rule facility 124 may have a generic set of rules that may be in support of an enterprise facility's 102 network access policies, such as denying access to certain types of websites, controlling instant messenger accesses, or the like.
- Rule evaluation may include regular expression rule evaluation, or other rule evaluation method for interpreting the network access request and comparing the interpretation to the established rules for network access.
- the network access rules facility 124 may receive a rules evaluation request from the network access control and may return the rules evaluation to the network access control.
- the network access rule facility 124 may provide updated rules and policies to the enterprise facility 102 .
- the network access rules facility 124 may be maintained by the network administration facility 134 , using network access rules facility 124 management.
- the network administration facility 134 may be able to maintain a set of access rules manually by adding rules, changing rules, deleting rules, or the like.
- the administration facility 134 may retrieve predefined rule sets from a remote provider of a set of rules to be applied to an entire enterprise facility 102 .
- the network administration facility 134 may be able to modify the predefined rules as needed for a particular enterprise facility 102 using the network access rules management facility 124 .
- the threat management facility 100 may perform or initiate a remedial action facility 128 .
- Remedial action may take a plurality of forms, such as terminating or modifying an ongoing process or interaction, sending a warning to a client or administration facility 134 of an ongoing process or interaction, executing a program or application to remediate against a threat or violation, record interactions for subsequent evaluation, or the like.
- Remedial action may be associated with an application that responds to information that a client facility network access request has been denied.
- remedial action may parse the data file, interpret the various aspects of the data file, and act on the parsed data file information to determine actions to be taken on an application requesting access to a denied network location.
- remedial action may access the threat definitions to parse the data file and determine an action to be taken on an application requesting access to a denied network location.
- the information received from the facility may be a command or a command file. The remedial action facility may carry out any commands that are received or parsed from a data file from the facility without performing any interpretation of the commands.
- the remedial action facility may interact with the received information and may perform various actions on a client requesting access to a denied network location.
- the action may be one or more of continuing to block all requests to a denied network location, a malicious code scan on the application, a malicious code scan on the client facility, quarantine of the application, terminating the application, isolation of the application, isolation of the client facility to a location within the network that restricts network access, blocking a network access port from a client facility, reporting the application to an administration facility 134 , or the like.
- the detection techniques facility 130 may include monitoring the enterprise facility 102 network or endpoint devices, such as by monitoring streaming data through the gateway, across the network, through routers and hubs, and the like.
- the detection techniques facility 130 may include monitoring activity and stored files on computing facilities, such as on server facilities 142 , desktop computers, laptop computers, other mobile computing devices, and the like.
- Detection techniques such as scanning a computer's stored files, may provide the capability of checking files for stored threats, either in the active or passive state.
- Detection techniques, such as streaming file management may provide the capability of checking files received at the network, gateway facility, client facility, and the like.
- the streaming file may be broken into blocks of information, and a plurality of virus identities may be used to check each of the blocks of information for malicious code.
- any blocks that are not determined to be clear of malicious code may not be delivered to the client facility, gateway facility, or network.
- Verifying that the threat management facility 100 is detecting threats and violations to established policy may require the ability to test the system, either at the system level or for a particular computing component.
- the testing facility 118 may allow the administration facility 134 to coordinate the testing of the security configurations of client facility computing facilities on a network.
- the administration facility 134 may be able to send test files to a set of client facility computing facilities to test the ability of the client facility to determine acceptability of the test file.
- a recording facility may record the actions taken by the client facility in reaction to the test file.
- the recording facility may aggregate the testing information from the client facility and report the testing information to the administration facility 134 .
- the administration facility 134 may be able to determine the level of preparedness of the client facility computing facilities by the reported information. Remedial action may be taken for any of the client facility computing facilities as determined by the administration facility 134 ; remedial action may be taken by the administration facility 134 or by the user of the client facility.
- the threat research facility 132 may provide a continuously ongoing effort to maintain the threat protection capabilities of the threat management facility 100 in light of continuous generation of new or evolved forms of malware.
- Threat research may include researchers and analysts working on known and emerging malware, such as viruses, rootkits a spyware, as well as other computer threats such as phishing, spam, scams, and the like.
- the threat management facility 100 may be able to provide swift, global responses to the latest threats.
- the threat management facility 100 may provide threat protection to the enterprise facility 102 , where the enterprise facility 102 may include a plurality of networked components, such as client facility, server facility 142 , administration facility 134 , firewall 138 , gateway, hubs and routers 148 , threat management appliance 140 , desktop users, mobile users, and the like. In embodiments, it may be the endpoint computer security facility 152 , located on a computer's desktop, which may provide threat protection to a user, and associated enterprise facility 102 .
- endpoint may refer to a computer system that may source data, receive data, evaluate data, buffer data, or the like (such as a user's desktop computer as an endpoint computer), a firewall as a data evaluation endpoint computer system, a laptop as a mobile endpoint computer, a personal digital assistant or tablet as a hand-held endpoint computer, a mobile phone as an endpoint computer, or the like.
- endpoint may refer to a source or destination for data, including such components where the destination is characterized by an evaluation point for data, and where the data may be sent to a subsequent destination after evaluation.
- the endpoint computer security facility 152 may be an application loaded onto the computer platform or computer support component, where the application may accommodate the plurality of computer platforms and/or functional requirements of the component.
- a client facility computer may be one of a plurality of computer platforms, such as Windows, Macintosh, Linux, and the like, where the endpoint computer security facility 152 may be adapted to the specific platform, while maintaining a uniform product and product services across platforms.
- components may have different functions to serve within the enterprise facility's 102 networked computer-based infrastructure.
- computer support components provided as hubs and routers 148 , server facility 142 , firewalls 138 , and the like, may require unique security application software to protect their portion of the system infrastructure, while providing an element in an integrated threat management system that extends out beyond the threat management facility 100 to incorporate all computer resources under its protection.
- the enterprise facility 102 may include a plurality of client facility computing platforms on which the endpoint computer security facility 152 is adapted.
- a client facility computing platform may be a computer system that is able to access a service on another computer, such as a server facility 142 , via a network.
- This client facility server facility 142 model may apply to a plurality of networked applications, such as a client facility connecting to an enterprise facility 102 application server facility 142 , a web browser client facility connecting to a web server facility 142 , an e-mail client facility retrieving e-mail from an Internet 154 service provider's mail storage servers 142 , and the like.
- traditional large client facility applications may be switched to websites, which may increase the browser's role as a client facility.
- Clients 144 may be classified as a function of the extent to which they perform their own processing. For instance, client facilities are sometimes classified as a fat client facility or thin client facility.
- the fat client facility also known as a thick client facility or rich client facility, may be a client facility that performs the bulk of data processing operations itself, and does not necessarily rely on the server facility 142 .
- the fat client facility may be most common in the form of a personal computer, where the personal computer may operate independent of any server facility 142 .
- Programming environments for fat clients 144 may include CURT, Delphi, Droplets, Java, win32, X11, and the like.
- Thin clients 144 may offer minimal processing capabilities, for instance, the thin client facility may primarily provide a graphical user interface provided by an application server facility 142 , which may perform the bulk of any required data processing.
- Programming environments for thin clients 144 may include JavaScript/AJAX, ASP, JSP, Ruby on Rails, Python's Django, PHP, and the like.
- the client facility may also be a mix of the two, such as processing data locally, but relying on a server facility 142 for data storage.
- this hybrid client facility may provide benefits from both the fat client facility type, such as multimedia support and high performance, and the thin client facility type, such as high manageability and flexibility.
- the threat management facility 100 , and associated endpoint computer security facility 152 may provide seamless threat protection to the plurality of clients 144 , and client facility types, across the enterprise facility 102 .
- the enterprise facility 102 may include a plurality of server facilities 142 , such as application servers, communications servers, file servers, database servers, proxy servers, mail servers, fax servers, game servers, web servers, and the like.
- a server facility 142 which may also be referred to as a server facility 142 application, server facility 142 operating system, server facility 142 computer, or the like, may be an application program or operating system that accepts client facility connections in order to service requests from clients 144 .
- the server facility 142 application may run on the same computer as the client facility using it, or the server facility 142 and the client facility may be running on different computers and communicating across the network. Server facility 142 applications may be divided among server facility 142 computers, with the dividing depending upon the workload.
- the threat management facility 100 may provide threat protection to server facilities 142 within the enterprise facility 102 as load conditions and application changes are made.
- a server facility 142 may also be an appliance facility 140 , where the appliance facility 140 provides specific services onto the network.
- the appliance facility 140 is a server facility 142 computer, that may be loaded with a server facility 142 operating system and server facility 142 application, the enterprise facility 102 user may not need to configure it, as the configuration may have been performed by a third party.
- an enterprise facility 102 appliance may be a server facility 142 appliance that has been configured and adapted for use with the threat management facility 100 , and located within the facilities of the enterprise facility 102 .
- the enterprise facility's 102 threat management appliance may enable the enterprise facility 102 to administer an on-site local managed threat protection configuration, where the administration facility 134 may access the threat resources through an interface, such as a web portal.
- the enterprise facility 102 may be managed remotely from a third party, vendor, or the like, without an appliance facility 140 located within the enterprise facility 102 .
- the appliance functionality may be a shared hardware product between pluralities of enterprises 102 .
- the appliance facility 140 may be located at the enterprise facility 102 , where the enterprise facility 102 maintains a degree of control.
- a hosted service may be provided, where the appliance 140 may still be an on-site black box to the enterprise facility 102 , physically placed there because of infrastructure requirements, but managed by a third party, vendor, or the like.
- Simple server facility 142 appliances may also be utilized across the enterprise facility's 102 network infrastructure, such as switches, routers, wireless routers, hubs and routers, gateways, print servers, net modems, and the like. These simple server facility appliances may not require configuration by the enterprise facility 102 , but may require protection from threats via an endpoint computer security facility 152 . These appliances may provide interconnection services within the enterprise facility 102 network, and therefore may advance the spread of a threat if not properly protected.
- a client facility may be protected from threats from within the enterprise facility 102 network using a personal firewall, which may be a hardware firewall, software firewall, or combination of these, that controls network traffic to and from a client.
- the personal firewall may permit or deny communications based on a security policy.
- Personal firewalls may be designed for use by end-users, which may result in protection for only the computer on which it's installed.
- Personal firewalls may be able to control network traffic by providing prompts each time a connection is attempted and adapting security policy accordingly.
- Personal firewalls may also provide some level of intrusion detection, which may allow the software to terminate or block connectivity where it suspects an intrusion is being attempted.
- a personal firewall may include alerts about outgoing connection attempts, control of program access to networks, hiding the client from port scans by not responding to unsolicited network traffic, monitoring of applications that may be listening for incoming connections, monitoring and regulation of incoming and outgoing network traffic, prevention of unwanted network traffic from installed applications, reporting applications that make connection attempts, reporting destination servers with which applications may be attempting communications, and the like.
- the personal firewall may be provided by the threat management facility 100 .
- a network firewall facility 138 may be a hardware or software device that may be configured to permit, deny, or proxy data through a computer network that has different levels of trust in its source of data.
- a network firewall facility 138 may be a hardware or software device that may be configured to permit, deny, or proxy data through a computer network that has different levels of trust in its source of data.
- an internal enterprise facility 102 network may have a high level of trust, because the source of all data has been sourced from within the enterprise facility 102 .
- An example of a low level of trust is the Internet 154 , because the source of data may be unknown.
- a zone with an intermediate trust level, situated between the Internet 154 and a trusted internal network, may be referred to as a “perimeter network.” Since firewall facilities 138 represent boundaries between threat levels, the endpoint computer security facility 152 associated with the firewall facility 138 may provide resources that may control the flow of threats at this enterprise facility 102 network entry point. Firewall facilities 138 , and associated endpoint computer security facility 152 , may also be associated with a network node that may be equipped for interfacing between networks that use different protocols.
- the endpoint computer security facility 152 may provide threat protection in a plurality of network infrastructure locations, such as at the enterprise facility 102 network entry point, e.g., the firewall facility 138 or gateway; at the server facility 142 ; at distribution points within the network, e.g., the hubs and routers 148 ; at the desktop of client facility computers; and the like.
- the most effective location for threat detection may be at the user's computer desktop endpoint computer security facility 152 .
- the interface between the threat management facility 100 and the enterprise facility 102 , and through the appliance facility 140 to embedded endpoint computer security facilities, may include a set of tools that may be the same for all enterprise implementations, but allow each enterprise to implement different controls.
- these controls may include both automatic actions and managed actions.
- Automatic actions may include downloads of the endpoint computer security facility 152 to components of the enterprise facility 102 , downloads of updates to existing endpoint computer security facilities of the enterprise facility 102 , uploaded network interaction requests from enterprise facility 102 components to the threat management facility 100 , and the like.
- automatic interactions between the enterprise facility 102 and the threat management facility 100 may be configured by the threat management facility 100 and an administration facility 134 in the enterprise facility 102 .
- the administration facility 134 may configure policy rules that determine interactions, such as developing rules for accessing applications, as in who is authorized and when applications may be used; establishing rules for ethical behavior and activities; rules governing the use of entertainment software such as games, or personal use software such as IM and VoIP; rules for determining access to enterprise facility 102 computing resources, including authentication, levels of access, risk assessment, and usage history tracking; rules for when an action is not allowed, such as whether an action is completely deigned or just modified in its execution; and the like.
- the administration facility 134 may also establish license management, which in turn may further determine interactions associated with a licensed application.
- interactions between the threat management facility 100 and the enterprise facility 102 may provide threat protection to the enterprise facility 102 by managing the flow of network data into and out of the enterprise facility 102 through automatic actions that may be configured by the threat management facility 100 or the administration facility 134 .
- Client facilities within the enterprise facility 102 may be connected to the enterprise facility 102 network by way of wired network facilities 148 A or wireless network facilities 148 B.
- Client facilities connected to the enterprise facility 102 network via a wired facility 148 A or wireless facility 148 B may receive similar protection, as both connection types are ultimately connected to the same enterprise facility 102 network, with the same endpoint computer security facility 152 , and the same threat protected enterprise facility 102 environment.
- Mobile wireless facility clients 144 B-F because of their ability to connect to any wireless 148 B,D network access point, may connect to the Internet 154 outside the enterprise facility 102 , and therefore outside the threat-protected environment of the enterprise facility 102 .
- the mobile client facility e.g., the clients 144 B-F
- the endpoint computer security facility 152 may experience a malware attack or perform actions counter to enterprise facility 102 established policies.
- the threat management facility 100 may protect the out-of-enterprise facility 102 mobile client facility (e.g., the clients 144 D-F) that has an embedded endpoint computer security facility 152 , such as by providing URI filtering in personal routers, using a web appliance as a DNS proxy, or the like.
- Mobile client facilities that are components of the enterprise facility 102 but temporarily outside connectivity with the enterprise facility 102 network may be provided with the same threat protection and policy control as client facilities inside the enterprise facility 102 .
- mobile the client facilities may receive the same interactions to and from the threat management facility 100 as client facilities inside the enterprise facility 102 , where the mobile client facilities may be considered a virtual extension of the enterprise facility 102 , receiving all the same services via their embedded endpoint computer security facility 152 .
- Threat management facility 100 downloads and upgrades to the enterprise facility 102 may be passed from the firewalled networks of the threat management facility 100 through to the endpoint computer security facility 152 equipped components of the enterprise facility 102 .
- the endpoint computer security facility 152 components of the enterprise facility 102 may upload policy and access requests back across the Internet 154 and through to the threat management facility 100 .
- the Internet 154 is also the path through which threats may be transmitted from their source.
- These network threats 104 may include threats from a plurality of sources, including without limitation, websites, e-mail, IM, VoIP, application software, and the like.
- threats may attempt to attack a mobile enterprise client facility (e.g., the clients 144 B-F) equipped with an endpoint computer security facility 152 , but in embodiments, as long as the mobile client facility is embedded with an endpoint computer security facility 152 , as described above, threats may have no better success than if the mobile client facility were inside the enterprise facility 102 .
- a mobile enterprise client facility e.g., the clients 144 B-F
- an endpoint computer security facility 152 e.g., the clients 144 B-F
- threats may have no better success than if the mobile client facility were inside the enterprise facility 102 .
- the mobile client facility may be required to request network interactions through the threat management facility 100 , where contacting the threat management facility 100 may be performed prior to any other network action.
- the client facility's 144 endpoint computer security facility 152 may manage actions in unprotected network environments such as when the client facility (e.g., client 144 F) is in a secondary location 108 or connecting wirelessly to a non-enterprise facility 102 wireless Internet connection, where the endpoint computer security facility 152 may dictate what actions are allowed, blocked, modified, or the like.
- the endpoint computer security facility 152 may inform the user of such, and recommend that the connection not be made.
- the endpoint computer security facility 152 may perform specific actions during or after the unprotected connection is made, including running scans during the connection period, running scans after the connection is terminated, storing interactions for subsequent threat and policy evaluation, contacting the threat management facility 100 upon first instance of a secured connection for further actions and or scanning, restricting access to network and local resources, or the like.
- the endpoint computer security facility 152 may perform specific actions to remediate possible threat incursions or policy violations during or after the unprotected connection.
- the secondary location 108 may have no endpoint computer security facilities 152 as a part of its computer components, such as its firewalls 138 B, servers 142 B, clients 144 G, hubs and routers 148 C-D, and the like.
- the computer components of the secondary location 108 may be open to threat attacks, and become potential sources of threats, as well as any mobile enterprise facility clients 144 B-F that may be connected to the secondary location's 108 network. In this instance, these computer components may now unknowingly spread a threat to other components connected to the network.
- Some threats may not come directly from the Internet 154 , such as from non-enterprise facility controlled mobile devices that are physically brought into the enterprise facility 102 and connected to the enterprise facility 102 client facilities.
- the connection may be made from direct connection with the enterprise facility's 102 client facility, such as through a USB port, or in physical proximity with the enterprise facility's 102 client facility such that a wireless facility connection can be established, such as through a Bluetooth connection.
- These physical proximity threats 110 may be another mobile computing device, a portable memory storage device, a mobile communications device, or the like, such as CDs and DVDs, memory sticks, flash drives, external hard drives, cell phones, PDAs, MP3 players, digital cameras, point-to-point devices, digital picture frames, digital pens, navigation devices, tablets, appliances, and the like.
- a physical proximity threat 110 may have been previously infiltrated by network threats while connected to an unprotected network connection outside the enterprise facility 102 , and when connected to the enterprise facility 102 client facility, pose a threat.
- physical proximity threats 110 may infiltrate computing resources in any location, such as being physically brought into the enterprise facility 102 site, connected to an enterprise facility 102 client facility while that client facility is mobile, plugged into an unprotected client facility at a secondary location 108 , and the like.
- a mobile device once connected to an unprotected computer resource, may become a physical proximity threat 110 .
- the endpoint computer security facility 152 may provide enterprise facility 102 computing resources with threat protection against physical proximity threats 110 , for instance, through scanning the device prior to allowing data transfers, through security validation certificates, through establishing a safe zone within the enterprise facility 102 computing resource to transfer data into for evaluation, and the like.
- FIG. 2 illustrates a computer system.
- the computer system 200 may include a computing device 210 connected to a network 202 , e.g., through an external device 204 .
- the computing device 210 may be or include any type of network endpoint or endpoints as described herein, e.g., with reference to FIG. 1 above.
- the computing device 210 may include a desktop computer workstation.
- the computing device 210 may also or instead be any device suitable for interacting with other devices over a network 202 , such as a laptop computer, a desktop computer, a personal digital assistant, a tablet, a mobile phone, a television, a set top box, a wearable computer, and the like.
- the computing device 210 may also or instead include a server such as any of the servers described herein.
- the computing device 210 may be used for any of the entities described in the threat management environment described above with reference to FIG. 1 .
- the computing device 210 may be part of or may include a client an enterprise facility, a threat management facility, or any of the other facilities or computing devices described therein.
- the computing device 210 may be implemented using hardware or a combination of software and hardware.
- the computing device 210 may be a standalone device, a device integrated into another entity or device, a platform distributed across multiple entities, or a virtualized device executing in a virtualization environment.
- the network 202 may include any network described above, e.g., data network(s) or internetwork(s) suitable for communicating data and control information among participants in the computer system 200 .
- This may include public networks such as the Internet, private networks, and telecommunications networks such as the Public Switched Telephone Network or cellular networks using third generation cellular technology (e.g., 3G or IMT-2000), fourth generation cellular technology (e.g., 4G, LTE.
- third generation cellular technology e.g., 3G or IMT-2000
- fourth generation cellular technology e.g., 4G, LTE.
- the network 202 may also include a combination of data networks, and need not be limited to a strictly public or private network.
- the external device 204 may be any computer or other remote resource that connects to the computing device 210 through the network 202 .
- This may include threat management resources such as any of those contemplated above, gateways or other network devices, remote servers or the like containing content requested by the computing device 210 , a network storage device or resource, a device hosting malicious content, or any other resource or device that might connect to the computing device 210 through the network 202 .
- the computing device 210 may include a processor 212 , a memory 214 , a network interface 216 , a data store 218 , and one or more input/output interfaces 220 .
- the computing device 210 may further include or be in communication with peripherals 222 and other external input/output devices that might connect to the input/output interfaces 220 .
- the processor 212 may be any processor or other processing circuitry capable of processing instructions for execution within the computing device 210 or computer system 200 .
- the processor 212 may include a single-threaded processor, a multi-threaded processor, a multi-core processor and so forth.
- the processor 212 may be capable of processing instructions stored in the memory 214 or the data store 218 .
- the memory 214 may store information within the computing device 210 .
- the memory 214 may include any volatile or non-volatile memory or other computer-readable medium, including without limitation a Random-Access Memory (RAM), a flash memory, a Read Only Memory (ROM), a Programmable Read-only Memory (PROM), an Erasable PROM (EPROM), registers, and so forth.
- RAM Random-Access Memory
- ROM Read Only Memory
- PROM Programmable Read-only Memory
- EPROM Erasable PROM
- registers and so forth.
- the memory 214 may store program instructions, program data, executables, and other software and data useful for controlling operation of the computing device 210 and configuring the computing device 210 to perform functions for a user.
- the memory 214 may include a number of different stages and types of memory for different aspects of operation of the computing device 210 .
- a processor may include on-board memory and/or cache for faster access to certain data or instructions, and a separate, main memory or the like may be included to expand memory capacity as desired. All such memory types may be a part of the memory 214 as contemplated herein.
- the memory 214 may, in general, include a non-volatile computer readable medium containing computer code that, when executed by the computing device 210 creates an execution environment for a computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of the foregoing, and that performs some or all of the steps set forth in the various flow charts and other algorithmic descriptions set forth herein. While a single memory 214 is depicted, it will be understood that any number of memories may be usefully incorporated into the computing device 210 .
- a first memory may provide non-volatile storage such as a disk drive for permanent or long-term storage of files and code even when the computing device 210 is powered down.
- a second memory such as a random-access memory may provide volatile (but higher speed) memory for storing instructions and data for executing processes.
- a third memory may be used to improve performance by providing higher speed memory physically adjacent to the processor 212 for registers, caching and so
- the network interface 216 may include any hardware and/or software for connecting the computing device 210 in a communicating relationship with other resources through the network 202 .
- This may include remote resources accessible through the Internet, as well as local resources available using short range communications protocols using, e.g., physical connections (e.g., Ethernet), radio frequency communications (e.g., WiFi), optical communications, (e.g., fiber optics, infrared, or the like), ultrasonic communications, or any combination of these or other media that might be used to carry data between the computing device 210 and other devices.
- the network interface 216 may, for example, include a router, a modem, a network card, an infrared transceiver, a radio frequency (RF) transceiver, a near field communications interface, a radio-frequency identification (RFID) tag reader, or any other data reading or writing resource or the like.
- a router for example, include a router, a modem, a network card, an infrared transceiver, a radio frequency (RF) transceiver, a near field communications interface, a radio-frequency identification (RFID) tag reader, or any other data reading or writing resource or the like.
- RF radio frequency
- RFID radio-frequency identification
- the network interface 216 may include any combination of hardware and software suitable for coupling the components of the computing device 210 to other computing or communications resources.
- this may include electronics for a wired or wireless Ethernet connection operating according to the IEEE 802.11 standard (or any variation thereof), or any other short or long range wireless networking components or the like.
- This may include hardware for short range data communications such as Bluetooth or an infrared transceiver, which may be used to couple to other local devices, or to connect to a local area network or the like that is in turn coupled to a data network 202 such as the Internet.
- This may also or instead include hardware/software for a WiMax connection or a cellular network connection (using, e.g., CDMA, GSM, LTE, or any other suitable protocol or combination of protocols).
- the network interface 216 may be included as part of the input/output devices 220 or vice-versa.
- the data store 218 may be any internal memory store providing a computer-readable medium such as a disk drive, an optical drive, a magnetic drive, a flash drive, or other device capable of providing mass storage for the computing device 210 .
- the data store 218 may store computer readable instructions, data structures, program modules, and other data for the computing device 210 or computer system 200 in a non-volatile form for subsequent retrieval and use.
- the data store 218 may store without limitation one or more of the operating system, application programs, program data, databases, files, and other program modules or other software objects and the like.
- the input/output interface 220 may support input from and output to other devices that might couple to the computing device 210 .
- This may, for example, include serial ports (e.g., RS-232 ports), universal serial bus (USB) ports, optical ports, Ethernet ports, telephone ports, audio jacks, component audio/video inputs, HDMI ports, and so forth, any of which might be used to form wired connections to other local devices.
- serial ports e.g., RS-232 ports
- USB universal serial bus
- Ethernet ports e.g., Ethernet ports, telephone ports, audio jacks, component audio/video inputs, HDMI ports, and so forth, any of which might be used to form wired connections to other local devices.
- This may also or instead include an infrared interface, RF interface, magnetic card reader, or other input/output system for coupling in a communicating relationship with other local devices.
- network interface 216 for network communications is described separately from the input/output interface 220 for local device communications, these two interfaces may be the same, or may share functionality, such as where a USB port is used to attach to a WiFi accessory, or where an Ethernet connection is used to couple to a local network attached storage.
- a peripheral 222 may include any device used to provide information to or receive information from the computing device 200 .
- This may include human input/output (I/O) devices such as a keyboard, a mouse, a mouse pad, a track ball, a joystick, a microphone, a foot pedal, a camera, a touch screen, a scanner, or other device that might be employed by the user 230 to provide input to the computing device 210 .
- This may also or instead include a display, a speaker, a printer, a projector, a headset or any other audiovisual device for presenting information to a user.
- the peripheral 222 may also or instead include a digital signal processing device, an actuator, or other device to support control or communication to other devices or components.
- peripheral 222 may serve as the network interface 216 , such as with a USB device configured to provide communications via short range (e.g., BlueTooth, WiFi, Infrared, RF, or the like) or long range (e.g., cellular data or WiMax) communications protocols.
- the peripheral 222 may provide a device to augment operation of the computing device 210 , such as a global positioning system (GPS) device, a security dongle, or the like.
- GPS global positioning system
- the peripheral may be a storage device such as a flash card, USB drive, or other solid state device, or an optical drive, a magnetic drive, a disk drive, or other device or combination of devices suitable for bulk storage. More generally, any device or combination of devices suitable for use with the computing device 200 may be used as a peripheral 222 as contemplated herein.
- Other hardware 226 may be incorporated into the computing device 200 such as a co-processor, a digital signal processing system, a math co-processor, a graphics engine, a video driver, and so forth.
- the other hardware 226 may also or instead include expanded input/output ports, extra memory, additional drives (e.g., a DVD drive or other accessory), and so forth.
- a bus 232 or combination of busses may serve as an electromechanical platform for interconnecting components of the computing device 200 such as the processor 212 , memory 214 , network interface 216 , other hardware 226 , data store 218 , and input/output interface. As shown in the figure, each of the components of the computing device 210 may be interconnected using a system bus 232 or other communication mechanism for communicating information.
- Methods and systems described herein may be realized using the processor 212 of the computer system 200 to execute one or more sequences of instructions contained in the memory 214 to perform predetermined tasks.
- the computing device 200 may be deployed as a number of parallel processors synchronized to execute code together for improved performance, or the computing device 200 may be realized in a virtualized environment where software on a hypervisor or other virtualization management facility emulates components of the computing device 200 as appropriate to reproduce some or all of the functions of a hardware instantiation of the computing device 200 .
- the techniques for forensic analysis for computer processes may be implemented by the threat management facility 100 described with reference to FIG. 1 , e.g., for one or more endpoints included on an enterprise facility 102 .
- the forensic analysis techniques may utilize any of the features of the threat management facility 100 described with reference to FIG. 1 , e.g., the detection techniques 130 .
- the techniques for forensic analysis for computer processes may also or instead be used for a computing device 210 as described with reference to FIG. 2 above.
- Forensic analysis for computer processes may include a root cause analysis—e.g., determining and analyzing an origin or root cause of a piece of malware.
- Techniques may include monitoring activity for one or more endpoints and recording the activity in a data recorder or the like.
- the data recorder may include a database or data store.
- the data recorder may act as a rolling buffer, e.g., storing a large amount of data for predetermined time windows before overwriting old data with new data.
- the data recorder may collect information about device activity, such as file creations, process creations, registry changes, memory injections, and so forth.
- a beacon or trigger event when a beacon or trigger event is detected (e.g., an event pertinent to computer or network security), information from the data recorder may be analyzed (e.g., starting at the trigger event) to determine a root cause and to determine affected computing objects.
- Existing compromise detection techniques such as host intrusion prevention, malicious traffic detection, uniform resource locator (URL) blocking, file-based detection, and so on, may be used to detect the beacon or trigger event.
- techniques for forensic analysis for computer processes may be combined with other malware and compromise prevention, detection, analysis, and remediation techniques such as any as described herein.
- An event graph may be generated showing connected events that are causally related to the detected event, e.g., based on one or more rules. Based on an analysis of these causally related events, the root cause of a detected event can be determined, and affected events going forward from the root cause can similarly be identified.
- FIG. 3 illustrates a system for forensic analysis for computer processes.
- the system 300 may include an endpoint 310 containing a data recorder 320 , a monitoring facility 330 , and any number of objects 312 and events 314 .
- An analysis facility 340 may be coupled in a communicating relationship with the endpoint 310 over a data network 350 such as any of the networks described above.
- a data network 350 such as any of the networks described above.
- certain components of the system 300 such as the data recorder 320 and the monitoring facility 330 and the analysis facility may also or instead be realized as remote services instantiated on a virtual appliance, a public or private cloud, or the like, any of which may be coupled to the endpoint 310 through the data network 350 or another communication channel (not shown).
- Each of the components of the system 300 may be configured with suitable programming and configuration to participate in the various forensic techniques, threat detection techniques, and security management techniques contemplated herein.
- the endpoint 310 may be any of the endpoints described herein, e.g., a computing device in an enterprise network, or any other device or network asset that might join or participate in an enterprise or otherwise operate on an enterprise network.
- This may, for example, include a server, a client device such as a desktop computer or a mobile computing device (e.g., a laptop computer or a tablet), a cellular phone, a smart phone, or other computing device suitable for participating in the system 300 or in an enterprise.
- the endpoint 310 may include any number of computing objects 312 , which may for example, be processes executed by one or more processors or other processing circuitry, files or data stored in memory, or any other computing objects described herein.
- object has a number of specific meanings in the art, and in particular in object-oriented programming, it will be understood that the term ‘object’ as used herein is intended to be significantly broader, and may include any data, process, file or combination of these including without limitation any process, application, executable, script, dynamic linked library (DLL), file, data, database, data source, data structure, function, resource locator (e.g., uniform resource locator (URL) or other uniform resource identifier (URI)), or the like that might be resident on the endpoint 310 and manipulated by the endpoint 310 or another component of the system 300 or other systems described elsewhere herein.
- DLL dynamic linked library
- resource locator e.g., uniform resource locator (URL) or other uniform resource identifier (URI)
- the object 312 may also or instead include a remote resource, such as a resource identified in a URL. That is, while the object 312 in the figure is depicted as residing on the endpoint 310 , an object 312 may also reside elsewhere in the system 300 , and may be specified for example with a link, pointer, or reference that is locally stored on the endpoint 310 .
- the object 312 may be an item that is performing an action or causing an event 314 , or the object 312 may be an item that is receiving the action or is the result of an event 314 (e.g., the object 312 may be an item in the system 300 being acted upon by an event 314 or another object 312 ).
- an event 314 as contemplated herein may be any data flow, execution flow, control flow, network flow, or other similar action or event that might causally relate objects 312 to one another.
- the object 312 is data or includes data
- the object 312 may be encrypted or otherwise protected, or the object 312 may be unencrypted or otherwise unprotected.
- the object 312 may be a process or other computing object that performs an action, which may include a single event 314 or a collection or sequence of events 314 taken by a process.
- the object 312 may also or instead include an item such as a file or lines of code that are executable to perform such actions.
- the object 312 may also or instead include a computing component upon which an action is taken, e.g., a system setting (e.g., a registry key or the like), a data file, a URL, and so forth.
- the object 312 may exhibit a behavior such as an interaction with another object or a component of the system 300 .
- Objects 312 may be described in terms of persistence.
- the object 312 may, for example, be a part of a process, and remain persistent as long as that process is alive.
- the object 312 may instead be persistent across an endpoint 310 and remain persistent as long as an endpoint 310 is active or alive.
- the object 312 may instead be a global object having persistence outside of an endpoint 310 , such as a URL or a data store. In other words, the object 312 may be a persistent object with persistence outside of the endpoint 310 .
- an object 312 may contain software associated with an advanced persistent threat (APT) or other malware that resides partially or entirely on the endpoint 310 .
- APT advanced persistent threat
- This associated software may have reached the endpoint 310 in a variety of ways, and may have been placed manually or automatically on the endpoint 310 by a malicious source.
- the associated software may take any number of forms and have any number of components.
- the associated software may include an executable file that can execute independently, or the associated software may be a macro, plug-in, or the like that executes within another application.
- the associated software may manifest as one or more processes or threads executing on the endpoint 310 . Further, the associated software may install from a file on the endpoint 310 (or a file remote from the endpoint 310 ), and the associated software may create one or more files such as data files or the like while executing. Associated software should be understood to generally include all such files and processes except where a specific file or process is more specifically noted.
- An event 314 may include an action, a behavior, an interaction, and so forth.
- the event 314 may be generated by or otherwise related to an object 312 .
- the event 314 may be associated with a file and include an action such as a read, a write, an open, a move, a copy, a delete, and so forth.
- the event 314 may also or instead include an inter-process communication, e.g., a create, a handle, a debug, a remote injection, and so forth.
- the event 314 may also or instead include a network action such as accessing an Internet Protocol (IP) address or URL.
- IP Internet Protocol
- the data recorder 320 may monitor and record activity related to the objects 312 and events 314 occurring on the endpoint 310 .
- the activity of the endpoint 310 may be stored in a data log 322 or the like on the data recorder 320 , which may be stored locally on the endpoint 310 (as depicted) or remotely at a threat management resource, or some combination of these, such as where the data log 322 is periodically transmitted to a remote facility for archiving or analysis.
- the data recorder 320 may continuously record any activity occurring on the endpoint 310 for predetermined periods of time before overwriting previously recorded data.
- the data log 322 may include a continuous data feed of events 314 .
- the data log 322 may be saved and transmitted to an analysis facility 340 or the like for analysis, e.g., to determine a root cause of the beacon or trigger event.
- the data log 322 may be used to create an event graph or other snapshot of the activity on the endpoint 310 , e.g., for a period of time surrounding a beacon or trigger event.
- the beacon or trigger event may be detected locally by the monitoring facility 330 , or remotely by a remote threat management facility or the like, or some combination of these.
- the data recorder 320 may also or instead be implemented at a remote location such as a threat management facility or other enterprise network security resource, or some combination of these.
- the data recorder 320 may be provisioned on the same or a different device than a data store in which data is stored.
- the data recorder 320 may be configured to record data as efficiently as possible so as to minimize impact on the endpoint 310 .
- the monitoring facility 330 may work in conjunction with the data recorder 320 to instrument the endpoint 310 so that any observable events 314 by or involving various objects 312 can be monitored and recorded. It will be appreciated that various filtering rules and techniques may be used to synopsize, summarize, filter, compress or otherwise process information captured by the data recorder 320 to help ensure that relevant information is captured while maintaining practical limits on the amount of information that is gathered.
- a security product 332 may execute on the endpoint 310 to detect a security event on the endpoint 310 , which may act as the beacon or trigger event for the system 300 .
- the security product 332 may use techniques such as signature-based and behavioral-based malware detection including without limitation one or more of host intrusion prevention, malicious traffic detection, URL blocking, file-based detection, and so forth.
- the beacon or trigger event on the endpoint 310 may be a fully qualified (e.g., definitive) detection of a compromise or other malicious activity.
- the beacon or trigger event on the endpoint 310 may be a suspicious behavior that is suspicious but not confirmed as malicious.
- the beacon or trigger event on the endpoint 310 may signal an unusual behavior that is known to commonly appear concurrently with the detection of malware.
- the data log 322 may be analyzed differently than when the beacon or trigger event is a confirmed malicious behavior. For example, the data log 322 may be sent to a different component of the system 300 through the network, e.g., to a different analysis facility 340 .
- the monitoring facility 330 may be disposed remotely from the endpoint 310 or analysis facility 340 .
- the monitoring facility 330 may be included on one or more of the endpoint 310 or analysis facility 340 .
- the monitoring facility 330 and the analysis facility 340 included in the same component.
- the analysis facility 340 may analyze the data log 322 , e.g., as part of a root cause analysis and to identify objects 312 compromised by the root cause. To this end, the analysis facility 340 may utilize one or more rules 342 for applying to the data included in the data log 322 to determine a root cause of a beacon or trigger event such as a suspected or actual security compromise on the endpoint 310 .
- the analysis facility 340 may reside locally on the endpoint 310 (e.g., be a part of, embedded within, or locally coupled to the endpoint 310 ).
- the analysis facility 340 may be an external facility, or it may reside in a virtual appliance (e.g., which could be run by a protected set of systems on their own network systems), a private cloud, a public cloud, and so forth.
- the analysis facility 340 may store locally-derived threat information for use in subsequent identification, remediation, or other similar activity.
- the analysis facility 340 may also or instead receive threat information from a third-party source such as any public, private, educational, or other organization that gathers information on network threats and provides analysis and threat detection information for use by others. This third-party information may, for example, be used to improve detection rules or other forensic analysis that might be performed on information in the data log 322 .
- the analysis facility 340 may create an event graph.
- the event graph may represent information in the data log 322 in a graph where objects 312 are nodes and events 314 are edges connecting the nodes to one another based on causal or other relationships as generally contemplated herein.
- the event graph may be used by the analysis facility 340 or other component(s) of the system 300 as part of a root cause analysis and to identify objects 312 compromised by the root cause.
- the event graph may also or instead be displayed to a user of the system 300 or endpoint 310 , e.g., using an interactive user interface or the like.
- the system 300 may advantageously use the data log 322 to configure and initialize an analysis in a sandboxed or otherwise isolated environment where the execution of the recorded activity related to a detected security event is allowed to run. That is, rather than uploading a complete image of an endpoint 310 using conventional techniques, the data log 322 may include only a series of events/processes related to the detected event that may be uploaded for execution/analysis. The analysis may thus include executing this series of events/processes in the same order to determine a threat level for the endpoint 310 .
- the data log 322 may include data from a single endpoint 310 , or from a number of endpoints 310 , for example where one endpoint 310 accesses a service or a file on another endpoint. This advantageously facilitates tracking or detection of potentially malicious activity that spans multiple devices, particularly where the behavior on a single endpoint does not appear malicious.
- the monitoring facility 330 may monitor activity from an endpoint 310 exclusively, or use the full context of activity from all protected endpoints 310 , or some combination of these.
- the event graph generated from the data log 322 may include activity from one endpoint 310 exclusively, or use the full context of activity from all protected endpoints 310 , or some combination of these.
- Data logs 322 and event graphs may also or instead be stored for future analyses, e.g., for comparing to future data logs and event graphs.
- the events may include human interactions such as keyboard strokes, mouse clicks or other input and output to human interface devices and hardware. This usefully permits discrimination within causal chains among events initiated by processes executing on a device and events that are initiated or controlled by a human user that is present on the endpoint.
- FIG. 4 is a flowchart of a method for forensic analysis for computer processes.
- the method 400 may be implemented by any of the systems described above or otherwise herein.
- the method 400 may be used as part of a root cause analysis, e.g., for determining a root cause of malware on an endpoint, and for identifying computing objects affected by malware, e.g., computing objects causally related to the root cause.
- the method 400 may include monitoring events on a device, such as a first endpoint.
- the events may be any as described herein, e.g., events associated with computing objects on the endpoint.
- the computing objects may, for example include a data file, a process, an application, a registry entry, a network address, a peripheral device, or any of the other computing objects described herein.
- the computing objects may include one or more network addresses specified at any suitable level of abstraction or according to any suitable protocol such as a uniform resource locator (URL), an Internet Protocol (IP) address, and a domain name, and may include any or a portion of associated path information or the like that might be associated therewith.
- URL uniform resource locator
- IP Internet Protocol
- the computing objects may also or instead include a peripheral device such as a universal serial bus (USB) memory, a camera, a printer, a memory card, a removable bulk storage device, a keyboard, a mouse, a track pad, a printer, a scanner, a cellular phone, or any other input or output device that might usefully be connected to an endpoint, a server, a mobile device, and so forth.
- a peripheral device such as a universal serial bus (USB) memory, a camera, a printer, a memory card, a removable bulk storage device, a keyboard, a mouse, a track pad, a printer, a scanner, a cellular phone, or any other input or output device that might usefully be connected to an endpoint, a server, a mobile device, and so forth.
- Events may include information or messages from a threat management facility, firewall, network device, and so on, for example, that may be resident on or in communication with an endpoint.
- a threat management facility may identify a potential or actual
- monitoring events on a first endpoint may include instrumenting a first endpoint to monitor a number of causal relationships among a number of computing objects.
- a monitoring facility or other monitoring component e.g., a component disposed on the first endpoint or otherwise in communication with the first endpoint
- a processor and a memory disposed on the endpoint may be configured to monitor events on the endpoint.
- a remote server may also or instead be configured to monitor events on the endpoint, for example, to create a data log as contemplated herein.
- Implementations may also or instead include monitoring events on multiple endpoints, e.g., endpoints included in an enterprise network or the like.
- the one or more computing objects include at least one or more computing object(s) on a device other than the first endpoint, such as a second endpoint in the enterprise network.
- the device may also or instead include a server configured to provide remote resources to other endpoints, network devices, firewalls, gateways, routers, wireless access points, mobile devices, and so forth.
- the causal relationships monitored by the system may include dependencies that form a link or an association between computing objects or events.
- Useful causal relationships may include a data flow, e.g., linking computing objects based on the flow of data from one computing object to another computing object.
- the causal relationships may also or instead include a control flow.
- a first computer program may generate a first event that triggers a second computer program to trigger a second event, thereby creating a causal relationship between the first computer program and the second computer program (and possibly a causal relationship between the first event and the second event).
- the causal relationships may include a network flow.
- a computing object may access a URL or other remote resource or location and receive data.
- causal relationship there may be a causal relationship between one or more of the computing object, the URL, and the data.
- causal relationship and the like is intended to cover a wide range of relationships between computing objects that might be formed by events, and unless explicitly stated to the contrary or otherwise clear from the text, the causal relationships may include anything that can link or associate multiple computing objects (of the same type or different types), e.g., in a directional manner, directly or indirectly.
- the method 400 may include recording events such as any of the events described above that occur on the endpoint.
- each event detected during monitoring may be recorded, e.g., by a data recorder or other component, to provide a data log including a sequence of events causally relating the number of computing objects.
- the data recorder may be configured to record events that occur on the endpoint, or events that occur on a plurality of endpoints.
- the data recorder may be locally disposed on the endpoint or otherwise in communication with the endpoint.
- the data recorder may also or instead be associated with a monitoring facility or an analysis facility such as any of those described above.
- the data recorder may record a sequence of events causally relating a number of computing objects on one or more endpoints in a data log or the like disposed in a memory.
- a number of events within the sequence of events may be preserved for a predetermined time window.
- a data recorder or the like may record all activity on an endpoint in a rolling buffer that overwrites data that is older than the predetermined time window. This may be true regardless of the types of computing objects associated with the sequence of events.
- the predetermined time window may have a different duration for different types of computing objects (e.g., for at least two types of computing objects).
- the sequence of events may be preserved for a longer predetermined time window relative to a sequence of events associated with data files, or vice-versa.
- the sequence of events may be preserved for longer predetermined time window relative to a sequence of events associated with applications, or vice-versa.
- the predetermined time window for which the sequence of events is preserved may be based on the likelihood of a security event originating from a certain type of computing object. For example, the reputation of a computing object (e.g., an application) or a machine state may be used for determining the duration of the predetermined time window for which the sequence of events is preserved.
- the predetermined time window for which the sequence of events is preserved may be determined by a color of a computing object or event, e.g., as described in U.S. patent application Ser. No.
- the time window for which the sequence of events is preserved may be variable or adjustable.
- a user or administrator using a user interface or the like may adjust the time window for which the sequence of events is preserved, e.g., based on computing object type or otherwise.
- one or more first event types may be recorded with a first time window and one or more second event types may be recorded with a second time window.
- the data recorder or the like may record only certain activity on an endpoint, e.g., activity associated with predetermined computing objects. The activity may be preserved for a predetermined amount of time dependent upon the specific computing object to which the activity is associated.
- the data recorder or the like may include a record of data for one week for applications, for three months for files, for two weeks for registry entries, and so forth. It will be understood that these timeframes are provided by way of example and not of limitation.
- data may be continuously recorded, periodically recorded, or some combination of these.
- data may be cached, stored, deleted or transmitted to a remote processing facility in any suitable manner consistent with appropriate use of local and remote resources, and the utility or potential utility of information that is being recorded.
- data may be periodically deleted or otherwise removed from the data recorder, such as after a security event has been detected and addressed as described below.
- a new data log may then be created for recording subsequent events on the one or more endpoints.
- the method 400 may include evaluating one or more events that occur on the endpoint.
- the evaluation of the one or more events may include the application of one or more security rules to determine whether the one or more events indicate or suggest a security event such as a security compromise event, a data exposure, a malware detection, or the like.
- a security event such as a security compromise event, a data exposure, a malware detection, or the like.
- this step 406 may be performed concurrently with or in sequence with the monitoring step 402 discussed above.
- the security event may be any beacon or trigger event, such as any of those discussed herein.
- the security event may include an event that is related to network security, computer security, data security, data leakage, data exposure, or any other actual or potential security issue.
- the security event may also or instead include other events of interest that are not directly related to computer/network security where, for example, they are useful for otherwise auditing or monitoring machines or characterizing device behavior.
- the security event may be any event general related to operation of a computer, and does not necessarily include an actual security compromise event.
- the security event may include an actual compromise to a network, an endpoint, or a computer system such as the detection of malware or any other threat detection.
- the security event may be a security compromise event related to a specific threat, e.g., an event related to computer-based malware including without limitation a virus, spyware, adware, a Trojan, an intrusion, an advanced persistent threat, spam, a policy abuse, an uncontrolled access, and so forth.
- a security compromise event related to a specific threat
- e.g., an event related to computer-based malware including without limitation a virus, spyware, adware, a Trojan, an intrusion, an advanced persistent threat, spam, a policy abuse, an uncontrolled access, and so forth.
- Detecting the security event may include detecting a security compromise by applying a static analysis to software objects on the first endpoint. For example, each software object may be individually analyzed for its compliance with a security policy or the like using signatures or other objective characteristics. It will be understood that while static analysis provides one useful form of evaluation for compliance with the security policy or the like, other techniques may also or instead be employed, e.g., a behavioral analysis, a sandbox execution, network traffic analysis, and so forth.
- Detecting the security event may also or instead include detecting a security compromise by applying dynamic or behavioral analysis to code executing on the first endpoint, or to specific computing objects (e.g., processes) on the endpoint.
- events that can warrant triggering the detection of the security event may include a process that loads a particular file that is known to be malicious, or a process that accesses a known malicious IP address, and the like.
- detecting the security event may include detecting a hardware change or other state changes. Detecting the security event may also or instead include detecting a potential data leakage.
- a security policy may be used to detect a security event. This may include, for example, whitelists or blacklists of known computing objects and events, or reputations and signatures thereof.
- a security policy may include rules that allow computing objects and events that are provided by a known, trusted source (e.g., a trusted user, endpoint, network, company, vendor, and so forth). The rules may be more complex, for example, where originating from a trusted source is only one factor in determining whether to whitelist computing objects and events.
- the security policy may include any suitable rules, logic, prioritizing, etc., as desired to detect a security event.
- a security policy may also or instead include other types of policies.
- a security policy may include a corporate or network policy having a list of approved computing objects and events, where computing objects and events outside of this list may not necessarily be security risks, but are otherwise unwanted in the network.
- the security policy may intend to detect malware and the like, while also detecting other types of unwanted computing objects and events that do not qualify as malware.
- any technique or combination of techniques suitable for evaluating endpoint activity for the detection of actual or potential security compromises may be used to detect security events as contemplated herein.
- step 408 if a security event is not detected, the method 400 may return to step 402 where monitoring can continue.
- a root cause analysis or the like may be performed to identify a source of the security event as further described below. That is, detecting a security event associated with one of the number of computing objects may trigger further analysis of other causally related computing objects on an endpoint (or in certain cases, remote from an endpoint) to identify a cause of the security event, as distinguished from the symptom that generated the beacon or trigger for the analysis.
- the method 400 may include generating an event graph.
- the event graph may be generated in response to detecting the security event, e.g., using the data log from the data recorder.
- the event graph may be generated at the same time as or as part of creating the data log.
- the event graph may include the sequence of events causally relating the number of computing objects, and more specifically, the sequence of events and computer objects causally associated with the object(s) that triggered the detected security event.
- the event graph may be generated based on a data log of events and computer objects stored by a data recorder during operation of the endpoint.
- the data recorder may provide a dump of logged activities, which may be causally associated into a graph for analysis, navigation, display and so forth. Any useful portion of the data log may be used.
- the data recorder may provide event data for a window of time before, after or surrounding the detected security event.
- the data log may be filtered, e.g., when the data is written to the data log (for example, by aging events as described above) or when the event graph is generated, or some combination of these. A variety of filtering techniques may be usefully employed.
- certain types of objects or events may be removed from an event graph for specific trigger events, or certain groups of events may be condensed into a single event, such as all normal activity that occurs when a user logs into an endpoint.
- computing objects that are too remote may be pruned and removed, particularly if they have a known, low diagnostic significance.
- the event graph may be filtered and condensed in a variety of manners to obtain a useful snapshot of events optimized for root cause analytics. Filtering of the data may be dependent upon the type of security event that is detected. Filtering of the data may adjust the level of detail included in the event graph based on memory limits, user parameters, security event type, or any other object metrics or inputs.
- the data is filtered based on reputation or the like, e.g., of computing objects included therein. For example, if an application has a good reputation, the application may not include a high level of detail associated therewith in a filtered version of the data log.
- the event graph may be generated based on a data log from a number of different endpoints and thus may represent a causal chain of data from various different endpoints.
- This approach advantageously permits an analysis using data that spans multiple endpoints or other network devices within a single data structure or package, thus permitting identification of a root cause even when an attack employs a complex, multi-hop approach to network assets that might otherwise evade detection.
- Event graphs may also or instead be generated separately for different endpoints and presented to a user or analytical system as separate, discrete entities. Event graphs for endpoints may be compared with one another, e.g., as part of the root cause analysis.
- event graphs for different endpoints in the same network enterprise may be compared or combined, e.g., where two or more endpoints have been exposed to a security event or threat.
- event graphs for similar time periods of two or more endpoints may be ascertained and analyzed.
- cross-correlating between different data logs or event graphs may be utilized in a root cause analysis. For example, if the same security event or root cause is identified on different endpoints, the endpoints may be flagged for review or remediation. This type of analysis may be used on different endpoints throughout a network.
- Implementations may include a number of different event graphs stored in a data store that can be used together to detect, prevent, or determine the root causes for suspicious activity or other activity of interest, e.g., a security event.
- the event graphs may be filtered before being stored in the data store, which can remove system activity that is not of interest in such analyses.
- the event graphs may be searchable, e.g., for analysis of event graphs including similar computing objects or events.
- the event graphs may also or instead be linked to one another, e.g., event graphs including similar computing objects or events.
- the event graphs may be presented to a user on a user interface or the like, e.g., an interactive user interface that allows a user to see similar or related event graphs, search the event graphs, link between event graphs, and so forth.
- An event graph may use a conventional structure of nodes (computing objects) and events (edges) to represent causal relationships among computing objects. This permits the use of a wide range of graph-based techniques to assist in analysis of the context leading up to a detected event.
- nodes computing objects
- edges events
- numerous other data structures, computer representations, and visual representations of such interrelated objects and events are also known in the art, any of which may be employed as an event graph as contemplated herein, provided that enough descriptive data about the context of an endpoint is captured to facilitate the various types of analysis and response contemplated herein.
- the method 400 may include, in response to detecting the security event, traversing the event graph based on the sequence of events in a reverse order from the one of the computing objects associated with the security event to one or more preceding ones of the computing objects.
- the reverse order is a causally reverse order. For example, where a network flow, data flow or control flow has a direction from one computing object to another computing object, the reverse order will follow this flow or causal link from the receiving computing object backward toward the source computing object.
- this may also or instead include a chronological flow, such as in a complex event graph where the time of receipt for two different inputs from two different sources is relevant.
- a review of each of the preceding computing objects may be conducted by working backward from the computing object associated with the security event, e.g., to determine a root cause of the security event.
- this may include a static analysis of each of the preceding computing objects, or a dynamic analysis of object and event interactions, or some combination of these.
- the method 400 may include applying one or more rules to the computing objects preceding the security event.
- the method 400 may include applying a cause identification rule to the preceding ones of the computing objects and the causal relationships while traversing the event graph in order to identify one of the computing objects as a cause of the security event.
- the root cause analysis may attempt to identify a pattern in the event graph using cause identification rules to identify one of the computing objects (or a group of the computing objects and events) as a root cause of the security event.
- the cause identification rule may associate the cause with one or more common malware entry points.
- common entry points include a word processing application, an electronic mail application, a spreadsheet application, a browser, or a universal serial bus (USB) drive that is attached to an endpoint, and any of these computing objects, when encountered in an event graph, may be identified as a root cause.
- USB universal serial bus
- the analysis when traversing the event graph in a reverse order from the security event, if the analysis identifies a USB drive, or an unsecure or unencrypted USB drive, from which a file was opened, this may be identified as a likely cause of the security event.
- multiple candidate root causes may be identified using the cause identification rules, and a final selection may be based on other contextual information such as reputation, source, etc.
- Security events may also or instead be caused by a certain combination of events or combinations of events and computing objects.
- the cause identification rule may associate the cause of the security event with a combination that includes a first process invoking a second process and providing data to the second process.
- invoking may be interpreted broadly, e.g., where any two processes share data through an intermediate file, or narrowly, e.g., where a first process specifically spawns the second process as a child process.
- invoking a process as used herein is intended to broadly include any causal relationship between to processes including, e.g., spawning a process, hijacking a process (e.g., seizing control of an existing process through thread injection, process hollowing, and the like), remotely launching a process over a network, instrumenting a service in the operating system, and the like.
- a cause identification rule may specify a particular type of invocation relationship between two processes, or multiple types of invocation, or any relationship between two processes.
- Providing data from a first process to a second process may include creating a file for use by the second process.
- the cause of a security event may include a first process that writes a file and then takes control of a second process that reads data from the file so that the first process and the second process share data through the file.
- a security event may include a known non-malicious application (e.g., a commonplace word processing application) launching a command line script, which may be identified as a cause of a security event.
- a known non-malicious application e.g., a commonplace word processing application
- launching a command line script which may be identified as a cause of a security event.
- the activity underlying events that are generated may not necessarily be malicious, but they could lead to security events or other events of interest to be further analyzed.
- a cause identification rule may flag this behavior as a root cause of a security event, or as an event that is otherwise of diagnostic interest.
- the method 400 may include traversing the event graph forward from an identified or presumed cause of the security event to identify one or more other ones of the computing objects affected by the cause.
- an analysis of each of the computing objects in the event graph may be conducted by working forward from the root cause to other causally dependent computing objects that might be compromised or otherwise affected by the root cause. This may include labeling or otherwise identifying the potentially compromised objects, e.g. for remediation or further analysis.
- a pruning step may also be employed, e.g. where any computing objects that are not causally dependent on the root cause in some way are removed from the event graph.
- the method 400 may include remediating one or more computing objects affected by the cause of the security event.
- Remediation may include deleting computing objects from the endpoint, or otherwise remediating the endpoint(s) using computer security techniques such as any described herein.
- the identification of the root cause may be used to create new detection rules capable of detecting a security event at a point in time (or causation) closer to the root cause within the event graph.
- Other remediation steps may include forwarding the event graph, or a filtered and pruned event graph, to a remote facility for analysis. This data may usefully provide a map for identifying sources of malware, or for ensuring thorough remediation by identifying all of the potentially compromised computing objects that should be examined after the compromise has been addressed.
- FIG. 5 illustrates a graphical depiction of a portion of an example event graph 500 .
- the event graph 500 may include a sequence of computing objects causally related by a number of events, and which provide a description of computing activity on one or more endpoints.
- the event graph 500 may be generated, for example, when a security event 502 is detected on an endpoint, and may be based on a data log or similar records obtained by an event data recorder during operation of the endpoint.
- the event graph 500 may be used to determine a root cause 504 of the security event 502 as generally described above.
- the event graph 500 may also or instead be continuously generated to serve as, or be a part of, the data log obtained by the data recorder.
- an event graph 500 may be obtained and analyzed after a security event 502 occurs to assist in determining its root cause 504 .
- the event graph 500 depicted in the figure is provided by way of example only, and it will be understood that many other forms and contents for event graphs 500 are also or instead possible. It also will be understood that while the figure illustrates a graphical depiction of an event graph 500 , the event graph 500 may be stored in any suitable data structure or combination of data structures suitable for capturing the chain of events and objects in a manner that preserves causal relationships for use in forensics and malware detection as contemplated herein.
- the event graph 500 depicted in the figure begins with a computing object that is a USB device 512 , which may be connected to an endpoint.
- the USB device 512 includes a directory or file system
- the USB device 512 may be mounted or accessed by a file system on an endpoint to read contents.
- the USB device 512 may be detected 513 and contents of the USB device 512 may be opened 514 , e.g., by a user of the endpoint or automatically by the endpoint in response to detection of the USB device 512 .
- the USB device 512 may include one or more files and applications, e.g., a first file 516 , a second file 518 , and a first application 520 .
- the first file 516 may be associated with a first event 522 and the second file may be associated with a second event 524 .
- the first application 520 may access one or more files on the endpoint, e.g., the third file 526 shown in the figure.
- the first application 520 may also or instead perform one or more actions 528 , such as accessing a URL 530 . Accessing the URL 530 may download or run a second application 532 on the endpoint, which in turn accesses one or more files (e.g., the fourth file 534 shown in the figure) or is associated with other events (e.g., the third event 536 shown in the figure).
- the detected security event 502 may include the action 528 associated with the first application 520 , e.g., accessing the URL 530 .
- the URL 530 may be a known malicious URL or a URL or network address otherwise associated with malware.
- the URL 530 may also or instead include a blacklisted network address that although not associated with malware may be prohibited by a security policy of the endpoint or enterprise network in which the endpoint is a participant.
- the URL 530 may have a determined reputation or an unknown reputation. Thus, accessing the URL 530 can be detected through known computing security techniques.
- the event graph 500 may be traversed in a reverse order from a computing object associated with the security event 502 based on the sequence of events included in the event graph 500 . For example, traversing backward from the action 528 leads to at least the first application 520 and the USB device 512 .
- one or more cause identification rules may be applied to one or more of the preceding computing objects having a causal relationship with the detected security event 502 , or to each computing object having a causal relationship to another computing object in the sequence of events preceding the detected security event 502 .
- computing objects and events may be tangentially associated with causally related computing objects when traversing the event graph 500 in a reverse order—such as the first file 516 , the second file 518 , the third file 525 , the first event 522 , and the second event 524 depicted in the figure.
- the one or more cause identification rules are applied to computing objects preceding the detected security event 502 until a cause of the security event 502 is identified.
- the USB device 512 may be identified as the root cause 504 of the security event 502 .
- the USB device 512 was the source of the application (the first application 520 ) that initiated the security event 502 (the action 528 of accessing the potentially malicious or otherwise unwanted URL 530 ).
- the event graph 500 may similarly be traversed going forward from one or more of the root cause 504 or the security event 502 to identify one or more other computing objects affected by the root cause 504 or the security event 502 .
- the first file 516 and the second 518 potentially may be corrupted because the USB device 512 included malicious content.
- any related actions performed after the security event 502 such as any performed by the second application 532 may be corrupted. Further testing or remediation techniques may be applied to any of the computing objects affected by the root cause 504 or the security event 502 .
- the event graph 500 may include one or more computing objects or events that are not located on a path between the security event 502 and the root cause 504 . These computing objects or events may be filtered or ‘pruned’ from the event graph 500 when performing a root cause analysis or an analysis to identify other computing objects affected by the root cause 504 or the security event 502 . For example, computing objects or events that may be pruned from the event graph 500 may include the USB drive 510 and the USB device being detected 513 .
- event graph 500 depicted in FIG. 5 is an abstracted, simplified version of actual nodes and events on an endpoint for demonstration. Numerous other nodes and edges will be present in a working computing environment. For example, when a USB device is coupled to an endpoint, the new hardware will first be detected, and then the endpoint may search for suitable drivers and, where appropriate, present a user inquiry of how the new hardware should be handled. A user may then apply a file system to view contents of the USB device and select a file to open or execute as desired, or an autorun.exe or similar file may be present on the USB device that begins to execute automatically when the USB device is inserted.
- event graph 500 may require multiple operating system calls, file system accesses, hardware abstraction layer interaction, and so forth, all of which may be discretely represented within the event graph 500 , or abstracted up to a single event or object as appropriate.
- event graph 500 depicted in the drawing is intended to serve as an illustrative example only, and not to express or imply a particular level of abstraction that is necessary or useful for root cause identification as contemplated herein.
- the event graph 500 may be created or analyzed using rules that define one or more relationships between events and computing objects.
- the C Language Integrated Production System (CLIPS) is a public domain software tool intended for building expert systems, and may be suitably adapted for analysis of a graph such as the event graph 500 to identify patterns and otherwise apply rules for analysis thereof. While other tools and programming environments may also or instead be employed, CLIPS can support a forward and reverse chaining inference engine suitable for a large amount of input data with a relatively small set of inference rules. Using CLIPS, a feed of new data can trigger a new inference, which may be suitable for dynamic solutions to root cause investigations.
- An event graph such as the event graph 500 shown in the figure may include any number of nodes and edges, where computing objects are represented by nodes and events are represented by edges that mark the causal or otherwise directional relationships between computing objects such as data flows, control flows, network flows and so forth. While processes or files are common forms of nodes that might appear in such a graph, any other computing object such as an IP address, a registry key, a domain name, a uniform resource locator, a command line input or other object may also or instead be designated to be a node in an event graph as contemplated herein.
- edges may be formed by an IP connection, a file read, a file write, a process invocation (parent, child, etc.), a process path, a thread injection, a registry write, a domain name service query, a uniform resource locator access and so forth other edges may be designated.
- the source of the security event may serve as a starting point within the event graph 500 , which may then be traversed backward to identify a root cause using any number of suitable cause identification rules.
- the event graph 500 may then usefully be traversed forward from that root cause to identify other computing objects that are potentially tainted by the root cause so that a more complete remediation can be performed.
- the sequence of events included in a data recorder or event graph may be executed within a sandbox or the like in a similar manner as the sequence of events occurred on the endpoint where a security event was detected. This may be accomplished without replicating the entire action sequence of events on the endpoint, e.g., using only a predetermined time window or a predetermined sequence of events. In this manner, information from the data recorder may be used to replicate the actual order of events and processes that were involved in a security event. This may increase the likelihood of a sample detonating in a useful manner for analyses.
- FIG. 6 shows a method for malware detection using an event graph.
- the event graph proximal to the root cause can be used to detect malware based on the emergence of a similar or identical event graph during malware monitoring. This potentially facilitates earlier detection by permitting detection based on the root cause pattern rather than the (subsequent) beacon that initially triggered the search for a root cause during forensic analysis.
- monitoring may be adapted to a current security context, e.g., by adding more monitoring points or decreasing filtering (e.g., to gather more data at each point) when the security state worsens or there is a perceived increase in security risk.
- the computing objects, events, event graph, and the like described below may be any of those described above with respect to root cause identification, with the characteristics of the root cause applied for prospective malware detection instead of or in addition to retroactive, forensic root cause analysis.
- the method 600 may include instrumenting an endpoint to monitor a number of causal relationships among computing objects at a plurality of logical locations within a computing environment related to the endpoint. Instrumentation may use any suitable techniques for recording data as contemplated herein.
- the computing objects may in general be any hardware or software computing object such as a data file, a database record, a database, a directory, a file system, a file system path, a process, an application, an operating system, a registry or registry entry, a network address, a network path, a peripheral device, a physical device (e.g., a disk drive, optical drive, communications or network interface, keyboard, mouse, sensor, camera, microphone, etc.), and so forth.
- a physical device e.g., a disk drive, optical drive, communications or network interface, keyboard, mouse, sensor, camera, microphone, etc.
- the logical locations may be any corresponding locations of diagnostic interest that might be accessed or used by the computing objects within the computing environment, such as hardware/device interfaces, device drivers, a file system and/or directory, memory (e.g., RAM, cache, processor registers), operating system interfaces, application programming interfaces, network communication ports or interfaces, and any data sources of interest such as credential stores, system registries, system configuration files, and so forth.
- this may include logical locations separate from the endpoint, such as locations on a second physical endpoint separate from the first endpoint, or a web site, file server, mail server, or other remote resource.
- the logical locations may also or instead include a programmatic interface to a human interface device such as a mouse, keyboard, sensor, camera, microphone, or other input/output device.
- the logical locations may also or instead include peripherals or other devices attached to and communicating with the endpoint such as USB memory devices, flash drives, and so forth.
- Monitoring may be performed at various levels of granularity. For example, monitoring may include monitoring of specific memory locations or file locations that are potentially of interest, such as by monitoring reads and/or writes to specific file names, specific directories, and so forth.
- the instrumentation may be configured for variable monitoring. For example, where a high-risk state is detected, filtering may be decreased so that, e.g., a file system or other resource is monitored more aggressively and additional events are captured. This heightened monitoring may be continued for a predetermined window, or until the high-risk state has passed, or indefinitely or until the occurrence of some specific event.
- the instrumentation contemplated herein may include any instrumentation suitable for monitoring causal relationships among computing objects at logical locations within a computing environment for an endpoint.
- the computing environment may be confined to the computing environment on a particular endpoint such as the hardware and software associated with that endpoint.
- the computing environment may more generally include any computing environment related to the endpoint, and may be extended to include other endpoints, remote computing resources such as websites, web servers, file servers, devices such as printers, copiers, watches, televisions, appliances, and so forth. More generally, any other location or resource that might provide logical locations useful for monitoring and diagnostic purposes may be included in the computing environment.
- this may include other endpoints within a local area network or enterprise network used by the endpoint, such as where another endpoint in the enterprise network sends commands or data to the endpoint or receives commands or data from the endpoint.
- the instrumentation may include predetermined instrumentation of specific logical locations. That is, the endpoint may be configured to provide causal information from specific logical locations, any of which may then be controllably selected for observation after an initial configuration.
- instrumentation may include dynamic instrumentation that is deployed as needed or desired for endpoint monitoring. Thus, for example, where a new registry entry is created or a new file is downloaded, that computing object may be monitored prospectively as a new logical location on the endpoint until it can be determined that the new computing object is safe.
- the method 600 may include selecting a set of logical locations from the plurality of logical locations. This may include adding one or more of the plurality of logical locations to the first set of logical locations in response to a detected increase in security risk. This may also or instead include removing one of the plurality of logical locations from the first set of logical locations in response to a detected decrease in security risk. More generally, this may include adapting the monitored locations according to a security state of the endpoint so that more or less computing resources can be used as necessary or appropriate according to the current state of risk.
- selecting logical locations may include adapting the monitoring based on observed properties of objects within a computing environment.
- computing objects such as files or processes may be explicitly labelled with information about reputation, exposure to external networks, usage history, security status, and so forth.
- One useful system for labeling objects in this manner is described by way of example in commonly-owned U.S. application Ser. No. 15/179,547, entitled “Network Security” and filed on Jun. 10, 2016, the entire content of which is hereby incorporated by reference.
- numerous techniques are described for labeling processes, files, and other computing objects with useful information for malware detection, reputation-based processing, and so forth. These and other techniques may be usefully employed to label computing objects in any manner useful for evaluating a security state of an endpoint (or specific computing objects on the endpoint), and for using this security state to adapt the monitoring processes contemplated herein.
- each file, process, or other object may be labelled according to whether the object has been exposed to an external network or resource.
- objects that have remained isolated on the endpoint can be distinguished from objects that have been exposed outside of the endpoint (and that are thus potentially at risk for infection or other malicious activity).
- selecting a set of logical locations may include selecting a group from the plurality of logical locations based on exposure to an external environment, e.g., where the exposure implies a greater degree of security risk.
- selecting a set of logical locations may include selecting a group from the plurality of logical locations based on a reputation, such as a reputation of one of the computing objects, or a reputation of a group of computing objects.
- reputation-based evaluations may be done at any suitable level of granularity or complexity.
- the selection may include excluding one of the plurality of logical locations associated with the known, good process. This may also or instead include adding locations associated with processes of unknown reputation, or increasing the number of locations or level of monitoring when an inconsistency is detected between a reputation of a first process and a reputation of a second process calling or invoking the first process. More generally, where reputation information is available for computing objects on an endpoint, any inconsistencies between reputations of computing objects that are causally linked in an event graph, or any other reputation information that might be available for the computing objects, may be usefully employed to adapt monitoring as contemplated herein.
- the reputation of computing objects may include a score (or other label, indication, weighting, and the like) of one or more of its prevalence, its provenance, and its pedigree.
- the prevalence of a computing object may include how the computing object has been seen on other machines or systems.
- the provenance of a computing object may include its origin, e.g., where it came from, who created or signed it, and the like.
- the pedigree of a computing object may allow for identification of the creator of the computing object. For example, the pedigree may be based on the public key of the certificate that signed software (e.g., typically the first intermediate certificate). For URLs, this may be based on the signed SSL server certificate. For software, this may be based on the signed packet that contains the software (if present).
- Schau and prevalence may be uncovered by checking on the public key of the certificate in question, and known good computing objects (or reputations or attributes thereof, e.g., certificates) may be hard coded into a list for future lookup.
- the method 600 may include recording a sequence of events causally relating the number of computing objects at the set of logical locations selected in step 604 .
- this may include recording any of the events described herein.
- This may also or instead include filtering the recorded events more or less aggressively according to a security state or other information.
- this may include filtering one or more of the events in the sequence of events according to a reputation, such as by excluding events that are related to a known good process, or increasing data collection or sensitivity for events that are related to unknown or low reputation computing objects.
- some or all of the events may have an aging or duration parameter such as a time to live.
- an aging or duration parameter such as a time to live.
- a time to live This permits appropriate aging of events according to their short-term or long-term diagnostic significance.
- one endpoint may try to log in to another endpoint using a series of login attempts with different credentials. To detect this type of attempted lateral movement, it may be useful to retain all login attempts for a relatively short period of time in order to see if a number of similar login attempts occur within a short time period. However, after the passage of some time, any such failed login attempts might be discounted in significance, and aged out of the current event graph using a suitable time to live or other time constant. Thus, a number of events within the sequence of events may be preserved for a predetermined time window.
- the predetermined time window may have a different duration for at least two of the types of computing objects contemplated herein, which may be useful where events for different computing objects (e.g., remote resources, local files, processes, and the like) provide information with differing long-term or short-term value.
- events for different computing objects e.g., remote resources, local files, processes, and the like
- the method 600 may include creating an event graph based on the sequence of events.
- the event graph may be continuously created and updated by a data recorder—that is, the data recorder may store the event graph as its native data logging format—or the event graph may be created on demand from a structured or unstructured data log at discrete moments, e.g., in response to a request for an event graph from the data recorder.
- the data recorder may function to continuously obtain data from a variety of sources or locations in addition to the locations that have been selected for monitoring. While this additional data logging may require additional computing resources to capture information beyond selecting monitoring points as well as additional storage, the additional data may also advantageously permit retroactive reconstruction of malicious causal chains if potential malware has been detected.
- a data recorder may record additional data from instrumentation points outside the scope of the logical locations that are currently explicitly being monitored.
- the data recorder may have a prioritized list of logical locations, and may record additional data based on the prioritized list of logical locations.
- the event graph may generally associate a number of computing objects to one another through events that establish causal relationships.
- the causal relationships may include a data flow, a control flow, or a network flow, or any other type of event or the like that causally relates one computing object to other computing objects within an endpoint computing environment.
- the method may include evaluating a security state of the endpoint.
- this may include evaluating the security state of the endpoint based on the event graph, such as by applying a malware detection rule to the event graph. This may provide useful diagnostic information by comparing the current event graph to one or more graphs for root causes that have been identified as described above, or by comparing the current event graph to other patterns of events that show a causal relationship among computing objects that is suggestive or indicative of malicious activity.
- the method 600 may include adjusting the set of logical locations according to the security state of the endpoint. In general, this may include adding a new logical location or removing an existing logical location. Thus, this may generally include selecting a second set of logical locations different from the first plurality of logical locations in response to an observed event graph for the sequence of events. This may also or instead include changing a level of filtering at one of the set of logical locations according to the security state of the endpoint. In another aspect, any of the selection criteria described above for use with an initial selection of monitoring locations (e.g., in step 604 ) may also or instead be employed as criteria for adding, removing, or filtering logical locations in order to adjust the monitoring in response to a security state.
- the event graph may generally provide useful information about the security state of the endpoint, other information may also or instead be used to evaluate the security state and modify the monitoring process accordingly.
- the monitoring may be adjusted based on a detection of malware obtained from another source such as an antivirus scanner or the like, or the monitoring may be adjusted based on exposure to external resources, reputation information, or any other information that might be available for processes, files, and the like as contemplated herein.
- the method 600 may include remediating the endpoint when the security state is compromised, for example, when a combination of a malware detection rule and the event graph indicate a compromised security state.
- This may include any suitable form of remediation.
- evaluating the security state includes identifying one of the computing objects (or a group of the computing objects) as a cause of a compromised security state
- the method 600 may include remediating that one of the computing objects. Remediation may also or instead include traversing the event graph forward from the cause to identify one or more other ones of the computer objects affected by the cause, any of which may be similarly remediated.
- remediation techniques are known in the art and may be usefully employed to remediate an endpoint, or one or more computing objects on an endpoint, as contemplated herein. This may for example include quarantining or isolating the endpoint to prevent interactions with other devices on a network. This may also or instead include deploying malware removal tools to the endpoint, or launching a malware removal tool that is already on the endpoint, to remove malware that has been detected. This may also include intermediate steps such as terminating processes, deleting logs, clearing caches, or any other steps or combination of steps suitable for removing malicious software from the endpoint and/or restoring the endpoint to an uninfected state. This may include notifying an administrator or user. This may include reporting a health state that indicates compromise, for example, as part of a heartbeat health report.
- the endpoint may include a network interface, a memory, and a processor.
- the processor may be configured by computer executable code stored in the memory to detect malware by performing the steps of instrumenting the endpoint to monitor a number of causal relationships among a number of computing objects at a plurality of logical locations within a computing environment related to the endpoint, selecting a first set of logical locations from the plurality of logical locations, recording a sequence of events causally relating the number of computing objects at the first set of logical locations, creating an event graph based on the sequence of events, applying a malware detection rule to the event graph, and remediating the endpoint when the malware detection rule and the event graph indicate a compromised security state.
- the processor may be further configured to adjust the set of logical locations by adding a new logical location, removing an existing logical location, or changing a level of filtering at one of the set of logical locations according to a security state of the
- FIG. 7 shows a malware detection system including an event handler on an endpoint.
- an event handler 760 may be deployed as an event-based state machine that monitors for a single event or group of events occurring next in a sequence of events associated with the malware.
- this approach permits a detection system that scales well with larger chains of events, for example by maintaining time complexity and space complexity that scales well as the number and complexity of monitored events, event types, and/or detected items is increased.
- malware detection is not limited to malware detection, and may usefully be deployed in any context where sequences of events provide a useful indication of endpoint status, software status, software installation, risky user behavior, enterprise security breaches, and so forth, or in any other context where a significant activity or global event can be characterized as one or more sequences of events.
- the system 700 may in general correspond to the system described above with reference to FIG. 3 , with differences as noted below.
- the system 700 may generally include an endpoint 710 with any number of objects 712 creating events 714 causally linked together to execute applications and perform other user functions, supporting computation tasks, and so forth.
- An event handler 740 may execute on the endpoint 710 to monitor events, and may be coupled in a communicating relationship with an analysis facility 740 that provides one or more rules 742 (e.g., for malware detection) over a data network 750 .
- rules 742 e.g., for malware detection
- certain components of the system 700 such as the event handler 760 and various objects 712 that create events 714 may also or instead include remote services instantiated on a virtual appliance, a public or private cloud, or the like, any of which may be coupled to the endpoint 710 through the data network 750 or another communication channel (not shown).
- Each of the components of the system 700 may be configured with suitable programming and configuration to participate in the event-based detection techniques contemplated herein.
- the endpoint 710 may be any of the endpoints described herein, e.g., a computing device in an enterprise network, or any other device or network asset that might join or participate in an enterprise or otherwise operate on an enterprise network.
- This may, for example, include a server, a client device such as a desktop computer or a mobile computing device (e.g., a laptop computer or a tablet), a cellular phone, a smart phone, or other computing device suitable for participating in the system 700 or in an enterprise.
- the endpoint 710 may include any number of computing objects 712 , which may for example, be processes executed by one or more processors or other processing circuitry, files or data stored in memory, or any other computing objects described herein. While the term object has a number of specific meanings in the art, and in particular in object-oriented programming, it will be understood that the term ‘object’ as used herein is intended to be significantly broader, and may include anything on the endpoint 710 , or associated with the endpoint 710 , that might include or create an event.
- the object may include any data, process, file or combination of these on the endpoint 710 including without limitation any process, application, executable, script, dynamic linked library (DLL), file, data, database, data source, data structure, function, resource locator (e.g., uniform resource locator (URL) or other uniform resource identifier (URI)), or the like that might be resident on the endpoint 710 and manipulated by the endpoint 710 or another component of the system 700 or other systems described elsewhere herein.
- the object 712 may also or instead include a remote resource, such as a resource identified in a URL.
- an object 712 in the figure may also reside elsewhere in the system 700 , and may be specified for example with a link, pointer, or reference that is locally stored on the endpoint 710 .
- the object 712 may be an item that is performing an action or causing an event 714 , or the object 712 may be an item that is receiving the action or is the result of an event 714 (e.g., the object 712 may be an item in the system 700 being acted upon by an event 714 or another object 712 ).
- an event 714 as contemplated herein may be any input, output, data flow, execution flow, control flow, network flow, or other similar action or event that might causally relate objects 712 to one another.
- the object 712 may be encrypted or otherwise protected, or the object 712 may be unencrypted or otherwise unprotected.
- the object 712 may be a process or other computing object that performs an action, which may include a single event 714 or a collection or sequence of events 714 taken by a process.
- the object 712 may also or instead include an item such as a file or lines of code that are executable to perform such actions.
- the object 712 may also or instead include a computing component upon which an action is taken, e.g., a system setting (e.g., a registry key or the like), a data file, a URL, and so forth.
- the object 712 may exhibit a behavior such as an interaction with another object or a component of the system 700 .
- the object 712 may also or instead include a hardware item for input or output such as a keyboard, display, mouse, speaker, and so forth, or any other peripheral or the like.
- the object 712 may also or instead include an abstraction of such a physical object such as a device driver, abstraction layer instance or the like.
- the object 712 may also or instead include a physical port for communicating with peripherals, external hardware, communications infrastructures and so forth.
- the object 712 may include a USB port, a serial port, a wireless network interface, or any other short range or long range communications interface or the like.
- Objects 712 may be described in terms of persistence.
- the object 712 may, for example, be a part of a process, and remain persistent as long as that process is alive.
- the object 712 may instead be persistent across an endpoint 710 and remain persistent as long as an endpoint 710 is active or alive.
- the object 712 may instead be a global object having persistence outside of an endpoint 710 , such as a URL or a data store. In other words, the object 712 may be a persistent object with persistence outside of the endpoint 710 .
- an object 712 may contain software associated with an advanced persistent threat (APT) or other malware that resides partially or entirely on the endpoint 710 .
- APT advanced persistent threat
- This associated software may have reached the endpoint 710 in a variety of ways, and may have been placed manually or automatically on the endpoint 710 by a malicious source.
- the associated software may take any number of forms and have any number of components.
- the associated software may include an executable file that can execute independently, or the associated software may be a macro, plug-in, or the like that executes within another application.
- the associated software may manifest as one or more processes or threads executing on the endpoint 710 . Further, the associated software may install from a file on the endpoint 710 (or a file remote from the endpoint 710 ), and the associated software may create one or more files such as data files or the like while executing. Associated software should be understood to generally include all such files and processes except where a specific file or process is more specifically noted.
- An event 714 may include an action, a behavior, an interaction, and so forth, as well as combinations of the foregoing.
- the event 714 may be generated by or otherwise related to an object 712 .
- the event 714 may be associated with a file and include an action such as a read, a write, an open, a move, a copy, a delete, and so forth.
- the event 714 may also or instead include process start and stop events or inter-process communication, e.g., a create, a handle, a debug, a remote injection, and so forth.
- the event 714 may also or instead include a network action such as accessing an Internet Protocol (IP) address or URL.
- IP Internet Protocol
- the events 714 may include human interactions such as keyboard strokes, mouse clicks or other input and output to human interface devices and hardware. This usefully permits discrimination within causal chains among events initiated by processes executing on a device (e.g., by a machine) and events that are initiated or controlled by a human user that is present on the endpoint.
- a security product 732 may execute on the endpoint 710 to detect a security event on the endpoint 710 , which may act as the beacon or trigger event for the system 700 as described above, and which may generate events 714 related to the security status of the endpoint 710 or other security-related states.
- the security product 732 may also or instead be used to remediate a compromised endpoint when another system such as the event handler 760 detects a threat.
- the security product 732 may use techniques such as signature-based and behavioral-based malware detection including without limitation one or more of host intrusion prevention, malicious traffic detection, URL blocking, file-based detection, and so forth, as well as any input from the event handler 760 .
- the analysis facility 740 may create or store any number of rules 742 as generally described above. This may, for example, include rules 742 that relate sequences of events to compromised conditions of an endpoint in an enterprise network.
- the rules 742 may be organized as a state machine suitable for deployment on the event handler 760 , or as individual events 714 or sequences of events 714 that can be communicated to the event handler 760 for use in detecting security threats or the like.
- the analysis facility 740 may analyze sequences of events to aid in improved threat detection, and the analysis facility 740 may be used to manage deployment of rules 742 and related information to the endpoint 710 .
- the analysis facility 740 may reside locally on the endpoint 710 (e.g., be a part of, embedded within, or locally coupled to the endpoint 710 ).
- the analysis facility 740 may also or instead be an external facility, or it may reside in a virtual appliance (e.g., which could be run by a protected set of systems on their own network systems), a private cloud, a public cloud, and so forth coupled to the endpoint 710 in a communicating relationship through the network 750 .
- the analysis facility 740 may store locally-derived threat information for use in subsequent identification, remediation, or other similar activity.
- the analysis facility 740 may also or instead receive threat information from a third-party source such as any public, private, educational, or other organization that gathers information on network threats and provides analysis and threat detection information for use by others.
- This third-party information may, for example, be used to improve detection rules or other forensic analysis that might be deployed for use in threat detection by the event handler 760 .
- the analysis facility 740 may provide a user environment for creating rules 742 that describe sequences of events associated with malware or other relevant items, events or context.
- the analysis facility 740 may provide a graphical user environment, scripting tool(s), software libraries, and any other tools or resources suitable for configuring the event handler 760 to assist in malware detection or other identification or detection processes as contemplated herein.
- the event handler 760 may be any program, executable code, data structure, or other software construct suitable for processing groups of events 714 to detect malware or other activities or context of interest.
- the event handler 760 may usefully be configured as a state machine where each state is characterized by (i) monitoring for an event 714 and (ii) responding to an occurrence of the event 714 by transitioning to a next state in which the state machine monitors for a next event.
- the event handler 760 can monitor for a long or complex chain of events in a compact computational manner that only requires instrumentation to monitor for the current event 714 of interest.
- Only modest computational resources may be required, and the resources can scale more easily to increasingly complex event chains, requiring little more than the memory resources required to store additional states that can be retrieved when needed as the state machine progresses through a number of state transitions.
- the event handler 760 may be deployed as a standalone monitoring agent on an endpoint 710 , or the event handler 760 may be deployed in whole or in part at a remote threat management facility or similar platform configured to receive event sequence information over the network and to transmit state updates or detections to the endpoint 710 as needed.
- the event handler 760 may persistently store state information for one or more sequences of events, e.g., in a manner that retains state information across machine crashes, restarts, updates, and so forth.
- the event handler 760 may selectively retain relevant state information (e.g., for sequences of events that can potentially span multiple machine reboots) for some detection patterns while purging state information for other detection patterns (e.g., for sequences of events that cannot span multiple machine reboots).
- the event handler 760 may usefully be configured, for example, using a suitably adapted scripting language. While a suitable scripting language may take a wide variety of forms, some useful characteristics of a useful scripting language are described below.
- a suitable scripting language may be optimized to ensure that particular states—conditions where the event handler 760 is monitoring for a particular event—are only activated at the appropriate time, e.g., in response to a transition from the immediately preceding state.
- the scripting language may be adapted to ensure that complex events can be handled, e.g., by permitting monitoring for multiple events concurrently when required by a particular state, or to ensure that multiple state machines can be operated concurrently. Other situations may also arise, such as forks or branches that require active monitoring for events for multiple, concurrent states, as well as situations where different state machines or event handlers should communicate with one another.
- event analysis by the event handler 760 may be performed incrementally, as each event is received. This advantageously reduces the need to store events 714 as they are detected.
- the term thread may be used in this context to describe a particular state machine, or particular sequence of events leading to an event-based conclusion. A new thread or state machine can be created each time an initial event in one of the sequences of events is detected. That thread can then sleep while it monitors for the next event in that sequence. Each time an event is received, every thread which is waiting for that event can be woken up to update its state. Each thread can then apply a local rule to determine whether to take an action (e.g., transition to another state), return to a sleep or waiting state for the same event or some other event, or when an intended event sequence become impossible to satisfy, terminate.
- an action e.g., transition to another state
- a standalone executable may be used to parse text files that store a description of each thread or state machine.
- Each event may be given a name, along with zero, one, or more associated parameters, the meaning for which may depend on the context. Parameters may usefully be textual or numeric.
- a file open event may have parameters which specify the ID of the process that performed the operation, the name of the file that was opened, and other information relevant to the file open operation.
- an event may be a static event that always causes the instantiation of a thread or state machine when it occurs, or the event may be a dynamic event that is waited for by the event handler 760 while in a particular state.
- the first state in a sequence may usefully have a scope that is shared to prevent multiple threads from launching in response to multiple occurrences of an initial event (unless that is intended).
- Shared scopes may usefully be defined with a combination of type and value, and may be global in nature. In this manner a different event body can make use of the same shared scope to access and also manipulate all variables declared at that scope level.
- a scripting language as contemplated herein may support numerous additional functions helpful in monitoring events and detecting event sequences of interest.
- the language may support output to signal specific events or sequences of events to a human or computer user.
- the language may support use of such output as if it were a client input for additional processing.
- Time base functions such as scheduling, waiting and the like may also be supported and may be used to schedule outputs or wait for inputs as needed.
- the language may also usefully support flow control using constructs such as if, while, for, and so forth.
- the language may also usefully support debugging, text or numeric manipulation, and the use of other functionality (e.g., functions, linked code, subroutines, coroutines or other analogous functionality, e.g., for a stackless language or the like) as appropriate. More generally, any functions, variables, flow control tools or other programmatic tools and techniques useful for describing event-monitoring state machines as contemplated herein may be incorporated into a scripting language for configuring the event handler.
- FIG. 8 shows a method for real time event detection.
- the method 800 employs a state machine or similar construct with each state configured to monitor for a single event (or group of events) expected to occur next in a sequence of events associated with, e.g., malware or other computer contexts or global events.
- the event handler may execute on the endpoint, on a remote threat management facility, or some combination of these.
- the event handler may also be deployed as a security agent, or as a portion of a security agent, locally installed on the endpoint.
- the method may begin with providing a development environment for creating a state machine that can be deployed on an event handler as described above.
- This may, for example, include a scripting language as described above, along with a graphical user interface or other programming environment that facilitates visualization of causal object-event chains as described above, and assists in configuring a responsive state machine for use with the event handler.
- the method 800 may include identifying a sequence of events, such as a sequence of events associated with malware on an endpoint or a sequence of events associated with some other global event, context or the like that might usefully be detected using the techniques described herein. As described above, for example, this may include traversing an event graph among a sequence of causal events in reverse chronological order to a root cause of the malware. This may also or instead include creating the sequence of events based on a forward traversal of the event graph, or otherwise using the event graph to identify and capture sequences of events that are potentially relevant to malware detection for us in an event handler as contemplated herein.
- identifying a sequence of events such as a sequence of events associated with malware on an endpoint or a sequence of events associated with some other global event, context or the like that might usefully be detected using the techniques described herein. As described above, for example, this may include traversing an event graph among a sequence of causal events in reverse chronological order to a root cause of the malware. This may also or instead include creating the sequence of events based on
- the method 800 may include configuring an event handler such as any of the event handlers described above for use with the endpoint.
- the event handler may implement a state machine including a first state configured to monitor for an occurrence of a first one of the sequence of events identified above.
- the first state may be configured to respond to the occurrence of the first one of the sequence of events by transitioning to a second state where the event handler monitors for a second one of the sequence of events, such as a next sequential one of the sequence of events described above (e.g., associated with malware detection or the like).
- the state machine may generally proceed in this manner, transitioning from state to state where each state is characterized by monitoring for an event on one hand and providing a transition to a next state with the event is detected.
- the event handler may be configured to respond to a terminal event in the sequence of events by identifying the malware (or other context) on the endpoint associated with the sequence of events, and the event handler may respond to an exit condition such as this detection by returning to the first one of the sequence of the events so that monitoring can resume for the item of interest.
- exit conditions may be configured for events that make the occurrence of the entire sequence of events impossible, such as the termination of a process, deletion of a file, and so forth.
- the exit conditions may also or instead include a time-based exit condition that terminates a state machine in a particular state after a predetermined amount of time, and resets the state machine to an initial state and initial event.
- the second event may be the terminal event.
- the first event may be an initial event in a sequence of events, e.g., the first event that triggers use of a particular state machine for detecting a particular malware instance.
- the method 800 may include deploying the event handler for use with the endpoint, such as transmitting script or other programmatic information to the endpoint for use by the event handler.
- the method 800 may include monitoring events on the endpoint with the event handler.
- monitoring events may include any of the events described herein, and where appropriate a monitoring state may monitor for multiple different events (e.g., where the monitored condition includes an occurrence of either of a first state or a second state, or where the event is a multi-parameter event for which two or more separate conditions must concurrently be met), complex or compound events, or events that are triggered by other states of the state machine.
- any number of parallel state machines may be used according to the number of different detection processes to be used, e.g. to concurrently monitor for multiple type of malware.
- a state machine provides a useful conceptual and programmatic construct for describing the event handler and monitoring for sequences of events, other programmatic techniques may also or instead be used, preferably where the techniques permit monitoring for multiple events in parallel and where the techniques facilitate detection of complex sequences of events in a manner that similarly scales efficiently in computation and space.
- the method 800 may include detecting sequences of events based on the monitoring. This may, for example, include detecting the malware on the endpoint based upon an occurrence of the sequence of events concluding in the terminal event.
- the event sequence may include at least one event from a computing object such as a data file, a process, an application, a registry entry, a network address, and a peripheral device.
- the event sequence includes at least one event from a network address such as a uniform resource locator (URL), an internet protocol (IP) address, and a domain name.
- the event sequence may include at least one event from a peripheral device such as a universal serial bus (USB) memory, a network interface card, a camera, a printer, a mouse and a keyboard.
- a computing object such as a data file, a process, an application, a registry entry, a network address, and a peripheral device.
- the event sequence includes at least one event from a network address such as a uniform resource locator (URL), an internet protocol (IP) address, and a domain name.
- IP internet protocol
- the event sequence may include at least one event from a peripheral device such as a universal serial bus (USB) memory, a network interface card, a camera
- the event sequence may include at least one file operation such as a read, a write, an open, a move, a copy and a delete.
- the event sequence may include at least one inter-process communication such as a create, a handle, a debug and a remote injection.
- the method 800 may include initiating a response to the detection, such as by remediating the malware on the endpoint or otherwise responding to what has been detected based on the sequence of events.
- the endpoint may include a network interface, a memory and a processor.
- the processor may be configured, e.g., with computer-executable code, to operate a real-time event detection system for malware detection or the like.
- the processor may operate an event handler with a state machine having a plurality of states including a first state configured to monitor for an occurrence of a first one of the sequence of events, and configured to respond to the occurrence of the first one of the sequence of events by transitioning to a second state where the event handler monitors for a second one of the sequence of events, wherein the second one of the sequence of events is a next sequential one of the sequence of events associated with malware, the even handler further configured to respond to a terminal event in the sequence of events by identifying the malware on the endpoint and to respond to an exit condition by returning to the first one of the sequence of events.
- a state machine having a plurality of states including a first state configured to monitor for an occurrence of a first one of the sequence of events, and configured to respond to the occurrence of the first one of the sequence of events by transitioning to a second state where the event handler monitors for a second one of the sequence of events, wherein the second one of the sequence of events is a next sequential one of the
- the above systems, devices, methods, processes, and the like may be realized in hardware, software, or any combination of these suitable for a particular application.
- the hardware may include a general-purpose computer and/or dedicated computing device. This includes realization in one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors or other programmable devices or processing circuitry, along with internal and/or external memory. This may also, or instead, include one or more application specific integrated circuits, programmable gate arrays, programmable array logic components, or any other device or devices that may be configured to process electronic signals.
- a realization of the processes or devices described above may include computer-executable code created using a structured programming language such as C, an object oriented programming language such as C++, or any other high-level or low-level programming language (including assembly languages, hardware description languages, and database programming languages and technologies) that may be stored, compiled or interpreted to run on one of the above devices, as well as heterogeneous combinations of processors, processor architectures, or combinations of different hardware and software.
- the methods may be embodied in systems that perform the steps thereof, and may be distributed across devices in a number of ways. At the same time, processing may be distributed across devices such as the various systems described above, or all of the functionality may be integrated into a dedicated, standalone device or other hardware.
- means for performing the steps associated with the processes described above may include any of the hardware and/or software described above. All such permutations and combinations are intended to fall within the scope of the present disclosure.
- Embodiments disclosed herein may include computer program products comprising computer-executable code or computer-usable code that, when executing on one or more computing devices, performs any and/or all of the steps thereof.
- the code may be stored in a non-transitory fashion in a computer memory, which may be a memory from which the program executes (such as random access memory associated with a processor), or a storage device such as a disk drive, flash memory or any other optical, electromagnetic, magnetic, infrared or other device or combination of devices.
- any of the systems and methods described above may be embodied in any suitable transmission or propagation medium carrying computer-executable code and/or any inputs or outputs from same.
- performing the step of X includes any suitable method for causing another party such as a remote user, a remote processing resource (e.g., a server or cloud computer) or a machine to perform the step of X.
- performing steps X, Y and Z may include any method of directing or controlling any combination of such other individuals or resources to perform steps X, Y and Z to obtain the benefit of such steps.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Virology (AREA)
- Multimedia (AREA)
- Debugging And Monitoring (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Computer And Data Communications (AREA)
Abstract
An event handler implements a state machine or similar construct for processing of complex event chains as incremental events are detected. This approach advantageously limits processing to monitoring for and responding to a next event in a sequence of events, and supports complex event detection in a manner that scales efficiently in time and computation.
Description
- This application is a continuation of U.S. patent application Ser. No. 16/032,814 filed on Jul. 11, 2018, which claims the benefit of U.S. Prov. Pat. App. No. 62/556,131 filed on Sep. 8, 2017, where the entire contents of each of the foregoing are hereby incorporated herein by reference.
- This application relates to event detection, and more particularly to an event handler for real time, event-based detection of the presence of malware or other context, conditions or uses of an endpoint.
- As computers and malware becomes more sophisticated, it becomes increasingly difficult to detect malicious computing activity or other endpoint conditions of interest, particularly where relevant patterns of events are complex or occur over an extended time period. There remains a need for improved techniques for real-time, event-based detection of malware and other complex computational events or contexts.
- An event handler implements a state machine or similar construct for processing of complex event chains as incremental events are detected. This approach advantageously limits processing to monitoring for and responding to a next event in a sequence of events, and supports complex event detection in a manner that scales efficiently in time and computation.
- The foregoing and other objects, features and advantages of the devices, systems, and methods described herein will be apparent from the following description of particular embodiments thereof, as illustrated in the accompanying drawings. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the devices, systems, and methods described herein.
-
FIG. 1 illustrates an environment for threat management. -
FIG. 2 illustrates a computer system. -
FIG. 3 illustrates a system for forensic analysis for computer processes. -
FIG. 4 is a flowchart of a method for forensic analysis for computer processes. -
FIG. 5 illustrates an event graph. -
FIG. 6 shows a method for malware detection using an event graph. -
FIG. 7 shows a malware detection system including an event handler on an endpoint. -
FIG. 8 shows a method for real time event detection. - Embodiments will now be described with reference to the accompanying figures, in which preferred embodiments are shown. The foregoing may, however, be embodied in many different forms and should not be construed as limited to the illustrated embodiments set forth herein.
- All documents mentioned herein are hereby incorporated by reference in their entirety. References to items in the singular should be understood to include items in the plural, and vice versa, unless explicitly stated otherwise or clear from the context. Grammatical conjunctions are intended to express any and all disjunctive and conjunctive combinations of conjoined clauses, sentences, words, and the like, unless otherwise stated or clear from the context. Thus, the term “or” should generally be understood to mean “and/or” and so forth.
- Recitation of ranges of values herein are not intended to be limiting, referring instead individually to any and all values falling within the range, unless otherwise indicated herein, and each separate value within such a range is incorporated into the specification as if it were individually recited herein. The words “about,” “approximately,” or the like, when accompanying a numerical value, are to be construed as indicating a deviation as would be appreciated by one of ordinary skill in the art to operate satisfactorily for an intended purpose. Ranges of values and/or numeric values are provided herein as examples only, and do not constitute a limitation on the scope of the described embodiments. The use of any and all examples, or exemplary language (“e.g.,” “such as,” or the like) provided herein, is intended merely to better illuminate the embodiments and does not pose a limitation on the scope of the embodiments or the claims. No language in the specification should be construed as indicating any unclaimed element as essential to the practice of the embodiments.
- In the following description, it is understood that terms such as “first,” “second,” “third,” “above,” “below,” and the like, are words of convenience and are not to be construed as limiting terms unless expressly state otherwise.
-
FIG. 1 illustrates an environment for threat management. Specifically,FIG. 1 depicts a block diagram of a threat management system providing protection to an enterprise against a plurality of threats—a context in which the following techniques may usefully be deployed. One aspect relates to corporate policy management and implementation through a unifiedthreat management facility 100. As will be explained in more detail below, athreat management facility 100 may be used to protect computer assets from many threats, both computer-generated threats and user-generated threats. Thethreat management facility 100 may be multi-dimensional in that it may be designed to protect corporate assets from a variety of threats and it may be adapted to learn about threats in one dimension (e.g. worm detection) and apply the knowledge in another dimension (e.g. spam detection). Policy management is one of the dimensions for which the threat management facility can provide a control capability. A corporation or other entity may institute a policy that prevents certain people (e.g. employees, groups of employees, types of employees, guest of the corporation, etc.) from accessing certain types of computer programs. For example, the corporation may elect to prevent its accounting department from using a particular version of an instant messaging service or all such services. In this example, thepolicy management facility 112 may be used to update the policies of all corporate computing assets with a proper policy control facility or it may update a select few. By using thethreat management facility 100 to facilitate the setting, updating and control of such policies the corporation only needs to be concerned with keeping thethreat management facility 100 up to date on such policies. Thethreat management facility 100 may take care of updating all of the other corporate computing assets. - It should be understood that the
threat management facility 100 may provide multiple services, and policy management may be offered as one of the services. We will now turn to a description of certain capabilities and components of thethreat management system 100. - Over recent years, malware has become a major problem across the Internet 154. From both a technical perspective and a user perspective, the categorization of a specific threat type, whether as virus, worm, spam, phishing exploration, spyware, adware, or the like, is becoming reduced in significance. The threat, no matter how it is categorized, may need to be stopped at various points of a networked computing environment, such as one of an
enterprise facility 102, including at one or more laptops, desktops, servers, gateways, communication ports, handheld or mobile devices, firewalls, and the like. Similarly, there may be less and less benefit to the user in having different solutions for known and unknown threats. As such, a consolidatedthreat management facility 100 may need to apply a similar set of technologies and capabilities for all threats. In certain embodiments, thethreat management facility 100 may provide a single agent on the desktop, and a single scan of any suspect file. This approach may eliminate the inevitable overlaps and gaps in protection caused by treating viruses and spyware as separate problems, while simultaneously simplifying administration and minimizing desktop load. As the number and range of types of threats has increased, so may have the level of connectivity available to all IT users. This may have led to a rapid increase in the speed at which threats may move. Today, an unprotected PC connected to the Internet 154 may be infected quickly (perhaps within 10 minutes) which may require acceleration for the delivery of threat protection. Where once monthly updates may have been sufficient, thethreat management facility 100 may automatically and seamlessly update its product set against spam and virus threats quickly, for instance, every five minutes, every minute, continuously, or the like. Analysis and testing may be increasingly automated, and also may be performed more frequently; for instance, it may be completed in 15 minutes, and may do so without compromising quality. Thethreat management facility 100 may also extend techniques that may have been developed for virus and malware protection, and provide them toenterprise facility 102 network administrators to better control their environments. In addition to stopping malicious code, thethreat management facility 100 may provide policy management that may be able to control legitimate applications, such as VoIP, instant messaging, peer-to-peer file-sharing, and the like, that may undermine productivity and network performance within theenterprise facility 102. - The
threat management facility 100 may provide anenterprise facility 102 protection from computer-based malware, including viruses, spyware, adware, Trojans, intrusion, spam, policy abuse, uncontrolled access, and the like, where theenterprise facility 102 may be any entity with a networked computer-based infrastructure. In an embodiment,FIG. 1 may depict a block diagram of thethreat management facility 100 providing protection to an enterprise against a plurality of threats. Theenterprise facility 102 may be corporate, commercial, educational, governmental, or the like, and the enterprise facility's 102 computer network may be distributed amongst a plurality of facilities, and in a plurality of geographical locations, and may includeadministration 134, afirewall 138A, anappliance 140A,server 142A,network devices 148A-B,clients 144A-D, such as protected bycomputer security facilities 152, and the like. It will be understood that any reference herein to client facilities may include theclients 144A-D shown inFIG. 1 and vice-versa. Thethreat management facility 100 may include a plurality of functions, such assecurity management facility 122,policy management facility 112,update facility 120,definitions facility 114, networkaccess rules facility 124,remedial action facility 128,detection techniques facility 130,testing facility 118,threat research facility 132, and the like. In embodiments, the threat protection provided by thethreat management facility 100 may extend beyond the network boundaries of theenterprise facility 102 to includeclients 144D (or client facilities) that have moved into network connectivity not directly associated or controlled by theenterprise facility 102. Threats to client facilities may come from a plurality of sources, such as fromnetwork threats 104,physical proximity threats 110, secondary location threats 108, and the like.Clients 144A-D may be protected from threats even when theclient 144A-D is not located in association with theenterprise 102, such as when aclient 144E-F moves in and out of theenterprise facility 102, for example when interfacing with anunprotected server 142C through theInternet 154, when aclient 144F is moving into a secondary location threat 108 such as interfacing withcomponents threat management facility 100 may provide anenterprise facility 102 protection from a plurality of threats to multiplatform computer resources in a plurality of locations and network configurations, with an integrated system approach. - In embodiments, the
threat management facility 100 may be provided as a stand-alone solution. In other embodiments, thethreat management facility 100 may be integrated into a third-party product. An application programming interface (e.g. a source code interface) may be provided such that thethreat management facility 100 may be integrated. For instance, thethreat management facility 100 may be stand-alone in that it provides direct threat protection to an enterprise or computer resource, where protection is subscribed to directly 100. Alternatively, thethreat management facility 100 may offer protection indirectly, through a third-party product, where an enterprise may subscribe to services through the third-party product, and threat protection to the enterprise may be provided by thethreat management facility 100 through the third-party product. - The
security management facility 122 may include a plurality of elements that provide protection from malware toenterprise facility 102 computer resources, including endpoint security and control, email security and control, web security and control, reputation-based filtering, control of unauthorized users, control of guest and non-compliant computers, and the like. Thesecurity management facility 122 may be a software application that may provide malicious code and malicious application protection to a client facility computing resource. Thesecurity management facility 122 may have the ability to scan the client facility files for malicious code, remove or quarantine certain applications and files, prevent certain actions, perform remedial actions and perform other security measures. In embodiments, scanning the client facility may include scanning some or all of the files stored to the client facility on a periodic basis, scanning an application when the application is executed, scanning files as the files are transmitted to or from the client facility, or the like. The scanning of the applications and files may be performed to detect known malicious code or known unwanted applications. In an embodiment, new malicious code and unwanted applications may be continually developed and distributed, and updates to the known code database may be provided on a periodic basis, on a demand basis, on an alert basis, or the like. - The
security management facility 122 may provide email security and control, where security management may help to eliminate spam, viruses, spyware and phishing, control of email content, and the like. The security management facility's 122 email security and control may protect against inbound and outbound threats, protect email infrastructure, prevent data leakage, provide spam filtering, and the like. In an embodiment,security management facility 122 may provide for web security and control, where security management may help to detect or block viruses, spyware, malware, unwanted applications, help control web browsing, and the like, which may provide comprehensive web access control enabling safe, productive web browsing. Web security and control may provide Internet use policies, reporting on suspect devices, security and content filtering, active monitoring of network traffic, URI filtering, and the like. In an embodiment, thesecurity management facility 122 may provide for network access control, which may provide control over network connections. Network control may stop unauthorized, guest, or non-compliant systems from accessing networks, and may control network traffic that may not be bypassed from the client level. In addition, network access control may control access to virtual private networks (VPN), where VPNs may be a communications network tunneled through another network, establishing a logical connection acting as a virtual network. In embodiments, a VPN may be treated in the same manner as a physical network. - The
security management facility 122 may provide host intrusion prevention through behavioral based protection, which may guard against unknown threats by analyzing behavior before software code executes. Behavioral based protection may monitor code when it runs and intervene if the code is deemed to be suspicious or malicious. Advantages of behavioral based protection over runtime protection may include code being prevented from running. Whereas runtime protection may only interrupt code that has already partly executed, behavioral protection can identify malicious code at the gateway or on the file servers and delete the code before it can reach endpoint computers and the like. - The
security management facility 122 may provide reputation filtering, which may target or identify sources of known malware. For instance, reputation filtering may include lists of URIs of known sources of malware or known suspicious IP addresses, or domains, say for spam, that when detected may invoke an action by thethreat management facility 100, such as dropping them immediately. By dropping the source before any interaction can initiate, potential threat sources may be thwarted before any exchange of data can be made. - In embodiments, information may be sent from the enterprise back to a third party, a vendor, or the like, which may lead to improved performance of the
threat management facility 100. For example, the types, times, and number of virus interactions that a client experiences may provide useful information for the preventions of future virus threats. This type of feedback may be useful for any aspect of threat detection. Feedback of information may also be associated with behaviors of individuals within the enterprise, such as being associated with most common violations of policy, network access, unauthorized application loading, unauthorized external device use, and the like. In embodiments, this type of information feedback may enable the evaluation or profiling of client actions that are violations of policy that may provide a predictive model for the improvement of enterprise policies. - The
security management facility 122 may support overall security of theenterprise facility 102 network or set ofenterprise facility 102 networks, e.g., by providing updates of malicious code information to theenterprise facility 102 network and associated client facilities. The updates may include a planned update, an update in reaction to a threat notice, an update in reaction to a request for an update, an update based on a search of known malicious code information, or the like. Theadministration facility 134 may provide control over thesecurity management facility 122 when updates are performed. The updates may be automatically transmitted without an administration facility's 134 direct control, manually transmitted by theadministration facility 134, or otherwise distributed. Thesecurity management facility 122 may manage the receipt of malicious code descriptions from a provider, distribution of the malicious code descriptions toenterprise facility 102 networks, distribution of the malicious code descriptions to client facilities, and so forth. - The
threat management facility 100 may provide apolicy management facility 112 that may be able to block non-malicious applications, such as VoIP, instant messaging, peer-to-peer file-sharing, and the like, that may undermine productivity and network performance within theenterprise facility 102. Thepolicy management facility 112 may be a set of rules or policies that may indicateenterprise facility 102 access permissions for the client facility, such as access permissions associated with the network, applications, external computer devices, and the like. Thepolicy management facility 112 may include a database, a text file, a combination of databases and text files, or the like. In an embodiment, a policy database may be a block list, a black list, an allowed list, a white list, or the like that may provide a list ofenterprise facility 102 external network locations/applications that may or may not be accessed by the client facility. Thepolicy management facility 112 may include rules that may be interpreted with respect to anenterprise facility 102 network access request to determine if the request should be allowed. The rules may provide a generic rule for the type of access that may be granted. The rules may be related to the policies of anenterprise facility 102 for access rights for the enterprise facility's 102 client facility. For example, there may be a rule that does not permit access to sporting websites. When a website is requested by the client facility, a security facility may access the rules within a policy facility to determine if the requested access is related to a sporting website. In an embodiment, the security facility may analyze the requested website to determine if the website matches with any of the policy facility rules. - The
policy management facility 112 may be similar to thesecurity management facility 122 but with the addition ofenterprise facility 102 wide access rules and policies that may be distributed to maintain control of client facility access toenterprise facility 102 network resources. The policies may be defined for application type, subset of application capabilities, organization hierarchy, computer facility type, user type, network location, time of day, connection type, or the like. Policies may be maintained by theadministration facility 134, through thethreat management facility 100, in association with a third party, or the like. For example, a policy may restrict IM activity to only support personnel for communicating with customers. This may allow communication for departments requiring access, but may maintain the network bandwidth for other activities by restricting the use of IM to only the personnel that need access to instant messaging (IM) in support of theenterprise facility 102. In an embodiment, thepolicy management facility 112 may be a stand-alone application, may be part of the network server facility 142, may be part of theenterprise facility 102 network, may be part of the client facility, or the like. - The
threat management facility 100 may provide configuration management, which may be similar to policy management, but may specifically examine the configuration set of applications, operating systems, hardware, and the like, and manage changes to their configurations. Assessment of a configuration may be made against a standard configuration policy, detection of configuration changes, remediation of improper configuration, application of new configurations, and the like. An enterprise may keep a set of standard configuration rules and policies which may represent the desired state of the device. For example, a client firewall may be running and installed, but in the disabled state, where remediation may be to enable the firewall. In another example, the enterprise may set a rule that disallows the use of USB disks, and sends a configuration change to all clients, which turns off USB drive access via a registry. - The
threat management facility 100 may also provide for the removal of applications that potentially interfere with the operation of thethreat management facility 100, such as competitor products that may also be attempting similar threat management functions. The removal of such products may be initiated automatically whenever such products are detected. In the case where such applications are services are provided indirectly through a third-party product, the application may be suspended until action is taken to remove or disable the third-party product's protection facility. - Threat management against a quickly evolving malware environment may require timely updates, and thus an
update management facility 120 may be provided by thethreat management facility 100. In addition, apolicy management facility 112 may also require update management (e.g., as provided by theupdate facility 120 herein described). The update management for thesecurity facility 122 andpolicy management facility 112 may be provided directly by thethreat management facility 100, such as by a hosted system or in conjunction with theadministration facility 134. In embodiments, thethreat management facility 100 may provide for patch management, where a patch may be an update to an operating system, an application, a system tool, or the like, where one of the reasons for the patch is to reduce vulnerability to threats. - The
security facility 122 andpolicy management facility 112 may push information to theenterprise facility 102 network and/or client facility. Theenterprise facility 102 network and/or client facility may also or instead pull information from thesecurity facility 122 andpolicy management facility 112 network server facilities 142, or there may be a combination of pushing and pulling of information between thesecurity facility 122 and thepolicy management facility 112 network servers 142,enterprise facility 102 network, and client facilities, or the like. For example, theenterprise facility 102 network and/or client facility may pull information from thesecurity facility 122 andpolicy management facility 112 network server facility 142 may request the information using thesecurity facility 122 andpolicy management facility 112 update module; the request may be based on a certain time period, by a certain time, by a date, on demand, or the like. In another example, thesecurity facility 122 andpolicy management facility 112 network servers 142 may push the information to the enterprise facility's 102 network and/or client facility by providing notification that there are updates available for download and then transmitting the information. The combination of thesecurity management 122 network server facility 142 and security update module may function substantially the same as thepolicy management facility 112 network server and policy update module by providing information to theenterprise facility 102 network and the client facility in a push or pull method. In an embodiment, thepolicy management facility 112 and thesecurity facility 122 management update modules may work in concert to provide information to the enterprise facility's 102 network and/or client facility for control of application execution. In an embodiment, the policy update module and security update module may be combined into a single update module. - As threats are identified and characterized, the
threat management facility 100 may create definition updates that may be used to allow thethreat management facility 100 to detect and remediate the latest malicious software, unwanted applications, configuration and policy changes, and the like. Thethreat definition facility 114 may contain threat identification updates, also referred to as definition files. A definition file may be a virus identity file that may include definitions of known or potential malicious code. The virus identity (IDE) definition files may provide information that may identify malicious code within files, applications, or the like. The definition files may be accessed bysecurity management facility 122 when scanning files or applications within the client facility for the determination of malicious code that may be within the file or application. The definition files may contain a number of commands, definitions, or instructions, to be parsed and acted upon, or the like. In embodiments, the client facility may be updated with new definition files periodically to provide the client facility with the most recent malicious code definitions; the updating may be performed on a set time period, may be updated on demand from the client facility, may be updated on demand from the network, may be updated on a received malicious code alert, or the like. In an embodiment, the client facility may request an update to the definition files from anupdate facility 120 within the network, may request updated definition files from a computing facility external to the network, updated definition files may be provided to theclient facility 114 from within the network, definition files may be provided to the client facility from an external computing facility from an external network, or the like. - A
definition management facility 114 may provide timely updates of definition files information to the network, client facilities, and the like. New and altered malicious code and malicious applications may be continually created and distributed to networks worldwide. The definition files that maintain the definitions of the malicious code and malicious application information for the protection of the networks and client facilities may need continual updating to provide continual defense of the network and client facility from the malicious code and malicious applications. The definition files management may provide for automatic and manual methods of updating the definition files. In embodiments, the network may receive definition files and distribute the definition files to the network client facilities, the client facilities may receive the definition files directly, or the network and client facilities may both receive the definition files, or the like. In an embodiment, the definition files may be updated on a fixed periodic basis, on demand by the network and/or the client facility, as a result of an alert of a new malicious code or malicious application, or the like. In an embodiment, the definition files may be released as a supplemental file to an existing definition files to provide for rapid updating of the definition files. - In a similar manner, the
security management facility 122 may be used to scan an outgoing file and verify that the outgoing file is permitted to be transmitted per theenterprise facility 102 rules and policies. By checking outgoing files, thesecurity management facility 122 may be able discover malicious code infected files that were not detected as incoming files as a result of the client facility having been updated with either new definition files orpolicy management facility 112 information. The definition files may discover the malicious code infected file by having received updates of developing malicious code from theadministration facility 134, updates from a definition files provider, or the like. Thepolicy management facility 112 may discover the malicious code infected file by having received new updates from theadministration facility 134, from a rules provider, or the like. - The
threat management facility 100 may provide controlled access to theenterprise facility 102 networks. For instance, a manager of theenterprise facility 102 may want to restrict access to certain applications, networks, files, printers, servers, databases, or the like. In addition, the manager of theenterprise facility 102 may want to restrict user access based on certain criteria, such as the user's location, usage history, need to know, job position, connection type, time of day, method of authentication, client-system configuration, or the like. Network access rules may be developed for theenterprise facility 102, or pre-packaged by a supplier, and managed by thethreat management facility 100 in conjunction with theadministration facility 134. - A network
access rules facility 124 may be responsible for determining if a client facility application should be granted access to a requested network location. The network location may be on the same network as the facility or may be on another network. In an embodiment, the networkaccess rules facility 124 may verify access rights for client facilities from within the network or may verify access rights of computer facilities from external networks. When network access for a client facility is denied, the networkaccess rules facility 124 may send an information file to the client facility containing. For example, the information sent by the networkaccess rules facility 124 may be a data file. The data file may contain a number of commands, definitions, instructions, or the like to be parsed and acted upon through theremedial action facility 128, or the like. The information sent by the network accessfacility rules facility 124 may be a command or command file that theremedial action facility 128 may access and take action upon. - The network
access rules facility 124 may include databases such as a block list, a black list, an allowed list, a white list, an unacceptable network site database, an acceptable network site database, a network site reputation database, or the like of network access locations that may or may not be accessed by the client facility. Additionally, the networkaccess rules facility 124 may incorporate rule evaluation; the rule evaluation may parse network access requests and apply the parsed information to network access rules. The networkaccess rule facility 124 may have a generic set of rules that may be in support of an enterprise facility's 102 network access policies, such as denying access to certain types of websites, controlling instant messenger accesses, or the like. Rule evaluation may include regular expression rule evaluation, or other rule evaluation method for interpreting the network access request and comparing the interpretation to the established rules for network access. In an embodiment, the networkaccess rules facility 124 may receive a rules evaluation request from the network access control and may return the rules evaluation to the network access control. - Similar to the
threat definitions facility 114, the networkaccess rule facility 124 may provide updated rules and policies to theenterprise facility 102. The networkaccess rules facility 124 may be maintained by thenetwork administration facility 134, using networkaccess rules facility 124 management. In an embodiment, thenetwork administration facility 134 may be able to maintain a set of access rules manually by adding rules, changing rules, deleting rules, or the like. Additionally, theadministration facility 134 may retrieve predefined rule sets from a remote provider of a set of rules to be applied to anentire enterprise facility 102. Thenetwork administration facility 134 may be able to modify the predefined rules as needed for aparticular enterprise facility 102 using the network accessrules management facility 124. - When a threat or policy violation is detected by the
threat management facility 100, thethreat management facility 100 may perform or initiate aremedial action facility 128. Remedial action may take a plurality of forms, such as terminating or modifying an ongoing process or interaction, sending a warning to a client oradministration facility 134 of an ongoing process or interaction, executing a program or application to remediate against a threat or violation, record interactions for subsequent evaluation, or the like. Remedial action may be associated with an application that responds to information that a client facility network access request has been denied. In an embodiment, when the data file is received, remedial action may parse the data file, interpret the various aspects of the data file, and act on the parsed data file information to determine actions to be taken on an application requesting access to a denied network location. In an embodiment, when the data file is received, remedial action may access the threat definitions to parse the data file and determine an action to be taken on an application requesting access to a denied network location. In an embodiment, the information received from the facility may be a command or a command file. The remedial action facility may carry out any commands that are received or parsed from a data file from the facility without performing any interpretation of the commands. In an embodiment, the remedial action facility may interact with the received information and may perform various actions on a client requesting access to a denied network location. The action may be one or more of continuing to block all requests to a denied network location, a malicious code scan on the application, a malicious code scan on the client facility, quarantine of the application, terminating the application, isolation of the application, isolation of the client facility to a location within the network that restricts network access, blocking a network access port from a client facility, reporting the application to anadministration facility 134, or the like. - Remedial action may be provided as a result of a detection of a threat or violation. The
detection techniques facility 130 may include monitoring theenterprise facility 102 network or endpoint devices, such as by monitoring streaming data through the gateway, across the network, through routers and hubs, and the like. Thedetection techniques facility 130 may include monitoring activity and stored files on computing facilities, such as on server facilities 142, desktop computers, laptop computers, other mobile computing devices, and the like. Detection techniques, such as scanning a computer's stored files, may provide the capability of checking files for stored threats, either in the active or passive state. Detection techniques, such as streaming file management, may provide the capability of checking files received at the network, gateway facility, client facility, and the like. This may provide the capability of not allowing a streaming file or portions of the streaming file containing malicious code from entering the client facility, gateway facility, or network. In an embodiment, the streaming file may be broken into blocks of information, and a plurality of virus identities may be used to check each of the blocks of information for malicious code. In an embodiment, any blocks that are not determined to be clear of malicious code may not be delivered to the client facility, gateway facility, or network. - Verifying that the
threat management facility 100 is detecting threats and violations to established policy, may require the ability to test the system, either at the system level or for a particular computing component. Thetesting facility 118 may allow theadministration facility 134 to coordinate the testing of the security configurations of client facility computing facilities on a network. Theadministration facility 134 may be able to send test files to a set of client facility computing facilities to test the ability of the client facility to determine acceptability of the test file. After the test file has been transmitted, a recording facility may record the actions taken by the client facility in reaction to the test file. The recording facility may aggregate the testing information from the client facility and report the testing information to theadministration facility 134. Theadministration facility 134 may be able to determine the level of preparedness of the client facility computing facilities by the reported information. Remedial action may be taken for any of the client facility computing facilities as determined by theadministration facility 134; remedial action may be taken by theadministration facility 134 or by the user of the client facility. - The
threat research facility 132 may provide a continuously ongoing effort to maintain the threat protection capabilities of thethreat management facility 100 in light of continuous generation of new or evolved forms of malware. Threat research may include researchers and analysts working on known and emerging malware, such as viruses, rootkits a spyware, as well as other computer threats such as phishing, spam, scams, and the like. In embodiments, through threat research, thethreat management facility 100 may be able to provide swift, global responses to the latest threats. - The
threat management facility 100 may provide threat protection to theenterprise facility 102, where theenterprise facility 102 may include a plurality of networked components, such as client facility, server facility 142,administration facility 134, firewall 138, gateway, hubs and routers 148, threat management appliance 140, desktop users, mobile users, and the like. In embodiments, it may be the endpointcomputer security facility 152, located on a computer's desktop, which may provide threat protection to a user, and associatedenterprise facility 102. In embodiments, the term endpoint may refer to a computer system that may source data, receive data, evaluate data, buffer data, or the like (such as a user's desktop computer as an endpoint computer), a firewall as a data evaluation endpoint computer system, a laptop as a mobile endpoint computer, a personal digital assistant or tablet as a hand-held endpoint computer, a mobile phone as an endpoint computer, or the like. In embodiments, endpoint may refer to a source or destination for data, including such components where the destination is characterized by an evaluation point for data, and where the data may be sent to a subsequent destination after evaluation. The endpointcomputer security facility 152 may be an application loaded onto the computer platform or computer support component, where the application may accommodate the plurality of computer platforms and/or functional requirements of the component. For instance, a client facility computer may be one of a plurality of computer platforms, such as Windows, Macintosh, Linux, and the like, where the endpointcomputer security facility 152 may be adapted to the specific platform, while maintaining a uniform product and product services across platforms. Additionally, components may have different functions to serve within the enterprise facility's 102 networked computer-based infrastructure. For instance, computer support components provided as hubs and routers 148, server facility 142, firewalls 138, and the like, may require unique security application software to protect their portion of the system infrastructure, while providing an element in an integrated threat management system that extends out beyond thethreat management facility 100 to incorporate all computer resources under its protection. - The
enterprise facility 102 may include a plurality of client facility computing platforms on which the endpointcomputer security facility 152 is adapted. A client facility computing platform may be a computer system that is able to access a service on another computer, such as a server facility 142, via a network. This client facility server facility 142 model may apply to a plurality of networked applications, such as a client facility connecting to anenterprise facility 102 application server facility 142, a web browser client facility connecting to a web server facility 142, an e-mail client facility retrieving e-mail from anInternet 154 service provider's mail storage servers 142, and the like. In embodiments, traditional large client facility applications may be switched to websites, which may increase the browser's role as a client facility. Clients 144 may be classified as a function of the extent to which they perform their own processing. For instance, client facilities are sometimes classified as a fat client facility or thin client facility. The fat client facility, also known as a thick client facility or rich client facility, may be a client facility that performs the bulk of data processing operations itself, and does not necessarily rely on the server facility 142. The fat client facility may be most common in the form of a personal computer, where the personal computer may operate independent of any server facility 142. Programming environments for fat clients 144 may include CURT, Delphi, Droplets, Java, win32, X11, and the like. Thin clients 144 may offer minimal processing capabilities, for instance, the thin client facility may primarily provide a graphical user interface provided by an application server facility 142, which may perform the bulk of any required data processing. Programming environments for thin clients 144 may include JavaScript/AJAX, ASP, JSP, Ruby on Rails, Python's Django, PHP, and the like. The client facility may also be a mix of the two, such as processing data locally, but relying on a server facility 142 for data storage. As a result, this hybrid client facility may provide benefits from both the fat client facility type, such as multimedia support and high performance, and the thin client facility type, such as high manageability and flexibility. In embodiments, thethreat management facility 100, and associated endpointcomputer security facility 152, may provide seamless threat protection to the plurality of clients 144, and client facility types, across theenterprise facility 102. - The
enterprise facility 102 may include a plurality of server facilities 142, such as application servers, communications servers, file servers, database servers, proxy servers, mail servers, fax servers, game servers, web servers, and the like. A server facility 142, which may also be referred to as a server facility 142 application, server facility 142 operating system, server facility 142 computer, or the like, may be an application program or operating system that accepts client facility connections in order to service requests from clients 144. The server facility 142 application may run on the same computer as the client facility using it, or the server facility 142 and the client facility may be running on different computers and communicating across the network. Server facility 142 applications may be divided among server facility 142 computers, with the dividing depending upon the workload. For instance, under light load conditions all server facility 142 applications may run on a single computer and under heavy load conditions a single server facility 142 application may run on multiple computers. In embodiments, thethreat management facility 100 may provide threat protection to server facilities 142 within theenterprise facility 102 as load conditions and application changes are made. - A server facility 142 may also be an appliance facility 140, where the appliance facility 140 provides specific services onto the network. Though the appliance facility 140 is a server facility 142 computer, that may be loaded with a server facility 142 operating system and server facility 142 application, the
enterprise facility 102 user may not need to configure it, as the configuration may have been performed by a third party. In an embodiment, anenterprise facility 102 appliance may be a server facility 142 appliance that has been configured and adapted for use with thethreat management facility 100, and located within the facilities of theenterprise facility 102. The enterprise facility's 102 threat management appliance may enable theenterprise facility 102 to administer an on-site local managed threat protection configuration, where theadministration facility 134 may access the threat resources through an interface, such as a web portal. In an alternate embodiment, theenterprise facility 102 may be managed remotely from a third party, vendor, or the like, without an appliance facility 140 located within theenterprise facility 102. In this instance, the appliance functionality may be a shared hardware product between pluralities ofenterprises 102. In embodiments, the appliance facility 140 may be located at theenterprise facility 102, where theenterprise facility 102 maintains a degree of control. In embodiments, a hosted service may be provided, where the appliance 140 may still be an on-site black box to theenterprise facility 102, physically placed there because of infrastructure requirements, but managed by a third party, vendor, or the like. - Simple server facility 142 appliances may also be utilized across the enterprise facility's 102 network infrastructure, such as switches, routers, wireless routers, hubs and routers, gateways, print servers, net modems, and the like. These simple server facility appliances may not require configuration by the
enterprise facility 102, but may require protection from threats via an endpointcomputer security facility 152. These appliances may provide interconnection services within theenterprise facility 102 network, and therefore may advance the spread of a threat if not properly protected. - A client facility may be protected from threats from within the
enterprise facility 102 network using a personal firewall, which may be a hardware firewall, software firewall, or combination of these, that controls network traffic to and from a client. The personal firewall may permit or deny communications based on a security policy. Personal firewalls may be designed for use by end-users, which may result in protection for only the computer on which it's installed. Personal firewalls may be able to control network traffic by providing prompts each time a connection is attempted and adapting security policy accordingly. Personal firewalls may also provide some level of intrusion detection, which may allow the software to terminate or block connectivity where it suspects an intrusion is being attempted. Other features that may be provided by a personal firewall may include alerts about outgoing connection attempts, control of program access to networks, hiding the client from port scans by not responding to unsolicited network traffic, monitoring of applications that may be listening for incoming connections, monitoring and regulation of incoming and outgoing network traffic, prevention of unwanted network traffic from installed applications, reporting applications that make connection attempts, reporting destination servers with which applications may be attempting communications, and the like. In embodiments, the personal firewall may be provided by thethreat management facility 100. - Another important component that may be protected by an endpoint
computer security facility 152 is a network firewall facility 138, which may be a hardware or software device that may be configured to permit, deny, or proxy data through a computer network that has different levels of trust in its source of data. For instance, aninternal enterprise facility 102 network may have a high level of trust, because the source of all data has been sourced from within theenterprise facility 102. An example of a low level of trust is theInternet 154, because the source of data may be unknown. A zone with an intermediate trust level, situated between theInternet 154 and a trusted internal network, may be referred to as a “perimeter network.” Since firewall facilities 138 represent boundaries between threat levels, the endpointcomputer security facility 152 associated with the firewall facility 138 may provide resources that may control the flow of threats at thisenterprise facility 102 network entry point. Firewall facilities 138, and associated endpointcomputer security facility 152, may also be associated with a network node that may be equipped for interfacing between networks that use different protocols. In embodiments, the endpointcomputer security facility 152 may provide threat protection in a plurality of network infrastructure locations, such as at theenterprise facility 102 network entry point, e.g., the firewall facility 138 or gateway; at the server facility 142; at distribution points within the network, e.g., the hubs and routers 148; at the desktop of client facility computers; and the like. In embodiments, the most effective location for threat detection may be at the user's computer desktop endpointcomputer security facility 152. - The interface between the
threat management facility 100 and theenterprise facility 102, and through the appliance facility 140 to embedded endpoint computer security facilities, may include a set of tools that may be the same for all enterprise implementations, but allow each enterprise to implement different controls. In embodiments, these controls may include both automatic actions and managed actions. Automatic actions may include downloads of the endpointcomputer security facility 152 to components of theenterprise facility 102, downloads of updates to existing endpoint computer security facilities of theenterprise facility 102, uploaded network interaction requests fromenterprise facility 102 components to thethreat management facility 100, and the like. In embodiments, automatic interactions between theenterprise facility 102 and thethreat management facility 100 may be configured by thethreat management facility 100 and anadministration facility 134 in theenterprise facility 102. Theadministration facility 134 may configure policy rules that determine interactions, such as developing rules for accessing applications, as in who is authorized and when applications may be used; establishing rules for ethical behavior and activities; rules governing the use of entertainment software such as games, or personal use software such as IM and VoIP; rules for determining access toenterprise facility 102 computing resources, including authentication, levels of access, risk assessment, and usage history tracking; rules for when an action is not allowed, such as whether an action is completely deigned or just modified in its execution; and the like. Theadministration facility 134 may also establish license management, which in turn may further determine interactions associated with a licensed application. In embodiments, interactions between thethreat management facility 100 and theenterprise facility 102 may provide threat protection to theenterprise facility 102 by managing the flow of network data into and out of theenterprise facility 102 through automatic actions that may be configured by thethreat management facility 100 or theadministration facility 134. - Client facilities within the
enterprise facility 102 may be connected to theenterprise facility 102 network by way ofwired network facilities 148A orwireless network facilities 148B. Client facilities connected to theenterprise facility 102 network via awired facility 148A orwireless facility 148B may receive similar protection, as both connection types are ultimately connected to thesame enterprise facility 102 network, with the same endpointcomputer security facility 152, and the same threat protectedenterprise facility 102 environment. Mobilewireless facility clients 144B-F, because of their ability to connect to anywireless 148B,D network access point, may connect to theInternet 154 outside theenterprise facility 102, and therefore outside the threat-protected environment of theenterprise facility 102. In this instance, the mobile client facility (e.g., the clients 144 B-F), if not for the presence of the endpointcomputer security facility 152 may experience a malware attack or perform actions counter toenterprise facility 102 established policies. In addition, there may be a plurality of ways for thethreat management facility 100 to protect the out-of-enterprise facility 102 mobile client facility (e.g., the clients 144 D-F) that has an embedded endpointcomputer security facility 152, such as by providing URI filtering in personal routers, using a web appliance as a DNS proxy, or the like. Mobile client facilities that are components of theenterprise facility 102 but temporarily outside connectivity with theenterprise facility 102 network may be provided with the same threat protection and policy control as client facilities inside theenterprise facility 102. In addition, mobile the client facilities may receive the same interactions to and from thethreat management facility 100 as client facilities inside theenterprise facility 102, where the mobile client facilities may be considered a virtual extension of theenterprise facility 102, receiving all the same services via their embedded endpointcomputer security facility 152. - Interactions between the
threat management facility 100 and the components of theenterprise facility 102, including mobile client facility extensions of theenterprise facility 102, may ultimately be connected through theInternet 154.Threat management facility 100 downloads and upgrades to theenterprise facility 102 may be passed from the firewalled networks of thethreat management facility 100 through to the endpointcomputer security facility 152 equipped components of theenterprise facility 102. In turn the endpointcomputer security facility 152 components of theenterprise facility 102 may upload policy and access requests back across theInternet 154 and through to thethreat management facility 100. TheInternet 154 however, is also the path through which threats may be transmitted from their source. Thesenetwork threats 104 may include threats from a plurality of sources, including without limitation, websites, e-mail, IM, VoIP, application software, and the like. These threats may attempt to attack a mobile enterprise client facility (e.g., theclients 144B-F) equipped with an endpointcomputer security facility 152, but in embodiments, as long as the mobile client facility is embedded with an endpointcomputer security facility 152, as described above, threats may have no better success than if the mobile client facility were inside theenterprise facility 102. - However, if the mobile client facility were to attempt to connect into an unprotected connection point, such as at a secondary location 108 that is not a part of the
enterprise facility 102, the mobile client facility may be required to request network interactions through thethreat management facility 100, where contacting thethreat management facility 100 may be performed prior to any other network action. In embodiments, the client facility's 144 endpointcomputer security facility 152 may manage actions in unprotected network environments such as when the client facility (e.g.,client 144F) is in a secondary location 108 or connecting wirelessly to anon-enterprise facility 102 wireless Internet connection, where the endpointcomputer security facility 152 may dictate what actions are allowed, blocked, modified, or the like. For instance, if the client facility's 144 endpointcomputer security facility 152 is unable to establish a secured connection to thethreat management facility 100, the endpointcomputer security facility 152 may inform the user of such, and recommend that the connection not be made. In the instance when the user chooses to connect despite the recommendation, the endpointcomputer security facility 152 may perform specific actions during or after the unprotected connection is made, including running scans during the connection period, running scans after the connection is terminated, storing interactions for subsequent threat and policy evaluation, contacting thethreat management facility 100 upon first instance of a secured connection for further actions and or scanning, restricting access to network and local resources, or the like. In embodiments, the endpointcomputer security facility 152 may perform specific actions to remediate possible threat incursions or policy violations during or after the unprotected connection. - The secondary location 108 may have no endpoint
computer security facilities 152 as a part of its computer components, such as itsfirewalls 138B,servers 142B,clients 144G, hubs androuters 148C-D, and the like. As a result, the computer components of the secondary location 108 may be open to threat attacks, and become potential sources of threats, as well as any mobileenterprise facility clients 144B-F that may be connected to the secondary location's 108 network. In this instance, these computer components may now unknowingly spread a threat to other components connected to the network. - Some threats may not come directly from the
Internet 154, such as from non-enterprise facility controlled mobile devices that are physically brought into theenterprise facility 102 and connected to theenterprise facility 102 client facilities. The connection may be made from direct connection with the enterprise facility's 102 client facility, such as through a USB port, or in physical proximity with the enterprise facility's 102 client facility such that a wireless facility connection can be established, such as through a Bluetooth connection. Thesephysical proximity threats 110 may be another mobile computing device, a portable memory storage device, a mobile communications device, or the like, such as CDs and DVDs, memory sticks, flash drives, external hard drives, cell phones, PDAs, MP3 players, digital cameras, point-to-point devices, digital picture frames, digital pens, navigation devices, tablets, appliances, and the like. Aphysical proximity threat 110 may have been previously infiltrated by network threats while connected to an unprotected network connection outside theenterprise facility 102, and when connected to theenterprise facility 102 client facility, pose a threat. Because of their mobile nature,physical proximity threats 110 may infiltrate computing resources in any location, such as being physically brought into theenterprise facility 102 site, connected to anenterprise facility 102 client facility while that client facility is mobile, plugged into an unprotected client facility at a secondary location 108, and the like. A mobile device, once connected to an unprotected computer resource, may become aphysical proximity threat 110. In embodiments, the endpointcomputer security facility 152 may provideenterprise facility 102 computing resources with threat protection againstphysical proximity threats 110, for instance, through scanning the device prior to allowing data transfers, through security validation certificates, through establishing a safe zone within theenterprise facility 102 computing resource to transfer data into for evaluation, and the like. - Having provided an overall context for threat detection, the description now turns to a brief discussion of an example of a computer system that may be used for any of the entities and facilities described above.
-
FIG. 2 illustrates a computer system. In general, thecomputer system 200 may include acomputing device 210 connected to anetwork 202, e.g., through anexternal device 204. Thecomputing device 210 may be or include any type of network endpoint or endpoints as described herein, e.g., with reference toFIG. 1 above. For example, thecomputing device 210 may include a desktop computer workstation. Thecomputing device 210 may also or instead be any device suitable for interacting with other devices over anetwork 202, such as a laptop computer, a desktop computer, a personal digital assistant, a tablet, a mobile phone, a television, a set top box, a wearable computer, and the like. Thecomputing device 210 may also or instead include a server such as any of the servers described herein. - The
computing device 210 may be used for any of the entities described in the threat management environment described above with reference toFIG. 1 . For example, thecomputing device 210 may be part of or may include a client an enterprise facility, a threat management facility, or any of the other facilities or computing devices described therein. In certain aspects, thecomputing device 210 may be implemented using hardware or a combination of software and hardware. Thecomputing device 210 may be a standalone device, a device integrated into another entity or device, a platform distributed across multiple entities, or a virtualized device executing in a virtualization environment. - The
network 202 may include any network described above, e.g., data network(s) or internetwork(s) suitable for communicating data and control information among participants in thecomputer system 200. This may include public networks such as the Internet, private networks, and telecommunications networks such as the Public Switched Telephone Network or cellular networks using third generation cellular technology (e.g., 3G or IMT-2000), fourth generation cellular technology (e.g., 4G, LTE. MT-Advanced, E-UTRA, etc.) or WiMax-Advanced (IEEE 802.16m)) and/or other technologies, as well as any of a variety of corporate area, metropolitan area, campus or other local area networks or enterprise networks, along with any switches, routers, hubs, gateways, and the like that might be used to carry data among participants in thecomputer system 200. Thenetwork 202 may also include a combination of data networks, and need not be limited to a strictly public or private network. - The
external device 204 may be any computer or other remote resource that connects to thecomputing device 210 through thenetwork 202. This may include threat management resources such as any of those contemplated above, gateways or other network devices, remote servers or the like containing content requested by thecomputing device 210, a network storage device or resource, a device hosting malicious content, or any other resource or device that might connect to thecomputing device 210 through thenetwork 202. - In general, the
computing device 210 may include aprocessor 212, amemory 214, anetwork interface 216, adata store 218, and one or more input/output interfaces 220. Thecomputing device 210 may further include or be in communication withperipherals 222 and other external input/output devices that might connect to the input/output interfaces 220. - The
processor 212 may be any processor or other processing circuitry capable of processing instructions for execution within thecomputing device 210 orcomputer system 200. Theprocessor 212 may include a single-threaded processor, a multi-threaded processor, a multi-core processor and so forth. Theprocessor 212 may be capable of processing instructions stored in thememory 214 or thedata store 218. - The
memory 214 may store information within thecomputing device 210. Thememory 214 may include any volatile or non-volatile memory or other computer-readable medium, including without limitation a Random-Access Memory (RAM), a flash memory, a Read Only Memory (ROM), a Programmable Read-only Memory (PROM), an Erasable PROM (EPROM), registers, and so forth. Thememory 214 may store program instructions, program data, executables, and other software and data useful for controlling operation of thecomputing device 210 and configuring thecomputing device 210 to perform functions for a user. Thememory 214 may include a number of different stages and types of memory for different aspects of operation of thecomputing device 210. For example, a processor may include on-board memory and/or cache for faster access to certain data or instructions, and a separate, main memory or the like may be included to expand memory capacity as desired. All such memory types may be a part of thememory 214 as contemplated herein. - The
memory 214 may, in general, include a non-volatile computer readable medium containing computer code that, when executed by thecomputing device 210 creates an execution environment for a computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of the foregoing, and that performs some or all of the steps set forth in the various flow charts and other algorithmic descriptions set forth herein. While asingle memory 214 is depicted, it will be understood that any number of memories may be usefully incorporated into thecomputing device 210. For example, a first memory may provide non-volatile storage such as a disk drive for permanent or long-term storage of files and code even when thecomputing device 210 is powered down. A second memory such as a random-access memory may provide volatile (but higher speed) memory for storing instructions and data for executing processes. A third memory may be used to improve performance by providing higher speed memory physically adjacent to theprocessor 212 for registers, caching and so forth. - The
network interface 216 may include any hardware and/or software for connecting thecomputing device 210 in a communicating relationship with other resources through thenetwork 202. This may include remote resources accessible through the Internet, as well as local resources available using short range communications protocols using, e.g., physical connections (e.g., Ethernet), radio frequency communications (e.g., WiFi), optical communications, (e.g., fiber optics, infrared, or the like), ultrasonic communications, or any combination of these or other media that might be used to carry data between thecomputing device 210 and other devices. Thenetwork interface 216 may, for example, include a router, a modem, a network card, an infrared transceiver, a radio frequency (RF) transceiver, a near field communications interface, a radio-frequency identification (RFID) tag reader, or any other data reading or writing resource or the like. - More generally, the
network interface 216 may include any combination of hardware and software suitable for coupling the components of thecomputing device 210 to other computing or communications resources. By way of example and not limitation, this may include electronics for a wired or wireless Ethernet connection operating according to the IEEE 802.11 standard (or any variation thereof), or any other short or long range wireless networking components or the like. This may include hardware for short range data communications such as Bluetooth or an infrared transceiver, which may be used to couple to other local devices, or to connect to a local area network or the like that is in turn coupled to adata network 202 such as the Internet. This may also or instead include hardware/software for a WiMax connection or a cellular network connection (using, e.g., CDMA, GSM, LTE, or any other suitable protocol or combination of protocols). Thenetwork interface 216 may be included as part of the input/output devices 220 or vice-versa. - The
data store 218 may be any internal memory store providing a computer-readable medium such as a disk drive, an optical drive, a magnetic drive, a flash drive, or other device capable of providing mass storage for thecomputing device 210. Thedata store 218 may store computer readable instructions, data structures, program modules, and other data for thecomputing device 210 orcomputer system 200 in a non-volatile form for subsequent retrieval and use. For example, thedata store 218 may store without limitation one or more of the operating system, application programs, program data, databases, files, and other program modules or other software objects and the like. - The input/
output interface 220 may support input from and output to other devices that might couple to thecomputing device 210. This may, for example, include serial ports (e.g., RS-232 ports), universal serial bus (USB) ports, optical ports, Ethernet ports, telephone ports, audio jacks, component audio/video inputs, HDMI ports, and so forth, any of which might be used to form wired connections to other local devices. This may also or instead include an infrared interface, RF interface, magnetic card reader, or other input/output system for coupling in a communicating relationship with other local devices. It will be understood that, while thenetwork interface 216 for network communications is described separately from the input/output interface 220 for local device communications, these two interfaces may be the same, or may share functionality, such as where a USB port is used to attach to a WiFi accessory, or where an Ethernet connection is used to couple to a local network attached storage. - A peripheral 222 may include any device used to provide information to or receive information from the
computing device 200. This may include human input/output (I/O) devices such as a keyboard, a mouse, a mouse pad, a track ball, a joystick, a microphone, a foot pedal, a camera, a touch screen, a scanner, or other device that might be employed by theuser 230 to provide input to thecomputing device 210. This may also or instead include a display, a speaker, a printer, a projector, a headset or any other audiovisual device for presenting information to a user. The peripheral 222 may also or instead include a digital signal processing device, an actuator, or other device to support control or communication to other devices or components. Other I/O devices suitable for use as a peripheral 222 include haptic devices, three-dimensional rendering systems, augmented-reality displays, and so forth. In one aspect, the peripheral 222 may serve as thenetwork interface 216, such as with a USB device configured to provide communications via short range (e.g., BlueTooth, WiFi, Infrared, RF, or the like) or long range (e.g., cellular data or WiMax) communications protocols. In another aspect, the peripheral 222 may provide a device to augment operation of thecomputing device 210, such as a global positioning system (GPS) device, a security dongle, or the like. In another aspect, the peripheral may be a storage device such as a flash card, USB drive, or other solid state device, or an optical drive, a magnetic drive, a disk drive, or other device or combination of devices suitable for bulk storage. More generally, any device or combination of devices suitable for use with thecomputing device 200 may be used as a peripheral 222 as contemplated herein. -
Other hardware 226 may be incorporated into thecomputing device 200 such as a co-processor, a digital signal processing system, a math co-processor, a graphics engine, a video driver, and so forth. Theother hardware 226 may also or instead include expanded input/output ports, extra memory, additional drives (e.g., a DVD drive or other accessory), and so forth. - A bus 232 or combination of busses may serve as an electromechanical platform for interconnecting components of the
computing device 200 such as theprocessor 212,memory 214,network interface 216,other hardware 226,data store 218, and input/output interface. As shown in the figure, each of the components of thecomputing device 210 may be interconnected using a system bus 232 or other communication mechanism for communicating information. - Methods and systems described herein may be realized using the
processor 212 of thecomputer system 200 to execute one or more sequences of instructions contained in thememory 214 to perform predetermined tasks. In embodiments, thecomputing device 200 may be deployed as a number of parallel processors synchronized to execute code together for improved performance, or thecomputing device 200 may be realized in a virtualized environment where software on a hypervisor or other virtualization management facility emulates components of thecomputing device 200 as appropriate to reproduce some or all of the functions of a hardware instantiation of thecomputing device 200. - Described herein are techniques for forensic analysis of computer processes. These forensic analysis techniques may use any of the components or systems described with reference to the figures above. For example, the techniques for forensic analysis for computer processes may be implemented by the
threat management facility 100 described with reference toFIG. 1 , e.g., for one or more endpoints included on anenterprise facility 102. Also, the forensic analysis techniques may utilize any of the features of thethreat management facility 100 described with reference toFIG. 1 , e.g., thedetection techniques 130. The techniques for forensic analysis for computer processes may also or instead be used for acomputing device 210 as described with reference toFIG. 2 above. - Forensic analysis for computer processes may include a root cause analysis—e.g., determining and analyzing an origin or root cause of a piece of malware. Techniques may include monitoring activity for one or more endpoints and recording the activity in a data recorder or the like. The data recorder may include a database or data store. The data recorder may act as a rolling buffer, e.g., storing a large amount of data for predetermined time windows before overwriting old data with new data. The data recorder may collect information about device activity, such as file creations, process creations, registry changes, memory injections, and so forth. In an aspect, when a beacon or trigger event is detected (e.g., an event pertinent to computer or network security), information from the data recorder may be analyzed (e.g., starting at the trigger event) to determine a root cause and to determine affected computing objects. Existing compromise detection techniques such as host intrusion prevention, malicious traffic detection, uniform resource locator (URL) blocking, file-based detection, and so on, may be used to detect the beacon or trigger event. In this manner, techniques for forensic analysis for computer processes may be combined with other malware and compromise prevention, detection, analysis, and remediation techniques such as any as described herein. An event graph may be generated showing connected events that are causally related to the detected event, e.g., based on one or more rules. Based on an analysis of these causally related events, the root cause of a detected event can be determined, and affected events going forward from the root cause can similarly be identified.
-
FIG. 3 illustrates a system for forensic analysis for computer processes. Thesystem 300 may include anendpoint 310 containing adata recorder 320, amonitoring facility 330, and any number ofobjects 312 andevents 314. Ananalysis facility 340 may be coupled in a communicating relationship with theendpoint 310 over adata network 350 such as any of the networks described above. It will be appreciated that, while illustrated as components of theendpoint 310, certain components of thesystem 300 such as thedata recorder 320 and themonitoring facility 330 and the analysis facility may also or instead be realized as remote services instantiated on a virtual appliance, a public or private cloud, or the like, any of which may be coupled to theendpoint 310 through thedata network 350 or another communication channel (not shown). Each of the components of thesystem 300 may be configured with suitable programming and configuration to participate in the various forensic techniques, threat detection techniques, and security management techniques contemplated herein. - The
endpoint 310 may be any of the endpoints described herein, e.g., a computing device in an enterprise network, or any other device or network asset that might join or participate in an enterprise or otherwise operate on an enterprise network. This may, for example, include a server, a client device such as a desktop computer or a mobile computing device (e.g., a laptop computer or a tablet), a cellular phone, a smart phone, or other computing device suitable for participating in thesystem 300 or in an enterprise. - In general, the
endpoint 310 may include any number of computing objects 312, which may for example, be processes executed by one or more processors or other processing circuitry, files or data stored in memory, or any other computing objects described herein. While the term object has a number of specific meanings in the art, and in particular in object-oriented programming, it will be understood that the term ‘object’ as used herein is intended to be significantly broader, and may include any data, process, file or combination of these including without limitation any process, application, executable, script, dynamic linked library (DLL), file, data, database, data source, data structure, function, resource locator (e.g., uniform resource locator (URL) or other uniform resource identifier (URI)), or the like that might be resident on theendpoint 310 and manipulated by theendpoint 310 or another component of thesystem 300 or other systems described elsewhere herein. Theobject 312 may also or instead include a remote resource, such as a resource identified in a URL. That is, while theobject 312 in the figure is depicted as residing on theendpoint 310, anobject 312 may also reside elsewhere in thesystem 300, and may be specified for example with a link, pointer, or reference that is locally stored on theendpoint 310. - The
object 312 may be an item that is performing an action or causing anevent 314, or theobject 312 may be an item that is receiving the action or is the result of an event 314 (e.g., theobject 312 may be an item in thesystem 300 being acted upon by anevent 314 or another object 312). In general, anevent 314 as contemplated herein may be any data flow, execution flow, control flow, network flow, or other similar action or event that might causally relateobjects 312 to one another. Where theobject 312 is data or includes data, theobject 312 may be encrypted or otherwise protected, or theobject 312 may be unencrypted or otherwise unprotected. Theobject 312 may be a process or other computing object that performs an action, which may include asingle event 314 or a collection or sequence ofevents 314 taken by a process. Theobject 312 may also or instead include an item such as a file or lines of code that are executable to perform such actions. Theobject 312 may also or instead include a computing component upon which an action is taken, e.g., a system setting (e.g., a registry key or the like), a data file, a URL, and so forth. Theobject 312 may exhibit a behavior such as an interaction with another object or a component of thesystem 300. -
Objects 312 may be described in terms of persistence. Theobject 312 may, for example, be a part of a process, and remain persistent as long as that process is alive. Theobject 312 may instead be persistent across anendpoint 310 and remain persistent as long as anendpoint 310 is active or alive. Theobject 312 may instead be a global object having persistence outside of anendpoint 310, such as a URL or a data store. In other words, theobject 312 may be a persistent object with persistence outside of theendpoint 310. - Although many if not
most objects 312 will typically be benign objects forming a normal part of the computing environment for anoperating endpoint 310, anobject 312 may contain software associated with an advanced persistent threat (APT) or other malware that resides partially or entirely on theendpoint 310. This associated software may have reached theendpoint 310 in a variety of ways, and may have been placed manually or automatically on theendpoint 310 by a malicious source. It will be understood that the associated software may take any number of forms and have any number of components. For example, the associated software may include an executable file that can execute independently, or the associated software may be a macro, plug-in, or the like that executes within another application. Similarly, the associated software may manifest as one or more processes or threads executing on theendpoint 310. Further, the associated software may install from a file on the endpoint 310 (or a file remote from the endpoint 310), and the associated software may create one or more files such as data files or the like while executing. Associated software should be understood to generally include all such files and processes except where a specific file or process is more specifically noted. - An
event 314 may include an action, a behavior, an interaction, and so forth. Theevent 314 may be generated by or otherwise related to anobject 312. For example, theevent 314 may be associated with a file and include an action such as a read, a write, an open, a move, a copy, a delete, and so forth. Theevent 314 may also or instead include an inter-process communication, e.g., a create, a handle, a debug, a remote injection, and so forth. Theevent 314 may also or instead include a network action such as accessing an Internet Protocol (IP) address or URL. - The
data recorder 320 may monitor and record activity related to theobjects 312 andevents 314 occurring on theendpoint 310. The activity of theendpoint 310 may be stored in adata log 322 or the like on thedata recorder 320, which may be stored locally on the endpoint 310 (as depicted) or remotely at a threat management resource, or some combination of these, such as where the data log 322 is periodically transmitted to a remote facility for archiving or analysis. Thedata recorder 320 may continuously record any activity occurring on theendpoint 310 for predetermined periods of time before overwriting previously recorded data. Thus, the data log 322 may include a continuous data feed ofevents 314. When anevent 314 is detected that is a beacon or trigger event (such as a file detection, a malicious traffic detection, or the like), the data log 322 may be saved and transmitted to ananalysis facility 340 or the like for analysis, e.g., to determine a root cause of the beacon or trigger event. The data log 322 may be used to create an event graph or other snapshot of the activity on theendpoint 310, e.g., for a period of time surrounding a beacon or trigger event. The beacon or trigger event may be detected locally by themonitoring facility 330, or remotely by a remote threat management facility or the like, or some combination of these. - While illustrated on the
endpoint 310, it will be understood that thedata recorder 320 may also or instead be implemented at a remote location such as a threat management facility or other enterprise network security resource, or some combination of these. Thedata recorder 320 may be provisioned on the same or a different device than a data store in which data is stored. Thedata recorder 320 may be configured to record data as efficiently as possible so as to minimize impact on theendpoint 310. - The
monitoring facility 330 may work in conjunction with thedata recorder 320 to instrument theendpoint 310 so that anyobservable events 314 by or involvingvarious objects 312 can be monitored and recorded. It will be appreciated that various filtering rules and techniques may be used to synopsize, summarize, filter, compress or otherwise process information captured by thedata recorder 320 to help ensure that relevant information is captured while maintaining practical limits on the amount of information that is gathered. - A
security product 332 may execute on theendpoint 310 to detect a security event on theendpoint 310, which may act as the beacon or trigger event for thesystem 300. Thesecurity product 332 may use techniques such as signature-based and behavioral-based malware detection including without limitation one or more of host intrusion prevention, malicious traffic detection, URL blocking, file-based detection, and so forth. - The beacon or trigger event on the
endpoint 310 may be a fully qualified (e.g., definitive) detection of a compromise or other malicious activity. In another aspect, the beacon or trigger event on theendpoint 310 may be a suspicious behavior that is suspicious but not confirmed as malicious. For example, the beacon or trigger event on theendpoint 310 may signal an unusual behavior that is known to commonly appear concurrently with the detection of malware. In an aspect, when the beacon or trigger event is a suspicious behavior, the data log 322 may be analyzed differently than when the beacon or trigger event is a confirmed malicious behavior. For example, the data log 322 may be sent to a different component of thesystem 300 through the network, e.g., to adifferent analysis facility 340. - The
monitoring facility 330 may be disposed remotely from theendpoint 310 oranalysis facility 340. Themonitoring facility 330 may be included on one or more of theendpoint 310 oranalysis facility 340. In an aspect, themonitoring facility 330 and theanalysis facility 340 included in the same component. - The
analysis facility 340 may analyze the data log 322, e.g., as part of a root cause analysis and to identifyobjects 312 compromised by the root cause. To this end, theanalysis facility 340 may utilize one ormore rules 342 for applying to the data included in the data log 322 to determine a root cause of a beacon or trigger event such as a suspected or actual security compromise on theendpoint 310. Theanalysis facility 340 may reside locally on the endpoint 310 (e.g., be a part of, embedded within, or locally coupled to the endpoint 310). Theanalysis facility 340 may be an external facility, or it may reside in a virtual appliance (e.g., which could be run by a protected set of systems on their own network systems), a private cloud, a public cloud, and so forth. Theanalysis facility 340 may store locally-derived threat information for use in subsequent identification, remediation, or other similar activity. Theanalysis facility 340 may also or instead receive threat information from a third-party source such as any public, private, educational, or other organization that gathers information on network threats and provides analysis and threat detection information for use by others. This third-party information may, for example, be used to improve detection rules or other forensic analysis that might be performed on information in the data log 322. - The
analysis facility 340 may create an event graph. In general, the event graph may represent information in the data log 322 in a graph whereobjects 312 are nodes andevents 314 are edges connecting the nodes to one another based on causal or other relationships as generally contemplated herein. The event graph may be used by theanalysis facility 340 or other component(s) of thesystem 300 as part of a root cause analysis and to identifyobjects 312 compromised by the root cause. The event graph may also or instead be displayed to a user of thesystem 300 orendpoint 310, e.g., using an interactive user interface or the like. - The
system 300 may advantageously use the data log 322 to configure and initialize an analysis in a sandboxed or otherwise isolated environment where the execution of the recorded activity related to a detected security event is allowed to run. That is, rather than uploading a complete image of anendpoint 310 using conventional techniques, the data log 322 may include only a series of events/processes related to the detected event that may be uploaded for execution/analysis. The analysis may thus include executing this series of events/processes in the same order to determine a threat level for theendpoint 310. - The data log 322 may include data from a
single endpoint 310, or from a number ofendpoints 310, for example where oneendpoint 310 accesses a service or a file on another endpoint. This advantageously facilitates tracking or detection of potentially malicious activity that spans multiple devices, particularly where the behavior on a single endpoint does not appear malicious. Thus, themonitoring facility 330 may monitor activity from anendpoint 310 exclusively, or use the full context of activity from all protectedendpoints 310, or some combination of these. Similarly, the event graph generated from the data log 322 may include activity from oneendpoint 310 exclusively, or use the full context of activity from all protectedendpoints 310, or some combination of these. Data logs 322 and event graphs may also or instead be stored for future analyses, e.g., for comparing to future data logs and event graphs. - Similarly, the events may include human interactions such as keyboard strokes, mouse clicks or other input and output to human interface devices and hardware. This usefully permits discrimination within causal chains among events initiated by processes executing on a device and events that are initiated or controlled by a human user that is present on the endpoint.
-
FIG. 4 is a flowchart of a method for forensic analysis for computer processes. Themethod 400 may be implemented by any of the systems described above or otherwise herein. Themethod 400 may be used as part of a root cause analysis, e.g., for determining a root cause of malware on an endpoint, and for identifying computing objects affected by malware, e.g., computing objects causally related to the root cause. - As shown in
step 402, themethod 400 may include monitoring events on a device, such as a first endpoint. The events may be any as described herein, e.g., events associated with computing objects on the endpoint. The computing objects may, for example include a data file, a process, an application, a registry entry, a network address, a peripheral device, or any of the other computing objects described herein. For example, in an aspect, the computing objects may include one or more network addresses specified at any suitable level of abstraction or according to any suitable protocol such as a uniform resource locator (URL), an Internet Protocol (IP) address, and a domain name, and may include any or a portion of associated path information or the like that might be associated therewith. The computing objects may also or instead include a peripheral device such as a universal serial bus (USB) memory, a camera, a printer, a memory card, a removable bulk storage device, a keyboard, a mouse, a track pad, a printer, a scanner, a cellular phone, or any other input or output device that might usefully be connected to an endpoint, a server, a mobile device, and so forth. Events may include information or messages from a threat management facility, firewall, network device, and so on, for example, that may be resident on or in communication with an endpoint. For example, a threat management facility may identify a potential or actual threat, and this may be treated as an event. - In an aspect, monitoring events on a first endpoint may include instrumenting a first endpoint to monitor a number of causal relationships among a number of computing objects. For example, a monitoring facility or other monitoring component (e.g., a component disposed on the first endpoint or otherwise in communication with the first endpoint), may be configured to detect computing objects and to monitor events on the first endpoint that associate the computing objects in a number of causal relationships. Thus, a processor and a memory disposed on the endpoint may be configured to monitor events on the endpoint. A remote server may also or instead be configured to monitor events on the endpoint, for example, to create a data log as contemplated herein.
- Implementations may also or instead include monitoring events on multiple endpoints, e.g., endpoints included in an enterprise network or the like. Thus, in an aspect, the one or more computing objects include at least one or more computing object(s) on a device other than the first endpoint, such as a second endpoint in the enterprise network. The device may also or instead include a server configured to provide remote resources to other endpoints, network devices, firewalls, gateways, routers, wireless access points, mobile devices, and so forth.
- The causal relationships monitored by the system may include dependencies that form a link or an association between computing objects or events. Useful causal relationships may include a data flow, e.g., linking computing objects based on the flow of data from one computing object to another computing object. The causal relationships may also or instead include a control flow. For example, a first computer program may generate a first event that triggers a second computer program to trigger a second event, thereby creating a causal relationship between the first computer program and the second computer program (and possibly a causal relationship between the first event and the second event). In yet another aspect, the causal relationships may include a network flow. For example, a computing object may access a URL or other remote resource or location and receive data. In this example, there may be a causal relationship between one or more of the computing object, the URL, and the data. It will be understood that the term “causal relationship” and the like is intended to cover a wide range of relationships between computing objects that might be formed by events, and unless explicitly stated to the contrary or otherwise clear from the text, the causal relationships may include anything that can link or associate multiple computing objects (of the same type or different types), e.g., in a directional manner, directly or indirectly.
- As shown in
step 404, themethod 400 may include recording events such as any of the events described above that occur on the endpoint. Thus, each event detected during monitoring may be recorded, e.g., by a data recorder or other component, to provide a data log including a sequence of events causally relating the number of computing objects. As described above, the data recorder may be configured to record events that occur on the endpoint, or events that occur on a plurality of endpoints. The data recorder may be locally disposed on the endpoint or otherwise in communication with the endpoint. The data recorder may also or instead be associated with a monitoring facility or an analysis facility such as any of those described above. The data recorder may record a sequence of events causally relating a number of computing objects on one or more endpoints in a data log or the like disposed in a memory. - A number of events within the sequence of events may be preserved for a predetermined time window. For example, in an aspect, a data recorder or the like may record all activity on an endpoint in a rolling buffer that overwrites data that is older than the predetermined time window. This may be true regardless of the types of computing objects associated with the sequence of events. In another aspect, the predetermined time window may have a different duration for different types of computing objects (e.g., for at least two types of computing objects). By way of example, when the computing objects include one or more network addresses, the sequence of events may be preserved for a longer predetermined time window relative to a sequence of events associated with data files, or vice-versa. Similarly, when the computing objects include one or more peripheral devices such as USB memories, the sequence of events may be preserved for longer predetermined time window relative to a sequence of events associated with applications, or vice-versa. In implementations, the predetermined time window for which the sequence of events is preserved may be based on the likelihood of a security event originating from a certain type of computing object. For example, the reputation of a computing object (e.g., an application) or a machine state may be used for determining the duration of the predetermined time window for which the sequence of events is preserved. Further, the predetermined time window for which the sequence of events is preserved may be determined by a color of a computing object or event, e.g., as described in U.S. patent application Ser. No. 14/485,759 filed on Sep. 14, 2014, which is incorporated by reference herein in its entirety. In an aspect, the time window for which the sequence of events is preserved may be variable or adjustable. For example, a user or administrator using a user interface or the like may adjust the time window for which the sequence of events is preserved, e.g., based on computing object type or otherwise. For example, one or more first event types may be recorded with a first time window and one or more second event types may be recorded with a second time window.
- In an aspect, the data recorder or the like may record only certain activity on an endpoint, e.g., activity associated with predetermined computing objects. The activity may be preserved for a predetermined amount of time dependent upon the specific computing object to which the activity is associated. In this manner, and by way of example, the data recorder or the like may include a record of data for one week for applications, for three months for files, for two weeks for registry entries, and so forth. It will be understood that these timeframes are provided by way of example and not of limitation.
- In general, data may be continuously recorded, periodically recorded, or some combination of these. Furthermore, data may be cached, stored, deleted or transmitted to a remote processing facility in any suitable manner consistent with appropriate use of local and remote resources, and the utility or potential utility of information that is being recorded. In one aspect, data may be periodically deleted or otherwise removed from the data recorder, such as after a security event has been detected and addressed as described below. A new data log may then be created for recording subsequent events on the one or more endpoints.
- As shown in
step 406, themethod 400 may include evaluating one or more events that occur on the endpoint. The evaluation of the one or more events may include the application of one or more security rules to determine whether the one or more events indicate or suggest a security event such as a security compromise event, a data exposure, a malware detection, or the like. Thus, the evaluation of the one or more events may lead to the detection of a security event. While illustrated as a separate step, thisstep 406 may be performed concurrently with or in sequence with themonitoring step 402 discussed above. - The security event may be any beacon or trigger event, such as any of those discussed herein. The security event may include an event that is related to network security, computer security, data security, data leakage, data exposure, or any other actual or potential security issue. The security event may also or instead include other events of interest that are not directly related to computer/network security where, for example, they are useful for otherwise auditing or monitoring machines or characterizing device behavior. Thus, the security event may be any event general related to operation of a computer, and does not necessarily include an actual security compromise event. However, in implementations, the security event may include an actual compromise to a network, an endpoint, or a computer system such as the detection of malware or any other threat detection. For example, the security event may be a security compromise event related to a specific threat, e.g., an event related to computer-based malware including without limitation a virus, spyware, adware, a Trojan, an intrusion, an advanced persistent threat, spam, a policy abuse, an uncontrolled access, and so forth.
- Detecting the security event may include detecting a security compromise by applying a static analysis to software objects on the first endpoint. For example, each software object may be individually analyzed for its compliance with a security policy or the like using signatures or other objective characteristics. It will be understood that while static analysis provides one useful form of evaluation for compliance with the security policy or the like, other techniques may also or instead be employed, e.g., a behavioral analysis, a sandbox execution, network traffic analysis, and so forth.
- Detecting the security event may also or instead include detecting a security compromise by applying dynamic or behavioral analysis to code executing on the first endpoint, or to specific computing objects (e.g., processes) on the endpoint. For example, events that can warrant triggering the detection of the security event may include a process that loads a particular file that is known to be malicious, or a process that accesses a known malicious IP address, and the like.
- In an aspect, detecting the security event may include detecting a hardware change or other state changes. Detecting the security event may also or instead include detecting a potential data leakage.
- As discussed herein, a security policy may be used to detect a security event. This may include, for example, whitelists or blacklists of known computing objects and events, or reputations and signatures thereof. For example, a security policy may include rules that allow computing objects and events that are provided by a known, trusted source (e.g., a trusted user, endpoint, network, company, vendor, and so forth). The rules may be more complex, for example, where originating from a trusted source is only one factor in determining whether to whitelist computing objects and events. In general, the security policy may include any suitable rules, logic, prioritizing, etc., as desired to detect a security event.
- Although referred to herein in terms of ‘security,’ one skilled in the art will recognize that a security policy may also or instead include other types of policies. For example, a security policy may include a corporate or network policy having a list of approved computing objects and events, where computing objects and events outside of this list may not necessarily be security risks, but are otherwise unwanted in the network. Thus, the security policy may intend to detect malware and the like, while also detecting other types of unwanted computing objects and events that do not qualify as malware.
- More generally, any technique or combination of techniques suitable for evaluating endpoint activity for the detection of actual or potential security compromises may be used to detect security events as contemplated herein.
- As shown in
step 408, if a security event is not detected, themethod 400 may return to step 402 where monitoring can continue. As further shown instep 408, if a security event is detected, a root cause analysis or the like may be performed to identify a source of the security event as further described below. That is, detecting a security event associated with one of the number of computing objects may trigger further analysis of other causally related computing objects on an endpoint (or in certain cases, remote from an endpoint) to identify a cause of the security event, as distinguished from the symptom that generated the beacon or trigger for the analysis. - As shown in
step 410, themethod 400 may include generating an event graph. The event graph may be generated in response to detecting the security event, e.g., using the data log from the data recorder. The event graph may be generated at the same time as or as part of creating the data log. The event graph may include the sequence of events causally relating the number of computing objects, and more specifically, the sequence of events and computer objects causally associated with the object(s) that triggered the detected security event. - As discussed herein, the event graph may be generated based on a data log of events and computer objects stored by a data recorder during operation of the endpoint. In particular, the data recorder may provide a dump of logged activities, which may be causally associated into a graph for analysis, navigation, display and so forth. Any useful portion of the data log may be used. For example, the data recorder may provide event data for a window of time before, after or surrounding the detected security event. The data log may be filtered, e.g., when the data is written to the data log (for example, by aging events as described above) or when the event graph is generated, or some combination of these. A variety of filtering techniques may be usefully employed. For example, certain types of objects or events may be removed from an event graph for specific trigger events, or certain groups of events may be condensed into a single event, such as all normal activity that occurs when a user logs into an endpoint. Similarly, computing objects that are too remote, either within the event graph or timewise, may be pruned and removed, particularly if they have a known, low diagnostic significance. Thus, the event graph may be filtered and condensed in a variety of manners to obtain a useful snapshot of events optimized for root cause analytics. Filtering of the data may be dependent upon the type of security event that is detected. Filtering of the data may adjust the level of detail included in the event graph based on memory limits, user parameters, security event type, or any other object metrics or inputs. In an aspect, the data is filtered based on reputation or the like, e.g., of computing objects included therein. For example, if an application has a good reputation, the application may not include a high level of detail associated therewith in a filtered version of the data log.
- In one aspect, the event graph may be generated based on a data log from a number of different endpoints and thus may represent a causal chain of data from various different endpoints. This approach advantageously permits an analysis using data that spans multiple endpoints or other network devices within a single data structure or package, thus permitting identification of a root cause even when an attack employs a complex, multi-hop approach to network assets that might otherwise evade detection. Event graphs may also or instead be generated separately for different endpoints and presented to a user or analytical system as separate, discrete entities. Event graphs for endpoints may be compared with one another, e.g., as part of the root cause analysis. For example, by analyzing and comparing similar event graphs or event graphs sharing similar computing objects or events, a heuristic approach may be developed for identifying suspicious events and computing objects for one or more endpoints. Similarly, event graphs for different endpoints in the same network enterprise may be compared or combined, e.g., where two or more endpoints have been exposed to a security event or threat. For example, event graphs for similar time periods of two or more endpoints may be ascertained and analyzed.
- In an aspect, cross-correlating between different data logs or event graphs may be utilized in a root cause analysis. For example, if the same security event or root cause is identified on different endpoints, the endpoints may be flagged for review or remediation. This type of analysis may be used on different endpoints throughout a network.
- Implementations may include a number of different event graphs stored in a data store that can be used together to detect, prevent, or determine the root causes for suspicious activity or other activity of interest, e.g., a security event. As discussed herein, the event graphs may be filtered before being stored in the data store, which can remove system activity that is not of interest in such analyses. The event graphs may be searchable, e.g., for analysis of event graphs including similar computing objects or events. The event graphs may also or instead be linked to one another, e.g., event graphs including similar computing objects or events. The event graphs may be presented to a user on a user interface or the like, e.g., an interactive user interface that allows a user to see similar or related event graphs, search the event graphs, link between event graphs, and so forth.
- An event graph may use a conventional structure of nodes (computing objects) and events (edges) to represent causal relationships among computing objects. This permits the use of a wide range of graph-based techniques to assist in analysis of the context leading up to a detected event. At the same time, numerous other data structures, computer representations, and visual representations of such interrelated objects and events are also known in the art, any of which may be employed as an event graph as contemplated herein, provided that enough descriptive data about the context of an endpoint is captured to facilitate the various types of analysis and response contemplated herein.
- As shown in
step 412, themethod 400 may include, in response to detecting the security event, traversing the event graph based on the sequence of events in a reverse order from the one of the computing objects associated with the security event to one or more preceding ones of the computing objects. In general, the reverse order is a causally reverse order. For example, where a network flow, data flow or control flow has a direction from one computing object to another computing object, the reverse order will follow this flow or causal link from the receiving computing object backward toward the source computing object. However, this may also or instead include a chronological flow, such as in a complex event graph where the time of receipt for two different inputs from two different sources is relevant. In general, a review of each of the preceding computing objects may be conducted by working backward from the computing object associated with the security event, e.g., to determine a root cause of the security event. In an aspect, this may include a static analysis of each of the preceding computing objects, or a dynamic analysis of object and event interactions, or some combination of these. - As shown in
step 414, themethod 400 may include applying one or more rules to the computing objects preceding the security event. For example, themethod 400 may include applying a cause identification rule to the preceding ones of the computing objects and the causal relationships while traversing the event graph in order to identify one of the computing objects as a cause of the security event. In general, the root cause analysis may attempt to identify a pattern in the event graph using cause identification rules to identify one of the computing objects (or a group of the computing objects and events) as a root cause of the security event. - The cause identification rule may associate the cause with one or more common malware entry points. For example, common entry points include a word processing application, an electronic mail application, a spreadsheet application, a browser, or a universal serial bus (USB) drive that is attached to an endpoint, and any of these computing objects, when encountered in an event graph, may be identified as a root cause. For example, when traversing the event graph in a reverse order from the security event, if the analysis identifies an electronic mail application that opened an attachment, this may be identified as the root cause because this is often a source of compromised security on an endpoint. Similarly, when traversing the event graph in a reverse order from the security event, if the analysis identifies a USB drive, or an unsecure or unencrypted USB drive, from which a file was opened, this may be identified as a likely cause of the security event. In one aspect, multiple candidate root causes may be identified using the cause identification rules, and a final selection may be based on other contextual information such as reputation, source, etc.
- Security events may also or instead be caused by a certain combination of events or combinations of events and computing objects. For example, in an aspect, the cause identification rule may associate the cause of the security event with a combination that includes a first process invoking a second process and providing data to the second process. As used herein, invoking may be interpreted broadly, e.g., where any two processes share data through an intermediate file, or narrowly, e.g., where a first process specifically spawns the second process as a child process. More generally, invoking a process as used herein is intended to broadly include any causal relationship between to processes including, e.g., spawning a process, hijacking a process (e.g., seizing control of an existing process through thread injection, process hollowing, and the like), remotely launching a process over a network, instrumenting a service in the operating system, and the like. A cause identification rule may specify a particular type of invocation relationship between two processes, or multiple types of invocation, or any relationship between two processes. Providing data from a first process to a second process may include creating a file for use by the second process. For example, the cause of a security event may include a first process that writes a file and then takes control of a second process that reads data from the file so that the first process and the second process share data through the file.
- Another example of a security event may include a known non-malicious application (e.g., a commonplace word processing application) launching a command line script, which may be identified as a cause of a security event. The activity underlying events that are generated may not necessarily be malicious, but they could lead to security events or other events of interest to be further analyzed. Thus, in one aspect, a cause identification rule may flag this behavior as a root cause of a security event, or as an event that is otherwise of diagnostic interest.
- As shown in
step 416, themethod 400 may include traversing the event graph forward from an identified or presumed cause of the security event to identify one or more other ones of the computing objects affected by the cause. In this manner, an analysis of each of the computing objects in the event graph may be conducted by working forward from the root cause to other causally dependent computing objects that might be compromised or otherwise affected by the root cause. This may include labeling or otherwise identifying the potentially compromised objects, e.g. for remediation or further analysis. A pruning step may also be employed, e.g. where any computing objects that are not causally dependent on the root cause in some way are removed from the event graph. - As shown in
step 418, themethod 400 may include remediating one or more computing objects affected by the cause of the security event. Remediation may include deleting computing objects from the endpoint, or otherwise remediating the endpoint(s) using computer security techniques such as any described herein. In another aspect, the identification of the root cause may be used to create new detection rules capable of detecting a security event at a point in time (or causation) closer to the root cause within the event graph. Other remediation steps may include forwarding the event graph, or a filtered and pruned event graph, to a remote facility for analysis. This data may usefully provide a map for identifying sources of malware, or for ensuring thorough remediation by identifying all of the potentially compromised computing objects that should be examined after the compromise has been addressed. -
FIG. 5 illustrates a graphical depiction of a portion of anexample event graph 500. Theevent graph 500 may include a sequence of computing objects causally related by a number of events, and which provide a description of computing activity on one or more endpoints. Theevent graph 500 may be generated, for example, when asecurity event 502 is detected on an endpoint, and may be based on a data log or similar records obtained by an event data recorder during operation of the endpoint. Theevent graph 500 may be used to determine a root cause 504 of thesecurity event 502 as generally described above. Theevent graph 500 may also or instead be continuously generated to serve as, or be a part of, the data log obtained by the data recorder. In any case, anevent graph 500, or a portion of anevent graph 500 in a window before or around the time of a security event, may be obtained and analyzed after asecurity event 502 occurs to assist in determining its root cause 504. Theevent graph 500 depicted in the figure is provided by way of example only, and it will be understood that many other forms and contents forevent graphs 500 are also or instead possible. It also will be understood that while the figure illustrates a graphical depiction of anevent graph 500, theevent graph 500 may be stored in any suitable data structure or combination of data structures suitable for capturing the chain of events and objects in a manner that preserves causal relationships for use in forensics and malware detection as contemplated herein. - By way of example, the
event graph 500 depicted in the figure begins with a computing object that is a USB device 512, which may be connected to an endpoint. Where the USB device 512 includes a directory or file system, the USB device 512 may be mounted or accessed by a file system on an endpoint to read contents. The USB device 512 may be detected 513 and contents of the USB device 512 may be opened 514, e.g., by a user of the endpoint or automatically by the endpoint in response to detection of the USB device 512. The USB device 512 may include one or more files and applications, e.g., afirst file 516, asecond file 518, and afirst application 520. Thefirst file 516 may be associated with afirst event 522 and the second file may be associated with asecond event 524. Thefirst application 520 may access one or more files on the endpoint, e.g., the third file 526 shown in the figure. Thefirst application 520 may also or instead perform one ormore actions 528, such as accessing aURL 530. Accessing theURL 530 may download or run asecond application 532 on the endpoint, which in turn accesses one or more files (e.g., thefourth file 534 shown in the figure) or is associated with other events (e.g., thethird event 536 shown in the figure). - In the example provided by the
event graph 500 depicted in the figure, the detectedsecurity event 502 may include theaction 528 associated with thefirst application 520, e.g., accessing theURL 530. By way of example, theURL 530 may be a known malicious URL or a URL or network address otherwise associated with malware. TheURL 530 may also or instead include a blacklisted network address that although not associated with malware may be prohibited by a security policy of the endpoint or enterprise network in which the endpoint is a participant. TheURL 530 may have a determined reputation or an unknown reputation. Thus, accessing theURL 530 can be detected through known computing security techniques. - In response to detecting the
security event 502, theevent graph 500 may be traversed in a reverse order from a computing object associated with thesecurity event 502 based on the sequence of events included in theevent graph 500. For example, traversing backward from theaction 528 leads to at least thefirst application 520 and the USB device 512. As part of a root cause analysis, one or more cause identification rules may be applied to one or more of the preceding computing objects having a causal relationship with the detectedsecurity event 502, or to each computing object having a causal relationship to another computing object in the sequence of events preceding the detectedsecurity event 502. For example, other computing objects and events may be tangentially associated with causally related computing objects when traversing theevent graph 500 in a reverse order—such as thefirst file 516, thesecond file 518, the third file 525, thefirst event 522, and thesecond event 524 depicted in the figure. In an aspect, the one or more cause identification rules are applied to computing objects preceding the detectedsecurity event 502 until a cause of thesecurity event 502 is identified. - In the example shown in the figure, the USB device 512 may be identified as the root cause 504 of the
security event 502. In other words, the USB device 512 was the source of the application (the first application 520) that initiated the security event 502 (theaction 528 of accessing the potentially malicious or otherwise unwanted URL 530). - The
event graph 500 may similarly be traversed going forward from one or more of the root cause 504 or thesecurity event 502 to identify one or more other computing objects affected by the root cause 504 or thesecurity event 502. For example, thefirst file 516 and the second 518 potentially may be corrupted because the USB device 512 included malicious content. Similarly, any related actions performed after thesecurity event 502 such as any performed by thesecond application 532 may be corrupted. Further testing or remediation techniques may be applied to any of the computing objects affected by the root cause 504 or thesecurity event 502. - The
event graph 500 may include one or more computing objects or events that are not located on a path between thesecurity event 502 and the root cause 504. These computing objects or events may be filtered or ‘pruned’ from theevent graph 500 when performing a root cause analysis or an analysis to identify other computing objects affected by the root cause 504 or thesecurity event 502. For example, computing objects or events that may be pruned from theevent graph 500 may include the USB drive 510 and the USB device being detected 513. - It will be appreciated that the
event graph 500 depicted inFIG. 5 is an abstracted, simplified version of actual nodes and events on an endpoint for demonstration. Numerous other nodes and edges will be present in a working computing environment. For example, when a USB device is coupled to an endpoint, the new hardware will first be detected, and then the endpoint may search for suitable drivers and, where appropriate, present a user inquiry of how the new hardware should be handled. A user may then apply a file system to view contents of the USB device and select a file to open or execute as desired, or an autorun.exe or similar file may be present on the USB device that begins to execute automatically when the USB device is inserted. All of these operations may require multiple operating system calls, file system accesses, hardware abstraction layer interaction, and so forth, all of which may be discretely represented within theevent graph 500, or abstracted up to a single event or object as appropriate. Thus, it will be appreciated that theevent graph 500 depicted in the drawing is intended to serve as an illustrative example only, and not to express or imply a particular level of abstraction that is necessary or useful for root cause identification as contemplated herein. - The
event graph 500 may be created or analyzed using rules that define one or more relationships between events and computing objects. The C Language Integrated Production System (CLIPS) is a public domain software tool intended for building expert systems, and may be suitably adapted for analysis of a graph such as theevent graph 500 to identify patterns and otherwise apply rules for analysis thereof. While other tools and programming environments may also or instead be employed, CLIPS can support a forward and reverse chaining inference engine suitable for a large amount of input data with a relatively small set of inference rules. Using CLIPS, a feed of new data can trigger a new inference, which may be suitable for dynamic solutions to root cause investigations. - An event graph such as the
event graph 500 shown in the figure may include any number of nodes and edges, where computing objects are represented by nodes and events are represented by edges that mark the causal or otherwise directional relationships between computing objects such as data flows, control flows, network flows and so forth. While processes or files are common forms of nodes that might appear in such a graph, any other computing object such as an IP address, a registry key, a domain name, a uniform resource locator, a command line input or other object may also or instead be designated to be a node in an event graph as contemplated herein. Similarly, while an edge may be formed by an IP connection, a file read, a file write, a process invocation (parent, child, etc.), a process path, a thread injection, a registry write, a domain name service query, a uniform resource locator access and so forth other edges may be designated. As described above, when a security event is detected, the source of the security event may serve as a starting point within theevent graph 500, which may then be traversed backward to identify a root cause using any number of suitable cause identification rules. Theevent graph 500 may then usefully be traversed forward from that root cause to identify other computing objects that are potentially tainted by the root cause so that a more complete remediation can be performed. - Using the systems and methods described herein may provide for advantageous sandboxing techniques. For example, the sequence of events included in a data recorder or event graph may be executed within a sandbox or the like in a similar manner as the sequence of events occurred on the endpoint where a security event was detected. This may be accomplished without replicating the entire action sequence of events on the endpoint, e.g., using only a predetermined time window or a predetermined sequence of events. In this manner, information from the data recorder may be used to replicate the actual order of events and processes that were involved in a security event. This may increase the likelihood of a sample detonating in a useful manner for analyses.
-
FIG. 6 shows a method for malware detection using an event graph. Once a root cause has been identified as described above, the event graph proximal to the root cause can be used to detect malware based on the emergence of a similar or identical event graph during malware monitoring. This potentially facilitates earlier detection by permitting detection based on the root cause pattern rather than the (subsequent) beacon that initially triggered the search for a root cause during forensic analysis. In addition, monitoring may be adapted to a current security context, e.g., by adding more monitoring points or decreasing filtering (e.g., to gather more data at each point) when the security state worsens or there is a perceived increase in security risk. In general, the computing objects, events, event graph, and the like described below may be any of those described above with respect to root cause identification, with the characteristics of the root cause applied for prospective malware detection instead of or in addition to retroactive, forensic root cause analysis. - As shown in
step 602, themethod 600 may include instrumenting an endpoint to monitor a number of causal relationships among computing objects at a plurality of logical locations within a computing environment related to the endpoint. Instrumentation may use any suitable techniques for recording data as contemplated herein. The computing objects may in general be any hardware or software computing object such as a data file, a database record, a database, a directory, a file system, a file system path, a process, an application, an operating system, a registry or registry entry, a network address, a network path, a peripheral device, a physical device (e.g., a disk drive, optical drive, communications or network interface, keyboard, mouse, sensor, camera, microphone, etc.), and so forth. In general, the logical locations may be any corresponding locations of diagnostic interest that might be accessed or used by the computing objects within the computing environment, such as hardware/device interfaces, device drivers, a file system and/or directory, memory (e.g., RAM, cache, processor registers), operating system interfaces, application programming interfaces, network communication ports or interfaces, and any data sources of interest such as credential stores, system registries, system configuration files, and so forth. In one aspect, this may include logical locations separate from the endpoint, such as locations on a second physical endpoint separate from the first endpoint, or a web site, file server, mail server, or other remote resource. By extending instrumentation beyond the individual endpoint, malicious software movements can be tracked throughout a network or from one device to another in order to improve malware detections and the like. The logical locations may also or instead include a programmatic interface to a human interface device such as a mouse, keyboard, sensor, camera, microphone, or other input/output device. The logical locations may also or instead include peripherals or other devices attached to and communicating with the endpoint such as USB memory devices, flash drives, and so forth. - Monitoring may be performed at various levels of granularity. For example, monitoring may include monitoring of specific memory locations or file locations that are potentially of interest, such as by monitoring reads and/or writes to specific file names, specific directories, and so forth. In another aspect, the instrumentation may be configured for variable monitoring. For example, where a high-risk state is detected, filtering may be decreased so that, e.g., a file system or other resource is monitored more aggressively and additional events are captured. This heightened monitoring may be continued for a predetermined window, or until the high-risk state has passed, or indefinitely or until the occurrence of some specific event.
- More generally, the instrumentation contemplated herein may include any instrumentation suitable for monitoring causal relationships among computing objects at logical locations within a computing environment for an endpoint. The computing environment may be confined to the computing environment on a particular endpoint such as the hardware and software associated with that endpoint. The computing environment may more generally include any computing environment related to the endpoint, and may be extended to include other endpoints, remote computing resources such as websites, web servers, file servers, devices such as printers, copiers, watches, televisions, appliances, and so forth. More generally, any other location or resource that might provide logical locations useful for monitoring and diagnostic purposes may be included in the computing environment. In one aspect, this may include other endpoints within a local area network or enterprise network used by the endpoint, such as where another endpoint in the enterprise network sends commands or data to the endpoint or receives commands or data from the endpoint. In general, the instrumentation may include predetermined instrumentation of specific logical locations. That is, the endpoint may be configured to provide causal information from specific logical locations, any of which may then be controllably selected for observation after an initial configuration. In another aspect, instrumentation may include dynamic instrumentation that is deployed as needed or desired for endpoint monitoring. Thus, for example, where a new registry entry is created or a new file is downloaded, that computing object may be monitored prospectively as a new logical location on the endpoint until it can be determined that the new computing object is safe.
- As shown in
step 604, themethod 600 may include selecting a set of logical locations from the plurality of logical locations. This may include adding one or more of the plurality of logical locations to the first set of logical locations in response to a detected increase in security risk. This may also or instead include removing one of the plurality of logical locations from the first set of logical locations in response to a detected decrease in security risk. More generally, this may include adapting the monitored locations according to a security state of the endpoint so that more or less computing resources can be used as necessary or appropriate according to the current state of risk. - In another aspect, selecting logical locations may include adapting the monitoring based on observed properties of objects within a computing environment. For example, computing objects such as files or processes may be explicitly labelled with information about reputation, exposure to external networks, usage history, security status, and so forth. One useful system for labeling objects in this manner is described by way of example in commonly-owned U.S. application Ser. No. 15/179,547, entitled “Network Security” and filed on Jun. 10, 2016, the entire content of which is hereby incorporated by reference. Without limiting the generality of that disclosure, numerous techniques are described for labeling processes, files, and other computing objects with useful information for malware detection, reputation-based processing, and so forth. These and other techniques may be usefully employed to label computing objects in any manner useful for evaluating a security state of an endpoint (or specific computing objects on the endpoint), and for using this security state to adapt the monitoring processes contemplated herein.
- For example, each file, process, or other object may be labelled according to whether the object has been exposed to an external network or resource. In this manner, objects that have remained isolated on the endpoint can be distinguished from objects that have been exposed outside of the endpoint (and that are thus potentially at risk for infection or other malicious activity). Where exposure of computing objects is explicitly tracked, selecting a set of logical locations may include selecting a group from the plurality of logical locations based on exposure to an external environment, e.g., where the exposure implies a greater degree of security risk. Similarly, these techniques may be used to label computing objects according to reputation, which permits the use of a local or remotely managed reputation database to label computing objects according to their own inherent reputation (e.g., good, bad, low, unknown, etc.) or according to the reputation of other computing objects that a computing object has been exposed to, or some combination of these. In this case, selecting a set of logical locations may include selecting a group from the plurality of logical locations based on a reputation, such as a reputation of one of the computing objects, or a reputation of a group of computing objects. In general, reputation-based evaluations may be done at any suitable level of granularity or complexity. For example, where a known and good reputation process is being used, the selection may include excluding one of the plurality of logical locations associated with the known, good process. This may also or instead include adding locations associated with processes of unknown reputation, or increasing the number of locations or level of monitoring when an inconsistency is detected between a reputation of a first process and a reputation of a second process calling or invoking the first process. More generally, where reputation information is available for computing objects on an endpoint, any inconsistencies between reputations of computing objects that are causally linked in an event graph, or any other reputation information that might be available for the computing objects, may be usefully employed to adapt monitoring as contemplated herein.
- The reputation of computing objects may include a score (or other label, indication, weighting, and the like) of one or more of its prevalence, its provenance, and its pedigree. The prevalence of a computing object may include how the computing object has been seen on other machines or systems. The provenance of a computing object may include its origin, e.g., where it came from, who created or signed it, and the like. The pedigree of a computing object may allow for identification of the creator of the computing object. For example, the pedigree may be based on the public key of the certificate that signed software (e.g., typically the first intermediate certificate). For URLs, this may be based on the signed SSL server certificate. For software, this may be based on the signed packet that contains the software (if present). Providence and prevalence may be uncovered by checking on the public key of the certificate in question, and known good computing objects (or reputations or attributes thereof, e.g., certificates) may be hard coded into a list for future lookup.
- As shown in
step 606, themethod 600 may include recording a sequence of events causally relating the number of computing objects at the set of logical locations selected instep 604. In general, this may include recording any of the events described herein. This may also or instead include filtering the recorded events more or less aggressively according to a security state or other information. For example, this may include filtering one or more of the events in the sequence of events according to a reputation, such as by excluding events that are related to a known good process, or increasing data collection or sensitivity for events that are related to unknown or low reputation computing objects. - In one aspect, some or all of the events may have an aging or duration parameter such as a time to live. This permits appropriate aging of events according to their short-term or long-term diagnostic significance. For example, in lateral movement malware exploit, one endpoint may try to log in to another endpoint using a series of login attempts with different credentials. To detect this type of attempted lateral movement, it may be useful to retain all login attempts for a relatively short period of time in order to see if a number of similar login attempts occur within a short time period. However, after the passage of some time, any such failed login attempts might be discounted in significance, and aged out of the current event graph using a suitable time to live or other time constant. Thus, a number of events within the sequence of events may be preserved for a predetermined time window. The predetermined time window may have a different duration for at least two of the types of computing objects contemplated herein, which may be useful where events for different computing objects (e.g., remote resources, local files, processes, and the like) provide information with differing long-term or short-term value.
- As shown in
step 608, themethod 600 may include creating an event graph based on the sequence of events. The event graph may be continuously created and updated by a data recorder—that is, the data recorder may store the event graph as its native data logging format—or the event graph may be created on demand from a structured or unstructured data log at discrete moments, e.g., in response to a request for an event graph from the data recorder. Thus, in one aspect, the data recorder may function to continuously obtain data from a variety of sources or locations in addition to the locations that have been selected for monitoring. While this additional data logging may require additional computing resources to capture information beyond selecting monitoring points as well as additional storage, the additional data may also advantageously permit retroactive reconstruction of malicious causal chains if potential malware has been detected. Thus, in one aspect, a data recorder may record additional data from instrumentation points outside the scope of the logical locations that are currently explicitly being monitored. The data recorder may have a prioritized list of logical locations, and may record additional data based on the prioritized list of logical locations. - As described herein, the event graph may generally associate a number of computing objects to one another through events that establish causal relationships. In general, the causal relationships may include a data flow, a control flow, or a network flow, or any other type of event or the like that causally relates one computing object to other computing objects within an endpoint computing environment.
- As shown in
step 610, the method may include evaluating a security state of the endpoint. In one aspect, this may include evaluating the security state of the endpoint based on the event graph, such as by applying a malware detection rule to the event graph. This may provide useful diagnostic information by comparing the current event graph to one or more graphs for root causes that have been identified as described above, or by comparing the current event graph to other patterns of events that show a causal relationship among computing objects that is suggestive or indicative of malicious activity. - It will be appreciated that other techniques may also or instead be employed to evaluate the security state of the endpoint, such as signature-based malware detection, behavioral malware detection, or any other techniques known in the art to be useful for detecting the presence of malware on an endpoint. These techniques may provide additional information that may be useful for a general evaluation of the security state of the endpoint, which may be used instead of or in addition to event-based techniques to evaluate the security state of an endpoint and to inform other event-based monitoring steps.
- As shown in
step 612, themethod 600 may include adjusting the set of logical locations according to the security state of the endpoint. In general, this may include adding a new logical location or removing an existing logical location. Thus, this may generally include selecting a second set of logical locations different from the first plurality of logical locations in response to an observed event graph for the sequence of events. This may also or instead include changing a level of filtering at one of the set of logical locations according to the security state of the endpoint. In another aspect, any of the selection criteria described above for use with an initial selection of monitoring locations (e.g., in step 604) may also or instead be employed as criteria for adding, removing, or filtering logical locations in order to adjust the monitoring in response to a security state. It will also be understood that, while the event graph may generally provide useful information about the security state of the endpoint, other information may also or instead be used to evaluate the security state and modify the monitoring process accordingly. For example, the monitoring may be adjusted based on a detection of malware obtained from another source such as an antivirus scanner or the like, or the monitoring may be adjusted based on exposure to external resources, reputation information, or any other information that might be available for processes, files, and the like as contemplated herein. - As shown in
step 614, themethod 600 may include remediating the endpoint when the security state is compromised, for example, when a combination of a malware detection rule and the event graph indicate a compromised security state. This may include any suitable form of remediation. For example, where evaluating the security state includes identifying one of the computing objects (or a group of the computing objects) as a cause of a compromised security state, themethod 600 may include remediating that one of the computing objects. Remediation may also or instead include traversing the event graph forward from the cause to identify one or more other ones of the computer objects affected by the cause, any of which may be similarly remediated. - Numerous remediation techniques are known in the art and may be usefully employed to remediate an endpoint, or one or more computing objects on an endpoint, as contemplated herein. This may for example include quarantining or isolating the endpoint to prevent interactions with other devices on a network. This may also or instead include deploying malware removal tools to the endpoint, or launching a malware removal tool that is already on the endpoint, to remove malware that has been detected. This may also include intermediate steps such as terminating processes, deleting logs, clearing caches, or any other steps or combination of steps suitable for removing malicious software from the endpoint and/or restoring the endpoint to an uninfected state. This may include notifying an administrator or user. This may include reporting a health state that indicates compromise, for example, as part of a heartbeat health report.
- According to the foregoing, there is also contemplated herein an endpoint that uses an adaptive event graph for malware detection. In general, the endpoint may include a network interface, a memory, and a processor. The processor may be configured by computer executable code stored in the memory to detect malware by performing the steps of instrumenting the endpoint to monitor a number of causal relationships among a number of computing objects at a plurality of logical locations within a computing environment related to the endpoint, selecting a first set of logical locations from the plurality of logical locations, recording a sequence of events causally relating the number of computing objects at the first set of logical locations, creating an event graph based on the sequence of events, applying a malware detection rule to the event graph, and remediating the endpoint when the malware detection rule and the event graph indicate a compromised security state. The processor may be further configured to adjust the set of logical locations by adding a new logical location, removing an existing logical location, or changing a level of filtering at one of the set of logical locations according to a security state of the endpoint.
-
FIG. 7 shows a malware detection system including an event handler on an endpoint. As described above, once a significant sequence of events is identified, the events on an endpoint can be recorded and accumulated into a data log that can be subsequently examined for corresponding patterns of events. This technique may present data storage and computation challenges, particularly where a group of events indicative of malware form complex event chain, or an event chain that extends over a relatively long period of time, such as days or weeks. To address these challenges, anevent handler 760 may be deployed as an event-based state machine that monitors for a single event or group of events occurring next in a sequence of events associated with the malware. As a significant advantage, this approach permits a detection system that scales well with larger chains of events, for example by maintaining time complexity and space complexity that scales well as the number and complexity of monitored events, event types, and/or detected items is increased. - It will be understood that while this approach has significant advantages in the detection of complex malware, the disclosed techniques are not limited to malware detection, and may usefully be deployed in any context where sequences of events provide a useful indication of endpoint status, software status, software installation, risky user behavior, enterprise security breaches, and so forth, or in any other context where a significant activity or global event can be characterized as one or more sequences of events.
- The
system 700 may in general correspond to the system described above with reference toFIG. 3 , with differences as noted below. Thesystem 700 may generally include anendpoint 710 with any number ofobjects 712 creatingevents 714 causally linked together to execute applications and perform other user functions, supporting computation tasks, and so forth. Anevent handler 740 may execute on theendpoint 710 to monitor events, and may be coupled in a communicating relationship with ananalysis facility 740 that provides one or more rules 742 (e.g., for malware detection) over adata network 750. It will be appreciated that, while illustrated as components of theendpoint 710, certain components of thesystem 700 such as theevent handler 760 andvarious objects 712 that createevents 714 may also or instead include remote services instantiated on a virtual appliance, a public or private cloud, or the like, any of which may be coupled to theendpoint 710 through thedata network 750 or another communication channel (not shown). Each of the components of thesystem 700 may be configured with suitable programming and configuration to participate in the event-based detection techniques contemplated herein. - The
endpoint 710 may be any of the endpoints described herein, e.g., a computing device in an enterprise network, or any other device or network asset that might join or participate in an enterprise or otherwise operate on an enterprise network. This may, for example, include a server, a client device such as a desktop computer or a mobile computing device (e.g., a laptop computer or a tablet), a cellular phone, a smart phone, or other computing device suitable for participating in thesystem 700 or in an enterprise. - In general, the
endpoint 710 may include any number of computing objects 712, which may for example, be processes executed by one or more processors or other processing circuitry, files or data stored in memory, or any other computing objects described herein. While the term object has a number of specific meanings in the art, and in particular in object-oriented programming, it will be understood that the term ‘object’ as used herein is intended to be significantly broader, and may include anything on theendpoint 710, or associated with theendpoint 710, that might include or create an event. Thus the object may include any data, process, file or combination of these on theendpoint 710 including without limitation any process, application, executable, script, dynamic linked library (DLL), file, data, database, data source, data structure, function, resource locator (e.g., uniform resource locator (URL) or other uniform resource identifier (URI)), or the like that might be resident on theendpoint 710 and manipulated by theendpoint 710 or another component of thesystem 700 or other systems described elsewhere herein. Theobject 712 may also or instead include a remote resource, such as a resource identified in a URL. That is, while theobject 712 in the figure is depicted as residing on theendpoint 710, anobject 712 may also reside elsewhere in thesystem 700, and may be specified for example with a link, pointer, or reference that is locally stored on theendpoint 710. - The
object 712 may be an item that is performing an action or causing anevent 714, or theobject 712 may be an item that is receiving the action or is the result of an event 714 (e.g., theobject 712 may be an item in thesystem 700 being acted upon by anevent 714 or another object 712). In general, anevent 714 as contemplated herein may be any input, output, data flow, execution flow, control flow, network flow, or other similar action or event that might causally relateobjects 712 to one another. In instances where theobject 712 is data or includes data, theobject 712 may be encrypted or otherwise protected, or theobject 712 may be unencrypted or otherwise unprotected. Theobject 712 may be a process or other computing object that performs an action, which may include asingle event 714 or a collection or sequence ofevents 714 taken by a process. Theobject 712 may also or instead include an item such as a file or lines of code that are executable to perform such actions. Theobject 712 may also or instead include a computing component upon which an action is taken, e.g., a system setting (e.g., a registry key or the like), a data file, a URL, and so forth. Theobject 712 may exhibit a behavior such as an interaction with another object or a component of thesystem 700. - The
object 712 may also or instead include a hardware item for input or output such as a keyboard, display, mouse, speaker, and so forth, or any other peripheral or the like. Theobject 712 may also or instead include an abstraction of such a physical object such as a device driver, abstraction layer instance or the like. Theobject 712 may also or instead include a physical port for communicating with peripherals, external hardware, communications infrastructures and so forth. Thus for example, theobject 712 may include a USB port, a serial port, a wireless network interface, or any other short range or long range communications interface or the like. -
Objects 712 may be described in terms of persistence. Theobject 712 may, for example, be a part of a process, and remain persistent as long as that process is alive. Theobject 712 may instead be persistent across anendpoint 710 and remain persistent as long as anendpoint 710 is active or alive. Theobject 712 may instead be a global object having persistence outside of anendpoint 710, such as a URL or a data store. In other words, theobject 712 may be a persistent object with persistence outside of theendpoint 710. - Although many if not
most objects 712 will typically be benign objects forming a normal part of the computing environment for anoperating endpoint 710, anobject 712 may contain software associated with an advanced persistent threat (APT) or other malware that resides partially or entirely on theendpoint 710. This associated software may have reached theendpoint 710 in a variety of ways, and may have been placed manually or automatically on theendpoint 710 by a malicious source. It will be understood that the associated software may take any number of forms and have any number of components. For example, the associated software may include an executable file that can execute independently, or the associated software may be a macro, plug-in, or the like that executes within another application. Similarly, the associated software may manifest as one or more processes or threads executing on theendpoint 710. Further, the associated software may install from a file on the endpoint 710 (or a file remote from the endpoint 710), and the associated software may create one or more files such as data files or the like while executing. Associated software should be understood to generally include all such files and processes except where a specific file or process is more specifically noted. - An
event 714 may include an action, a behavior, an interaction, and so forth, as well as combinations of the foregoing. Theevent 714 may be generated by or otherwise related to anobject 712. For example, theevent 714 may be associated with a file and include an action such as a read, a write, an open, a move, a copy, a delete, and so forth. Theevent 714 may also or instead include process start and stop events or inter-process communication, e.g., a create, a handle, a debug, a remote injection, and so forth. Theevent 714 may also or instead include a network action such as accessing an Internet Protocol (IP) address or URL. In one aspect, theevents 714 may include human interactions such as keyboard strokes, mouse clicks or other input and output to human interface devices and hardware. This usefully permits discrimination within causal chains among events initiated by processes executing on a device (e.g., by a machine) and events that are initiated or controlled by a human user that is present on the endpoint. - A
security product 732 may execute on theendpoint 710 to detect a security event on theendpoint 710, which may act as the beacon or trigger event for thesystem 700 as described above, and which may generateevents 714 related to the security status of theendpoint 710 or other security-related states. Thesecurity product 732 may also or instead be used to remediate a compromised endpoint when another system such as theevent handler 760 detects a threat. Thesecurity product 732 may use techniques such as signature-based and behavioral-based malware detection including without limitation one or more of host intrusion prevention, malicious traffic detection, URL blocking, file-based detection, and so forth, as well as any input from theevent handler 760. - The
analysis facility 740 may create or store any number ofrules 742 as generally described above. This may, for example, includerules 742 that relate sequences of events to compromised conditions of an endpoint in an enterprise network. Therules 742 may be organized as a state machine suitable for deployment on theevent handler 760, or asindividual events 714 or sequences ofevents 714 that can be communicated to theevent handler 760 for use in detecting security threats or the like. In general, theanalysis facility 740 may analyze sequences of events to aid in improved threat detection, and theanalysis facility 740 may be used to manage deployment ofrules 742 and related information to theendpoint 710. - The
analysis facility 740 may reside locally on the endpoint 710 (e.g., be a part of, embedded within, or locally coupled to the endpoint 710). Theanalysis facility 740 may also or instead be an external facility, or it may reside in a virtual appliance (e.g., which could be run by a protected set of systems on their own network systems), a private cloud, a public cloud, and so forth coupled to theendpoint 710 in a communicating relationship through thenetwork 750. Theanalysis facility 740 may store locally-derived threat information for use in subsequent identification, remediation, or other similar activity. Theanalysis facility 740 may also or instead receive threat information from a third-party source such as any public, private, educational, or other organization that gathers information on network threats and provides analysis and threat detection information for use by others. This third-party information may, for example, be used to improve detection rules or other forensic analysis that might be deployed for use in threat detection by theevent handler 760. - In one aspect, the
analysis facility 740 may provide a user environment for creatingrules 742 that describe sequences of events associated with malware or other relevant items, events or context. Thus for example theanalysis facility 740 may provide a graphical user environment, scripting tool(s), software libraries, and any other tools or resources suitable for configuring theevent handler 760 to assist in malware detection or other identification or detection processes as contemplated herein. - The
event handler 760 may be any program, executable code, data structure, or other software construct suitable for processing groups ofevents 714 to detect malware or other activities or context of interest. For example, theevent handler 760 may usefully be configured as a state machine where each state is characterized by (i) monitoring for anevent 714 and (ii) responding to an occurrence of theevent 714 by transitioning to a next state in which the state machine monitors for a next event. In this manner, theevent handler 760 can monitor for a long or complex chain of events in a compact computational manner that only requires instrumentation to monitor for thecurrent event 714 of interest. Thus only modest computational resources may be required, and the resources can scale more easily to increasingly complex event chains, requiring little more than the memory resources required to store additional states that can be retrieved when needed as the state machine progresses through a number of state transitions. - The
event handler 760 may be deployed as a standalone monitoring agent on anendpoint 710, or theevent handler 760 may be deployed in whole or in part at a remote threat management facility or similar platform configured to receive event sequence information over the network and to transmit state updates or detections to theendpoint 710 as needed. In one aspect, theevent handler 760 may persistently store state information for one or more sequences of events, e.g., in a manner that retains state information across machine crashes, restarts, updates, and so forth. In another aspect, theevent handler 760 may selectively retain relevant state information (e.g., for sequences of events that can potentially span multiple machine reboots) for some detection patterns while purging state information for other detection patterns (e.g., for sequences of events that cannot span multiple machine reboots). - The
event handler 760 may usefully be configured, for example, using a suitably adapted scripting language. While a suitable scripting language may take a wide variety of forms, some useful characteristics of a useful scripting language are described below. A suitable scripting language may be optimized to ensure that particular states—conditions where theevent handler 760 is monitoring for a particular event—are only activated at the appropriate time, e.g., in response to a transition from the immediately preceding state. Similarly, the scripting language may be adapted to ensure that complex events can be handled, e.g., by permitting monitoring for multiple events concurrently when required by a particular state, or to ensure that multiple state machines can be operated concurrently. Other situations may also arise, such as forks or branches that require active monitoring for events for multiple, concurrent states, as well as situations where different state machines or event handlers should communicate with one another. - In general, event analysis by the
event handler 760 may be performed incrementally, as each event is received. This advantageously reduces the need to storeevents 714 as they are detected. The term thread may be used in this context to describe a particular state machine, or particular sequence of events leading to an event-based conclusion. A new thread or state machine can be created each time an initial event in one of the sequences of events is detected. That thread can then sleep while it monitors for the next event in that sequence. Each time an event is received, every thread which is waiting for that event can be woken up to update its state. Each thread can then apply a local rule to determine whether to take an action (e.g., transition to another state), return to a sleep or waiting state for the same event or some other event, or when an intended event sequence become impossible to satisfy, terminate. - A standalone executable may be used to parse text files that store a description of each thread or state machine. Each event may be given a name, along with zero, one, or more associated parameters, the meaning for which may depend on the context. Parameters may usefully be textual or numeric. For example, a file open event may have parameters which specify the ID of the process that performed the operation, the name of the file that was opened, and other information relevant to the file open operation. In general, an event may be a static event that always causes the instantiation of a thread or state machine when it occurs, or the event may be a dynamic event that is waited for by the
event handler 760 while in a particular state. The first state in a sequence may usefully have a scope that is shared to prevent multiple threads from launching in response to multiple occurrences of an initial event (unless that is intended). Shared scopes may usefully be defined with a combination of type and value, and may be global in nature. In this manner a different event body can make use of the same shared scope to access and also manipulate all variables declared at that scope level. - A scripting language as contemplated herein may support numerous additional functions helpful in monitoring events and detecting event sequences of interest. For example, the language may support output to signal specific events or sequences of events to a human or computer user. Similarly, the language may support use of such output as if it were a client input for additional processing. Time base functions such as scheduling, waiting and the like may also be supported and may be used to schedule outputs or wait for inputs as needed. The language may also usefully support flow control using constructs such as if, while, for, and so forth. The language may also usefully support debugging, text or numeric manipulation, and the use of other functionality (e.g., functions, linked code, subroutines, coroutines or other analogous functionality, e.g., for a stackless language or the like) as appropriate. More generally, any functions, variables, flow control tools or other programmatic tools and techniques useful for describing event-monitoring state machines as contemplated herein may be incorporated into a scripting language for configuring the event handler.
-
FIG. 8 shows a method for real time event detection. In general, themethod 800 employs a state machine or similar construct with each state configured to monitor for a single event (or group of events) expected to occur next in a sequence of events associated with, e.g., malware or other computer contexts or global events. As noted above, the event handler may execute on the endpoint, on a remote threat management facility, or some combination of these. The event handler may also be deployed as a security agent, or as a portion of a security agent, locally installed on the endpoint. - As shown in step 802, the method may begin with providing a development environment for creating a state machine that can be deployed on an event handler as described above. This may, for example, include a scripting language as described above, along with a graphical user interface or other programming environment that facilitates visualization of causal object-event chains as described above, and assists in configuring a responsive state machine for use with the event handler.
- As shown in
step 804, themethod 800 may include identifying a sequence of events, such as a sequence of events associated with malware on an endpoint or a sequence of events associated with some other global event, context or the like that might usefully be detected using the techniques described herein. As described above, for example, this may include traversing an event graph among a sequence of causal events in reverse chronological order to a root cause of the malware. This may also or instead include creating the sequence of events based on a forward traversal of the event graph, or otherwise using the event graph to identify and capture sequences of events that are potentially relevant to malware detection for us in an event handler as contemplated herein. - As shown in step 806, the
method 800 may include configuring an event handler such as any of the event handlers described above for use with the endpoint. In one aspect, the event handler may implement a state machine including a first state configured to monitor for an occurrence of a first one of the sequence of events identified above. The first state may be configured to respond to the occurrence of the first one of the sequence of events by transitioning to a second state where the event handler monitors for a second one of the sequence of events, such as a next sequential one of the sequence of events described above (e.g., associated with malware detection or the like). The state machine may generally proceed in this manner, transitioning from state to state where each state is characterized by monitoring for an event on one hand and providing a transition to a next state with the event is detected. The event handler may be configured to respond to a terminal event in the sequence of events by identifying the malware (or other context) on the endpoint associated with the sequence of events, and the event handler may respond to an exit condition such as this detection by returning to the first one of the sequence of the events so that monitoring can resume for the item of interest. In another aspect, exit conditions may be configured for events that make the occurrence of the entire sequence of events impossible, such as the termination of a process, deletion of a file, and so forth. The exit conditions may also or instead include a time-based exit condition that terminates a state machine in a particular state after a predetermined amount of time, and resets the state machine to an initial state and initial event. - In one aspect, e.g., where the sequence of events is a simple sequence with two events, or where a terminal portion of the state machine of the event handler is being configured, the second event may be the terminal event. In another aspect, the first event may be an initial event in a sequence of events, e.g., the first event that triggers use of a particular state machine for detecting a particular malware instance.
- As shown in
step 808, themethod 800 may include deploying the event handler for use with the endpoint, such as transmitting script or other programmatic information to the endpoint for use by the event handler. - As shown in
step 810, themethod 800 may include monitoring events on the endpoint with the event handler. One of ordinary skill in the art will readily discern suitable techniques for instrumenting an endpoint to detect events as contemplated herein, and detailed discussions of such monitoring techniques is omitted here. However, it will be appreciated that the events may include any of the events described herein, and where appropriate a monitoring state may monitor for multiple different events (e.g., where the monitored condition includes an occurrence of either of a first state or a second state, or where the event is a multi-parameter event for which two or more separate conditions must concurrently be met), complex or compound events, or events that are triggered by other states of the state machine. It will also be appreciated that while a single state machine is described, any number of parallel state machines may be used according to the number of different detection processes to be used, e.g. to concurrently monitor for multiple type of malware. It will also be appreciated that while a state machine provides a useful conceptual and programmatic construct for describing the event handler and monitoring for sequences of events, other programmatic techniques may also or instead be used, preferably where the techniques permit monitoring for multiple events in parallel and where the techniques facilitate detection of complex sequences of events in a manner that similarly scales efficiently in computation and space. - As shown in
step 812, themethod 800 may include detecting sequences of events based on the monitoring. This may, for example, include detecting the malware on the endpoint based upon an occurrence of the sequence of events concluding in the terminal event. - Numerous events and event types may be used for event detection as contemplated herein including any of the events described above. By way of non-limiting examples, the event sequence may include at least one event from a computing object such as a data file, a process, an application, a registry entry, a network address, and a peripheral device. The event sequence includes at least one event from a network address such as a uniform resource locator (URL), an internet protocol (IP) address, and a domain name. The event sequence may include at least one event from a peripheral device such as a universal serial bus (USB) memory, a network interface card, a camera, a printer, a mouse and a keyboard. The event sequence may include at least one file operation such as a read, a write, an open, a move, a copy and a delete. The event sequence may include at least one inter-process communication such as a create, a handle, a debug and a remote injection.
- As shown in
step 814, themethod 800 may include initiating a response to the detection, such as by remediating the malware on the endpoint or otherwise responding to what has been detected based on the sequence of events. - There is also disclosed herein an endpoint for use in an enterprise network. In general, the endpoint may include a network interface, a memory and a processor. The processor may be configured, e.g., with computer-executable code, to operate a real-time event detection system for malware detection or the like. For example, the processor may operate an event handler with a state machine having a plurality of states including a first state configured to monitor for an occurrence of a first one of the sequence of events, and configured to respond to the occurrence of the first one of the sequence of events by transitioning to a second state where the event handler monitors for a second one of the sequence of events, wherein the second one of the sequence of events is a next sequential one of the sequence of events associated with malware, the even handler further configured to respond to a terminal event in the sequence of events by identifying the malware on the endpoint and to respond to an exit condition by returning to the first one of the sequence of events.
- The above systems, devices, methods, processes, and the like may be realized in hardware, software, or any combination of these suitable for a particular application. The hardware may include a general-purpose computer and/or dedicated computing device. This includes realization in one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors or other programmable devices or processing circuitry, along with internal and/or external memory. This may also, or instead, include one or more application specific integrated circuits, programmable gate arrays, programmable array logic components, or any other device or devices that may be configured to process electronic signals. It will further be appreciated that a realization of the processes or devices described above may include computer-executable code created using a structured programming language such as C, an object oriented programming language such as C++, or any other high-level or low-level programming language (including assembly languages, hardware description languages, and database programming languages and technologies) that may be stored, compiled or interpreted to run on one of the above devices, as well as heterogeneous combinations of processors, processor architectures, or combinations of different hardware and software. In another aspect, the methods may be embodied in systems that perform the steps thereof, and may be distributed across devices in a number of ways. At the same time, processing may be distributed across devices such as the various systems described above, or all of the functionality may be integrated into a dedicated, standalone device or other hardware. In another aspect, means for performing the steps associated with the processes described above may include any of the hardware and/or software described above. All such permutations and combinations are intended to fall within the scope of the present disclosure.
- Embodiments disclosed herein may include computer program products comprising computer-executable code or computer-usable code that, when executing on one or more computing devices, performs any and/or all of the steps thereof. The code may be stored in a non-transitory fashion in a computer memory, which may be a memory from which the program executes (such as random access memory associated with a processor), or a storage device such as a disk drive, flash memory or any other optical, electromagnetic, magnetic, infrared or other device or combination of devices. In another aspect, any of the systems and methods described above may be embodied in any suitable transmission or propagation medium carrying computer-executable code and/or any inputs or outputs from same.
- It will be appreciated that the devices, systems, and methods described above are set forth by way of example and not of limitation. Absent an explicit indication to the contrary, the disclosed steps may be modified, supplemented, omitted, and/or re-ordered without departing from the scope of this disclosure. Numerous variations, additions, omissions, and other modifications will be apparent to one of ordinary skill in the art. In addition, the order or presentation of method steps in the description and drawings above is not intended to require this order of performing the recited steps unless a particular order is expressly required or otherwise clear from the context.
- The method steps of the implementations described herein are intended to include any suitable method of causing such method steps to be performed, consistent with the patentability of the following claims, unless a different meaning is expressly provided or otherwise clear from the context. So, for example performing the step of X includes any suitable method for causing another party such as a remote user, a remote processing resource (e.g., a server or cloud computer) or a machine to perform the step of X. Similarly, performing steps X, Y and Z may include any method of directing or controlling any combination of such other individuals or resources to perform steps X, Y and Z to obtain the benefit of such steps. Thus, method steps of the implementations described herein are intended to include any suitable method of causing one or more other parties or entities to perform the steps, consistent with the patentability of the following claims, unless a different meaning is expressly provided or otherwise clear from the context. Such parties or entities need not be under the direction or control of any other party or entity, and need not be located within a particular jurisdiction.
- It will be appreciated that the methods and systems described above are set forth by way of example and not of limitation. Numerous variations, additions, omissions, and other modifications will be apparent to one of ordinary skill in the art. In addition, the order or presentation of method steps in the description and drawings above is not intended to require this order of performing the recited steps unless a particular order is expressly required or otherwise clear from the context. Thus, while particular embodiments have been shown and described, it will be apparent to those skilled in the art that various changes and modifications in form and details may be made therein without departing from the spirit and scope of this disclosure and are intended to form a part of the invention as defined by the following claims, which are to be interpreted in the broadest sense allowable by law.
Claims (20)
1. A computer program product comprising computer executable code embodied in a non-transitory computer readable medium that, when executing on one or more computing devices, causes the one or more computing devices to perform the steps of:
identifying a first event in a sequence of events associated with malware on an endpoint, wherein identifying the first event includes traversing an event graph among a sequence of causal events in reverse chronological order to a root cause of the malware;
configuring an event handler as a plurality of states for malware detection on the endpoint based on the sequence of events,
the event handler including a first state of the plurality of states configured to monitor for an occurrence of the first event in the sequence of events, and to respond to the occurrence of the first event in the sequence of events by transitioning to a second state of the plurality of states,
the event handler configured in the second state to monitor for a second one of the sequence of events, wherein the second one of the sequence of events is a next sequential one of the sequence of events associated with malware,
the event handler further configured in a final one of the plurality of states to respond to a terminal event in the sequence of events by identifying a compromised computing object causally dependent on the root cause of the malware on the endpoint, and
the event handler configured to respond to an exit condition from one or more of the plurality of states by returning to the first state;
deploying the event handler on the endpoint for use in identifying the malware in response to detecting the root cause;
monitoring events on the endpoint with the event handler;
detecting the malware on the endpoint based upon a detection of the sequence of events concluding in the terminal event; and
remediating the malware on the endpoint.
2. The computer program product of claim 1 , further comprising code embodied in the non-transitory computer readable medium that causes the one or more computing devices to perform the step of creating the sequence of events based on a forward traversal of the event graph.
3. The computer program product of claim 1 , further comprising code embodied in the non-transitory computer readable medium that, when executing on the one or more computing devices, causes the one or more computing devices to perform the steps of:
storing a current one of the plurality of states; and
retrieving an additional state of the plurality of states from a remote threat management facility when the event handler transitions from the current one of the plurality of states based upon the occurrence of a corresponding one of the sequence of events.
4. The computer program product of claim 1 , wherein the first state of the event handler is an initial state having a shared scope to prevent multiple threads from launching in response to multiple occurrences of the root cause in the sequence of events.
5. A method comprising:
identifying a first event in a sequence of events associated with malware on an endpoint, wherein identifying the first event includes traversing an event graph among a sequence of causal events in reverse chronological order to a root cause of the malware;
configuring an event handler for use with the endpoint,
the event handler including a first state configured to monitor for an occurrence of the first event in the sequence of events, the first state configured to respond to the occurrence of the first event in the sequence of events by transitioning to a second state,
the event handler configured in the second state to monitor for a second one of the sequence of events,
wherein the second one of the sequence of events is a next sequential one of the sequence of events associated with malware,
the event handler configured to respond to a terminal event in the sequence of events by identifying a compromised computing object causally dependent on the root cause of the malware on the endpoint, and
the event handler configured to respond to an exit condition by returning to the first event in the sequence of events; and
deploying the event handler on the endpoint for use in identifying the malware.
6. The method of claim 5 , further comprising monitoring events on the endpoint with the event handler, and in response to detecting the malware on the endpoint based upon an occurrence of the sequence of events concluding in the terminal event, remediating the malware on the endpoint.
7. The method of claim 5 , wherein configuring the event handler includes creating the sequence of events based on a forward traversal of the event graph.
8. The method of claim 5 , wherein deploying the event handler includes deploying the event handler in a security agent executing on the endpoint.
9. The method of claim 5 , wherein deploying the event handler includes deploying the event handler on a threat management facility, wherein the endpoint is instrumented to communicate event detection information for the sequence of events to the threat management facility.
10. The method of claim 5 wherein at least one of the sequence of events includes a multi-parameter event.
11. The method of claim 5 , wherein the exit condition includes a time limit for detection of the malware.
12. The method of claim 5 , wherein the sequence of events includes at least one event from a computing object selected from a group consisting of a data file, a process, an application, a registry entry, a network address, and a peripheral device.
13. The method of claim 5 , wherein the sequence of events includes at least one event from a network address selected from a group consisting of a uniform resource locator (URL), an internet protocol (IP) address, and a domain name.
14. The method of claim 5 , wherein the sequence of events includes at least one event from a peripheral device selected from a group including at least one of a universal serial bus (USB) memory, a network interface card, a camera, a printer, a mouse and a keyboard.
15. The method of claim 5 , wherein the sequence of events includes at least one file operation selected from a group consisting of a read, a write, an open, a move, a copy and a delete.
16. The method of claim 5 , wherein the sequence of events includes at least one inter-process communication selected from a group consisting of a create, a handle, a debug and a remote injection.
17. A system comprising:
a threat management facility configured to perform the steps of:
identifying a first event in a sequence of events associated with malware on an endpoint, wherein identifying the first event includes traversing an event graph among a sequence of causal events in reverse chronological order to a root cause of the malware;
configuring an event handler for malware detection on the endpoint based on the sequence of events,
the event handler including a first state configured to monitor for an occurrence of the first event in the sequence of events, and to respond to the occurrence of the first event in the sequence of events by transitioning to a second state,
the event handler configured in the second state to monitor for a second one of the sequence of events, wherein the second one of the sequence of events is a next sequential one of the sequence of events associated with malware,
the event handler further configured to respond to a terminal event in the sequence of events by identifying a compromised computing object casually dependent on the root cause of the malware on the endpoint, and
the event handler configured to respond to an exit condition from one or more of the sequence of events by returning to the first event in the sequence of events; and
a local security agent locally executing on the endpoint,
the local security agent deploying the event handler on the endpoint for use in identifying the malware,
the local security agent configured to monitor events on the endpoint with the event handler, and
the local security agent configured to, in response to detecting the malware on the endpoint based upon an occurrence of the terminal event in the sequence of events, initiate remediation of the malware on the endpoint.
18. The system of claim 17 , wherein configuring the event handler for malware detection includes creating the sequence of events based on a forward traversal of the event graph.
19. The system of claim 17 , wherein the exit condition includes a time limit for detection of the malware.
20. The system of claim 17 , wherein the sequence of events includes an event from at least one of a computing object, a network address, a peripheral device, a file operation, and an inter-process communication.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/965,075 US20230032874A1 (en) | 2017-09-08 | 2022-10-13 | Realtime event detection |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762556131P | 2017-09-08 | 2017-09-08 | |
US16/032,814 US20190081963A1 (en) | 2017-09-08 | 2018-07-11 | Realtime event detection |
US17/965,075 US20230032874A1 (en) | 2017-09-08 | 2022-10-13 | Realtime event detection |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/032,814 Continuation US20190081963A1 (en) | 2017-09-08 | 2018-07-11 | Realtime event detection |
Publications (1)
Publication Number | Publication Date |
---|---|
US20230032874A1 true US20230032874A1 (en) | 2023-02-02 |
Family
ID=65631817
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/032,814 Abandoned US20190081963A1 (en) | 2017-09-08 | 2018-07-11 | Realtime event detection |
US17/965,075 Pending US20230032874A1 (en) | 2017-09-08 | 2022-10-13 | Realtime event detection |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/032,814 Abandoned US20190081963A1 (en) | 2017-09-08 | 2018-07-11 | Realtime event detection |
Country Status (3)
Country | Link |
---|---|
US (2) | US20190081963A1 (en) |
GB (1) | GB2581608B (en) |
WO (1) | WO2019048858A1 (en) |
Families Citing this family (32)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10958667B1 (en) | 2016-06-03 | 2021-03-23 | Mcafee Llc | Determining computing system incidents using node graphs |
US10565376B1 (en) | 2017-09-11 | 2020-02-18 | Palo Alto Networks, Inc. | Efficient program deobfuscation through system API instrumentation |
US10785239B2 (en) | 2017-12-08 | 2020-09-22 | Mcafee, Llc | Learning maliciousness in cybersecurity graphs |
US11863572B1 (en) * | 2018-03-14 | 2024-01-02 | Amazon Technologies, Inc. | Adaptive data filtering system |
KR102059808B1 (en) * | 2018-06-11 | 2019-12-27 | 주식회사 티맥스오에스 | Container-based integrated management system |
WO2020033457A1 (en) * | 2018-08-07 | 2020-02-13 | Jamf Software, Llc | Game engine-based computer security |
US20220035906A1 (en) * | 2018-11-12 | 2022-02-03 | Nec Corporation | Information processing apparatus, control method, and program |
US11354407B2 (en) * | 2018-12-28 | 2022-06-07 | Intel Corporation | Techniques for library behavior verification |
US11481486B2 (en) | 2019-03-27 | 2022-10-25 | Webroot Inc. | Behavioral threat detection engine |
US11314863B2 (en) * | 2019-03-27 | 2022-04-26 | Webroot, Inc. | Behavioral threat detection definition and compilation |
US11080394B2 (en) | 2019-03-27 | 2021-08-03 | Webroot Inc. | Behavioral threat detection virtual machine |
US11080391B2 (en) | 2019-03-27 | 2021-08-03 | Webroot Inc. | Behavioral threat detection definition and compilation |
US11334666B2 (en) * | 2019-04-15 | 2022-05-17 | Qualys Inc. | Attack kill chain generation and utilization for threat analysis |
US11290494B2 (en) | 2019-05-31 | 2022-03-29 | Varmour Networks, Inc. | Reliability prediction for cloud security policies |
US11290493B2 (en) | 2019-05-31 | 2022-03-29 | Varmour Networks, Inc. | Template-driven intent-based security |
US11711374B2 (en) | 2019-05-31 | 2023-07-25 | Varmour Networks, Inc. | Systems and methods for understanding identity and organizational access to applications within an enterprise environment |
US11575563B2 (en) | 2019-05-31 | 2023-02-07 | Varmour Networks, Inc. | Cloud security management |
US11310284B2 (en) * | 2019-05-31 | 2022-04-19 | Varmour Networks, Inc. | Validation of cloud security policies |
US11863580B2 (en) | 2019-05-31 | 2024-01-02 | Varmour Networks, Inc. | Modeling application dependencies to identify operational risk |
CN112395149B (en) * | 2019-08-15 | 2023-01-06 | 奇安信安全技术(珠海)有限公司 | Script behavior identification method and device, storage medium and computer equipment |
US11296868B1 (en) * | 2019-09-17 | 2022-04-05 | Trend Micro Incorporated | Methods and system for combating cyber threats using a related object sequence hash |
AU2021231655B2 (en) | 2020-02-06 | 2024-02-15 | Austin Star Detonator Company | Integrated detonator sensors |
US20210397738A1 (en) * | 2020-06-22 | 2021-12-23 | Sophos Limited | Filtered data lake for enterprise security |
US12056239B2 (en) * | 2020-08-18 | 2024-08-06 | Micro Focus Llc | Thread-based malware detection |
US11818152B2 (en) | 2020-12-23 | 2023-11-14 | Varmour Networks, Inc. | Modeling topic-based message-oriented middleware within a security system |
US11876817B2 (en) | 2020-12-23 | 2024-01-16 | Varmour Networks, Inc. | Modeling queue-based message-oriented middleware relationships in a security system |
US12050693B2 (en) | 2021-01-29 | 2024-07-30 | Varmour Networks, Inc. | System and method for attributing user behavior from multiple technical telemetry sources |
US11777978B2 (en) | 2021-01-29 | 2023-10-03 | Varmour Networks, Inc. | Methods and systems for accurately assessing application access risk |
US11734316B2 (en) | 2021-07-08 | 2023-08-22 | Varmour Networks, Inc. | Relationship-based search in a computing environment |
LU500755B1 (en) * | 2021-10-19 | 2023-04-20 | Microsoft Technology Licensing Llc | Confining lateral traversal within a computer network |
US11874933B2 (en) | 2021-12-29 | 2024-01-16 | Qualys, Inc. | Security event modeling and threat detection using behavioral, analytical, and threat intelligence attributes |
US20240169056A1 (en) * | 2022-11-17 | 2024-05-23 | Sophos Limited | Managing and classifying computer processes |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7249381B2 (en) * | 2004-03-29 | 2007-07-24 | Bryte Computer Technologies, Inc. | Controller and resource management system and method with improved security for independently controlling and managing a computer system |
US7490065B1 (en) * | 1999-10-18 | 2009-02-10 | Stamps.Com | Cryptographic module for secure processing of value-bearing items |
US20150142988A1 (en) * | 2012-04-16 | 2015-05-21 | Telefonaktiebolaget L M Ericsson (Publ) | Protocol state based packet filter |
US9225730B1 (en) * | 2014-03-19 | 2015-12-29 | Amazon Technologies, Inc. | Graph based detection of anomalous activity |
US10389738B2 (en) * | 2015-08-31 | 2019-08-20 | Splunk Inc. | Malware communications detection |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8648621B2 (en) * | 2011-12-15 | 2014-02-11 | Micron Technology, Inc. | Counter operation in a state machine lattice |
US10042654B2 (en) * | 2014-06-10 | 2018-08-07 | International Business Machines Corporation | Computer-based distribution of large sets of regular expressions to a fixed number of state machine engines for products and services |
CA3020559C (en) * | 2016-04-15 | 2024-06-25 | Sophos Limited | Forensic analysis of computing activity and malware detection using an event graph |
-
2018
- 2018-07-11 US US16/032,814 patent/US20190081963A1/en not_active Abandoned
- 2018-09-06 GB GB2004874.0A patent/GB2581608B/en active Active
- 2018-09-06 WO PCT/GB2018/052520 patent/WO2019048858A1/en active Application Filing
-
2022
- 2022-10-13 US US17/965,075 patent/US20230032874A1/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7490065B1 (en) * | 1999-10-18 | 2009-02-10 | Stamps.Com | Cryptographic module for secure processing of value-bearing items |
US7249381B2 (en) * | 2004-03-29 | 2007-07-24 | Bryte Computer Technologies, Inc. | Controller and resource management system and method with improved security for independently controlling and managing a computer system |
US20150142988A1 (en) * | 2012-04-16 | 2015-05-21 | Telefonaktiebolaget L M Ericsson (Publ) | Protocol state based packet filter |
US9225730B1 (en) * | 2014-03-19 | 2015-12-29 | Amazon Technologies, Inc. | Graph based detection of anomalous activity |
US10389738B2 (en) * | 2015-08-31 | 2019-08-20 | Splunk Inc. | Malware communications detection |
Also Published As
Publication number | Publication date |
---|---|
GB2581608A8 (en) | 2020-10-14 |
WO2019048858A1 (en) | 2019-03-14 |
US20190081963A1 (en) | 2019-03-14 |
GB2581608B (en) | 2023-02-01 |
GB2581608A (en) | 2020-08-26 |
GB202004874D0 (en) | 2020-05-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11550909B2 (en) | Tracking malicious software movement with an event graph | |
US20230032874A1 (en) | Realtime event detection | |
US12052272B2 (en) | Forensic analysis of computing activity | |
CA3020559C (en) | Forensic analysis of computing activity and malware detection using an event graph | |
US11853414B2 (en) | Mitigation of return-oriented programming attacks | |
US11741222B2 (en) | Sandbox environment for document preview and analysis | |
US10868821B2 (en) | Electronic mail security using a heartbeat | |
US10972483B2 (en) | Electronic mail security using root cause analysis | |
US12093383B2 (en) | Tracking malware root causes with an event graph | |
US11929992B2 (en) | Encrypted cache protection | |
WO2022208045A1 (en) | Encrypted cache protection | |
WO2019122832A1 (en) | Electronic mail security using a user-based inquiry | |
GB2551972B (en) | Endpoint malware detection using an event graph | |
GB2573076A (en) | Endpoint malware detection using an event graph |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SOPHOS LIMITED, UNITED KINGDOM Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WAGHORN, WILLIAM DAVID;REEL/FRAME:061416/0059 Effective date: 20180710 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |