X Scrappy is a python based tool. which is used to find and collect sub-domains for a given domain from various websites.

The tool is collecting data from the following services:

• CRT.sh
• Censys
• HackerTarget
• ThreatCrowd

• Find Subdomains from various services
• Filter Out Duplicates sub-domains
• Stores all the unique subdomains into a file inside the folder with the name of the domain.

python3

1. Normal installation:

$ git clone https://github.com/altaf99/Tools.git
$ python3 -m pip install -r requirements.txt

2. Preferably install in a virtualenv:

Clone the repo into your machine
$ git clone https://github.com/altaf99/Tools.git

Create a virtual environment,
$ virtualenv -p /usr/bin/python3.8 myvenv

Now, at last, we just need to activate it, using the command
$ source myvenv/bin/activate

Now you are in a Python virtual environment

You can deactivate using
$ deactivate

and now install all the requirements
$ python3 -m pip install -r requirements.txt

the tool requires an API key for Censys, visit Censys API and Sign Up to get the below API credentials.

CENSYS_API_ID
CENSYS_API_SECRET

use the below command to set the environment variable, assign the value to the variables with your credentials, and enter the command in the terminal.

export CENSYS_API_ID="YOUR_ID"
export CENSYS_API_SECRET="YOUR_SECRET"

python3 x_scrappy.py domain

python3 x_scrappy.py google.com

Altaf Shaikh
Email

The tool is made as a part of the STTP Program by We Are plymouths
Thank You So much for conduction such a wonderful 21 days program 💯

Also thanks to Harsh Bothra sir for helping me to build the tool :)