shriyanss / subdomain_wordlist_gen

Subdomain wordlist generator

subdomain_wordlist_gen (aka subgen)

Subdomain wordlist generator

Github: @shriyanss/subdomain_wordlist_gen

Table of contents

• Installation
  • Install using pip (recommended)
  • Install using setup.py file
• Usage
  • Generate a simple wordlist using the given subdomains file

Installation

Install using pip (recommended)

pip install subgen

OR

pip3 install subgen

NOTE: When tested on mac OS, installing without sudo didn't worked as expected, so consider running above commands as root instead

Install using setup.py file

sudo python setup.py install

OR

sudo python3 setup.py install

Usage

usage: subgen-runner.py [-h] -i INPUT [-s] [-o OUTPUT]

optional arguments:
  -h, --help            show this help message and exit
  -i INPUT, --input INPUT
                        Input file to generate wordlist with
  -s, --silent          Don't print the banner
  -o OUTPUT, --output OUTPUT
                        Output file to write the wordlist

Generate a simple wordlist using the given subdomains file

This will split and then print the results.

Example:-

$ cat subdomains.txt
www.example.com
blog.example.com
store.example.com
forum.example.com
support.example.com
news.example.com
app.example.com
mail.example.com
forum.example.com
events.example.com
partners.example.com

$ subgen -i subdomains.txt
               __                   
   _______  __/ /_  ____ ____  ____ 
  / ___/ / / / __ \/ __ `/ _ \/ __ \
 (__  ) /_/ / /_/ / /_/ /  __/ / / /
/____/\__,_/_.___/\__, /\___/_/ /_/ 
                 /____/             

www
blog
store
forum
support
news
app
mail
events
partners

subdomain_wordlist_gen's Issues

AttributeError: module 'importlib.resources' has no attribute 'files'

Hi, i when i want to use your program i get error like this i use the setup.py file also using pip and i have same error

Traceback (most recent call last):
  File "/usr/local/bin/subgen", line 11, in <module>
    load_entry_point('subgen==0.0.1', 'console_scripts', 'subgen')()
  File "/usr/local/lib/python3.8/dist-packages/subgen-0.0.1-py3.8.egg/subgen/subgen/cli.py", line 29, in main
  File "/usr/local/lib/python3.8/dist-packages/subgen-0.0.1-py3.8.egg/subgen/subgen/cli.py", line 7, in banner
  File "/usr/local/lib/python3.8/dist-packages/pyfiglet-1.0.2-py3.8.egg/pyfiglet/__init__.py", line 67, in figlet_format
    fig = Figlet(font, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/pyfiglet-1.0.2-py3.8.egg/pyfiglet/__init__.py", line 862, in __init__
    self.setFont()
  File "/usr/local/lib/python3.8/dist-packages/pyfiglet-1.0.2-py3.8.egg/pyfiglet/__init__.py", line 869, in setFont
    self.Font = FigletFont(font=self.font)
  File "/usr/local/lib/python3.8/dist-packages/pyfiglet-1.0.2-py3.8.egg/pyfiglet/__init__.py", line 128, in __init__
    self.data = self.preloadFont(font)
  File "/usr/local/lib/python3.8/dist-packages/pyfiglet-1.0.2-py3.8.egg/pyfiglet/__init__.py", line 141, in preloadFont
    path = importlib.resources.files('pyfiglet.fonts').joinpath(fn)
AttributeError: module 'importlib.resources' has no attribute 'files'```

Feature to remove any noise from the output

With reference to wordlist generated at https://github.com/shriyanss/subdomains_wordlist/blob/main/wordlist.txt, add a feature, that will remove any UUIDs or hashes from the output

Noise includes:-

• Hashes
• UUIDs
• Random numbers

Add a feature to remove the domain from the output

Add a feature, that will remove the TLD like .com and all to protect the privacy if the wordlist is to be shared

A new flag can be added for this

Feature to get the subdomains with most number of occurance

Adding a feature, that would filter out subdomains with less number of occurrences, or sort them as per their number of occurrences.

Can't be executed with `python3 -m subgen`

Add a file __main__.py so that it can be executed directly with python3 -m subgen