19
GitHub - s0md3v/uro: declutters url lists for crawling/pentesting
source link: https://github.com/s0md3v/uro
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Using a URL list for security testing can be painful as there are a lot of URLs that have uninteresting/duplicate content; uro aims to solve that.
It doesn't make any http requests to the URLs and removes:
- human written content e.g. blog posts
- urls with same path but parameter value difference
- incremental urls e.g.
/cat/1/and/cat/2/ - image, js, css and other static files
Usage
First, install uro with pip:
pip3 install uro
Now, there's just one way to use it, no args, no bullshit.
cat urls.txt | uro
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK