Awesome

URL Extractor

Attempts to create a list of URLs from files, and checks whether they actually exist/respond before saving them to a file.

Usually log files.

For example, getting domains from my Bind (DNS) server. But not every domain has a webserver running behind it.

Populate my GFW-URL-checker's host file (http://yeri.be/hr).

Maintained by Yeri Tiete (aka Tuinslak)