URL Extractor

Extract every single internal and external URL from a domain name. Guaranteed no duplicates.

Spidering domain and extracting href attributes. Removing duplicates...