patrik 84c3de36fc Applied patch from Daniel Miller to fix two bugs in the httpspider library: ...

* First bug, the LinkExtractor portion of httpspider doesn't check for a negative
    maxdepth (indicating no limit), and rejects all links.
  * Second bug, the withinhost and withindomain matching functions would throw an error
    when presented with a URL without a host portion. 

In addition the validate_link function was moved out to a separate function in the
LinkExtractor Class. [Daniel Miller]

2012-05-22 17:26:12 +00:00

25 KiB

Raw Blame History

View Raw