patrik
|
156e89c597
|
Fixed a bug that would incorrectly parse the url scheme [Patrik]
|
2011-12-17 19:45:48 +00:00 |
|
patrik
|
4214307364
|
o [NSE] Added the script http-grep that attempts to match web pages and urls
against a given pattern. [Patrik]
|
2011-12-11 19:44:26 +00:00 |
|
patrik
|
74b53a6a14
|
o [NSE] Added stop function to crawler so that scripts can properly shutdown
the crawler in case they want to end early. [Patrik]
|
2011-12-11 10:59:35 +00:00 |
|
patrik
|
8254da793e
|
o [NSE] Added getLimitations function to httpspider that returns any
limitations imposed on the crawler. [Patrik]
|
2011-12-10 10:11:56 +00:00 |
|
patrik
|
e20a1b5174
|
o [NSE] Modified the httpspider library to prefetch links in the queue and
change how script arguments are processed. Script and library arguments are
now processed from within the library. [Patrik]
|
2011-12-09 15:48:19 +00:00 |
|
patrik
|
682a9a746b
|
o [NSE] Added a new httpspider library and the script http-email-harvest that
collects e-mail addresses by spidering a website. [Patrik]
|
2011-12-06 22:47:11 +00:00 |
|