# Copyright (C) 2011 Diego Pardilla Mata # # This file is part of SpiderBOY. # # SpiderBOY is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program. If not, see . This is the SpiderBoy crawler. It has (among others) the following major features Search URL's from another URL and with a depth indicated Installation: See INSTALL file for information on how to install SpiderBOY Starting SpiderBOY: run from the command line: `spiderboy.py [-h] [-n NUMBER_OF_LEVELS] [url]' run `spiderboy.py -h' for more startup options More information: http://code.sidelab.es/projects/diegopardilla/wiki Written by: see AUTHORS for more information Reporting Bugs: Please report bugs to our mailing list or our bugtracker: munikes@members.fsf.org pardilla@members.fsf.org http://code.sidelab.es/projects/diegopardilla/issues/new Contacting us: http://packages.python.org/SpiderBOY (homepage) munikes@members.fsf.org (mUniKeS) pardilla@members.fsf.org (Diego Pardilla)