SourceForge.net hosts over 100,000 Open Source projects. You may find what you're looking for by searching our site directory .
This is the Web Crawler Security Tool project ("webcrawler-py")
This project is hosted by SourceForge.net. The project team describes it as:
Last update on tue mar 26 16:25 UTC 2012 The Web Crawler Security is a python based tool to automatically crawl a web site. It is a web crawler oriented to help in penetration testing tasks. The main task of this tool is to search and list all the links (pages and files) in a web site. The crawler has been completely rewritten in v1.0 bringing a lot of improvements: improved the data visualization, interactive option to download files, increased speed in crawling, exports list of found files into a separated file (useful to crawl a site once, then download files and analyse them with FOCA), generate an output log in Common Log Format (CLF), manage basic authentication and more! Many of the old features has been reimplemented and the most interesting one is the capability of the crawler to search for directory indexing.
SourceForge.net is the world's largest provider of hosting for Open Source software development projects. SourceForge.net provides a variety of services to projects, including a download mirror network, code hosting (like Git, Mercurial, and Subversion), and tools to support discussion and support. These services are provided to projects and their end-users free-of-charge.
Of benefit to users, Open Source software is licensed so you can download and use the software free-of-charge. The source code for this software is made available free-of-charge, you (or a programmer you hire) can make changes to this software to better meet your needs, and you can release your changed code back to the community passing the benefit on to other users.
To join this project, please contact the project administrators of this project, as shown on the project summary page.
This page is the default project web page supplied by SourceForge.net. If you are a member of this project, you can deploy your own project web site as per our site documentation.
If you are a developer interested in this project, please consider reaching out to the project admin (per the "Join this project" section, above) to offer your assistance.