Skip to content

benevolent0377/Wanderer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

113 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

__      __            _                 
\ \    / /_ _ _ _  __| |___ _ _ ___ _ _ 
 \ \/\/ / _\` | ' \/ _` / -_) '_/ -_) '_|
  \_/\_/\__,_|_||_\__,_\___|_| \___|_|  

Developed by: Benevolent0377

Start date: April 19, 2024

First stable release date: N/A

End date: N/A

==============================================

The Wanderer is a python web crawler designed to be a mulit-use web tool.

It will be expected to do the following:

  • Fetch HTML from a site or webpage

  • Fetch links from a webpage through HTML

  • Download video, image, and files from websites.

  • Index sites and write the data to a file.

The dependecies are currently unknown, but as development continues, I will list them here.

About

A python web crawler that downloads content from specified sites. The supported sites are in the sites file.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages