Skip to content

A small and simple web crawler designed to log bad links and images on a given website.

Notifications You must be signed in to change notification settings

apawloski/Daddy-Small-Legs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This was a quick project designed to find broken links and bad images on a given domain.

INSTALLATION: $ pip install -r requirements.txt

USAGE: 	      $ python daddy.py $BASE_DOMAIN_URL

OUTPUT:       bad_links.log	 <- list of all bad links found during crawl
	      bad_images.log	 <- list of all bad images found during crawl

The first line of these output files is the number of bad links or images found. This is convenient for interacting with a Nagios plugin or similar monitoring utility -- they just have to check the first line of the bad_*.log file. Two bare-bone nagios plugins are included as examples.

About

A small and simple web crawler designed to log bad links and images on a given website.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published