sitescrapr

Simple website crawler and content scraper.

Author

Steve Veerman

About

The purpose of sitescrapr is to provide a framework to scrape content from a particular website.

Most sitescrapr projects will follow this pattern:

1. Get "search results/listings"
2. Parse "search results/listings" and save "item links"
3. Get all "items" from "item links"
4. Parse all "items"
5. Save all "items"

Usage

Please see sitescrapr-example for more documentation and working example.

$ npm install sitescrapr

History

0.0.1

• Initial sitescrapr implementation.

License

(The MIT License)