❤
npm
Sign UpSign In

sunnypurewal

Sunny Purewal

Packages 5

  • hittp

    HTTP library specifically designed for crawling the web. Built-in caching and per-domain queueing

    sunnypurewal
    published version 0.7.7, 5 years ago

  • getsitemap

    Node.js module that recursively crawls a website's sitemap and returns a stream of URLs

    sunnypurewal
    published version 0.11.0, 5 years ago

  • turbocrawl

    The simple and fast crawling framework. So you can focus on scraping.

    sunnypurewal
    published version 0.4.1, 5 years ago

  • tcrawl

    Command Line Interface for Turbo Crawl

    sunnypurewal
    published version 0.3.3, 5 years ago

  • s3-bucket-stream

    Readable stream of the Body of every object in an S3 bucket.

    sunnypurewal
    published version 1.3.2, 5 years ago