Search results

cheerio

The fast, flexible & elegant library for parsing and manipulating HTML and XML.

• htmlparser
• jquery
• selector
• scraper
• parser
• dom
• xml
• html

feedic

• 1.0.0 • 9 months ago • 17,673 dependents • MITpublished version 1.0.0, 9 months ago17673 dependents licensed under $MIT

robots-parser

A specification compliant robots.txt parser with wildcard (*) matching support.

• robots.txt
• parser
• user-agent
• scraper
• spider
• bot
• robots-exclusion-standard

samclarke

• 3.0.1 • 2 years ago • 79 dependents • MITpublished version 3.0.1, 2 years ago79 dependents licensed under $MIT

@bochilteam/scraper

Browserless scraper module

• scraper
• web scraping
• http web scraping

bochilgaming

• 5.0.1 • 9 months ago • 15 dependents • GPL-3.0-or-laterpublished version 5.0.1, 9 months ago15 dependents licensed under $GPL-3.0-or-later

@mendable/firecrawl-js

JavaScript SDK for Firecrawl API

• firecrawl
• mendable
• crawler
• web
• scraper
• api
• sdk

hello_sideguide

• 1.24.0 • 8 days ago • 25 dependents • MITpublished version 1.24.0, 8 days ago25 dependents licensed under $MIT

apify-client

Apify API client for JavaScript

• apify
• api
• apifier
• crawler
• scraper

apify-service-account

• 2.12.3 • 16 hours ago • 32 dependents • Apache-2.0published version 2.12.3, 16 hours ago32 dependents licensed under $Apache-2.0

open-graph-scraper

Node.js scraper module for Open Graph and Twitter Card info

• app links
• dublin core
• json ld
• meta tags
• metadata
• og
• ogp
• ogs
• open graph scraper
• open graph
• opengraph
• openGraphScraper
• scraper
• twitter card

jshemas

• 6.10.0 • 3 days ago • 72 dependents • MITpublished version 6.10.0, 3 days ago72 dependents licensed under $MIT

@crawlee/core

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.13.2 • 17 days ago • 27 dependents • Apache-2.0published version 3.13.2, 17 days ago27 dependents licensed under $Apache-2.0

metascraper

A library to easily scrape metadata from an article on the web using Open Graph, JSON+LD, regular HTML metadata, and series of fallbacks.

• RDF
• article
• browser
• cheerio
• content
• expand
• extract
• facebook
• fallback
• fetch
• get
• graph
• html
• json-ld
• View more

kikobeats

• 5.46.11 • 21 days ago • 74 dependents • MITpublished version 5.46.11, 21 days ago74 dependents licensed under $MIT

@crawlee/cheerio

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.13.2 • 17 days ago • 4 dependents • Apache-2.0published version 3.13.2, 17 days ago4 dependents licensed under $Apache-2.0

@crawlee/cli

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.13.2 • 17 days ago • 1 dependents • Apache-2.0published version 3.13.2, 17 days ago1 dependents licensed under $Apache-2.0

ddg-bulk-image-downloader

Lazy way to download images from Duck Duck Go search results in bulk

• duckduckgo
• scraper
• images
• download
• image-downloader
• oclif

ankii

• 0.1.11 • 3 years ago • 0 dependents • MITpublished version 0.1.11, 3 years ago0 dependents licensed under $MIT

@crawlee/browser

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.13.2 • 17 days ago • 6 dependents • Apache-2.0published version 3.13.2, 17 days ago6 dependents licensed under $Apache-2.0

@crawlee/playwright

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.13.2 • 17 days ago • 7 dependents • Apache-2.0published version 3.13.2, 17 days ago7 dependents licensed under $Apache-2.0

@crawlee/puppeteer

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.13.2 • 17 days ago • 3 dependents • Apache-2.0published version 3.13.2, 17 days ago3 dependents licensed under $Apache-2.0

@crawlee/jsdom

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.13.2 • 17 days ago • 1 dependents • Apache-2.0published version 3.13.2, 17 days ago1 dependents licensed under $Apache-2.0

@crawlee/http

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.13.2 • 17 days ago • 5 dependents • Apache-2.0published version 3.13.2, 17 days ago5 dependents licensed under $Apache-2.0

@crawlee/templates

Templates for the crawlee projects

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.13.2 • 17 days ago • 1 dependents • Apache-2.0published version 3.13.2, 17 days ago1 dependents licensed under $Apache-2.0

crawlee

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.13.2 • 17 days ago • 50 dependents • Apache-2.0published version 3.13.2, 17 days ago50 dependents licensed under $Apache-2.0

@crawlee/linkedom

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.13.2 • 17 days ago • 1 dependents • Apache-2.0published version 3.13.2, 17 days ago1 dependents licensed under $Apache-2.0

apify

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify
• headless
• chrome
• puppeteer
• crawler
• scraper

apify-service-account

• 3.4.0 • 24 days ago • 49 dependents • Apache-2.0published version 3.4.0, 24 days ago49 dependents licensed under $Apache-2.0