Search results
220 packages found
SeoCheck module is build to check if there is/are any irregularites in your HTML file. You can customise your own set of rules to check if your end requirements are met.
Async and sync crawler for json object
Crawls a Multi-Page Application to a zip file, serve the Multi-Page Application from the zip file. A MPA archiver. Could be used as a Site Generator
A simple web crawler with a cli suitable for downloading online html documentation.
URL crawler for analysing web content
Perfect SEO for JavaScript websites. Pre-rendering — it's just like SSR with simple integration and no coding
- _escaped_fragment_
- crawl
- SEO
- middleware
- spiderable
- crawlble
- prerender
- prerendering
- ajax
- seo
- angular
- backbone
- emberjs
- meteor
- View more
takes an array of urls and crawls the urls for links
Generic utility functions (Mixin Lodash)
- utils
- kaio
- util
- random
- md5
- sha256
- hash
- crawl
- random datetime
- isEmpty
- isNullOrWhiteSpace
- isNullOrUndefined
- toKb
- toHHMMSS
- View more
Crawl your CSS/SCSS or HTML files for img URL's and store the crawled image URL's in a local JSON file.
crawl github issues to build a dependency graph
A composable component that recreates the Star Wars opening crawl
`algoliasearch-netlify-frontend` is the front-end bundle we recommend to use with our Netlify plugin.
- algolia
- algoliasearch
- crawl
- crawler
- indexing
- jamstack
- netlify-plugin
- netlify-search
- netlify
- plugin
- robots
- search
- ui
Scrap the web asynchronously in live, reusing Node.js, all in one file, with a few lines!
- scrap
- scraping
- web
- web-scraping
- webscraping
- electron
- async
- asynchronous
- live
- browser
- automation
- web2os
- harvest
- crawl
- View more
Crawl data or download files from website with custom rules
Harvesting data at the <html> mine.
A Node.js module for downloading a single image or multiple images to disk from a given Url (checking if url exist and detecting image type)