Get the HTML text bodies from web pages
Get a single body
const { getBody } = require('body-snatchers')
const bodyString = await getBody('https://news.ycombinator.com/', false)
Multiple bodies
const { getBodies } = require('body-snatchers')
const bodyStrings = await getBodies([
{ url: 'https://news.ycombinator.com/' },
{ url: 'https://google.com/', js: true } // page that requires JavaScript
])
Motivation
- Ease burden on CPU (requests pages one at a time)
- Work on Raspberry Pi (tested on 2, 3, 4*)