krabber
Easy to use webscraper using Axios and JSDOM.
Example
; const scrapeConfig = url: 'https://github.com/axios/axios' options: headers: 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:64.0) Gecko/20100101 Firefox/64.0' select: { return dominnerHTML; }
More examples, including pagination handling
Please see the test suite in src/lib/scrape.spec.ts