❤
npm
Sign UpSign In

Search results

1000+ packages found

Sort by: Default
  • Default
  • Most downloaded this week
  • Most downloaded this month
  • Most dependents
  • Recently published

crawler

Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.

mike442144
published version 2.0.2, 10 months ago124 dependents licensed under $MIT
17,715

huntsman

Super configurable async web spider

missinglink
published version 0.3.0, 10 years ago0 dependents licensed under $MIT
122

web-spider

web-spider is a simple and fast web spider written with Nodejs!

yuexing0921
published version 0.3.1, 9 years ago0 dependents licensed under $MIT
38

floodesh

Floodesh is a distributed web spider/crawler written with Nodejs.

mike442144
published version 0.8.19, 5 years ago0 dependents licensed under $ISC
254

jul11co-sitespider

Jul11Co Web Spider

jul11co
published version 0.0.6, 7 years ago1 dependents licensed under $Apache-2.0
40

ppspider

web spider, support puppeteer, cheerio and so on, include task-queue and dispatcher

xiyuan_fengyu
published version 2.2.4-preview.1607350101966, 4 years ago0 dependents licensed under $MIT
339

@giladbeer/node-spider

Node.js web spider for site search

giladbeer
published version 2.0.2, 2 years ago0 dependents licensed under $MIT
36

spidey

Robust web spider for Node.js

smasadhaider
published version 1.0.7, 2 years ago1 dependents licensed under $ISC
48

siphon-web

make up a web spider with a few regular module。

royk
published version 0.3.1, 5 years ago0 dependents licensed under $ISC
54

nspider

A Node.js Web Spider

xiongjia
published version 0.0.3, 11 years ago0 dependents licensed under $MIT
22

crawler-hangzhou

A web spider of hangzhou

xjchenhao
published version 1.2.2, 8 years ago0 dependents licensed under $ISC
33

spider-cookies

Parse and stringify cookies for web spider.

jannchie
published version 1.0.3, 4 years ago1 dependents licensed under $MIT
21

node-webcrawler

Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously

mike442144
published version 0.8.0, 8 years ago6 dependents licensed under $ISC
894

xlspider

nodejs's web spider tools

xiaolongnice
published version 1.0.6, 3 years ago0 dependents licensed under $MIT
23

flowesh

Flowesh is the non-cluster version of floodesh. It's a middleware based web spider which is lightweight and easy to maintain

darrenqc
published version 1.2.4, 9 years ago0 dependents licensed under $ISC
60

@zachleat/spider-pig

Get a list of local URL links from a root URL.

zachleat
published version 3.0.0, 3 years ago1 dependents licensed under $MIT
10,623

spidar

web spider common tools, targets on chinese sites

bibig
published version 0.0.2, 11 years ago0 dependents licensed under $BSD-2-Clause
15

anansi-js

Node.js web spider for site search

giladbeer
published version 0.0.5, a year ago0 dependents licensed under $MIT
16

findmecrawler

Web spider for news

campanate
published version 1.0.0, 8 years ago0 dependents licensed under $ISC
13

fren

easy to build multi-node web spider based on request

molekilla
published version 0.2.0, 9 years ago0 dependents
20