@picosix/cli
Picosix - modern, fast, powerful big data platform (#cli)
Usage
$ npm install -g @picosix/cli
$ picosix COMMAND
running command...
$ picosix (-v|--version|version)
@picosix/cli/1.0.21 darwin-x64 node-v10.16.3
$ picosix --help [COMMAND]
USAGE
$ picosix COMMAND
...
Commands
picosix copy ENTITY PROCESSNAME
picosix help [COMMAND]
picosix import DATA
picosix master FLOW
picosix prepare
picosix worker FLOW
picosix copy ENTITY PROCESSNAME
Copy your data from mongodb to elasticsearch
USAGE
$ picosix copy ENTITY PROCESSNAME
ARGUMENTS
ENTITY (post|comment) Your index entity likes: post or comment
PROCESSNAME (master|worker) Process you want to run
OPTIONS
-c, --cron=cron Run by cronjob (Please check [cron] for more details)
-h, --help show CLI help
-i, --fetchOpts.ids=fetchOpts.ids
-l, --fetchOpts.limit=fetchOpts.limit
-r, --bulkOpts.refresh
-s, --settings=settings /path/to/your/settings/file or json string (Please check [jsonic] for more
details)
-w, --workingDir=workingDir (required) [process.env.PWD] Defined working directory
--maxRound=maxRound [default: 99]
See code: dist/commands/copy.ts
picosix help [COMMAND]
display help for picosix
USAGE
$ picosix help [COMMAND]
ARGUMENTS
COMMAND command to show help for
OPTIONS
--all see all commands in CLI
See code: @oclif/plugin-help
picosix import DATA
Import your data
USAGE
$ picosix import DATA
ARGUMENTS
DATA /path/to/your/data or json string (Please check [jsonic] for more details)
OPTIONS
-h, --help show CLI help
-r, --repository=repository
-s, --settings=settings /path/to/your/settings/file or json string (Please check [jsonic] for more details)
-w, --workingDir=workingDir (required) [process.env.PWD] Defined working directory
See code: dist/commands/import.ts
picosix master FLOW
Exec Master Engine of Picosix Platform
USAGE
$ picosix master FLOW
ARGUMENTS
FLOW Your defined flow like: spider.links, link.details, link.comments, ...
OPTIONS
-c, --cron=cron Run by cronjob (Please check [cron] for more details)
-h, --help show CLI help
-l, --spiderOpts.limit=spiderOpts.limit
-q, --spiderOpts.query=spiderOpts.query
-s, --settings=settings /path/to/your/settings/file or json string (Please check [jsonic]
for more details)
-u, --spiderOpts.urls=spiderOpts.urls
-w, --workingDir=workingDir (required) [process.env.PWD] Defined working directory
--spiderOpts.insertUrlsIfNotFound
--spiderOpts.skipDuration=spiderOpts.skipDuration Don't select spider in this duration (unit: minutes)
See code: dist/commands/master.ts
picosix prepare
Prepare your data for crawler
USAGE
$ picosix prepare
OPTIONS
-h, --help show CLI help
-s, --settings=settings /path/to/your/settings/file or json string (Please check [jsonic] for more details)
-w, --workingDir=workingDir (required) [process.env.PWD] Defined working directory
See code: dist/commands/prepare.ts
picosix worker FLOW
Exec Worker Engine of Picosix Platform
USAGE
$ picosix worker FLOW
ARGUMENTS
FLOW Your defined flow like: spider.links, link.details, link.comments, ...
OPTIONS
-h, --help show CLI help
-s, --settings=settings /path/to/your/settings/file or json string (Please check [jsonic] for more details)
-w, --workingDir=workingDir (required) [process.env.PWD] Defined working directory
See code: dist/commands/worker.ts