deepl-scraper
Scrape data from DeepL translator without applying for the paid authenticated API, using Puppeteer, Chrome browser's headless API.
Getting started
Prerequisites
- NodeJS
- NPM
- Yarn
Install
From npm
yarn add deepl-scraper
or
npm i deepl-scraper --save
Usage
const translate getSupportedLanguages quit = ; ;
Parameters
sentence
string - Word/sentence to be translatedsource
string (optional) - Word/sentence original language
Default :auto
target
string - Language for word/sentence to be translated
Supported languages
The module doesn't store languages and will always support DeepL's languages list without required update.
IETF tags are used as language format.
Get arrays of supported source and target languages using the following code :
;
Quitting
Since this module uses a headless browser, it won't quit as long as your main script is ronning or until you quit it using the following code :
Error handling
INVALID_SOURCE_LANGUAGE
INVALID_TARGET_LANGUAGE
UNSUPPORTED_SOURCE_LANGUAGE
UNSUPPORTED_TARGET_LANGUAGE
Examples
Translate from defined language
;
Translate from auto-detected language
(a single word's language is usually more difficult to detect)
// Either;// Or;
(a sentence's language is usually more efficient)
;
Planned features
- Get word-by-word definitions, quotes and synonyms
- Bypass maximum text length
FAQ
Why using Puppeteer instead of HTTP requests ?
Fucking rate limit error always showing up, whatever you do.
Changelog
1.0.0
(2019-05-06) • Initial release1.0.x
(2019-05-11)1.0.1
- Added examples title in
README.md
- Fixed Promise never resolving while alt sentences not available
1.0.2
- Retry when browser error
1.0.3
- Fixed retry
- Fixed changelog version typo
1.0.4
- Close page after translation
- Added examples title in
1.0.5
(2019-06-27)- Added
getSupportedLanguages
method - Improved translation complete detection
- Fixed cannot launch new browser when previously closed
- Fixed incompatibility with multi-requests translation (#1)
- Added
1.0.6
(2019-07-05)- Fixed auto/non-auto parameter
- Fixed translation complete detection (again)
1.0.7
(2019-07-05)- Fixed translation complete detection (again !)
1.0.9
(2020-07-10)- Fixed supported languages detection & selection
- Improved translation completion detection & result parsing
- Replaced deprecated request dependency by axios dependency
- Replaced JSDOM dependency by RegExp processing
- Replaced
quit
parameter fromtranslate
method to newquit
method - Refactored using async/await
1.0.10
(2020-08-21) • Actually remove jsdom NPM dependency1.0.11
(2020-08-24)- Fixed & improved supported languages parsing
- Implemented
UNSUPPORTED_SOURCE_LANGUAGE
&UNSUPPORTED_TARGET_LANGUAGE
errors