Scrapera is a completely Chromedriver free package that provides access to a variety of scraper scripts for most commonly used machine learning and data science domains. Scrapera directly and asynchronously scrapes from public API endpoints, thereby removing the heavy browser overhead which makes Scrapera extremely fast and robust to DOM changes. Currently, Scrapera supports the following crawlers:
DISCLAIMER: Owner or Contributors do not take any responsibility for misuse of data obtained through Scrapera. Contact the owner if copyright terms are violated due to any module provided by Scrapera.
Prerequisites can be installed separately through the requirements.txt file as below
pip install -r requirements.txt
Scrapera is built with Python 3 and can be pip installed directly
Alternatively, if you wish to install the latest version directly through GitHub then run
pip install git+https://github.com/DarshanDeshpande/Scrapera.git
To use any sub-module, you just need to import, instantiate and execute
from scrapera.video.vimeo import VimeoScraper
scraper = VimeoScraper()
scraper.scrape('https://vimeo.com/191955190', '540p')
For more examples, please refer to the individual test folders in respective modules
Scrapera welcomes any and all contributions and scraper requests. Please raise an issue if the scraper fails at any instance. Feel free to fork the repository and add your own scrapers to help the community!
For more guidelines, refer to CONTRIBUTING
Distributed under the MIT License. See LICENSE for more information.
Feel free to reach out for any issues or requests related to Scrapera
Darshan Deshpande (Owner) - Email | LinkedIn
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4