Install the following packages:
- selenium: To automate scraping. You can download using pip through command line as:
pip install selenium
- webdriver-manager: Install the chrome driver inplace so no need to download explicitly. You can download it through command line as:
pip install webdriver_manager
- word to number conversion:
pip install word2number
Currently this script works on chrome browser.
File structure:
-- AmazonConfig.py: Contains user-defined functions to retrieve data.
-- SetupDriver.py: Defines and initiate webdriver object of selenium.
-- ReviewScraping.py: Run this file to start scraping by entering the url of the page.