How to scrape data from any website using Python

Manpreet Singh
5 min readApr 19, 2021

Welcome back! Web scraping is one of the most powerful things you can learn, so let’s Learn to scrape some data from some websites using Python!

Basic introduction you could probably skip that I copied from my other article

First things first, we will need to have Python installed, read my article here to make sure you have Python and some IDE installed. Next, I wrote a article on using Selenium in Python, Selenium is a web scraping package that allows us to mimic a web browser using Python, it might be best to read that article for more of an understanding on web scraping, but it’s not a necessity, you can read that article here.

Python has several different web scraping packages, beautiful soup and selenium are a few, in this tutorial we’re going to be using Selenium, in another article we’ll talk about Beautiful Soup.

The Website

First off, we need to find a website where we want to scrape some data from, in this case lets just use Amazon. Lets first make our way over to a product page from Amazon, in this case I searched up Amazon and found a product, clicked on it and this is what we see:

--

--

Manpreet Singh
Manpreet Singh

No responses yet