Member-only story
The Best Ways To Scrape Websites In 2022
Welcome back! Web scraping is one of my favorite things to do, it’s so much fun and it’s a great way to build out data sets for projects, so, let’s take a look at some of the best ways to scrape websites in 2022!
Selenium
In my opinion, Selenium is probably one of the most powerful web scrapers/crawlers out there, essentially, Selenium allows us to not only scrape websites, but allows us to navigate through websites as well! This is massive, imagine if you wanted to automatically populate information within a website, click a button on a website, even scroll down on a website, selenium can do that! There are also many different languages that support Selenium as well, if you want to jump to their website, here is a link to it:
Beautiful Soup
This is probably the most popular web scraping package with Python, Beautiful Soup was initially released in 2004…
