Learning Path ⋅ Skills: Web Scraping, HTTP Requests, Data Parsing
Web scraping is about downloading structured data from the Web, selecting some of that data, and passing along what you selected to another process. With this learning path, you’ll learn the core Python technologies and skills that you need to build your own web scraper.
Python Web ScrapingLearning Path ⋅ 9 Resources
Laying the Foundation for Web ScrapingBefore you jump into web scraping, it’s important to brush up on some foundational skills, like making HTTP requests and understanding HTML and CSS.
#1
Course
HTTP Requests With Python's urllib.requestIn this video course, you'll explore how to make HTTP requests using Python's handy built-in module, urllib.request. You'll try out examples and go over common errors, all while learning more about HTTP requests and Python in general.
#2
Course
Making HTTP Requests With PythonThe requests library is the de facto standard for making HTTP requests in Python. It abstracts the complexities of making requests behind a beautiful, simple API so that you can focus on interacting with services and consuming data in your application. This course shows you how to work effectively with requests, from start to finish.
#3
Course
HTML and CSS Foundations for Python DevelopersThere's no way around HTML and CSS when you want to build web apps. Even if you're not aiming to become a web developer, knowing the basics of HTML and CSS will help you understand the Web better. In this video course, you'll get an introduction to HTML and CSS for Python programmers.
Getting Started With Web ScrapingNow that you’ve learned some foundational skills, you’re ready to start web scraping!
#4
Course
Web Scraping With Beautiful Soup and PythonIn this course, you'll walk through the main steps of the web scraping process. You'll learn how to write a script that uses Python's requests library to scrape data from a website. You'll also use Beautiful Soup to extract the specific pieces of information that you're interested in.
#5
Course
Exercises Course: Introduction to Web Scraping With PythonIn this course, you'll practice the main steps of the web scraping process. You'll write a script that uses Python's requests library to scrape and parse data from a website. You'll also interact with HTML forms using tools like Beautiful Soup and Mechanical Soup to extract specific information.
#6
Handling Response DataIn web scraping, you end up with lots of response data. Next up, you’ll learn what to do with it.
#7
Course
Working With JSON in PythonLearn how to work with Python's built-in json module to serialize the data in your programs into JSON format. Then, you'll deserialize some JSON from an online API and convert it into Python objects.
#8
Course
Reading and Writing CSV FilesThis short course covers how to read and write data to CSV files using Python's built in csv module and the pandas library. You'll learn how to handle standard and non-standard data such as CSV files without headers, or files containing delimeters in the data.
Automating Your Web Scraping ProcessFinally, you’ll learn how to use a headless browser to automate the web scraping process.
#9
Got feedback on this learning path?
Looking for real-time conversation? Visit the Real Python Community Chat or join the next “Office Hours” Live Q&A Session. Happy Pythoning!
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4