The Ultimate Web Scraping Course
Please rate the course
Category:
Language:
English
Duration:
10:32:49
Number of lessons:
53
Update date:
27/02/2025
Rating:
0.0
Course short description
I have been making a living with web scraping for over 3 years, earned more than $125,000, I have over 25,000 followers on social media, and in this course, I will tell exactly how I scrape websites, as well as how to find clients and grow on social media.
In this course, I will show you how to scrape the following websites (and provide you with the code):
- TikTok
- Zillow
- Google Search
- Google Maps
- Amazon
- Indeed
- ESPN
- Angi List
- And more!
I will also explain how I found clients and gained over 25,000 followers on social media (and how you can do the same).
What's inside the course:
- 9 hours of video materials
- The legality of web scraping: what do you need to know?
- Scrapers vs. hackers: what's the difference?
- All the services I use (proxies, programming languages, servers, databases, packages for bypassing blocks)
- How websites get their data (how APIs work)
- My process for scraping ANY website
- How to find the data source
- How to avoid being blocked
- All about proxies
- Scraping by web frameworks (React, Next.js, static HTML/server-side rendering, ASP.NET, Java)
- How to reverse engineer and bypass websites with good protection
- Scraping websites with cursor-based pagination (e.g., comments on YouTube)
- Scraping Chrome extensions to get free email addresses
- How to scrape mobile apps
- How to search for information about people (finding phone numbers and email addresses)
- How to run Puppeteer on AWS Lambda
- How to intercept requests with Puppeteer
- Solving captchas with Puppeteer
- How to find clients for web scraping
- How to invoice clients
- Product ideas based on web scraping
Disclaimers:
- The code is written in JavaScript, and I use a Mac with VS Code.
- I only briefly mention Puppeteer (there are much BETTER ways).
- Web scraping is not magic. You need a source to scrape from (a website). For example, you cannot scrape people's bank accounts or something similar. That would fall under hacking, which is a different field.
Requirements:
- You should have a good understanding of JavaScript or some other programming language to get the most out of this course.
- If you cannot program at all, this course is not for you.
- I do not teach the basics of programming or JavaScript in this course.