Create a web crawler in Python

This course cover the process of creating a web crawler in Python.


About this course

This course cover the process of creating a web crawler in Python.  A web crawler is a program that browses the World Wide Web in a methodical fashion for the purpose of collecting information.


This tutorial is designed for people with prior experience in the world of programming and the Python programming language. If you are not familiar with Python, we recommend that you take our free Python course first.


You should have a year or two Python programming experience. You should know what a function is, how to create a file in Python, what are classes…

What you’ll learn

You will learn to create a fully functional web crawler in Python. After you finish the course, you should have a functional web crawler that you can use to gather all the links (or other elements) from a domain.


This course uses the web crawler code found on the GitHub website of Mr. Bucky Roberts, a well-known YouTube instructor. I encourage you to support his work by pledging an amount on

Course Reviews


3 ratings
  • 5 stars3
  • 4 stars0
  • 3 stars0
  • 2 stars0
  • 1 stars0
  1. Nice Web Crawler Course


    Thanks Geek University. The course explains nicely about web crawling with hands on code.

  • Number of Units20
  • Number of Quizzes0

Who’s Online

Profile picture of Jantzen Crosby
Profile picture of Johansson Bruun
Profile picture of Watts Rasch
Profile picture of Stuart Duke
Profile picture of Banke Freeman
Profile picture of Korsgaard Cooley
Profile picture of bkipgaa
Profile picture of Dominguez Cheng
Profile picture of podsumowania sprawdziany
Profile picture of Stanley Lindholm
Geek University 2021