Web crawler requirements
If you would like to follow along, here is a list of the software that will be used throughout this tutorial and other requirements:
- Python 3.x software, available at https://www.python.org/downloads/
- an IDLE. We will use the free edition of PyCharm: https://www.jetbrains.com/pycharm/
- Internet connection is required in order to run the crawler.
- the code will be valid for Python 3.x. It will not work in the previous versions of Python.
- all code used in the tutorial is available at https://geek-university.com/crawler.zip