Add and delete URLs
Once we create queue and crawled files, we need to add data to them. We can do this by using a function that accepts two arguments:
- the path to the file.
- the data that need to be added to the file.
Here is the code you need to add to the general.py file:
def append_to_file(path, data): with open(path, 'a') as file: # opens the file in the append mode. file.write(data + '\n') # adds data (links) to file and bumps the cursor on the new line.
We will also create a function that will delete (overwrite) a file, which we will use in later sections:
def delete_file_contents(path): with open(path, 'w'): # opens data in write mode and overwrite it pass
The pass statement used above ensures that the block has at least one statement, but does nothing.