Add and delete URLs

Once we create queue and crawled files, we need to add data to them. We can do this by using a function that accepts two arguments:

  • the path to the file.
  • the data that need to be added to the file.

Here is the code you need to add to the general.py file:

 def append_to_file(path, data):
    with open(path, 'a') as file: # opens the file in the append mode.
        file.write(data + '\n') # adds data (links) to file and bumps the cursor on the new line.

We will also create a function that will delete (overwrite) a file, which we will use in later sections:

 def delete_file_contents(path):
     with open(path, 'w'): # opens data in write mode and overwrite it
         pass

The pass statement used above ensures that the block has at least one statement, but does nothing.

SEE ALL Add a note
YOU
Add your Comment
 

Who’s Online

There are no users currently online
Geek University 2021