Finishing Crawl Web – Intro to Computer Science
Articles,  Blog

Finishing Crawl Web – Intro to Computer Science


So now, we’re ready to finish the heart of our crawler. Let me put the last statement in, so you know there’s nothing else missing and you’ll be able to test this. And the last thing we want to do is return the result in crawled. When we finished the while loop, we’re ready to return crawled, which is the list of pages we found. What we have left to do is to figure out what we do to crawl each page. This is going to be a pretty tough quiz, I think you’ll need at least two lines of code. If you think about using all the procedures that you’ve learned about and the ones that you’ve defined in earlier quizzes, you shouldn’t need more than two lines. And the two things that you need to do are update the value of to crawl to reflect all the new links that are found on page And update the value of crawled, to keep track of the pages that have been crawled. See if you can figure out how to finish the crawl web procedure.

Leave a Reply

Your email address will not be published. Required fields are marked *