Awesome Open Source
Awesome Open Source

DaveDaveFind is a simple search engine based on the web crawler developed in the Udacity CS101 course. It is built with the Bottle web framework by Marcel Hellkamp and designed to run on Google App Engine. The web crawler script udacity_crawler.py uses BeautifulSoup, an HTML parsing library by Leonard Richardson, and the Robot Exclusion Rules parser by Philip Semanchuk.

A working version of this application is available here. Detailed development notes for this project are available here.

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License. Please see the included licensing information for further details.

Alternatives To Davedavefind
Select To Compare


Alternative Project Comparisons
Related Awesome Lists
Top Programming Languages

Get A Weekly Email With Trending Projects For These Topics
No Spam. Unsubscribe easily at any time.
Python (889,294
Web (37,741
Course (20,514
Crawler (10,223
Udacity (5,008
Web Crawler (4,265
Search Engine (2,676