A pipeline to scrape, extract, and analyze book data from web pages to insights.
This repository contains the source files of the Web Data Commons website and is used to maintain the site. The Web Data Commons project extracts structured data from the Common Crawl
Scrape the novel Moby Dick from the website Project Gutenberg using the Python package requests. Then you'll extract words from this web data using BeautifulSoup. Finally, we'll dive into analyzing the distribution of words using the Natural Language ToolKit (nltk)
Add a description, image, and links to the web-data-extraction topic page so that developers can more easily learn about it.
To associate your repository with the web-data-extraction topic, visit your repo's landing page and select "manage topics."