Contributing to Larger Open Source Project - Scrapy

This page summarizes the projects mentioned and recommended in the original post on dev.to

InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com
featured
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video.
Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
getstream.io
featured
  1. Repo-Context-Packager

    Pack Git Repository into a text file for use in LLM (by DenisC96)

    In the past three months, I worked on various open source projects, including my own project Repo Context Packager, Math Worksheet Generator and Open Web Calendar. This month, I want to challenge myself to work on a larger and more widely used project - Scrapy, a Python module for web crawling.

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. math-worksheet-generator

    Create basic addition, subtraction, multiplication and division practice questions with the answer sheet

    In the past three months, I worked on various open source projects, including my own project Repo Context Packager, Math Worksheet Generator and Open Web Calendar. This month, I want to challenge myself to work on a larger and more widely used project - Scrapy, a Python module for web crawling.

  4. open-web-calendar

    Embed a highly customizable web calendar into your website using ICal source links

    By working on several issues in Open Web Calendar, I've gained experience in working on Python project with a comprehensive test suite and continuous integration. I want to push myself further so I tried to find a larger Python project to work on. Besides, I want to find a project that I would use on a regular basis. One of the topics I'm interested in is web crawling, and I do need to extract data from online sources sometimes for statistical analysis. I then searched for "open source web scraper", and found Scrapy, which happens to be a great choice that satisfies all the criteria, with a large user base, plenty of issues to work on, and a well organized program structure.

  5. Scrapy

    Scrapy, a fast high-level web crawling & scraping framework for Python.

    In the past three months, I worked on various open source projects, including my own project Repo Context Packager, Math Worksheet Generator and Open Web Calendar. This month, I want to challenge myself to work on a larger and more widely used project - Scrapy, a Python module for web crawling.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Advent of AI 2025 - Day 16: Planning With .goosehints

    2 projects | dev.to | 23 Dec 2025
  • Turn Claude Code into a Fullstack web app expert 🔌

    3 projects | dev.to | 23 Dec 2025
  • Plugins case study: mdBook preprocessors

    2 projects | news.ycombinator.com | 22 Dec 2025
  • Scaling LLMs to Larger Codebases

    3 projects | news.ycombinator.com | 22 Dec 2025
  • Show Git Branch & Status in Bash Prompt

    5 projects | dev.to | 22 Dec 2025

Did you know that Python is
the 2nd most popular programming language
based on number of references?