🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data
⚡ Easiest no code web data extraction platform • Instantly turn any website into API or spreadsheet ⚡
Self-hosted webscraper.
Dive into web scraping and build a Next.js 13 eCommerce price tracker within a single video that teaches you data scraping, cron jobs, sending emails, deployment, and more.
➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are completely removed. Crawl and convert any website into LLM-ready markdown.
📚 This is an adapted version of Jina AI's Reader for local deployment using Docker. Convert any URL to an LLM-friendly input with a simple prefix http://127.0.0.1:3000/https://website-to-scrape.com/
Animos - Clean and minimal Anime-streaming desktop application without any ads.
Perceptual image hashing for Node.js
🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
Using LLMs and AI browser automation to robustly extract web data
📑 A way to automatically sync data with your kindle, such as RSS feeds, manga, and too much more.
JavaScript / TypeScript SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sensors/cookies via API.
API for Arknights
Hyper Solutions SDK for Playwright - Bypass Akamai Bot Manager, Incapsula, Datadome and Kasada.
🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
Build web scraping agents using AI to auto-extract the data from websites, capture screenshot, generate pdf from URL and web crawling with Agenty
An n8n custom node that integrates HeadlessX, enabling headless browser automation (navigation, scraping, screenshots, PDF generation) directly inside your n8n workflows.
Now you can keep track of your followers from YouTube, Instagram and Twitter accounts - Followers scraper API on AWS serverless
SDK for Scrapfly.io web scraping API
Add a description, image, and links to the webscraping topic page so that developers can more easily learn about it.
To associate your repository with the webscraping topic, visit your repo's landing page and select "manage topics."