Skip to content
Navigation menu
Log in
Create account
DEV Community
Close
#
webscraping
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
BeautifulSoup vs lxml: A Practical Performance Comparison
di
di
di
Follow
Jul 6
BeautifulSoup vs lxml: A Practical Performance Comparison
#
python
#
webscraping
1
reaction
Comments
Add Comment
3 min read
🕸️ Web Scraping & Automation: How to Ethically Collect Web Data Without Getting Blocked (or Banned)
Okoye Ndidiamaka
Okoye Ndidiamaka
Okoye Ndidiamaka
Follow
Jul 6
🕸️ Web Scraping & Automation: How to Ethically Collect Web Data Without Getting Blocked (or Banned)
#
webscraping
#
webdev
#
automation
#
python
3
reactions
Comments
1
comment
3 min read
How I Scraped our Private Google Site in a Semi-Automated way
Saugata Roy Arghya
Saugata Roy Arghya
Saugata Roy Arghya
Follow
Jul 5
How I Scraped our Private Google Site in a Semi-Automated way
#
playwright
#
googlesite
#
webscraping
#
automation
Comments
Add Comment
7 min read
From manual to autonomous: How AI-driven scraping saves 40% of time
Astro — Enterprise Data Gathering Infrastructure
Astro — Enterprise Data Gathering Infrastructure
Astro — Enterprise Data Gathering Infrastructure
Follow
for
Astro
Jul 4
From manual to autonomous: How AI-driven scraping saves 40% of time
#
webscraping
#
ai
#
datascience
#
machinelearning
Comments
Add Comment
9 min read
I Tried 15+ Web Scraping Tools — Here's the Only One I'd Trust for Big Data Projects
Nitin Sharma
Nitin Sharma
Nitin Sharma
Follow
Jul 2
I Tried 15+ Web Scraping Tools — Here's the Only One I'd Trust for Big Data Projects
#
webscraping
#
programming
#
ai
#
productivity
10
reactions
Comments
Add Comment
7 min read
Building a Production-Ready LinkedIn Scraper with Python Scrapy 🐍
Noorsimar Singh
Noorsimar Singh
Noorsimar Singh
Follow
Jul 2
Building a Production-Ready LinkedIn Scraper with Python Scrapy 🐍
#
webscraping
#
linkedin
#
datascience
#
scrapy
Comments
Add Comment
7 min read
3 Subtle Mistakes That Slowed Down My Web App (And How I Fixed Them)
FreezyStock
FreezyStock
FreezyStock
Follow
Jun 21
3 Subtle Mistakes That Slowed Down My Web App (And How I Fixed Them)
#
webdev
#
website
#
webscraping
Comments
Add Comment
1 min read
Mastering Residential Proxies with Python
Constantine
Constantine
Constantine
Follow
Jun 21
Mastering Residential Proxies with Python
#
programming
#
webscraping
#
python
#
tutorial
Comments
Add Comment
2 min read
Beautiful Soup: Web Scraping's Delightful Deception
Lohit Kolluri
Lohit Kolluri
Lohit Kolluri
Follow
Jun 20
Beautiful Soup: Web Scraping's Delightful Deception
#
python
#
webscraping
#
programming
#
beginners
Comments
Add Comment
2 min read
🕷️For Developers Losing Hair Over Web Scraping: Is a Scraper API Your Lifesaver?
Anna Li
Anna Li
Anna Li
Follow
Jun 19
🕷️For Developers Losing Hair Over Web Scraping: Is a Scraper API Your Lifesaver?
#
programming
#
webscraping
#
api
2
reactions
Comments
Add Comment
2 min read
🕸️ Web Scraping in Python: A Practical Guide for Data Scientists
Vikas Gulia
Vikas Gulia
Vikas Gulia
Follow
Jun 22
🕸️ Web Scraping in Python: A Practical Guide for Data Scientists
#
programming
#
datascience
#
webscraping
#
beginners
1
reaction
Comments
Add Comment
3 min read
Analysed over 500+ publicly available workflow templates
Agent_ummi
Agent_ummi
Agent_ummi
Follow
Jun 7
Analysed over 500+ publicly available workflow templates
#
automaton
#
webscraping
Comments
Add Comment
1 min read
3 bewährte Wege für den HTML-zu-Excel-Export
hanna Fischer
hanna Fischer
hanna Fischer
Follow
Jun 11
3 bewährte Wege für den HTML-zu-Excel-Export
#
webscraping
#
html
#
excel
#
automation
Comments
1
comment
1 min read
From 500+ Lines to 150: How I Refactored My Amazon Scraper Into a Clean Scrapy Project
Noorsimar Singh
Noorsimar Singh
Noorsimar Singh
Follow
Jun 25
From 500+ Lines to 150: How I Refactored My Amazon Scraper Into a Clean Scrapy Project
#
webscraping
#
scrapy
#
scrapeops
#
python
Comments
1
comment
4 min read
AI-Ready Congressional Data: Building a Python Tool for Plaintext Extraction
Bryan Doss
Bryan Doss
Bryan Doss
Follow
May 17
AI-Ready Congressional Data: Building a Python Tool for Plaintext Extraction
#
python
#
webscraping
#
government
#
ai
3
reactions
Comments
Add Comment
5 min read
Why your site needs a sitemap?
Rita {FlyNerd} Lyczywek
Rita {FlyNerd} Lyczywek
Rita {FlyNerd} Lyczywek
Follow
Jun 15
Why your site needs a sitemap?
#
webdev
#
seo
#
website
#
webscraping
31
reactions
Comments
4
comments
3 min read
Web Scraping to SQL: How to Effectively Store and Analyze Your Scraped Data
LacrymosaTech
LacrymosaTech
LacrymosaTech
Follow
May 12
Web Scraping to SQL: How to Effectively Store and Analyze Your Scraped Data
#
sql
#
database
#
datascience
#
webscraping
Comments
Add Comment
5 min read
What Are Today’s Top Movie Plots? I Wrote a Python Scraper to Find Out
Ahmad Azeez
Ahmad Azeez
Ahmad Azeez
Follow
May 14
What Are Today’s Top Movie Plots? I Wrote a Python Scraper to Find Out
#
python
#
webscraping
#
movies
#
datascience
2
reactions
Comments
Add Comment
2 min read
Google blocks Yandex: A Tale of Two robots.txt Files
Mikalai Urusau
Mikalai Urusau
Mikalai Urusau
Follow
May 9
Google blocks Yandex: A Tale of Two robots.txt Files
#
webdev
#
seo
#
webscraping
#
web
Comments
Add Comment
2 min read
🧑💻 Web Scraping Indeed Remote Jobs and Storing in PostgreSQL
Josiah Nyamai
Josiah Nyamai
Josiah Nyamai
Follow
Jun 17
🧑💻 Web Scraping Indeed Remote Jobs and Storing in PostgreSQL
#
webscraping
#
data
#
python
5
reactions
Comments
1
comment
2 min read
Finding Hidden Comic Book Deals: A TypeScript Scraping Solution
Radzion Chachura
Radzion Chachura
Radzion Chachura
Follow
May 4
Finding Hidden Comic Book Deals: A TypeScript Scraping Solution
#
typescript
#
webscraping
#
puppeteer
#
dataanalysis
1
reaction
Comments
Add Comment
6 min read
How to Block Requests with Puppeteer
Jonathan Geiger
Jonathan Geiger
Jonathan Geiger
Follow
May 2
How to Block Requests with Puppeteer
#
puppeteer
#
webscraping
#
webdev
Comments
Add Comment
5 min read
How to Hide Cookie Banners with Puppeteer
Jonathan Geiger
Jonathan Geiger
Jonathan Geiger
Follow
May 15
How to Hide Cookie Banners with Puppeteer
#
puppeteer
#
webscraping
#
webdev
#
javascript
6
reactions
Comments
Add Comment
3 min read
Supercharge Your Search Automation with Bright Data MCP + Google, Bing & Yandex
Ranjan Dailata
Ranjan Dailata
Ranjan Dailata
Follow
Jun 2
Supercharge Your Search Automation with Bright Data MCP + Google, Bing & Yandex
#
ai
#
webscraping
#
automation
#
tutorial
6
reactions
Comments
Add Comment
3 min read
Web Scraping Best Practices for CloudFront
Swiftproxy - Residential Proxies
Swiftproxy - Residential Proxies
Swiftproxy - Residential Proxies
Follow
Apr 27
Web Scraping Best Practices for CloudFront
#
webscraping
#
cloudfront
Comments
Add Comment
5 min read
loading...
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account
