close

DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Eight checks before you buy a CAPTCHA solver: the 403 debugging ladder

Eight checks before you buy a CAPTCHA solver: the 403 debugging ladder

Comments
4 min read
DataDome in Playwright: why rotating your proxy makes blocking worse

DataDome in Playwright: why rotating your proxy makes blocking worse

Comments
4 min read
500 Weibo Profile Rows Carried No IP Region. 30 of 36 Search Rows Did

500 Weibo Profile Rows Carried No IP Region. 30 of 36 Search Rows Did

Comments
6 min read
How to Scrape the Shopify App Store for App Data, Pricing, and Reviews

How to Scrape the Shopify App Store for App Data, Pricing, and Reviews

BERJAYA 1
Comments
5 min read
I built a Douyin scraper API with pay-per-result x402 payments

I built a Douyin scraper API with pay-per-result x402 payments

Comments 1
2 min read
I built a Korean real-estate data tool in 2 days. Then I found 7 others just like it.

I built a Korean real-estate data tool in 2 days. Then I found 7 others just like it.

Comments 1
5 min read
Turn Any Product Page Into the Same JSON Shape With Python (Schema-First AI Extraction)

Turn Any Product Page Into the Same JSON Shape With Python (Schema-First AI Extraction)

Comments
4 min read
Make vs Apify: Which Should You Try First to Add Web Data to Your AI Agent?

Make vs Apify: Which Should You Try First to Add Web Data to Your AI Agent?

Comments
5 min read
How to compare Lazada prices across six countries in one table

How to compare Lazada prices across six countries in one table

Comments
4 min read
How to see what things really sell for on Mercari Japan (in English and US dollars)

How to see what things really sell for on Mercari Japan (in English and US dollars)

Comments
5 min read
A job postings API over 18,000 company career sites, measured: one night's crawl, its cost and one search

A job postings API over 18,000 company career sites, measured: one night's crawl, its cost and one search

Comments
8 min read
ScraperAPI vs ScrapingBee: What One Credit Actually Buys

ScraperAPI vs ScrapingBee: What One Credit Actually Buys

Comments 1
6 min read
How to Scrape Instagram Comments With an API (curl + Python to CSV)

How to Scrape Instagram Comments With an API (curl + Python to CSV)

Comments
5 min read
TikTok Gave Me 2,400,000,000 Views and 999,139 Saves. Only the Saves Number Is Real

TikTok Gave Me 2,400,000,000 Views and 999,139 Saves. Only the Saves Number Is Real

Comments
7 min read
Comment trouver le flux ou les pages de rubrique d'un site d'actualité à partir de robots.txt et des sitemaps en Python

Comment trouver le flux ou les pages de rubrique d'un site d'actualité à partir de robots.txt et des sitemaps en Python

Comments
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.