Skip to content
#

sitemap-scraper

Here are 2 public repositories matching this topic...

advanced-sitemap-parser

Parse XML sitemaps and extract URLs. Designed to process millions of URLs while bypassing most modern anti-bot protections. Supports plain and compressed XML, unlimited nested sitemaps, multi-threading, multiple inputs, CloudScraper integration, fingerprint randomization, proxy/user agent rotation, auto stealth mode, and detailed monitoring.

  • Updated Apr 11, 2026
  • Python

Improve this page

Add a description, image, and links to the sitemap-scraper topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the sitemap-scraper topic, visit your repo's landing page and select "manage topics."

Learn more