🔍 WebProbe

Fast, async website health checker and performance analyzer. Check response times, status codes, SSL certificate expiry, and redirect chains for any number of URLs — all at once.

---

✨ Features

• ⚡ Async Engine — Check hundreds of URLs concurrently with aiohttp
• 🔒 SSL Analysis — Detect expiring certificates (warns at <30 days)
• 🔄 Redirect Tracking — Full redirect chain with status codes
• 📊 Multiple Outputs — Color-coded table, JSON, or CSV
• 📁 File Input — Read URLs from a file, one per line
• 🔧 Pipe-Friendly — Works with stdin/stdout for shell pipelines

🚀 Quick Start

git clone https://github.com/sofia-willow/webprobe.git
cd webprobe
pip install -e .

Check a single URL

python -m webprobe https://example.com

Check multiple URLs

python -m webprobe https://google.com https://github.com https://httpbin.org/status/404

Read from file

python -m webprobe -f urls.txt

Output as JSON

python -m webprobe -o json https://example.com https://github.com

Pipe from other tools

cat urls.txt | python -m webprobe -o csv > results.csv

📖 Usage

usage: webprobe [-h] [-f FILE] [-o {table,json,csv}] [-c CONCURRENCY]
                [-t TIMEOUT] [--no-redirects] [urls ...]

🔍 WebProbe — Fast, async website health checker

positional arguments:
  urls                  URLs to check

options:
  -f, --file FILE       Read URLs from file (one per line)
  -o, --output          Output format: table, json, csv (default: table)
  -c, --concurrency     Max concurrent connections (default: 20)
  -t, --timeout         Timeout per request in seconds (default: 30)
  --no-redirects        Don't follow redirects

🏗️ Architecture

webprobe/
├── __init__.py     # Package metadata
├── __main__.py     # python -m webprobe entry point
├── cli.py          # Argument parsing and CLI commands
├── models.py       # ProbeResult and RedirectHop dataclasses
├── checker.py      # Core async probing engine
└── output.py       # Table, JSON, and CSV formatters

Data flow: CLI → URL list → probe_many() → async checks → format → output

🧪 Running Tests

pip install pytest
python -m pytest tests/ -v

📚 Library Usage

Use WebProbe programmatically in your own async code:

import asyncio
from webprobe.checker import probe_url, probe_many

async def main():
    # Single URL
    result = await probe_url("https://example.com", timeout_seconds=10)
    print(f"{result.url} → {result.status_code} ({result.response_time_ms:.0f}ms)")
    
    if result.ssl_days_remaining is not None:
        print(f"  SSL expires in {result.ssl_days_remaining} days")
    
    # Multiple URLs concurrently
    urls = ["https://google.com", "https://github.com", "https://python.org"]
    results = await probe_many(urls, concurrency=5)
    for r in results:
        status = "✅" if r.healthy else "❌"
        print(f"  {status} {r.url} → {r.status_code}")

asyncio.run(main())

📝 License

MIT License — see LICENSE for details.

---

Built by Sofia Willow