|
1 | 1 | --- |
2 | 2 | title: "Introduction" |
3 | | -description: "The web infrastructure platform for AI. Scrape, crawl, and automate the web from a single API." |
| 3 | +description: "The web infrastructure platform for AI. Scrape, crawl, extract, and automate the web from a single API." |
4 | 4 | --- |
5 | 5 |
|
6 | | -Reader is the web infrastructure platform for AI. Scrape, crawl, and automate the web from a single API. Get back clean markdown, HTML, and metadata, or spin up cloud browser sessions with full Playwright/Puppeteer control. |
| 6 | +Reader is the web infrastructure platform for AI. Scrape, crawl, extract, and automate the web from a single API. Get back clean markdown, structured JSON, HTML, and metadata, or spin up cloud browser sessions with full Playwright/Puppeteer control. |
7 | 7 |
|
8 | | -One API key. Three primitives. You point it at a URL, we handle the rest: |
| 8 | +One API key. Four primitives. You point it at a URL, we handle the rest: |
9 | 9 |
|
10 | 10 | - **Rendering** dynamic, JavaScript-heavy sites so you get the page the user sees |
11 | 11 | - **Bypassing** bot walls automatically. Pick `standard` (default) or `premium` for hostile sites |
@@ -51,20 +51,21 @@ One API key. Three primitives. You point it at a URL, we handle the rest: |
51 | 51 |
|
52 | 52 | ## How Reader works |
53 | 53 |
|
54 | | -Three primitives, each with its own endpoint: |
| 54 | +Four primitives: |
55 | 55 |
|
56 | 56 | | Endpoint | Primitive | What it does | |
57 | 57 | |---|---|---| |
58 | 58 | | `POST /v1/read` with single `url` | **Read** | Scrape a page. Returns results synchronously | |
59 | 59 | | `POST /v1/read` with `urls` array | **Batch** | Scrape many pages. Returns a `jobId` to poll or stream | |
60 | 60 | | `POST /v1/read` with `maxDepth` / `maxPages` | **Crawl** | Discover links and scrape each page asynchronously | |
| 61 | +| `POST /v1/read` with `extract` | **Extract** | Pull structured JSON from a page using a schema or prompt | |
61 | 62 | | `POST /v1/sessions` | **Browse** | Spin up a cloud browser. Connect Playwright/Puppeteer via CDP | |
62 | 63 |
|
63 | 64 | See [The read primitive](/home/concepts/read-primitive) for the scrape/batch/crawl mental model, or [Browser sessions](/home/concepts/browser-sessions) for interactive automation. |
64 | 65 |
|
65 | 66 | ## Why developers pick Reader |
66 | 67 |
|
67 | | -- **Three primitives, one platform.** Read, crawl, and browse through one API key, one credit pool. No separate billing tracks or hidden multipliers. |
| 68 | +- **Four primitives, one platform.** Read, crawl, extract, and browse through one API key, one credit pool. No separate billing tracks or hidden multipliers. |
68 | 69 | - **Browser automation included.** Full Playwright and Puppeteer compatibility via CDP. Connect your existing scripts to cloud browsers with anti-bot stealth active. |
69 | 70 | - **Handles the modern web.** Dynamic pages render correctly, bot walls get bypassed using standard or premium proxy modes, and you never touch the underlying infrastructure. |
70 | 71 | - **Built for LLMs.** Output is clean markdown by default, with optional HTML and metadata. Main content extraction removes boilerplate so your tokens aren't wasted. |
|
0 commit comments