Skip to content

feat: add Azure AI + GCP image scrapers, price freshness indicators, …#4

Closed
duksh wants to merge 5 commits intovantage-sh:mainfrom
duksh:main
Closed

feat: add Azure AI + GCP image scrapers, price freshness indicators, …#4
duksh wants to merge 5 commits intovantage-sh:mainfrom
duksh:main

Conversation

@duksh
Copy link
Copy Markdown
Contributor

@duksh duksh commented Mar 20, 2026

…and image gen routing

  • Add scraper/scrapers/azure.ts: scrapes 13 Azure AI models (GPT-4o, GPT-4.1, GPT-5, o1/o3/o4, Phi-4) via LiteLLM
  • Add scraper/scrapers/gcp-image.ts: adds Imagen 2, Imagen 3, Imagen 3 Fast pricing
  • Add Microsoft to PROVIDERS and Google to IMAGE_PROVIDERS in shared.ts
  • Add Phi-4 to reasoning prefixes, self-hostable, and tokenizer map in constants.ts
  • Add priceSource (scraped | hardcoded) to VendorModelInfo and ImageVendorModelInfo
  • Add scrapedAt timestamp to DataFormat, set in runner.ts on each run
  • Add price diff detection in runner.ts: warns on >5% price changes vs previous run
  • Add Prices refreshed label to table toolbar
  • Add Live pricing / Manually maintained badge to PricingCalculator and ImageModelPage
  • Add LLM / Image Gen tab switcher to toolbar, fix SSR snapshot in ModelTypeTabs
  • Fix image gen routing: rename _index.astro and _[id].astro to remove underscore prefix
  • Add .github/workflows/scrape.yml: daily scheduled scraper at 06:00 UTC with auto-commit

…and image gen routing

- Add scraper/scrapers/azure.ts: scrapes 13 Azure AI models (GPT-4o, GPT-4.1, GPT-5, o1/o3/o4, Phi-4) via LiteLLM
- Add scraper/scrapers/gcp-image.ts: adds Imagen 2, Imagen 3, Imagen 3 Fast pricing
- Add Microsoft to PROVIDERS and Google to IMAGE_PROVIDERS in shared.ts
- Add Phi-4 to reasoning prefixes, self-hostable, and tokenizer map in constants.ts
- Add priceSource (scraped | hardcoded) to VendorModelInfo and ImageVendorModelInfo
- Add scrapedAt timestamp to DataFormat, set in runner.ts on each run
- Add price diff detection in runner.ts: warns on >5% price changes vs previous run
- Add Prices refreshed label to table toolbar
- Add Live pricing / Manually maintained badge to PricingCalculator and ImageModelPage
- Add LLM / Image Gen tab switcher to toolbar, fix SSR snapshot in ModelTypeTabs
- Fix image gen routing: rename _index.astro and _[id].astro to remove underscore prefix
- Add .github/workflows/scrape.yml: daily scheduled scraper at 06:00 UTC with auto-commit

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@vercel
Copy link
Copy Markdown

vercel bot commented Mar 20, 2026

@duksh is attempting to deploy a commit to the vantage Team on Vercel.

A member of the Team first needs to authorize it.

duksh and others added 3 commits March 20, 2026 14:31
Hardcoded image model prices (AWS, OpenAI, GCP) now carry a
priceVerifiedAt date so users and downstream consumers (e.g. FiceCal)
can tell how old a manually-maintained price is.

- Add priceVerifiedAt?: string to ImageVendorModelInfo type
- Accept priceVerifiedAt param in addImageModelToFormat (scraper/shared.ts)
- Pass "2026-03-20" verification date in aws-image, openai-image, gcp-image scrapers
- Add price_source + price_verified_at columns to image_models_vendors schema
- Write both fields in the JSON→SQLite conversion (data.db.ts)
- ImageModelPage badge now shows: verified date when fresh (<30d),
  red "Unverified (N days old)" when stale (>=30d), fallback amber
  when no date is present

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
aws.ts constructs VendorModelInfo directly (bypassing addModelToFormat)
and was missing the required priceSource field, causing 4 TypeScript
errors in CI (TS2741, TS2345, TS18048 x2).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
forex.json is required at Astro SSR build time (imported directly by
Table.tsx, CurrencyPicker.tsx, PricingCalculator.tsx). Unlike data.json
it is small (~10KB) and stable enough to commit. npm run init refreshes
it on every scraper run via scraper/scrapers/forex.ts (floatrates.com).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@vercel
Copy link
Copy Markdown

vercel bot commented Mar 20, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
models-vantage-sh Ready Ready Preview, Comment Mar 20, 2026 7:58pm

Request Review

G1: Switch default columns to per-1M-token pricing (more intuitive)
G2: Add reasoning-only quick-filter toggle to Table toolbar
G3: Add Country column to LLM defaults
G4: Add Copy-to-CSV button with clipboard success toast
G5: Show priceVerifiedAt badge on PricingCalculator for hardcoded prices
G6: Add benchmark tooltip explanations (HLE, SWE-Bench, SkateBench)
G7: Token load presets (1K / 10K / 100K / 1M) in PricingCalculator
G8: FiceCal FinOps attribution link in site header
G9: Dark mode already correct (no-op)
G10: Add 'Estimate in FiceCal' CTA on individual model pages
fix: null-safety guard for empty models array in useMultiColumnSync call

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@IAmJSD IAmJSD self-requested a review March 27, 2026 14:14
@IAmJSD IAmJSD mentioned this pull request Mar 27, 2026
@IAmJSD
Copy link
Copy Markdown
Contributor

IAmJSD commented Mar 27, 2026

moved to #5, not closed bc won't merge

@IAmJSD IAmJSD closed this Mar 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants