Skip to content

ChatGPT status enum does not include "started" #26

@frockett

Description

@frockett

The expected types in the SDK do not match the actual types returned by the ChatGPT scraper:

{"timestamp":1780467628875,"level":"WARNING","logger":"utils.response","message":"unexpected API response shape for datasets/v3/progress","error":"✖ Invalid option: expected one of \"running\"|\"ready\"|\"failed\"|\"cancelled\"|\"error\"\n  → at status","data":"{\"status\":\"starting\",\"snapshot_id\":\"sd_mpxoge3f2aes4c6gd2\",\"dataset_id\":\"gd_m7aof0k82r803d5bjm\"}"}
[scrape-worker] Job 56b9bf14-0130-4cbc-8780-960514ed3007 failed: Error: ChatGPT scrape failed: Unexpected response from datasets/v3/progress: ✖ Invalid option: expected one of "running"|"ready"|"failed"|"cancelled"|"error"
  → at status
    at scrapeChatGPT (/home/crockett/repos/geo-tool/apps/app/src/lib/server/brightdata/chatgpt.ts:48:9)
    at process.processTicksAndRejections (node:internal/process/task_queues:104:5)
    at async processJob (/home/crockett/repos/geo-tool/apps/app/src/lib/server/workers/scrape-worker.ts:62:13)
    at async Promise.all (index 0)
    at async handleScrapeJob (/home/crockett/repos/geo-tool/apps/app/src/lib/server/workers/scrape-worker.ts:21:2)
    at async resolveWithinSeconds (file:///home/crockett/repos/geo-tool/node_modules/.pnpm/pg-boss@12.18.2/node_modules/pg-boss/dist/tools.js:38:18)
    at async #processJobs (file:///home/crockett/repos/geo-tool/node_modules/.pnpm/pg-boss@12.18.2/node_modules/pg-boss/dist/manager.js:211:28)
    at async Worker.onFetch (file:///home/crockett/repos/geo-tool/node_modules/.pnpm/pg-boss@12.18.2/node_modules/pg-boss/dist/manager.js:304:21)
    at async Worker.run (file:///home/crockett/repos/geo-tool/node_modules/.pnpm/pg-boss@12.18.2/node_modules/pg-boss/dist/worker.js:56:21)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions