API Data Access Changes #4466
Description
Description:
Following the public announcement of API data access changes, the items below need to be implemented and rolled out by end of week. Italicized items from the post represent net-new changes that are not yet live.
Changes to the API gateway:
- all accounts have current CP access on ~50 questions in a "bot testing" project (to be created).
- all accounts have question text and resolution value access to any question it's ever predicted.
- all accounts have access to staff comments.
- there is a new access tier that gives access to a "bot benchmarking" project which will have ~250 open questions and ~250 resolved questions. Accounts with this access tier have access to the current CP of the open questions and the resolution value of the resolved questions.
Other changes:
- MiniBench CP history – For MiniBench questions that ask bots to predict the Metaculus CP, inject additional historical CP aggregation values directly into the question text.
- document all this in the API docs.
Context: link to public post | link to Slack thread