Skip to content

Get command with "askui" model (including response schema)#40

Merged
adi-wan-askui merged 22 commits intoadd-locatorsfrom
get-command
Apr 23, 2025
Merged

Get command with "askui" model (including response schema)#40
adi-wan-askui merged 22 commits intoadd-locatorsfrom
get-command

Conversation

@adi-wan-askui
Copy link
Contributor

No description provided.

- set `askui` model as default model (if `model_name is None`)
- response format can only used with `askui` model
- rename and reorder parameters of `get()`
- `get()` can now return `Any` instead of `str`

BREAKING CHANGE:
- `get()` now has a different signature
…r schema definition

- better ux
- type safety
- typechecking for users using mypy or similar
adi-wan-askui and others added 16 commits April 15, 2025 17:44
…gent

- set default model for `VisionAgent` using `model` parameter
- use `ModelComposition` for askui models
- possible values of model of `VisionAgent.act()` changed
- only for locate (not for get or act)

BREAKING CHANGE:
- model value "claude" for `VisionAgent.act()` changed to
  "anthropic-claude-3-5-sonnet-20241022"
- non-pydantic based locators are way easier to use because they have less
  methods (autocompletion) --> instead use validate_call & make
  properties read-only
- make the file name more unique to avoid collisions
- allow injecting a custom controller server
- move controller server starting/stopping to client
-
- allow passing PIL Image, path or data url instead of custom type
Model Composition / Selection
@adi-wan-askui adi-wan-askui merged commit a19e477 into add-locators Apr 23, 2025
1 check passed
@adi-wan-askui adi-wan-askui deleted the get-command branch April 23, 2025 08:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant