Skip to content

update openai_api_server#1

Open
Mingyu-Wei wants to merge 2 commits intointel-staging:mainfrom
Mingyu-Wei:update_openai_server
Open

update openai_api_server#1
Mingyu-Wei wants to merge 2 commits intointel-staging:mainfrom
Mingyu-Wei:update_openai_server

Conversation

@Mingyu-Wei
Copy link
Copy Markdown

@Mingyu-Wei Mingyu-Wei commented Mar 26, 2024

For pydantic v2, the dump_kwargs keyword arguments are not supported so we will run into this error when using the openai_api service.

TypeError: dumps_kwargs keyword arguments are no longer supported

Another workaround is to use older version of pydantic, but this will break the gradio service due to package version conflicts. Therefore we have to change the way we dump chunks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant