Skip to content

[WIP] Fix import error in distributed_executor.py due to vllm deprecation#2

Closed
Copilot wants to merge 1 commit intomainfrom
copilot/fix-import-error-vllm
Closed

[WIP] Fix import error in distributed_executor.py due to vllm deprecation#2
Copilot wants to merge 1 commit intomainfrom
copilot/fix-import-error-vllm

Conversation

Copy link

Copilot AI commented Oct 25, 2025

Fix VLLM v0 engine deprecation compatibility issue

Plan

  • Analyze the current import structure in distributed_executor.py
  • Make imports compatible with both old and new VLLM versions using try-except blocks
  • Handle the case where v0 engine classes are completely removed
  • Test the changes with available VLLM versions
  • Verify no other files are affected by the changes

Issue

VLLM deprecated the v0 engine in their main branch, causing import failures in xinference/model/llm/vllm/distributed_executor.py. The imports work in VLLM 0.11.0 but fail in the main branch due to removed/moved files.

Original prompt

帮我修复一个错误位于,xinference/model/llm/vllm/的distributed_executor.py因为vllm对v0引擎的弃用,文件被删除或移动导致无法正常导入,在版本0.11.0或之前可以正常导入,而在VLLM的main分支不行


💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

Copilot AI self-assigned this Oct 25, 2025
@zhcn000000 zhcn000000 closed this Oct 25, 2025
@zhcn000000 zhcn000000 deleted the copilot/fix-import-error-vllm branch October 25, 2025 13:36
Copilot AI requested a review from zhcn000000 October 25, 2025 13:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants