CNCF Project
Volcano
Term
2026 Term 3 (Sep-Nov)
Program Name
Kthena LLM Resource Management in Volcano Dashboard
Program Description
-
Description: Volcano Dashboard already supports Jobs, Queues, Pods, and PodGroups, but Kthena LLM workloads still depend heavily on kubectl and separate tooling for day-to-day operations. This project extends the dashboard into a richer operational interface for Kthena by bringing core serving resources into the UI and improving how users inspect, manage, and troubleshoot inference workloads. The mentee should study the existing dashboard architecture and Kthena resource model, then design an experience that covers not only resource management but also deeper operational workflows such as serving status visualization, routing visibility, rollout awareness, resource relationships, and troubleshooting context across Kthena, Volcano, and Kubernetes objects.
-
Expected Outcome:
- Dashboard support for major Kthena resources such as ModelServing, ModelBooster, ModelRoute, and ModelServer.
- UI workflows for inspecting and managing those resources.
- Clear visibility into conditions, replicas, rollout state, and relationships to related Pods, PodGroups, Queues, and other underlying resources.
- Improved operational and troubleshooting workflows, including routing visibility and serving health context.
- Required RBAC and deployment updates for practical cluster usage.
- Tests and user-facing documentation.
Technologies
TypeScript, React, Next.js, Kubernetes API, observability basics, familiarity with Volcano and Kthena
Skills same as Technologies?
Required/Desirable Skills
No response
Mentors
ZhenCheng Lee | @LiZhenCheng9527 | lizhencheng6@huawei.com| LiZhenCheng9527
Kuldeep Singh | @de6p | de6p97@gmail.com | 05cc0d01-c938-4a18-951e-af71be282b2b
Zicong Chen (Jesse Stutler) | @JesseStutler | jessestutler97@gmail.com| ca54663f-6e7b-4839-a779-eaafb23aab59
Upstream Issue URL
volcano-sh/dashboard#307
Application Prerequisites
Coding Challenge URL
volcano-sh/dashboard#308
Custom Prerequisite Name
Dashboard Authn/z
Custom Prerequisite Description
Applicants should review this issue and submit a short technical design covering:
- proposed auth approach for Volcano Dashboard,
- how user identity maps to Kubernetes RBAC,
- how the UI should behave for unauthorized access,
- a high-level implementation and test plan.
Custom Prerequisite — File Upload
CNCF Project
Volcano
Term
2026 Term 3 (Sep-Nov)
Program Name
Kthena LLM Resource Management in Volcano Dashboard
Program Description
Description: Volcano Dashboard already supports Jobs, Queues, Pods, and PodGroups, but Kthena LLM workloads still depend heavily on
kubectland separate tooling for day-to-day operations. This project extends the dashboard into a richer operational interface for Kthena by bringing core serving resources into the UI and improving how users inspect, manage, and troubleshoot inference workloads. The mentee should study the existing dashboard architecture and Kthena resource model, then design an experience that covers not only resource management but also deeper operational workflows such as serving status visualization, routing visibility, rollout awareness, resource relationships, and troubleshooting context across Kthena, Volcano, and Kubernetes objects.Expected Outcome:
Technologies
TypeScript, React, Next.js, Kubernetes API, observability basics, familiarity with Volcano and Kthena
Skills same as Technologies?
Required/Desirable Skills
No response
Mentors
ZhenCheng Lee | @LiZhenCheng9527 | lizhencheng6@huawei.com| LiZhenCheng9527
Kuldeep Singh | @de6p | de6p97@gmail.com | 05cc0d01-c938-4a18-951e-af71be282b2b
Zicong Chen (Jesse Stutler) | @JesseStutler | jessestutler97@gmail.com| ca54663f-6e7b-4839-a779-eaafb23aab59
Upstream Issue URL
volcano-sh/dashboard#307
Application Prerequisites
Coding Challenge URL
volcano-sh/dashboard#308
Custom Prerequisite Name
Dashboard Authn/z
Custom Prerequisite Description
Applicants should review this issue and submit a short technical design covering:
Custom Prerequisite — File Upload