Skip to content

Pinned Loading

  1. xllm xllm Public

    A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

    C++ 1.4k 255

  2. xllm-service xllm-service Public

    A flexible serving framework that delivers efficient and fault-tolerant LLM inference for clustered deployments.

    C++ 95 32

Repositories

Showing 10 of 17 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…