Skip to content

Add env param KV_CACHE_LOCATION to control kv cache memory numanode location#462

Open
a3213105 wants to merge 4 commits into
intel:mainfrom
a3213105:kvcache_location
Open

Add env param KV_CACHE_LOCATION to control kv cache memory numanode location#462
a3213105 wants to merge 4 commits into
intel:mainfrom
a3213105:kvcache_location

Recheck the code

f0236e6
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs