Skip to content

[utils] Improve cache utils to support layer-based caches#545

Open
dayo09 wants to merge 3 commits intoSamsung:mainfrom
dayo09:0310-improve
Open

[utils] Improve cache utils to support layer-based caches#545
dayo09 wants to merge 3 commits intoSamsung:mainfrom
dayo09:0310-improve

Conversation

@dayo09
Copy link
Contributor

@dayo09 dayo09 commented Mar 10, 2026

Let's improve its coverage.

TICO-DCO-1.0-Signed-off-by: Dayoung Lee dayoung.lee@samsung.com

/cc
@parjong Some Qwen-3 VLM export issue will now be covered.
@llFreetimell Llama export issues too.
NOTE: But this don't resolve vmap issue lazy_load_decomposition issue.

Related to #417


NOTE

  • StaticLayer's _init_ function's implementation differs based on torch version.
  • Static/DynamicCache implementation diverges into 'list-based' and 'layer-based'.
    • See the comment on the top of pytree_utils.py for details.

dayo09 added 3 commits March 10, 2026 15:14
Let's improve its coverage.

TICO-DCO-1.0-Signed-off-by: Dayoung Lee <dayoung.lee@samsung.com>
@dayo09 dayo09 marked this pull request as ready for review March 10, 2026 09:35
@dayo09 dayo09 requested a review from mhs4670go March 10, 2026 09:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant