Skip to content

support batched inference (text: list[str]) in generate()#35

Open
twangodev wants to merge 4 commits into
HumeAI:mainfrom
twangodev:feat/batched-generation
Open

support batched inference (text: list[str]) in generate()#35
twangodev wants to merge 4 commits into
HumeAI:mainfrom
twangodev:feat/batched-generation

fix: input_lengths += prefix_len, not len(prefix_text_tokens)

24245b2
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs