Fix Gemma stop tokens: read additional EOS from tokenizer config#36

stikves merged 1 commit into

apple:mainapple/coreai-models:mainfrom

stikves:sukru/gemma-stop-tokensstikves/coreai-models:sukru/gemma-stop-tokensCopy head branch name to clipboard