Skip to content

Record LLM model execution latency#21040

Open
yenhao-huang wants to merge 4 commits into
pytorch:mainfrom
yenhao-huang:fix/11771-llama-forward-latency
Open

Record LLM model execution latency#21040
yenhao-huang wants to merge 4 commits into
pytorch:mainfrom
yenhao-huang:fix/11771-llama-forward-latency