Download gemma3:1b from ollama You can choose any LLM you want. change model_name=" " accordingly.

This works both on CLI and on Local host.

To run on CLI: python app.py

To run on local host: streamlit run streamlit_app.py