server for large language model.
This is mostly a learning project to get more involved into training my own large language model and also hosting them.
pip install -r requirements.txt
The server is based on FastAPI, simply take the app and start it. It will start the uvicorn server to run your FastAPI.
python app.y