Saturn Cloud Template: NLP & LLMs Section#405

Open

GeoSegun wants to merge 15 commits intomainfrom

Commits on Oct 22, 2025

vLLM-based LLM inference notebook that runs 7B-class models (like Mistral, Llama, and Gemma) on Saturn Cloud GPUs, enabling fast text generation, interactive prompt input, and scalable multi-GPU de…
GeoSegun
committed

Commits on Oct 24, 2025

Using lora to fine tuning model which help improves memory efficiency
GeoSegun
committed

Commits on Nov 5, 2025

RAG mini template for Q & A
GeoSegun
committed

Commits on Nov 6, 2025

Commits on Nov 11, 2025

setup template for vector DB Menu for python server API
GeoSegun
committed

Commits on Nov 14, 2025

nim and tgi drop-in template for using models
GeoSegun
committed

Commits on Nov 16, 2025

template for ray serve model deployment
GeoSegun
committed

Commits on Nov 18, 2025

template on deploying vllm models using tensor parallelism
GeoSegun
committed

Commits on Dec 27, 2025

PyTorch FSDP Training
GeoSegun
committed

Commits on Dec 28, 2025

Commits on Jan 29, 2026

small transformer inference and benchmarking
GeoSegun
committed

Commits on Mar 2, 2026