We start with this article: https://blog.mozilla.ai/3w-for-in-browser-ai-webllm-wasm-webworkers/
and we replicate a similar example using Java Open Source technologies:
- Quarkus
- Langchain4j
- JLama (so that is fully JVM?)
- Chicory
Key factors:
- Local
- Polyglot(should we add Python?)