A RetroSearch Logo

Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Search Query:

Showing content from https://github.com/StreamDeploy-DevRel/streamdeploy-llm-app-scaffold below:

StreamDeploy/streamdeploy-llm-app-scaffold: StreamDeploy offers this free LLM application template leveraging Ollama as the LLM service provider. This llm scaffold leverages Sveltekit for the frontend, Python for the backend, and Ollama as llm service provider.

StreamDeploy LLM App Scaffold

This repo contains a pre-architected, production-ready LLM application that may be easily deployed to cloud thanks tothe independent containers used for the frontend, backend, and LLM service Ollama.

Run the following from the root of the llm-app-scaffold directory:

docker-compose up --build

To use a model from Ollama, run Ollama pull. For example, to use mistral, run the following:

ollama pull mistral

then run the docker compose command


RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4