Vibe Coding Discoverollaya
View on GitHubRun open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
A Rust runtime and server for pulling and running decision models locally, including classifiers and NLI models. Provides an Ollama-style CLI, a TypeSafe-compatible API, and an MCP server for agent access.
Use Cases
Classify support tickets by intent and urgencyScore customer frustration or churn riskRoute requests by languageRun zero-shot text classification locallyApply NLI-based classificationServe decision models to applications through an HTTP APIExpose local decision models to AI agents through MCP
Built With
- Language
- Rust
- Frameworks
- ONNX Runtime · llama.cpp · MCP
Tags
local inference · decision models · classification · zero-shot classification · NLI · model serving · LLM routing · calibration · MCP · ONNX · Ollama-compatible CLI