Vibe Coding Discover

AI Tools

SemIf-OpenJev

View on GitHub

Semantic ifs from open models, on a 3090 at home. Independent; not affiliated with Jev or TypeSafe.

★ 4.2K282 forksPythonMITTheoLeeCJ

Python tool for scoring runtime-defined semantic decisions with open models. It reads option probabilities directly from model logits, with calibration and direct, cached, and parallel scoring modes; includes PyTorch, MLX, llama.cpp, and browser demos.

Use Cases

Route requests to a support queueChoose whether an agent should retry an actionEvaluate whether evidence supports a claimScore runtime-defined options without generating response textBatch decisions that share the same input state

Built With

Language
Python
Frameworks
PyTorch · Transformers · MLX · llama.cpp

Tags

semantic decisions · direct logits · open models · model inference · probability calibration · decision scoring · benchmarking · WebGPU