jevlike
View on GitHubPython starter for training a small one-pass scorer that turns text plus a changing list of options into one probability per option, an independent alternative to TypeSafe's Jev. Ships train/eval/predict CLIs, byte and frozen Hugging Face encoder paths, and Doom/chess vision-scoring examples.
Use Cases
Score a variable-length list of text options with one probability eachMultiple-choice / intent classification over changing option menusReranking candidate labels for a contextNext-click prediction on Wikispeedia navigation graphsSupport ticket routing to the correct queueModel evaluation with top-1/top-3 accuracy and expected calibration errorFine-tuning a small scorer head on a frozen LLM encoderScoring game controller buttons from image patches (Doom, chess)
Built With
- Language
- Python
- Frameworks
- PyTorch · Hugging Face Transformers · NumPy · pytest · vizdoom · python-chess · imageio · Pillow · Playwright · setuptools · uv
Tags
one-pass scorer · system-one model · text ranking · attention pooling · training toolkit · evaluation metrics · calibration · byte encoder · frozen encoder · PyTorch · CLI · research starter · vision scorer