claude-code-karma
★ 328Local-first dashboard that reads ~/.claude/ JSONL data to visualize Claude Code sessions: timelines, tasks, files, subagents, skills, hooks, plugins, tools/MCP usage, and token/cost analytics, plus live session tracking via hooks. Read-only, no cloud or telemetry.
AI Tools | Python · claude-code · observability
View Project →AnyJev
★ 323Python library that turns an open LLM into a calibrated decision model by reading typed questions from one next-token prefill. L0 removes position/label bias with zero labels; L1/L2 add temperature or closed-form heads for real probabilities, with shipped Qwen3 heads.
AI Tools | Python · calibration · decision-making
View Project →StatsPAI
★ 322Agent-native Python library for causal inference and applied econometrics, offering a unified Stata/R-style API, machine-readable function schemas, a bundled MCP server, and Skills for LLM agents. Covers DiD, IV, RD, synthetic control, matching, DML, and panel models with R/Stata parity checks.
AI Tools | Python · agent-native · mcp
View Project →scribe.js
★ 320JavaScript OCR and text-extraction library for images and PDFs, powered by WebAssembly Tesseract with no build step. Runs in browser or Node, outputs searchable PDFs, and ships a CLI plus an MCP server for agent/tool integration.
AI Tools | JavaScript · ocr · text-extraction
View Project →docjev
★ 308DocJev is a Python library, CLI, and local web app that classifies PDFs/DOCX/PPTX into your own natural-language categories and splits multi-document packets into page ranges. It uses local LiteParse OCR plus hosted Jev (or an OpenAI baseline) decisions, with review flags, PDF export, and a benchmark harness.
AI Tools | Python · document-classification · document-splitting
View Project →bg0
★ 304BG0 is an open-source background remover that runs fully in the browser using a BiRefNet ONNX model over WebGPU with a WASM fallback, so images never leave the device. It ships a TanStack Start web app plus a reusable @bg0/browser package with progress, cancellation, and transparent PNG output.
AI Tools | TypeScript · background-removal · browser-inference
View Project →backlot
★ 295Local emulator of enterprise SaaS APIs (Slack, Gmail, Drive, GitHub, Jira, Notion, S3) serving vendor-shaped responses, pagination, auth and per-document ACLs from a deterministic corpus you supply. Ships an MCP server and agent skill for offline agent and RAG evaluation.
AI Tools | Python · mcp · mock-server
View Project →kitaru
★ 292Kitaru records or imports production AI agent traces as sessions, then replays the real agent code against changes in model, prompt, or tools so you see what improved or regressed before shipping. Self-hosted, Apache 2.0, with Python/TypeScript SDKs, framework adapters, MCP server, and agent skills.
AI Tools | Python · agent-evals · observability
View Project →emulo
★ 291Emulo mines local AI coding session logs into a personal profile that agents can load before tasks. It supports Claude Code, Codex, and adapters for other coding agents, with CLI, plugins, and an MCP server.
AI Tools | HTML · agent-personalization · agent-memory
View Project →freebucks-proxy
★ 291Go gateway exposing OpenAI- and Anthropic-compatible /v1 endpoints in front of a coding-model provider, pooling multiple account tokens with session lifecycle and credit metering, optional browser-like TLS stealth, and an embedded Svelte admin dashboard. Single binary, self-hosted, no CLI.
AI Tools | Go · openai-compatible · api-gateway
View Project →jev-chat-jarvis-mac
★ 285macOS 悬浮窗:只读抓取微信聊天窗口并 OCR,用本地 decider-2b 判断消息意图与风险分级,再经 LLM 并发生成候选回复并按本地排序重排,可一键填入微信输入框;不注入、不自动发送、数据可全本地。
AI Tools | Python · macos · wechat
View Project →engrim
★ 282Engrim is a local-first SQLite episodic memory engine for AI coding agents. It injects a ~4k-char memory pack at session boot and shares one project-scoped store across Claude Code, Cursor, Codex CLI, OpenCode, Copilot CLI and Antigravity via hooks plus an MCP server.
AI Tools | Python · episodic-memory · memory
View Project →OrcaReplay
★ 268OrcaReplay records AI agent runs below the agent — at the proxy, shell, MCP and filesystem boundary — then replays them offline byte-for-byte and forks them at any checkpoint onto a different model. CLI tool for debugging why an agent run did what it did.
AI Tools | TypeScript · agent-debugging · agent-tracing
View Project →ConsistI2V
★ 261Official code for ConsistI2V (TMLR 2024), a diffusion method that turns a still image plus text prompt into a consistent video using first-frame spatiotemporal attention and low-frequency noise initialization. Includes inference and training scripts, a Gradio demo, and Hugging Face weights.
AI Tools | Python · image-to-video · video-generation
View Project →jentic-public-apis
★ 259A community catalog of public API specifications and Arazzo workflows designed to give AI agents structured API knowledge. Includes machine-readable OpenAPI files and supports AI-readiness scoring.
AI Tools | API catalog · AI agents
View Project →safelabs-eval
★ 257safelabs-eval is a framework-agnostic Python red-teaming toolkit that fires 131 OWASP ASI-aligned adversarial prompts at any agent HTTP endpoint or Python callable, scoring responses with pure-Python detectors (no LLM cost) and emitting structured JSON reports for CI.
AI Tools | Python · red-teaming · agent-security
View Project →BeefTV
★ 256A local-first AI video and media creation workspace with a node-based canvas for connecting prompts, assets, models, and agents. Supports configurable model providers and workflows for generating and editing text, images, video, and audio.
AI Tools | TypeScript · AI video creation · creative workspace
View Project →Prism-Legal-OS
★ 253Self-hostable legal workspace with an AI assistant for document drafting, contract review, and legal research. It supports source-backed document search using Qdrant and lets users configure OpenAI, Anthropic, Google, or OpenAI-compatible providers.
AI Tools | TypeScript · legal AI · legal assistant
View Project →plate-playground-template
★ 240Next.js 16 + React 19 starter template for a Plate rich-text editor with AI plugins, shadcn/ui components, and MCP support. Uses the Vercel AI SDK and a user-supplied AI Gateway key to power inline AI editing commands.
AI Tools | TypeScript · rich-text-editor · plate
View Project →gflow-cli
★ 237Python CLI plus MCP server that drives Google Flow's Veo and Imagen models from the terminal for scripted, batched text-to-video, image-to-video and text-to-image work. Alpha, reverse-engineered via headed Playwright and unofficial; install the Claude plugin or MCP server so agents can generate too.
AI Tools | Python · cli · mcp
View Project →agent-inspect
★ 233Local-first TypeScript toolkit for AI agent observability: turns JSONL runs into execution trees, runs deterministic trajectory checks in CI, and exports redacted hash-verifiable evidence bundles. Includes framework adapters (LangChain, LangGraph, AI SDK, OpenAI Agents) and an optional read-only MCP server.
AI Tools | TypeScript · observability · debugging
View Project →bitrouter
★ 231Rust LLM router and gateway that sits in front of any agent harness: routes each model call, MCP tool/skill, and ACP sub-agent to the cheapest adequate path, with OTel telemetry and a git-owned policy-lock it improves from admitted eval evidence. Reports ~33% cost cut on Terminal-Bench 2.1 at near-parity accuracy.
AI Tools | Rust · llm-router · model-routing
View Project →AgentMeasure
★ 218Open measurement and conformance layer for AI-agent telemetry. Audits token and usage accounting with PASS/FAIL/UNPROVABLE CI checks, reads Codex rollout logs locally to expose retries and duplicate records, and runs preregistered harness experiments.
AI Tools | Python · agent-observability · token-accounting
View Project →node9-proxy
★ 216Node9 is a security proxy that sits between AI coding agents and their tools: it scans past sessions for leaks, blocks risky commands before execution, gates MCP servers, and produces audit reports. Works with Claude Code, Codex, Cursor and any MCP server.
AI Tools | TypeScript · agent-security · mcp-security
View Project →design-studio-ai
★ 215Agent-first design workspace where humans and LLM agents co-edit web layouts, slides, wireframes, 3D scenes, and motion videos on one versioned document. Exposes MCP/WebMCP, a dsa CLI and an agent skill, with BYOK media generation and multi-format export.
AI Tools | TypeScript · agent-first · design-workspace
View Project →inference-gateway
★ 209A Go, cloud-native gateway that unifies many LLM providers (OpenAI, Anthropic, Groq, Ollama, DeepSeek, and more) behind one OpenAI-compatible API. Adds MCP tool discovery, streaming, vision, OIDC auth, and OpenTelemetry/Prometheus metrics for self-hosted LLM traffic.
AI Tools | Go · llm-gateway · proxy
View Project →storycast
★ 206A browser-based AI film maker that turns a topic and chosen character into a narrated, animated short film. It generates scripts, images, video shots, voice, music, edits, and subtitles using fal.ai; users provide their own fal key.
AI Tools | TypeScript · AI video generation · storytelling
View Project →ETOS-LLM-Studio
★ 205Native iOS/watchOS LLM client in Swift: runs local GGUF models offline via llama.cpp or connects to OpenAI, Claude and Gemini. Adds session-level Chat/Agent modes, MCP tools, Agent Skills, an embedded Alpine Linux sandbox, Browser Agent, local SQLite RAG memory and two-way device sync.
AI Tools | Swift · ios · watchos
View Project →proxy
★ 204Local-first MIT proxy that sits between AI agents and model providers, pricing every request and rolling cost up per run, agent, and model. Adds budget caps, a kill switch, anomaly detection, complexity-based model routing, and cross-provider failover behind one Anthropic/OpenAI-compatible base URL.
AI Tools | TypeScript · llm-proxy · cost-tracking
View Project →Token-Print
★ 203TokenPrint renders a real LLM forward pass in interactive 3D: attention heads, RoPE, GQA and the residual stream traced from actual tensors or a local GGUF file. Four modes (architecture, generation, walkthrough, debugger) with provenance tagging. Runs a FastAPI backend plus a Next.js/Three.js frontend.
AI Tools | TypeScript · transformer-visualization · llm-interpretability
View Project →awesome-jev
★ 202A curated directory of Jev demos, SDKs, skills, and integrations, with source links, recorded examples, and notes on setup and limitations. Covers browser and computer-use agents, MCP tools, coding-agent integrations, and other typed-decision applications.
AI Tools | Python · awesome-list · Jev
View Project →eGEOagents
★ 194Python toolkit and CLI for auditing and optimizing web content for citations in AI search engines. Includes a content analysis, ranking, rewriting, and schema-generation pipeline, plus Claude Code skills, MCP support, and an evaluation harness.
AI Tools | Python · generative engine optimization · answer engine optimization
View Project →ThinkingOrbs
★ 192A SwiftUI package of nine animated, dotted 3D indicators and status labels for AI and agent interfaces. Supports state-specific designs, adjustable sizing, accessibility features, and pausing when offscreen or in the background.
AI Tools | Swift · SwiftUI · loading indicators
View Project →pad
★ 183Local-first project management app with a CLI, web UI, MCP server, and skills for coding agents. Agents can manage tasks and project knowledge while their actions are recorded in an activity feed.
AI Tools | Go · AI agents · project management
View Project →www-project-agent-memory-guard
★ 183OWASP Agent Memory Guard is a Python runtime defense layer that sits between an AI agent and its memory store, screening writes/reads for prompt injection, memory poisoning, secret leakage, protected-key tampering and self-reinforcement loops. It enforces YAML policies, emits audit events and ships drop-in integrations
AI Tools | Python · agent-memory · ai-security
View Project →dynolab
★ 178A free macOS Apple Silicon workbench for AI safety and interpretability research. Run local MLX models, capture activations, train probes and SAEs, run interventions, and script or automate studies via a Python SDK, HTTP API and MCP bridge.
AI Tools | Swift · ai-safety · interpretability
View Project →crawlberg
★ 178Rust web-crawling engine that turns sites into clean Markdown and structured metadata, with 14 language bindings plus an MCP server and agent skills for feeding AI agents and RAG pipelines. SSRF-safe, robots-aware, optional headless-browser rendering.
AI Tools | Rust · web-crawling · web-scraping
View Project →AnvilWiki
★ 173Astro + Cloudflare Pages template for SEO-driven game wiki sites: static, zero-JS, Lighthouse 4x100, AdSense slots, i18n. It bundles AI content skills and an MCP ops tool, but the product itself is a website template, not an AI system.
AI Tools | TypeScript · astro · cloudflare-pages
View Project →remote-agent-browser
★ 169A TypeScript client that runs agent-browser in disposable Vercel Sandboxes. It provides persistent browser sessions, command execution, screenshots, file transfer, and proxy support for agent-driven web automation.
AI Tools | TypeScript · browser automation · computer use
View Project →AiNiee-Next
★ 167CLI/TUI batch translation fork of AiNiee powered by LLM APIs (OpenAI, Anthropic, Gemini, DeepSeek, local models). Handles 20+ file formats at 100+ async concurrency, with profiles, task queue, RAG glossary reference, plugins, web dashboard and an optional MCP server.
AI Tools | Python · translation · llm
View Project →llm-api-setup-guides
★ 164Chinese-language documentation hub (98 guides) for wiring LLM APIs into tools: base URL/key setup for chat clients, coding agents (Claude Code, Codex, Cursor, Cline), local model servers and RAG platforms, plus billing checks and 401/404/429 troubleshooting.
AI Tools | Python · chinese · tutorials
View Project →claude-s40
★ 157A Java ME Claude chat client for Nokia Series 40 phones, backed by a small Go server that handles modern Claude API requests, web search, pairing, and chat storage. Includes a custom TLS setup for older phones.
AI Tools | Java · Claude · chat client
View Project →toon-java
★ 155JToon is a Java library for encoding and decoding TOON, a compact structured-data format for LLM contexts. It supports Java objects, JSON input, Jackson annotations, configurable delimiters, and strict decoding.
AI Tools | Java · TOON · serialization
View Project →context-engineering
★ 155Companion repo for a book on context engineering: runnable Python/JS/Java/Jupyter examples covering RAG, agent memory, tools and MCP servers, multi-agent orchestration, prompting patterns, evals, and governance. A hands-on reference for building reliable LLM systems.
AI Tools | Python · context-engineering · llm
View Project →goutoujunshi-jev-chat
★ 152Cross-platform chat assistant that reads visible conversations, analyzes context, and drafts ranked replies in a floating window. Users review OCR and suggestions before copying or filling a draft; sending remains manual. Android currently cannot capture WeChat chats.
AI Tools | Python · chat assistant · reply drafting
View Project →aiworkdeck
★ 150Self-hosted AI-native document workspace for legal teams: agents, MCP tool orchestration, plugin/skill marketplace, embedded LibreOffice editing with tracked changes, OCR, RAG, and evidence-chain review. Java/Spring backend, Vue + Electron desktop, optional local models via Ollama.
AI Tools | Java · ai-workspace · legaltech
View Project →servo-fetch
★ 149Rust browser engine built on embedded Servo that renders pages and extracts Markdown, schema-driven JSON, or PNG screenshots with no Chromium or API key. Ships as CLI, Rust/Python/Node libraries, HTTP API, built-in MCP server, and agent skill for feeding agents web content.
AI Tools | Rust · web-scraping · headless-browser
View Project →WebReaper
★ 148WebReaper is a self-hosted .NET scraper with a CLI and library for crawling sites, producing Markdown, and extracting structured data with optional LLM support. It also provides MCP servers and a Claude Code skill for agent-driven scraping.
AI Tools | C# · web scraping · web crawling
View Project →canonry
★ 145Self-hosted, agent-first AEO/GEO platform (CLI, MCP, API, web UI) that tracks brand mentions and citations across AI answer engines, crawls sites for technical SEO health, and runs competitor visibility analysis on SQLite with BYOK provider keys.
AI Tools | TypeScript · aeo · geo
View Project →open
★ 144Self-hosted tool for tracking brand mentions, rankings, and citations across AI search engines. Includes a dashboard, scheduled evaluations, SQLite storage, data export, and an MCP server.
AI Tools | Go · AI visibility · AEO
View Project →dasheng
★ 144A Next.js web app that scores English read-aloud: streaming R2T2 ASR transcribes speech, word-level alignment finds mismatches, and the Jev LLM answers closed questions (same word? error type? same sentence?) to flag errors and compute a weighted total. Self-hostable on a 12GB NVIDIA GPU or via a relay demo; pronunciat
AI Tools | JavaScript · streaming-asr · speech-recognition
View Project →shellward
★ 136ShellWard is a zero-dependency AI agent security and China-compliance gateway. It scans projects for cross-border data flow, hardcoded secrets and Chinese PII (PIPL/CSL/MLPS), then blocks prompt injection, data exfiltration and dangerous tool calls at runtime via SDK, MCP server or CLI.
AI Tools | TypeScript · ai-security · prompt-injection
View Project →vellium
★ 134A local-first desktop AI workbench for chat, character roleplay, and long-form writing. It supports OpenAI-compatible providers and local model backends, with SQLite storage, RAG collections, MCP tools, plugins, and live voice features.
AI Tools | TypeScript · local-first · desktop-app
View Project →aikito
★ 133Aikito is a Python CLI that keeps coding-agent instructions, skills, MCP definitions, subagents and durable Markdown memory in one Git-managed workspace synced across agents, projects and machines. Stdlib-only, no daemon or vector store; adds adopt/sync/status/doctor commands with preflight safety checks.
AI Tools | Python · agent-memory · agent-governance
View Project →antigravity-fixer
★ 130A Python CLI that diagnoses Google Antigravity and Gemini Code Assist eligibility and login errors, then cleans local credentials and cache and guides account re-authentication. Supports Windows, macOS, and Linux.
AI Tools | Python · Antigravity · Gemini Code Assist
View Project →knowclip
★ 128KnowClip is a Tauri + React + FastAPI desktop app that transcribes long videos locally with Paraformer, uses your own OpenAI-compatible LLM key to pick highlight segments, and batch-exports clips via ffmpeg stream copy without re-encoding.
AI Tools | TypeScript · video-editing · speech-recognition
View Project →protocol-launcher
★ 127Type-safe TypeScript library that builds deep links and URL scheme links for protocol-based apps, including one-click MCP server installs for Cursor and provider imports for Cherry Studio. Useful for wiring AI tool launch/install buttons into docs, sites, or CLIs.
AI Tools | TypeScript · deep-link · url-scheme
View Project →codified-prompt-rule-engine
★ 123A static HTML project describing a prompt-optimization pipeline that adds task structure, constraints, confidence boundaries, and self-check instructions. The repository appears to contain a landing page rather than an implemented optimization engine.
AI Tools | HTML · prompt engineering · prompt optimization
View Project →awesome-ai-gateway
★ 119A bilingual catalog and comparison guide to 160+ AI gateways, with decision tools, reproducible cost benchmarks, security and compliance data, and an eight-chapter handbook. Helps developers choose and evaluate gateways for LLM routing and agent traffic.
AI Tools | HTML · AI gateways · LLM routing
View Project →claude-gateway-manager
★ 119Describes a gateway for routing Anthropic Messages API requests across Claude models and account pools, with budget controls, failover, and monitoring. The repository appears to contain a static HTML landing page rather than the gateway implementation.
AI Tools | HTML · Anthropic API · Claude
View Project →dsh-config-manager
★ 119A DeepSeek Harness (DSH) plugin that exports, imports, migrates, schedules and syncs your complete DSH setup — settings, plugins, MCP servers, skills, agent presets and workspaces — with secret stripping, dry-run preview, rollback and Git/WebDAV remote sync.
AI Tools | TypeScript · backup · restore
View Project →Miffan
★ 118Miffan is an open-source Android AI client (RikkaHub fork) that connects OpenAI, Gemini, Claude and compatible endpoints with BYOK or ChatGPT Codex sign-in. Each assistant has isolated prompts, memory, MCP servers, Skills and tools, plus local Linux or SSH remote workspaces, TTS/STT and selected-text translation.
AI Tools | Kotlin · android · ai-chat-client
View Project →Skill2Env
★ 115Skill2Env converts Agent Skills into Docker-based, host-validated terminal-agent tasks in Harbor format, ready for reinforcement learning or dataset publication. It uses Codex agents to plan and create tasks.
AI Tools | Python · agent evaluation · RL tasks
View Project →OGAD
★ 115Off Grid AI is a local-first desktop runtime and studio that runs open models (text, vision, image, voice) on-device via llama.cpp, stable-diffusion.cpp, whisper.cpp and Kokoro, exposed through one OpenAI-compatible gateway. Includes chat, RAG projects, MCP connectors, artifacts, and an opt-in Pro memory layer.
AI Tools | TypeScript · local-ai · on-device
View Project →agentburn
★ 114A local, read-only CLI profiler for AI coding agents and assistants. It analyzes usage logs to show peak limits, token costs by source, overnight spending, and behavioral causes such as retry loops, then suggests configuration fixes.
AI Tools | Python · usage tracking · cost profiling
View Project →swarm-orchestrator
★ 113Swarm Verify runs repository checks and records tamper-evident evidence in verifiable bundles. It integrates with GitHub Actions to report what was tested and what remains unverified; the repository also includes an optional beta coding agent.
AI Tools | JavaScript · code verification · AI-generated code
View Project →Heisenberg
★ 112Laravel package providing a Gutenberg-style block editor, content model, media library, templates and bilingual blog backend with zero host coupling. Ships an optional AI writing assistant and MCP server, but its core is a CMS, not an AI/agent product.
AI Tools | PHP · laravel · cms
View Project →Hermes-router
★ 110A self-hosted Python gateway for OpenAI- and Anthropic-compatible requests. It routes across cloud and local model providers with failover, key rotation, caching, budgets, and a monitoring dashboard.
AI Tools | Python · LLM router · API proxy
View Project →easyedit
★ 107Local-first Python tool that turns a movie title into a captioned speech and beat-cut montage. It uses Claude Code or Codex for planning, faster-whisper for transcription, and HyperFrames for rendering; it can also run with heuristic defaults.
AI Tools | Python · video-generation · video-editing
View Project →guardana
★ 101Python security verification tool for AI artifacts, live model endpoints, MCP servers, and recorded agent traces. Runs offline artifact scans or bounded active probes, produces reproducible findings, and can gate CI with SARIF output.
AI Tools | HTML · AI security · LLM security
View Project →know-where
★ 101A self-hosted Feishu bot and CLI that extracts public content from supported links, uses configurable AI models for classification and summaries, and archives results in Feishu Bitable. Supports articles, GitHub READMEs, image posts, and video transcription.
AI Tools | Python · knowledge management · AI summarization
View Project →Magic-Resume
★ 101MIT-licensed AI resume workbench (Next.js/TypeScript) that edits resumes in place with multi-model AI, scores and tailors them to job descriptions, and ships a schema-aware MCP server so Claude Code, Cursor or Windsurf can read and patch resumes safely. Self-hosted mode is browser-only with data in IndexedDB; bring you
AI Tools | TypeScript · resume-builder · ats-optimization
View Project →metrik
★ 100A cross-platform desktop app that tracks quotas, reset times, and token usage across locally installed AI coding agents. It parses local logs and official quota endpoints, with reports and no cloud service.
AI Tools | Rust · AI coding agents · token usage
View Project →Librechat-Mobile
★ 100Native Android and iOS client for self-hosted LibreChat servers. Supports streaming chats, multiple accounts, model selection, attachments, artifacts, voice features, agents, and MCP configuration.
AI Tools | Kotlin · AI chat · mobile app
View Project →blink
★ 79Blink is a TypeScript CLI that uses Jev to search codebases with natural-language queries. It ranks likely files by walking directory paths and can run multiple walkers to explore recursively.
AI Tools | TypeScript · code search · natural language
View Project →jev-curate
★ 74A Rust CLI and Python-bindable pipeline that streams Parquet or JSONL datasets and uses TypeSafe AI's Jev model to score, filter, and curate examples. Includes presets for reasoning quality, anti-sycophancy, and code correctness.
AI Tools | Rust · dataset curation · synthetic data
View Project →semdecide
★ 73Python CLI that brings typed LLM judgments to Unix pipelines and CI: is/choose/score/filter commands return predicates, routes, scores, and stable exit codes from TypeSafe AI Jev, plus a guard recipe for agent action safety.
AI Tools | Python · cli · unix-pipelines
View Project →curlora
★ 53Research code for CURLoRA, a LoRA variant that uses CUR matrix decomposition to fine-tune LLMs with fewer trainable parameters and less catastrophic forgetting. Includes PyTorch/Transformers implementations and notebooks reproducing experiments on Mistral 7B and GPT2-Large.
AI Tools | Jupyter Notebook · lora · peft
View Project →brain-portal
★ 19Self-hosted AI-native knowledge base for notes, tasks, projects and contacts. Every item is embedded and FTS5-indexed for semantic Q&A, and a 38-tool MCP server lets Claude Code, Cursor or other agents read and capture into your workspace.
AI Tools | TypeScript · ai · knowledge-base
View Project →collabosm
★ 15Scripts to deploy Qwen3.8-Flash-Next on a high-RAM Colab A100 and expose it through an authenticated OpenAI-compatible API. Includes runtime and model setup, session recovery, performance measurements, and KV-cache management.
AI Tools | Python · LLM inference · model serving
View Project →typesafe-ai-playground
★ 5Rust CLI playground for TypeSafe's Jev (System One) model API. Commands score text for PHI, rate code-comment accuracy and usefulness, build line-importance heat maps, analyze typed tone live, and classify businesses or occupations.
AI Tools | Rust · cli · llm-api
View Project →