mistral.rs
Eric Buehlermistral.rs is an LLM inference engine written in Rust, exposing OpenAI-compatible and Anthropic-compatible endpoints from one binary. It carries paged attention, prefix caching, ISQ and UQFF quantization and multimodal support. It is not affiliated with Mistral AI.
The Rust and prebuilt-binary distribution is primary, so the PyPI wrapper is not declared as an artifact. Verified 2026-08-31 via GitHub, the LICENSE body and the repository README.
Openness
5 medium confidence- license
- MIT(OSI)
- source
- public(the published repository is the engine)
- core-gated
- ungated(no enterprise path in the repository root and no paid build of the engine in the README)
The LICENSE body is the stock MIT text, Copyright (c) 2024 Eric Buehler, with no appended condition, read in full rather than taken from the API's label. The repository is public and unarchived and builds the engine itself. Its root tree carries no enterprise, ee or commercial directory and its README describes no licence-gated build, so the core reads as ungated. Confidence is medium because that is a repository-and-README read rather than a pricing-page read.
- https://raw.githubusercontent.com/EricLBuehler/mistral.rs/master/LICENSE recorded 2026-08-31
LICENSE body, read in full: the stock MIT text, Copyright (c) 2024 Eric Buehler, with no appended condition.
- https://api.github.com/repos/EricLBuehler/mistral.rs recorded 2026-08-31
Repo metadata for EricLBuehler/mistral.rs - archived false, 7,638 stars.
- https://raw.githubusercontent.com/EricLBuehler/mistral.rs/master/README.md recorded 2026-08-31
README, read for a paid tier, an enterprise edition or a licence-gated build beside the published source, and for whether any component is stated to be private.
Adoption
2 low confidence7,638 GitHub stars, in the 1K-10K band of the stars scale. A `mistralrs` package on PyPI resolves to this repository but drew 545 downloads in the trailing 30 days against a Rust and prebuilt-binary primary distribution, so it measures a minority channel and is not declared. The stars band should be read as a floor.
- https://api.github.com/repos/EricLBuehler/mistral.rs recorded 2026-08-31
Repo metadata - stargazers_count = 7,638 - for EricLBuehler/mistral.rs.
Capability
4 medium confidenceOne band below the vllm anchor. The feature set overlaps the anchor's closely - paged attention, prefix caching, quantization - but it is banded below rather than at, because sglang holds the `at` band on a published multi-node serving record this engine does not claim.
- https://raw.githubusercontent.com/EricLBuehler/mistral.rs/master/README.md recorded 2026-08-31
README, read for the engine's feature set: Paged attention, prefix caching, ISQ/UQFF quantization and multimodality in one engine, serving OpenAI-compatible and Anthropic-compatible endpoints.
Verified 2026-08-31