Back to Gap Map Product / UX / Assurance & compliance evidence

MarkLLM

THU-BPM
open source / Overall score: 1.6

MarkLLM is a Python toolkit for embedding watermarks in the text a language model generates and for detecting them. It puts many published methods behind one interface, among them KGW, Unigram, SynthID-Text and the publicly verifiable UPV, and adds visualizations of how each method marks tokens and pipelines that test detection rates, robustness to edits and paraphrase, and text quality. The THU-BPM research group develops it, and it was published as an EMNLP 2024 demo paper.

Tagged self-attested: most of its detectors need the key the generator used, so only the key holder can check a mark.

Openness

5 high confidence
5.0
license
Apache-2.0 (OSI; the LICENSE body is the unmodified Apache 2.0 text)
source
public (the toolkit, its algorithm configurations and evaluation pipelines)
core features withheld
no — an academic research toolkit with nothing sold beside it, and the tree has no enterprise path

The whole toolkit is Apache-2.0 in one public repository. It is an academic research project with no paid edition, so nothing is held back from the published code.

Adoption

1 medium confidence
1.0

PyPI downloads of the markllm package, the toolkit's published install.

Capability

2 medium confidence
2.0

A MarkLLM watermark is checked by running the toolkit's detector with the key the generator used, so an outsider who lacks the key takes the operator's word, as with SynthID-Text. UPV, one method among many, lets anyone holding its detector network check a mark; the toolkit's usual output is still a detection score that only the key holder can reproduce.

Verified 2026-11-12