Back to Gap Map Model components / Fine-tuning code

OpenTinker

OpenTinker
open source / Overall score: 2.0

OpenTinker trains language-model agents with supervised fine-tuning and reinforcement learning as a service: a client defines environments and objectives, and a server-side scheduler runs jobs on shared GPUs, with many LoRA adapters sharing one base model. Training runs on verl, with examples for math, vision-language geometry, ALFWorld, Android World and Gomoku agents. It was built at the University of Illinois Urbana-Champaign, independently of Thinking Machines, whose closed Tinker API its paper cites as motivation.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI)
source
public(open-tinker/OpenTinker)
core features withheld
no — no ee, enterprise, commercial or proprietary path in the tree at commit f87fe25
training-backend
open(verl, Apache-2.0, included as a git submodule from volcengine/verl)

OpenTinker is Apache-2.0, and the client, scheduler and server all build from this repository. Its training backend, verl, is Apache-2.0 too, and the authors are university researchers who describe no paid edition or hosted tier.

Adoption

1 low confidence
1.0

OpenTinker has no registry package: the opentinker name in its pyproject.toml is not published on PyPI, and the README installs it from a clone. GitHub stars are the only signal left, and a star records interest rather than a use.

Capability

3 medium confidence
3.0

OpenTinker trains agents with SFT and reinforcement learning in single- and multi-turn environments, letting many LoRA adapters share one base model with their training state kept apart, the same agent-RL ground OpenPipe's ART covers. Its documented examples stop at 3B-parameter models, so none of the large-scale parallel training of verl or Megatron-LM is shown.

  • https://arxiv.org/abs/2601.07376 recorded 2026-10-19

    The abstract describes "multi-LoRA SFT/RL training in which many users, tasks, or agents can share a base model while keeping adapter updates, checkpoints, and rollout snapshots isolated", and "the training scheduler that isolates adapter-local gradients and optimizer state", validated on "single-turn, multi-turn, LoRA, and multi-agent agentic training".

  • https://raw.githubusercontent.com/open-tinker/OpenTinker/main/docs/alfworld_multiturn.md recorded 2026-10-19

    The ALFWorld example trains "tokenizer_path=Qwen/Qwen2.5-3B-Instruct" through the scheduler and lists "`adv_estimator`: Advantage estimator (`gae`, `grpo`, `grpo_per_step`)".

  • https://raw.githubusercontent.com/open-tinker/OpenTinker/main/README.md recorded 2026-10-19

    Quick Start table lists LLM single- and multi-turn math, an LLM single-LoRA math run, VLM single- and multi-turn geometry, and Gomoku, ALFWorld and Android World agents; an Environments section describes data-dependent and data-free, single- and multi-turn paradigms.

Verified 2026-10-19, except some scores, still awaiting re-confirmation