AI Potluck
Model components / Fine-tuning code

Miles

RadixArk

Miles is a reinforcement learning framework for post-training large language and vision-language models. It pairs SGLang for rollout generation with Megatron-LM for training and offers a PyTorch FSDP2 backend as an alternative, with rollout and training workers decoupled so runs can be fully asynchronous. It is a fork of slime, maintained by RadixArk.

Verified 2026-08-31 via the repository LICENSE and README.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI)
source
public(radixark/miles)
core-gated
ungated(no enterprise or ee path in the repository root and no paid tier described in the README)

Apache-2.0, an OSI licence, with the full source public and the shipped code in this repository. The LICENSE body was read in full: the stock Apache-2.0 text, its core byte-identical to the canonical template, with nothing after END OF TERMS AND CONDITIONS but the standard appendix. No enterprise or ee path in the repository root and no paid tier described in the readme.

Adoption

2 low confidence
2.0

No package registry carries this product, so stars are the only available signal and the band is capped at 3 by the instrument. 2,293 stargazers places it at level 2. Stars measure attention rather than use, which is why the confidence is low. A PyPI project named `miles` exists but belongs to an unrelated package - version 0.1, no summary and no project URLs pointing at this repository - so it is not declared here.

Capability

4 medium confidence
4.0

Miles runs RL post-training at trillion-parameter scale on a Megatron-LM training backend with SGLang rollout, and its async design and P2P RDMA weight transfer are the same class of infrastructure verl provides. It sits one band below verl because verl publishes a substantially wider algorithm catalogue (PPO, GRPO, RLOO, ReMax, REINFORCE++, GSPO, PRIME, DAPO, DrGRPO plus SFT/DPO) while Miles documents PPO and GRPO; method breadth is what separates the top two bands in this category.

  • https://raw.githubusercontent.com/radixark/miles/main/README.md recorded 2026-08-31

    About and Performance sections describe pairing SGLang for rollout with Megatron-LM for scalable training, a PyTorch FSDP2 backend alternative, fully async RL with decoupled rollout/training workers, and in-loop weight updates over P2P RDMA on a trillion-parameter model (Kimi-K2.6).

Verified 2026-08-31