AI Potluck
Organization

LMMs-Lab

lab

Openness profile

1 product on the map — 1 open.

lmms-eval

Openness

5 high confidence
5.0
license
Apache-2.0/MIT(OSI
split license
MIT for the pipeline code inherited from lm-evaluation-harness, Apache-2.0 for the added code in lmms_eval/tasks and lmms_eval/models. Both parts OSI, so the most restrictive part is still osi.)
source
public(GitHub)
core-gated
ungated

GitHub's classifier reports NOASSERTION because the LICENSE file is a composite, but the body read this session is two stock OSI texts with a scope note each: "For the main pipeline structure-related code, we maintain the original license provided with lm-evaluation-harness, which is the MIT License", then "For the multimodal models and datasets that we have added (defined as code in the lmms_eval/tasks and lmms_eval/models folders), we apply the Apache License." Both parts resolve to the osi tier — the rubric already names Apache-2.0/MIT verbatim — so the compound governs at osi. Fully public, and the 23KB README documents no pricing, enterprise edition, paid tier or license key.

  • https://api.github.com/repos/EvolvingLMMs-Lab/lmms-eval/license recorded 2026-09-01

    LICENSE body is a split license: the MIT text (Copyright (c) 2025 LMMs-Lab) for the harness-derived pipeline code, then the Apache-2.0 notice for code in lmms_eval/tasks and lmms_eval/models. GitHub reports spdx_id NOASSERTION for the composite; both component licenses are OSI.

  • https://raw.githubusercontent.com/EvolvingLMMs-Lab/lmms-eval/main/README.md recorded 2026-09-01

    README documents installing editable from a clone or from git and running the harness locally against local weights or APIs; all tasks ship in lmms_eval/tasks and models in lmms_eval/models. Nothing in the 23KB mentions pricing, a paid tier, an enterprise edition or a license key.