EuroEval

license

MIT(OSI)

source

public(GitHub)

core-gated

ungated

MIT and fully public: the LICENSE body is the stock MIT text (copyright Dan Saattrup Smart and Alexandra Instituttet A/S) with no appended terms. The package installs from PyPI, dataset-creation scripts ship in the repo, and no pricing, paid tier or license key appears in the README or on the docs site.

• https://api.github.com/repos/EuroEval/EuroEval/license recorded 2026-09-01

  GitHub's license endpoint reports spdx_id MIT and returns the stock MIT text (Copyright (c) 2021-2026 Dan Saattrup Smart; Copyright (c) 2022-2026 Alexandra Instituttet A/S) with no appended terms

• https://raw.githubusercontent.com/EuroEval/EuroEval/main/README.md recorded 2026-09-01

  README documents the open framework, reproduction scripts for every evaluation dataset in src/scripts/dataset_creation, and the docs-site install path; no pricing, paid tier or license key

The euroeval package draws 750 PyPI downloads in the trailing 30 days, banding at level 1 (<10K). The package is the documented install path and is backlink-verified. The legacy scandeval package (the project's pre-rename name) still draws 2,207 a month; summed the product stays well under 10K, so the band holds across the rename.

• https://pypistats.org/api/packages/euroeval/recent recorded 2026-09-01

  last_month = 750 downloads of the euroeval package

• https://pypistats.org/api/packages/scandeval/recent recorded 2026-09-01

  last_month = 2,207 downloads of the legacy scandeval package — recorded so the rename's second channel is visible; the sum stays under 10K

• https://pypi.org/pypi/euroeval/json recorded 2026-09-01

  project_urls.Repository = github.com/EuroEval/EuroEval, author Dan Saattrup Smart <dan.smart@alexandra.dk>, version 18.0.0 uploaded 2026-08-14 — the package is the product

The deepest European-language coverage in the category — 30+ languages, all model classes, reproducible datasets and public leaderboards — but a single-domain harness with a narrow task surface and one primary maintainer, an order below lighteval's 1000+ tasks and backend spread, so one below lighteval beside bigcodebench and olmes.

• https://euroeval.com recorded 2026-09-01

  "the standard benchmark for evaluating language models across 30+ European languages"; supports encoders, decoders, encoder-decoders, base and instruction-tuned models; publisher Alexandra Institute; interactive leaderboards

• https://raw.githubusercontent.com/EuroEval/EuroEval/main/README.md recorded 2026-09-01

  dataset reproduction scripts per language; formerly ScandEval; maintainer and docs links