YYLO Benchmark
JUNO AIBenchmark harness for coding agents that runs every candidate attempt in a dedicated fresh repository with private home, temp, cache, and config roots behind a selective filesystem sandbox, and retains one hash-verified evidence chain linking the plan, attempt, workspace receipt, post-execution repository manifest, terminal, and evaluation IDs. Recovery, doctor, and report fail closed unless the complete chain verifies. It offers isolated v2 attempts plus an explicitly authorized governed-workflow lane, and distributes as the @yylo/benchmark npm package.
Openness
5 high confidence- license
- MIT(OSI)
- source
- public
- core features withheld
- no
yylo-benchmark is MIT, the standard license text under a 2026 JUNO AI INC. copyright, with its full harness source public on GitHub and no paid tier, managed offering or enterprise directory. Paid and provider execution always requires separate consumer authorization; package tests use synthetic boundaries only.
- https://github.com/yylo-dev/yylo-benchmark recorded 2026-09-14
MIT license on the repo, full harness source public, 1 star; no managed tier, no paid plan, no enterprise directory
- https://github.com/yylo-dev/yylo-benchmark/blob/main/LICENSE recorded 2026-09-14
MIT License text, Copyright (c) 2026 JUNO AI INC., standard OSI license body
Adoption
1 medium confidenceyylo-benchmark's npm downloads are read directly, since @yylo/benchmark is the product's only distribution channel and the figure measures use of the product itself, not a proxy for it. Raw download volume includes CI and mirror traffic, so this is install volume rather than a user count, and the harness remains early-stage next to the framework-scale projects leading the category.
- https://api.npmjs.org/downloads/point/last-month/@yylo/benchmark recorded 2026-09-14
npm registry download API returns 326 downloads for @yylo/benchmark over the trailing month, 2026-08-13 to 2026-09-11
Capability
2 medium confidenceyylo-benchmark is a narrow, early evaluation harness, capable within its scope: isolated attempt workspaces, retained hash-verified evidence chains, and fail-closed doctor and report steps. It is young and has no third-party adoption yet, and no peer comparison is recorded because there is not yet enough evidence to place it against category leaders.
- https://raw.githubusercontent.com/yylo-dev/yylo-benchmark/main/README.md recorded 2026-09-14
README describing two evaluation lanes, isolated fresh-repository attempt workspaces with selective filesystem sandboxing, deterministic and LLM-judge evaluator profiles, and fail-closed recovery, doctor, and report over one retained hash-verified evidence chain
Verified 2026-09-14