Model components / Dataset Processing Tools

smallpond

Lightweight distributed data-processing framework built on DuckDB and DeepSeek's 3FS, aimed at PB-scale preprocessing.

DeepSeek smallpond; MIT confirmed live 2026-07-21, but effectively dormant (no repo commits since 2025-03). A rare open data-infra release from an otherwise closed-data lab; strong launch-driven star count, thin sustained use.

Openness

5 high confidence

5.0

license: MIT(OSI)
source: public(deepseek-ai/smallpond)
governance: DeepSeek
core-gated: ungated

Fully OSI-licensed (MIT), full source public.

https://github.com/deepseek-ai/smallpond/blob/main/LICENSE recorded 2026-07-21
MIT License text (Copyright 2025 DeepSeek)

Adoption

1 high confidence

1.0

~250 PyPI downloads/month; large star count from the DeepSeek open-infra launch but little sustained adoption, dormant since March 2025.

https://pypistats.org/packages/smallpond recorded 2026-07-21
Downloads last month: 254

Capability

3 medium confidence

3.0

Promising design, but not proven on downstream corpora and dormant.

https://github.com/deepseek-ai/smallpond recorded 2026-07-21
smallpond repo feature set confirmed

Unchanged since 2026-07-30 (last edited, not re-checked)