WhyLabs
WhyLabsAI observability platform for monitoring machine-learning models and LLM applications in production, covering data drift detection, performance monitoring and LLM security guardrails. It is built on the whylogs profiling library and the LangKit monitoring toolkit, and takes a statistical profiling approach that monitors distributions rather than individual requests.
WhyLabs, Inc. has discontinued operations, so the entry is scored on what remains runnable: the whylogs and LangKit libraries. The record declares no artifacts, which is why its adoption band has no signal route behind it. Verified 2026-08-13 via the WhyLabs LangKit page and the whylabs/whylogs repository.
Openness
5 high confidence- license
- Apache-2.0(OSI, whylogs + LangKit + open sourced platform)
- source
- public(github.com/whylabs)
- core-gated
- ungated(nothing is withheld - the company ceased operations and open sourced the platform on closure)
- hosted-SaaS
- discontinued
- status
- company-ceased-ops, platform open sourced on closure
The score is taken on what remains accessible, which is the open source stack. whylogs, for data logging, and LangKit, for LLM monitoring, are both Apache-2.0, and WhyLabs open sourced its platform when it shut down. The two objections that would hold this lower - the hosted backend no longer operating, and the open source pieces being libraries rather than a turnkey observability product - are judgments about maturity rather than openness, and they are recorded on the adoption and capability axes, both at 2. On openness the published source is now the whole product, because there is nothing else left, and that is open source rather than open core.
- https://whylabs.ai/langkit recorded 2026-08-13
The closure notice, in the vendor's own words - "WhyLabs, Inc. is discontinuing operations", followed by "The complete WhyLabs platform has been open sourced to help support next iterations of AI observability research" and, on LangKit, "The open source toolkit for monitoring LLMs, langkit will continue to help teams monitor and secure LLMs while preserving privacy." Nothing is withheld, because there is no longer a commercial product to withhold it for.
- https://github.com/whylabs/whylogs recorded 2026-08-13
Repository page. GitHub resolves the LICENSE to Apache-2.0 and the README carries an Apache 2 badge; the source tree is public. 2,830 stars.
Adoption
2 low confidenceThe hosted SaaS has shut down, so there are no active platform users. The remaining signal is the open source libraries: whylabs/whylogs has 2,830 GitHub stars, which bands at 1K-10K stars and level 2. Stars cannot carry a product above level 3, and no download-range label is recorded because stars have their own vocabulary - a star is not a download. The level is placed at 2 rather than 3 because the commercial product is dead and the release cadence has stalled: the last release was in December 2024 and the last push to the repository was in January 2025. The honest reading is modest residual open source usage, not a live platform.
- https://github.com/whylabs/whylogs recorded 2026-06-04
2.8k stars, latest release v1.6.4 (Dec 3, 2024)
- https://api.github.com/repos/whylabs/whylogs recorded 2026-08-13
stargazers_count = 2830 for whylabs/whylogs, with pushed_at 2025-01-10T20:14:49Z. No download, install or customer figure exists for this product, the hosted platform having shut down.
Capability
2 medium confidenceAs living, usable capability this is a pair of monitoring libraries rather than a full tracing, evaluation and prompt platform: whylogs does data logging and profiling with drift and data-quality monitoring, and LangKit adds LLM text-quality and safety metrics such as sentiment, toxicity and prompt-injection signals. There is no live tracing backend and no evaluation-experiment or prompt-management platform - what was open sourced is now unmaintained, with the last release in December 2024 and the last push in January 2025 - and the README still describes a profiling library that integrates with Spark, Airflow, S3 and MLflow rather than an observability platform. That is narrow enough to sit two rungs below the MLflow and Langfuse anchors at 4.
- https://github.com/whylabs/whylogs recorded 2026-08-13
README describes a data-logging and profiling library with integrations for AWS S3, Apache Airflow, Apache Spark and MLflow, designed to run "typically in a distributed environment, such as Ray or Apache Spark". There is no tracing backend, prompt-management or eval-experiment surface in it. The repository's last push was in January 2025.
Verified 2026-08-13