Observability & traceability
Dutch open-source LLMOps platform that automatically tracks every LLM call, tool usage and user interaction as traces, spans and metadata, adds prompt versioning, dataset experiments and multi-turn agent testing against a simulated user. Self-hosted and enterprise editions document audit logs, RBAC and SSO/SCIM.
hybrid · generally available · Research snapshot 2026-09-06
Visit the official product source ↗Observability & traceability · Evaluation & testing
Useful conversation with: AI platform lead, AI engineer, Compliance-minded engineering manager.
Show me the full conversation trace for one agent session, then show the audit log entry for the user who changed the evaluation configuration.
Support labels reflect the supplied research. Documentation and vendor claims are not independent product tests. “Not established” means the researcher did not find support; it does not prove a capability is absent.
Documented by provider
LangWatch automatically tracks every LLM call, tool usage and user interaction with detailed traces, spans and metadata, showing the full conversation flow, and supports agent testing of multi-turn conversations with a simulated user.
Limit: Multi-agent handoffs and human feedback capture are not documented on the introduction page.
Documented by provider
Self-hosting documentation states the same software as LangWatch Cloud can be self-hosted for data sovereignty, regulatory compliance or air-gapped environments with no separate community or enterprise build, and lists audit logs giving visibility into who did what and when, role-based access control with fine-grained permissions across projects and teams, and SSO with SCIM provisioning.
Limit: Retention configuration and PII redaction are not documented on that page, and audit-log contents and immutability are not specified.
Documented by provider
Documented deployment models include self-hosted, Cloud Enterprise with dedicated instances in a chosen cloud region, and a hybrid model where LangWatch runs the control plane while ClickHouse and S3 data planes sit in the customer VPC.
Limit: Compliance references (GDPR, SOC 2) appear as motivations for self-hosting rather than as certifications of the vendor.
Documented by provider
The introduction describes an AI Gateway with budgets, routing policies and anomaly detection, and evaluations positioned to guard against harm.
Limit: No documented enforcement semantics, policy language or blocked-call logging.
Listing does not imply partnership, supplier status, a working DutyGraph integration, or a compliance certification.
Suggest a correction