Observability & traceability
LangSmith
LangChain's hosted platform for tracing LLM and agent applications. Traces record what agents did in production and feed evaluation datasets, online evaluation rules and annotation queues. Enterprise plans add role-based access control with workspace roles and custom organization roles; audit logging is not documented.
commercial · generally available · Research snapshot 2026-09-06
Visit the official product source ↗Where it fits
Observability & traceability · Evaluation & testing
Useful conversation with: AI engineering lead, Platform engineer.
Ask for a demonstration
Show me a production trace for a failed agent run and demonstrate which workspace roles can view or edit that trace.
Capabilities and evidence
Support labels reflect the supplied research. Documentation and vendor claims are not independent product tests. “Not established” means the researcher did not find support; it does not prove a capability is absent.
Documented by provider
LangSmith Observability provides visibility from individual traces to production-wide performance metrics, with traces described as the record of what agents did in production, plus annotation of outputs, feedback via queues or inline annotation, and rules for online evaluations.
Limit: The overview does not state whether tool calls, sessions, token counts or costs are captured as structured fields.
Source s1
Documented by provider
RBAC is available only to Enterprise customers, with other plans defaulting to the Admin role for all users; built-in workspace roles are Workspace Admin, Editor and Viewer, and organization admins can create custom roles.
Limit: Audit logs, retention configuration, PII redaction and compliance certifications are not documented on the pages fetched.
Source s2
Limitations to discuss
- No documented audit trail, retention policy or data-masking control, so trace records are developer telemetry rather than governance evidence.
- Self-hosted deployment was not established from the pages fetched.
Sources
- LangSmith Observability · LangChain · official docs
Access date reported by researcher: 2026-09-06 - Administration overview · LangChain · official docs
Access date reported by researcher: 2026-09-06
Listing does not imply partnership, supplier status, a working DutyGraph integration, or a compliance certification.
Suggest a correction