Observability & traceability

LangSmith

LangChain's hosted platform for tracing LLM and agent applications. Traces record what agents did in production and feed evaluation datasets, online evaluation rules and annotation queues. Enterprise plans add role-based access control with workspace roles and custom organization roles; audit logging is not documented.

commercial · generally available · Research snapshot 2026-09-06

Visit the official product source ↗

Where it fits

Observability & traceability · Evaluation & testing

Useful conversation with: AI engineering lead, Platform engineer.

Ask for a demonstration

Show me a production trace for a failed agent run and demonstrate which workspace roles can view or edit that trace.

Capabilities and evidence

Support labels reflect the supplied research. Documentation and vendor claims are not independent product tests. “Not established” means the researcher did not find support; it does not prove a capability is absent.

Documented by provider

LangSmith Observability provides visibility from individual traces to production-wide performance metrics, with traces described as the record of what agents did in production, plus annotation of outputs, feedback via queues or inline annotation, and rules for online evaluations.

Limit: The overview does not state whether tool calls, sessions, token counts or costs are captured as structured fields.

Source s1

Documented by provider

RBAC is available only to Enterprise customers, with other plans defaulting to the Admin role for all users; built-in workspace roles are Workspace Admin, Editor and Viewer, and organization admins can create custom roles.

Limit: Audit logs, retention configuration, PII redaction and compliance certifications are not documented on the pages fetched.

Source s2

Limitations to discuss

Sources

  1. LangSmith Observability · LangChain · official docs
    Access date reported by researcher: 2026-09-06
  2. Administration overview · LangChain · official docs
    Access date reported by researcher: 2026-09-06

Listing does not imply partnership, supplier status, a working DutyGraph integration, or a compliance certification.

Suggest a correction