Observability & traceability
Helicone
Apache-2.0 gateway and observability service that proxies LLM requests and logs them for inspection, with model routing across many providers. Capture is request/response oriented rather than agent-span oriented, and the pages reviewed document no RBAC, retention or redaction controls despite claiming SOC 2 and GDPR compliance.
hybrid · generally available · Research snapshot 2026-09-06
Visit the official product source ↗Where it fits
Observability & traceability
Useful conversation with: AI engineer, Platform engineer.
Ask for a demonstration
Show me the logged request and response for a specific model call routed through the gateway, and what data I can export via the API.
Capabilities and evidence
Support labels reflect the supplied research. Documentation and vendor claims are not independent product tests. “Not established” means the researcher did not find support; it does not prove a capability is absent.
Documented by provider
Helicone's AI Gateway automatically logs LLM requests, which appear in the Requests tab within seconds, and provides access to 100+ models across providers including OpenAI, Anthropic, Google Vertex and Groq through an OpenAI-compatible endpoint.
Limit: The quickstart documents no LLM spans, tool calls, multi-agent handoffs, dataset scoring or evaluation features.
Source s1
Vendor claim
The repository states Helicone is an open-source LLM observability platform licensed under Apache v2.0, references SOC 2 and GDPR compliance, and documents data export via API and access via an MCP server.
Limit: Compliance is asserted on the repository page without linked attestations; no RBAC, SSO, retention or PII redaction features are stated.
Source s2
Limitations to discuss
- Gateway-level logging captures requests, not agent decision structure, so multi-step agent accountability is limited.
- No access control, audit trail or retention documentation was found on the pages fetched.
Sources
- Helicone quick start · Helicone · official docs
Access date reported by researcher: 2026-09-06 - Helicone/helicone · GitHub / Helicone · official repository
Access date reported by researcher: 2026-09-06
Listing does not imply partnership, supplier status, a working DutyGraph integration, or a compliance certification.
Suggest a correction