Skip to content
O

OpenLLMetry

Open-source observability platform for LLMs using OpenTelemetry

Open source

#174in AI
0In stores

Description

OpenLLMetry is an open-source observability library for large language model applications, built on OpenTelemetry. It records what your LLM…

Preview

Highlights

  • Two lines of code to start tracing
  • Built on OpenTelemetry
  • Traces for many LLM providers
  • Works with LangChain and LlamaIndex
  • Sends traces to your existing tools

Ratings & Reviews

No ratings yet

Be the first to rate OpenLLMetry.

People also visit

O

OpenLIT: Zero code Agent Observability

Continuous feedback for testing, tracing & fixing AI agents

AI
Launch
L

Langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability…

AI
Launch
L

Lmnr

Laminar - open-source observability platform purpose-built for AI agents

AI
Launch
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

AI
Launch
L

LiteLLM

Acts as a unified proxy across 100+ LLMs

AI
Launch
L

LLM Gateway

Route, manage, and analyze LLM requests across multiple providers with one API

AI
Launch

OpenLLMetry FAQ

Is OpenLLMetry free?

Yes. It is an open-source library, and its code is on GitHub.

How much code do I need to add?

The site says two lines: initialise the SDK and add a decorator to the workflow function you want to trace. Examples are given for Python and TypeScript.

Which models does it track?

The site lists OpenAI, Anthropic, Bedrock, Cohere, Gemini, Mistral AI, Ollama, together.ai and Watsonx.

Where do the traces go?

Because it is built on OpenTelemetry, you can send them to tools such as Datadog, Grafana Tempo, Honeycomb and New Relic, according to the site.

What are the best OpenLLMetry alternatives?

Popular alternatives to OpenLLMetry include OpenLIT: Zero code Agent Observability, Langtrace and Lmnr. See all OpenLLMetry alternatives

Developer Stuff

Badges