AI / LLM Observability & Evaluation

34 enterprise products in the directory are classified under AI / LLM Observability & Evaluation. Compare them below, or open the full directory to filter by your whole stack.

• Alyx

  Arize AI

  An AI teammate designed to help debug, shorten the knowledge loop, and build AI applications with greater confidence and speed.

• Arize AX

  Arize AI

  Enterprise AI engineering platform for ML, computer vision, and generative AI applications, offering deep visibility and evaluation capabilities.

• Arize Phoenix

  Arize AI

  Open-source platform for LLM tracing and evaluation, built on OpenTelemetry for transparent, framework-agnostic, and vendor-lock-in-free AI application development.

• Arize Platform

  Arize AI

  A comprehensive platform for monitoring, troubleshooting, and improving AI and machine learning models in production environments.

• Velvet

  Arize AI

  An AI gateway designed to help engineers analyze, evaluate, and monitor AI-powered features in production environments by acting as a proxy.

• Arthur AI Monitoring Platform

  Arthur AI

  Arthur AI provides a platform for monitoring and managing the performance of AI models in production, ensuring fairness and transparency. ServiceNow's AI Platform enables businesses to automate workflows and improve deci

• Langfuse Cloud

  ClickHouse

  LLM observability and evaluations for reliable AI applications and agents, now part of ClickHouse.

• Coder AI Bridge

  Coder

  A gateway for AI requests, handling authentication, observability, and policy enforcement for AI agents.

• LLM Mesh

  Dataiku

  Abstracts and switches LLM providers with centralized routing, quotas, monitoring, and safety controls for managing cost and risk at scale.

• Agentic Observability

  Fiddler AI

  Provides end-to-end visibility across the agentic hierarchy, making AI agents interpretable to understand system behaviors, dependencies, and outcomes.

• Control Plane for Agents

  Fiddler AI

  Offers visibility, context, and control across the agentic lifecycle with observability, guardrails, and governance for autonomous AI systems.

• Fiddler AI Observability and Security platform

  Fiddler AI

  Provides unified visibility, context, and control for AI applications, monitoring performance, behavior, and risks throughout their lifecycle.

• Fiddler Trust Service

  Fiddler AI

  Strengthens AI guardrails and LLM monitoring, mitigating LLM security risks by scoring extensive metrics for advanced use cases and compliance.

• Guardrails

  Fiddler AI

  Ensures AI safety and compliance by protecting and enforcing AI applications with guardrails that prevent costly incidents in real-time.

• Google Cloud Vertex AI

  Google Cloud

  Google Cloud Vertex AI is a unified platform for building, deploying, and managing machine learning models. It offers a range of tools and services for data preparation, model training, and model deployment. By integrati

• Jasper IQ

  Jasper

  A rich context hub designed to maintain quality and authenticity in AI-generated content, ensuring brand voice and factual accuracy.

• Generative AI Solutions

  Labelbox

  Tailored tools for working with large language models and generative systems, including instruction tuning, output evaluation, and human feedback.

• LangSmith Evaluation

  LangChain

  Tools to score and improve the performance of AI agents.

• LangSmith Observability

  LangChain

  Provides deep visibility into AI agent behavior through tracing execution paths and runtime metrics.

• LangSmith Platform

  LangChain

  A platform for observing, evaluating, and deploying AI agents throughout the development lifecycle.

• Okahu AI Observability

  Okahu

  A platform for observing AI workloads, offering insights into performance, reliability, and cost-effectiveness for generative AI applications.

• AI Evaluation Platform

  Patronus AI

  Comprehensive platform for evaluating, monitoring, and improving AI models throughout their lifecycle.

• AI Observability

  Patronus AI

  Provides deep insights into AI model behavior and operational performance for proactive issue resolution.

• LLM Testing and Monitoring

  Patronus AI

  Specialized tools for testing and continuously monitoring the performance and safety of Large Language Models.

• Sapient Bodhi

  Publicis Sapient

  Builds and orchestrates enterprise-ready AI agents with built-in context, controls, and observability for secure production deployment.

• Snorkel AI Data Development Platform

  Snorkel AI

  A comprehensive platform for building, evaluating, and improving AI models and agents through data-centric development and programmatic labeling.

• Snorkel Evaluate

  Snorkel AI

  A component of the platform for building deep, targeted evaluators to assess and improve the performance of AI models and agentic systems.

• Agent Cost Observability

  Tensorcost

  Provides per-agent and per-workflow attribution for AI agent costs, with anomaly detection and alerts.

• UiPath AI Center

  UiPath

  UiPath AI Center provides a platform to deploy, manage, and govern AI models within the UiPath RPA platform. Integrating with Microsoft Azure Cognitive Services gives UiPath users access to Azure's robust suite of pre-tr

• W&B Reports

  Weights & Biases

  Generates interactive reports and dashboards to visualize ML experiments and model performance.