「AI 可观测与评测」工具排行榜

Prompt once. Compare multiple AI-built apps for free.

AI Model & API Providers Analysis 是 Artificial Analysis 旗下与 artificialanalysis.ai 对应的产品官网，主要提供：Comparison and analysis of AI models and API hosting providers. Independent benchmarks across key performance metrics including quality, price, output speed & latency.

Datadog 对应 datadoghq.com。See inside any stack, any app, at any scale, anywhere.

Sentry 对应 sentry.io。Application performance monitoring for developers & software teams to see errors clearer, solve issues faster & continue learning continuously. Get started at sentry.io.

PostHog – We make dev tools for product engineers 对应 posthog.com。All your developer tools in one place. PostHog gives engineers everything to build, test, measure, and ship successful products faster. Get started free.

基于真实用户投票的 AI 设计能力评测平台。

Grafana Labs 对应 grafana.com。Avoid lock-in and ensure reliability with Grafana Cloud. The AI-powered platform built on open standards unifies metrics, logs, traces, profiles, and business data.

Compare API models by benchmarks, cost & capabilities

开源LLM应用程序分析

Codex 今天降智了吗？

Scale AI的核心功能包括高质量的训练数据，由经验丰富的专家团队进行的数据标记和注释，用户友好的平台界面以及可满足各种AI应用程序需求的可扩展性。

Epoch AI 是 Epoch AI 旗下与 epoch.ai 对应的产品官网，主要提供：Epoch AI is a research institute investigating key trends and questions that will shape the trajectory and governance of Artificial Intelligence.

Better Stack 是 Better Stack 旗下与 betterstack.com 对应的产品官网，主要提供：AI SRE and MCP server, incident management, on-call, logs, metrics, traces, and error tracking. 7,000+ happy customers. 60-day money back guarantee.

Arena 对应 lmarena.ai。Chat, compare, vote for the world's best AI models. Join the community shaping the public leaderboard for LLMs, image, and code models through real-world evaluation.

Comet is represented by comet.com. Comet provides an end-to-end model evaluation platform for AI developers, with best-in-class LLM evaluations, experiment tracking, and production monitoring.

Honeycomb 对应 honeycomb.io。Honeycomb is the observability platform built for AI-era software. Fast queries, unified telemetry, and LLM observability. Used by Slack, Intercom, and Dropbox.

开发人员编程统计和分析仪表板

开源聊天机器人，性能接近ChatGPT

Braintrust 对应 braintrust.dev。Braintrust - The AI observability platform for building quality AI products

可观察性套件AI网关提示播放器

移情语音接口 (EVI) 表情测量API自定义模型API

监控仪表板评估和性能跟踪可解释性和公平性嵌入式和RAG分析器LLM跟踪微调Phoenix OSS

METR 是 METR Substack twitter 旗下与 metr.org 对应的产品官网，主要提供：METR is a research nonprofit that evaluates frontier AI models to help companies and wider society understand AI capabilities and what risks they pose.

MLflow AI Platform 对应 mlflow.org。The largest open source AI engineering platform for agents, LLMs, and ML models. Debug, evaluate, monitor, and optimize your AI applications. Built for teams of all sizes.

适用于所有数据类型的灵活数据注释支持计算机视觉，自然语言处理，语音，声音和视频模型，可自定义的标签和注释模板，通过Webhooks，Python SDK和API与ML / AI管道集成，ML辅助注释与后端集成，连接到云对象存储 (S3和GCP)，使用data manager进行高级数据管理，支持多个项目和用户，并获得数据科学家社区的广泛信任

Build Secure AI Applications is represented by promptfoo.dev. The AI Security Platform that catches vulnerabilities in development. Trusted by 127 of the Fortune 500 and 300,000+ developers worldwide.

Vectra AI is represented by vectra.ai. We protect modern networks from modern attacks. Vectra AI sees attackers' every move, connecting the dots across network, identity, and cloud.

Evidently AI is represented by evidentlyai.com. Ensure your AI is production-ready. Test LLMs and monitor performance across AI applications, RAG systems, and multi-agent workflows. Built on open-source.

PromptQuorum 是 PromptQuorum 旗下与 promptquorum.com 对应的产品官网，主要提供：Prompt optimization and management across 25+ AI models. Run one prompt, compare outputs, detect hallucinations, and pick the best answer. Free with your API key.

Voxel51 is represented by voxel51.com. Voxel51 empowers multimodal and physical AI builders to unlock visual data insights and maximize model performance. Start building today.

AI 论文评审 Agent。

Maxim AI is represented by getmaxim.ai. Evaluate and ship your AI applications with quality, speed, and reliability.

Confident AI is represented by confident-ai.com. Confident AI is the AI quality layer for engineers, QA teams, and product leaders. Benchmark, test, and monitor AI systems with research-backed metrics.

Helicone.ai is represented by helicone.ai. Routing and monitoring for reliable AI apps - the LLMOps platform behind the fastest-growing AI companies.

用于 Agent 评估的动态仿真研究平台。

字节跳动推出的视觉 AI 模型对战平台。

Future AGI is represented by futureagi.com. Build self-improving agents. Catch what breaks. Know why. Fix it. Ship smarter every time.

OrcaRouter 是 OrcaRouter 旗下与 orcarouter.ai 对应的产品官网，主要提供：One OpenAI-compatible AI gateway for production AI — adaptive routing, load balancing, guardrails, agent firewall, observability and governance across 200+ models.

Raindrop is represented by raindrop.ai. Monitor your AI Agent the right way. Get alerted when your agent fails in production, trace exactly what went wrong, and prove your fix worked.

Respan 对应 respan.ai。Respan is the LLM engineering platform that unifies observability, evals, prompt optimization, and a unified LLM gateway. Ship reliable AI applications with confidence.

使用免编码技能构建AI代理聊天机器人使用自定义数据训练AI代理将AI代理部署到网站或消息传递应用程序中

数据操作数据管理实验管理和可视化模型培训和生命周期管理协作，仪表板和报告模型管理，仓库和版本控制自动化 (CI/CD) 和管道模型服务和监视完全可见的基础架构使用情况自动将环境打包并部署到远程计算机减少计算，硬件和资源成本，以优化性能

Fiddler AI is represented by fiddler.ai. The Fiddler AI Control Plane provides enterprises with visibility, context, and control across the agentic lifecycle with observability, guardrails, and governance.

AI合规和标准AI采用跟踪AI风险管理生成AI保护措施合规监管

联络中心运营自动化

一键可无限创建个性化聊天机器人，无需编码，共享和集成生成的AI，最大的社区生成聊天机器人库

AI Red Teaming & LLM Security Platform is represented by giskard.ai. Secure AI agents with Giskard’s continuous AI red teaming. Detect vulnerabilities, improve LLM security, and safeguard your AI systems.

Cekura is represented by cekura.ai. End-to-end testing and observability for Conversational AI. Run pre-production simulations across diverse personas and monitor production conversations to test instruction-following, tool calls, and conversational quality.

住在 macOS 灵动岛里的 AI Agent 控制中心