New Relic AI Monitoring

Meet APM for AI. Confidently build and run AI apps with observability across your stack to maintain peak performance, promote quality, ensure compliance, and reduce costs.

Get Demo

Observability makes AI your business partner.

Why New Relic AI Monitoring?

As AI gains complexity, you stay a step ahead.

Set up fast and easily.

New Relic agents include all AI monitoring capabilities—no new instrumentation needed.

Find and fix issues faster.

Instantly visualize your entire AI stack from apps to infra to AI layer in one place.

Optimize your AI workloads.

Gain instant insights into LLMs to troubleshoot performance, error, or cost issues.

See details of every MCP server call.

Automatically monitor the entire Model Context Protocol (MCP) request lifecycle.

Bugs can’t hide from intelligent monitoring.

View a summary of AI metrics, including response time, quality, tokens, APM golden signals, and infrastructure.
Isolate problems faster with a holistic view of your AI stack on one screen.
Use built-in integrations, including AWS Bedrock, DeepSeek, LangChain, NVIDIA NIM, OpenAI, and Pinecone.

Stay confident in your AI app’s quality and reliability.

Get a consolidated view of all model responses with in-depth insights to quickly identify outliers.
Ensure quality by seeing the entire trace from prompt to response, including user feedback.
With complete visibility, easily spot and solve issues like bias, hallucination, and toxicity.

Keep your AI app performance high and costs low.

Easily monitor and control costs by tracking request tokens used, and setting custom alerts.
Quickly compare different models for cost, performance, and quality—all in one view.
Analyze the prompts and responses generated by models for speed, accuracy, and cost impact.

Gain instant insights across multi-agent MCP environments.

Automatically identify every tool and function engaged in MCP service calls, accelerating AI troubleshooting and bottleneck resolution.
Link MCP performance to your full AI application ecosystem—including databases, microservices, and queues.
Keep your AI ecosystem safe from misuse or malicious attacks with New Relic Security RX.

Upgrade model performance with ML monitoring.

Get instant visibility into all your models with out-of-the-box performance dashboards.
Easily track model predictions and drift with at-a-glance view.
Reduce alert noise and resolve issues faster with New Relic alerts and applied intelligence.