Dynatrace extends AI observability to secure generative AI apps

Dynatrace has expanded its platform to include end-to-end observability for Large Language Models (LLMs) and Generative AI-powered apps. The move aims to offer organisations greater visibility when adopting these technologies, allowing them to maintain security and compliance, prevent AI' hallucinations' and more accurately forecast and control the costs of AI model consumption.

The enhancement to Dynatrace's analytics and automation platform, titled AI Observability, proffers holistic observability and security for LLMs and generative AI-powered applications. This development has enabled organisations worldwide to confidently and cost-effectively integrate generative AI into their roadmap, promoting innovation, productivity and revenue growth.

Dynatrace AI Observability covers the full AI stack, from infrastructure and foundational models to semantic caches, vector databases, and orchestration frameworks. It also extends support to major platforms used for building, training and delivering AI models, such as Microsoft Azure OpenAI Service, Amazon SageMaker, and Google AI Platform.

Leveraging key technologies, including the platform's Davis AI, AI Observability provides a precise and complete view of AI-powered applications. It helps organisations identify performance bottlenecks and root causes, enabling improved user experiences and compliance with privacy and security regulations and governance standards. Moreover, it aids in forecasting and controlling costs associated with the consumption of tokens, which generative AI models use to process queries.

Ryan Berry, SVP of Engineering and Architecture at OneStream, commented, "Generative and predictive AI will unlock new possibilities for our business with our ML and LLM services, but to implement them successfully, we need to ensure that our services supporting these critical workloads are reliable and perform well. That's why we rely on Dynatrace, a leader in AI and observability."

Gartner predicts that by 2028, over 50% of cloud computing resources will be allocated to AI workloads, signalling a growing interest among organisations in generative AI to drive automation and innovation. However, concerns about the significant costs associated with generative AI-powered services have also been highlighted, alongside a worldwide push for responsible and ethical use of AI in accordance with applicable legal regulations.

Bernd Greifeneder, CTO at Dynatrace, said, "Generative AI is the new frontier of digital transformation. This technology enables organisations to create innovative solutions that boost productivity, profitability, and competitiveness. While transformational, it also poses new challenges for security, transparency, reliability, experience, and cost management."

"Organisations need AI observability that covers every aspect of their generative AI solutions to overcome these challenges. Dynatrace is extending its observability and AI leadership to meet this need, helping customers to embrace AI confidently and securely with unparalleled insights into their generative AI-driven applications."

Ali Dalloul, VP of AI at Microsoft, also commented, "AI-powered transformation is a key driver of productivity and competitiveness for organisations worldwide. We are pleased to partner with Dynatrace, a leader in AI-powered observability, to empower our shared customers…to create generative AI-based services using Azure Open AI Service and Dynatrace AI Observability."