Total Performance Management – A Holistic View of Application and Platform Big Data Performance

Posted by:

Total Performance Management has two components:

  • Application performance management (APM)
  • Operations performance management (OPM)

The reason why those two components application and platform need to be thought about together is because your application is a distributed application it relies on what your platform is able to do as well. Those two components are interlinked. With classic APM, you didn’t need to worry about the fact that you have other things are running on this application or that the number of resources being used is massive. If you miscalculate the resources, you mess up the platform, and it costs a lot of money.

You have to look at the problem holistically. You can’t just look at your application. You must look at your application and also, you have to look at what it does to this shared resource, your cluster. The application and the platform have to be combined in order for you to understand performance. And that’s basically what we do – we look at both the application and platform and how they interact with each other to provide a holistic view of what is happening on the application and the platform. And you receive notifications, alerts, and useful recommendations or resource usage and tuning. And in this way, Pepperdata performance management solutions improve collaboration between operations and development teams because the combination of APM and OPM is presented cohesively in a single pane of glass so that both operators and developers receive the same information and it is interpreted in one way. The data exhaust informing all of the decisions being made is exactly the same from one unified system.

For developers to get the maximum performance out of their applications, this holistic view of everything that is going on is key. Without this holistic view, they cannot accomplish the business critically important things like meeting SLAs and meeting business requirements. The alternative, and the way that many are doing this today is they are receiving information from several different applications to get a piece of the puzzle, stitch all of the pieces together, and use their experience to make sense of how they all interact and how to manage it. And it’s a mess.

One of the common experiences that our customers share is that before using Pepperdata, they never got all of the information that would help them resolve an issue–they would only get small pieces of the information. While this information might help them understand the problem better, it wasn’t enough information to understand the issue and solve the problem.

This holistic view of application and platform for big data performance is how Pepperdata brings total performance management to big data.   

For developers, the Application Spotlight self-service application performance management (APM) portal makes it easy to get recommendations and insights into how to optimize applications and the root cause of bottlenecks and failures.

For operators, Cluster Analyzer makes it easy to identify applications and users causing issues on the platform, proactively alert on those issues, and improve cluster performance. We  also have roll up reports for things like chargeback and capacity planning. The Capacity Optimizer add-on module automatically increases cluster throughput 30-50% by addressing some of the inefficiencies of how YARN does resource management today.

This week, Pepperdata will be demonstrating, speaking, exhibiting (Booth #831) at Strata Big Data Conference in San Jose. Please come and ask us about our total performance management product solutions.