Get a 360° View of Your Applications, Infrastructure, and Resource Utilization
Pepperdata Platform Spotlight gives you an in-depth view of your applications, infrastructure, and resource utilization in any cloud and on premises. It also provides recommendations and custom alerts, so you can rapidly make resource decisions and diagnose performance issues. Pepperdata cluster performance monitoring includes real-time and historical information covering system demand, abusive users, and wasteful applications. Pepperdata Platform Spotlight allows you to:
- Monitor supported technologies and frameworks including Kafka, Impala, HBase, Hive, MapReduce, Tez, Spark, IBM BigSQL, LLAP, Amazon EMR, and Google Dataproc.
- Identify big data application slowdowns cause by disk, network, or node failures/congestion.
- Attribute costs to cluster users and business units for IT chargeback.
Get Recommendations to Optimize Workloads
Big data operators need to configure and size critical resources running on big data environments, but it’s hard to get an accurate view without access to the right data. It’s even harder when operating in complex cloud settings. To make this easier, Pepperdata provides actionable reporting, insights, and recommendations to rightsize containers, queues, and other resources. Platform Spotlight continuously collects extensive unique data about your hosts, queues, users, applications, and all relevant resources, providing you with insights to quickly diagnose performance issues and make resource decisions. Pepperdata Platform Spotlight allows you to:
- Size big data queues appropriately based on criticality.
- Get self-service recommendations on container sizes and heap reservations.
- Identify growth trends and accurately forecast resource needs.
Store Your Data More Efficiently with HDFS Data Temperature
Right now, you probably don’t know the exact age of every file you have stored in HDFS. Which files should be archived? Which files need to be moved to SSDs based on how frequently (or infrequently) they are accessed? With Pepperdata, you can access a summarized view of policy definitions and roll-up metrics on the state of HDFS, including the total number of files and where they fall within the policy spectrum.
Pepperdata provides you with a cold file breakdown that details each policy’s coverage and each file’s state relative to the governing policies. The breakdown includes the exact file names and sizes for each temperature. The Pepperdata Data Temperature report allows you to:
- See which files are out of policy and get a comprehensive view of how much movement is required to adhere policy.
- Get the age and size of your HDFS data files.
- Access exact file names for each temperature.
- See which files don’t match their current policy based on access times.
Receive Alerts on Platform Health and Performance
Create and receive alerts that identify root causes of performance issues and operational inefficiencies. Customize alerts for events that interfere with performance. Identify resource contention and get ahead of issues before they become critical. Pepperdata Platform Spotlight allows you to:
- Track any resource, including CPU, memory, and IO to alert on rogue users.
- Use data on activity to alert on rogue applications and identify which applications will miss SLAs.
- Identify under-performing or failing hardware.
Monitor Big Data Application Performance and Run More Efficiently on Amazon EMR
Automatically optimize your big data infrastructure and deliver superior application performance in the cloud with Pepperdata Cloud for Amazon EMR. Platform Spotlight is available on AWS Marketplace as part of Pepperdata Cloud.
In addition to optimizing application performance, get full-stack observability, automated tuning with managed autoscaling, and real-time insights across all of your EMR instances—all in one place. Pepperdata Cloud for Amazon EMR allows you to:
- Get full-stack observability, automated tuning, and job-specific recommendations for Spark and MapReduce.
- Use managed autoscaling to automatically optimize node performance and prevent waste by applications.
- Customize alerts to quickly understand and troubleshoot application and infrastructure issues.
Benefits for Your Team
Operation Teams
- Understand why jobs are running slowly.
- Compare jobs run over time.
- Understand the performance of each job phase.
Application teams
- Automatically identify bottlenecks and alert on duration, failure conditions, and resource usage.
- Highlight applications that need attention.
Business Teams
- Report on capacity trends
- Get accurate chargeback reporting.
- Increase productivity.
Take a Free Thirty-Day Trial to See What Big Data Success Looks Like
Pepperdata products provide complete visibility and automation for your big data environment. Get the observability, automated tuning, recommendations, and alerting you need to efficiently and autonomously optimize big data environments at scale.