Application Performance Management for the Big Data Stack

Managing multi-tenant big data clusters is complex. Pepperdata partners with you to deliver predictable performance, empowered users, managed cost, and managed growth with proven big data APM.

VIEW PRODUCTS

Elements of Big Data APM Success

Pepperdata delivers proven big data APM products, operational experience, and deep expertise.

CUSTOMERS

GEOVANIE MARQUEZ, SOFTWARE ARCHITECT

PHILIPS WELLCENTIVE

“Before Pepperdata, we experimented with various approaches to solve our big data performance issues, but we couldn’t see deep enough into our Hadoop cluster. Platform Spotlight shined a bright light into our Hadoop cluster and provided detailed data that helped us isolate and resolve the problem.”

JESSE ESCOBEDO, SENIOR SYSTEMS ENGINEER

RUBICON PROJECT

“At Rubicon Project, having the appropriate visibility and insight into our big data applications is extremely important when delivering detailed reports to our clients and meeting our SLA. We challenged Pepperdata to find a solution to profile our applications before going to production that would help us maintain our SLA to our customers as we introduce new applications. Pepperdata listened to us and quickly understood the problem we were trying to address.”

MICHAEL MCGOWEN, MANAGER OF DATA ENGINEERING

CHARTBOOST

“Chartboost is the world’s largest mobile games-only advertising platform, reaching one billion active players around the world every month. Chartboost utilizes Apache Spark on large Amazon EC2 Hadoop clusters for machine learning and ETL workflows. Understanding Spark application performance in these complex environments is always a challenge. As a current user of Pepperdata Platform Spotlight, it has been great to work with Pepperdata on the development of the Application Spotlight self-service portal software. It will give us a comprehensive insight into Spark jobs.”

DAVID NGUYEN, SENIOR MANAGER OF EDW OPERATIONS ENGINEERING

EXPEDIA

“The level of support and expertise that we receive from the Pepperdata team made a big difference to us. Pepperdata worked closely with us on our Platform Spotlight implementation to ensure success on our big data cluster. With Pepperdata capacity optimization, the DevOps team runs more jobs, faster. We’ve seen a big performance boost across the cluster and have a much more efficient data footprint. Using the Pepperdata dashboard to see application-level metrics, unique custom views, resource utilization per workload drill-downs, and hardware utilization by various workgroups has significantly improved the way that we manage and troubleshoot big data cluster performance issues.”

Our Customers Get Results

See who’s using Pepperdata big data APM solutions to achieve predictable performance, empower users, and to manage cost and growth for their big data investment.

Customers

451 Research Report: Top Ten IT Trends for 2019

Evaluating and purchasing a big data APM solution is complicated. This recent research report by the 451 Group discusses the top ten major trends that will drive the IT industry in 2019.

Request a trial to see firsthand how Pepperdata big data solutions can help you achieve big data performance success. Pepperdata’s proven APM solutions provide a 360° degree view of both your platform and applications, with realtime tuning, recommendations, and alerting. See and understand how Pepperdata big data performance solutions helps you to quickly pinpoint and resolve big data performance bottlenecks. See for yourself why Pepperdata’s big data APM solutions are used to manage performance on over 30K Hadoop production clusters.

Request Trial

Resources

Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

Pepperdata Announces Free Version of Application Spotlight

Pepperdata Application Spotlight Free for Enterprises with a Single Cluster with Up to 20 Nodes

NEW YORK — January 8, 2019 — Pepperdata, the leader in big data Application Performance Management (APM), today announced a free version of Application Spotlight™ for enterprises for use in a single cluster with up to 20 nodes.

Pepperdata Application Spotlight is a self-service APM solution that provides developers with a holistic and real-time view of their applications in the context of the entire big data cluster, allowing them to quickly identify and fix problems (failed Spark applications, for instance) to improve application runtime, predictability, performance and efficiency. Pepperdata Application Spotlight also provides automatic tuning for applications, delivers job-specific recommendations, and enables users to set up alerts on specific behaviors and outcomes to avoid the risk of failure.

“This free offering gives developers a powerful introduction to the robust capabilities of Pepperdata,” said Ash Munshi, Pepperdata CEO. “Application Spotlight gives them self-service access to all the data on their applications in one place so they can determine whether performance issues were caused by their application or other applications running on the cluster.”

With Pepperdata Application Spotlight, developers can:

  • Reduce troubleshooting time by 90% on average to ensure SLAs are met.
  • Reduce runtime – one Pepperdata customer reduced critical job runtime from 3.5 hours to 90 minutes after applying recommendations.
  • Improve productivity by quickly identifying lines of code that cause performance issues.
  • Determine whether performance issues are due to the application or other workloads on the cluster.
  • Safely and confidently move performant applications to production faster.
  • And more.

Availability

Application Spotlight is available immediately for free for use in a single cluster with up to 20 nodes by visiting www.pepperdata.com/free-enterprise-apm.

About Pepperdata
Pepperdata (https://pepperdata.com) is the leader in big data Application Performance Management solutions and services, solving application and infrastructure issues throughout the stack for developers and operations managers. The company partners with its customers to provide proven products, operational experience, and deep expertise to deliver predictable performance, empowered users, managed costs and managed growth for their big data investments, both on-premise and in the cloud. Leading companies like Comcast, Philips Wellcentive and NBC Universal depend on Pepperdata to deliver big data success. Founded in 2012 and headquartered in Cupertino, California, Pepperdata has attracted executive and engineering talent from Yahoo, Google, Microsoft and Netflix. Pepperdata investors include Citi Ventures, Costanoa Ventures, Signia Venture Partners, Silicon Valley Data Capital and Wing Venture Capital, along with leading high-profile individual investors. For more information, visit www.pepperdata.com.

###

Contact:
Samantha Leggat
samantha@pepperdata.com

Pepperdata and the Pepperdata logo are registered trademarks of Pepperdata. Other names may be trademarks of their respective owners.

January 8, 2019
Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

Pepperdata Announces Major Enterprise-Grade Capabilities, Enhanced Usability and Services

Extensive Enterprise Reporting Capabilities for Application Spotlight and Platform Spotlight and Expanded Professional Services Unveiled at Strata Data NYC

NEW YORK — September 11, 2018 (Strata Data New York 2018, Booth 741) — Pepperdata, the leader in Application Performance Management (APM) for big data success, announced enterprise-grade features to its APM suite that include auto-tuning, enhanced recommendations, and management and operational reporting, powered by an easy-to-use self-service interface. The company also announced professional services offerings that include best-practices, performance planning, capacity planning, and architecture design for big data success.

The company’s new professional services are directly enabled by the vast amount of metrics — 600 trillion data points every year — that Pepperdata collects from tens of thousands of nodes every few seconds. This data provides unique insight into all aspects of operationalizing big data applications. Pepperdata is unique in its ability to deliver not only enterprise-grade software, but also expertise, experience and knowledge that ensures big data success.

“Customers are demanding more than features and function from us — they’re asking us to become partners in making sure their big data investments yield business results,” said Ashfaq Munshi, Pepperdata CEO. “We are the only company offering expert services along with a solution delivering instantaneous time-series data that provides precise insight relevant to enterprise platforms and applications.”

Proven Products

The Pepperdata APM suite — comprised of Platform Spotlight and Application Spotlight — enables tight collaboration between developers and operators, improves overall efficiency and performance, and enables enterprises to do more with their existing big data investments.

Platform Spotlight provides infrastructure and capacity managers with:

  • 360° Platform View: Pepperdata continuously collects exhaustive data in real time about clusters, hosts, queues, users, applications and all relevant resources, providing a single source of operational and performance truth across clusters. This breadth of real-time data, which no other tool or product collects and provides, enables enterprises to quickly diagnose performance issues up to 90% faster than without Pepperdata, while making real-time resource decisions based on user priorities and needs.
  • Real-Time Platform Tuning: Pepperdata increases platform throughput up to 50% by leveraging AI-driven resource management to automatically tune cluster resource usage and recapture wasted capacity.
  • Platform Recommendations: Pepperdata provides actionable reporting and recommendations to rightsize containers, queues and other resources so enterprises can achieve optimal application and cluster performance on multi-tenant systems.
  • Platform Alerting: Pepperdata exposes data at sufficient granularity to avoid nuisance alarms and create tailored alerts that pinpoint the root causes of performance issues and operational inefficiencies.
  • 360° Reports: With its vast amount of data that correlates configuration and tuning changes with changes in platform performance, Pepperdata reports allow executives to understand financial impacts of operational decisions across the platform.

Application Spotlight provides developers with:

  • 360° Application View: Pepperdata provides developers with a holistic source of application performance data within the context of the cluster, and enables them to quickly diagnose issues, reduce troubleshooting time, and improve performance.
  • Application Tuning: Pepperdata provides real-time data from applications and cluster resources, which informs developers’ decisions about application configuration and environment considerations for improving runtime performance. Additionally, Pepperdata automatically tunes applications on an ongoing basis to improve runtime or resource utilization.
  • Application Recommendations: Pepperdata automatically delivers job-specific recommendations based on comparing the values of dozens of performance metrics and tuning parameters using industry heuristics, best practices and in-depth knowledge of those metrics and parameters.
  • Application Alerting: In addition to surfacing performance bottlenecks, Pepperdata enables developers to create and receive alerts about events that degrade application performance so they know when an application is at risk of failure.

Operational Experience and Deep Expertise

Pepperdata continuously monitors over 250 production clusters across its customer base — over 30,000 nodes across all Big Data distributions and hardware configurations — for a total 550 million jobs and 600 trillion data points every year. Coupled with its success serving Fortune 100 customers, this uniquely broad set of data empowers Pepperdata to help customers:

  • Establish and follow best practices and effectively set and achieve strategic initiatives.
  • Stay ahead of the competition by providing faster applications and more efficient resource usage.
  • Stay ahead of capacity needs and squeeze the most out of existing capacity.
  • Design a successful architecture using real-world experience derived from some of the world’s biggest clusters.
  • Successfully support developers and operations managers by providing self-service access to data-rich, curated, self-service portals.
  • Pepperdata will be exhibiting at the Strata Data Conference at the Jacob Javits Center (booth 741) in New York City, September 12th and 13th.

Helpful Links

About Pepperdata

Pepperdata is the leader in Application Performance Management solutions and services for big data success, solving application and platform issues throughout the stack for developers as well as capacity and infrastructure managers. The company partners with its customers to provide proven products, operational experience, and deep expertise to deliver predictable performance, empowered users, managed costs and managed growth for their big data investments, both on-premise and in the cloud. Leading companies like Comcast, Philips Wellcentive and NBC Universal depend on Pepperdata to deliver big data success.

Founded in 2012 and headquartered in Cupertino, California, Pepperdata has attracted executive and engineering talent from Yahoo, Google, Microsoft and Netflix. Pepperdata investors include Costanoa Ventures, Signia Venture Partners, Silicon Valley Data Capital and Wing Venture Capital, along with leading high-profile individual investors. For more information, visit www.pepperdata.com.

###

Contact:
Samantha Leggat
samantha@pepperdata.com

Pepperdata and the Pepperdata logo are registered trademarks of Pepperdata, Inc. Other names may be trademarks of their respective owners.

September 11, 2018
Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

Pepperdata Announces Executive Appointments and the Close of Recent 
Funding Round

Pepperdata Anticipates Doubling Team Within a Year to Support Increase in Seven-Figure Sales Deals

CUPERTINO, Calif. — September 4, 2018 — Pepperdata, the leader in Application Performance Management (APM) for big data success, announced the appointment of two executives reporting to CEO Ash Munshi. The appointments include Charles Marker as Vice President of Engineering and Dan Marx as Vice President of Sales. This announcement comes on the heels of the company’s latest funding, which Pepperdata will allocate to hiring and product development as it continues to deliver on feature requests from customers to support their mission-critical big data deployments.

Charles Marker joins Pepperdata as VP of Engineering from his previous position as Global Head of Engineering at Guidewire Software. Prior to Guidewire, Mr. Marker held Engineering VP positions at Kontagent, Yahoo, Qualcomm and Atheros. Dan Marx, who has been with Pepperdata since 2014, has been named VP of Sales. Mr. Marx brings deep expertise and experience in enterprise sales, including extensive success in big data technology sales at WANdisco and Zettaset.

“We are excited about the contagious enthusiasm and deep expertise Charles and Dan bring to Pepperdata,” said Mr. Munshi, Pepperdata CEO. “As we close more and more seven-figure deals, we are pleased to have the funding necessary to make appointments like these, and we will continue expanding to support the tremendous growth we’re experiencing. We anticipate more than doubling our team within a year.”

“Pepperdata is the leader in Application Performance Management for big data, delivering scalable solutions that enable Fortune 100 companies to achieve successful outcomes from their investments. We continue to be impressed with Pepperdata’s ability to facilitate adoption by these leading companies by identifying use cases that benefit from APM. We are pleased to work with them as they continue to execute their strategy,” said Jim McLean, Managing Director at Silicon Valley Data Capital.

“We were impressed to see the world’s biggest and best AI-driven companies already using Pepperdata so their Hadoop and Spark clusters perform at scale. Pepperdata helps ensure these global brands in e-commerce, voice applications and consumer banking optimize both the productivity and performance of their big data practices. Their continued team and company growth is exciting,” said Greg Sands, Managing Partner at Costanoa Ventures.

Since its founding in 2012, Pepperdata has established itself as a leader in APM for big data success, delivering proven products, operational experience, and deep expertise for its customers. Pepperdata is deployed at Fortune 100 companies in financial services, retail, healthcare, telecommunications and more, totaling more than 250 production clusters with 30,000 nodes spanning all big data distributions and hardware configurations. With the level of data the company collects — over 550 million jobs and 600 trillion data points annually — and its extensive global enterprise experience, Pepperdata is the wise choice for companies looking to get more value and optimal performance from their big data investments.

Pepperdata will be exhibiting at the Strata Data Conference at the Jacob Javits Center (booth 741) in New York City, September 12th and 13th.

Helpful Links

About Pepperdata

Pepperdata is the leader in Application Performance Management solutions and services for big data success, solving application and platform issues throughout the stack for developers as well as capacity and infrastructure managers. The company partners with its customers to provide proven products, operational experience, and deep expertise to deliver predictable performance, empowered users, managed costs and managed growth for their big data investments, both on-premise and in the cloud. Leading companies like Comcast, Philips Wellcentive and NBC Universal depend on Pepperdata to deliver big data success.

Founded in 2012 and headquartered in Cupertino, California, Pepperdata has attracted executive and engineering talent from Yahoo, Google, Microsoft and Netflix. Pepperdata investors include Costanoa Ventures, Signia Venture Partners, Silicon Valley Data Capital and Wing Venture Capital, along with leading high-profile individual investors. For more information, visit www.pepperdata.com.

###

Contact:

Samantha Leggat

samantha@pepperdata.com

Pepperdata and the Pepperdata logo are registered trademarks of Pepperdata, Inc. Other names may be trademarks of their respective owners.

September 4, 2018
Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

Eight ROI Benefits of APM (Part 3)

For enterprises leveraging big data to stay competitive, Application Performance Management (APM) is crucial. An effective APM solution maintains expected levels of application services by detecting, identifying and diagnosing complex application performance problems. But APM solutions can only deliver a return on investment (ROI) if used to their full potential.

The following are 8 ROI elements to consider when evaluating APM solutions.

  1. Increasing Developer Productivity
  2. Reducing Downtime, Improving Business Continuity
  3. Delivering Performance as a Feature
  4. Preventing Application Problems
  5. Reducing Infrastructure and Hosting Costs
  6. Meeting SLA Requirements
  7. Discovering and Resolving Issues Faster with AI and Analytics
  8. Unwavering Focus on Your Applications

We highlighted the first six benefits APM delivers for ROI previously In previous blogs (part 1 and part 2). Today, we’ll finish up by highlighting the last two.

7. Discovering and Resolving Issues Faster with AI and Analytics

In today’s increasingly complex technological environment, pinpointing the root cause of an outage or slowdown is like looking for a needle in a haystack, while revenue during the search takes a hit. If you don’t have all the necessary data, it’s impossible to identify exactly where the problem is. A modern APM platform can accelerate the search by zeroing in on the problem quickly, using data captured from the infrastructure as well as all of the applications running on it. Not all APM solutions provide both types of data.

Pepperdata takes a holistic approach by looking at your applications and how they interact within the context of your big data infrastructure. Then we provide you with a real-time view of your cluster and provide context-aware recommendations to optimize your applications and infrastructure. This unified approach to big data performance management reduces MTTR. Pepperdata offers the most flexible, powerful, and rigorous set of performance metrics in the industry to speed up troubleshooting and improve uptime.

8. Unwavering Focus on Your Applications

Remember: To your internal and external customers, the only performance that matters is the performance of the application they’re using. It’s where the rubber meets the road. This customer-centric mindset is baked into Pepperdata’s DNA.

Pepperdata offers a broadly deployable unified performance management solution that eliminates guesswork. By instrumenting all of the nodes on your infrastructure, Pepperdata provides you with visibility into how the infrastructure and applications are performing so you can enhance customer satisfaction. With the data Pepperdata collects, unique data that enables you to quickly diagnose application performance issues up to 90% faster, you get a 360° single pane of glass view of your environment with customer-centric performance insight on both.

Fine-tune your big data applications by understanding exactly what CPU and memory resources it requested, what it needs, what it used, and what it wasted. Identify the impact queue congestion, hardware bottlenecks and failures have on your big data application performance. Leverage all eight ROI benefits with Pepperdata.

Learn more

February 12, 2019
Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

Eight ROI Benefits of APM (Part 2)

There’s no doubt that APM is an essential part of the IT toolbox. By detecting and diagnosing complex infrastructure issues and translating metrics into valuable insights, APM solutions improve MTTR, inform product development and customer service, and bolster the bottom line. In part 1, we identified eight ROI benefits of APM:

  1. Increasing Developer Productivity
  2. Reducing Downtime, Improving Business Continuity
  3. Delivering Performance as a Feature
  4. Preventing Application Problems
  5. Reducing Infrastructure and Hosting Costs
  6. Meeting SLA Requirements
  7. Discovering and Resolving Issues Faster with AI and Analytics
  8. Unwavering Focus on Your Applications

We highlighted the first few financial and non-financial benefits APM delivers for ROI last week, and today, we’ll highlight benefits 4-6.

4. Preventing Application Problems

The challenge is to discover application problems during development or QA to limit time and costs associated with fixing them. According to the Systems Sciences Institute at IBM (emphasis my own), “the cost to fix an error found after product release was four to five times as much as one uncovered during design, and up to 100 times more than one identified in the maintenance phase.”  In addition to added costs, catching errors late multiplies issues since bugs can have a cascading effect, overwhelming support teams and damaging reputations.

Pepperdata automatically tunes repetitive applications for resource efficiency and continues to make improvements on an ongoing basis to improve runtime. With real-time data from applications and cluster resources, developers can make accurate decisions about application configuration to prevent problems and improve performance.

5. Reducing Infrastructure and Hosting Costs

IT organizations today are tasked with managing growth and costs carefully, optimizing existing resources and buying only when needed. Developers and operators must align to reduce costs through optimization.

Pepperdata Capacity Optimizer leverages active resource management features in Hadoop to dynamically tune cluster resources and eliminate inefficiencies.


With Capacity Optimizer, travel services leader Expedia increases capacity utilization by 30-50 percent without adding hardware, saving thousands of dollars and increasing cluster productivity.

6. Meeting Service Level Agreement (SLA) Requirements

SLA breaches can negatively impact sales, support, reputation and renewals. Critical operational environments that have near-zero tolerance for downtime, like healthcare, understandably have aggressive SLAs, and there are serious penalties if they’re breached Platform Spotlight enables operators to manage and troubleshoot performance issues to ensure these stringent SLA requirements are achieved.

To overcome performance issues and the risk of breached SLA related to processing over three billion medical records daily, Philips Wellcentive deployed Pepperdata Platform Spotlight and Capacity Optimizer to automatically improve capacity utilization. The result was increased throughput, which meant jobs completed on time and SLAs were met.

With benefits for both application development and infrastructure teams, Pepperdata provides organizations with an integrated “single-pane-of-glass” that correlates application and infrastructure performance and delivers operational efficiencies that multiple, disparate tools cannot.

In the final part of this blog series, we’ll cover the last two of the eight benefits mentioned earlier.

Learn more:

 

February 5, 2019
Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

Eight ROI Benefits of APM (Part 1)

Application performance management (APM) is an essential element of operations and business success. The goal of APM is to detect and diagnose complex issues and translate performance metrics into valuable insights in order to meet service levels by improving mean time to repair (MTTR), customer relations/service and business outcomes. It’s a mouthful but very important to understand.

When used to its full potential, APM provides both financial and non-financial benefits for a significant – and often glaringly obvious – return on investment (ROI). Financial benefits include cost reductions or revenue increases, while non-financial benefits include things like improved customer satisfaction, better stickiness, and shorter cycle time. Both financial and non-financial benefits must be taken into account to fully assess the value of any technology solution, and APM is no different.

There are numerous benefits of an effective APM solution, including:

  1. Increasing Developer Productivity
  2. Reducing Downtime, Improving Business Continuity
  3. Delivering Performance as a Feature
  4. Preventing Application Problems
  5. Reducing Infrastructure and Hosting Costs
  6. Meeting SLA Requirements
  7. Discovering and Resolving Issues Faster with AI and Analytics
  8. Unwavering Focus on Your Applications

Let’s look at a few of them in detail.

1. Increasing Developer Productivity

Developers usually have only a limited understanding of how new features or releases perform. In addition, all too frequently, bottlenecks occur during development and testing, which cripples infrastructure performance. It’s important that expensive and highly sought after software developers spend their time on innovation to grow the business, as opposed to solving difficult and complex  performance problems..

With our extensive collection of real-time hardware and application metrics, Pepperdata Application Spotlight enables developers to quickly identify and resolve performance problems to maximize productivity. With Pepperdata, they can also create custom alerts to quickly identify potential issues and pinpoint the root cause of a problem, easily saving them a few hours a month and paying for itself very quickly.

2. Reducing Downtime, Improving Business Continuity

When a website is down, business is lost. Period. Internet users are finicky and impatient, and when faced with a 404 (Page Not Found) error, usually seek to buy elsewhere, including from your competition.  If a pizza delivery site goes down or responds slowly, there are countless options for ordering a pie. Compared to a $15 pie, consider the scale and impact on revenue for an airline, hotel chain, or travel site.

Proactive application monitoring with Pepperdata Platform Spotlight helps raise the flag on symptoms before they become problems, from finding sluggish queries to identifying high volume requests that should be optimized. Being able to quickly identify the root cause of a problem can drastically reduce the mean time to repair (MTTR) for disabled online sites.

3. Delivering Performance as a Feature

Remember that performance is also an application feature, capable of driving higher sentiment for and stickiness to your product. While hard to quantify, performance is key to customer conversion and retention. Reduced cycle time means faster data processing and faster results for stakeholders. Ad targeting is a perfect example of an app that benefits from (and in fact, must have) high-performance software.

To ensure application performance, Pepperdata increases platform throughput up to 50% by leveraging AI-driven resource management to tune cluster resources and recapture wasted capacity. For example, Chartboost, which provides mobile game developers with an ad marketplace, was faced with explosive data growth in their cluster. By leveraging Capacity Optimizer, Chartboost significantly improved cluster throughput and performance and therefore lowered their total AWS spend by more than 30 percent.

The bottom line is that Pepperdata offers unified performance management solution that delivers benefits for both application development and infrastructure teams. With Pepperdata, organizations get an integrated “single-pane-of-glass” that correlates application and infrastructure performance and delivers operational efficiencies that multiple, disparate tools cannot.

In future blog posts, we’ll cover the other APM benefits mentioned above.

Learn more

Read the blog post, The Relentless Growth of Big Data and the Challenge to APM and Developers

January 29, 2019