The Big Data Performance Company

Managing multi-tenant big data clusters is complex. Pepperdata partners with you to deliver the following for your big data investments:

  • Predictable performance
  • Empowered users
  • Managed cost
  • Managed growth

View Product

Elements of Big Data Success

Pepperdata delivers proven products, operational experience, and deep expertise.

CUSTOMERS

GEOVANIE MARQUEZ, SOFTWARE ARCHITECT

PHILIPS WELLCENTIVE

“Before Pepperdata, we experimented with various approaches to solve our performance issues, but we couldn’t see deep enough into the cluster. Pepperdata Platform Spotlight shined a bright light into our Hadoop environment and provided the detailed data that helped us isolate and resolve the problem.”

JESSE ESCOBEDO, SENIOR SYSTEMS ENGINEER

RUBICON PROJECT

“At Rubicon Project, having the appropriate visibility and insight into our Big Data applications is extremely important when delivering detailed reports to our clients and meeting our SLA. We challenged Pepperdata to find a solution to profile our applications before going to production that would help us maintain our SLA to our customers as we introduce new applications. Pepperdata listened to us and quickly understood the problem we were trying to address.”

MICHAEL MCGOWEN, MANAGER OF DATA ENGINEERING

CHARTBOOST

“Chartboost is the world’s largest mobile games-only advertising platform, reaching one billion active players around the world every month. Chartboost utilizes Apache Spark on large Amazon EC2 Hadoop clusters for machine learning and ETL workflows. Understanding Spark application performance in these complex environments is always a challenge. As a current user of Pepperdata Platform Spotlight, it has been great to work with Pepperdata on the development of the Application Spotlight self-service portal software. It will give us a comprehensive insight into Spark jobs.”

DAVID NGUYEN, SENIOR MANAGER OF EDW OPERATIONS ENGINEERING

EXPEDIA

“The level of support and expertise that we receive from the Pepperdata team made a big difference to us. Pepperdata worked closely with us on our Cluster Analyzer implementation to ensure success. With Pepperdata Capacity Optimizer, the DevOps team runs more jobs, faster. We’ve seen a big performance boost across the cluster and have a much more efficient data footprint. Using the Pepperdata dashboard to see application-level metrics, unique custom views, resource utilization per workload drill-downs, and hardware utilization by various workgroups has significantly improved the way that we manage and troubleshoot.”

Our Customers Get Results

See who’s using Pepperdata Big Data performance solutions to achieve Big Data success.

Customers

Pepperdata Big Data Success and Solutions Overview

Evaluating and purchasing a big data performance solutions can be complicated. We’ve made it easy to make sure you don’t miss anything with our Pepperdata Product and Solutions Guide.

See firsthand how Pepperdata solutions bring APM to every phase of the big data DevOps cycle with solutions for monitoring, tuning, troubleshooting, and improving collaboration between teams.

Schedule a demo today!

Schedule A Demo

Resources

Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

Pepperdata Announces Major Enterprise-Grade Capabilities, Enhanced Usability and Services

Extensive Enterprise Reporting Capabilities for Application Spotlight and Platform Spotlight and Expanded Professional Services Unveiled at Strata Data NYC

NEW YORK — September 11, 2018 (Strata Data New York 2018, Booth 741) — Pepperdata, the leader in Application Performance Management (APM) for big data success, announced enterprise-grade features to its APM suite that include auto-tuning, enhanced recommendations, and management and operational reporting, powered by an easy-to-use self-service interface. The company also announced professional services offerings that include best-practices, performance planning, capacity planning, and architecture design for big data success.

The company’s new professional services are directly enabled by the vast amount of metrics — 600 trillion data points every year — that Pepperdata collects from tens of thousands of nodes every few seconds. This data provides unique insight into all aspects of operationalizing big data applications. Pepperdata is unique in its ability to deliver not only enterprise-grade software, but also expertise, experience and knowledge that ensures big data success.

“Customers are demanding more than features and function from us — they’re asking us to become partners in making sure their big data investments yield business results,” said Ashfaq Munshi, Pepperdata CEO. “We are the only company offering expert services along with a solution delivering instantaneous time-series data that provides precise insight relevant to enterprise platforms and applications.”

Proven Products

The Pepperdata APM suite — comprised of Platform Spotlight and Application Spotlight — enables tight collaboration between developers and operators, improves overall efficiency and performance, and enables enterprises to do more with their existing big data investments.

Platform Spotlight provides infrastructure and capacity managers with:

  • 360° Platform View: Pepperdata continuously collects exhaustive data in real time about clusters, hosts, queues, users, applications and all relevant resources, providing a single source of operational and performance truth across clusters. This breadth of real-time data, which no other tool or product collects and provides, enables enterprises to quickly diagnose performance issues up to 90% faster than without Pepperdata, while making real-time resource decisions based on user priorities and needs.
  • Real-Time Platform Tuning: Pepperdata increases platform throughput up to 50% by leveraging AI-driven resource management to automatically tune cluster resource usage and recapture wasted capacity.
  • Platform Recommendations: Pepperdata provides actionable reporting and recommendations to rightsize containers, queues and other resources so enterprises can achieve optimal application and cluster performance on multi-tenant systems.
  • Platform Alerting: Pepperdata exposes data at sufficient granularity to avoid nuisance alarms and create tailored alerts that pinpoint the root causes of performance issues and operational inefficiencies.
  • 360° Reports: With its vast amount of data that correlates configuration and tuning changes with changes in platform performance, Pepperdata reports allow executives to understand financial impacts of operational decisions across the platform.

Application Spotlight provides developers with:

  • 360° Application View: Pepperdata provides developers with a holistic source of application performance data within the context of the cluster, and enables them to quickly diagnose issues, reduce troubleshooting time, and improve performance.
  • Application Tuning: Pepperdata provides real-time data from applications and cluster resources, which informs developers’ decisions about application configuration and environment considerations for improving runtime performance. Additionally, Pepperdata automatically tunes applications on an ongoing basis to improve runtime or resource utilization.
  • Application Recommendations: Pepperdata automatically delivers job-specific recommendations based on comparing the values of dozens of performance metrics and tuning parameters using industry heuristics, best practices and in-depth knowledge of those metrics and parameters.
  • Application Alerting: In addition to surfacing performance bottlenecks, Pepperdata enables developers to create and receive alerts about events that degrade application performance so they know when an application is at risk of failure.

Operational Experience and Deep Expertise

Pepperdata continuously monitors over 250 production clusters across its customer base — over 30,000 nodes across all Big Data distributions and hardware configurations — for a total 550 million jobs and 600 trillion data points every year. Coupled with its success serving Fortune 100 customers, this uniquely broad set of data empowers Pepperdata to help customers:

  • Establish and follow best practices and effectively set and achieve strategic initiatives.
  • Stay ahead of the competition by providing faster applications and more efficient resource usage.
  • Stay ahead of capacity needs and squeeze the most out of existing capacity.
  • Design a successful architecture using real-world experience derived from some of the world’s biggest clusters.
  • Successfully support developers and operations managers by providing self-service access to data-rich, curated, self-service portals.
  • Pepperdata will be exhibiting at the Strata Data Conference at the Jacob Javits Center (booth 741) in New York City, September 12th and 13th.

Helpful Links

About Pepperdata

Pepperdata is the leader in Application Performance Management solutions and services for big data success, solving application and platform issues throughout the stack for developers as well as capacity and infrastructure managers. The company partners with its customers to provide proven products, operational experience, and deep expertise to deliver predictable performance, empowered users, managed costs and managed growth for their big data investments, both on-premise and in the cloud. Leading companies like Comcast, Philips Wellcentive and NBC Universal depend on Pepperdata to deliver big data success.

Founded in 2012 and headquartered in Cupertino, California, Pepperdata has attracted executive and engineering talent from Yahoo, Google, Microsoft and Netflix. Pepperdata investors include Costanoa Ventures, Signia Venture Partners, Silicon Valley Data Capital and Wing Venture Capital, along with leading high-profile individual investors. For more information, visit www.pepperdata.com.

###

Contact:
Samantha Leggat
samantha@pepperdata.com

Pepperdata and the Pepperdata logo are registered trademarks of Pepperdata, Inc. Other names may be trademarks of their respective owners.

September 11, 2018
Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

Pepperdata Announces Executive Appointments and the Close of Recent 
Funding Round

Pepperdata Anticipates Doubling Team Within a Year to Support Increase in Seven-Figure Sales Deals

CUPERTINO, Calif. — September 4, 2018 — Pepperdata, the leader in Application Performance Management (APM) for big data success, announced the appointment of two executives reporting to CEO Ash Munshi. The appointments include Charles Marker as Vice President of Engineering and Dan Marx as Vice President of Sales. This announcement comes on the heels of the company’s latest funding, which Pepperdata will allocate to hiring and product development as it continues to deliver on feature requests from customers to support their mission-critical big data deployments.

Charles Marker joins Pepperdata as VP of Engineering from his previous position as Global Head of Engineering at Guidewire Software. Prior to Guidewire, Mr. Marker held Engineering VP positions at Kontagent, Yahoo, Qualcomm and Atheros. Dan Marx, who has been with Pepperdata since 2014, has been named VP of Sales. Mr. Marx brings deep expertise and experience in enterprise sales, including extensive success in big data technology sales at WANdisco and Zettaset.

“We are excited about the contagious enthusiasm and deep expertise Charles and Dan bring to Pepperdata,” said Mr. Munshi, Pepperdata CEO. “As we close more and more seven-figure deals, we are pleased to have the funding necessary to make appointments like these, and we will continue expanding to support the tremendous growth we’re experiencing. We anticipate more than doubling our team within a year.”

“Pepperdata is the leader in Application Performance Management for big data, delivering scalable solutions that enable Fortune 100 companies to achieve successful outcomes from their investments. We continue to be impressed with Pepperdata’s ability to facilitate adoption by these leading companies by identifying use cases that benefit from APM. We are pleased to work with them as they continue to execute their strategy,” said Jim McLean, Managing Director at Silicon Valley Data Capital.

“We were impressed to see the world’s biggest and best AI-driven companies already using Pepperdata so their Hadoop and Spark clusters perform at scale. Pepperdata helps ensure these global brands in e-commerce, voice applications and consumer banking optimize both the productivity and performance of their big data practices. Their continued team and company growth is exciting,” said Greg Sands, Managing Partner at Costanoa Ventures.

Since its founding in 2012, Pepperdata has established itself as a leader in APM for big data success, delivering proven products, operational experience, and deep expertise for its customers. Pepperdata is deployed at Fortune 100 companies in financial services, retail, healthcare, telecommunications and more, totaling more than 250 production clusters with 30,000 nodes spanning all big data distributions and hardware configurations. With the level of data the company collects — over 550 million jobs and 600 trillion data points annually — and its extensive global enterprise experience, Pepperdata is the wise choice for companies looking to get more value and optimal performance from their big data investments.

Pepperdata will be exhibiting at the Strata Data Conference at the Jacob Javits Center (booth 741) in New York City, September 12th and 13th.

Helpful Links

About Pepperdata

Pepperdata is the leader in Application Performance Management solutions and services for big data success, solving application and platform issues throughout the stack for developers as well as capacity and infrastructure managers. The company partners with its customers to provide proven products, operational experience, and deep expertise to deliver predictable performance, empowered users, managed costs and managed growth for their big data investments, both on-premise and in the cloud. Leading companies like Comcast, Philips Wellcentive and NBC Universal depend on Pepperdata to deliver big data success.

Founded in 2012 and headquartered in Cupertino, California, Pepperdata has attracted executive and engineering talent from Yahoo, Google, Microsoft and Netflix. Pepperdata investors include Costanoa Ventures, Signia Venture Partners, Silicon Valley Data Capital and Wing Venture Capital, along with leading high-profile individual investors. For more information, visit www.pepperdata.com.

###

Contact:

Samantha Leggat

samantha@pepperdata.com

Pepperdata and the Pepperdata logo are registered trademarks of Pepperdata, Inc. Other names may be trademarks of their respective owners.

September 4, 2018
Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

Pepperdata Announces Application Spotlight–New Self-Service APM Portal

CUPERTINO, Calif.March 1, 2018Pepperdata, the Big Data Performance company that provides developer and operator solutions to optimize application and cluster performance in Big Data environments, announces Application Spotlight. This self-service portal enables Big Data application developers to generate application-specific recommendations to improve application performance, highlight applications that need attention, automatically identify bottlenecks, and alert on duration, failure conditions, and resource usage.

Application Spotlight helps developers to search for all applications running on the cluster or just the specific applications that they are interested in, compare current and previous runs, and visualize Spark applications and its stages for easy root cause failure analysis and performance tuning.

“Application Spotlight provides relevant application information, insights, and calls to action, all in one place, so that developers can easily and quickly perform these tasks,” said Ash Munshi, CEO of Pepperdata. “In addition to helping developers make jobs go faster, Application Spotlight enables them to be better tenants in multi-tenant clusters by showing them how to write optimal jobs and more efficiently use their queue and cluster resources with practical, innovative application performance management solutions. Application Spotlight enables developers to quickly understand performance impacts and get recommendations on how to better optimize their jobs.”

Big Data Performance Solutions for Both Developers and Operators

The Pepperdata product suite provides solutions for monitoring, tuning, troubleshooting, applications and clusters along with automated cluster optimization. Pepperdata allows enterprises to:

  • Reduce time-to-problem resolution using comprehensive and detailed performance data, allowing developers and operators to troubleshoot performance problems 10x faster.
  • Provide developers with solutions that help them identify and fix application performance problems caused by excessive usage of resources and application errors
  • Automatically increase cluster capacity utilization by 30 percent to 50 percent without adding hardware.

Pepperdata products improve collaboration between development and operations teams by providing both an application as well as cluster view of performance. Pepperdata products, are used to monitor and manage mixed workloads from frameworks such as Spark, MapReduce, Kafka, Tez, Solr, and Impala.

See a Demo of Application Spotlight at Strata San Jose

Pepperdata is sponsoring, speaking, and exhibiting at Strata Strata Data Conference on March 6–8 at the San Jose Convention Center. Please visit Pepperdata Booth to discuss your requirements and see a demonstration of Pepperdata Application Spotlight. For information about our Strata schedule, go to www.pepperdata/events.

Helpful Links

About Pepperdata

Pepperdata is the big data performance company. Leading companies such as Comcast, Philips Wellcentive, and NBC Universal depend on Pepperdata to manage and improve the performance of Hadoop and Spark. Enterprise customers use Pepperdata products and services to troubleshoot performance problems in production, increase cluster utilization, and enforce policies to support multi-tenancy. Pepperdata products and services work with customer Big Data systems both on-premise and in the cloud.

Founded in 2012, Pepperdata has raised $20M from investors including Citi Ventures, Signia Venture Partners and Wing Venture Capital, and attracted senior engineering talent from Yahoo, Google, Microsoft and Netflix. Pepperdata is headquartered in Cupertino, California. For more information, visit pepperdata.com.

###

Pepperdata and the Pepperdata logo are registered trademarks of Pepperdata, Inc. Other names may be trademarks of their respective owners.

Media Contact

Jim Dvorak
Offleash for Pepperdata
(415) 735-1622
pepperdata@offleashpr.com

March 1, 2018
Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

The Five Real Benefits of Effective APM

When you start to consider Application Performance Management (APM) solutions, you have specific pain points or challenges that you need to overcome. Don’t forget about those initial challenges as you go through the steps of assessing solutions. Developers want their apps to work faster, but why? Capacity managers want to alleviate bottlenecks and optimize their existing infrastructure resources, but why? Let’s look at some of the real benefits to the business, factors that will help your management team understand the bottom line need for a big data APM solution — and ultimately agree to the spend.

Revenue Impact.

This is the biggest, most obvious business benefit to any infrastructure monitoring solution, and one that every line of business leader understands. The availability and performance of critical applications — booking, ecommerce, service and communications platforms — can have significant impact on revenue. To meet SLAs, infrastructure managers need to mitigate outages that can result in lost revenue and customers. When evaluating APM solutions, make sure that you choose a solution that provides all the features you need to maintain expected levels of availability, ensure efficient troubleshooting, and accurately plan for growth.

  • Maintaining available and performant clusters requires an understanding of dozens of performance metrics and tuning parameters. Pepperdata continuously collects extensive unique data—that nobody else collects—about your hosts, queues, users, applications and all relevant resources, providing you with a 360° view that enables you to quickly diagnose revenue-impacting performance issues and make resource decisions based on user priorities and needs.

End User Satisfaction.

It’s difficult to know if you’re satisfying end users or customers because they may never tell you — they just go away. External users (customers) give up and go to your competition, and internal users go around you, eliminating your control. An effective APM solution provides the deep visibility and performance insight you need to ensure productivity and satisfaction, keeping users happy so they don’t go away.

  • To continually ensure user satisfaction, Pepperdata generates targeted recommendations to improve application performance, highlights applications that require attention, automatically identifies bottlenecks, and alerts on duration (missed SLAs), failure conditions, and resource usage.

Higher Productivity.

A highly performant infrastructure directly correlates to improved developer and IT staff productivity. An effective APM solution provides you with all the necessary data to make infrastructure changes that are necessary to help IT staff support more developers. Recommendations and alerts enable you to adjust configuration settings before these users are negatively impacted. Everyone is simply more productive when the infrastructure is finely tuned and running well.

  • With its vast collection of real-time metrics, Pepperdata allows you to create custom alerts and queries and filter and compare by different dimensions (application name, queue, host name etc.) to quickly identify which app is causing a problem so you can meet end user needs and improve developer productivity.

Reduced Operational Costs.

The right APM solution enables you to continuously tune the infrastructure to meet business needs by minimizing the risk of poor performance and identifying inefficiencies that would otherwise increase costs. In addition to problem prevention, effective APM helps you more accurately plan for growth and avoid overspending.

  • Pepperdata enables you to Increase capacity utilization by 30-50% without adding hardware. Pepperdata also generates comprehensive planning reports containing real-time and historical data about the cluster so you can plan capacity for predictable performance. Use these reports to identify wasteful system resource usage to attribute accurate costs to users and business units.

Innovation.

When applications and the platform are running well, there are fewer fire drills which frees up time to spend on delivering new innovations that support business growth. Your APM solution should drive collaboration, which results in faster problem resolution and increased confidence in application and feature rollouts.

  • Pepperdata gives developers the tools they need to build and deploy high performance applications, and it gives capacity and infrastructure managers the tools they need to manage those applications and the platform, fostering effective communication and tight collaboration.

Pepperdata – APM for Big Data Success

Managing multi-tenant big data clusters is complex. Pepperdata partners with you to deliver predictable performance, empowered users, managed costs and managed growth. Pepperdata continuously collects extensive data on over 350 real-time metrics from all of your applications and infrastructure resources — metrics about CPU, RAM, disk I/O, HDFS, and many others for every job, task, user, host, workflow, and queue. This breadth of data — not available with any other tool — empowers you to understand and improve application performance, reduce mean time to problem resolution and increase capacity utilization by 30-50% without adding new hardware. In addition to surfacing performance bottlenecks, Pepperdata also provides automatic tuning for recurring applications, delivers app-specific recommendations and allows users to set up alerts on specific behaviors and outcomes to avoid the risk of failure.

For more information on how Pepperdata can help you optimize application and platform performance, watch one of our technical webinars or schedule a demo.

October 9, 2018
Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

Developer Q and A – How to Improve Your Application Performance and Efficiency

Developers are faced with specific challenges to big data success, including poor performance, unpredictable runtimes, and bottlenecks. They need faster, more efficient applications to meet SLAs, but at times, they submit a query and have no insight into when it starts running — or whether it will finish successfully.

Developers look at different tools to try and understand what’s going on and why things are hung up, but even with all those tools, they don’t have an accurate picture. They have countless questions and have no way to get the answers, which we discussed in our webinar last week:

  • Why is my job running slow?
  • Is there something wrong with the platform?
  • How do I guarantee SLAs of my app?
  • How do I maintain my jobs over time?
  • How do I make my job go faster?
  • How can my job be more efficient?
  • Is my job even running?
  • Is my job bottlenecked?

To answer these questions, you need self-service access to actionable insights and recommendations. Furthermore, you need tailored alerts and recommendations based on job types, job performance over time, and cluster-wide utilization trends. With most current tools, the metrics to feed these insights aren’t even available – not to you or your infrastructure manager.

That’s where Pepperdata comes in. We create a holistic view of your application performance across the cluster and provide automatic tuning as well as alerts and recommendations for optimal application performance. By that I don’t mean we’re just going to make your application run better this time — we make your application perform best all the time in your multitenant environment. That’s one of the big differences. In the Hadoop space, you can’t just be concerned with how things work this time: You need to tune performance continually within the parameters of the environment you’re dealing with.

Pepperdata Application Spotlight provides all of the tools developers need to optimize performance, including a 360° View, Application Tuning, Application Recommendations, Application Alerts and reporting.

360° View

Sometimes your application performance problems are your fault, and sometimes they’re a result of your multi-tenant environment. You need to be able to look at the last number of times — say 5 times — you ran the application, understand what’s going on in the environment and learn where and why extra time was spent in the queue, to determine whether it’s just you who’s experiencing the slowdown. Maybe others are experiencing similar bottlenecks and if so, your operator needs to know that.

Pepperdata Application Spotlight provides a 360° View of applications in one place — in the context of the entire multi-tenant cluster — giving you quick insight into why your application is running slow. It helps you target your performance tuning by helping you understand exactly what CPU and memory resources it requested, what it needs, what it used, and what it wasted. Pepperdata is the only APM solution that continuously collects metrics about every single application and infrastructure resource, which means you can diagnose application performance issues up to 90% faster and fine-tune each application.

For instance, you get much more insight on what happened than just knowing Spark used a certain amount of memory — you get details into specific jobs and stages, allowing you to drill down to get the why and when so you can make impactful changes. A lot can be going on with your application and understanding where a problem is requires time series data so you can do some fine-grained, effective tuning. We provide in-depth insight into that Spark application, unlike other solutions that just provide you with the top layer.

Application Tuning

Pepperdata automatically tunes applications that are repetitive for either resource efficiency or runtime, improving performance and efficiency of applications as well as resource utilization. We help you understand and make efficient and cost effective utilization of your resources by helping you discover where there are inefficiencies or where there are resources that are being over allocated and even wasteful.

Application Recommendations

Pepperdata also provides job-specific Application Recommendations based on industry best practices and the in-depth knowledge of performance metrics we’ve already discussed. You get self-service recommendations for best queues and launch times — based on current workloads, data partitioning, serialization, container sizes and heap reservations.

Application Alerts

In addition to surfacing performance bottlenecks, Pepperdata improves application runtime predictability by allowing you to create and receive Application Alerts on important events and outcomes so you know when an application is at risk of failure. This alarm can be tailored to go to you or to certain development teams. Use our data to identify any resource bottleneck (CPU, memory, IO, etc.), pinpoint straggling tasks or poor parallelization, and alert on thresholds such as duration, amount of data processed or other milestone.

Reporting

Pepperdata provides you with a holistic picture of everything that’s going on – relevant real-time and historical information about the cluster, including system demand, users, and applications — in one cohesive capacity planning report. This allows you to understand and accurately size queues, gain insight into which applications are using what resources, and plan for future jobs by considering things that tend to go on in your particular environment.

Experts ready to help

We realize you face challenges.I’s not an overstatement to say we’ve probably seen every single issue you face. Our big data experts have been working on most of these problems for a very long time. We’ve seen a lot of systems, a lot of applications and a lot of tasks. So we have a very good understanding of what the average Hadoop environment looks like and what needs to be done to maximize application performance. Having worked with many large-cluster customers and having seen a myriad of challenges and problems, it’s more than likely we’ve seen environments and problems like yours, making us a perfect partner to help you achieve your goals.

Contact sales@pepperdata.com today and learn how we can help you.

More info:

October 2, 2018
Synecdoche and SaaS: What Title Should the Customer Success Leader Have? Image

What We Learned at Strata NYC 2018: Hot Topics and Misperceptions

The Strata Data Conference is always well worth the trip, whether it’s within driving distance or clear across the country. This year’s Strata Data NYC was no exception, and we enjoyed the lively conversations and excitement of the attendees.

This show’s topics ran the gamut, from Spark to Kubernetes, from AI and machine learning to the unconscious habits of the human mind. But it’s obvious some things have drastically changed. For instance, Hadoop had far less visibility at this particular show, getting even further away from its status as “the” buzzword of the show a few years back. This year, popular topics (not surprisingly) included machine learning, containers, self-service, streaming or real-time, data governance, GDPR, and language processing. All in all, a great array of topics, enough to satisfy any attendee, including engineers, big data architects, data scientists, marketing leads, and more.

However, while we return from these shows with our creativity sparked, we also recognize a fair number of misconceptions cropping up in our discussions. One of the biggest Application Performance Monitoring (APM) misperceptions we hear relates to application tuning: It is often identified as “The Problem” when it is only one aspect of APM and often it is not actually the real issue at hand. On more than one occasion, we asked a booth visitor, “What’s your biggest big data infrastructure challenge? What are you having a problem with right now?” Too often, the response was, “We need to tune our applications.”

That may sound like a fair and accurate answer, but as we got further into a few discussions, we identified that the problem was more about understanding what’s going on in the environment rather than the application, and tuning alone is insufficient. Let’s take a look at the subtle but very important differences.

What is Application Tuning?

Application tuning is specifically the improvement of application performance, usually an exercise resulting from an actual performance issue or a practice undertaken to avoid the possibility of a problem.

Why do you need it?

You need fast and efficient applications in order to meet your SLAs and to maximize productivity. You fine tune performance in order to improve runtimes and resource utilization.

Is that all you need?

No. Don’t let other vendors tell you it is. More than once, an attendee would mention that some vendors are indeed saying that Application Tuning is all you need. It’s not. In order to performance tune your applications, you first need to be able to find out where the problem is.

  1. First, you need a view into all of your applications in the context of the entire cluster. You need to go beyond your own application and uncover data about what else is happening on the node and in the queue, who’s vying for the same resources you need, how much memory is allocated for the jobs before yours, and so on. Essentially, you need a 360° view of all your applications. This is very important.
  2. Once you have access to all this data across the cluster, you’ll be able to identify the problematic application and diagnose performance issues.
  3. Finally, with a comprehensive view into both application and cluster data, you can take actions to tune performance.

What is 360° Application View?

With Pepperdata Application Spotlight, you get a 360° view of all your applications in one place — in the context of the entire cluster. Pepperdata continuously collects data about all of your applications and infrastructure resources – unique data that enables you to quickly pinpoint and diagnose application performance issues up to 90% faster. Nobody else does this.

Why do you need it?

With Application Spotlight, you have self-service access to application performance data — data you can’t get anywhere else —  for a 360° view of your apps and the cluster. With insight into exactly what CPU and memory resources your applications and others on the cluster have requested, what they need, what they actually use, and what they waste, you can quickly identify where problems are and tune applications to improve performance and efficiency.

Figure One – Pepperdata provides you with self-service access to all of the data on your applications in one place – a 360° view of everything going on in the cluster across all applications and resources.

Figure Two – Pepperdata provides recommendations, alarms and alerts about bottlenecks.


Is that all you need?

No, but it’s certainly a prime necessity. With the 360° Application View, as a developer, you have self-service access to all of the data on your applications in one place. This allows you to distinguish whether performance issues were caused by your application or other applications on the cluster. In addition, Application Spotlight provides recommendations on possible issues and it auto-tunes configurations for optimization of recurring applications.

What else?

For capacity and infrastructure managers, Pepperdata Platform Spotlight continuously collects extensive unique data — data not available anywhere else or with any other tool — about hosts, queues, users, applications and all relevant resources. Pepperdata collects two billion performance data points every five minutes. No other vendor does this.

Together, Pepperdata Application Spotlight and Platform Spotlight provide developers as well as infrastructure and capacity managers with the following capabilities:

  • A single source of real-time big data platform and application truth, on-premise or in the cloud or both, collected from all applications and tasks, sampled every five seconds — data not available from any other source.
  • Diagnose performance issues 10x faster and make informed resource decisions based on user priorities and needs.
  • Automatically tune platform and applications simultaneously for peak performance and efficiency, achieving 50% improved throughput cluster-wide.
  • Reclaim wasted resources dynamically at runtime for improved efficiency and savings.
  • Identify rogue users and applications for rapid automatic or manual remediation.
  • Automatically tune repetitive applications resulting in 70% faster runtime or reduced resource utilization.
  • Accurately forecast resource needs based on cluster-wide trends using data collected, enabling informed capacity planning.
  • Determine optimal software and hardware stacks based on Pepperdata’s extensive knowledge of similar environments and workloads.
  • Extensive reporting on both platform and application usage patterns, costs, wasted resources, and performance bottlenecks.

For more information, download our product guide or schedule a demo.

September 24, 2018