Optimising Hadoop on Amazon Web Services

Compuware Corporation has released an APM solution for Hadoop on Amazon Elastic MapReduce, (EMR) available now in the AWS Marketplace. This solution enables organizations to tame big data at scale, enabling customers to gain faster business value at lower cost, and furthers Compuware APM’s ability to provide visibility and troubleshooting insight into big data workloads.

Powered by its patented PurePath Technology®, Compuware APM profiles Amazon EMR jobs, providing drill-down dashboards that can pinpoint the root cause of failed jobs or performance hotspots with a single click. Operation teams gain full visibility into cluster usage based on users or job types, enabling monitoring of service level agreements (SLAs) and charge-back models to consumers. By profiling Hadoop jobs in production, operations teams can quickly identify the issues, whether they are misconfigured or unbalanced clusters, poorly-coded workloads or unhealthy hosts. Developers, armed with exact detail shared by operations and QA, no longer have to guess at the performance of their code when running at massive scale.


“Compuware APM combined with the AWS cloud provides customers with the technical capabilities they need to allow them to focus on their business,” said Terry Hanold, Vice President, Cloud Commerce, AWS. “We’re excited to welcome Compuware into the AWS Marketplace, where customers will be able to now gain the advantage of Compuware APM for Amazon EMR.”


Features and capabilities of Compuware APM solution with Amazon EMR include:
· Profiling Hadoop jobs in production clusters to see which teams are utilizing the cluster and exactly why, to code level, a job takes minutes or hours to run.
· Automatically identifying performance hotspots in Amazon EMR, such as whether the problem is due to a poor configuration, over-utilized or failed infrastructure, or inefficient code.
· Eliminating the need to scour log files by identifying the root cause of a job failure in one click. Exceptions, stack traces and logged data are automatically identified by PurePath Technology, showing both where and why failures occur. Deep facts can be easily shared with development to quickly fix issues.


“Compuware APM makes application performance management for big data both simple and straightforward across the lifecycle from development to test to production,” said Steve Tack, Vice President of Product Management for Compuware’s APM business unit. “To help customers grappling with this maturing technology where expertise is scarce, Compuware APM for Amazon EMR adds visibility and helps organizations better manage their big data workloads and transactions, enabling them to leap ahead in the analytics race.”
 

New state-of-the-art data centre features Vultr’s first AMD GPU supercompute cluster.
Only a quarter (25%) think their approach to the cloud is carefully considered and successful.
Moving to AWS Cloud will enable The Co-operative Bank to adopt cutting edge IT Infrastructure.
The global airline group will upgrade the value of its data and get its AI & generative AI ready...
Barracuda Networks’s award-winning Email Protection and Cloud Backup security solutions will be...
Leading company in renewables to leverage HPE’s unique turnkey AI infrastructure solution to...
The four-year project extension focuses on cloud transformation and enhanced operational efficiency...
Businesses in the UK are risking slower development as they fail to fully embrace technologies that...