Hortonworks Supercharges Hadoop

At the Hadoop Summit North America Wednesday in San Jose, Hortonworks announced the availability of the Hortonworks Data Platform (HDP) 2.0 Community Preview and the launch of the Hortonworks Certification Program for Apache Hadoop YARN to accelerate the availability of YARN-based partner solutions.

YARN is a sub-project of Hadoop at the Apache Software Foundation that separates the resource management and processing components.  The YARN-based architecture of Hadoop 2.0 provides a more general processing platform that is not constrained to MapReduce.

Culmination of Years of Work

"Hortonworks Data Platform 2.0 marks a truly pivotal moment for Apache Hadoop and represents the culmination of many years of hard engineering work,” said Arun Murthy, founder, Hortonworks. “The power of YARN to enable applications to run ‘in’ Hadoop, instead of ‘on’ Hadoop, is the key to leveraging all other common services of the next-generation data platform, from security to data lifecycle management. We look forward to growing HDP 2.0 as the 100-percent open source Hadoop distribution of choice for enterprises and an IT ecosystem dedicated to making the next-generation platform a core component of the enterprise data architecture.”

HDP 2.0 marks a significant step forward in the Apache Hadoop architecture, and the community preview is the first distribution to include the upcoming beta release of Apache YARN that enables a wide range of data processing applications to run natively in Hadoop with predictable performance and quality of service. More than four years in the making, YARN takes Hadoop beyond batch and the restraints of a single application and single-use to enable organizations to store large amounts of data in Hadoop and then interact with it in multiple ways from batch, interactive, streaming and more – and all with a consistent level and quality of service.

Certification Program for Developers

The Hortonworks Certification Program for Apache Hadoop YARN is designed to support the Apache Hadoop ecosystem behind this next-generation architecture by helping application developers build and certify their applications to use the YARN architecture of Hadoop 2.0. Participants in this program have been instrumental in the testing and delivery of this new framework.

“TIBCO is investing heavily in the area of big data and analytics,” said Tom Laffey, executive vice president, products and technology, TIBCO Software. “As part of this program we are integrating several of our strategic products with Apache Hadoop 2.0. We are pleased to be a part of the YARN 2.0 Certification Program and look forward to helping bridge the gap between data at rest and data in motion.”

“YARN is the future of Hadoop,” said Mark Terenzoni, CEO, Sqrrl. “We are excited to begin work with HDP 2.0 and partner with Hortonworks to deliver secure, scalable and real-time applications to our mutual customers. With Sqrrl’s data-centric security and YARN’s ability to support multiple applications simultaneously, customers can easily create secure multi-tenant analytic environments.”

Hortonworks Data Platform 2.0 Community Preview is available immediately as a downloadable single-node instance that runs inside a virtual machine, and also as a complete installation for deployment to distributed infrastructure.