Apache Hadoop YARN

“This book is a critically needed resource for the newly released Apache Hadoop 2.0, highlighting YARN as the significant breakthrough that broadens Hadoop beyond the MapReduce paradigm.”

—From the Foreword by Raymie Stata, CEO of Altiscale

The Insider’s Guide to Building Distributed, Big Data Applications with Apache Hadoop? YARN

Apache Hadoop is helping drive the Big Data revolution. Now, its data processing has been completely overhauled: Apache Hadoop YARN provides resource management at data center scale and easier ways to create distributed applications that process petabytes of data. And now in Apache Hadoop? YARN, two Hadoop technical leaders show you how to develop new applications and adapt existing code to fully leverage these revolutionary advances.

YARN project founder Arun Murthy and project lead Vinod Kumar Vavilapalli demonstrate how YARN increases scalability and cluster utilization, enables new programming models and services, and opens new options beyond Java and batch processing. They walk you through the entire YARN project lifecycle, from installation through deployment.

You’ll find many examples drawn from the authors’ cutting-edge experience—first as Hadoop’s earliest developers and implementers at Yahoo! and now as Hortonworks developers moving the platform forward and helping customers succeed with it.

Coverage includes

• YARN’s goals, design, architecture, and components—how it expands the Apache Hadoop ecosystem
• Exploring YARN on a single node
• Administering YARN clusters and Capacity Scheduler
• Running existing MapReduce applications
• Developing a large-scale clustered YARN application
• Discovering new open source frameworks that run under YARN

Table of Contents

Chapter 1 Apache Hadoop YARN: A Brief History and Rationale
Chapter 2 Apache Hadoop YARN Install Quick Start
Chapter 3 Apache Hadoop YARN Core Concepts
Chapter 4 Functional Overview of YARN Components
Chapter 5 Installing Apache Hadoop YARN
Chapter 6 Apache Hadoop YARN Administration
Chapter 7 Apache Hadoop YARN Architecture Guide
Chapter 8 Capacity Scheduler in YARN
Chapter 9 MapReduce with Apache Hadoop YARN
Chapter 10 Apache Hadoop YARN Application Example
Chapter 11 Using Apache Hadoop YARN Distributed-Shell
Chapter 12 Apache Hadoop YARN Frameworks