1 / 3

Enhancing MapReduce with Combiner and Multiple Input Formats

This document explores advanced features of the MapReduce framework, focusing on the use of Combiners and Multiple Input Formats. It highlights the utilization of a local reducer to optimize data processing. The configuration example, `conf.setCombinerClass(LongSumReducer.class);`, showcases how to effectively reduce the volume of data transfer between the Mapper and Reducer phases. Understanding these features can significantly improve the efficiency of big data applications, allowing for faster computations and better resource management.

mostyn
Télécharger la présentation

Enhancing MapReduce with Combiner and Multiple Input Formats

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. -- Nagarjunak Map Reduce nagarjuna@outlook.com

  2. More Features • Combiner • Counters • MultipleInputFormat nagarjuna@outlook.com

  3. Combiner • A local reducer • conf.setCombinerClass(LongSumReducer.class); nagarjuna@outlook.com

More Related