Hadoop multiple input files example In MapReduce

Hadoop multiple input files example In MapReduce

In Our basic MapReduce Programs we took a single input file and then we load that particular input file from local path to Mapreduce framework.In this process we just add a single input file and then we got a single output file but coming to the real time scenarios we have to load multiple input […]

Multiple Output Files in MapReduce Program using MultipleTextOutputFormat

multiple-output-files-in-mapreduce-program-using-multipletextoutputformat

In Our Previous Post we discussed about MultipleInputs multiple input files concept in Mapreduce and now this is the time to discuss about Multiple Output Files in MapReduce Program using MultipleTextOutputFormat by using We have to import first of all import org.apache.hadoop.mapreduce.lib.output.MultipleOutputs from hadoop librires. Multiple Outputs in Mapreduce FileOutputFormat and its subclasses generate a set of files in […]

Hadoop setup Method cleanup Method example in Mapreduce

hadoop-setup-method-cleanup-method-example-in-mapreduce

In hadoop Mapreduce program basically two methods are there Hadoop setup Method and hadoop cleanup method.This two methods we will use in our mapreduce program based on our requirement.We can write Hadoop setup method and cleanup method in both Mapper and reducer where we required in our mapreduce code. Hadoop setup method What typically happens […]

hadoop custom partitioner in mapreduce example

hadoop-custom-partitioner-in-mapreduce-example

In our last posts we all are clearly discussed about hadoop mapreduce architecture and how mapper function will work and how reducer function will work and how to set mapreduce program configurations in mapreduce driver class.Now we will learn about hadoop custom partitioner in mapreduce example . what is partitioner in hadoop The main purpose of […]

Testing Hadoop Mapreduce Programs With MRUnit

Testing Hadoop Mapreduce Programs With MRUnit

Generally Distributed Programmings like Mapreduce programs are very difficult to debug after completing the entire code,so that kind of programs better to test in earlier stages.This testing is very useful to find the bugs and fix the bugs in begging stages of programming.So Here we are discussing about  Testing Hadoop Mapreduce Programs With MRUnit  . […]