Big Data : Big Data is a problem that has evolved with time. With so much use of technology the scale of digital data has also increased. Every enterprise wants to process this data now. Big data is the amount of data which can not be processed using any triditional technologies like Teradata, Oracle , mysql or others.so we need a new solution. Hadoop is the solutionto solve this problem of huge amount of data.
This problem has two aspects.
Hadoop Uses HDFS to solve the problem of storage and Map reduce framework to solve the problem of processing. HDFS is Hadoop distributed file system. It is special file system designed to store files on multiple computers.
Map reduce is programing paradigm inspired from functional programing and divide and conqur problem solving technique. Basically we divide our solution in two functions named map and reduce and run map function on different chunks of data parllely.