Hadoop Tag

Hadoop Technology

Introduction:-

       Hadoop is a new technology. Hadoop is an open-source software framework for storing data and running applications on clusters of commodity hardware. It provides massive storage for any kind of data, processing power and the ability to handle virtually limitless concurrent tasks or jobs.

History:-

        As the World Wide Web grew in the late 1900s and early 2000s, search engines and indexes were created to help locate relevant information amid the text-based content. In the early years, search results were returned by humans. But as the web grew from millions of pages, automation was needed.

Why is Hadoop important?

• Ability to store and process huge amounts of any kind of data, quickly. With data volumes and varieties constantly increasing.
• Computing power.
• Fault tolerance.
• Flexibility.
• Low cost. The open-source framework is free and uses commodity hardware to store large quantities of data.
• Scalability. You can easily grow your system to handle more data simply by adding nodes. Little administration is required.

What are the challenges of using Hadoop?

• MapReduce programming is not a good match for all problems.
• There’s a widely acknowledged talent gap.
• Data security– it is also provide data security for hadoop and big data users.
• Full-fledged data management and governance. Hadoop does not have easy-to-use, full-feature tools for data management, data cleansing, governance and metadata.

How Is Hadoop Being Used?

• low-cost storage and data archive.

  

• Sandbox for discovery and analysis.
• Data Lake.
• Complement your data warehouse.

Awadhesh Kumar

Jain Software Develepors

What is Big Data?

Introduction:

            Big data is a term that describes the large volume of data ` both structured and unstructured ` that inundates a business on a day-to-day basis. But it’s not the amount of data that’s important. It’s what organizations do with the data that matters. Big data can be analyzed for insights that lead to better decisions and strategic business moves for any organizations or company.

History:

            While the term “big data” is relatively new, the act of gathering and storing large amounts of information for eventual analysis is ages old. The concept gained momentum in the early 2000s when industry analyst Doug Laney articulated the now-mainstream definition of big data as the three Vs:

1. Volume:-Organizations collect data from a variety of sources, including business transactions, social media and information from sensor or machine-to-machine data.
2. Velocity:-Data streams in at an unprecedented speed and must be dealt with in a timely manner.
3. Variety:-Data comes in all types of formats ` from structured, numeric data in traditional databases to unstructured text documents, email, video, audio, stock ticker data and financial transactions.

Why Big Data important?

The importance of big data doesn’t revolve around how much data you have, but what you do with it. You can take data from any source and analyze it to find answers that enable 1) cost reductions, 2) time reductions, 3) new product development and optimized offerings, and 4) smart decision making. When you combine big data with high-powered analytic, you can accomplish business-related tasks such as:

• Determining root causes of failures, issues and defects in near-real time.
• Generating coupons at the point of sale based on the customer’s buying habits.
• Recalculating entire risk portfolios in minutes.
• Detecting fraudulent behavior before it affects your organization

Who uses Big Data?

Today’s life we have large amount of information to gathering and storing but that doesn’t matter how much amount of data you have.

Below points shows where big data is important-

• Education
• Government
• Healthcare
• Banking
• Manufacturing
• Retail etc.

Awadhesh Kumar

Jain Software Developers