BDE S3 INTRO

Big Data Architectures

WELCOME TO UNIT 3

In this unit, Big Data Architecture, we will review topics related to the integration of the technological elements for the establishment of a Big Data architecture from the data model, which is the lowest level, to the presentation of the data either in local or distributed environments.

Objective

Hadoop has become an icon of Big Data architectures, mainly because of its framework for performing parallel computation and the ability to split large files into smaller segments of information, promoting the use of commodity hardware that allows high scalability of data architectures.

Hadoop

APPLICATIONS

What do we understand by scalability? Scalability is a critical factor in the growth of a system. If a strategy aims to grow in the number of users while maintaining its current performance, it has to evaluate two possible options: • With more powerful hardware or • With a better combination of hardware and software.

APPLICATIONS

The Hadoop ecosystem is a complex ecosystem of highly diverse projects working together. Its objective is to create a standard set of services capable of transforming what we call “commodity hardware” (low-cost hardware, without redundancy capacity) into a coherent service that can redundantly store petabytes of data and process it efficiently.

To delve deeper into the concepts presented in the unit, I suggest reviewing the related resources. Afterwards, consult the week's case and answer the questions in the guide.