Deep Dive into the Hadoop Distributed File System

• Defining HDFS
• Deep dive into the HDFS architecture
• NameNode internals
• DataNode internals
• Quorum Journal Manager (QJM)
• HDFS high availability in Hadoop 3.x
• Data management
• HDFS reads and writes
• Managing disk-skewed data in Hadoop 3.x
• Lazy persist writes in HDFS
• Erasure encoding in Hadoop 3.x
• HDFS common interfaces
• HDFS command reference

YARN Resource Management in Hadoop

• Architecture
• YARN job scheduling
• FIFO scheduler
• Capacity scheduler
• Fair scheduler
• Resource Manager high availability
• Node labels
• YARN Timeline server in Hadoop 3.x
• Opportunistic containers in Hadoop 3.x
• Docker containers in YARN
• YARN REST APIs
• YARN command reference

Internals of MapReduce

• Deep dive into the Hadoop MapReduce framework
• YARN and MapReduce
• MapReduce workflow in the Hadoop framework
• Common MapReduce patterns
• MapReduce use case
• Optimizing MapReduce

SQL on Hadoop

• Hive

Real-Time Processing Engines

• Spark
• Storm

Widely Used Hadoop Ecosystem Components

• Pig
• HBase
• Kafka
• Flume

Designing Applications in Hadoop

• File formats
• Data compression
• Serialization
• Data ingestion
• Data processing
• Common batch processing pattern
• Airflow for orchestration
• Data governance

Real-Time Stream Processing in Hadoop

• What are streaming datasets?
• Stream data ingestion
• Common stream data processing patterns
• Streaming design considerations
• Micro-batch processing case study
• Real-time processing case study

Machine Learning in Hadoop

• Machine learning steps
• Common machine learning challenges
• Spark machine learning
• Hadoop and R
• Mahout
• Machine learning case study in Spark

Hadoop in the Cloud

• Introduction to Cloudera
• Logical view of Hadoop in the cloud
• Network
• Managing resources
• Data pipelines
• High availability (HA)

Hadoop Cluster Profiling

• Benchmarking and profiling
• HDFS
• NameNode
• YARN
• Hive
• Mix-workloads