Hadoop Architecture & Administration for Big Data Solutions
PDF Add to WishList
The emergence of large data sets presents new opportunities and challenges to organizations of all sizes. In this Hadoop architecture and administration training course, you gain the skills to install, configure, and manage the Apache Hadoop platform and its associated ecosystem, and build a Hadoop solution that satisfies your business requirements.
You Will Learn How To
- Architect a Hadoop solution to satisfy your business requirements
- Install and build a Hadoop cluster capable of processing large data
- Configure and tune the Hadoop environment to ensure high throughput and availability
- Allocate, distribute, and manage resources
- Monitor the file system, job progress, and overall cluster performance
Important Course Information
Recommended Experience:
- Knowledge of Linux at the level of:
- Course 144, Linux Administration & Support
- Knowledge of Java at the level of:
- Course 471, Java Programming Introduction
Course Outline
- Introduction to Data Storage and Processing
Installing the Hadoop Distributed File System (HDFS)
- Defining key design assumptions and architecture
- Configuring and setting up the file system
- Issuing commands from the console
- Reading and writing files
Setting the stage for MapReduce
- Reviewing the MapReduce approach
- Introducing the computing daemons
- Dissecting a MapReduce job
- Defining Hadoop Cluster Requirements
Planning the architecture
- Selecting appropriate hardware
- Designing a scalable cluster
Building the cluster
- Installing Hadoop daemons
- Optimizing the network architecture
- Configuring a Cluster
Preparing HDFS
- Setting basic configuration parameters
- Configuring block allocation, redundancy and replication
Deploying MapReduce
- Installing and setting up the MapReduce environment
- Delivering redundant load balancing via Rack Awareness
- Maximizing HDFS Robustness
Creating a fault–tolerant file system
- Isolating single points of failure
- Maintaining High Availability
- Triggering manual failover
- Automating failover with Zookeeper
Leveraging NameNode Federation
- Extending HDFS resources
- Managing the namespace volumes
Introducing YARN
- Critiquing the YARN architecture
- Identifying the new daemons
- Managing Resources and Cluster Health
Allocating resources
- Setting quotas to constrain HDFS utilization
- Prioritizing access to MapReduce using schedulers
Maintaining HDFS
- Starting and stopping Hadoop daemons
- Monitoring HDFS status
- Adding and removing data nodes
Administering MapReduce
- Managing MapReduce jobs
- Tracking progress with monitoring tools
- Commissioning and decommissioning compute nodes
- Maintaining a Cluster
Employing the standard built–in tools
- Managing and debugging processes using JVM metrics
- Performing Hadoop status checks
Tuning with supplementary tools
- Assessing performance with Ganglia
- Benchmarking to ensure continued performance
- Extending Hadoop
Simplifying information access
- Enabling SQL–like querying with Hive
- Installing Pig to create MapReduce jobs
Integrating additional elements of the ecosystem
- Imposing a tabular view on HDFS with HBase
- Configuring Oozie to schedule workflows
- Implementing Data Ingress and Egress
Facilitating generic input/output
- Moving bulk data into and out of Hadoop
- Transmitting HDFS data over HTTP with WebHDFS
Acquiring application–specific data
- Collecting multi–sourced log files with Flume
- Importing and exporting relational information with Sqoop
- Planning for Backup, Recovery and Security
- Coping with inevitable hardware failures
- Securing your Hadoop cluster
Convenient Ways to Attend This Instructor-Led Course
Hassle-Free Enrollment: No advance payment required to reserve your seat.
Tuition due 30 days after you attend your course.
In the Classroom
Live, Online
Private Team Training
In the Classroom — OR — Live, Online
Tuition — Standard: $2990 Government: $2659
Nov 27 - 30
(4 Days)
9:00 AM - 4:30 PM EST
Toronto / Online (AnyWare)
Reserve Your Seat
Feb 5 - 8
(4 Days)
9:00 AM - 4:30 PM EST
Rockville, MD / Online (AnyWare)
Reserve Your Seat
Mar 26 - 29
(4 Days)
9:00 AM - 4:30 PM EDT
Herndon, VA / Online (AnyWare)
Reserve Your Seat
Apr 23 - 26
(4 Days)
9:00 AM - 4:30 PM EDT
Ottawa / Online (AnyWare)
Reserve Your Seat
May 28 - 31
(4 Days)
9:00 AM - 4:30 PM EDT
Toronto / Online (AnyWare)
Reserve Your Seat
Jul 23 - 26
(4 Days)
9:00 AM - 4:30 PM EDT
Rockville, MD / Online (AnyWare)
Reserve Your Seat
Sep 10 - 13
(4 Days)
9:00 AM - 4:30 PM EDT
Herndon, VA / Online (AnyWare)
Reserve Your Seat
Guaranteed to Run
When you see the "Guaranteed to Run" icon next to a course event, you can rest assured that your course event — date, time, location — will run. Guaranteed.Private Team Training
Enrolling at least 3 people in this course? Consider bringing this (or any course that can be custom designed) to your preferred location as a private team training.
For details, call 1-888-843-8733 or Click Here »
Tuition
Standard
Government
In Classroom or
Online
Standard
$2990
Government
$2659
Private Team Training
Course Tuition Includes:
Training Hours
Standard Course Hours: 9:00 am – 4:30 pm
*Informal discussion with instructor about your projects or areas of special interest: 4:30 pm – 5:30 pm
Enhance Your Credentials with Professional Certification
Learning Tree's comprehensive training and exam preparation guarantees that you will gain the knowledge and confidence to achieve professional certification and advance your career.
Earn 23 Credits from NASBA
This course qualifies for 23 CPE credits from the National Association of State Boards of Accountancy CPE program. NOTE: Only live, in-class attendance qualifies for NASBA CPEs. Read more ...