Data Engineering Foundations Part 2: Building Data Pipelines with Kafka and Nifi free download

Academy

Category:
Computer Science

Views: 830
Likes: 7

Catalogue

Uploader:

Tutorials

Upload Date:

12/31/2022 5:39:29 AM

To download click on link in the Links Table below

Description: Click to see full description

The Perfect Way to Get Started with Data Pipelines, Kafka, and NiFi

Data Engineering Foundations Part 2: Building Data Pipelines with Kafka and NiFi provides over four hours of video introducing you to creating data pipelines at scale with Kafka and NiFi. You learn to work with the Kafka message broker and discover how to establish NiFi dataflow. You also learn about data movement and storage. All software used in videos is open source and freely available for your use and experimentation on the included virtual machine.

About the Instructor

Doug Eadline, PhD, began his career as a practitioner and a chronicler of the Linux Cluster HPC revolution and now documents big data analytics. Starting with the first Beowulf How To document, Dr. Eadline has written hundreds of articles, white papers, and instructional documents covering virtually all aspects of HPC computing. Prior to starting and editing the popular ClusterMonkey.net website in 2005, he served as editor-in-chief for ClusterWorld Magazine and was Senior HPC Editor for Linux Magazine. Currently, he is a consultant to the HPC industry and writes a monthly column in HPC Admin Magazine. He has practical hands-on experience in many aspects of HPC, including hardware and software design, benchmarking, storage, GPU, cloud, and parallel computing. He is the co-author of the Apache Hadoop YARN book and author of Hadoop Fundamentals LiveLessons and Apache Hadoop YARN LiveLessons.

Skill Level:

Beginner
    Intermediate

Learn How To:

Understand Kafka topics, brokers, and partitions
    Implement basic Kafka usage modes
    Use Kafka producers and consumers with Python
    Utilize the KafkaEsque graphical user interface
    Understand the core concepts of NiFi
    Understand NiFi flow and web UI components
    Understand direct data movement with HDFS
    Use HBase with Python Happybase
    Use Sqoop for database movement

Who Should Take This Course:

Users, developers, and administrators interested in learning the fundamental aspects and operations of date engineering and scalable systems

Course Requirements:

Basic understanding of programming and development
    A working knowledge of Linux systems and tools
    Familiarity with Python

Lesson Descriptions:

Lesson 7: Working with the Kafka Message Broker

In Lesson 7, Doug introduces introduce the Kafka message broker concept and describes the producer-consumer model that enables input data to be reliably decoupled from output requests. Kafka producers and consumers are developed using Python, and internal broker operations are displayed using the Kafkaesque graphical user interface.

Lesson 8: Working with NiFi Dataflow

Lesson 8 begins with a description of NiFi flow-based programming and then provides several examples that include writing pipeline data to the local file system, then to the Hadoop Distributed File System, and finally to Hadoop Hive tables. The entire flow process is constructed using the NiFi web Graphical User Interface. The creation of portable flow templates for all examples is also presented.

Lesson 9: Big Data Movement and Storage

Lesson 9 provides you with several methods for moving data to and from the Hadoop Distributed File System. Hands-on examples include direct web downloads and using Python Pydoop to move data. Basic data movement between Apache HBase, Hive, and Spark using Python Happybase and Hive-SQL is also presented. Finally, movement of relational data to and from the Hadoop Distributed File System is demonstrated using Apache Sqoop.

Links Table (Note: Download all parts and then extract file if below is multiple parts)

	Links	Download Link
3164570	Part	https://rapidgator.net/file/deb137083bfd8d927c1c80baf6404438/Data_Engineering_Foundations_Part_2_Building_Data_Pipelines_with_Kafka_and_Nifi.part1.rar.html
3164571	Part	https://rapidgator.net/file/fa34681d14d13d90b11beaef2d213212/Data_Engineering_Foundations_Part_2_Building_Data_Pipelines_with_Kafka_and_Nifi.part2.rar.html
3164572	Part	https://rapidgator.net/file/61274640b1d1b5a7edf69378ea2a6a7a/Data_Engineering_Foundations_Part_2_Building_Data_Pipelines_with_Kafka_and_Nifi.part3.rar.html
3164573	Part	https://rapidgator.net/file/bda33ebe47ef95ead972277db2b8e9f7/Data_Engineering_Foundations_Part_2_Building_Data_Pipelines_with_Kafka_and_Nifi.part4.rar.html

	Mirror Links	Downbload Mirror Link
3164574	Mirror	https://nitroflare.com/view/EFFC275891DB547/Data_Engineering_Foundations_Part_2_Building_Data_Pipelines_with_Kafka_and_Nifi.part1.rar
3164575	Mirror	https://nitroflare.com/view/E0D4AA38E366BC1/Data_Engineering_Foundations_Part_2_Building_Data_Pipelines_with_Kafka_and_Nifi.part2.rar
3164576	Mirror	https://nitroflare.com/view/C18E773055AAC61/Data_Engineering_Foundations_Part_2_Building_Data_Pipelines_with_Kafka_and_Nifi.part3.rar
3164577	Mirror	https://nitroflare.com/view/0A8A66BC209A791/Data_Engineering_Foundations_Part_2_Building_Data_Pipelines_with_Kafka_and_Nifi.part4.rar

Tags: Building Data Engineering Foundations Kafka Nifi Part Pipelines

Those who downloaded this book also downloaded the following books:
Comments

New comment:

Data Engineering Foundations Part 2: Building Data Pipelines with Kafka and Nifi free download

Category: Computer Science

Description: Click to see full description

Category:
Computer Science