Building Data Pipelines with Kafka and Nifi

Colleagues, in the “Building Data Pipelines with Kafka and Nifi” program you will learn about Kafka topics, brokers, and partitions, how to implement basic Kafka usage modes, use Kafka producers and consumers with Python, utilize the KafkaEsque graphical user interface, understand the core concepts of NiFi, NiFi flow and web UI components, understand direct data movement with HDFS, u se HBase with Python Happybase and Sqoop for database movement. Skill-based training modules include: 1) Working with the Kafka Message Broker - describes the producer-consumer model that enables input data to be reliably decoupled from output requests. Kafka producers and consumers are developed using Python, and internal broker operations are displayed using the Kafkaesque graphical user interface, 2) Working with NiFi Dataflow - writing pipeline data to the local file system, then to the Hadoop Distributed File System, and finally to Hadoop Hive tables. The entire flow process is constructed using the NiFi web Graphical User Interface. The creation of portable flow templates for all examples is also presented, 3) Big Data Movement and Storage - methods for moving data to and from the Hadoop Distributed File System. Hands-on examples include direct web downloads and using Python Pydoop to move data. Basic data movement between Apache HBase, Hive, and Spark using Python Happybase and Hive-SQL is also presented. Finally, movement of relational data to and from the Hadoop Distributed File System is demonstrated using Apache Sqoop.

Enroll today (teams & executives are welcome): https://tinyurl.com/a6bu77db 

Download your free Data Science  - Career Transformation Guide.

Explore our Data-Driven Organizations Audible and Kindle book series on Amazon:

1 - Data-Driven Decision-Making  (Audible) (Kindle)

2 - Implementing Data Science Methodology: From Data Wrangling to Data Viz (Audible) (Kindle)

3 - The Upskill Gambit - Discover the 5 Keys to Your Career and Income Security in the Digital Age (Audible) (Kindle) 

Much career success, Lawrence E. Wilson - Data Science Academy (share with your team)