【評判】Apache Airflow: The Hands-On Guide
-
-
本コースの特徴 -
受講生の声
講座情報
- ・講師名：Marc Lamberti(詳しい経歴はこちら)
- ・作成日：2019-08-11
- ・レクチャー数：121
- ・週間：0記事
- ・月間：0記事
- ・年間：1記事
- ・全期間：1記事
レビュー数
レビュー数の推移
直近6か月以内に本講座のレビューに関して記載された記事はありません。
学習内容
How to Follow Best Practices with Apache Airflow
How to Scale Airflow with the Local, Celery and Kubernetes Wxecutors
How to Set Up Monitoring with Elasticsearch and Grafana
How to Secure Airflow with authentication, crypto and the RBAC UI
Core and Advanced Concepts with Pros and Limitations
Mastering DAGs with timezones, unit testing, backfill and catchup
Organising the DAG folder and keep things clean
詳細
Apache Airflow is a platform created by the community to programmatically author, schedule and monitor workflows.
It is scalable, dynamic, extensible, and modulable.
Without any doubt, mastering Airflow is becoming a must-have and an attractive skill for anyone working with data.
What you will learn in the course:
Fundamentals of Airflow are explained such as what Airflow is, how the scheduler and the web server work
The Forex Data Pipeline project is an incredible way to discover many operators in Airflow and deal with Slack, Spark, Hadoop, and more
Mastering your DAGs is a top priority, and you can play with timezones, unit test your DAGs, structure your DAG folder, and much more.
Scaling Airflow through different executors such as the Local Executor, the Celery Executor, and the Kubernetes Executor will be explained in detail. You will discover how to specialize your workers, add new workers, and what happens when a node crashes.
A Kubernetes cluster of 3 nodes will be set up with Rancher, Airflow, and the Kubernetes Executor local to run your data pipelines.
Advanced concepts will be shown through practical examples such as templating your DAGs, how to make your DAG dependent on another, what are Subdags and deadlocks, and more.
You will set up a Kubernetes cluster in the cloud with AWS EKS and Rancher to use Airflow and the Kubernetes Executor.
Monitoring Airflow is extremely important! That's why you will know how to do it with Elasticsearch and Grafana.
Security will also be addressed to make your Airflow instance compliant with your company. Specifying roles and permissions for your users with RBAC, preventing them from accessing the Airflow UI with authentication and password, data encryption, and more.
In addition:
Many practical exercises are given along the course so that you will have occasions to apply what you learn.
Best practices are stated when needed to give you the best ways of using Airflow.
Quiz are available to assess your comprehension at the end of each section.
Answering your questions fast is my top priority, and I will do my best for you.
I put a lot of effort into giving you the best content, and I hope you will enjoy it as much as I wanted to do it.
At the end of the course, you will be more confident than ever in using Airflow.
I wish you a great success!
Marc Lamberti
本コースの特徴
本コースの特徴を単語単位でまとめました。以下の単語が気になる方は、ぜひ本講座の受講をオススメします。
受講者の感想
本講座を受講した皆さんの感想を以下にまとめます。
評価や口コミ
参考になる受講者の口コミやレビューを以下にまとめます。
良い点
- ● Content was really useful so far.I really liked how in-depth the course material went. Every step was easy to follow and everything necessary to build the DAGs was shown in the video. Definitely will watch again!Thank your creating this kind of course with all topics related to manage distributed computing using pipelines with Airflow.I really appreciate the explanations and examples given, particularly those with cloud environments and exercises. Definitely sections are well organized to learn from the basic to advanced concepts with DAGS and security.Really nice combination between theory and practiceObjetivo e claro, direto ao ponto, com explicações fáceis de entenderthis very well detailed couurseThe instructor is knowledgeable and his explanations are easy to understand.Perfect explanation and learning process without any issues.Best Airflow course on the market and most positive author on Udemy :-)Love the excitement of the instructor. And, I am already a user of Airflow. Very Good Explanations.Easily to understand, many supporting materials, not only Airflow but also connection to other interesting topics, "neverending" course thanks to YouTube videos, and sharing news on LinkedIn. Thank you very much.Very Nice training. Nice explanation with Practicals.good informationThis course is an excellent survey of Airflow and its capabilities in various scenarios. It begins with a small project that gives an overview of how Airflow works and then dives deep into the various features.Yes it is good match but in this course many topics are covered like vagrant, ranchor, elasticsearch, metrics and so on.....but for the first time user it is a lot to process all at one go which might be confusing at the end.J'étais prêt à mettre la note maximale de 5 étoiles, pour les premières parties, car elles étaient interactives, dynamiques et très formatrices.A partir de la partie sur la "maîtrise d'Airflow", le format a radicalement changé. L'utilisation de PowerPoint (en soi, ce n'est pas un problème) et la quantité importante de lecture passive ont rendu le cours moins dynamique et captivant. J'ai eu l'impression que ces parties de la formation étaient obsolètes et n'avaient pas été mises à jour. Malgré ce bémol, la formation m'a permis d'apprendre beaucoup de choses, de pratiquer et de mettre la main à la pâte sur la technologie.Je la recommande globalement, très bon formateur !Marc is vary talented tutor. This class give a lot of insight to configure the Airflow in many things. I just found how powerful Airflow is after completing his courseI wish the pace at which the topics are covered, is marginally reduced and i wish more information is shared on each of the topics that are discussedステップバイステップで分かりやすい。
- ● 序盤と後半でAirflow のバージョンが違うのが残念。
- ● 全体を通してAirflow 2.4あたりで更新してくれれば完璧。
レビューの一覧
・新入社員に向けて私が3年間で受講したUdemyの講座を紹介する[2024-05-29に投稿]
他にオススメな関連講座のランキング
