Damavis Summary of week 21, 2021
Avoiding UDFs in Apache Spark, working in Damavis, and a guide to discovering which open-source tool is the right for your project
Tag apache airflow
Avoiding UDFs in Apache Spark
Review of some Apache Spark library functions and some practical examples avoiding UDFs
Damavis Summary of week 18, 2021
Advanced Airflow, creation of machine learning pipelines and artificial intelligence in supermarkets
Advanced Airflow. Cross-DAG task and sensor dependencies
Cross-DAG task and sensor dependencies with Airflow. How to solve problems related to data engineering complexity.
Introduction to Apache YARN
How to configure Apache YARN to execute parallel jobs
Deploying Airflow: CeleryExecutor on Kubernetes
How to deploy the Apache Airflow process orchestrator on Kubernetes
Pentaho PDI Plugin for Airflow
Schedule, orchestrate and monitor your Kettle tasks with Airflow with this Pentaho plugin.