Tag apache airflow

Software

Basics on Apache Airflow

Introduction Apache Airflow is a free workflow orchestration software, which are created through Python scripts, and can be monitored using its user interface. Some examples of workflows in which this tool could be used are the scheduling of ETL (Extract,…

Guillermo Camps
2022-01-27

Damavis

Damavis Summary of week 21, 2021

damavis-weekly-summary

Avoiding UDFs in Apache Spark, working in Damavis, and a guide to discovering which open-source tool is the right for your project

Corina Schuster
2021-05-30

Data Engineering

Avoiding UDFs in Apache Spark

avoid-udf-apache-spark

Review of some Apache Spark library functions and some practical examples avoiding UDFs

Cristòfol Torrens
2021-05-26

Damavis

Damavis Summary of week 18, 2021

Damavis-week-18-summary

Advanced Airflow, creation of machine learning pipelines and artificial intelligence in supermarkets

Corina Schuster
2021-05-07

Data Engineering

Advanced Airflow. Cross-DAG task and sensor dependencies

advanced-airflow

Cross-DAG task and sensor dependencies with Airflow. How to solve problems related to data engineering complexity.

Cristòfol Torrens
2021-05-05

Data Engineering

Introduction to Apache YARN

How to configure Apache YARN to execute parallel jobs

Daniel Bestard
2021-03-03

Data Engineering

Deploying Airflow: CeleryExecutor on Kubernetes

How to deploy the Apache Airflow process orchestrator on Kubernetes

Antonio Boutaour
2021-02-17

Data Engineering

Pentaho PDI Plugin for Airflow

Schedule, orchestrate and monitor your Kettle tasks with Airflow with this Pentaho plugin.

Cristòfol Torrens
2021-02-02