Tag mapreduce

Software

Dynamic Task Mapping in Airflow 2.3.0

One of the most outstanding new features of Airflow 2.3.0 is Dynamic Task Mapping. This new feature adds the possibility of creating tasks dynamically at runtime. Thanks to this we can change the number of such tasks in our DAG…

Francisco Arenas
2022-06-03

Damavis

Damavis Summary of week 9, 2021

Compilation of the news and news shared this week in our networks

Corina Schuster
2021-03-05

Data Engineering

Introduction to Apache YARN

Basic Single Node Configuration Note: the code of this post has been tested using Apache Hadoop 2.10.1. Please check out our previous post, Introduction to Apache Hadoop, to configure this version of Hadoop, in case you have not done it…

Daniel Bestard
2021-03-03