Introduction Apache Airflow is an open source tool for workflow orchestration widely used in the field of data engineering. You can take a look at this other blog post where we made an introduction to Basics on Apache Airflow. In…
Introducción Since our Pentaho PDI plugin for Apache Airflow release, we have seen an industry shift towards the usage of Apache Hop for data processing. What is Apache Hop? Apache Hop started (late 2019) as a fork of Kettle PDI,…
Introduction One of the most outstanding new features of Airflow 2.3.0 is Dynamic Task Mapping. This new feature adds the possibility of creating tasks dynamically at runtime. Thanks to this we can change the number of such tasks in our…
Introduction Apache Airflow is a free workflow orchestration software, which are created through Python scripts, and can be monitored using its user interface. Some examples of workflows in which this tool could be used are the scheduling of ETL (Extract,…
What is a digital twin? When we talk about digital twins, we are mainly referring to a virtual representation of a physical system, where a copy (twin) of the real environment is reproduced using the information (Big Data) that affects…
2021 has been a year where many things have happened very quickly at Damavis. In this last post before the arrival of 2022, we will make a summary of the contents published in our blog throughout all these months. Damavis…
Damavis Blog New article in our blog with the interview conducted by the program La gran vida of IB3 Ràdio to David Martín, CEO of Damavis “Today, all comanies, all lof them, have an enormous volume of data. But what…