Advanced Airflow: Cross-DAG tasks and sensor dependencies
In this article we are going to tell you some ways to solve problems related to the complexity of data engineering itself. An Airflow DAG can become very complex if we start including all dependencies in it, and furthermore, this…
Damavis Summary of week 17, 2021
Simple Perceptron: Python implementation
Artificial neural networks are one of the main lines of study in the field of artificial intelligence today. This family of algorithms allows solving tasks as complex and diverse as image recognition, natural language processing or music generation. The main…
Damavis Summary of week 16, 2021
Why a Data Scientist should know Data Engineering
Today, we would like to share with you how useful it could be for a data scientist at Damavis to have a good understanding about data engineering. For those of you who have a background in statistics and mathematics and…
Damavis Summary of week 15, 2021
Application of Survival Analysis to price changes
Damavis Summary of week 14, 2021
First steps with Apache YARN customization
Basic Single Node Configuration Note: the code of this post has been tested using Apache Hadoop 2.10.1. Please check out our previous post, Introduction to Apache Hadoop, to configure this version of Hadoop, in case you have not done it…