Month May 2021
Demand forecasting and Dynamic Pricing
Demand forecasting and suitable pricing are two key factors in any business. In the hotel context in particular, and more specifically in the online segment, these tasks are of vital importance due to the dynamic nature of prices and high…
Avoiding UDFs in Apache Spark
It is well known that the use of UDFs (User Defined Functions) in Apache Spark, and especially in using the Python API, can compromise our application performace. For this reason, at Damavis we try to avoid their use as much…
Damavis Summary of week 20, 2021
Dynamic programming and the Fibonacci series
Dynamic programming Dynamic programming (DP) is a computer programming method which consists in breaking down a complex problem into smaller problems, usually in a recursive way. Then, these problems are solved one at a time, typically storing the already computed…
Damavis Summary of week 18, 2021
Advanced Airflow: Cross-DAG tasks and sensor dependencies
In this article we are going to tell you some ways to solve problems related to the complexity of data engineering itself. An Airflow DAG can become very complex if we start including all dependencies in it, and furthermore, this…