When analysing a system’s behavior, it is not uncommon to encounter some kind of problem or difficulty. For example, we might want to improve a process—whether by better distributing workloads, avoiding long wait times, or increasing its performance. However, it…
In various blog posts, we’ve explored what graphs are and how they work from both theoretical and practical perspectives. In the post Graph databases: Analysis and example, we already discussed how this technology can model relationships that would be impossible…
In the world of data engineering, the use of job orchestrators is key to ensuring that data arrives at the right time and in the right format. One of the most widely used orchestrators—which we’ve already discussed in several posts…
One of the peculiarities of SQL and its many dialects is that they attempt to add features that are not present in ANSI SQL. This phenomenon is so common that it is usual to find that each dialect implements these…
In cases where it is necessary to model relationships between entities, it is common to use a graph system. The functioning of this type of element is very simple. Its structure consists of entities, represented as nodes, and edges, which…
What are Vehicle Routing optimization Problems? The concept of Vehicle Routing Problem (VRP) is a generalization of the well-known Traveling Salesman Problem (TSP). Specifically, the VRP is a pure optimization problem whose objective is to determine the most efficient route.…
Recently, Airflow version 3.0.0 was officially released, and with it comes several new features in the implemented functionalities and the graphical interface. In this post, we will discuss the most interesting changes. DAGs versioning One of the new features of…
Testing is a process that is always necessary to ensure that the behavior we expect from an application is also the actual behavior. Without proper testing, uploading a change can cause some uncertainty, as it is difficult to confirm that…
When we are working with relational databases, it is usual for some queries to be extremely slow. This can be due to different reasons, but the most common is that the data access pattern that the query demands is not…
Process Discovery is a family of techniques used to obtain information from event logs and reconstruct the underlying model they have generated. This model can then be used for different tasks such as identifying bottlenecks, monitoring deviations from an ideal…