A linear regression is a model that is used to approximate the linear relationship between a dependent variable Y and a set of independent variables X. In matrix format it can be expressed as where ε is a vector of…
We know that there is a large number of products in the data engineering ecosystem to perform the data processing of a company and that most of them provide the necessary tools to be able to perform many types of…
Introduction All graphics in this article are interactive due to the nature of trying to represent text graphically. To see which sentence each point represents, simply hover the mouse over it. The results obtained have been generated on the “STS…
In this post we are going to talk about how DBT integrates with Spark and how this integration can be useful for us. DBT is a framework that facilitates the design of data modeling throughout the different data modeling cycles.…
What is a digital twin? When we talk about digital twins, we are mainly referring to a virtual representation of a physical system, where a copy (twin) of the real environment is reproduced using the information (Big Data) that affects…
Apache Airflow is an open source tool for workflow orchestration widely used in the field of data engineering. You can take a look at this other blog post where we made an introduction to Basics on Apache Airflow. In this…
As we do every year, at Damavis we organize meetings where we can get together as a team to get away from the routine of teleworking and do something different. And, this May, it was time to meet again and…
The kernel trick is a typical method in machine learning to transform data from an original space to an arbitrary Hilbert space, usually of higher dimensions, where they are more easily separable (ideally, linearly separable). This technique is the basis…
This post is about the impact that blocking code can have on an application and the importance of using libraries that natively support asynchronous programming. The goal is to understand that a blocking call is always blocking. In the article,…
Despite the uncertainty of 2023 regarding growth in the technology sector, data from a barometer on employability and digital talent has shown an increase in the search for talent by Spanish ICT companies. Increased demand for specialized talents The study,…