Introduction In other discussion spaces we elaborated a comparison between DBT, Pentaho and Spark to perform data transformations. In this post, we will look at some of the key concepts of DBT: models, snapshots and materializations. In the context of…
Introduction In two previous posts we introduced the basic concepts of Fuzzy Logic and linear programming with the Simplex method. As promised, in this post we are going to join these two concepts and introduce fuzzy linear programming. In many…
Introduction BigQuery has become in recent years a powerful tool for data storage and analysis in the cloud. Its size, scalability and all the features it offers would be difficult for a user or company to replicate from scratch due…
Introduction Modeling and explaining the consumer behavior of a product is very important to know what factors affect their behavior, price being one of these important factors. Let’s take as an example a company X that sells clothing. It is…
Introduction Software tests are tests that are performed on a piece of code or an entire software to validate that the behavior of the software is as expected. The main purpose of testing is to detect errors in the code…
Introduction A linear regression is a model that is used to approximate the linear relationship between a dependent variable Y and a set of independent variables X. In matrix format it can be expressed as where ε is a vector…
Introduction We know that there is a large number of products in the data engineering ecosystem to perform the data processing of a company and that most of them provide the necessary tools to be able to perform many types…
Introduction All graphics in this article are interactive due to the nature of trying to represent text graphically. To see which sentence each point represents, simply hover the mouse over it. The results obtained have been generated on the “STS…
Introduction In this post we are going to talk about how DBT integrates with Spark and how this integration can be useful for us. DBT is a framework that facilitates the design of data modeling throughout the different data modeling…
What is a digital twin? When we talk about digital twins, we are mainly referring to a virtual representation of a physical system, where a copy (twin) of the real environment is reproduced using the information (Big Data) that affects…