Introduction Software tests are tests that are performed on a piece of code or an entire software to validate that the behavior of the software is as expected. The main purpose of testing is to detect errors in the code…
Introduction A linear regression is a model that is used to approximate the linear relationship between a dependent variable Y and a set of independent variables X. In matrix format it can be expressed as where ε is a vector…
Introduction In this post we are going to talk about how DBT integrates with Spark and how this integration can be useful for us. DBT is a framework that facilitates the design of data modeling throughout the different data modeling…
Introduction In a previous blog article, we analyzed from a theoretical point of view which are the main libraries for data science and machine learning used by data scientists to treat data efficiently and extract its full potential. In this…
Introduction Data science is an interdisciplinary area that deals with extracting knowledge and useful information from data. Given the large amount of data generated by companies, it is important for data scientists to have tools that facilitate the manipulation, analysis…
Introduction Regression is a statistical methodology that describes the relationships between a continuous explained variable and a set of explanatory variables. In other words, regression models are able to predict the value of a dependent variable y with respect to…
Introduction Recently, the OpenAI team launched ChatGPT, a new deep learning-based conversational tool that promises to improve human-machine interaction in a variety of environments. ChatGPT is designed to understand natural language and provide consistent and relevant responses to questions or…
Introduction In the last few years, we have seen a great evolution in the Python programming language as it has gained popularity to become one of the most widely used programming languages. The involvement of the community with the development…
Introducción Since our Pentaho PDI plugin for Apache Airflow release, we have seen an industry shift towards the usage of Apache Hop for data processing. What is Apache Hop? Apache Hop started (late 2019) as a fork of Kettle PDI,…
Introduction Apache Spark is an open source framework that allows us to process large volumes of data in a distributed way. How? By dividing the large volumes of data, impossible to process in one machine, and distributing them among the…