In the world of data, several programming languages are used and one of the most famous is Python. Among the multitude of tasks it can perform, it is used to read, treat or transform data, when we need to manipulate…
Apache Airflow is a free workflow orchestration software, which are created through Python scripts, and can be monitored using its user interface. Some examples of workflows in which this tool could be used are the scheduling of ETL (Extract, Transform,…
Damavis Studio is a company born in Mallorca specialized in Big Data and Artificial Intelligence technologies. The largest of the Balearic Islands is one of the most important tourism hub in Europe. At Damavis, we have had the opportunity to…
When we imagine a simple programming algorithm, it is logical to think about a succession of instructions that are executed sequentially, where the next instruction will not be executed until the one immediately preceding it has been completed. However, depending…
If part of our application is executed in an EKS cluster, either one or several availability zones, it is likely that it will be necessary to access some service through the Internet that is protected by a firewall. In these…
We end 2021 with the compilation of the news of this week 52, the last of the year, in Damavis: New post in our blog by David Martín and the latest news about Big Data and Artificial Intelligence seen in…
2021 has been a year where many things have happened very quickly at Damavis. In this last post before the arrival of 2022, we will make a summary of the contents published in our blog throughout all these months. Damavis…
We compile the most important news of week 51 at Damavis: an interview in our blog with Pedro Novas and we review the most important publications and news from our social networks. Seen in networks In addition to a new…
We make a summary of the most important news of the week 50 at Damavis: new blog post by Antonio Boutaour and the most relevant news from our social networks. Damavis Blog How to leverage Apache Kafka and Apache Spark…
How to leverage Streaming technologies like Apache Kafka and Apache Spark for Batch processing ETL process. Central piece of the Big Data project Collecting, ingesting, integrating, processing, storing and analyzing large volumes of information are the fundamental activities of a…