Data deduplication is a problem that affects many organisations. In addition to negatively impacting business operations, it can also affect costs. In this article, we will analyse what it entails and what architecture to implement in a project of this…
Kafka is one of the most popular technologies in the Apache stack, which we have already explored in our blog. If you are not yet familiar with it, we recommend reading Introduction to Apache Kafka to learn about its main…
What is Apache Kafka? Apache Kafka is an open source distributed event system. It was originally developed by LinkedIn, in order to cover the needs caused by its rapid growth, and moved to a microservices-based infrastructure. It is also an…
Batch processing is a methodology widely used in the world of Big Data. Throughout this post, we will analyse how technologies typically used for streaming -such as Apache Kafka and Apache Spark– can ve leveraged for batch data processing. What…