When processing data we often find ourselves in a situation where we want to calculatevariables over certain subset of observations. For example, we might be interested in theaverage value per group or the maximum value for each group. The groupBy functionavailable in many programming or consulting programs allows us to do these calculations easily, simply … Continue reading The use of Window in Apache Spark