Diving Into Spark 2.1.0 Blacklisting Feature
Disclaimer: What I am about to talk about is an experimental Spark feature. We are about to dive into an implementation detail, which is subject to change...
Recent Posts
MutableList And The Short Path To A StackOverflowError
When working with collections in Scala, or any other high level programming language, one does not always stop to think about the underlying implementation o...
The Case Of The Immutable Map and Object Who Forgot To Override HashCode
Disclaimer: What we’re about to look at is an implementation detail valid for the current point in time, and is valid for Scala 2.10.x and 2.11.x (not sur...
Exploring Stateful Streaming with Apache Spark
Update (01.08.2017): Spark v2.2 has recently come out with a new abstraction for stateful streaming called mapGroupsWithState which I’ve recently blogged abo...