Oct 28, 2016

Simplifying Distributed Systems Using Apache Kafka

With the rising popularity of micro service architectures and typical scaling patterns used at enterprises, distributed systems are becoming more common and complex. What was once a simple web server connected to a database now can entail multiple databases, caches and integrations to other services/systems. By using Apache Kafka one can take much of the integration complexity out of the system, reduce coupling between the different components, easily expand functionality without disruption and scale horizontally.

This presentation will cover patterns and concepts that can be used to achieve all of the above. There will be a quick overview of how Apache Kafka works, it’s differences from other messaging brokers and why that’s important. I’ll speak about the good, the bad and what was missed during my experience working with large distributed systems. Finally I’ll briefly mention other technologies that work well with Kafka.

Original slides here.

About the Author

Object Partners profile.
Leave a Reply

Your email address will not be published. Required fields are marked *

Related Blog Posts
Designing Kubernetes Controllers
There has been some excellent online discussion lately around Kubernetes controllers, highlighted by an excellent Speakerdeck presentation assembled by Tim Hockin. What I’d like to do in this post is explore some of the implications […]
React Server Components
The React Team recently announced new work they are doing on React Server Components, a new way of rendering React components. The goal is to create smaller bundle sizes, speed up render time, and prevent […]
Jolt custom java transform
Jolt is a JSON to JSON transformation library where the transform is defined in JSON. It’s really good at reorganizing the json data and massaging it into the output JSON you need. Sometimes, you just […]
Page Object Model for UI Testing