Dogfooding Kafka: How We Built Heroku's Real-Time Platform Event Stream
The Heroku platform event stream contains events for all app deploys, all database provisions, almost any change you make to your Heroku apps, and a lot more. Distributing this firehose of data quickly and reliably using Apache Kafka allows Heroku to build new features and services with lightning speed. Learn how rethinking your services as event-driven stream processors offers a path toward a much more agile, scalable, and real-time system. We’ll talk about how we use our own product, Apache Kafka on Heroku, to host event streams which power an increasing number of new Heroku services built and operated by multiple engineering teams at once.