Abstract: LinkedIn is building massive and complex data pipelines based on its Pub/Sub system, Kafka. Kafka uses topics to categorize data. The number of topics can grow organically depending on business needs, but Kafka itself doesn't have a mechanism to detect and delete unused topics.
19-19 January 2023