YDB Topics - Kafka-compatible message broker from Yandex
Advantages of YDB Topics
Automatic balancing
Unlike Apache Kafka:
- When recovering after failures, partition leaders are evenly distributed across nodes
- Partition replica rebalancing on new nodes is fully automated
- Resource control during replication
Security
- Workloads from different users do not interfere with each other, thanks to a flexible quota system
- Full hierarchical role-based model (RBAC) for granting access to teams and departments
Reliability
- ACID transactions between topics and YDB tables ensure consistency
- If any broker fails, reading resumes in less than 200ms
- Withstands failure of one data center and one server rack
- Full availability for writes
Message broker for organizations with large amounts of data
Fast and convenient development
- ACID transactions between topics and YDB tables instead of Transactional outbox
- Exactly once write guarantees to prevent data duplication when sending to the broker
- Easy migration thanks to compatibility with Apache Kafka
Convenient administration
- A single cluster for hundreds of teams and projects
- Administrators don’t spend time on manual scaling
Secure data handling
- Hierarchical role model and audit logs
- Protection against noisy neighbors and DDoS, thanks to a flexible quota system
