Messaging terms

8 terms of 1506 total

📨 Decoupling systems through reliable, async communication

Asynchronous messaging decouples producers from consumers and makes distributed systems more resilient. This category covers message queues, pub/sub patterns, event streaming with Kafka, delivery guarantees, dead letter queues, and the architecture patterns that make event-driven systems robust at scale. When you need services to communicate without depending on each other's availability, messaging is the answer.

More on Messaging history · 6 references · key concepts

History

Messaging emerged as a critical architectural pattern in distributed systems during the 1980s and 1990s, when enterprises needed reliable asynchronous communication between decoupled applications. Early message-oriented middleware (MOM) systems like IBM MQ and TIBCO enabled guaranteed delivery and decoupling, becoming foundational for enterprise integration. The rise of internet-scale applications in the 2000s drove demand for higher-throughput, distributed messaging systems, leading to open-source platforms like RabbitMQ (2007) and Apache Kafka (2011), which fundamentally changed how organizations handle event streams and real-time data. Modern messaging practice has evolved to encompass diverse patterns—pub/sub, event sourcing, CQRS, and saga patterns—addressing challenges in microservices architectures, distributed transactions, and asynchronous workflows. Today, messaging is essential infrastructure for cloud-native systems, event-driven architectures, and real-time data processing pipelines.

Key concepts

Message Queue
Message Broker
Pub/Sub Pattern
Message Ordering Guarantees
At-Least-Once Delivery
Consumer Groups
Message Idempotency
CQRS Pattern

Best references

Apache Kafka Documentation Official reference for Kafka architecture, APIs, and operational concepts. Essential for understanding partitions, consumer groups, delivery semantics, and replication.
RabbitMQ Official Documentation Authoritative guide to RabbitMQ messaging patterns, exchanges, queues, and reliability features. Core resource for understanding traditional message broker design.
Enterprise Integration Patterns by Gregor Hohpe & Bobby Woolf Seminal reference covering message queues, pub/sub, routing, transformation, and other foundational patterns. The canonical taxonomy for messaging system design.
Protocol Buffers Documentation Official specification for Protocol Buffers serialization format. Essential for understanding modern message serialization alongside Avro.
CQRS and Event Sourcing by Microsoft Authoritative explanation of CQRS pattern and its relationship to event-driven messaging architectures, with practical examples and trade-offs.
The Saga Pattern (Chris Richardson) Definitive resource on the Saga pattern for distributed transactions using messaging, distinguishing choreography and orchestration approaches.