Software Engineering Stack Exchange
Software Engineering Stack Exchange

Questions tagged [message-queue]

A message queue is a service that receives events or messages from producers and provides them to consumers.

A message queue is a service that receives events or messages from producers and provides them to consumers.

See also:

248 questions
46
votes
2 answers

When to use Advanced Message Queuing Protocol like RabbitMQ?

Can somebody explain me in what use-cases I should consider using AMQP like e.g. RabbitMQ? What are the pros and cons?
vbd
  • 815
  • 2
  • 8
  • 11
40
votes
1 answer

Why database as queue so bad?

I've just read this article, and I'm confused. Let's imagine 1 webapp and 1 distinct application acting as "worker", both sharing the same database. Oh, I said "sharing"..but what does the article warns about? : Fourthly, sharing a database between…
Mik378
  • 3,838
  • 7
  • 33
  • 60
33
votes
3 answers

How to implement a message queue over Redis?

Why Redis for queuing? I'm under the impression that Redis can make a good candidate for implementing a queueing system. Up until this point we've been using our MySQL database with polling, or RabbitMQ. With RabbitMQ we've had many problems - the…
djechlin
  • 2,212
  • 1
  • 15
  • 26
30
votes
5 answers

Message Queue. Database vs Dedicated MQ

I am after advice regarding message queueing. We have requirements for "jobs" to be posted to a message queue. The original suggestion was just to use a SQL Server instance and process messages from that. Everything I have read on the internet…
user1653400
  • 503
  • 1
  • 4
  • 6
26
votes
1 answer

Designing an scalable message queue architecture

I have recently started learning the nuances of scalable and enterprise computer architecture, and one of the central components is a messaging queue. In order to learn the most I can from any programming paradigm, I am trying to implement my own…
topherg
  • 561
  • 1
  • 4
  • 11
23
votes
1 answer

Does Akka obsolesce JMS/AMQP message brokers?

I spent the last week deep diving into the Akka docs and finally understand what actor systems are, and the problems that they solve. My understanding (and experience with) traditional JMS/AMQP message brokers is that they exist to provide the…
smeeb
  • 4,820
  • 10
  • 30
  • 49
23
votes
1 answer

What are the solutions to the Distributed Queue problem?

I am trying to learn more about the various ways that the problem of a Distributed Queue may be solved. So I would like know what products, services, implementations and research papers that are already out there. An implementation will face many…
Chris Vest
  • 381
  • 1
  • 2
  • 7
20
votes
4 answers

Using flat files vs database/API as a transport between a frontend and backend

I've got an application which has generated a rather heated discussion between a couple of the developers. Basically, it's split into a web layer and a backend layer. The web layer collects information by a simple web form, stashes this data as a…
Mikey T.K.
  • 403
  • 3
  • 12
17
votes
2 answers

Traditional Message Brokers and Streaming Data

According to the Kafka site: "Kakfa is used for building real-time data pipelines and streaming apps." Searching the internet far and wide, I've found the following generally-accepted definition of what "stream data" is: Stream data is data that…
smeeb
  • 4,820
  • 10
  • 30
  • 49
14
votes
3 answers

UML: Queue processor in a sequence diagram

Which is the appropriate way of representing a queue processor in a UML sequence diagram? I want to represent in the same diagram two systems that are loosely coupled through a queue. The first system, performs some actions and insert an action in a…
NullOrEmpty
  • 687
  • 2
  • 6
  • 16
10
votes
2 answers

REST or a message queue in a multi-tier heterogeneous system?

I'm designing a REST API for a three-tier system like: Client application -> Front-end API cloud server -> user's home API server (Home). Home is a home device, and is supposed to maintain connection to Front-end via Websocket or a long poll (this…
Victor Sergienko
  • 361
  • 1
  • 2
  • 13
9
votes
1 answer

Do I actually need a message broker or are websockets enough?

The website I am building has a real-time messaging component. The backend is built with Flask and I have integrated Flask-SocketIO to handle Websocket connections when users are on the messaging page. My current infrastructure is pretty simple.…
turnip
  • 1,657
  • 2
  • 15
  • 21
9
votes
5 answers

Message validation in async messaging-based services

I'm looking for information on the best approach to message validation in asynchronous-messaging-based services (i.e. services that pull messages from some sort of message queue or broker, rather than providing an HTTP-based API or something…
samfrances
  • 1,065
  • 1
  • 10
  • 15
9
votes
4 answers

Handling changes in a event-driven microservice architecture

I'm doing an research-project where I'm researching the options to handle changes in an event-driven microservice architecture. So, let's say we got an application where we got four different services. Each of these services has an own database to…
CGeense
  • 191
  • 1
  • 5
8
votes
3 answers

Message Queues and Multiple Subscribers

My team is discussing using RabbitMQ for microservice to microservice communication (among other things). We are also supporting a SAP backend that will be pushing data to us in a method undecided at this time (likely through Boomi or Idocs). We…
Marshall Tigerus
  • 550
  • 5
  • 13
1
2 3
…
16 17