Questions tagged [load-balancing]
44 questions
19
votes
4 answers
Rate limiting *un*-authenticated requests
Say we have a load balancer that also does rate limiting. Rate limiting seems pretty straightforward for logged-in users - just look at the JWT and maybe use an in-memory data-store to see how many requests in the last 10 seconds for that…
user290257
18
votes
3 answers
What does a load balancer return?
When a user hits the load balancer and the load balancer determines which web server to forward to, what happens next? Does the load balancer forward the request and all its data to the webserver, receive the webserver's response and return that…
smaili
- 291
- 2
- 5
16
votes
1 answer
Should I split my API by user type?
Let's say I have an app to manage sporting teams. Potential users have a role of 'coach', 'player', and 'fan'. In many cases they will have to make similar api calls to retrieve info like this:
/api/v1/players (retrieve all players on their…
Msencenb
- 271
- 2
- 5
8
votes
1 answer
Bottlenecks, nginx as a load balancer
Why nginx can keep itself from being a bottleneck when serving as a load balancer. If it becomes the single point bottleneck in some conditions, then is there solution except hardware load balancer?
upton
- 673
- 1
- 7
- 12
6
votes
1 answer
Optimal load distribution with maximum workload
I need to find an optimal distribution of some matching tasks on multiple jobs; each job is limited by a maximum workload and the grouped tasks should maximize the workload within the same job.
However, tasks with similar values within the same…
vanilla
- 71
- 2
5
votes
2 answers
Load Balancer / API Gateway availability or is it a single point of failure?
I'm developing a microservice system. I have a discovery service (Eureka) for all my services and an API Gateway (Zuul) to call each service via an URL.
My problem: How can I assure that a service call via my API Gateway is high available?
If the…
Milgo
- 161
- 1
- 5
4
votes
1 answer
Service discovery and load balancers with high-frequency health checks
I am trying to understand the advantages of service discovery compared to load-balancing within the context of a microservice mesh where many instances/nodes/VMs/containers of many web services are all calling each other in a complicated…
hotmeatballsoup
- 51
- 12
3
votes
0 answers
Blue-Green Deployment: how to synchronize and maintain data consistency after migration?
To provide zero downtime upgrades of my highload service I use blue green deployment strategy.
Every moment data changing happens, so how to migrate all data consistently? In the moment I switch between blue and green the data is changing.
What is…
J.J. Beam
- 461
- 1
- 4
- 7
3
votes
2 answers
Scaling a Restful Web Service Hosted in Server
We have deployed a restful web service on a application server (Apache). The volume is getting higher and we do want to scale it. We will deploy two more Apache instances on two more machines.
How do I implement a layer which sends request to each…
Learner_101
- 280
- 2
- 9
3
votes
1 answer
What is the best way to horizontally scale .Net back-end applications?
Given a workload with many long running CPU/IO intensive operations (e.g. producing multi-GB text files from database reads and business rules), what is the best way to balance .net application load across a group of Windows Server 2012 R2 VMs?…
Paul G
- 133
- 1
- 5
3
votes
2 answers
Parallelising processing of users
Update I updated my question to reflect the fact I'm working with a database.
I need to process user actions:
The actions for each user change the user's balance which is then persisted to a database.
A user's action must be processed sequentially.…
daramasala
- 273
- 2
- 7
2
votes
1 answer
Granularity of API Gateways to Service Balancers
OSS API Gateways typically come bundled with built-in load-balancing capabilities. We see this with Netflix Zuul and Kong.
In a service-oriented architecture, where many microservices are talking to many others, is the idea that each service has its…
hotmeatballsoup
- 51
- 12
2
votes
4 answers
Reverse Load Balancer: Out Balancer?
Load balancing in is a common topic, but there isn't as much said about load balancing out. I may have an application that can prepare 1mm requests/s but is unable to send them all out at that speed because of network restraints.
Is there a concept…
micah
- 195
- 2
2
votes
1 answer
Deliver message to websocket client connected through load balancer
The problem
I have a number of clients connected via websocket to nodes of my web application through a load balancer. What I need is to deliver notifications on a per-user basis.
My idea
My idea is to have each web application node connected to a…
Piero Nadello
- 31
- 4
2
votes
1 answer
How to minimize database deadlocks in a load balanced web application?
I'm working on a web application hosted on multiple load-balanced web front ends (WFEs). This application has an API method that performs a database query and returns the results. This query only performs reads. There is a single database server.
We…
Alex Angas
- 681
- 1
- 8
- 19