Software Engineering Stack Exchange
Software Engineering Stack Exchange

Questions tagged [aws]

AWS refers to Amazon Web Services.

Further information about Amazon Web Services can be found on their website

156 questions
9
votes
3 answers

How to handle backpressure in message queue

I am designing a AWS web service which is going to get 1000 TPS from devices(Android) and it has dependency on multiple downstream services. The usecase is to hit this service periodically from device, get a piece of data and cache it in the device…
Jegan Babu
  • 201
  • 2
  • 4
9
votes
5 answers

Re-architecting CPU intensive Node application to handle multiple users

A few years ago, I wrote an application that allowed users to upload a file (it's a very specific file type) to a server. It then sends instructions to the server on how to visualise the data, and the server presents the data as either a dot plot…
Mark
  • 79
  • 8
8
votes
2 answers

DB migration strategy for docker containers in AWS ECS

I am working on creating a set of microservices in Docker (using .net core and AWS RDS as the backbone, but that is not relevant). As part of the deployment, the old container and new container co-exist for a short period of time (under 30 seconds…
zaitsman
  • 384
  • 4
  • 13
7
votes
1 answer

Invoking lambda directly from S3 vs going via SQS

I'm relatively new to AWS. I'm working with what I think is a common pattern: Put file in S3 bucket Do something with said file in Lambda function I see two options for making this link (ignoring SNS): invoke the lambda when an S3 event…
moarCoffee
  • 181
  • 2
  • 5
7
votes
1 answer

Best way to notify the client in real time that their queue (e.g. SQS) job has finished?

Current Scenario Our application allows users to upload (Amazon S3) and manage their files through our interface. Currently those users can download the files directly from S3/Cloudfront through our application. Adding a Zip feature We would like…
Slickrick12
  • 173
  • 1
  • 5
6
votes
0 answers

Getting AWS SNS Messages into Azure Service Bus

I have a similar question to one already asked about SQS to Azure Service Bus - https://stackoverflow.com/questions/51650073/consume-aws-sqs-and-publish-to-azure-service-bus. I want to get messages from AWS SNS (hosted by another party) into an…
GRoberts
  • 71
  • 3
6
votes
1 answer

Does AWS Kinesis guarantee a specific type of ordering?

From AWS documentation: A Kinesis data stream is an ordered sequence of data records. Each record in the stream has a sequence number that is assigned by Kinesis Data Streams I don't see any connection between those 2 sentences. Also, the…
Stav Alfi
  • 297
  • 3
  • 10
6
votes
2 answers

Which is the best option to exchange large amount of data in a micro-service architecture?

Application I am working on requires text contents to be extracted from various proprietary document formats like Microsoft word documents (doc, ppt, xls ), pdf and etc. I am planning to implement a micro-service which takes document in proprietary…
user2586432
  • 69
  • 1
  • 2
6
votes
3 answers

Server architecture for short bursts of ~150 parallel CPU-heavy subqueries

The client sends a query (a few hundred characters) to the web service. This query can be split into 20 to 150 subqueries with a simple regex. Those subqueries can then be computed independently and take each up to 5 seconds. Thus we'd like to have…
mb21
  • 163
  • 5
6
votes
0 answers

Rails on AWS Elastic Beanstalk - limitations

I have been looking at AWS Elastic Beanstalk service for the deploymeny of my rails application, and I came to think it was actually a bad idea given some specific requirements of my application. But then, it is still quite a pain to configure…
Cyril Duchon-Doris
  • 228
  • 1
  • 6
6
votes
4 answers

Building a distributed system on Amazon Web Services

Would simply using AWS to build an application make this application a distributed system? For example if someone uses RDS for the database server, EC2 for the application itself and S3 for hosting user uploaded media, does that make it a…
Songo
  • 6,548
  • 4
  • 48
  • 89
5
votes
1 answer

Sharding and application routing cross region on AWS

We current have a very simple Multi Tenant monolith, with a SQL SERVER backend (Self hosted on EC2 on AWS), and multiple application services talking to one DB behind an Classic AWS ELB. Our database has grown to a point now that we are considering…
Joshscorp
  • 101
  • 6
4
votes
4 answers

Do Lambdas(AWS) stop making sense after a certain number of functions?

I am working on a project and created multiple lambda functions and now I am thinking about whether I made the correct decision to go this route. Reasons I chose lambda: The App will have spiky traffic and almost no traffic at some times, so it is…
AKT
  • 149
  • 2
4
votes
2 answers

Robust way to aggregate results from 2 AWS lambdas for a SPA

I'm new to AWS serverless applications and am looking for something like ocelot request aggregation on the AWS serverless stack. Assume I have two AWS lambdas that return data needed by a SPA: A and B. They each take 1 second to run to load data…
C.M.
  • 149
  • 3
4
votes
3 answers

how to pass credentials to api gateway securely?

I have a code at my local machine, with which I want to call an AWS Lambda function. I have configured AWS API Gateway as doorway to Lambda function, but I am concerned about security when sending credentials as query string parameters. So could…
Malacophonous
  • 53
  • 3
1
2 3
…
10 11