Questions tagged [cron]

42 questions
30
votes
8 answers

Is it reasonable to run processes with CI tools?

At my company, we have a quagmire of disparate cron jobs (on multiple systems) and manually kicked off processes which keep our business functioning that is a result of years of expedient development and subsequent neglect. Someday, we will need to…
smp7d
  • 4,201
  • 1
  • 22
  • 40
5
votes
1 answer

Are scheduled job servers the right choice for a time sensitive game engine?

I am currently architecting and designing an exciting new web application that will be entering into some areas that I have very little experience in, game development. The application is not necessarily a game, but there are some very time…
maple_shaft
  • 26,401
  • 11
  • 57
  • 131
4
votes
0 answers

Relational or non-relational database for storing and querying log data?

I'm planning to extend an application with logging of user events. (Client application via REST-API to Symfony). What is the preferred type of databases? Currently the log data is stored in a relational database along with the rest of the data.…
yellowduck
  • 57
  • 1
4
votes
2 answers

Can Time be a Primary Actor in the Hexagonal Architecture?

I really like the fundamental principles behind the Hexagonal Architecture (Ports and Adapters) and I have mostly applied it to my system/application. There is one thing that I wasn't able to completely grasp: The system needs to wake up and do…
Guven
  • 914
  • 5
  • 18
4
votes
5 answers

Cron Job Microservice

I'm implementing an application that's made of bunch of microservices. Each of them is fairly simple, focusing on its own task. Let's call two of them Service A and Service B. They are both implemented in NodeJs and expose a Rest API. Now I need to…
Matis
  • 145
  • 1
  • 4
4
votes
1 answer

How to set up a recurring job server in a Kubernetes cluster

My current task is to set up a system that pushes out notifications to specific users based on a set schedule. Having tackled the push notifications issue, I am now trying to put together a system that will actually send out those push notifications…
moberemk
  • 473
  • 2
  • 10
4
votes
1 answer

Schedule Task prevent duplicate notification

I am creating schedule tasks that run on daily basis monitor system events and send email notification based on some criteria. For example, if user subscription will expire after one month, task scheduler will detect that by comparing dates then…
user968159
  • 75
  • 1
  • 4
4
votes
4 answers

Failover for High Frequency Jobs

I have a job that runs at a fairly high frequency (~1x every second). This job needs to be executed constantly as long as the web app is running. However, I really only want 1 instance of the job running at a time. Currently, I just fire up a thread…
Jerod Venema
  • 141
  • 5
4
votes
1 answer

Converting cron schedule to time intervals

I have, on the server, many jobs defined by users and some of those jobs are scheduled using cron expressions. I need to check (I can execute Groovy/Java on the server) if those jobs take longer than they are scheduled (I mean job is taking 10…
Erki M.
  • 141
  • 1
  • 5
3
votes
0 answers

What're the necessary considerations when developing Cron Jobs (Scheduled Tasks)

I'm working on a website that has a section that shows the company's stock details and investor-related data. This data is retrieved through scheduled SOAP API calls. I created two scheduled tasks for achieving that: feth-data (every 10 minutes):…
3
votes
2 answers

Alternatives to cron jobs or other ways of improving scheduled task performance

I'm working on a social networking website where users gain ratings after specific actions taken and proper conditions are met on the tables. The ratings are calculated depending on 'total hours worked' and 'total points gained'. The cron php has an…
Ekin
  • 131
  • 1
  • 6
2
votes
3 answers

Organize and maintain a lot of cron jobs

I am working on a fairly large project written in PHP (Yii2) in which we are increasingly using cron for background tasks, such as generating caches, reports, etc. We have started to move the hourly timings by a few minutes so that they don't…
MKMarek
  • 29
  • 1
2
votes
3 answers

Should a process be responsible for scheduling itself?

I need to create a very small service which will programmatically make a database insertion once a day. As our stack primarily uses Node.js, we’re going to write a JS script responsible just for making the insertion and then ending execution. We…
2
votes
1 answer

Kubernetes cronjobs - triggering one after another completes - best practice?

I have a micro-service based system running in kubernetes bare-metal. The key aspects are: download data from a datasource nightly and add to a database get any new data from the database, run a ML algorithm to get predictions for new data…
wokiwiv
  • 21
  • 1
2
votes
1 answer

How to to design a cronjob-like requirement

I have to design a system where I need to make some processing (which might take say 10 mins). After some amount of time (say 30 mins), I need to come back and check the status of this processing and possibly stop any further processing. There…
ksprashu
  • 381
  • 2
  • 5
1
2 3