11

In my company, it's common not to do any intermediate build to check how each feature/bugfix branch is merged in dev. There is only daily build, which always elicit a lot of test fails and build errors. I have been told that it's unreasonable to do build for each merge for over 1000 developers.

So I searched how CI is organized in companies that have that much developers or more (Microsoft, Facebook), and found nothing. Maybe, insiders can tell me then?

Tulains Córdova
  • 39,201
  • 12
  • 97
  • 154
Megamozg
  • 256
  • 1
  • 7
  • see [Why we're not customer support for \[your favorite company\]](https://meta.stackoverflow.com/q/255745/839601) – gnat Aug 11 '17 at 12:29
  • @gnat Are you adequate? How it's related? I asked for insider experience, and pointed companies just for example. I didn't asked any customer support. – Megamozg Aug 11 '17 at 12:34
  • 11
    @gnat I don't see how it is related to that. Megamozg : CI is organized by module of projects, there is no module with 1000 developers. So if there are too much people, cut down your project/module in smaller part. – Walfrat Aug 11 '17 at 12:35
  • @Walfrat it is totally related. This site is not for making surveys / polls of big companies insiders about how their companies do various things. If one is curious about stuff like that they should use support channels of these companies – gnat Aug 11 '17 at 15:22
  • @gnat I really don't see how the link you provided applied, especially with the comment you provided in response to Walfrat. Based on that comment this IMHO would be the proper link (the part about poll type questions) https://softwareengineering.meta.stackexchange.com/a/6490/ – Newtopian Aug 11 '17 at 16:41
  • @gnat the question in the post is not the best as it was written, however the question in the title is perfectly clear and is answerable without providing opinion. And I think the question in the title cover what the OP really want more than the question in the post. – Walfrat Aug 16 '17 at 07:19

2 Answers2

12

It is, basically, a scaling problem. You separate your work into modules, which can be different projects and/or different functionalities of your product.

You would have teams that cover sets of those modules. Each of those teams would have CI cycles set up for their scopes, and only after their respective cycles would pass, the code would be pushed to master repos, where the master CI cycle would be run.

The master CI cycle will most likely differ from team level CI cycles in these aspects:

  • Team level CI cycles do not have to build the code of entire company, just those modules that they are responsible for and the dependent modules. If there are two modules that are completely independent and in different teams, they would not be part of the other team's CI cycle.
  • Team level CI cycles can have much more detailed automated tests than master CI cycle. Master CI cycle would have sanity check tests and regression tests that would, depending on the size of the master solution, be run daily or even weekly, as these tests can sometimes take more than 24 hours to execute.

What you must do with this approach is to provide automated push from local repos to central repo once the local CI cycle passes, lest your developers spend enormous amounts of time to push the code to central repos.

Vladimir Stokic
  • 2,943
  • 14
  • 25
7

In addition to what @Vladimir_Stokic said, on some teams (mine has ~150 developers), we do builds more frequently than every 24 hours. Whenever a commit occurs, we start a 5 minute timer. After the 5 minutes are up, all commits that happened during the 5 minute interval are combined and built. The build is usually an incremental build. We have a separate builder that runs unit tests for each build that occurs. After the build is finished, if there were any more commits during the build (which takes between 1 and 45 minutes depending on what changed), any pending changes are built, and so-on. We also have a nightly (clean, full) build, but the builds that happen on each commit (roughly) tell us very quickly whether any tests fail.

user1118321
  • 4,969
  • 1
  • 17
  • 25