0

Software packages usually get a label for stability, like 'alpha', 'beta', or 'stable', next to their version string.

It seems the most used metric to decide which stage a package belongs to is the number of issues reported by its users per unit of time (be it a week, a month, or a quarter).

But this strikes me as undefined when a package has just been developed and released: there are no users yet, and it is difficult to win the users' confidence if the package has a big 'alpha status' written all over it.

Reported issues may also be a good measure for open source packages with (potentially) a wide audience, but what happens to small projects developed in-house for internal use within a company? Or for niche audiences, like audio processing or astronomy simulations? What if a project never attracts enough users, should it be considered forever 'alpha', or is it enough that its authors have used it for their intended purposes and the package did what it was supposed to do?

In summary, I would like to ask if there is an alternative metric for software stability that I am not aware of. Preferably a widely used metric, and one that avoids such pitfalls as I have described further up.

gnat
  • 21,442
  • 29
  • 112
  • 288
logc
  • 2,190
  • 15
  • 19
  • I am not even sure that there are *useful* metrics in general for software. YMMV. – Basile Starynkevitch Mar 04 '15 at 12:15
  • 2
    In terms of `alpha` and `beta` it's not **stability** that's generally important, but whether or not the test version is **feature complete**. See e.g. http://en.wikipedia.org/wiki/Software_release_life_cycle. Do you have a reference for *"It seems the most used metric..."*? – jonrsharpe Mar 04 '15 at 12:17
  • 1
    @jonrsharpe very valid point. However feature completeness seems to be the boundary at which 'alpha' goes into 'beta', while 'may contain known or unknown bugs' is the boundary between 'beta' and 'release'. So the terminology has to do something with stability, in the current usage. – logc Mar 04 '15 at 12:26
  • 1
    @logc virtually all software *always* falls into *"may contain unknown bugs"*! – jonrsharpe Mar 04 '15 at 13:34
  • @jonrsharpe I am quoting your quote :) see the reference number 3 ("Beta Test Management Glossary") on the Wikipedia article you linked. – logc Mar 04 '15 at 13:56

0 Answers0