Software Engineering Stack Exchange
Software Engineering Stack Exchange

Questions tagged [analytics]

Analytics is the discovery and communication of meaningful patterns in data.

Analytics is similar to data mining and typically involves looking for patterns such as the following:

  • Certain classes of users performing certain actions. For example, perhaps a specific demographic group makes more in-app purchases in a mobile game.
  • Certain data is requested at various times. For example, before a new movie is released in theaters, users stream previous or similar movies.
  • Customers who view or purchase one type of item subsequently purchase related items (sign in to Amazon for endless examples of this).

Analytics involve searching through large quantities of data to look for common threads which can then be used for a variety of purposes from predicting future customer behavior (sales), to developing new products that customers may want, to offering new services or new ways of paying for or acquiring digital content.

38 questions
7
votes
1 answer

What's the best way to track web application deployments in analytics?

I'm close to opening up access to a web application that I've built, and I wanted to make sure that I can link updates to the app to errors, or other changes in analytics data. My first thought was to put the current git ref in a custom variable…
bigblind
  • 1,415
  • 1
  • 13
  • 17
6
votes
3 answers

Why is it rare to collect analytics/usage data in open source software?

So, I've been developing some analytic software at my work and also have started to take more notice to analytics in general. For instance, I recently installed Google Analytics on my blog(which is custom and open source). I mostly make open source…
Earlz
  • 22,658
  • 7
  • 46
  • 60
5
votes
3 answers

What time series database can support high cardinality?

I have a situation where I want to track page views, click events, etc. in a time series database but am having scalability issues in the case where I want to retrieve aggregated groups of data that has very high cardinality. The problems I'm…
AnonymousCoward
  • 69
  • 5
5
votes
2 answers

Analytics Architecture for Multiple APIs

We’re building a platform of different APIs (every API is written by different team, different timezone). We want to implement unified analytics for all of the APIs to have one data lake as a single source of truth. We are using Apigee as our API…
user2919190
  • 59
  • 1
5
votes
1 answer

How to introduce Google Analytics code in a modular way?

We are working on a very large codebase. It's basically a web-based operating system, with its own file system and applications. The system's UIs are generated dynamically with Javascript. We've decided to introduce Google Analytics to track…
Stas Bichenko
  • 3,689
  • 4
  • 24
  • 32
4
votes
2 answers

How to show fluctuating data smoothly and accurately?

I am working on a project in which I have to read data from liquid level sensor installed in tank which measures fluid level and sends output in millivolt. The device has predefined ranges of voltage to decide fluid level from voltage. The tank…
Kashyap Kansara
  • 159
  • 4
4
votes
1 answer

Architecture for Real Time data processing

I'm looking at building out the architecture for the following, and wanted to see what others think about it. Assume that the system is running some non-trivial algorithm (so it's not simply a sum of something etc.) on the data collected on each…
kozyr
  • 141
  • 2
4
votes
3 answers

Should we reuse web app logs for user behaviour analytics?

Our web app generates a large amount of logs. These logs include both events regarding background operations in the app (data arrives from the server, ajax failures, inter-component communication, etc.); and also user initiated actions (user clicked…
EyalAr
  • 223
  • 2
  • 5
4
votes
1 answer

Best practices for dashboard of near real-time analytics

I’m currently building a dashboard to view some analytics about the data generated by my company's product. We use MySQL as our database. The SQL queries to generate the analytics from the raw live data can be a bit complicated and take long time to…
Julien
  • 141
  • 3
3
votes
1 answer

How can I track who invited who to install?

After a user invites their contacts from within my app, I want to send the first user a notification "so and so installed the app, you can now connect with them." So when a user invites someone, I send the invitee a link to my landing page, with a…
Dingredient
  • 375
  • 3
  • 9
3
votes
3 answers

Big Data: Can it be pre-processed?

My question is about "big data". Basically, big data involves the analysis of a large amount of data to make meaningful insights from it. I would like to know: Whether or not large amounts of data can be pre-processed? (like say for example you are…
Joe
  • 608
  • 3
  • 9
2
votes
1 answer

Are Timeseries Databases useful for non-numerical data?

I have a huge time series (about 30 million) of network paths with the following format: timestamp, path, latency The path is a sequence of IP address, so it can be represented either as a string or an array of integers. Currently the data are…
Vasilis
  • 239
  • 1
  • 7
2
votes
2 answers

What are the some common practices for storing and accessing data for analytics?

If you need to access application information from a database for analytics, is it better to copy the information first and analyse the copy or is it okay to analyse the data retrieved fresh from the application database?
irl_irl
  • 129
  • 4
2
votes
1 answer

Near real-time analytics from Cassandra with frequent updates

We have an activity metrics page where users can select a date period and see other user's aggregated activity (by action) and optionally filter everything by 4 or 5 fields. Actions happen sequentially, but one of the fields is "Tags" and the user…
Federico Pugnali
  • 129
  • 2
2
votes
2 answers

How to perform summary analytics on production databases?

I want to use production data to generate "user activity" metrics. My thought is to set up a cron job that regularly reads production databases to summarize user activity and then stores the results in a separate metrics database. This metrics…
another_user10293412
  • 163
  • 4
1
2 3