Dashboard for metrics

[captn3m0]

At @sdslabs, I've worked on a publicly visible dashboard that lets us monitor metrics for various apps. Its not available online, so here's a screenshot:

Its based on shopify/dashing, which is a ruby+sinatra based framework for building dashboards. We track all sorts of metrics, including facebook likes (which is useless) to number of people watching our live stream, which helps us a lot.

Since I've worked on this before, I'd be willing to do this for gratipay as well. Would something like this be useful? If yes, let me know what metrics you'd like to track. Metrics should be aggregate preferably as that leaves less scope for privacy leaks.

A few suggestions:

• Commit counts
• Issues closed/open in freshdesk
• Visitor count?
• Money transfered via gratipay (perhaps even across categories such as CC/paypal/bitcoin)
• More analytics metrics such as bounce rates

Some of these would require API endpoints in the main app, and some would require integrations with github etc.

[Changaco]

We already have a Librato Dashboard for metrics that are of interest to developers, and the Stats page for metrics that can be of interest to Gratipay users in general.

[chadwhitacre]

@captn3m0 The pain point I'm feeling right now is related to queues. I would appreciate a table on that page that gave me numbers for the following queues:

• open support tickets (from Freshdesk)
• open issues (across all repos)
• open PRs not ready for review (across all repos: ~Review where that label exists; none otherwise)
• open PRs ready for review (across all repos: Review where that label exists; all otherwise)
• open security issues (security label across all repos + security repos)
• open violations issues

[captn3m0]

A few queries:

• would a breakdown for open issues be helpful (say top 3 repos as well)
• security repos are private, so I'm guessing an org-wide token would be needed
• How are the current stats generated? Is it on a cron?

[chadwhitacre]

How are the current stats generated?

Which stats are you referring to? The Librato dashboard consumes log output via a Heroku log drain. The stats page does database queries.

would a breakdown for open issues be helpful (say top 3 repos as well)

Yes.

security repos are private, so I'm guessing an org-wide token would be needed

Yes, we'll configure that in the process environment during deployment.

[chadwhitacre]

This should actually go under /appendices/queues rather than inline on the Manage Queues howto. You can either implement inline as a simplate, or a standalone service that we iframe in (see other examples).

[chadwhitacre]

I want to be able to click through to the queues themselves.

[captn3m0]

I'm not that good at python, so I'm thinking I'll expose it as a json/jsonp endpoint in a simple app. I'll start working on it.

[chadwhitacre]

Let's have groupings in the table for Support, Review, WIP, and Issues. Here's a sketch:

Support	10
Review	10
repo-1	5
repo-2	3
repo-3	1
repo-4	1
WIP	20
repo-1	10
repo-2	6
repo-3	2
repo-4	2
Issues	500
security	4
violations	1
repo-1	450
repo-2	40
repo-3	3
repo-4	2

[chadwhitacre]

!m @captn3m0

Thanks! :-)

[captn3m0]

I'm thinking it makes sense to link these to site-wide search results where needed (multi repo results) and direct repo search when it makes sense.

For eg security count would be site-wide search. Now looking at http://freshdesk.com/api

[chadwhitacre]

I'm thinking it makes sense to link these to site-wide search results where needed (multi repo results) and direct repo search when it makes sense.

Yup, sounds good.

[captn3m0]

Putting links here for documentation:

• List of open security issues in all gratipay repos - Will hopefully include private repos as well
• Freshdesk list of tickets - Doesn't seem to include number of tickets. Might have to paginate

Can someone think of any other providers (other than github/freshdesk) that we might need?

[chadwhitacre]

@captn3m0 You should see an invite to Freshdesk. Once you sign in you should have access to the support queue (but not the other queues in Freshdesk, we'll handle those later).

[captn3m0]

Could you clarify what WIP means? Is it PRs tagged with 3 - Work in Progress label?

[chadwhitacre]

Yup! :-)

[chadwhitacre]

This has gone cold. Closing.