Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: upgrade dora benchmarks to 2023 version #712

Merged
merged 5 commits into from
Feb 8, 2024

Conversation

abeizn
Copy link
Contributor

@abeizn abeizn commented Feb 4, 2024

⚠️   Pre Checklist

Please complete ALL items in this checklist, and remove before submitting

  • I have npm run build and npm run serve locally before submitting this PR
  • I have read through the Contributing Documentation

Summary

docs: upgrade dora benchmarks to 2023 version

Does this close any open issues?

Related to apache/incubator-devlake#6794

Screenshots

image
image

Other Information

Any other information that is important to this PR.


| Groups | Benchmarks | DevLake Benchmarks |
| ----------------- | ---------- | ------------------ |
| Elite performers | 5% | 0%-5% |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suggest updating the the DevLake Benchmarks to a preciser manner, which is:

(0, 5%]
(5%, 10%]
...

| Groups | Benchmarks | DevLake Benchmarks |
| ----------------- | ---------------------------- | ---------------------------- |
| Elite performers | Less than one hour | Less than one hour |
| High performers | Less one day | Less than one day |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Less than one day?
image

@@ -25,7 +25,17 @@ The number of deployments affected by incidents/total number of deployments. For

When there are multiple deployments triggered by one pipeline, tools like GitLab and BitBucket will generate more than one deployment. In these cases, DevLake will consider these deployments as ONE deployment and use the last deployment's finished date as the deployment finished date.

Below are the benchmarks for different development teams from Google's report. However, it's difficult to tell which group a team falls into when the team's change failure rate is `18%` or `40%`. Therefore, DevLake provides its own benchmarks to address this problem:
Below are the 2023 DORA benchmarks for different development teams from Google's report. However, it's difficult to tell which group a team falls into when the team's change failure rate is `13%` or `30%`. Therefore, DevLake provides its own benchmarks to address this problem:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The correct expression should be:

However, it's difficult to tell which group a team falls into when the team's change failure rate is between 15% and 64%. Therefore, DevLake provides its own benchmarks to address this problem:

@@ -25,7 +25,20 @@ Deployment frequency is calculated based on the number of `deployment days`, not

When there are multiple deployments triggered by one pipeline, tools like GitLab and BitBucket will generate more than one deployment. In these cases, DevLake will consider these deployments as ONE deployment and use the last deployment's finished date as the deployment finished date.

Below are the benchmarks for different development teams from Google's report. DevLake uses the same benchmarks.
Below are the 2023 DORA benchmarks for different development teams from Google's report. DevLake uses the same benchmarks.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The correct expression should be:

... from Google's report. However, it's difficult to tell which group a team falls into when the team's deployment frequency is `between once per week and once per month`. Therefore, DevLake provides its own benchmarks to address this problem:

Copy link
Contributor

@Startrekzky Startrekzky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Startrekzky Startrekzky merged commit 76e80a1 into main Feb 8, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants