-
Notifications
You must be signed in to change notification settings - Fork 98
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
docs: upgrade dora benchmarks to 2023 version #712
Conversation
docs/Metrics/CFR.md
Outdated
|
||
| Groups | Benchmarks | DevLake Benchmarks | | ||
| ----------------- | ---------- | ------------------ | | ||
| Elite performers | 5% | 0%-5% | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I suggest updating the the DevLake Benchmarks to a preciser manner, which is:
(0, 5%]
(5%, 10%]
...
docs/Metrics/MTTR.md
Outdated
| Groups | Benchmarks | DevLake Benchmarks | | ||
| ----------------- | ---------------------------- | ---------------------------- | | ||
| Elite performers | Less than one hour | Less than one hour | | ||
| High performers | Less one day | Less than one day | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
docs/Metrics/CFR.md
Outdated
@@ -25,7 +25,17 @@ The number of deployments affected by incidents/total number of deployments. For | |||
|
|||
When there are multiple deployments triggered by one pipeline, tools like GitLab and BitBucket will generate more than one deployment. In these cases, DevLake will consider these deployments as ONE deployment and use the last deployment's finished date as the deployment finished date. | |||
|
|||
Below are the benchmarks for different development teams from Google's report. However, it's difficult to tell which group a team falls into when the team's change failure rate is `18%` or `40%`. Therefore, DevLake provides its own benchmarks to address this problem: | |||
Below are the 2023 DORA benchmarks for different development teams from Google's report. However, it's difficult to tell which group a team falls into when the team's change failure rate is `13%` or `30%`. Therefore, DevLake provides its own benchmarks to address this problem: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The correct expression should be:
However, it's difficult to tell which group a team falls into when the team's change failure rate is between 15% and 64%. Therefore, DevLake provides its own benchmarks to address this problem:
docs/Metrics/DeploymentFrequency.md
Outdated
@@ -25,7 +25,20 @@ Deployment frequency is calculated based on the number of `deployment days`, not | |||
|
|||
When there are multiple deployments triggered by one pipeline, tools like GitLab and BitBucket will generate more than one deployment. In these cases, DevLake will consider these deployments as ONE deployment and use the last deployment's finished date as the deployment finished date. | |||
|
|||
Below are the benchmarks for different development teams from Google's report. DevLake uses the same benchmarks. | |||
Below are the 2023 DORA benchmarks for different development teams from Google's report. DevLake uses the same benchmarks. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The correct expression should be:
... from Google's report. However, it's difficult to tell which group a team falls into when the team's deployment frequency is `between once per week and once per month`. Therefore, DevLake provides its own benchmarks to address this problem:
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
npm run build
andnpm run serve
locally before submitting this PRSummary
docs: upgrade dora benchmarks to 2023 version
Does this close any open issues?
Related to apache/incubator-devlake#6794
Screenshots
Other Information
Any other information that is important to this PR.