Add Prom/Grafana dashboard for M3DB as well as docker-compose for local development of m3-stack #939
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,3 @@ | ||
| FROM grafana/grafana:latest | ||
|
|
||
| COPY ./docker/grafana/datasource.yaml /etc/grafana/provisioning/datasources/datasource.yaml |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,5 @@ | ||
| datasources: | ||
| - name: Prometheus | ||
| type: prometheus | ||
| access: proxy | ||
| url: http://prometheus01:9090 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -18,7 +18,7 @@ RUN cd /go/src/github.com/m3db/m3/ && \ | |
| FROM alpine:latest | ||
| LABEL maintainer="The M3DB Authors <[email protected]>" | ||
|
|
||
| EXPOSE 2379/tcp 2380/tcp 7201/tcp 7203/tcp 9000-9004/tcp | ||
|
|
||
| COPY --from=builder /go/src/github.com/m3db/m3/bin/m3dbnode /bin/ | ||
| COPY --from=builder /go/src/github.com/m3db/m3/src/dbnode/config/m3dbnode-local-etcd.yml /etc/m3dbnode/m3dbnode.yml | ||
|
|
||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| f6192b8d35518098fbb645ffd807a53749ffb00e | ||
|
There was a problem hiding this comment. Don't think this should be here, might be a good idea to regenerate your tokens too There was a problem hiding this comment. Yeah I deleted the access token, thanks. There was a problem hiding this comment. Was actually deleted before I accidentally pushed it here, but I'll reach out to GitHub support as well There was a problem hiding this comment. OK just verified the access token doesn't work by running: which returned So I must have deleted the token awhile back before it ever made it into this P.R We're good 👍 There was a problem hiding this comment. Yeah just make sure you delete the token in GH settings and should be good There was a problem hiding this comment. wanna delete this file now? |
||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,12 @@ | ||
| # Local Development | ||
|
There was a problem hiding this comment. mind linking a new section in https://github.com/m3db/m3/blob/master/DEVELOPER.md to this page |
||
|
|
||
| This docker-compose file will setup the following environment: | ||
|
|
||
| 1. 3 M3DB nodes with a single node acting as an EtcD seed | ||
|
|
||
| 2. 1 M3Coordinator node | ||
| 3. 1 Grafana node (with a pre-configured Prometheus source) | ||
| 4. 1 Prometheus node that scrapes the M3DB/M3Coordinator nodes and writes the metrics to M3Coordinator | ||
|
|
||
| ## Usage | ||
|
|
||
| Use the `start.sh` and `stop.sh` scripts | ||
|
There was a problem hiding this comment. nit: Maybe give these scripts more descriptive names? |
||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,212 @@ | ||
| coordinator: | ||
|
There was a problem hiding this comment. re: dbnode_config.yaml and coordinator config here - i'm a little concerned about the duplication of configs - it's one more thing to keep in sync. Anyway we can merge with others we already have? There was a problem hiding this comment. Already sync'd with @robskillington and this is the best we can do for now until we can get some kind of templating system, I already did some kind of weird stuff to avoid having 3 different m3db configs |
||
| listenAddress: | ||
| type: "config" | ||
| value: "0.0.0.0:7201" | ||
|
|
||
| metrics: | ||
| scope: | ||
| prefix: "coordinator" | ||
| prometheus: | ||
| handlerPath: /metrics | ||
| listenAddress: 0.0.0.0:7203 # until https://github.com/m3db/m3/issues/682 is resolved | ||
| sanitization: prometheus | ||
| samplingRate: 1.0 | ||
| extended: none | ||
|
|
||
| db: | ||
| logging: | ||
| level: info | ||
|
|
||
| metrics: | ||
| prometheus: | ||
| handlerPath: /metrics | ||
| sanitization: prometheus | ||
| samplingRate: 1.0 | ||
| extended: detailed | ||
|
|
||
| listenAddress: 0.0.0.0:9000 | ||
| clusterListenAddress: 0.0.0.0:9001 | ||
| httpNodeListenAddress: 0.0.0.0:9002 | ||
| httpClusterListenAddress: 0.0.0.0:9003 | ||
| debugListenAddress: 0.0.0.0:9004 | ||
|
|
||
| hostID: | ||
| resolver: environment | ||
| envVarName: M3DB_HOST_ID | ||
|
|
||
| client: | ||
| writeConsistencyLevel: majority | ||
| readConsistencyLevel: unstrict_majority | ||
| writeTimeout: 10s | ||
| fetchTimeout: 15s | ||
| connectTimeout: 20s | ||
| writeRetry: | ||
| initialBackoff: 500ms | ||
| backoffFactor: 3 | ||
| maxRetries: 2 | ||
| jitter: true | ||
| fetchRetry: | ||
| initialBackoff: 500ms | ||
| backoffFactor: 2 | ||
| maxRetries: 3 | ||
| jitter: true | ||
| backgroundHealthCheckFailLimit: 4 | ||
| backgroundHealthCheckFailThrottleFactor: 0.5 | ||
|
|
||
| gcPercentage: 100 | ||
|
|
||
| writeNewSeriesAsync: true | ||
| writeNewSeriesLimitPerSecond: 1048576 | ||
| writeNewSeriesBackoffDuration: 2ms | ||
|
|
||
| bootstrap: | ||
| bootstrappers: | ||
| - filesystem | ||
| - peers | ||
| - commitlog | ||
| - uninitialized_topology | ||
| fs: | ||
| numProcessorsPerCPU: 0.125 | ||
|
|
||
| cache: | ||
| series: | ||
| policy: lru | ||
|
|
||
| commitlog: | ||
| flushMaxBytes: 524288 | ||
| flushEvery: 1s | ||
| queue: | ||
| calculationType: fixed | ||
| size: 2097152 | ||
| blockSize: 10m | ||
|
|
||
| fs: | ||
| filePathPrefix: /var/lib/m3db | ||
| writeBufferSize: 65536 | ||
| dataReadBufferSize: 65536 | ||
| infoReadBufferSize: 128 | ||
| seekReadBufferSize: 4096 | ||
| throughputLimitMbps: 100.0 | ||
| throughputCheckEvery: 128 | ||
|
|
||
| repair: | ||
| enabled: false | ||
| interval: 2h | ||
| offset: 30m | ||
| jitter: 1h | ||
| throttle: 2m | ||
| checkInterval: 1m | ||
|
|
||
| pooling: | ||
| blockAllocSize: 16 | ||
| type: simple | ||
| seriesPool: | ||
| size: 262144 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| blockPool: | ||
| size: 262144 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| encoderPool: | ||
| size: 262144 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| closersPool: | ||
| size: 104857 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| contextPool: | ||
| size: 262144 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| segmentReaderPool: | ||
| size: 16384 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| iteratorPool: | ||
| size: 2048 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| fetchBlockMetadataResultsPool: | ||
| size: 65536 | ||
| capacity: 32 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| fetchBlocksMetadataResultsPool: | ||
| size: 32 | ||
| capacity: 4096 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| hostBlockMetadataSlicePool: | ||
| size: 131072 | ||
| capacity: 3 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| blockMetadataPool: | ||
| size: 65536 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| blockMetadataSlicePool: | ||
| size: 65536 | ||
| capacity: 32 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| blocksMetadataPool: | ||
| size: 65536 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| blocksMetadataSlicePool: | ||
| size: 32 | ||
| capacity: 4096 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| identifierPool: | ||
| size: 262144 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| bytesPool: | ||
| buckets: | ||
| - capacity: 16 | ||
| size: 524288 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| - capacity: 32 | ||
| size: 262144 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| - capacity: 64 | ||
| size: 131072 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| - capacity: 128 | ||
| size: 65536 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| - capacity: 256 | ||
| size: 65536 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| - capacity: 1440 | ||
| size: 16384 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
| - capacity: 4096 | ||
| size: 8192 | ||
| lowWatermark: 0.7 | ||
| highWatermark: 1.0 | ||
|
|
||
| config: | ||
| service: | ||
| env: default_env | ||
| zone: embedded | ||
| service: m3db | ||
| cacheDir: /var/lib/m3kv | ||
| etcdClusters: | ||
| - zone: embedded | ||
| endpoints: | ||
| - m3db_seed:2379 | ||
| seedNodes: | ||
| initialCluster: | ||
| - hostID: m3db_seed | ||
| endpoint: http://m3db_seed:2380 | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,75 @@ | ||
| version: "3.5" | ||
| services: | ||
| m3db_seed: | ||
| networks: | ||
| - backend | ||
| build: | ||
| context: ../../../ | ||
| dockerfile: ./docker/m3dbnode/Dockerfile | ||
| image: m3dbnode01:latest | ||
| volumes: | ||
| - "./dbnode_config.yml:/etc/m3dbnode/m3dbnode.yml" | ||
| environment: | ||
| - M3DB_HOST_ID=m3db_seed | ||
| m3db_data01: | ||
| networks: | ||
| - backend | ||
| build: | ||
| context: ../../../ | ||
| dockerfile: ./docker/m3dbnode/Dockerfile | ||
| image: m3dbnode02:latest | ||
| volumes: | ||
| - "./dbnode_config.yml:/etc/m3dbnode/m3dbnode.yml" | ||
| environment: | ||
| - M3DB_HOST_ID=m3db_data01 | ||
| m3db_data02: | ||
| networks: | ||
| - backend | ||
| build: | ||
| context: ../../../ | ||
| dockerfile: ./docker/m3dbnode/Dockerfile | ||
| image: m3dbnode03:latest | ||
| volumes: | ||
| - "./dbnode_config.yml:/etc/m3dbnode/m3dbnode.yml" | ||
| environment: | ||
| - M3DB_HOST_ID=m3db_data02 | ||
| coordinator01: | ||
| expose: | ||
| - "7201" | ||
| - "7203" | ||
| - "7208" | ||
|
|
||
| ports: | ||
| - "0.0.0.0:7201:7201" | ||
| - "0.0.0.0:7203:7203" | ||
| - "0.0.0.0:7208:7208" | ||
|
|
||
| networks: | ||
| - backend | ||
| build: | ||
| context: ../../../ | ||
| dockerfile: ./docker/m3coordinator/Dockerfile | ||
| image: m3coordinator01:latest | ||
| volumes: | ||
| - "./:/etc/m3coordinator/" | ||
| prometheus01: | ||
| expose: | ||
| - "9090" | ||
| ports: | ||
| - "0.0.0.0:9090:9090" | ||
| networks: | ||
| - backend | ||
| image: prom/prometheus:latest | ||
| volumes: | ||
| - "./:/etc/prometheus/" | ||
| grafana2: | ||
| build: | ||
| context: ../../../ | ||
| dockerfile: ./docker/grafana/Dockerfile | ||
| expose: | ||
| - "3000" | ||
| ports: | ||
| - "0.0.0.0:3000:3000" | ||
| networks: | ||
| - backend | ||
| image: grafana/grafana:latest | ||
| networks: | ||
| backend: | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,47 @@ | ||
| listenAddress: | ||
| type: "config" | ||
| value: "0.0.0.0:7201" | ||
|
|
||
| metrics: | ||
| scope: | ||
| prefix: "coordinator" | ||
| prometheus: | ||
| handlerPath: /metrics | ||
| listenAddress: 0.0.0.0:7203 # until https://github.com/m3db/m3/issues/682 is resolved | ||
| sanitization: prometheus | ||
| samplingRate: 1.0 | ||
| extended: none | ||
|
|
||
| clusters: | ||
| - namespaces: | ||
| - namespace: prometheus_metrics | ||
| type: unaggregated | ||
| retention: 48h | ||
| client: | ||
| config: | ||
| service: | ||
| env: default_env | ||
| zone: embedded | ||
| service: m3db | ||
| cacheDir: /var/lib/m3kv | ||
| etcdClusters: | ||
| - zone: embedded | ||
| endpoints: | ||
| - m3db_seed:2379 | ||
| writeConsistencyLevel: majority | ||
| readConsistencyLevel: unstrict_majority | ||
| writeTimeout: 10s | ||
| fetchTimeout: 15s | ||
| connectTimeout: 20s | ||
| writeRetry: | ||
| initialBackoff: 500ms | ||
| backoffFactor: 3 | ||
| maxRetries: 2 | ||
| jitter: true | ||
| fetchRetry: | ||
| initialBackoff: 500ms | ||
| backoffFactor: 2 | ||
| maxRetries: 3 | ||
| jitter: true | ||
| backgroundHealthCheckFailLimit: 4 | ||
| backgroundHealthCheckFailThrottleFactor: 0.5 |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
do you need this change once you delete the file?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is where goreleaser expects it to be so might save someone else the trouble
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
meh separate PRs mate =P
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
fiiiiiine haha